What's the hardest part of working remotely for you?

I know that a lot of people love working remotely, but I ask those who are struggling: why is that? What are things that are hard (time management, motivation, bad internet etc)?