And there's nothing wrong with it! I take detours on road trips all the time following “Historic <thing> →” signs or just because I see something interesting in the distance and want to go check it out. On a train journey I'd just have to watch them pass by.
I want to move on my schedule and convenience, I don't want to have to warp my day to day around someone else's departure schedule.