I'll be attending some stages, but wonder do you have to be strictly to the spectator areas?

For example here - https://i.imgur.com/XvEvuzZ.png

Green are where spectator areas are, could I walk along (well in advance, of course) the road (or through forest) to the red arrows?