I've got a theory about that.It may be a little strange,but I like thinking so.I don't know if I'll be able to explain it well.However,let's try.
When you are sitting on a rocking chair you are moving,right?But you are going nowhere,because while moving up and down you're still there in the same place.In my opinion the villagers,sometimes,would like to go away from the village,to escape for a moment,especially in sad or bad circumstances,maybe just to think about it (see Ivy's father),or because they are afraid of something (see Noah,after having wondered Lucius).I think it's difficult for human being to remain always in the same little place...
This is my personal opinion,there can be a thousand others,at least :wink: