Time travel, location. How will that work?

This part confuses me, if I travel forward or back in time and this planet has moved in it's orbit where does that leave me? Is there a concept or theory that allows for location? Geographic shift? I realize this is all science fiction right now, but I never heard it addressed.