I guess so. Since that's what happens, even if travelling between the two is instant, for the person doing the actual travelling you lose time between them.

And did I tell you about the time I passed my dreamself in it once? Talk about weird.