Coordinates are bugging out

I traveled to a dark dimension and the game will randomly decide that I’m actually in a random tavern that I’ve never visited. Whenever I go to correct the issue, the correct coordinates won’t register and the location won’t show up as an option.