Mouse can have this effect: You click somewhere to the left (say you came into the map on the right edge) it can make you move up or down first before moving left depending on the poor RPGM pathing. Example using the east district map leaving the west side you have 5 warp points going to the Government District on that side it comes out at 69,y looking like this:
View attachment 5132424
So you appear in gov dist at the level of the warps. you should have offset it by one to come in at 68,y so it looks like this:
View attachment 5132429
That way with the hideous pathing it won't trigger a teleport back to east dist by accident

the only way when using a mouse to move and avoid going back to east dist is by exactly clicking on a point directly matching the y row :/ (x column if moving north/south transfers.
Does that come across better explained?