It likely needed to be set exact to be in the middle of travel. But if the shifter is getting erratic enough to not repeat positions in space every time it gets moved then shifter or cable(s) can cause it.
If CVT trans I suppose there could be internal wear to cause it too, maybe even on a manual trans, on the internal shift linkage.
Historically on cars the shifting linkage from your hand all the way to inside of trans needs to be tight and work every time by going to the exact same spot needed for different gears. Then the neutral switch reads that supposedly locked in position to tell computer what gear you are in. Any looseness anywhere can mess that up, it will show in that switch first, switch either being still good or not good. Loose linkage can make a good switch appear bad.
If CVT trans I suppose there could be internal wear to cause it too, maybe even on a manual trans, on the internal shift linkage.
Historically on cars the shifting linkage from your hand all the way to inside of trans needs to be tight and work every time by going to the exact same spot needed for different gears. Then the neutral switch reads that supposedly locked in position to tell computer what gear you are in. Any looseness anywhere can mess that up, it will show in that switch first, switch either being still good or not good. Loose linkage can make a good switch appear bad.