I think you are saying the same thing we are. The user controlled player will move on their own, unless we provide manual input (you said you take a step back).
Ideal behavior would be: If I don't touch the paddle, my user controlled player shouldn't move.