Although I don't know if anyone's confirmed that, this is my belief as well.
I do agree that it's more jarring in some stadiums though (such as behind-the-pitcher CitiField), so I understand the complaints.
If that truly is the tradeoff for solid framerate, give me the framerate every time.