if you do want to tweak, you have several options. You can turn down Timing to make it a little harder to time it perfectly (which can lead to less homeruns). You can also turn down Contact to affect your plate coverage and ability to make good contact (which can lead to less homeruns), or you can turn down Solid Hits but if your physical timing and user skill with the L stick is high enough, you will still hit them out.
Just depends.....I would personally wait it out a couple more games and play at least a month (30 or so games).