Yeah, this is not great, but definitely not a game killer for me. And of course, sometimes PI is blatant in a real game and is not called so I just try to look at it that way when playing the game.
One thing I have found is that penaly slider adjustments do have a real impact. Slight changes can bring more or less penalties as you wish. I think I have mine down pretty well where I get a realistic number of penalties. The only one I have yet to see even with major slider adjustments is face-masking.