It really isnt though... I mean, there's times when a right fielder has to run to back up first base on a grounder to 3rd, or a 1st baseman being the cutoff man to home on a throw from the outfield. A lot of people dont like baseball, or golf, or football on TV because there is a lot of stoppage and youre not engaged because youre not there.
If someone who was extremely bored by golf or baseball, went to the final round of the Masters or the US Open, or went to any game of a World Series, I'll bet their mind will be changed after.