Celtus,
I feel the same way. Gaming is one of the greatest hobbies ever. I am not ashamed to say that I game. When people give me "that look" I ask them if they watch television? Most reply, "yes". Then I ask if they read books. Again, "yes."
I then inform them that gaming is no different with the exception being that you are immersed into a story with the ability to make things happen. Not to mention no matter what game you play it takes problem solving to get past obstacles.
Gaming, if done in moderation, is an excellent activity that allows people to interact with those from around the county, and the world (whoever thought you could play against a human player from a different zip code from the comfort of your home?).