Well, you ought to, since statistics are the most tangible way to quantify what a player accomplishes.
Take passer rating, for example. Who are the top 5 QBs in this stat?
Steve Young
Peyton Manning
Kurt Warner
Tom Brady
Joe Montana
So far that is 5 Hall of Famers (well, Warner, Brady and Manning will all eventually be there).
If you divide the list into groups, you get something close to this:
Top 20- Probably 9 Hall of Famers, assuming Big Ben never gets there.
Between 20 and 40- 6 Hall of Famers
Between 40 and 60- 5
Between 60 and 80-3
Between 80 and 100-1
How bout reception yards?
Top 5- at least 4 (Jerry Rice, Isaac Bruce, Tim Brown, and Marvin Harrison) will be in the Hall, maybe 5 if Terrel Owens gets in (remember, he is second all time in reception TDs- but of course his attitude will likely keep him out- but physically, he should be in)
The next five are James Lofton (HoF), Cris Carter (no question one of the best), Henry Ellard, Andre Reed (one of the best AFC WRs in his era), Steve Largent (HoF)
Next five: Randy Moss (he's going to the HoF...), Irving Fyrar, Art Monk (HoF), Torry Holt (he might squeeze into the Hall), Jimmy Smith (maybe not Hall worthy, but he dominated).
Next 5: Charlie Joyner (HoF), Michael Irvin (HoF), Don Maynard (HoF), Rod Smith, Kennan McCardel (2 Pro Bowls)...
etc
You get the point. Stats may not be the end all be all, but it is a little absurd to think that great stats don't generally correlate with great players.
Look at Sammy Baugh and his QB ratings were terrible. But you compare them to the people he played against and he was a GOD. The game changed, but the players with the best stats are and have always been the best players, more often than not. As Bill Parcels put it, "You are what you are."