This isn't a hobby to make money in, believe me. Sure, it can happen here and there, but if you aren't buying cards you really like, and buying solely for the purposes of watching it appreciate in value, what pleasure is there?
As far as the collectors who love to put the still-pristine packs on their shelves to look at rather than crack them open to play with, well... If that's what gives you pleasure, real pleasure, then go ahead, knock yourself out. But as an "investment"? You're nuts.
Same thing for people collecting uncut sheets. I have some, and they're things of beauty. But I'm hanging on to them because they have meaning for me - each one was given to me as a gift from a famous magician! I could care less if they're worth a trillion dollars or 99 cents in the future - I'm fine with it either way. Buying so many sheets that you can't even display them in your home? That's a little overboard. At the least, if they were framed and you rotated which ones were on display now and then, that would be cool. (Hell, that would be REALLY cool - it'd be like your home was a card museum/art gallery!) But owning them just to be able to say "I own this!" or "This will put my kids through college when I have kids!" is crazy.