I see both sides of the coin here. What you say is definitely one way to look at it. And if I were upside down in my house (which I might actually be - but probably not by much) I'd look at it that way.
However, when you're in the process of finding and buying a home - it's a damned good idea to look at it as an investment. We don't live in a culture (at least not here in North Texas) where people tend to buy a house and live in it for 30 years and then give it to their kids. Most people around here see their house as a stepping-stone to the next one. In that situation, resale value in 5-8 years is a necessary factor to consider.
The problem with all these goofy loan programs is like an onion - it's just wrong on so many levels. My wife worked at a mortgage lender for almost 6 years until we had our kid last August. Believe it or not - that company is doing better in the last year and a half than they have ever done before. Why? Because all along they refused to sell homes to people who realistically could not afford them. They stayed away from the funky loan programs and rejected anyone who was trying to do something risky. So now they can't keep up with the amount of business they have - even in this recession - because all their competition went under and they're the only ones left.
Who does the blame lie with? Anyone who had anything to do with someone signing the paperwork for a home they couldn't afford. It starts with the home owner and their realtor showing them properties that they know the prospective buyer can't afford. It ends with the bank funding the check at closing and it includes every individual in between.