I bought a house in NJ -- 14 miles from NYC in a beautiful little town -- and financed it in late 2012 at 3 3/8%. With such a low rate I almost feel a disincentive to pay down principle too quickly because it's such cheap money. Our property taxes are high -- about 15K a year -- but city services and amenities are good and schools are great. The public schools in NYC suck and I'd pay more than 15K for private school for my kid in the city and feel like an elitist jerk for sending him to private school. I guess it's all how you look at relative situations. People in one part of the country that have potentially lower wages and lower housing costs have just as much right to complain as people who live in another part that has higher wages and higher costs.
We all need a place to live, so if we look at our homes too much like an investment we may get disappointed. On the other hand if we look at financing a home as paying rent + a mandatory savings + a place to live, it starts to look good. I rented way below market rate (rent control) in Manhattan and then got paid a bunch of money to tear up my lease. Now I've got a home, a garage for my old Dodge and Honda + non-gridlock places to ride the bike, fresh air, quiet nights, neighbors to drink beer and wine with, a tennis court whenever I want it, a 30 minute commute to work by train, a yard for the kid and the dog, a real kitchen, a basement for playing ping pong, a washer and dryer in my house, a garden and on an on. Those things are all incredibly valuable but impossible to put a price on. So it would be really hard to do a accurate spreadsheet analysis on whether I'm getting my money's worth -- but I absolutely know I am.
Congrats to the OP on the house. Love it and make it yours, even while the bank still technical owns more of it than you do.