What would cause this?

Before you go ahead and replace the socket, take a small screwdriver and scrape the little copper connectors in the socket, re-install the bulb and check it again. It could also be you may have got a bad bulb, take one from somewhere else and see if it still doesn't work.