One kind of fun thing to do is take the ferry across to Algiers Point and check out things over there. It's small but there are a couple little bars there. It has some of the oldest houses in New Orleans and is a historic district. It's my favorite part, not so touristy.
http://www.algierspoint.org/
OH, watch the cheesy audio at that site! lol