The Earl
For music and comedy, you can go to The Earl, which are music venues (Earl also has some decent food) and then go to Flatiron which is I think the coolest dive bar in Atlanta.
They also do comedy, making it a great spot for the Asker's interests.