Well, I finally got a chance to see this thing after so many long years. And to be brief, I quite enjoyed the play. Didn't just feel like "Sesame Street with sex jokes" but something with the same heart that Jim Henson had. Would definitely recommend this to Muppet fans.
Meant to comment on this sooner. But yeah, Avenue Q is one of the funniest things ever.