I think a chat feature makes sense for moderators, but the type of chat a mod would want should not be publicly available. If you were to implement something like this I'd either make it moderator only, or have discrete channels for users and moderators, e.g. mod.unicornoverflow.com and lounge.unicornoverflow.com

I'd also consider making posting on it a privilege based on reputation to stop it from being a spam-fest.