Is it possible to set up a Group live chat between 3-4 super users that is publicly visible?

Hi
The chat bar is working with your friends If all the 3-4 super users are a friend. Any of them can add others to the conversation by adding people in chat box
Here : prntscr.com/i1091s
Type the name of the friend and add them.

Regards

Thanks for the response. I was envisioning a chat that is immediately viewable to guests without being added to the conversation.

Hi
It seems you are looking for something related to support chat. As on a community, it depends on the members to whom they want to add in their chat.
In this case, you may look on the live chat platforms that work for guest and does not belong to the community. You can find chat extensions for Joomla on JED.

Regards