If you're the room owner in Pidgen just type /configure then un-check 'room is persistent' in the above pic.
In Spark right click configure or right click destroy room:
(And yes we realize most aren't ready to 'advertise these chat rooms to their users' until this RFE:
Bug 27700 - IM : conference room admin settings)