...while one of the moderators are doing their moderating.
I'm not entirely sure what you mean by this (how do you know what they're doing at the time?), but in any event, please make a note of the time and your IP the next time the problem occurs, and drop me a note with this information.
The more information I can collect from people, the faster I can get the issue resolved.
Thanks.