Eljock
I would hope that a bit of common sense would be applied in yours & similar cases. If there are five of you and four have the bands, I doubt very much that you would be asked to leave. The aim of the bands originally was to stop non residents of DV coming in and using the pools, plus try and stop non payers of the community fees (of which there were many) from using the pools.
Re security, I may be wrong but I think legally the security men at the gate house cannot refuse entry to the site and that there is a general right of way to enter. The barriers and the security hut are just a deterent to anyone up to no good.