I flew at the local fireworks display by first asking security for permission. I wasn't breaking any laws at that time, just as flying over an empty stadium is not breaking a law (unless, of course, there is a local law against it).
It may not work to ask for permission, but if it does, asking...