You are OK so long as you are not invading any ones privacy. Also heritage sites may have a moan but my understanding is that so long as you are not launching from their site then to over fly is lawful. The best way forward is to always seek permission from the land owner first then it keeps everyone happy. Hope this helps, I'm in Leicester UK