Under Part 107, it says I can fly in Class G airspace. There are plenty of houses around me, a large company, plenty of stores and shops. There's even a facility owned by the Navy in my vicinity. But I do not see anything in the rules about this (other than flying over people, moving cars...