In Australia our CASA (same as the FAA) says you should not fly above 120m (400ft) AGL which is added to your ASML height as depicted by a GPS. This means once you know your site height as shown by a GPS, you add 400 get to that figure and that is the Max. height you can fly.
A licensed UAV operator must also have a set of charts or an app called 'Ozrunways' which shows what Fly Zone are are in, the Min. height of planes can fly in relation to airports, airfields and the CTAF radio freq. of that area. Even out in the bush miles way from any airport or town, you are still flying in controlled airspace.
Those who fly for profit after acquiring a CASA issued UOC license, must also have a current Aviation Radio Operator's Certificate as issued by CASA. That hand held radio is then set on a set Mzh frequency, and every 15 minutes, whether there its a plane the sky of not, the radio op would say something like this......" UAV in operation at Boo Boo, 15 Nm SW from Boo Boo airport, not above 2500 feet, Boo Boo traffic..." I'm sure your FAA have similar rules?.
Those flying for fun do not need a license from CASA under 2kgs MTOW. But if you want make money out of your bird, you must get that license and it's not easy!
Regardless of what bird you fly, here is Oz its not above 400 ft, and no more closer than 100 ft from buildings, people etc. My RPAS training allows me to fly birds up to 7kgs and in VLOS - Virtual Line Of Sight. You must have an Observer at all times when flying an UAV. and if flying a two RC bird, you have an Observer, Polot,
CASA will be releasing a new set of UAV Regs and Rules after September 16 this year. FYI, Australia has the world's highest safety aviation standard in the world.