I find it humorous how we as Model Aircraft Operators want to be all big and tough when we talk about flying in national airspace but when it comes to regulations we don't want to fly by them. We want it to be considered a toy when it benefits us but other times we want to be Big Boys and be true aircraft.
You can NOT have it both ways. If you are going to fly in the National Airspace System you have to learn the rules of NAS, learn how to know where you are in the NAS, and understand we are at the bottom of the NAS totem pole.
The way I see it is... if our aircraft is capable of flying more than 100'AGL, it has any form or autonomous flight capabilities, and it is GPS stabilized it should be an aircraft and as such should have to follow all aircraft rules associated with the type and class.
To the OP, do you know what class of Airspace you are trying to fly in? Do you know if it's a Military Operations Area (MOA) or not? Do you happen to check to see if there are any flight restrictions in your area? If you can't positively and correctly answer every one of these questions you are indeed a part of the problem all of us are having to deal with. I am pretty sure the current state of regulations is minimal compared to what will happen when/if there is a UAS to GA/Commercial aircraft strike.
Like it or not we are hobbyists and our small aircraft will always have to give way to manned aircraft regardless if the manned aircraft is in the right or not.