I think we all probably once or twice have stretched the envelope.
What is important to remember, is that these things arent high technology, even if they, with their features appears to be so, its not tested and approved like general aviation, its simply advanced toys assembled with parts from the lowest bidder.
Arguments like "what are the chances" "birdstrikes happen more often" and so on, is a sign of bad risk assessment.
No private person simply have the privilege to do risk analysis based on their own personal judgement, of what is likely going to happen or not, especially not on behalf of other peoples live and health.
The aviation safety is built on a "better safe than sorry" principal, that is also why there is close to zero accidents in that industry, compared to car accidents and other land based traffic, cause its so well organized, but a chain is no stronger than its weakest link.
No serious accident have happened yet, luckily, but we dont need to wait until it happens, before we can say "oh we were wrong" One tragic accident, is one to many.
The amount of drones are increasing every day all around the world, and sadly, there is always an idiot somewhere stretching the limits, these people are also the reason we now have all these regulations.
People have been flying RC equipment for decades, but using common sense, people dont do that anymore, allot of them care more about thrills and attention, their need to show off, or simply to stimulate your own need for excitement.
I think its too late now to stop these drones from flying everywhere, apart from some countries that already have taken action, like Sweden, where its now forbidden to fly anything with a camera on, without special permission.
It will for sure spread to other countries as well, where people cannot be controlled through regular restrictions.
If you really have to fly beyond VLOS, at least get a scanner and listen to local traffic in your area, then you will get a little better view of what is coming at you. Are you doing this professionally, then you will have to communicate with the local aerodrome or tower, so they can alert other traffic in that area.
Even just a simple phone call to the local airport prior to your mission can be enough, then you will either get a no, due to special reasons, or you will be notified of what precautions you need to take at the present time, that way the ATC can also notify other traffic in the area, when and if they request low level flights. Its a normal procedure for all low level flights, cause not even large aircrafts are always easy to spot air to air.