If you weren't doing anything wrong, why were you scared? Are you afraid of helicopters? Police? Guilty conscience?
if you were in the phantom pilots shoes you might feel differently about it, something similar happened to me shortly after i purchased my P2 and it scared the hell out of me, it was shortly after the issue with the guy landing on the white house lawn. its an uncomfortable feeling to say the least, i called the FAA to report the issue with loss of separation and called to local PD filed a complaint and spoke to the pilot. i almost expected them to be at my house waiting for me when i got home. even the innocent can feel intruded opon by the local police especially after the barrage of police shootings.......