Do you have a car? I just drive out into the open countryside, where there's nobody around to get annoyed. Easy (around where I live at least) to just find a quiet side road, pull off the road, and fly.
I wouldn't dream of flying in a town or city. Far too many people around.