If you've got that degree of control with a Syma. you'll have no problems with a Phantom!
I don't want to sound like too much of a goody goody, but you're breaking all the regulations flying that close to other houses.....beware of complaints from neighbours!...You really ought to find yourself some open land to fly in.