I think the four green flashes your seeing at the end is just the tail end of the System start and self check LED! If you have it in GPS what do you get?
If its in GPS after the System start/Self check LED you should get 1green and three red flashes and it should start changing to 1green 2red flashes meaning your picking up more and more satellites, Once you get at least 1green and 1red or even better all green flashes you should then wait for a very rapid green light which means your home point has been recorded!
If your not flying in GPS and just take off in ATTITUDE OR MANUAL MODE then I don't believe it will come back to you since you have no home point!!