I experienced something similar on a windy day. I looked up and saw that my green lights suddenly started flashing yellow. I check the remote and saw that it was still powered up and set to GPS but somehow the Phantom lost it's GPS signal. Once it lost it's GPS signal, it started drifting away...