That is your problem. The edge of the antenna on the controller needs to face the Phantom legs. If you go straight up you will get a bad signal. Even if you put the controller out flat you still won't have the best signal, because the phantom antenna runs down the legs.
You need to fly away...