On iOS, I usually leave it connected but with auto updates turned off. You don't need wifi/internet/cellular service to fly in any case unless you want to reset your home point or use follow me mode.
It doesn't matter either way since the Phantom 4 does not use Wi-Fi when you're flying. Some people turn it off to free up resources on slower mobile devices.