You could go with a headmounted visor style of device that allows you to slip your phone into the end of it. Kinda Google Cardboard style , but more refined. That way you can just run the standard USB cable from the Remote Controller and plug the other end into your phone and slip your phone into the headset.
You may look like a dork and have to pull it up for line of sight flying , but it is more immersive than most goggles. Plus it does not rely on HDMI output from the controller or a tablet. Another strong point is that you are not having to use a program that breaks up the image into two different video feeds for the right and left eyes as googles do. Its all one image on the phone that you can look left or right within.