I have the exact same problem. Very noticeably slower and no reason for it.
I turned of obstacle avoidance and it returned to a decent speed although obviously couldn't see obstacles. Its strangely only been since the RC and firmware update for the Phantom. Maybe DJI want us to buy a P4 Pro and crippled out P4's LOL