I have a similar issue, living near an unpaved airstrip.. sure it's a bit of a pain but if you jump into DJI GEO System - Unlock Areas For Authorized Access before you lift, tap and authorise the areas you need - you should be away with no interruptions inflight.
Do that from home before you...