I live in an area with exactly the same CASA warning, and most of my city is covered by such a warning if not red zones. The one I am in no one in living memory has seen a helicopter land or take off from there, including Parks and Wildlife employees who have worked in the area for decades. In these areas with this warning, thousands fly in them. Some I do not because I know flights take place or have in the past.
To the north, north east of my home is a red zone "This is a restricted area. Do not fly here." It covers an area about 5 times the size of Metropolitan Perth. 100,000s live there and 100s if not more fly daily both as a hobby and professionally. It is a red zone but it is not geofenced. There is even a Drone Retail outlet in it. No one has ever been prosecuted or even warned for flying there. The nearest Airport is 25 kilometers away.
Be safe and use your common sense.