Police served Mr Le and co-owners with a fortification warning earlier this month and ordered the removal of parts of the walls, as well as 32 CCTV cameras and 16 floodlights.
The anti-fortification law was originally introduced to allow police to enter the premises of outlaw motorcycle gangs.
Mr Le, who has spoken to the Weekender several times since a big police raid on his Safari Place property in May, said he had 14 days to act or object to the notice.
Get in front of tomorrow's news for FREE
Journalism for the curious Australian across politics, business, culture and opinion.
READ NOW‘I have to now write to the Police Commissioner explaining why I’ve got these walls and why I’ve got these cameras and these floodlights,’ he said.
‘If he is satisfied, then the notice goes away. If he’s not satisfied, then we have seven days to either take it to court or they’ll come in and take them down themselves.’
Mr Le said he sent an application for the walls to the City of Wanneroo in 2011.
‘They wrote back to us recently to say the application is now refused,’ he said.
‘We will be appealing against the Wanneroo Council decision to reject our application for the walls.’
Mr Le said the height of the wall was about 1.5m but up to 2m where sand had eroded away over time.
He said the company was in the process of backfilling the eroded sand.
‘We’re not bikies’