About 9.15am, police were called to Raleigh Street in Carlisle after reports of a man suspiciously riding a bike along the driveways of units.
Police located the man but he refused to stop his bike. A short foot pursuit ended when the man allegedly rode his bike into a police car.
It is alleged the man had a backpack that contained a handgun, housebreaking implements and several items suspected stolen or unlawfully obtained.
The 35-year-old Bruce Rock man has been remanded until September 10 after appearing in Perth Magistrates Court charged with several offences including trespass, failing to stop when directed by police and possession of an unlicensed firearm.
Kensington Police want residents to report if a bike is taken from their property.
Kensington Senior Sergeant Ash Goy said the station regularly received abandoned bikes but it was hard to find owners unless the theft had been reported or the bike had identification markings.