"It was April 6, 1972 at 9.15 in the morning," he recalls.
It was an emotional time for Mr Atkins, whose wife was pregnant and due around that time.
He said to the nurse: "I want to walk on two artificial legs before she has the baby."
Get in front of tomorrow's news for FREE
Journalism for the curious Australian across politics, business, culture and opinion.
READ NOWFive minutes before she gave birth, he walked in.
Losing both his legs had a massive effect on his life, but it did not stop him competing in three Rottnest Channel Swims, water skiing competitions and donating his time to the SES and People Who Care.
Mr Atkins lost his legs in 1972 after five tonnes of steel fell on him while he was working in New South Wales.
He said he enjoys helping people and was honoured with 30 years of service for his work with People Who Care.
The 69-year-old became the first person ever to receive a perpetual trophy for his effort.
Mr Atkins said he originally joined when he saw an advertisement in a newspaper looking for volunteers.
"I always look at the positives, not the negatives," he said. "I think I am just a person who cares about other people."
As part of his work with People Who Care he visits five nursing homes each week.
Along with his work at People Who Care he also spends time talking to people who have lost legs or are about to lose one.
"Sometimes I go and speak to people who are about to lose a leg and I introduce myself as having lost one too," he said.
"Just before I walk out I like to say"By the way, I have no legs" and that makes them think, I am about to lose one leg and he just walked out with no legs."
Despite losing his legs, Mr Atkins still sees the funny side of things and is not afraid to make jokes about having no legs.
"The good thing is, I don't have to worry about changing my socks," he said.