Swapping switches and outlets is more trivial than changing the oil on your car if you turn off the breaker first.
And to be clear, I'm not saying that the US should adopt laws like Australia. I'm saying that I understand why Australia adopted those laws.
I do know how to do the basics. I've installed smart switches and outlets, doorbell cameras, ceiling lights...I haven't had cause to do an overhead fan, but I'm pretty confident I could manage it.
I'm glad I have the ability and legal right to do so. But electrical fires destroy 51,000 homes a year, and most of those are caused by faulty or poorly-installed components or wiring; and that in particular can affect not only you, but people who live with you and even neighbors as well. And the U.S. CPSC estimates 400 non-professionals die of electrocution every year.
Add to that that, as you say,
Most people won't do it because they do have enough fear not to play around with it
...but those who don't are split among the people who know what they're doing and the people who are too stupid to see the risk. Is the danger caused by the idiots worth banning it for everyone? I don't think so, but I understand and respect that decision for Australia.