Although I tend to agree and I have spent my entire working life working within / teaching these rules. They are a complete horses bum when you stand back and look at them objectively. As an exercise, try explaining the purpose of the various references, Act, CAR, CASR, CAO, CAAP, AC, AIP, ERSA etc to a non-aviator who is interested in learning to fly.
Then explain where to find the airspace rules relating to a local flight for the holder of an RPL with Nav endorsement from a class D metro airport.