You're absolutely right! They do the same thing in California in most harbours, but they're pretty lenient if you're just anchoring in a cove someplace... It's funny how human feces are so much more offensive than say shark or whale cr*p!
BTW, I used to live in Melbourne, it's where I learned to sail, so I'll always have a special place in my heart for Australia.. It's changed so much since I left in 1984... When I lived there, the biggest threat was the Chinese invading, or the Queen interfering in politics.. -still miss it though.