That's not true. The problem is that when a large ship is forced to a course due to its draft, a smaller boat, whether sail or power, must get out of its way. A sailboat also has the obligation to keep clear of a fishing vessel that is trawling or otherwise unable to keep out of the way of other vessels.
ColRegs are common sense regulations - everybody is required to do whatever is necessary to avoid collision. The way I see it, codifying it into regulations is for the benefit of all, except maybe lawyers, because it doesn't pit "big guy" against "little guy" but rather recognizes that there are unique situations where one vessel has less ability to avoid collision than another.
Several years ago there was a big news story in New England about a fishing vessel being "run over" by a tug towing a barge. The first reports made it sound as if the tug was at fault, running over a fishing boat that was busily engaged in fishing. When the inquiry was held, it turned out that there was nobody at the helm of the fishing boat which was motoring on a collision course with the tug. The tug made every effort to get its attention, including hailing on the VHF, sounding horns, flashing high-powered searchlights at the boat, and finally, when it became clear that no response was forthcoming, the tugboat captain stopped the tug to let the towing cable drop below the water in the hope that the fishing vessel's course would bring it between tug and barge. As it turned out, since there was nobody on the helm of the fishing boat (comment later on this), the boat did not avoid the barge, but ran smack dab into it!
It was a terrible tragedy that could have been avoided had there been somebody on watch on the fishing boat. Clearly, they had set their autopilot for home and all gone to sleep. And they all died as a result.
That tug had no options. It takes miles to slow down and stop a tug with barge in tow. It takes miles for it to change course. It can't speed up very much, and certainly not quickly enough to make a difference. If you're the sailboat, powerboat, fishing boat, or freighter, you are burdened with the responsibility of avoiding collision. Pure and simple common sense. The guy who has most maneuverability has greatest responsibility for not putting himself, and others, into peril.
On our crossing from Ecuador to Easter Island, about 3 days out from Ecuador, I was on watch late at night when I saw a fishing vessel motoring on a collision course with us. No amount of hailing, shining a light on our sails, anything, made it change course one degree. I had to tack to get out of its way. I was told by our friend, a former shrimpboat crew and skipper, to NEVER trust a fishing boat to know the rules of the road, to get out of your way, or for there even to be someone on the helm. Rules are good, but people often don't follow them!
Be careful out there, but enjoy yourself nonetheless.