It's a GAME to squeeze the most money out of the buyer... and obviously it works or they wouldn't do it.
There have been attempts to change this to a non-negotiable "set" price. Saturn always did this, Oldsmobile tried it for a few years, there are dealerships here and there that aren't "dealers" but all this is rare because it doesn't produce as much profit. This goes hand-in-hand with a rapid deduction in competition. Pontiac, Oldsmobile, Mercury, Plymouth, Saturn divisions and dealers are all gone.... and gone are the days of the family-owned local dealership, most are now owned by big corporations that operate many dealerships and keep profits high.
Several groups exist to supposedly help the buyer - Consumers Reports, The Auto Club, True Car, even COSTCO have car buying programs. But typically, the savings is minimal - you can probably do better yourself although they save you the hassle.
.