I agree completely.
I am certain that if darker skin tones ruled the planet, it would have gone exactly as badly as it had now.
My point is just that it didn't - people of pallor have been in control for a long time now, and we're the ones steering the bus off the cliff.
The bus analogy is good. Likely any group of humans in the driver's seat would keep their foot firmly on the accelerator all the way off the cliff and even into the abyss, as long as they were being plied with consumer goods. However, we white guys are in the driver's seat, so hypotheticals gotta hypothetic.