Replacing labor doesn't require replacing whole jobs, it's enough to only replace specific tasks within those jobs which will reduce the number of workers needed for the same amount of work.
To pick a rather extreme example, the fraction of the population involved in farming is rather lower than in the past. Due to productivity improvements.
It's not clear why your analogy wouldn't have implied the end of white collar work when computers were first invented or when the internet was invented. Both of those should have been massive productivity boosts which meant the workers would have to go elsewhere to feed themselves. Instead Jevon's paradox kicks in every time.
I think it was the GPS, automation (robotics), bioengineered crops, and conglomerates. My point is, I'm pretty sure it's a lot of factors. Even in the cotton gin case. It's probably naïve to give so much credit to one thing