“What happens when anyone can make it appear as if anything has happened, regardless of whether or not it did?” technologist Aviv Ovadya warns/asks in this interesting journey through the existing and coming technologies for manipulating words, images, networks and people..
“Alarmism can be good — you should be alarmist about this stuff,” Ovadya said one January afternoon before calmly outlining a deeply unsettling projection about the next two decades of fake news, artificial intelligence–assisted misinformation campaigns, and propaganda. “We are so screwed it’s beyond what most of us can imagine,” he said. “We were utterly screwed a year and a half ago and we’re even more screwed now. And depending how far you look into the future it just gets worse.”
That future, according to Ovadya, will arrive with a slew of slick, easy-to-use, and eventually seamless technological tools for manipulating perception and falsifying reality, for which terms have already been coined — “reality apathy,” “automated laser phishing,” and “human puppets.”
He then describes how rapidly the technologies for manipulating images, mining personal information and using AI to tailor messages specifically to each user are developing. And he fears that:
“fast-developing tools powered by artificial intelligence, machine learning, and augmented reality tech could be hijacked and used by bad actors to imitate humans and wage an information war”
Of course they will. And the technology development will not stop just because it can be put to scary uses. I cannot think of an example from history where technological development was stopped because X “enlightened individuals” predicted it would be destabilizing. (Aviv is not saying that either, I just wanted to get that out of the way). So eventually everyone will be playing with these tools, and so? Didn’t everyone start using print and then radio, and then TV and then the internet? Maybe it made it possible to coordinate people in larger numbers towards common ends (not necessarily good ones, but I mean the game of politics did not change to some new game, it just ramped up a level), but the numbers coordinated by religion/culture in the past were not trivial either, just slower moving .. The question is this: is there a point where quantitative change becomes qualitative? and what does that mean? What will be radically different? Leaders? followers? patsies? useful idiots?
This is not a rhetorical question, I am really curious what people think will change and what will not.
By the way, i read that while he was waiting for Stalin to shoot him, Bukharin was reading philosophy and this was the question that stumped him; the question of quantitative change versus qualitative change..