Tuesday, June 16, 2026

A misuse of AI that I hadn't foreseen

 

We know artificial intelligence (AI) can be a very useful tool for good.  Sadly, it can be used for evil as well.


Police have launched a criminal investigation into an officer accused of using artificial intelligence (AI) systems to "create evidential material in a number of cases".

The Derbyshire Police officer has been removed from front-line duties, pending the outcome of the investigation, the force said.

The officer is alleged to have perverted the course of justice, but no arrests have been made, police added.

A Crown Prosecution Service spokesperson said they were working with police, adding: "We are engaging with defence teams and the courts in appropriate cases."


There's more at the link.

I hadn't given this enough consideration, but thinking about it, it's potentially a very serious problem.  Perverting the course of justice is bad enough, but think about how a group with a particular ideology can fabricate "evidence" to persuade their government to act in a certain way towards another country?  The neocon outrage at President Trump's announcement of a deal with Iran is a good example.  What if the outspoken pro-war ideologues could concoct their own evidence to "show" that the deal is a lousy one, and should be abandoned?  What if they could "create" evidence to persuade Iran to start hostilities again, because it was convinced America was about to attack it again?

This adds a very worrying dimension to AI.  It will probably be almost impossible for a non-specialist to figure out whether or not the evidence presented is authentic or fabricated.  Indeed, it may contain just enough truth to be persuasive, and add enough falsehood to lead to a wrong conclusion.  How would one prove it false when it contains at least some truth?

This adds new complexity to the issue of censorship - of news, of social media, of whatever.  First Street Journal gives us examples.


It was just over four years ago that we wrote about The New York Times publishing an article by a member of their own Editorial Board, Greg Bensinger, telling readers of that august supporter of Freedom of the Press that it was bad, bad, bad that Elon Musk was trying to buy Twitter, and that his promise to make the social media service an “inclusive arena for free speech” and that “Twitter Under Elon Musk Will Be a Scary Place.”

. . .

We pointed out that The New York Times gave OpEd space to Chad Malloy[2] to claim that restrictions on speech actually promoted freedom of speech. They also published articles claiming that Free Speech is killing us. Noxious language online is causing real-world violence ... And today? There were riots in Belfast, Northern Ireland, following the attempted beheading of a Scotsman by a Sudanese asylum seeker, and the Usual Suspects complained not about the attack, but about Twitter not censoring people writing about it! There’s more of that here and here and here.

The United Kingdom’s Secretary for Northern Island Hilary Benn said, following the knife attack in Belfast:

Social media companies have a very heavy responsibility. It’s why we’re going to bring forward new powers next week to make it clear that social media companies need to take down illegal content, particularly when we are facing circumstances such as the ones we’ve seen in Northern Ireland over the last two days.

It’s simple: our good friends on the left are afraid, deathly afraid, that if the people in general have the information Our Betters would rather not see disseminated, people might, horrors! draw conclusions from that information of which the left would disapprove!


Again, more at the link.

Imagine that the sources quoted by First Street Journal had been "massaged" by AI to give a rather different emphasis to the news than the reality?  For that matter, what if the journal itself used AI to give a particular propaganda twist to its presentation of the news?  Merely by selecting words and phrases that "shaded" the presentation in one direction or another, its impression on readers could be significantly altered;  and AI systems, with their vast resources of language, facts, figures and news, would be in an ideal position to shape and form that impression.

Hmmmm . . .

Peter


10 comments:

Anonymous said...

Merely by selecting words and phrases that "shaded" the presentation in one direction or another, its impression on readers could be significantly altered;
This sounds like yet another publishing day at the MSM, except that it is AI doing the "shading" instead of the alleged journalists.

To the beginning point about the policeman using AI to fabricate evidence, again that has happened in the real world to the point it becomes a cliche; i.e. the drop gun or placed marijuana bag, and I expect to hear more examples of this in the future. AI just makes the fabrication easier.
Steve

Francis Turner said...

So far (knock on wood) it seems that AI text has sufficient tells which seem to be inherent to the technology, that using it to create fake documents that cannot be detected will be hard. I suspect there are similar tells in images and videos - actually I know there are some, but I'm not sure how easy it is to hide them.

Anonymous said...

well, it would be best to remember that this is the "system' that hide the news of rape gangs for years if not decades. kind of weird that all of this shit happened AFTER they disarmed the locals.
funny that now isn't it ?

Anonymous said...

This it's different from what we have now, how?
-Texas Mike

boron said...

You don't need AI to select words and phrases that "shade" the presentation in one direction or another, all you need is an individual /person who is competent in the English language - and we've had many of those "reporting" for the New York Times and similar rags for many years

Peter said...

To all those pointing out that this sort of thing has been happening for a very long time, even without AI: you're right, of course. However, the increasing use - and universality - of AI will make it much easier to do, and much harder to detect against a background where many things - almost everything, in fact - is at least influenced by AI. People and institutions who/which had never even considered that sort of thing will now find it offered to them on a plate. I suspect many will find the temptation to use it almost irresistible.

Anonymous said...

Among my concerns are that the .gov and police using AI created / edited images / video clips to fake real time evidence the way that they have in the recent past used photos used out of context or out of time / location to falsely attribute acts to their enemies.
John in Indy

Anonymous said...

There are people who are working on that. Dig into the youtube AI generated or altered material help pages to see descriptions of one approach, a trusted toolchain from cameras to editing software. Another approach is to encode data into white light that is then captured in the recording. For instance, the lighting at the Whitehouse could have "official whitehouse.gov" digitally encoded which would then be visible with verification tools in every video shot there.

google "using white light encoding to ensure provenance" to see some details.

nick

Dan said...

The real question being how many people are languishing in prison due to manufactured evidence like this case....

Anonymous said...

My "worry" if I can dignify it by that is the rapid advance of AI video.

As a "for example" this is (correctly) named Cursed Heidi and is noted as being tywo years old:

https://www.youtube.com/watch?v=0A2-Af5JEWU&pp=ygULd2VpcmQgaGVpZGk%3D

Now, contrast the depiction of people in these which are difficult (at times) to distinguish from real life (the shadows, lighting and movement of the people are very good), the latest is 5 months old.

In this one the firearms are very realistically rendered:
https://www.youtube.com/watch?v=BEZgWAdL0p4

https://www.youtube.com/watch?v=-xy4dP0UP0E&pp=ygUHc2FnYSBhaQ%3D%3D

https://www.youtube.com/watch?v=7pWCOfnCFs4

My concern is that there is no need of false allegations against a politician when you can generate AI video of him caught in a compromising situation with either women, boys or animals ... Prove it ISN'T AI and even if you do "there is no smoke without fire" and six months down the line when it is proven that the video is false, then mission accomplished.

Still, look on the bright side. If AI advances as rapidly in the future, then all the Hollyweird actors and actresses will be out of a job and we won't have to listen to them pontificating about stuff they know nothing about and have everyone hanging on their every word.

Phil B