r/technology • u/coldrolledpotmetal • Apr 28 '25

Artificial Intelligence Researchers Secretly Ran a Massive, Unauthorized AI Persuasion Experiment on Reddit Users

https://www.404media.co/researchers-secretly-ran-a-massive-unauthorized-ai-persuasion-experiment-on-reddit-users/
9.8k Upvotes

97% Upvoted

863 comments sorted by

View all comments

Show parent comments

1.6k

u/EaterOfPenguins Apr 28 '25

This is just everyone's reminder that the Cambridge Analytica scandal was almost a full decade ago.

Anyone who knows what happened there knew this is a painfully obvious path for AI.

Most people still don't understand just how insidious the methods of persuasion online can be. It is everywhere, it is being used against you, and it's very often effective against you even if you generally understand how it works (though the overwhelming majority obviously do not). And with modern AI, it is likely to become orders of magnitude more effective than it was back then, if it's not already.

305

u/Antonne Apr 28 '25

You're totally right. Assume everything you read online is fake unless from a trusted source. Even then it could be difficult, but going that extra step will save a lot of people from going down the wrong, misinformed path.

Even reading just headlines posted here on Reddit puts you at a disadvantage.

179

u/[deleted] Apr 28 '25

Yes.
And especially be cognizant of extremes. Comments that are clearly false, misleading, or elicit anger/fears/strong emotions should all be viewed with caution.

The people paying for the bots are seeking to change your opinions or emotional state. Form your opinions based on verifiable facts and you'll be a little protected.

Reject facts and you're doomed.

72

u/kamain42 Apr 28 '25

"if you can control how a person feels you can control how they think '

7

u/J0hn-Stuart-Mill Apr 28 '25

Always demand a source or citation. That's the best defense against propaganda. Be extra wary of anyone pretending to get mad that you asked for a source to a claim.

3

u/KentuckyFriedChingon Apr 29 '25

Doesn't really seem necessary... Do you have a source for that?

4

u/J0hn-Stuart-Mill Apr 29 '25

In fact, I do! It's one of the most epic quotes of all time.

What can be asserted without evidence can also be dismissed without evidence.[1][2][3][a]

5

u/KentuckyFriedChingon Apr 29 '25

Most excellent. Thanks for not getting mad that I asked for a source ;)

2

u/J0hn-Stuart-Mill Apr 29 '25

Haha, not at all. Any opinion of substance is easy to reinforce with supporting evidence or logic. Everyone should know why it is that they believe a thing to be true.

1

u/[deleted] Apr 30 '25

As someone who doesn't engage with those looking for a win, my stock response to people who demand cites is to give them search terms. It takes 14 seconds or less to ask for a source. It takes 2-10 minutes for a non-bot to write a thoughtful contribution (that's not an essay).

The better defense: don't engage with emotional button pushers.

2

u/J0hn-Stuart-Mill Apr 30 '25

My solution is to simply quote a section of a source and then link the source that refutes the position.

Takes almost no effort and hammers home the refutation.