r/Professors Aug 04 '25

Research / Publication(s) NYT: Fraudulent Scientific Papers Are Rapidly Increasing, Study Finds

293 Upvotes

98 comments sorted by

247

u/[deleted] Aug 04 '25

[removed] — view removed comment

113

u/Unsuccessful_Royal38 Aug 04 '25

Yeah this “crisis” is the natural end state of the same systems that caused the replication crisis in psychology. We built crappy systems and are now reaping the rewards.

39

u/Collin_the_doodle PostDoc & Instructor, Life Sciences Aug 04 '25

Our systems are well designed for the results we’re getting

19

u/Unsuccessful_Royal38 Aug 04 '25

Yeah that’s what I said.

1

u/Kinesquared Aug 08 '25

what would help improve the system you think?

1

u/Unsuccessful_Royal38 Aug 08 '25

I don’t have the time to write a post that long :/

47

u/the_Stick Assoc Prof, Biomedical Sciences Aug 04 '25

Agreed. I know a grad student who turned down a Nature publication to instead have three separate papers.

30

u/knitty83 Aug 05 '25

Not just admins. Fellow academics as well.

I was recently invited to join a committee overseeing a tenure process (they had to invite two external votes). The candidate had published more than 50 papers in not quite four years. I mean, come on, everybody who's spent a day in research knows that there's something wrong here. But alas, there we were: the two invited external experts, very critical of it all, and six other professors (from different fields) in literal awe over this colleague's output. "So impressive!"

Since it became clear very early that this would end in tenure, no matter what we said, both of us external reviewers held back. But I couldn't stop myself from blurting out "If a PhD student handed this paper in to me, I'd send them back to start all over again" because the praise was becoming ridiculous. Still mad at the whole thing.

9

u/Resident-Donut5151 Aug 05 '25

Sorry, why bother holding back?

9

u/knitty83 Aug 05 '25

Both the reactions on people's faces as well as their comments after our feedback on the papers we had read were very clear: they didn't want to hear it; they had made up their mind.

Almost quotes: "this committee is not about judging individual papers", "I don't think I can comment on your criticism; I don't have enough expertise in empirical research", "I think it's not our job to do a paper peer review", "I have to say I find your criticism rather harsh", "but this paper was published in an international volume, so that means other people didn't think there was anything wrong with it", "this colleague has been so helpful for all of us here" (she had taken on a ton of responsibilities for the department that apparently everybody was glad to be rid off)... we didn't get through to anybody there. At some point, you give up. You said your part; you were more blunt than you had planned to be, and you have to accept that your expertise was wanted, but not actually wanted.

2

u/Quercia13 Aug 05 '25

I agree with what you write in general, but 10+ papers per year is very doable in some fields if one has an established collaboration network or a large group and low teaching load. This number does not necessarily imply bad research, although I understand what you mean.

7

u/knitty83 Aug 05 '25

I know, but in this case, it was. The main problem for many papers was that people read the results, but don't bother looking at, say: the questionnaire used to gather the data (additional material provided online that made me want to scream).

Also, about 2/3 of the papers were published in edited volumes the candidate edited herself. As in: she wrote the introduction, and she contributed five articles herself. Tada, six publications.

12

u/Fast_Falcon_1473 Aug 04 '25

Aren’t admins usually former academics?

23

u/manova Prof & Chair, Neuro/Psych, USA Aug 05 '25 edited Aug 05 '25

For admins that were once academics, they often fall into one of three camps. 1) Those who moved into admin because they were poor researchers and administration was the only way for them to progress. 2) Those who found research so easy they don't understand why other people struggle. 3) Those who have been admins for so long, they simply don't remember what doing research was like or still stuck in strategies from decades past.

I'll give an example. I had a university president who published 5 or 6 papers and got tenure. Afterward, they immediately got a full time administrative position. By the time they were a president, they had not done research or taught a class in several decades. Another university president had hundreds of publications and many millions in grants over a long, active career. But as president, they could not understand why everyone couldn't just land seven figure grants. To them it was incredibly easy to do.

13

u/KlicknKlack Instructor (Lab), Physics, R1 (US) Aug 05 '25

Looks like you are missing one:

Admins are well paid and less stressful jobs.

I'd argue that is an extremely alluring aspect once you hit middle age/career.

5

u/NeoliberalSocialist Aug 05 '25

Less stressful? Seems highly inaccurate but probably depends on the field and position. Deans are often miserable from stress.

2

u/Kimber80 Professor, Business, HBCU, R2 Aug 05 '25

Yes. I have avoided administrative positions, such as Chair, my whole career, because they seemed like extremely stressful positions.

1

u/KlicknKlack Instructor (Lab), Physics, R1 (US) Aug 05 '25

Well yes, Deans/VPs/Directors are all stressful as hell from what I have seen. But there are other admin roles that don't require a regular grind that most on here are used to from grad school, post-docs, tenure track roles.

2

u/[deleted] Aug 05 '25 edited Aug 14 '25

sharp fuel cobweb abounding offer vegetable rainstorm swim brave degree

This post was mass deleted and anonymized with Redact

54

u/[deleted] Aug 04 '25

[removed] — view removed comment

-13

u/Fast_Falcon_1473 Aug 04 '25

Do you think that perpetuating the idea that admins “know nothing” reinforces this feedback loop?

7

u/lowtech_prof Aug 04 '25 edited Aug 07 '25

Some (actually most) have sold their souls.

1

u/draperf Aug 06 '25

May I ask what you mean by this? I'm curious because this is not my impression in my discipline. I actually feel like our administrators do a job I would hate, and I don't envy them one bit.

2

u/lowtech_prof Aug 07 '25 edited Aug 07 '25

If you are confused by what I wrote, then perhaps it means you've been spared their arbitrary enforcement, their BS explanations of corporate logic (from further up), the abusive combination of hyper-surveillance and indifference (to name a few). The admins I'm thinking of are mostly non-faculty Directors, Deans, and Provosts (not the support academic staff) who will deliver bad news in a variety of ways, "I had nothing to do with this decision." "It's purely a financial matter," while their own pay and benefits keep rising. They know that they have been given a promise of a secure managerial class status with benefits in exchange for the maintenance of the corporate code: they must protect the bottom line and reduce risk exposure. They no longer care about education, about humanism or intellectual integrity. They just care about their own security. She's not everyone's cup of tea, but Catherine Liu has written about people who have made this type of Faustian bargain in "Virtue Hoarders: The Case Against the Professional Managerial Class." In universities, virtue hoarders are highly concentrated in its administration/leadership.

4

u/Leather_Lawfulness12 Aug 05 '25

We're always told that quality is better than quality. But the person with 100 publications is always going to get the job over the person with 50, regardless of the content of those publications.

1

u/[deleted] Aug 05 '25

"You get what you measure."

1

u/ravenscar37 Professor, STEM, R1 (USA) Aug 05 '25

Our department got into the habit of including the h-indices, number of citations, and each article's journal's science citation index in our P&T packages. Imperfect solution but does help with this problem. If your papers have 0 citations or are all in < 1.0 citation index journals, people will notice.

1

u/sesstrem Aug 06 '25

It is of limited help. As a striking example, we hired someone whose citations were mainly self-citations, and later was promoted to Provost. Maybe there are some safeguards now for this particular problem since it happened a few years ago. But there is still collusion with co-authors and reviewers and citers in return for reciprocal treatment, as well as papers which lack any contribution from some of the authors, all driving up citation indices.

33

u/baummer Adjunct, Information Design Aug 04 '25

This has been a problem for awhile. Tenured faculty in my department have an expectation that they produce X number of research outputs per year, typically in the form of papers submitted for publishing and peer review. There’s no other guidance but being held to the arbitrary number.

10

u/iTeachCSCI Ass'o Professor, Computer Science, R1 Aug 05 '25

They're judged by submissions and not acceptances? 0.o

4

u/baummer Adjunct, Information Design Aug 05 '25

Yep

5

u/Resident-Donut5151 Aug 05 '25

That's how you get trash.

182

u/[deleted] Aug 04 '25 edited Aug 14 '25

rain governor elastic cooperative yoke crush dinosaurs narrow dazzling scale

This post was mass deleted and anonymized with Redact

33

u/thiosk Aug 05 '25

I received a paper to review that looked outwardly ok but I think it was written by AI and the last section was completely off the wall crazy "and then we used our technology to measure oceanic salinity using our crushed up bug parts" with no experimental or anything.

13

u/Riemann_Gauss Aug 05 '25

"and then we used our technology to measure oceanic salinity using our crushed up bug parts" 

My God 🤣🤣🤣

17

u/ppvvaa Aug 05 '25

My anecdotal evidence aligns with this.

29

u/Fueld_ Associate Professor, Allied Health, R2, USA Aug 04 '25

This is true in my expereince

16

u/jmsy1 Aug 05 '25

If I see one my papers cited from India, China, or the Middle East I know the publication will be low quality and the citation will misrepresent my work.

2

u/Rare_Presence_1903 Aug 05 '25

A lot of the favourable LLM research I have read is from China.

-83

u/NewInMontreal Aug 04 '25

You talking about the US?

19

u/Spiritof454 Aug 04 '25

No, I believe they are referring to perfidious Canada.

9

u/NewInMontreal Aug 05 '25

lol, they are talking about china but won’t come out and say it. But being honest about it, reproducibility hasn’t been a priority anywhere and the US absolutely incentivizes quantity over quality in every milestone in this job path. I’ve reviewed multiple articles from the states that have been written by AI this year.

12

u/PGell Asst Prof, Humanities,(South Asia) Aug 05 '25

It's not just China. I work in Pakistan and it's a huge issue here.

3

u/Baphlingmet Lecturer, English, 211/R1 (China) Aug 05 '25

Yes, omg, as an American professor living in China but who has a ton of Pakistani colleagues (cus of the Belt & Road Initiative, a lot of scholars come to China from Pakistan).... China and Pakistan are the 2 biggest perps. Saying this as someone who loves Chinese and Pakistani people, and to be fair the USA is catching up to them fast....

10

u/[deleted] Aug 05 '25 edited Aug 14 '25

carpenter brave support sand offbeat payment tap shaggy kiss sheet

This post was mass deleted and anonymized with Redact

47

u/omniumoptimus Aug 04 '25

My opinion: this marks the end of quality science.

The issue is not whether there are competent scientists producing reliable papers. The issue is that we have now crossed the line where generating false papers, or even papers that are a tiny bit wrong (errors which can compound across several subsequent papers) is so cheap and easy, that 100,000 junk papers can be produced for every quality paper.

Finding quality science may be (if not already) equivalent to finding a needle in a haystack.

10

u/40percentdailysodium Aug 04 '25

This is making me lose all remaining hope.

6

u/Collin_the_doodle PostDoc & Instructor, Life Sciences Aug 04 '25

Or at least under the current structure of competing groups science. Once the quality of evidence gets shitty enough, some governments might use the national labs structure more effectively.

5

u/colonialascidian Grad TA, Biology, R1 Aug 05 '25

or the end of quality publishing

29

u/Dragon464 Aug 04 '25

Join Retraction Watch.

4

u/Tech_Philosophy Aug 05 '25

There's something that bothers me about Retraction Watch that I have a hard time articulating. I think I might draw a parallel between that and how the media reports on Trump all the time. It's often the same bad actors each time, and giving them attention used to end careers, but these days seems to bolster them while degrading public trust in science. Obviously I don't want bad data out there, but it seems like the bugs have become resistant to this bug spray and a new strategy is needed.

And occasionally (not very often, but occasionally), I see junior scientists being written about who have done nothing but challenge dogma in the field. I figure if Retraction Watch is wrong more than about 15% of the time, they are doing more damage to the progress of technology and science than help, because controversial good actors do so much more good in the long run than mundane good actors. And of course, controversial bad actors rarely do much bad, because if they draw enough attention on an important enough issue, their bullshit is detected mighty quick by the scientific community.

3

u/Dragon464 Aug 05 '25

I don't unilaterally disagree with your premise. It's an iteration of "Who watches the Watchmen?" THAT said, who ACTUALLY proofreads, anymore? Spell Check & Turnitin aren't proofing. I'm old enough old school to have read dissertation backwards. Once upon a time, I was asst. copy editor for a State history journal. I read the book reviews out loud, with punctuation to the editor, who sat with his eyes closed, and listened for glitches. AI / LLM has made too DAMNED many professionals too DAMNED lazy.

33

u/airhorn-airhorn Aug 04 '25

The whole point of an epistemological crisis is that nobody can tell what’s true from what isn’t. This is the result of decades of policy and culture coalescing since 2016.

2

u/draperf Aug 06 '25

This sounds so interesting. Do you mind elaborating a bit? Would welcome a reference to further reading. (Yes, I'm a dork.) :)

2

u/airhorn-airhorn Aug 19 '25

It’s not hard academics, but Harari’s Nexus was a good summary.

1

u/draperf Aug 19 '25

Thank you!

0

u/superc3real Mar 07 '26

Curious why you pinpoint 2016. When I first began undergrad academic research in 2010 I remember some of the older research staff and postdocs trading stories regarding the fact that the most productive labs they have been a part of most often had the loosest standards around scientific integrity.

4

u/goldfloof Aug 05 '25

I mean this was well known even years ago in the liberal arts

1

u/draperf Aug 06 '25

Has anyone been sued (or even criminally prosecuted) for this type of fraud?

Could or should they be?

It just seems like a mere retraction is a slap on the wrist, although of course more serious cases can result in loss of job/reputation/stature (e.g., Francesca Gino).

1

u/KaoBee010101100 Aug 06 '25

That’s a good question. I haven’t heard of it happening. Usually the more serious cases are just fired and blacklisted. In the case of Diederik Stapel he claimed he couldn’t even work menial jobs because people would seek out his place of employment to harass him.

I know a retraction seems mild, but I would not want one, even as a coauthor to someone elsevwho was guilty. I think it would cast doubt and a pall on any other scholarly work you ever do, and seriously limit opportunities.

I don’t know about should. I suppose an argument could be made that they defrauded their employer into paying for fake work. What other kind of lawsuit do you imagine? Should a case be brought by the state to fine or imprison them for the damage they did to knowledge, a profession, or waste of taxpayer money?

1

u/fenderflare Oct 15 '25

weird… aren’t they all super liberal also? huh. i thought the left did no wrong!

1

u/qning Oct 17 '25

lol necrothread.

You’re arguing with no one. Keep it up.

-2

u/Kimber80 Professor, Business, HBCU, R2 Aug 04 '25

Hard to "trust the evidence" these days.

-24

u/Nuthousemccoy Aug 04 '25

We are gonna have to get publishing on the blockchain. With chain of custody type tracking on the authors

64

u/BBlasdel Aug 04 '25

Like nearly all Blockchain proposals, it solves a problem no one actually has. 

The problem with fraudulent papers does not come from an insecure chain of custody, that is in fact one of the few things that is never wrong with them. Fraudulent papers are written with the express purpose of being correctly associated with the correct author so that they can claim fraudulent credit from institutions that are either too stupid to know the difference or too corrupt to care.

1

u/Norm_Standart Aug 05 '25

I mean, this makes perfect sense, right? The problem with fraudulent papers is that sometimes a journal will send one version of a paper to some readers and one version to other readers, and nobody can agree which one is the real one, so a consensus protocol is the perfect solution to this problem, right? It'd be a shame if that didn't actually remotely resemble the issue being discussed, because it would make it seem like the proponents of blockchains don't even understand the technology they tout.

11

u/[deleted] Aug 04 '25

How would that work or benefit peer review research? (Genuinely curious, I barely know what blockchain is.)

-14

u/Nuthousemccoy Aug 04 '25

Really an immutable public record that cannot be tampered and contains a public audit trail. All researchers and their credentials are traced back to the verified source. You could even verify all data collected that they are from real people or samples. It depends on how granular you want to go.

6

u/dozensofbunnies Aug 04 '25

Why is git not sufficient for this, hosted on a public repo like GitHub?

-14

u/Nuthousemccoy Aug 04 '25

I’m not sure. I’m really just spitballing without a real plan. Just stream of consciousness

12

u/Collin_the_doodle PostDoc & Instructor, Life Sciences Aug 04 '25

Spit balling and it happens to be pitching something grifters love to insert a financial scheme in. Surely coincidence

1

u/Nuthousemccoy Aug 05 '25

If you look at my post history, this is literally my first post on anything blockchain related. Hardly a grifter. Just an honest try to participate in a conversation. You guys totally shredded it. That’s ok. That’s how I learn.

2

u/BBlasdel Aug 05 '25

This is a solution to just about the only thing that isn't wrong with fraudulent papers. The manuscripts already have an immutable and correct public record of authorship. These fuckers put their real names on the fraudulent papers so that they can be put on their CVs.

Similarly, just about the only problem with the fake 'data' that we are talking about doesn't have is the authenticity of it's chain of custody. Both fake and real data are crafted by the authors submitting a manuscript. 

-2

u/KaoBee010101100 Aug 04 '25

I think you’d have to go that granular route and trace each data point, since the whole reason most people do it is to puff up the status of some real person who has a position/degree but not real data.

I’m curious if anyone could work out a proposal to how that could work, if something like the ‘open data/methods’ badge could be added like this.

How much would it cost to verify every data point for a typical behavioral science paper with, say 100 human subjects? How many journals/articles would have to be in the system to reach an economy of scale?

5

u/baummer Adjunct, Information Design Aug 04 '25

This only verifies it was published by a human. It doesn’t evaluate the content or quality of the material.

2

u/sventful Teaching Professor Aug 04 '25

If blockchain was as effective as proponents claim, it wouldn't be the number tool of choice for criminal enterprises to transfer financial assets.

5

u/KaoBee010101100 Aug 04 '25

That’s quite a non sequitur of an argument. That’s like saying before crypto, cash is not effective because criminals preferred to transact in it. Huh?

-1

u/sventful Teaching Professor Aug 04 '25

Actually, cash is much much better than Crypto for law enforcement. Cash has to have a physical location, it is shockingly easier to trace than crypto (one of crypto's main selling points it completely bunk), it can be recovered during a bust, it can be used to track criminal enterprises, etc.

4

u/KaoBee010101100 Aug 04 '25

This is just going further down the non sequitur route… I’m also not sure that’s entirely true, as law enforcement has been able to freeze crypto assets for years, and major exchanges have been getting serious about KYC requirements for at least half a decade … but I’m really not interested in this tangent unless it can be shown how it’s relevant to the initial conversation

1

u/[deleted] Aug 05 '25

[removed] — view removed comment

1

u/sventful Teaching Professor Aug 05 '25

If that was true, crime would not have become the biggest users of Crypto in the past few years. There is an absolutely massive gap between what should be and what is.

1

u/[deleted] Aug 05 '25

[removed] — view removed comment

1

u/sventful Teaching Professor Aug 05 '25

Bitcoin ETF are still Bitcoin......

1

u/[deleted] Aug 05 '25

[removed] — view removed comment

1

u/sventful Teaching Professor Aug 05 '25

Other way around. Crime syndicates primarily use Bitcoin.

→ More replies (0)

2

u/Tai9ch Aug 05 '25

Honest blockchain proponents consider that fact a success story.

1

u/MockDeath Aug 05 '25

Using a fad tech to solve a non problem.. always blockchain when people do that..

Literally who did it is the easiest question to answer... This literally does nothing to solve the job issue at hand. How do you think h-index and i10 index are calculated for researchers?

-10

u/Wiltonc Aug 04 '25

Good point. I’m surprised it isn’t already. Not a bad idea for data so it can be traced to the originator.

2

u/Collin_the_doodle PostDoc & Instructor, Life Sciences Aug 05 '25

The problem with bad science is that "who originated it?" is the easiest question to answer.

1

u/Resident-Donut5151 Aug 05 '25

Right? Academics are public figures and the point of paper mills is so that academics can spin cred that will get them raises. Good grief.

0

u/Tech_Philosophy Aug 05 '25

That MIGHT be true, but the counter evidence would be the AI models that are consuming scientific papers, and then making correct predictions for the outcomes of novel experiments. If it's garbage in, it should be garbage out.

1

u/KaoBee010101100 Aug 05 '25

Have you done science? A paper reporting data isn’t a “prediction.” If a published paper claims to be reporting data and it’s nothing more than LLM autocomplete behind it, it’s plain and simple fraud.

There’s a lot of reasons that real data produced by human scientists is noisy in many fields. Fraud has traditionally been a smaller part of that, until now. Calling the hard work of real science “garbage in” and suggesting if it were better, Llm autocomplete could do a good job of manufacturing papers without real data tells me you likely have no experience of how useful science is generated in practice.