I have a preprint out estimating how many scholarly papers are written using chatGPT etc? I estimate upwards of 60k articles (>1% of global output) published in 2023. arxiv.org/abs/2403.16887

How can we identify this? Simple: there are certain words that LLMs love, and they suddenly start showing up *a lot* last year. Twice as many papers call something "intricate", big rises for "commendable" and "meticulous".

@generalising As an arXiv moderator, I've noticed the rise in use of "meticulous". The increase in positive adjectives in general makes scientific papers sound like press releases. ArXiv has a rule against "drum banging". I rejected two submissions in the past week on this basis.


@tdietterich this one is really interesting, thankyou! I had wondered if it would be visibly showing up in submitted material.

"Press release" is a good way of describing it - I think the first time I saw it it made me think of people writing travel guides, everywhere "vibrant" and with "stunning natural beauty"...

· · Web · 0 · 0 · 2
Sign in to participate in the conversation

The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!