This morning I received the copy-edited version of a paper I recently submitted to a journal. This is always cause for celebration, another step towards publication accomplished! But this time the copy-editor wasn’t human, it was an AI.

We have undertaken a light text edit using the tool Paperpal Preflight; please check all edits to ensure you are happy with the changes made.

Right off the bat I noticed they had Americanised all my spelling. That’s annoying, especially for a European journal. I checked the journal’s author guidelines: write in English, they say. It doesn’t specify which English.

There’s the usual annoyances that I’ve experienced with human copy-editors too: every “like” was changed to “such as” and every “so” to “thus” or “therefore”. Some journals do require that sort of language, but I don’t like it. I don’t like having my “don’t” changed to “do not” either, but OK.

They copyedited direct citations. Hey, that’s not cool. And honestly, a half-decent copyediting tool should be able to identify a block quote and skip copyediting it.

A direct citation with lots of copyediting that actually changes its meaning.

And it adds mistakes. The name “Perez y Perez” is corrected to “Perez and Perez” which is certainly not correct.

The word “demonym” is changed to “denomination”, which completely changes the meaning:

Some of the corrections were just strange. “Aer indicatesmeans air in all three languages.” Why would you change means to indicates in that sentence? It diffuses meaning. It added a “the” in front of ChatGPT. I have never seen ChatGPT referred to as “the ChatGPT”.

The irony here is that the paper that Paperpal butchered is about how generative AI normalises and homogenises our writing. Which is exactly what Paperpal was doing to my writing.

Paperpal is one of many AI writing assistants being touted specifically for “academic writing”. It’s obviously mostly meant for students, with tools that both check for accidental plagiarism and paraphrase text for you. The unspoken suggestion is that you can copy and paste text and it will paraphrase it so the plagiarism isn’t detectable. It has a disturbing feature called “Citation Generation” that allows you to “Find generate, and cite papers in 10,000+ citation styles.” I’m not sure I want my AI to be generating citations for me – does it just make it up at random, do you think, or does it try to find a real paper and just make it sound relevant? The website promises both US and UK spelling and style, so perhaps the journal I had submitted my paper to simply didn’t take the time to check the box for UK English.

It feels like a huge waste of time to have to go through each of hundreds of tiny changes to my text to reject most of the edits. There were a few good edits. But almost all of them were either homogenising my writing by making it more American and more blandly impersonal, or they were actually adding mistakes to my work.

At least I now have an extra example to add to the paper of how generative AI homogenises the way we express ourselves.

The paper will be out soon so you can read it for yourself!


Discover more from Jill Walker Rettberg

Subscribe to get the latest posts sent to your email.

Leave A Comment

Recommended Posts

screenshot of blogpost from sept 11, 2001, about blogger.com showing blog posts about the attacks
Networked Politics social media

25 years since September 11

I’ve been reading through my blog posts on September 11, 2001 and the days that followed. The things that stand out to me – in addition to the horror of the attack itself – are how massively we (or at least I) used the web to understand what was happening, […]

AI STORIES

AI-generated stories have longer endings than human stories

My colleague Jessica Witte has just shared a preprint where she compared the emotional arcs of the stories we generated using gpt-4o-mini to those of human-authored (pre-2022) stories from the subreddit r/WritingPrompts, conveniently gathered in this dataset. She found a distinct difference in the endings of the LLM-generated stories: both […]

How to peer review a paper in 2026

Dorothy Bishop, a psychologist, wrote a useful list of what reviewers need to look out now that so many papers are bad science that looks good thanks to LLMs. Read her whole blog post, she explains it well, but here’s a brief version because I’m pretty sure we’ll be needing […]

“So what if it was ChatGPT? It *could* have been true!”

I recently read a good article on the different kinds of truth a language model operates with by Luke Mann, Liam Magee and Vanicka Arora, Truth Machines: Synthesizing Veracity in AI Language Models, but despite its lovely typology of truths (consensus, correspondence, coherence and pragmatic) it doesn’t help me with […]

AI STORIES

AI shimmer and sparkle

I have this hunch that sparkles and glow and shimmer are somehow a point in the latent spaces of LLMs that have more connections than you would expect. Perhaps their connotation to magic and to the unknown matches some of the mystique of genAI? Or perhaps these words are used […]