Peer-review praise register
- Id
- review-praise-register
- Status
- Fading
- Severity
- medium
- Detection
- deterministic
- Evidence grade
- peer-reviewed
- Languages
- en
- Added
- 2026-08-15
- Updated
- 2026-08-17
Signal is weakening, usually because model vendors trained the habit out.
What it is
Evaluative praise vocabulary that rose sharply in conference peer review after 2022. Liang and colleagues measured review text at four AI conferences and estimated that between 6.5 and 16.9 percent of it was substantially modified by a language model after ChatGPT, against a pre-ChatGPT control of 1.6 to 2.4 percent. The control is what makes that number citable, and it is the number this entry rests on. Per-word fold changes appear in the paper body and we did not confirm them at page level, so they are not printed here.
Why it reads as machine-made
Praise vocabulary is what a text produces when it has read something and has nothing to say about it. A commendable effort and a compelling narrative are verdicts with no reasons attached, and a reviewer with a reason usually leads with the reason.
Specimens
The authors have done a commendable job, and the meticulously crafted methodology makes for a compelling read. The framing is timely and the argument is organised well throughout. The literature review is thorough and situates the contribution appropriately within the wider body of work. A few small clarifications would strengthen the presentation, though none of them touch the substance of what is claimed, and the reviewer has no material concerns to raise on that front. The manuscript would make a welcome addition to the issue.
The sampling frame excludes anyone who left the platform before 2024, which is the population the paper is about. Table 3 would settle it if it reported the attrition count.
The repair is the objection. It is also shorter, which is usual.
How it is detected
- Pattern
- \bcommendable\s+(?:effort|work|job|attempt|contribution)\b|\bmeticulous(?:ly)?\s+(?:crafted|curated|researched|documented|designed)\b|\ba\s+(?:truly\s+)?compelling\s+(?:case|narrative|argument|read)\b|\b(?:is|are|was|were)\s+(?:a\s+)?(?:noteworthy|invaluable)\s+(?:contribution|addition|resource)\b
- Flags
- gi
- Scope
- sentence
Who writes this way legitimately
Reviewers, referees, examiners and anyone writing a school report are required to evaluate, and evaluation vocabulary is the tool for it. Recommendation letters are built from this register, and a letter writer who avoids it damages the candidate. Meticulous is literal in conservation, watchmaking, archaeology and laboratory technique, where it describes an observable working method rather than a compliment. Yakura and colleagues measured these words rising in spontaneous podcast speech after 2022, which means a human writing commendable in 2026 may simply have heard it. The discriminator is whether a reason follows the verdict within a sentence or two. A hit on a peer review is a prompt to ask what the reviewer noticed, and never a finding about who wrote it.
Model attribution
Measured across review text at four machine learning conferences without attribution to a vendor. Liang estimates the share of substantially modified text in a corpus and makes no claim about any single review.
Status history
| Date | Status | Rationale |
|---|---|---|
| 2026-08-15 | Fading | Fading. Liang measured the rise in reviews written between 2023 and 2024, and the vocabulary has since been named in every venue that discusses this, including conference policies. Yakura documents the same words entering unscripted human speech, which drains a word-level marker of information regardless of what any model does next. |
Sources
- 01Liang et al., Monitoring AI-Modified Content at Scale, ICML 2024 (arXiv:2403.07183)peer-reviewedaccessed 2026-08-14
- 02Kobak et al., Delving into LLM-assisted writing in biomedical publications, Science Advances 11(27)peer-reviewedaccessed 2026-08-14
- 03Yakura et al., Empirical evidence of LLM influence on human spoken communication (arXiv:2409.01754)primary-docaccessed 2026-08-14
CC BY 4.0 / The AI Tells Index, feedsquad.com/ai-tells