Skip to content

PolicyFor administrators

Write the Non-Native Writer Clause as a Corroboration Rule, Not a Carve-Out

In the 2023 Stanford study, seven detectors wrongly flagged human-written TOEFL essays at an average rate of 61.22 percent across 91 essays [1]. A ChatGPT rewrite gave those same essays richer vocabulary, and the rate fell to 11.77 percent [1]. The paper offers limited word choice as one possible explanation, not a proven one [1]. So a policy answers with a corroboration rule covering every student rather than a carve-out naming non-native writers: no integrity finding rests on a detector score alone, whoever wrote the paper.

Olive Staff & OliveUpdated

What Should a Policy Say About Writers a Detector Flags More Often?

Write one sentence: no integrity finding rests on a detector reading alone, whoever wrote the paper. Three clauses are on the table. A carve-out exempts a named group from detector-based referral. A corroboration rule bars any finding that rests on a score alone. A course-level switch-off drops the reading where a cohort makes it unreliable. Only the last two avoid a roster of students, and only the corroboration rule keeps the detector and reaches the same students without labeling any.

Clause shapeThe sentence it addsWhat it costs
Carve-outNamed students are exempt from detector-based referralSomebody decides who goes on the list, and the list sits inside a disciplinary process
Corroboration ruleNo finding rests on a detector reading aloneA committee defines what else counts, in advance of the first case
Course-level switch-offThe AI indicator is off for named coursesFaculty in those courses lose a signal some of them want

Much of the demand traces to one paper. In the 2023 Stanford study, seven detectors read 91 human-written TOEFL essays and averaged a false positive rate of 61.22 percent 1. At least one detector flagged 89 of the 91 1.

A December 2023 brief from the Center for Democracy & Technology connected that result to US civil rights law 2. Title VI of the Civil Rights Act of 1964, a US federal statute, bars discrimination on the basis of race, color and national origin in programs receiving federal financial assistance 8. English learners are protected from discrimination under Title VI on both race and national origin grounds 2.

Those two documents are a large part of why the topic reaches a policy committee. Neither supplies the clause.

The student-facing version of the same problem, and what a flagged writer can put in a reply, sits at what happens when a detector flags a non-native speaker.

Why a Named Carve-Out Fails the Students It Is Meant to Protect

A carve-out fails because it has to name its beneficiaries, and the exposure it answers does not stop at a name. The paper names non-native writers as the exposed group 1; the reading that its second experiment reaches further than that label is this article's. The researchers rewrote those 91 human essays with a ChatGPT prompt for richer vocabulary, and the average false positive rate fell from 61.22 percent to 11.77 percent 1.

A second prompt simplified the word choices in essays by US eighth graders and ran the effect backwards, from 5.19 percent to 56.65 percent 1. The paper's reading is that the detectors penalized limited word choice, offered as a possible explanation rather than a proven one 1.

Read the second half of that result slowly, because it is the part policy drafts skip. The eighth-grade essays came from a US dataset, and the paper treats them as native-speaker writing 1. Plainer word choice alone moved the detectors' average false positive rate on their essays more than tenfold 1.

The list is the first cost. Enrollment data does not record the range of English a student writes in. An institution that tries is likely to fall back on proxies such as visa status or language-program enrollment, which measure something else.

The record is the second cost. English learners are protected under Title VI on race and national origin grounds 2. An exemption list would identify students by that membership and store it inside a disciplinary process, where people deciding cases read it. That inference is this article's, not the brief's; the brief's argument is about the effect of detectors on English learners, not about exemption lists 2.

What that means for a particular district is a question for its own counsel. The drafter's point is narrower: the carve-out manufactures the record, and a clause covering every submission does not.

Coverage is the third cost. Writers flagged for plainness include students who are not English learners at all, which is why the same clause has to reach them too.

The parallel case, and the reason a disability-linked carve-out meets a sharper version of the same problem, is a policy for neurodivergent students and AI detectors.

A carve-out also has a shelf life. Written against one study and one generation of tools, it reopens the argument at every vendor release. A corroboration rule takes no position on vendor accuracy, so it doesn't expire.

Write One Corroboration Clause Instead of an Exemption List

The clause opens with one sentence: a detector reading may open a review and may never, by itself, support a finding of academic misconduct. That covers every student without naming any, which is why it survives the next accuracy release. The University of Pittsburgh's teaching center states the underlying reason in its own guidance, saying detectors are not reliable enough to act as proof 6.

The clause is only as good as its second half, which names what else counts. Define that list before the first case, because a definition written during a case is a definition written around one student. Four kinds of evidence are commonly listed:

  • Timestamped draft history from the document the paper was written in
  • Sources the student can produce and discuss in specific terms
  • Prior work already on file in the same course, read for voice
  • An interview whose questions are recorded and asked the same way of every student in the course

None of these is a detector score. Each still involves human judgment, and a committee should check that an interview or a reading for voice does not penalize fluency.

A corroboration clause is not a ban. Faculty keep the tool and keep the review it triggers. What moves is the burden. That distinction matters politically, because a committee that votes down a detector ban will still pass a sentence about what a finding requires.

Where that sentence has to land in the procedure, and who is allowed to hear the result, is worked out in designing an AI detection appeal process.

How Should a District Answer a Vendor That Says the Bias Is Fixed?

Ask three things in writing: which population the figure was measured on, how many documents it covers, and whether the set is published. Turnitin reports a false positive rate of 0.014 for English language learner writers against 0.013 for native English writers, on documents meeting its 300-word requirement 3. Pangram Labs reports no false positives on the 91 non-native samples of the 2023 study 4. Both numbers are real and neither closes the question.

A clean run of 91 documents says the rate is not large. It doesn't say the rate is near zero, and the distance between those two readings is the whole argument. The 91 essays are public, so any vendor can test on them, and a result on 91 documents bounds the rate loosely whichever vendor reports it.

The length floor is the second gap. Turnitin states its comparison for documents meeting a 300-word requirement 3. The weekly discussion post sits outside that figure. So does the short reflection.

Pangram's own model card also reports results by language. Its multilingual miss rate is 1.24 percent across 18 languages, and 5.3169 percent on Urdu 4. Those rows measure missed machine text in other languages, not wrongful flags on English written by non-native writers, so they are context rather than a third gap. What they do show, in the vendor's own evidence, is that performance varies with the language a writer works in. The same model card acknowledges a non-zero error rate and says false accusations of AI use can lead to serious consequences 4.

Put in the fileWhy it decides something
The population, named exactlyEnglish language learners and non-native English writers are different sets
The document countZero errors in 91 and zero in tens of thousands are not one claim
Where the set is publishedA set the vendor holds cannot be re-run locally
The length floorA figure stated above 300 words says nothing about a 150-word post
False positive or accuracyAn accuracy figure blends both errors and hides the costly one

The fuller version of that list, written as procurement questions with the reasoning behind each, is ten questions to ask an AI detection vendor.

When Does Switching the Detector Off Beat Writing a Clause?

When the cohort and the assignment weaken the reading at the same time. Vanderbilt University disabled Turnitin's AI detector in August 2023, citing research that detectors are more likely to label non-native English writing as AI-written and saying Turnitin gave no detailed information on how its tool decides 5.

The University of Pittsburgh's teaching center went further and endorses no AI detection tool 6. Both were institution-wide positions. A course-level switch-off is the narrower version of the same decision, and at many institutions it can be made without a campus-wide vote; who holds that authority is a local question.

Vanderbilt set the 1 percent false positive rate Turnitin claimed at the time against the 75,000 papers it submitted in 2022 and said around 750 could have been incorrectly labeled 5. That sum assumes the vendor's rate holds on Vanderbilt's papers and treats every paper as human-written; both are assumptions. The same arithmetic on 1,600 papers gives 16 documents, on the same two assumptions.

The TeachAI toolkit goes as far as a ban. Its sample school guidance tells teachers not to use technologies that purport to identify generative AI use, on the ground that their accuracy is questionable 7. The same toolkit asks that any use of an AI system by a teacher or a student be disclosed and explained 7.

That trade is worth naming for what it is. Declaration replaces detection, and it runs on a disclosure culture a school has to build.

A targeted switch-off is narrower and easier to pass. The usual candidates are first-year composition with high international enrollment, intensive English programs, and timed in-class writing that falls under the vendor's length floor anyway.

Which institutions have published their own pages doing this, and the reasons each gave, is collected in universities that turned off Turnitin AI detection.

A switch-off is reversible at any point in the term. A disciplinary record built on a weak reading is far harder to undo.

Common questions

Does the 2023 Stanford finding still apply to detectors released since?

The study tested seven detectors available in 2023 and describes no tool released after that 1. The mechanism may carry forward: a detector that reads a limited range of expression as machine-written would fall on plain writing whoever produced it, and the same paper moved the average error in both directions with ChatGPT prompts that rewrote word choices 1. Whether a current tool behaves that way is a question for that vendor's evidence, measured on that vendor's set. It belongs in the procurement file beside the study rather than in place of it.

Is an exemption for English learners allowed under Title VI?

Title VI of the Civil Rights Act of 1964, a US federal statute, bars discrimination on the basis of race, color and national origin in programs receiving federal financial assistance 8. The Center for Democracy & Technology's December 2023 brief states that English learners are protected under Title VI on both race and national origin grounds 2. Whether a particular exemption is lawful turns on local facts and is a question for a district's own counsel, not for an article. The narrower drafting point: an exemption list would identify students by that membership inside a disciplinary process, and a clause covering every submission creates no such record.

What counts as corroboration if a detector score cannot stand alone?

Evidence a committee names before the first case rather than during it: timestamped draft history from the document the paper was written in, and sources the student can produce and discuss. Prior work in the same course already on file counts too, as does an interview whose questions are recorded and asked of everyone the same way. None of these is a detector score, and each still involves human judgment.

Does raising the word-count minimum fix the false positive problem?

It narrows where a reading is offered. That helps, and it doesn't answer the finding. Turnitin states its English language learner comparison for documents meeting a 300-word requirement 3, so shorter submissions sit outside that figure entirely. The 2023 study does not report essay lengths 1, so it cannot say how much of its error a length floor would have removed.

Should the policy name the bias in the version parents read?

Naming it in advance costs less than explaining it after a case. A parent-facing policy can say two things: that detector readings open a review and never conclude one, and that the institution is aware published research reports higher false positive rates on writing by non-native English speakers 1. That sentence lands before a flag does. It also commits the institution in writing to the standard its own committee will be held to.

References

  1. 1.GPT detectors are biased against non-native English writers arXiv (Stanford University; published in Patterns), 2023. arxiv.orgThe 61.22 percent average false positive rate across seven detectors on 91 human-written TOEFL essays, 89 of 91 flagged by at least one detector, the fall to 11.77 percent after richer vocabulary, and the rise from 5.19 to 56.65 percent when eighth-grade essays were simplified.
  2. 2.Brief - Late Applications: Disproportionate Effects of Generative AI-Detectors on English Learners Center for Democracy & Technology, 2023. cdt.orgEnglish learners are protected from discrimination under Title VI on the basis of both race and national origin.
  3. 3.AI Checker Solutions: Ensure Academic Integrity Turnitin, 2026. turnitin.comTurnitin's published false positive comparison for documents meeting the 300-word requirement: 0.014 for English language learner writers and 0.013 for native English writers.
  4. 4.Pangram 4 Model Card Pangram Labs, 2026. pangram.comNo false positives reported on the 91 human-authored non-native English samples from the 2023 study; the multilingual miss rate of 1.24 percent across 18 languages and 5.3169 percent on Urdu; and the acknowledgement of a non-zero error rate with the statement that false accusations of AI use can lead to serious consequences.
  5. 5.Guidance on AI Detection and Why We’re Disabling Turnitin’s AI Detector Vanderbilt University, Brightspace and Instructional Technology Support, 2023. vanderbilt.eduThe August 2023 decision to disable the detector, the research it cited that detectors are more likely to label non-native English writing as AI-written, the statement that Turnitin gave no detailed information on how it decides, and the 75,000 papers of 2022 against roughly 750 that could have been incorrectly labeled.
  6. 6.Encouraging Academic Integrity University of Pittsburgh, University Center for Teaching and Learning, 2026. teaching.pitt.eduThe Teaching Center endorses no AI detection tool, and detectors are not reliable enough to act as proof.
  7. 7.AI Guidance for Schools Toolkit, sample guidance TeachAI, 2025. teachai.orgThe sample school policy telling teachers not to use technologies that purport to identify generative AI use because their accuracy is questionable, and requiring that any AI use be disclosed and explained.
  8. 8.Title VI of the Civil Rights Act of 1964, 42 U.S.C. § 2000d Et Seq. US Department of Justice, Civil Rights Division, 2023. justice.govTitle VI, 42 U.S.C. § 2000d et seq., enacted as part of the Civil Rights Act of 1964, prohibits discrimination on the basis of race, color, and national origin in programs and activities receiving federal financial assistance. Page updated June 6, 2023.

8 sources, numbered by first appearance.

General guidance, not legal advice. Rules on academic integrity differ by institution, by state and by country, and they change often; anything here is worth checking against an institution's own counsel before it is acted on.

Human checks whether a piece of writing can be verified as written by a person, and shows the sentences behind the result. It does not report a probability that a person used AI, it does not check for plagiarism, and no number it produces stands for a student's honesty. A flag should be reason to look closer and not verified proof of cheating.

Human

Read the measurements

The measured operating points and the false-flag ceiling, for a policy or a procurement decision.