PangramFor students
Pangram's Own Guidance After a Flag: Drafts, Notes, a Conversation
Pangram publishes its own answer to a flag on work a student wrote, and the page is written for the teacher, not the student. It doesn't ask for a second scan. It asks for the writing process: the research notes, the early drafts that got saved, and, for work typed in Google Docs, the file's version history. A "robust multi-hour writing history", in the page's own words, is "some very compelling evidence that they wrote the work themselves" [1]. Evidence, not proof.
Olive Staff & OliveUpdated
What Does Pangram's Own Guidance Say to Do Next?
Pangram's guidance for exactly this moment is a page on its own site, published in February 2025 under its chief executive's name, and it is written to the teacher rather than to the student 1. It doesn't ask for another scan. It asks what the student can show about how the paper got written, and it names the notes, the early drafts and the file's version history.
The page puts two questions to the teacher directly: "What research did they do for this assignment, and did they take notes? Do they have early drafts saved?" 1 What a drafting record is worth depends on what it shows: a paste, or a draft typed straight through from top to bottom, reads to the page as a sign of AI help 1. "If they have a robust multi-hour writing history, then that's some very compelling evidence that they wrote the work themselves," the page says 1. That wording came from the company that built the detector.
The page recommends talking to the student, and says a detection warrants further investigation before any punitive measure 1. The comparison it borrows from The Cheat Sheet, an academic integrity newsletter, is the metal detector at an airport: the alarm starts a search, and it doesn't end one 1.
Read the Rate Pangram Publishes, and the Conditions On It
Pangram's September 2026 post on false positives puts its overall rate at roughly 1 in 10,000, and says the figure moves with the kind of writing 2. It carries two academic figures: the summary puts academic writing at 0.02 percent, about 1 in 5,000; the domain table and the Turnitin comparison put academic essays at 0.004 percent, about 1 in 25,000 2. All three are the company's own measurements, not an independent audit 2.
The post also names writing the company doesn't want screened at all: short bullet lists or outlines, single-sentence responses, and formulaic text such as data lists and templates 2. The model card sets a floor of 50 words in complete sentences 3. A 40-word discussion post is under that floor, so a reading reported on one needs explaining before anything else 3.
The rate and its cost both sit in Pangram's own material. The guidance page says a positive reading "could be real, or it could be the statistically anomalous one-in-ten-thousand situation where Pangram gets it wrong" 1. The model card adds that the model carries a non-zero error rate, and that a false accusation of AI use does real harm 3.
The Atlantic set that rate against the scale of American schooling in May 2026, writing that Pangram "would produce plenty of false accusations even with a one-in-10,000 error rate" 4. That is the magazine's estimate, and it assumes every paper is screened and that the published rate holds on all of them. A false flag becomes an accusation only when someone treats it as one.
Why a 99 Percent Reading Is Not a Sentence-by-Sentence Verdict
A high percentage is a confidence figure about part of the document, not a count of machine-written sentences. Pangram's guidance page spells this out: a 99 percent score on a segment means the model is 99 percent confident that AI was used somewhere in that text, not that every word came from a machine 1. The figure says how sure the model is. It doesn't say how much of the essay a person wrote.
Long documents get split into segments before scoring, and the verdict is arithmetic on characters. The model card gives the thresholds: Human at 90 percent human characters, AI at 80 percent machine characters, Mixed in between 3.
A Mixed paper is pointing at a stretch of text, and what the AI-Assisted label marks on a mixed paper is a different question from what the document verdict says.
Segmentation cuts the other way too. Pangram's chief executive told Nature in August 2026 that a paragraph judged human on its own can switch to AI once it sits inside a larger segment 5. A student who pastes one flagged paragraph into a free checker and gets a clean result has not settled anything, since the paragraph was scored as a different input. A teacher who pastes it and gets a worse one has not settled anything either.
A second opinion from a different detector is a different kind of input, and a fragment gives it less to read than a whole essay does. Human's public check reads up to 1,200 words, one paper a day, with no account, so a longer essay is a partial read there. Human's detector scores the text in memory and de-identifies any personal information for additional training. Human reports its false-flag count as its own in-house measurement on its own held-out documents, as of September 2026, not an outside audit: 0 wrongly flagged by Human's default model of 600 human-written papers it had never been trained on; the ceiling on that is 0.498%. Treating that count as the odds on one particular essay is an assumption. This is an estimate from our detector. A flag should be reason to look closer and not verified proof of cheating. A second reading does not replace the drafts.
Which Ordinary Tools Can Set Off a Flag?
Pangram names five of them on its own guidance page: grammar checkers such as Grammarly that write as well as correct, translation tools built on language models, the Help me write feature in Google Docs, phrasing carried over from a brainstorming chat, and asking ChatGPT for wording advice 1. The page lists these as uses of AI that may trigger detection, and whether any of them breaks a course's rules depends on that course's policy 1.
Bloomberg Businessweek, testing detectors other than Pangram in 2024, reported that Grammarly's rewriting features turned work that read as fully human into fully machine-written, while plain spelling and grammar fixes had only a marginal effect 6. Whether Pangram reads the same edits the same way is not something that report shows. Which Grammarly feature was switched on separates an edited sentence from a generated one.
Pangram's own page calls this a mismatch 1: what a teacher counts as cheating, what a student counts as cheating and what sets off a detector are three different lines. The page's fix is an AI-use policy, and it links a tier system so that students and teachers agree on which assistive tools are allowed 1.
Write the Reply Around the Process, Not the Percentage
A reply that works is short and attaches the record. It names the file the essay was drafted in, offers the version history, and asks for a meeting. The notes and the sources go in as attachments. If a vendor-stated limit applies, one sentence citing the vendor's own page carries it; a general argument about detector accuracy is weaker ground for a student, and it moves the conversation off the page the vendor wrote. Attach that page instead.
The record also has to arrive in readable form, and what a Google Docs version history can and cannot show is worth checking first.
A clean typing record is not proof by itself. Process documentation, argues a 2026 framework in Frontiers in Artificial Intelligence, is evidence of engagement rather than proof of independent authorship, since an artifact can be staged 7. That limit lands better coming from the student than from the instructor.
So the record goes over as the account of how the essay was made, next to the essay itself. The email after an AI flag and what a student can actually show cover the wording and the evidence in detail.
One line on Pangram's guidance page cuts the other way. A record of repeated flags counts, and the benefit of the doubt thins each time 1.
Common questions
Does Pangram's own material treat a flag as proof?
No. The Pangram 4 model card states that the model has a non-zero error rate and that false accusations of AI use cause serious harm 3. The guidance page describes a positive reading as the start of an investigation rather than the end of one 1. Pangram's chief executive told The Atlantic in May 2026 that the tool should never be the ending arbiter, and that the company looks into every reported error 4. The vendor's own material leaves the decision to the people investigating 14.
Is a two-paragraph response long enough for Pangram to read?
Pangram's model card says the model is intended for writing of at least 50 words in complete sentences 3. Its September 2026 post goes further and recommends against screening short bullet lists, outlines, single-sentence responses and highly formulaic text at all 2. A two-paragraph post in complete sentences that clears 50 words is inside the model card's stated use 3. If the flagged response is one of the forms the post names 2, saying so in the first reply cites the vendor's own limit. If it is not, the limit does not apply.
Can the same essay come back with a different reading?
A fragment can. Pangram's chief executive told Nature that a paragraph judged human on its own could switch to AI once it sits inside a larger segment 5. A paragraph pasted on its own is a different input from the same paragraph inside the essay. Nothing cited here says the same whole essay scores differently twice.
Does Pangram explain which sentences made it flag the essay?
It highlights segments, not reasons. The product marks which stretches of text read as machine-written, which is where a conversation about a specific paragraph can start 1. What it doesn't produce is an explanation. Pangram's chief executive described the model's inner workings to The Atlantic as pretty uninterpretable 4. A student asking why one sentence was flagged won't get an answer from the tool, so the useful request is the highlighted report itself rather than a rationale.
What counts as a writing process artifact besides a Google Doc?
Pangram's guidance page asks what research was done and whether notes and early drafts were saved 1. Read broadly, that question reaches a long way: library records and database searches, annotated PDFs, handwritten notes photographed with a date, outlines emailed to a study partner, and earlier graded work in the same voice. A file with a long editing history is what the page itself calls "some very compelling evidence" 1. Several ordinary sources assembled into a paper trail answer the same question, which is how the essay came to exist.
References
- 1.What to do when a student submission is flagged as AI Pangram Labs (Max Spero), 2025. pangram.comPangram's own guidance: look at writing process artifacts, notes and early drafts, check Google Docs version history, talk to the student, and treat a flag as the start of an investigation.
- 2.All About False Positives in AI Detectors Pangram Labs, 2026. pangram.comThe 15 September 2026 post: roughly 1 in 10,000 overall; academic writing at 0.02 percent in its summary and academic essays at 0.004 percent in its domain table and Turnitin comparison; and the advice against screening short or formulaic text.
- 3.Pangram 4 Model Card Pangram Labs, 2026. pangram.comThe 50-word intended-use floor, the character arithmetic behind Human, Mixed and AI verdicts, and the stated non-zero error rate.
- 4.America Has a Pangram Problem The Atlantic (Matteo Wong), 2026. theatlantic.comSpero on the tool never being the ending arbiter and on the model being uninterpretable, plus the scale arithmetic on a 1 in 10,000 rate.
- 5.AI-detection tools have made huge leaps forward - how good are they? Nature (Naddaf and Van Noorden), 2026. nature.comSegment chunking: a paragraph judged human in isolation can switch to AI inside a larger segment.
- 6.AI Detectors Falsely Accuse Students of Cheating-With Big Consequences Bloomberg Businessweek, 2024. cs.utexas.eduGrammarly's rewriting features flipped a human-written essay from fully human to fully machine-written; spelling and grammar fixes barely moved it.
- 7.Designing AI-Resilient Assessment in Higher Education: A Four-Pillar Conceptual Framework Frontiers in Artificial Intelligence, 2026. frontiersin.orgProcess documentation is evidence of engagement rather than proof of independent authorship, since process artifacts can be fabricated.
7 sources, numbered by first appearance.
General guidance for teachers, administrators and students. What holds at one institution, on one assignment, may not transfer to another.
Human checks whether a piece of writing can be verified as written by a person, and shows the sentences behind the result. It does not report a probability that a person used AI, it does not check for plagiarism, and no number it produces stands for a student's honesty. A flag should be reason to look closer and not verified proof of cheating.