Skip to content

PangramFor teachers

Pangram and GPTZero Each Win Their Own Benchmark; Two Independent Tests Found Pangram Level or Ahead

GPTZero's own head-to-head puts GPTZero first: its 9 October 2025 post scores it 99.6% accurate and Pangram 97.5% [1]. Pangram's own September 2026 post puts GPTZero's false positive rate at 2.01% on a subset of Pangram's data, twice the 1% figure Pangram says GPTZero claims [2]. Outside both companies, a June 2026 peer-reviewed study of 160 constructed academic documents found Pangram ahead [8], and Epoch AI's July 2026 author-imitation test found the two just two passages apart [3].

Olive Staff & OliveUpdated

What Does Each Vendor's Benchmark Actually Report?

Each benchmark ranks its own publisher first. GPTZero's comparison page, dated 9 October 2025, gives GPTZero 99.6% accuracy, a 0.13% false positive rate and 99.4% recall, against Pangram at 97.5%, 0.20% and 95.4% 1. Pangram's false positives post, dated 15 September 2026, puts its own rate at roughly 1 in 10,000 and GPTZero's at 2.01% 2.

FigureGPTZero's 9 October 2025 page 1Pangram's 15 September 2026 post 2
GPTZero, human text wrongly flagged0.13%2.01%
Pangram, human text wrongly flagged0.20%about 1 in 10,000
Who ran the testGPTZeroPangram

Both pages are specific, and neither can be set against the other. GPTZero's own comparison page puts its rate at 0.13% 1, while the 1% Pangram measures against is the figure Pangram attributes to GPTZero 2. The two companies don't even agree on what GPTZero claims.

GPTZero's table does its real work in the per-model rows. It has GPTZero catching 97.2% of o3 output against Pangram's 85.1%, and 96.6% of Gemini 2.5 Pro output against 85.6% 1. Both are 2025 readings of a 2025 product.

Pangram 4 replaced Pangram 3.3.2 on 29 July 2026 6, so the Pangram in GPTZero's table isn't the one a district would license this term. A comparison ages as fast as the products in it do, and the October 2025 page carries no later rerun 1.

Why Can Both Tables Be Right at the Same Time?

Because each was measured on a set the other company can't inspect. GPTZero's post says the table reuses the set from its September 2025 Copyleaks and Originality.AI benchmark 1, and that benchmark describes 3,000 samples, half human and half AI 9. Neither post publishes the set. Pangram's post raises that exact objection about published competitor figures: "a naked number in isolation like this does not tell the whole story" 2.

Then Pangram's post does the same thing. It says the origin of an evaluation set and its possible biases can't be seen from outside, and later it reports an internal benchmark of GPTZero run on a subset of Pangram's general set, finding 2.01% rather than the 1% figure Pangram attributes to GPTZero 2. One vendor is auditing another on data it doesn't publish.

So there are two unpublished sets and two winners. A school that buys on either table has bought a claim it can't audit, from a company with a stake in the result, about a product version that may already have been replaced. The figures aren't necessarily wrong; they're unverifiable. For a procurement file, that is the worse problem.

Nobody outside the two companies can reconcile the two results. Detector accuracy is two numbers rather than one, and both move with the corpus underneath.

GPTZero's own site makes the point without help from a rival. Its FAQ reports 99.1% of human articles classified as human and 98.4% of AI articles classified as AI, but only inside the high confidence band 5. That's a different pair of numbers from the 99.6% and 0.13% on the comparison page. It was measured under a different condition, and both live on gptzero.me.

What Did the Independent Tests of Both Find?

A peer-reviewed study in the International Journal for Educational Integrity, published in June 2026, compared GPTZero, Pangram, Copyleaks and Turnitin on 160 constructed academic documents with known authorship. The set mixed fully human, fully AI, hybrid and humanized papers. Pangram did consistently better than the other tools on the AI, hybrid and humanized ones, and all four correctly identified the fully human texts 8. The authors' conclusion is that detection tools shouldn't be the sole evidence in a high-stakes decision 8.

Epoch AI, a research firm in San Francisco 4 that sells neither product, published its own test on 15 July 2026. It scored Pangram 3.3.2, a May 2026 GPTZero model and Originality.ai 3. Neither Pangram nor GPTZero produced a single false positive on 495 human-written passages. On AI text written to imitate a named author, Pangram missed 30 of 297 passages, 10.1%, and GPTZero missed 32, 10.8% 3. Thirty against thirty-two isn't a difference a department can act on.

The rest of that result matters more than the ranking. Scientific writing was the hardest genre for all three detectors. Across them, about 26% of the imitated scientific passages went uncaught: Pangram missed 25 of 99 and GPTZero 24 of 99 3. If graduate coursework reads like the scientific writing Epoch imitated, which is an assumption about the coursework and not a finding of the test, that shared blind spot sits right where that coursework lives.

A 2026 Carnegie Mellon paper found a second one. Text from base language models is often judged overwhelmingly human by GPTZero and Pangram alike, while output from the instruction-tuned versions of the same models isn't 7. Neither vendor table predicts either finding.

Nature reached the general version of this in August 2026. Only the accuracy rates the firms announce from internal testing can be current, it said, and those aren't externally verified 4. A school reading two vendor pages is reading two unaudited claims, however precise the decimals look.

Which Published Limits Should Decide a Purchase?

The limits each company publishes about itself, since nothing cited here shows either side disputing them. Pangram's model card sets a floor of 50 words in complete sentences. It also names the writing the model isn't built for, among them source code, reference sections, templated writing and text dominated by mathematical notation 6. GPTZero's FAQ says its results should not be used to punish students 5.

Both companies also concede the failure a purchase order usually assumes away. Pangram's model card states that false accusations of AI use can lead to reputational damage, emotional trauma and other undue harm, and that the model has a non-zero error rate 6. A competitor's table will never carry that sentence.

One more spread deserves a read before anything is signed, and it comes from a single company. Pangram's false positives post gives roughly 1 in 10,000 overall 2. Its model card gives 0.0041%, about 1 in 24,000, on a million human-written FineWeb documents 6. Same vendor, two figures, and one is about two and a half times the other. The post's is a rounded overall rate it says moves with the kind of writing 2, and the model card's is on a named set. By the vendor's own account, what sits under the detector moves the number.

The same discipline applies to a Pangram and Turnitin comparison, where the two companies also measure on different populations of documents.

Ask These Five Things Before Either Tool Is Bought

Who measured the figure, and on whose data? How many documents, and is the set published? Which model version was tested, and on what date? What does the vendor say the tool can't do? And what happens, procedurally, when a flagged student says the work is theirs? Neither vendor page answers all five, so put the missing ones to the vendor directly.

Ask the fifth one first. It decides whether the other four matter.

A detector that is 99.6% accurate on a vendor's own corpus still produces flagged papers every term. The policy around the flag decides what a wrong reading costs a student, and the decimal in the table doesn't. Pangram's model card concedes the non-zero error rate in writing 6, and GPTZero's FAQ concedes the punishment question 5.

Human's numbers are a maker's numbers too. Held to the first of those five questions and the size half of the second, Human answers with its own in-house measurement on its own held-out sets rather than an independent audit, measured September 2026: at the standard point, which flags a paper above 6% machine content, 0 wrongly flagged by Human's default model of 600 human-written papers it had never been trained on; the ceiling on that is 0.498%. This is an estimate from our detector. A flag should be reason to look closer and not verified proof of cheating. The count describes documents, never students, and nobody outside Human has rerun it.

The benchmark worth trusting is the one a school can rerun.

Common questions

Which detector is more accurate, Pangram or GPTZero?

No vendor table settles it. GPTZero's 9 October 2025 table puts GPTZero ahead at 99.6% accuracy against Pangram's 97.5% 1. Pangram's 15 September 2026 post puts GPTZero's false positive rate at 2.01%, and its own at roughly 1 in 10,000 2. Outside the two companies, a June 2026 peer-reviewed study of 160 constructed academic documents found Pangram ahead on AI, hybrid and humanized papers, and every tool cleared the fully human ones 8. Epoch AI's July 2026 test found no false positives from either on 495 human passages. On author-imitation text they missed 30 and 32 out of 297, 10.1% and 10.8% 3.

Has anyone outside the two companies compared them?

Yes, on small sets. A peer-reviewed study in the International Journal for Educational Integrity, published in June 2026, put GPTZero, Pangram, Copyleaks and Turnitin through 160 constructed academic documents and found Pangram consistently ahead 8. Epoch AI published a test of Pangram, GPTZero and Originality.ai on 15 July 2026 3. A 2026 Carnegie Mellon paper found that text from base language models is often read as overwhelmingly human by both 7. Nature's August 2026 survey adds that current vendor rates aren't externally verified 4.

Why do the two vendor tables disagree so much?

Different datasets, and neither is published. GPTZero's table reuses the 3,000-sample set, half human and half AI, from its September 2025 Copyleaks and Originality.AI benchmark 19. Pangram's post objects to exactly that pattern in competitor figures, calling a naked number in isolation something that does not tell the whole story, and then reports its own internal benchmark of GPTZero on a subset of Pangram's data 2. Neither result can be reproduced outside the company that ran it.

Does either company claim its detector proves a student used AI?

Not in the pages cited here, and both warn against acting on a reading alone. Pangram's model card states that false accusations of AI use can lead to reputational damage, emotional trauma and other undue harm, and that the model has a non-zero error rate 6. GPTZero's FAQ says its results should not be used to punish students 5. A reading from either tool is a reason to open the draft history and talk with the student.

What should a school ask a detector vendor for?

Start with the size of the evaluation set and whether it's published. Then the model version and the date it was tested, the false positive rate broken out by kind of writing, and what the tool isn't built for. Pangram publishes the last of those: its model card names source code, reference sections, templated writing and text dominated by mathematical notation as outside scope 6. A vendor that can't answer the first two has supplied a number nobody can check.

Is a benchmark from 2025 still worth reading in 2026?

Only as a record of what was true then. Pangram 4 replaced Pangram 3.3.2 on 29 July 2026 6. Epoch AI's July 2026 test scored Pangram 3.3.2 3. GPTZero's October 2025 table names no Pangram version 1 and predates Pangram 4, so neither describes the product a school would license now. None of the independent tests cited here put Pangram 4 against GPTZero.

References

  1. 1.GPTZero vs Pangram: AI Detector Accuracy Comparison GPTZero, 2025. gptzero.meGPTZero's own head-to-head, dated 9 October 2025: GPTZero 99.6% accuracy, 0.13% false positive rate, 99.4% recall against Pangram at 97.5%, 0.20% and 95.4%, plus per-model recall rows including o3 at 97.2% against 85.1% and Gemini 2.5 Pro at 96.6% against 85.6%. States that it used the same dataset as the earlier Copyleaks and Originality.AI benchmark, linked from the post; the set itself is not published. Fetched 2026-09-18.
  2. 2.All About False Positives in AI Detectors Pangram Labs, 2026. pangram.comPangram's own post, dated 15 September 2026: puts Pangram's overall false positive rate at approximately 1 in 10,000, reports an internal benchmark finding GPTZero's false positive rate at 2.01% against the 1% GPTZero claims, and objects that a naked number in isolation does not tell the whole story because the provenance and possible biases of the evaluation data are unknown. Fetched 2026-09-18.
  3. 3.AI detectors rarely flag human writing, but sometimes miss AI text imitating real authors Epoch AI (Jaeho Lee), 2026. epoch.aiIndependent test published 15 July 2026 covering Pangram (version 3.3.2), GPTZero (model 2026-05-11-base) and Originality.ai: zero false positives for both Pangram and GPTZero on 495 human-written passages; on author-imitation text Pangram missed 30 of 297 and GPTZero 32 of 297; scientific text was the hardest genre for all three, about 26% missed across them, Pangram 25 of 99 and GPTZero 24 of 99. Fetched 2026-09-18.
  4. 4.AI-detection tools have made huge leaps forward — how good are they? Nature (Naddaf and Van Noorden), 2026. nature.comAugust 2026 news feature. Supports the sentence that only the accuracy rates the firms announce from internal testing can be current, and that those are not externally verified; also describes Epoch AI as a research firm in San Francisco, California.
  5. 5.Frequently asked questions GPTZero, 2026. gptzero.meGPTZero's own FAQ. Supports the high confidence band figures, 99.1% of human articles classified as human and 98.4% of AI articles classified as AI, and the statement that these results should not be used to punish students.
  6. 6.Pangram 4 Model Card Pangram Labs, 2026. pangram.comSupports the 29 July 2026 release date and the succession from Pangram 3.3.2, the 50-word floor and the out-of-scope list, the 0.0041% false positive rate on 1,000,000 human-written English FineWeb examples, and the model card's own statement that false accusations cause serious consequences and that the error rate is non-zero.
  7. 7.Base Models Look Human To AI Detectors Xu, Zhong, Raghunathan, Fang and Kolter, Carnegie Mellon University (arXiv), 2026. arxiv.orgSupports the shared blind spot: evaluated by GPTZero and Pangram, text generated by base models is often judged overwhelmingly human, while text from their instruction-tuned counterparts is not.
  8. 8.Who wrote this? Evaluating the reliability of AI detection tools in higher education International Journal for Educational Integrity (Van Vlasselaer, Van Droogenbroeck and Spruyt), 2026. link.springer.comPeer-reviewed, open access, vol. 22 art. 16, published 29 June 2026 (Crossref). Abstract (read via OpenAlex 2026-09-19): compares GPTZero, Pangram, Copyleaks and Turnitin on 160 synthetic academic documents (fully human, fully AI, hybrid, humanized); 'Pangram consistently performed better than the other tools'; 'All tools correctly identified fully human texts'; tools 'should not be used as sole evidence in high-stakes decision-making'.
  9. 9.GPTZero vs Copyleaks vs Originality: AI Detector Accuracy Comparison GPTZero, 2025. gptzero.meGPTZero's own benchmark post, dated 25 September 2025, linked from [1] as the source of its dataset: 'we tested 3,000 samples with half written by humans, half by AI', drawn from student essays, academic papers, textbooks, news, blogs and creative writing. Fetched 2026-09-19.

9 sources, numbered by first appearance.

General guidance for teachers, administrators and students. What holds at one institution, on one assignment, may not transfer to another.

Human checks whether a piece of writing can be verified as written by a person, and shows the sentences behind the result. It does not report a probability that a person used AI, it does not check for plagiarism, and no number it produces stands for a student's honesty. A flag should be reason to look closer and not verified proof of cheating.

Human

Read the measurements

The measured operating points and the false-flag ceiling, for a policy or a procurement decision.