Skip to content

PolicyFor administrators

Four Clauses an AI Detector RFP Needs Before a Bid Can Be Scored

An AI detector RFP for a school district should turn four questions into contract requirements rather than evaluation criteria. Which measured set sits behind each accuracy figure, and who ran the measurement. What happens to student writing, meaning retention, deletion and training. How a parent or eligible student gets to the report. Which threshold the product ships with, costed at the district's own submission volume. A question a bid leaves blank is a term the district doesn't have.

Olive Staff & OliveUpdated

What Should an AI Detector RFP Require Instead of Ask?

A vendor-questions checklist produces answers a district can't enforce. An RFP produces terms. The conversion is mechanical: each question becomes a requirement with a named deliverable, a format and a consequence for a blank. Four families carry most of the weight: evidence for accuracy claims, data handling for student writing, the student's route to the report, and the thresholds the product arrives with. The table below turns six evaluation questions into clauses inside those four families.

The questions to ask an AI detection vendor belong to the evaluation stage. This is the document stage, where an answer has to land in a form a procurement officer can score and a general counsel can sign.

The question at evaluationThe clause in the RFP
How accurate is it?Every figure arrives with document count, writer population, length floor and date.
Has anyone else checked?Name any evaluation run by someone other than the bidder, with a link.
What happens to student work?Retention period, deletion route, training prohibition, sub-processor list.
Can a student obtain the result?Full report per document, exportable and shareable with a parent or eligible student.
What threshold ships?The default point, every alternative, and the one arriving on day one.
What does it refuse to answer?Minimum document length, and the content types outside scope.

A bid that answers five of the six is not a partial win. The blank one is the term that gets argued about in March.

Require the Measured Set Behind Every Accuracy Figure

Require the set, not the number. A bid that quotes a false positive rate says how many documents produced it, who wrote them and how long they were, and it dates the measurement. Nature's 2026 review of detection tools found that only the accuracy rates firms announce from internal testing can be current, and that those are not externally verified 1.

A rate with no set behind it is marketing copy.

The condition attached to a figure matters more than the figure. Turnitin puts its document-level false positive rate under 1%, and says in the same post that the number holds for documents its model reads as 20% or more AI writing 2. That is a real measurement with a real scope. A district that quotes the first half without the second has put the wrong sentence in a board memo.

Whose writing sat in the set is the question that decides equity. Seven detectors tested on 91 TOEFL essays by non-native English writers wrongly flagged more than half of them, an average false positive rate of 61.3% 3. No headline accuracy figure exposes that. A clause requiring results broken out by writer population does.

The requirement is answerable, which is worth saying to a bidder who calls it unreasonable. Pangram Labs publishes a per-domain table in its Pangram 4 model card, with academic writing in English at a 0.019% false positive rate across 62,971 documents 4. Domain, rate, set size, in one row. A bid that can't produce a table of that shape hasn't measured itself in the way a district needs.

Require the date beside the figure as well. Models change. A model released in July is not the model the case study was written about.

Write the Data Terms a District Already Owes

A district already owes FERPA's terms on every paper it keeps: student papers are education records, directly related to a student and maintained by the district or a party acting for it 12. Those obligations travel to a detector. FERPA treats an outside provider as a school official only where it performs a service the district would otherwise use employees for, stays under its direct control over those records, and is bound by FERPA's limits on passing the records on 5.

That test is contract language. The RFP writes it rather than assuming it.

The full argument sits in FERPA and student papers sent to a detector.

Department of Education guidance on online educational services adds the part that gets skipped. The provider has to meet the criteria the district's annual FERPA notice sets out for a school official with a legitimate educational interest 6. The guidance says a signed contract is the common way a district establishes the direct control the exception demands, and that a Terms of Service the district agreed to can carry the same provisions 6.

Three clauses then do the work:

  • Retention. How long a submission is kept, in what form, and whether the clock starts at upload or at the close of an integrity case.
  • Deletion. A route the district can trigger on request, with a completion deadline rather than a best effort, and confirmation in writing.
  • Training. Whether student writing enters a training set at all, written as a prohibition rather than described as a current practice.

Where a vendor's service collects personal information from students under 13, COPPA can apply to the operator. The Federal Trade Commission places that compliance on the operator rather than the school, and says an operator should not write the opposite into its terms of service 7. An RFP can reject that shift by name. A bid that carries it inside a linked online agreement has answered the question without meaning to. The K-12 specifics are in COPPA and student writing.

Illinois already folds the federal test into state contract law: an operator agreement must state on its face that the operator acts as a FERPA school official with a legitimate educational interest 8. A district in another state can borrow the sentence.

Who Can Obtain the Report, and How Fast?

A parent or eligible student, through the district, inside 45 days. FERPA gives a parent or eligible student the right to inspect and review education records. The school must answer within a reasonable period, and no more than 45 days after receiving the request 9. Where the detector report sits in a vendor system the district can't export from, the deadline still belongs to the district.

Department of Education guidance says it directly: where a provider holds education records, the school and district must be able to provide the requesting parent or eligible student with access to those records 6. The RFP turns that into a deliverable rather than an assurance: the full report, per document, exported in a readable format, on request, at no additional charge.

Three things belong in that export before a district can hand it to a family. The verdict or score, with the scale it sits on. Every passage the product marked, in place. And the model version and date that produced the reading, so the same document can be re-run in six months and the difference explained.

A screenshot of a dashboard is not the record a hearing needs. A number with no version attached is hard to defend at one.

Charging per export is the quiet failure here. A per-report fee turns a records request into a budget line, and a budget line is how a district ends up hesitating over something it's obliged to produce.

How Should a Bid State the Threshold It Ships?

As a number. The bid names the default and names who owns the setting. A detector converts a continuous score into a verdict somewhere, and where that line sits decides how many papers a district argues about. Turnitin marked AI scores below 20% with an asterisk in May 2023 because the score is less reliable in that band, and raised its minimum document length from 150 words to 300 10. Since July 2024 it attributes no score there 13.

Run the arithmetic on district volume before the award rather than after the first complaint. Vanderbilt ran the sum in public: 1% of the 75,000 papers it sent Turnitin in 2022, around 750 papers that could have been incorrectly labeled 11. The sum assumes a rate measured on Turnitin's own set holds for Vanderbilt's papers. It also counts every submission rather than only the human-written ones a false positive can land on, so it is an upper bound on documents.

The rate reads as small. The count is 750 documents somebody has to read again.

The same arithmetic at a district's own numbers takes five minutes and belongs in the board packet.

An RFP can require a bidder to list every operating point the product supports and say which one arrives by default. One vendor's answer to that clause already sits on a public page: Human lists three points: accusation-safe flags a paper above 15% machine content, standard above 6% (the default), sensitive above 2%. Its false-flag figure, measured as of September 2026, is 0 wrongly flagged by Human's default model of 600 human-written papers it had never been trained on; the ceiling on that is 0.498%. This is an estimate from our detector. A flag should be reason to look closer and not verified proof of cheating. Both figures are Human's own in-house measurements on its own held-out set rather than an independent audit, which is the distinction the evidence clause exists to draw.

A threshold the district can't change is a policy the vendor wrote. A threshold any teacher can change per assignment is a policy nobody wrote. The RFP should say which of the two the product is. A setting with no named owner is the one that gets changed without anyone deciding to change it.

Score the Bid on District Writing, Not a Demo

Require a pilot on papers the district already holds, de-identified, from its own students. Vendor benchmarks run on corpora the vendor picked. A district that scores several hundred of its own passing papers through each finalist learns the one number no vendor benchmark can supply, which is how many of its own students' submissions come back flagged, broken out by course, grade level and language program.

Two conditions keep it honest. The papers predate the product's public release wherever the archive allows, so nothing in the set was written against it. And the same set goes through every finalist at each product's default setting, with no bidder told which papers are in it.

Write the consequence in as well. A bidder that won't support a pilot on district data has told the evaluation team something about the product. So has one that supports a pilot only after a term sheet is signed.

The clause procurement forgets is the one about what happens after a flag. A detector contract silent on appeals hands the design of the appeals process to whoever happens to be in the room the first time a student disputes a verdict. The RFP can require the deliverables an appeal needs: the report, the model version, and an export the student can read without a license.

None of these clauses asks a bidder for a promise. Each asks for a document that either exists or doesn't, which is why the envelopes sort themselves.

Common questions

Can a district require a vendor to publish the set behind its accuracy figure?

Yes, and at least one vendor already publishes that shape of evidence. An RFP can require every accuracy figure to arrive with its document count and writer population, plus the length floor and the measurement date. Pangram Labs gives a per-domain table in its Pangram 4 model card, with academic writing in English at a 0.019% false positive rate across 62,971 documents 4. Nature's 2026 review found that only the figures firms announce from internal testing can be current, and that they are not externally verified 1. That is the reason the clause exists at all.

Does FERPA let a district send student papers to a detection vendor?

Yes, where every condition of the school official exception is met, on terms the contract sets out. FERPA treats an outside provider as a school official where it performs a service the district would otherwise use employees for and stays under the district's direct control over the education records, and is bound by FERPA's limits on passing the records on 5. Department of Education guidance adds that the provider must meet the criteria in the district's annual FERPA notice, and that a signed contract is the common way that direct control gets established 6. All of it is contract language, which is why the RFP states it instead of trusting it.

What retention terms belong in a detector contract?

Three, stated separately. How long a submission is kept and in what form, including any copy held for product improvement. A deletion route the district can trigger on request, with a completion deadline rather than a best effort. And a flat prohibition on training any model on student writing, written as a term rather than described as current practice. Add a sub-processor list beside them. A retention promise means little without the names of everyone holding a copy.

Should the RFP set the threshold, or leave it to the vendor?

The RFP states the requirement and the district sets the number after the pilot. A bid should list every operating point the product supports, name the one that arrives by default, and say who is allowed to change it. Turnitin's own history shows why the band matters. It added an asterisk to AI scores below 20% in 2023, raised its document minimum from 150 words to 300 10, and in July 2024 stopped attributing a score in that band at all 13. A threshold nobody can see is a policy nobody voted on.

How many papers should a detector pilot cover?

Enough that a false positive count is readable, which means several hundred known-human papers rather than a dozen. Arithmetic settles it. Take the document-level rate Turnitin publishes, under 1% for documents it reads as 20% or more AI writing 2. A 200-paper pilot produces at most about 2 flags and decides nothing. A term of known-human submissions produces a number a board can act on. Vanderbilt ran the sum at its own scale, 75,000 papers in 2022 and around 750 that could have been incorrectly labeled 11. That figure assumes Turnitin's rate held for Vanderbilt's papers and counts every submission, so it is an upper bound.

What should a district do when no bid clears the evidence bar?

Buy nothing and keep the work. A district can require the four clauses, run the pilot and conclude that the flag rate on its own students' writing is higher than the appeals process can absorb. That is a finished procurement rather than a failed one. It leaves behind three things: a measured number for the local population, a written record of what was asked, and a reusable clause set for the next cycle, when the models and the vendors will both have moved.

References

  1. 1.AI-detection tools have made huge leaps forward — how good are they? Nature, 2026. nature.comSupports the evidence clause: only the accuracy rates firms announce from internal testing can be current, and those are not externally verified.
  2. 2.Understanding the false positive rate for sentences of our AI writing detection capability Turnitin, 2023. turnitin.comSupports the document-level false positive rate under 1% and the condition attached to it, documents read as 20% or more AI writing.
  3. 3.GPT detectors are biased against non-native English writers Patterns (Cell Press), 2023. pmc.ncbi.nlm.nih.govSupports the 61.3% average false positive rate across seven detectors on 91 TOEFL essays by non-native English writers.
  4. 4.Pangram 4 Model Card Pangram Labs, 2026. pangram.comSupports the worked example of a published per-domain table: academic writing in English at 0.019% across 62,971 documents.
  5. 5.34 CFR 99.31, Under what conditions is prior consent not required to disclose information? Legal Information Institute, Cornell Law School, 2025. law.cornell.eduSupports the FERPA school official test: an institutional service the district would otherwise use employees for, under the district's direct control.
  6. 6.Protecting Student Privacy While Using Online Educational Services: Requirements and Best Practices U.S. Department of Education, Privacy Technical Assistance Center, 2014. studentprivacy.ed.govSupports the annual FERPA notice criterion, the signed contract as the usual route to direct control (with a Terms of Service sometimes carrying the same provisions), and the district's duty to provide access to records a provider holds.
  7. 7.Complying with COPPA: Frequently Asked Questions U.S. Federal Trade Commission, 2020. ftc.govSupports the point that COPPA compliance rests on the operator and should not be shifted to the school in terms of service.
  8. 8.105 ILCS 85/15, Student Online Personal Protection Act, operator duties Illinois General Assembly, 2021. ilga.govSupports the Illinois requirement that an operator agreement state the operator is acting as a FERPA school official with a legitimate educational interest.
  9. 9.34 CFR 99.10, What rights exist for a parent or eligible student to inspect and review education records? Legal Information Institute, Cornell Law School, 2025. law.cornell.eduSupports the 45-day deadline for answering a request to inspect and review education records.
  10. 10.AI writing detection update from Turnitin’s Chief Product Officer Turnitin, 2023. turnitin.comSupports the asterisk on AI scores below 20% and the rise in minimum document length from 150 words to 300.
  11. 11.Guidance on AI Detection and Why We’re Disabling Turnitin’s AI Detector Vanderbilt University, Brightspace and Instructional Technology Support, 2023. vanderbilt.eduSupports the volume arithmetic: 75,000 papers submitted in 2022 and around 750 that could have been incorrectly labeled.
  12. 12.34 CFR 99.3, What definitions apply to these regulations? Legal Information Institute, Cornell Law School, 2025. law.cornell.eduSupports the definition of education records: records directly related to a student and maintained by an educational agency or institution or by a party acting for it.
  13. 13.Using the AI Writing Report Turnitin Guides, 2026. guides.turnitin.comThe current AI writing report: below the 20 percent threshold no score and no highlights are attributed and the indicator shows an asterisk with no percentage; reports generated before 8 July 2024 may still show a numerical score below 20.

13 sources, numbered by first appearance.

General guidance, not legal advice. Rules on academic integrity differ by institution, by state and by country, and they change often; anything here is worth checking against an institution's own counsel before it is acted on.

Human checks whether a piece of writing can be verified as written by a person, and shows the sentences behind the result. It does not report a probability that a person used AI, it does not check for plagiarism, and no number it produces stands for a student's honesty. A flag should be reason to look closer and not verified proof of cheating.

Human

Read the measurements

The measured operating points and the false-flag ceiling, for a policy or a procurement decision.