Skip to content

ClassroomFor teachers

How to Collect an In-Class Writing Sample and Read an Essay Against It

Early in the term, and again around the midpoint, give 20 to 25 minutes of one class to a prompt tied to the course reading, no devices, and collect roughly 300 to 500 supervised words from every student. Those numbers are a working rule, not a measured threshold. File each sample by name. When a later essay reads out of character, put the two side by side and note what changed: sentence length, habitual errors, citation habits, register. A shift is a reason to ask questions, not a finding.

Olive Staff & OliveUpdated

What Does an In-Class Writing Sample Need to Contain?

A few hundred words, written in class early in the term with nothing open and nobody helping. This article's working rule is 300 to 500 words in the first two weeks; it is a rule of thumb, not a measured threshold. The prompt has to produce the same kind of writing the course will grade later. GPTZero's teacher guide puts a short in-class piece first, ahead of any scan, and calls it a snapshot of a student's natural writing voice 1.

Length matters more than it looks. A very short sample leaves too little of a student on the page for a comparison to mean much, and the working rule assumes a class period does not yield much more than 500 words by hand.

ElementWhat works
LengthAbout 300 to 500 words (a working rule)
TimeAbout 20 to 25 minutes of one class
WhenEarly in the term, and again around the midpoint
ConditionsSupervised, phones and laptops away, or a locked browser if typed
PromptA claim about a short course reading, backed by two reasons
StorageThe course space, filed under the student's name

Two samples beat one. The reason is the objection that arrives in every misconduct meeting: students get better. A single September page makes ordinary growth look like substitution. A September page and a late-October page show the slope, which is what a December essay has to be read against.

Say out loud what the sample is for on the day it is collected: so that nobody is accused on the strength of a score alone. A class that learns of it first in a disciplinary meeting has reason to read it as surveillance.

Write the Prompt So Two Pieces of Writing Stay Comparable

The prompt has to pull the same muscles as the assignments that follow, and a personal narrative pulls none of the ones a source-based argument needs. Give the class a short passage from the course reading and ask for a claim about it with two reasons, in whatever form comes naturally, then keep that prompt reusable so the second sample can be read against the first.

The shape that travels: a passage everyone has already read, a question with more than one defensible answer, and an instruction to take a position. No research, no citation format, no choice of topic. Choice of topic is one of the quickest ways to make two samples incomparable.

The sample is not a graded assignment. Marking it for correctness turns it into a performance, and a performance is the wrong baseline. Collect it, read it once, then file it. That one reading is the part that pays off in December.

GPTZero's guide tells teachers to pay attention to patterns 1. Quality is the wrong thing to read a sample for; habits are what survive into a later essay. A word the student reliably misspells. British and American spellings used interchangeably. Long unbroken sentences, or short flat ones. Vocabulary that is either narrow or unusually adventurous 1. Those are what a comparison can see.

A course where the writing happens in visible stages collects the same evidence without a separate exercise. The assignments that survive AI are the ones where a proposal, an annotated source list and a rough draft all exist before the final file does.

Where Should the Samples Live, and for How Long?

In the course space the school already runs, under each student's name. Not a personal drive, not an email thread, not a phone camera roll. Under FERPA (34 CFR 99.10, current as of 2025), which covers US schools that receive federal education funds, a student who is 18 or in college, or a parent of a younger student, can ask to inspect education records, and the school must comply within a reasonable period and no later than 45 days 4.

A sample filed there is likely to count as an education record; the school's records office decides.

Retention is the easier half of the question. Keep a sample through the grade appeal window and any open integrity case, then delete it or hand it to the school's records process, whichever the school's retention schedule requires. Retention is the school's rule, not the instructor's, and files about a named student that no longer serve a purpose are worth clearing out where that rule allows.

Three places a sample should not end up:

  • A personal laptop or a private cloud account that leaves with the instructor at the end of term.
  • An email thread, which scatters copies the school cannot gather again on request.
  • A third-party detection tool, uploaded as a reference document. Handing a student's unpublished writing to an outside vendor to store is a different decision from running one check, and it belongs to the school rather than to one instructor.

Handwritten pages photograph fine. Name each image by student identifier and date. One image per page, sitting in the same course space the essays land in, is enough to make the comparison reproducible six weeks later.

How Should a Later Essay Be Read Against the Sample?

Read for the habits that persist. Set the two texts side by side and look at four things: recurring spelling and punctuation habits, how long the sentences run and how much that varies, the way sources get introduced, and the words the student reaches for under time pressure. Quality is expected to rise over a term. Habits mostly don't.

Four comparisons that carry information:

  • Habitual error. A student who has misused the semicolon since September, then suddenly never does, in a paper whose argument is no sharper than before.
  • Sentence rhythm. Supervised, timed writing often runs uneven. A paper whose sentences all land within a few words of each other may have been through something: a grammar tool, a tutor, a model. Or that is how the student writes when there is time. Either way it's one question to ask, not a conclusion.
  • Source handling. How a student introduces a quotation is a habit the course teaches. A new convention appearing correctly on the first attempt is worth one question.
  • Register. Vocabulary that climbs two levels while the argument stays where it was.

None of the four settles who wrote the essay. What a comparison does is narrow a vague suspicion into something specific enough to ask about, and the next move is a request for the drafting history rather than a scan. The version history of the document shows whether a paper was built or whether it arrived.

Then ask the student. Two questions about one paragraph go further than a percentage: why that source, and what got cut. That conversation is close to the oral defense that Harvard College's academic integrity resources list as a way to evaluate comprehension and let students explain their process, including how AI was used 6.

The whole sequence, with software last, is the five checks in order.

Why a Voice Shift Is Not Proof

Because style moves for reasons that have nothing to do with a chatbot. A writing center appointment. A grammar checker. A term of reading, or a topic the student already knew well. An essay drafted over two weeks instead of 40 minutes. When the Stanford team had ChatGPT simplify the word choices in US eighth-grade essays, the average misclassification rate across the seven detectors went from 5.19 percent to 56.65 percent 2.

Detection software makes the same case for keeping the comparison first. Bloomberg Businessweek ran two detectors over 500 college application essays submitted to Texas A&M University in the summer of 2022. That was before ChatGPT was released, which all but guarantees they were written by people 3. Between 1 and 2 percent came back flagged on that one set of essays, some with near total certainty 3.

The bias has a seam, and it is the one a baseline is meant to protect. In the same Stanford study, having ChatGPT enrich the vocabulary of the human TOEFL essays dropped the average false positive rate from 61.22 percent to 11.77 percent 2. The flag rate moved with word choice. A class with many non-native English writers has a particular reason to keep the comparison first, since the flag rate in that study was highest on their essays 2, which is why detectors and non-native English writers is a policy question before it is a classroom one.

A baseline does not settle a case either; in the one case this article cites, the student's evidence was the drafting history 5. The referral at UC Davis began with a professor running an exam through a detector. William Quarterman, the senior who wrote that exam, answered the accusation with the edit history of the document he wrote it in, which showed the paper being built over two or three hours, and was eventually cleared 5. The sample is what tells an instructor whether asking for that history is worth the afternoon.

Software goes last, and a teacher who reaches for it after the side-by-side reading has a specific question for it to answer. Human fits that slot: paste up to 1,200 words of the suspect essay at human.olive.is (one paper a day, no account) and it reports how much of the text reads as machine-written or machine-edited, sentence by sentence, with a document verdict of Human, Mixed or AI. Its own in-house measurement as of September 2026, on its own held-out set, with no outside audit, is 0 wrongly flagged by Human's default model of 600 human-written papers it had never been trained on; the ceiling on that is 0.498%. Human is tuned for college-level academic writing; how that rate carries to another class's essays is an assumption, not a measurement. This is an estimate from our detector. A flag should be reason to look closer and not verified proof of cheating. Human's detector scores the text in memory and de-identifies any personal information for additional training. Read beside the baseline, the reading is one more difference to ask the student about, and the drafting history is still the next thing to ask for.

Common questions

How many words does an in-class writing sample need to be?

About 300 to 500 words, a working rule rather than a measured threshold; no cited source names a length. A very short sample leaves too little of a student's habit on the page to compare anything against, and much above 500 does not fit a class period when the writing is done by hand. The 20 to 25 minutes is sized to that range, on the same working rule. A second sample midway through the term matters more than a longer first one.

Should the sample be handwritten or typed?

Handwritten is easier. It needs pens, paper, phones away and a photograph of each page filed afterwards. Typed samples give cleaner text for a side-by-side reading and are easier to store, but only where the devices are locked down. That means a proctored browser or a school-managed machine with nothing else open. An unsupervised typed sample is a weak baseline, because nothing shows whose writing it is.

What if a student's writing genuinely improves during the term?

That's the common case, and it's the reason one sample is weak and two are better. A September page and a page from week 8 show the direction and the pace of a student's growth, which makes a December jump either consistent with that slope or not. Real improvement also arrives unevenly: the argument sharpens while habitual punctuation errors stay put. A change that lands everywhere at once is the pattern worth asking about.

Can an in-class writing sample be used in an academic integrity case?

It can be shown as context; it settles nothing on its own. A comparison of two texts is the instructor's own interpretation. Under FERPA (34 CFR 99.10, current as of 2025), which covers US schools receiving federal education funds, an eligible student or a parent can ask to inspect education records, and the school must comply within a reasonable period and no later than 45 days 4. A sample filed there is likely to count as one; the school's records office decides. Whether the student may respond to the comparison is the school's integrity procedure, not federal law. In the reported UC Davis case the student answered the accusation with the edit history of his document, and was eventually cleared 5.

Does a baseline sample replace an AI detector?

No, and the two answer different questions. A baseline asks whether this essay looks like the writing this student produced under supervision, which is specific to one person and says nothing in general. A detector asks whether the text carries the statistical marks of machine generation, which is general and blind to the individual. Run the comparison first. It costs no money and no upload, and it decides whether a scan is worth running at all.

When should the baseline be collected?

In the first two weeks of term, before any graded writing is due. A sample collected after a first flag is not a baseline, because it is written under suspicion, by one student, for one case. A second sample around week 8 is worth another 20 minutes, since it turns a single data point into a trajectory, and a trajectory is what answers the objection that students improve.

References

  1. 1.How to check if a student used AI (Teacher's Guide) GPTZero, 2025. gptzero.meStep one of six is establishing a baseline: a short piece written in class without devices, kept alongside earlier assignments, read for patterns such as recurring misspellings and mixed British and American spelling.
  2. 2.GPT detectors are biased against non-native English writers arXiv (Stanford University; published in Patterns), 2023. arxiv.orgSimplifying the word choices in US eighth-grade essays raised misclassification from 5.19% to 56.65%; enriching the vocabulary of human TOEFL essays cut the average false positive rate from 61.22% to 11.77%.
  3. 3.AI Detectors Falsely Accuse Students of Cheating-With Big Consequences Bloomberg Businessweek, 2024. cs.utexas.eduTwo detectors falsely flagged 1% to 2% of 500 Texas A&M application essays submitted before ChatGPT was released, some with near-total claimed certainty. Copy of the October 18, 2024 Businessweek article hosted on a University of Texas at Austin course reading list; the publisher's page is behind a paywall.
  4. 4.34 CFR 99.10, What rights exist for a parent or eligible student to inspect and review education records? Legal Information Institute, Cornell Law School, 2025. law.cornell.eduUS federal rule: a school must comply with a request for access to education records within a reasonable period and no later than 45 days.
  5. 5.He Was Falsely Accused of Using AI. Here's What He Wishes His Professor Did Instead Tech & Learning, 2023. techlearning.comWilliam Quarterman cleared himself with a document edit history showing the exam being written over two or three hours.
  6. 6.Academic Integrity and Teaching With(out) AI Office of the Secretary of the College, Harvard College, 2026. secretary.college.harvard.eduLists oral presentations as a way to evaluate comprehension and let a student explain their process, including how AI was used.

6 sources, numbered by first appearance.

General guidance for teachers, administrators and students. What holds at one institution, on one assignment, may not transfer to another.

Human checks whether a piece of writing can be verified as written by a person, and shows the sentences behind the result. It does not report a probability that a person used AI, it does not check for plagiarism, and no number it produces stands for a student's honesty. A flag should be reason to look closer and not verified proof of cheating.

Human

Check a paper

Paste a paper and see whether it is verified as human, with the sentences behind the result. One check a day needs no account. Our detector scores the text in memory and de-identifies any personal information for additional training.