Screening

Should You Still Ask for a Cover Letter If AI Writes Them All?

Keep the cover letter only where prose is the deliverable: communications, brand, policy, technical writing, fundraising. There it is a small work sample, and the ask should be 250 words to a named audience under a real constraint. On every other req, delete the field and put one required question in its place, capped at 100 words, about a trade-off your team argues about. Say AI is allowed, ask it of every applicant, and write down what a good answer contains before the first one lands.

The takeThe letter was also where a rejection could be made on taste and filed under fit. Nothing in it had to be written down, and nothing about it had to be applied the same way twice. Cheap prose pulled the cover off that. Nine times out of ten, a recruiter who says the letters all read the same is describing a stack that was always sorted on feel and now cannot be sorted at all without saying on what. That is not a loss worth mourning. It is a bill arriving late.

Where Olive fits

Open a role and see what the work shows

A cover letter is a document, and reading it carefully still cannot show you the person deciding anything. Olive is an employer-purchased assignment for the occupation, 40 to 60 minutes with an AI assistant, returned as six findings a human writes against timestamped moments in the session, and the candidate is granted the same report.

Rank your shortlist

Should you drop the cover letter entirely?

No. Drop it from most reqs and keep it on a few. The letter is a writing sample wearing the costume of a formality, so it carries real information exactly where writing is the work: communications, brand, policy, technical writing, fundraising. Federal occupational data rates writing importance at 97 out of 100 for technical writers and far lower for most other jobs 2. A blanket keep-or-kill policy gets half your postings wrong.

The fork is not seniority and it is not industry. It is whether prose is a deliverable the person will be paid to produce. A communications manager, a policy analyst and a grant writer ship writing as output, and a letter is a small honest sample of it. A staff engineer, a warehouse supervisor and a revenue-cycle specialist do not, and their letters were never evidence about the job.

On those reqs the letter was measuring effort, and effort is the part that broke. Twenty minutes of work used to separate people who wanted this job from people who wanted any job. That cost is now close to zero, the filter is gone, and what remains is a field every applicant fills and nobody reads, one contributor to the volume problem covered in what to do when applications per opening triple.

A blanket rule is what makes this expensive in both directions. Requiring letters on thirty open reqs means thirty stacks of a document that decides nothing. Dropping them everywhere means your one communications hire gets screened on a resume, which is the wrong instrument for the only role where the letter was still working.

What does an AI-written letter actually cost you?

Less than it looks, and not in the direction most people assume. In a field experiment with nearly half a million jobseekers in an online labor market, giving people algorithmic writing help on their resumes raised hires by 8%, and employers were no less satisfied with who they got 1. Clearer writing helped employers read ability rather than disguise it. What you lost is spread: when every letter clears the bar, none of them separates anyone.

That result is worth sitting with, because it contradicts the usual complaint. The fear is that writing help strips out a signal about the person. What the experiment found was closer to the opposite: better prose made ability easier for the reader to see, and satisfaction after the hire held 1. The letter was doing less signaling than the ritual around it suggested.

What did change is the distribution. When the median applicant writes at the level that used to mark the top of your stack, the sort you were making by feel stops sorting. The tell is no longer quality. It is specificity: whether anything in the letter could only have been written by someone who read the posting, used the product, or knows what your team argues about on a Tuesday.

Do not try to fix this by guessing which letters a model wrote. Detectors misclassify writing by people who learned English later as machine-generated, and simple prompting evades them 3, so the false positives land on the applicants you have the least reason to cut. Whether AI detectors work in hiring has a short answer, and the longer problem is that authorship was never the question: a stack of perfect-looking applications is a signal problem, not a fraud problem.

Replace the letter with one question a model answers generically

One required field on the application, capped at 100 words, tied to a decision your team actually argues about. The test for a good question is blunt: a fluent generic answer to it should be visibly generic. Ask about a trade-off inside your context (your pricing, your constraint, your users) and the non-answer sits there in plain sight next to a specific one.

The reqThe question on the applicationWhat the generic answer looks like
SalesWhich part of the pricing page would a prospect push back on first, and what would you say?Discusses 'communicating value' without naming a tier, a number or an objection
Customer supportA customer emails at 6pm about an outage with no fix yet. What goes in the first reply?Apologizes, promises to escalate, commits to nothing and asks for nothing
Software engineeringWhich requirement in this posting would you push back on before your first week?Praises the stack and restates the posting
MarketingWhich claim on the homepage would you cut, and what evidence would the replacement need?Recommends clearer messaging and more audience research, in general
Finance and analysisName a number in a model you would refuse to accept without recomputing it, and why.Says every assumption should be validated, names none
Recruiting and opsWhich step of this hiring process would you delete, and what breaks if you do?Suggests streamlining without naming a step

Five rules make the field work, and skipping any one of them turns it back into a cover letter.

  • Ask it of everyone, the same way. A question that decides who advances is a selection procedure, and applying it consistently is what makes it explainable later 4.
  • Say that AI is allowed. A ban you cannot enforce only teaches applicants that the honest answer is the risky one.
  • Write the answer key first. Three things a good answer contains, written before the first application arrives. Without it you will grade fluency by accident.
  • Grade content, not prose. A specific answer in clumsy sentences beats a polished one that names nothing.
  • Enforce the cap. A field with no word limit becomes a cover letter again inside a week.

The question also travels further than the letter did, because it can be reused in the phone screen verbatim: ask the applicant to say more about the answer they submitted. Someone who wrote it can extend it; someone who pasted it stalls. More options for the field, and what each one costs to read, are in what should replace the cover letter in a screen.

Keep the letter where writing is the deliverable

On communications, brand, policy, technical writing and fundraising reqs, keep the sample and change the ask. Instead of a letter about the applicant, request 250 words to a named audience under a stated constraint: a renewal at risk, a launch slipping, a policy nobody read. Say plainly that AI is allowed. Then ask the second half of the question: what the assistant got wrong, and what got cut.

The second half is the part that survives a model. An applicant who drafted with an assistant and edited hard can tell you which paragraph was a hallucinated benefit, which sentence assumed a fact about the audience that was not true, and why the version you are reading is shorter. An applicant who pasted the first output has nothing to say there, and the gap shows up in two sentences rather than two rounds.

Three things keep this fair and defensible. Give every applicant the same brief and the same constraint. Write the rubric before you read the first submission, so the standard is not set by whoever happened to submit first. And cap the time it should take, in the posting, because an open-ended writing sample quietly becomes unpaid work that filters for people who can afford to do it.

One caution on scope. A writing sample tells you about writing, and it will tell you almost nothing about how the person handles a confident wrong answer in a spreadsheet. If the posting is going to ask for AI skill on top of the writing, say what you actually require instead of putting 'AI-proficient' in the requirements and hoping the letter settles it.

What can a replacement question still not tell you?

Anything about the act itself. Whatever you put on the form comes back as a finished document, produced off-platform, with unlimited time and any tool the applicant owns. It can show you what someone chose to say about their judgment. It cannot show you the judgment: the moment a confident, wrong answer arrived and either got tested against something real or got shipped.

So treat the field as a sorting device for the first conversation, not as evidence for a decision. It earns its place by being cheap, consistent and hard to answer generically. It does not earn the weight people used to put on the letter, and stacking three of them does not add up to a work sample.

The weight belongs downstream, in one exercise run identically for every finalist and graded against something written beforehand. The arithmetic for that trade is in skipping the resume screen for a work sample. That is also where the honest limit of everything above sits: an application field can be gamed by anyone with an afternoon, and a work sample built for the occupation cannot be gamed the same way, because the interesting failures happen while the work is being done.

Several instruments cover that stage, and they are not equivalent: multiple-choice AI literacy tests, code-collaboration graders, unwatched take-homes, live AI interviews and in-house rounds all exist with different costs and different blind spots. Olive is one of them. Pick on what the role fails at, not on what is easiest to add to the pipeline this quarter.

See a sample report

Common questions

Does dropping the cover letter hurt candidates who write well?

It moves where they show it. On reqs where prose is the deliverable, the sample stays and gets sharper: 250 words to a named audience beats a letter about themselves. On every other req, strong writers were being read for a document that did not decide anything. A 100-word answer to a real trade-off gives them a better place to be good at their job, and gives every other applicant the same place.

Should applicants have to disclose whether AI helped?

Ask, but ask something worth answering. A yes-or-no disclosure box invites the safe answer and cannot be checked. A field asking what the assistant produced that got cut, and why, can be answered in two sentences by someone who did the work and not at all by someone who did not. State the policy in the posting, apply it to every applicant, and never treat a disclosed 'yes' as a mark against anyone.

Can a detector tell you which cover letters a model wrote?

No, and its errors are not evenly distributed. Detectors misclassify writing by people who learned English later as machine-generated, and simple prompting defeats them, so false positives concentrate on applicants you have the least reason to cut. Authorship is also the wrong question. A letter drafted with help by someone who knows your business is worth more than an unassisted one that names nothing specific.

What makes a good replacement question?

It cannot be answered without your context. 'Which part of our pricing would a prospect push back on first?' needs the pricing page. 'Why do you want to work here?' does not, and a model answers it perfectly while saying nothing. Cap the field at 100 words, ask every applicant the same question, and write down the three things a good answer contains before the first one arrives.

Where does Olive fit into this?

After the application, not inside it. Olive is an employer-purchased assessment: the candidate spends 40 to 60 minutes on a task built for their occupation with an AI assistant available, and a human reviewer writes six findings, each attached to a timestamped moment in the session. Outcomes are per dimension (demonstrated, partly demonstrated, not demonstrated) with no composite number and no hiring recommendation. The candidate is granted the same report the employer reads.

References

  1. 1. Algorithmic Writing Assistance on Jobseekers' Resumes Increases Hires National Bureau of Economic Research (Wiles, Munyikwa and Horton), 2023. nber.org Field experiment with nearly half a million jobseekers: writing assistance raised hires 8% with no drop in employer satisfaction.
  2. 2. Essential Skills - Writing O*NET OnLine, U.S. Department of Labor, 2026. onetonline.org Writing importance is rated 97 out of 100 for technical writers and drops steeply across the 894 occupations listed.
  3. 3. GPT detectors are biased against non-native English writers Liang, Yuksekgonul, Mao, Wu and Zou (arXiv), 2023. arxiv.org Detectors misclassify non-native English writing as machine-generated, and simple prompting evades them.
  4. 4. Employment Tests and Selection Procedures U.S. Equal Employment Opportunity Commission, 2007. eeoc.gov A step that decides who advances is a selection procedure and has to be applied consistently.

4 sources, numbered by first appearance. Every one was opened and checked against the claim it carries. How Olive sources claims

General guidance for hiring teams. What works at one company and one volume may not transfer to yours.

Olive assesses how a person works with AI. It does not detect AI-written documents, and it never produces a score, a ranking, or a match percentage for a person. Candidates read the same report the employer reads.

Back to answers

Open your first role Ten attempts a month against a live item bank, with a human-written report on every one.