Assessment design

Paying for the Take-Home Buys a Shorter Take-Home

US law generally does not require pay for a short pre-employment exercise whose output you never use, and that last clause is the real test: if you would ship it, it is work. Pay anyway. Use a flat rate, pay everyone who reaches that stage or nobody, and put the amount in the brief. The return is not goodwill. It is scope, because paid assignments usually get shorter within one cycle.

The takeThe ethics argument settles nothing, because both sides are arguing about fairness to one candidate at a time. The structural version is duller and harder to dodge. Three unpaid hours on a Tuesday evening is a fee, and the people who cannot pay it are the ones with a second job, caring responsibilities, or a current employer whose evenings are already spoken for. An unpaid assignment sorts your pipeline before anyone has read a word of the work.

Where Olive fits

Open a role and see what the work shows

Olive is charged per attempt rather than per seat: ten attempts a month are free with no card, and the Team plan is $199 a month for three roles. An attempt is counted when the candidate opens the workspace, and the session runs 50 to 70 minutes on their own clock.

Rank your shortlist

Do you have to pay?

Usually not, under US federal law. Federal wage law reaches employees, and the Fair Labor Standards Act defines employ as to suffer or permit to work 1. A candidate doing a short exercise whose output nobody uses generally sits outside that. The line is the use: the Supreme Court held in 1947 that trainees whose work gave the railroad no immediate advantage were not employees 2.

Both of those need their limits stated. The 1947 case concerned a week-long practical course for prospective yard brakemen, and its modern descendant is the primary-beneficiary test courts apply to unpaid interns. Neither is a ruling about take-home assignments, state wage law can be stricter than the federal floor, and other countries answer this differently. This is public legal fact rather than advice, and an unpaid exercise that runs past a few hours is worth a conversation with counsel before it goes out.

The workable test is the one you can apply without a lawyer. If the deliverable would go to a customer, into your codebase, into a deck someone presents, or into a decision you were going to have to pay somebody to make, it is work. A candidate asked to audit your actual onboarding funnel and hand back recommendations is producing something you will use, whatever the stage is called. A candidate analysing a sanitised dataset that goes in the bin on Friday is not.

That test also catches the assignment nobody meant to write. Briefs drift toward live problems because live problems are easier to describe than invented ones, and the drift is exactly what moves an exercise from a test into unpaid consulting.

Who does an unpaid assignment filter out?

People whose evenings are already committed. Three unpaid hours is a fee payable in time, and the candidates least able to pay it are those with caring responsibilities, a second job, or a current role with a demanding week. None of that predicts how well somebody does the job. All of it predicts who returns the assignment, which is the part that reaches your shortlist.

Be honest about what kind of claim that is. It is a structural argument about who can afford an unfunded stage, not a measured finding, and no study here says that paying changes the composition of a specific pool. What makes it worth acting on anyway is the cost of being wrong in each direction. Paying costs a few hundred dollars a candidate. Not paying costs you the people you never see, and they leave no trace in any funnel report, because a candidate who quietly does not start is indistinguishable from one who was never interested.

Two design choices make the same exercise land very differently. An assignment placed after a human conversation asks for time from someone who now knows something about the role. An assignment used as a top-of-funnel filter asks for three hours from strangers, which is the version that produces both the worst completion rates and the loudest public complaints. Placing it late costs nothing and fixes most of this.

Disclosure does the rest of the work. When the job post names the assignment and its length, the people who cannot spend the time find out at the cheapest possible moment instead of after two rounds of interviews.

Pay a flat rate, and pay everyone at that stage

Flat rate, not hourly, and everyone who reaches the stage or nobody. A flat rate keeps the cap honest, because paying by the hour rewards whoever spends six of them. Paying only some candidates turns the payment into a signal about who you already favour, which is worse than paying none. Put the amount in the brief and in the job post.

The mechanics that actually derail this are administrative rather than ethical:

  • Set the rate against the cap, not against the role. For a two-to-three hour exercise in a mid-level knowledge role, something in the range of a few hundred dollars reads as serious to candidates and rounds to nothing in a recruiting budget. Below about a hundred it reads as a gesture and occasionally as an insult.
  • Agree the payment mechanism with finance before the round opens, once. This is where paid assignments die. Vendor onboarding for a $200 payment is absurd, so most teams settle on gift cards or a simple invoice, and the decision needs to exist before a candidate is waiting on it.
  • Pay on submission, never on outcome. Payment conditional on passing is not payment, it is a prize, and it changes what candidates submit.
  • Have an answer for people who cannot accept money. Current government employees, some contractors and some visa holders genuinely cannot. Offer an equivalent donation to a charity they name, record that the same rate was offered, and move on.

The rate does not move for the candidate you are most excited about. Raising it there is the same failure as paying selectively, wearing better clothes, and it shows the moment two candidates compare notes.

What changes once the hours are billed?

The assignment gets shorter, usually inside one cycle. Once the hours appear on an invoice, somebody asks what the fourth one is buying, and the honest answer is rarely something the second hour did not already produce. That conversation never happens while the cost sits entirely on the candidate, because a cost nobody in the room pays is a cost nobody in the room questions.

The budget objection is smaller than it feels. SHRM's benchmarking data puts median cost-per-hire for non-executive roles at $1,244, with a 25th percentile of $354 and a 75th of $4,375 against a mean of $4,683, and its definition sums agency fees, advertising, job boards, referrals, travel, relocation, recruiter pay and system costs 3. Two things follow. The distribution is heavily right-skewed, so no single number describes your situation, and the definition leaves out the hiring manager's and interviewers' hours, which are usually the largest real cost of a loop. Paying four or five candidates a few hundred dollars each sits inside the spread of what the process already costs, and it funds a stage that was previously financed entirely by people who did not get the job.

Three second-order effects worth expecting. You will send the assignment to fewer people, which is good, because reviewer time was always the binding constraint. Completion rates go up, which makes small differences between candidates easier to read. And the pressure to cap the exercise finally has somebody inside the company behind it, which is the only reason scope discipline ever survives contact with a hiring manager who wants one more question answered.

Paying does not make a long exercise acceptable, and it does not repair a vague one. It buys attention on the size of the thing. The related lever is the clock: what a time limit on an assessment actually measures is worth settling in the same sitting, since a paid cap and a graded timer are not the same instrument. And if the work is genuinely a week of somebody's life, you are not designing an assignment at all, which is the question behind running a paid trial project instead.

See what gets scored

Common questions

How much should the payment be?

Anchor it to the time cap rather than to the salary. A defensible approach is a plausible contractor hourly rate for the level, multiplied by the stated cap, paid as one flat figure. For a two-to-three hour exercise in most knowledge roles that lands in the low hundreds. Round it to a clean number, say it in the brief, and do not vary it by candidate, because the variation is what turns a payment into a signal.

Do we have to pay for a one-hour exercise?

No, and most teams reasonably do not. The threshold where payment starts to matter is roughly where the exercise stops fitting in an evening, which for most people is somewhere past two hours. Below that, the higher-value move is usually cutting the assignment further rather than paying for it. The test that never changes is use: a thirty-minute task whose output you ship is work at any length.

Does paying make it harder to reject someone?

It should not, and in practice it makes the conversation easier. A paid exercise carries an explicit transaction: the candidate was paid for their time, not promised an outcome. Say that in the brief in one sentence. What genuinely does make rejection harder is a long unpaid exercise followed by silence, which is the combination behind most public complaints about take-homes.

What about candidates who cannot accept payment?

Offer a donation to a charity they name at the same amount, and note in the file that the identical rate was offered. Current public-sector employees, some contractors, and some visa holders have real restrictions, and asking them to work unpaid because of it recreates the problem payment was meant to remove. Keep the offer and the alternative in the same template so nobody has to improvise it under time pressure.

Is a paid trial day the same thing as a paid take-home?

No. A trial day is real work, done alongside the team, on live problems, and it is closer to a short contract than to an assessment: it needs a contract, an hourly or daily rate, and usually access to systems. A paid take-home is a self-contained exercise on invented material with a fixed cap. Confusing the two is how a two-hour assignment becomes a week of somebody's unpaid consulting.

References

  1. 1. 29 U.S. Code 203 - Definitions (Fair Labor Standards Act), subsections (e)(1) and (g) Legal Information Institute, Cornell Law School, 2026. law.cornell.edu Supports the statutory definitions that federal wage duties attach to an employee and that employ means to suffer or permit to work.
  2. 2. Walling v. Portland Terminal Co., 330 U.S. 148 (1947) Supreme Court of the United States, via Cornell Legal Information Institute, 1947. law.cornell.edu Supports the claim that unpaid trainees whose work gave the employer no immediate advantage were held not to be employees, which is the origin of the use test applied here.
  3. 3. SHRM Benchmarking: Talent Access (Selection Criteria, Overall) Society for Human Resource Management, 2022. shrm.org Supports the median and percentile cost-per-hire figures, and the fact that SHRM's definition excludes interviewer time, behind the claim that candidate payments sit inside existing recruiting spend.

3 sources, numbered by first appearance. How Olive sources claims

General guidance for hiring teams. What works at one company and one volume may not transfer to yours.

Olive assesses how a person works with AI. It does not detect AI-written documents, and it never produces a score, a ranking, or a match percentage for a person. Candidates read the same report the employer reads.

Back to answers

Open your first role Ten attempts a month against a live item bank, with a human-written report on every one.