Screening
A New-Grad AI Requirement Selects for Access, Not Skill
Almost every graduating student now has AI experience, so an AI requirement on a new-grad posting filters almost nobody. In the Higher Education Policy Institute's December 2025 survey of 1,054 UK undergraduates, 95% reported using AI in at least one way [1]. The 95% is British, and nothing here counts a US graduating year. What still varies is access: whether the university supplied tools, and how advantaged a student's background is. Ask instead for one time a model handed a candidate something confidently wrong, and how they found out.
The takeA requirement that every applicant meets does no filtering; it only tells a graduate what to write on the resume. And the difference that remains separates people on access, because the student whose university bought seats is not more careful than the student whose university bought none. The test worth running at this level costs one question and no budget: name something a model told you that turned out to be wrong. A graduate can have that story without a resume line to show for it.
Where Olive fits
Open a role and see what the work shows
No line in a posting can tell you which graduate checks what a model hands them, so Olive skips the claim and assesses the work: a 40-to-60-minute occupational assignment done alongside an AI assistant, returned as six findings with the timestamped moment behind each one. The candidate is granted the same report the employer reads.
Assess your shortlistWhat does an AI line on a new-grad req select for?
The line selects for access, and after that for very little. Nearly every graduating student now uses AI, so the requirement removes almost nobody from the pile. The differences that survive sit upstream of the person: which university bought tools, which subject they studied, how advantaged their background is.
None of those describe how a candidate works.
In December 2025, Savanta polled 1,054 full-time UK undergraduates for the Higher Education Policy Institute. Some 95% reported using AI in at least one way, and 94% said they used it to help with assessed work 1.
A line that 95% of undergraduates clear is not a bar.
That poll is British. The posting and labour-market evidence in the rest of this piece is American, and nothing here counts a US graduating year the same way.
So the 95% is read across a border, and the nearest US check is the resume.
Handshake compared the resumes graduating seniors uploaded to its own US platform. On that platform, Class of 2026 resumes name AI skills more than nine times as often as Class of 2022 resumes, with two-thirds of those mentions now coming from students outside computer science 2.
Handshake is counting labels, not use or authorship, so the document cannot break the tie either. What is left to screen on if every new-grad resume is AI-built is the question the posting hands you, unanswered.
Where the HEPI survey does find gaps, they are not gaps in the person. The authors report persistent divides by subject, by socio-economic group in favour of more advantaged students, and by gender, with men still the more frequent users 1.
Institutional supply is a fourth difference, and it sits wholly outside the student. Asked whether their institution currently provides generative AI tools, 38% of students said yes in 2026, against 23% in 2025 and 9% in 2024 1.
The graduate whose university provided nothing did not decline the tools. Nobody offered them.
Why does a graduate's AI experience predict so little?
Because experience measured at the moment of hire barely predicts job performance, across the studies pooled to test it. Chad Van Iddekinge and three co-authors, writing in Personnel Psychology in 2019, pooled 81 independent samples on prehire work experience. The corrected correlation with later job performance was .06, and with turnover it was .00 3.
Experience with the relevant tasks did no better for job performance, at about .07 3.
Van Iddekinge's meta-analysis covered work experience in general rather than experience with AI tools. It describes experience as a resume reports it, not experience built up in the current job, which is a separate and more favourable literature.
Entry-level postings have been asking for more anyway. PwC's 2026 Barometer looked at skills that appeared in US entry-level postings in 2025 and had barely appeared in 2019. In the most AI-exposed quarter of occupations, 52% of those new skills were ones previously asked of senior staff, against 7% in the least exposed quarter 4.
PwC is reading advert wording, not job content. An employer writing stakeholder management into a graduate posting has stated a demand the role may not contain, and an AI line on the same list reads the same way.
For a graduating student the line has even less to read. There may be no prior job to report, so the answer comes from coursework, a club, an internship or a side project.
The resume records the label rather than the act.
GPA can have the same shape, which is why whether GPA still predicts anything for entry-level roles now depends on the role. Where it has that shape, the proxy is cheap to read and thin on signal.
Ask what a model got confidently wrong, and how they caught it
One question does the work the requirement cannot. Ask the candidate for a specific occasion when a model handed them something confident and wrong, and how they found out. A graduate who has been through it answers with the claim, the check and what the check cost in time.
A graduate who has not moves to a principle about verifying outputs and stays there.
The answer needs no career behind it. A course citation that resolved to a real paper saying something else. A summer job where a generated formula quietly changed a total. A club budget that stopped adding up. All of them contain the same act.
Grade the catch, not the story.
How hard was the thing to see? A fabricated citation is caught by clicking. A plausible wrong number inside a correct-looking spreadsheet is caught only by somebody who went back to the source and re-derived it.
A story like this is easy to have ready, which is why how hard the catch was separates candidates better than whether a story exists at all.
Then ask the follow-up that is harder to rehearse: what would have happened if nobody caught it. A candidate who traced the consequence has thought about the work. One who says it would have been embarrassing has thought about the interview.
The question tests verification, and hiring someone who can tell when AI is wrong is a narrower brief than the posting admits.
Ask every applicant the same question, write the answer down in their own words, and score the catch on one scale everybody on the panel can see.
Where does the AI line belong in the posting?
In the description of the work, and out of the knockout questions. Written as a hard requirement, the line can put off applicants who read requirement lists as eligibility rules, and it does so before a name ever reaches you. Written as a description of what the job involves, it tells a graduate what to prepare.
Tara Mohr surveyed more than a thousand professionals, mostly American, about a job whose qualifications they did not fully meet and had decided not to apply for. The top reason, twice as common as any other, was that they did not think they would be hired without the qualifications and did not want to spend the effort. It was named first by 41% of women and 46% of men 5.
The least common reason of all was doubting they could do the job 5.
Mohr's survey is a blog-published self-report with no control condition, and it measures what people say about a decision already made. Read it for the shape of the problem, not for a coefficient.
So write the line as work rather than as a credential. Swap tool experience for the act you want evidence of: finding a claim a model got wrong and correcting it before it went out. Then say what counts as evidence, because a graduate's version of that came from a course, a shift or a side project.
The or-equivalent line is where that belongs, and on a new-grad req it carries more weight than the requirement above it.
Why the rewritten AI line can return the same shortlist
Rewriting a requirement moves the posting, and on its own a posting moves hiring only a little. The share of hires without a bachelor's degree rose about 3.5 percentage points inside 11,332 large-firm roles that had dropped the degree requirement 6. The Burning Glass Institute and Harvard Business School reached that figure by matching those roles against the career histories of roughly 65 million US workers.
Across the market it came to almost nothing. Only 3.6% of roles dropped the degree requirement at all, so the net effect was 0.14 percentage points, or roughly 97,000 workers a year out of 77 million hires 6.
Requirement text is not harmless. The wording can change who applies, while the rest of the loop decides who is hired, so an edited posting behind an unchanged interview returns much the same shortlist.
In a small number of entry-level roles the requirement earns its place. For an evaluations engineer, or a research assistant on a model team, the AI line names something specific, scarce and checkable. Near-universal AI use says nothing about whether a graduate has ever built an evaluation set.
Those postings should keep the requirement and describe it exactly.
Open the requisition and read the line again. A line asking for experience with AI tools describes the year group about to apply; it does not narrow it. A line asking for one wrong claim from a model, found and fixed before it shipped, does not narrow it either.
But it tells whoever runs the screen what to ask about. The screen is where the hire is made.
Common questions
Does a graduating student have any AI experience worth screening on?
Nearly all graduating students have some, which is the problem with screening on it. In the Higher Education Policy Institute's December 2025 survey of 1,054 full-time UK undergraduates, 95% reported using AI in at least one way and 94% said they used it to help with assessed work. That survey is British, and the nearest US figures, from Handshake, count what a student writes on a resume rather than what a student does. A requirement almost everyone meets removes almost nobody. What differs between two graduates is not whether they have used a model, but whether one of them has ever been handed a confident wrong answer and noticed. Ask for that, and ask every applicant in the same words.
What should the AI line on a new-grad posting say instead?
Name the act, not the tool. Something close to: found a claim an AI tool got wrong and corrected it before it went out. Then say what evidence counts, because a graduate's version of that came from a course, an internship, a part-time job or a personal project rather than a job title. Put the line in the description of the work instead of the knockout questions, and say that no particular tool or paid subscription is expected. The point of the line is to tell an applicant what the screen will ask about.
Is an AI requirement unfair to students whose university provides nothing?
It can be, if the line asks for tool experience. Only 38% of UK undergraduates in the Higher Education Policy Institute's 2026 survey said their institution provides generative AI tools, up from 9% in 2024. The same report finds persistent divides by subject and by socio-economic group in favour of more advantaged students. A requirement written as tool experience therefore partly reads what a campus supplied and how advantaged a student's background is. A requirement written as an account of catching a wrong answer reads something the student did, wherever they happened to do it.
Should the AI question be a knockout on the application form?
No. A knockout question turns a requirement almost everyone meets into a yes or no that measures how confidently an applicant answers it. Some candidates read requirement lists as eligibility rules: in Tara Mohr's self-report survey of more than a thousand professionals, the top reason for skipping a job whose qualifications they did not fully meet, twice as common as any other, was believing they would not be hired without them. On a new-grad req that can put off applicants before you ever see them. Leave the AI line in the job description and test it in a live conversation.
How do you score the answer about what a model got wrong?
On how hard the mistake was to catch, and on one scale used for everyone. A fabricated citation caught by clicking a link sits at the easy end. A plausible wrong number inside a correct-looking spreadsheet, caught by going back to the source, sits at the hard end. Record what the candidate said in their own words rather than a summary of your impression, then have a second reader score the same notes. Two readers who cannot agree on a rating are rating something other than the answer.
References
- 1. Student Generative AI Survey 2026 (HEPI Report 199) ✓ hepi.ac.uk Supports the near-universal student AI use, the institutional-supply figures and the divides that remain. The report states: 'Some 95% of students report using AI in at least one way and 94% say they use generative AI to help with assessed work'; that the proportion providing AI tools has risen 'from 9% in 2024, to 23% in 2025 and 38% in 2026'; and that divides persist by subject, 'socio-economic group (favouring more advantaged students); and gender (with the gap between men and women having narrowed, but men remaining the more frequent users)'. Methodology: 1,054 full-time UK undergraduates polled through Savanta in December 2025, margin of error approximately 3%.
- 2. AI and the Workforce Ahead: What the Class of 2026 tells us about the future of the labor market ✓ joinhandshake.com Supports the claim that naming AI on a resume no longer separates candidates: Class of 2026 resumes mention AI skills more than nine times as often as Class of 2022 resumes, with two-thirds of those mentions coming from non-computer-science majors. This counts AI being named on an uploaded resume, on one US career platform, not how many applicants used AI to write one.
- 3. A meta-analysis of the criterion-related validity of prehire work experience ✓ digitalcommons.unf.edu Supports the claim that experience measured at hire predicts little: 81 independent samples, corrected correlations of .06 with job performance, .00 with turnover, and about .07 for experience with relevant tasks. It concerns experience as a screen reads it, not tenure in the current job.
- 4. Two futures for jobs in an AI era — 2026 Global AI Jobs Barometer (global findings) ✓ pwc.com Supports the claim that entry-level postings are being written upward: among new skills appearing in US entry-level postings in 2025 and having five or fewer mentions in that occupation in 2019, 52% were traditionally senior-level skills in the most AI-exposed quarter of occupations against 7% in the least exposed. Cited as an analysis of advert wording, not of what junior roles contain.
- 5. Why Women Don't Apply for Jobs Unless They're 100% Qualified ✓ web.archive.org Supports the claim that a hard requirement suppresses applications because candidates read the list as an eligibility rule: the top reason for not applying, twice as common as any other, was named by 41% of women and 46% of men, while doubting they could do the job well was the least common answer. Self-report survey published as a blog post, with no control condition and no published sampling frame.
- 6. Skills-Based Hiring: The Long Road from Pronouncements to Practice ✓ static1.squarespace.com Supports the claim that editing a requirement moves hiring far less than expected: 11,332 roles at large firms dropped a degree requirement, hires without a degree rose about 3.5 percentage points inside those roles, but only 3.6% of roles removed a degree requirement in the study window, giving a net 0.14 percentage points, roughly 97,000 workers a year out of 77 million hires. Estimated from resume-inferred education and posting text, at large firms only.
6 sources, numbered by first appearance. Every one was opened and checked against the claim it carries. How Olive sources claims
General guidance for hiring teams. What works at one company and one volume may not transfer to yours.
Olive assesses how a person works with AI. It does not detect AI-written documents, and it never produces a score, a ranking, or a match percentage for a person. Candidates read the same report the employer reads.