Assessment design
AI Fluency Is Four Competencies, Not a Tool List
AI fluency is the ability to work effectively, efficiently, ethically and safely with AI, and the definition with named authors behind it breaks that into four competencies: deciding what to hand over, describing it well enough to get something useful, judging what comes back, and owning the result. No board issues it as a credential. Whoever writes the job description decides what counts as fluent, which is why the phrase currently means whatever the last person to type it meant.
The takeThe phrase has a shelf life. It is useful right now because it names something a tool list cannot, and it will stop being useful the moment enough vendors sell a fluency badge. Treat it as a placeholder for four specific behaviors, write those four into the requisition in your own words, and let the word go when it stops carrying them. A requirement that survives the term dying was a better requirement all along.
Where Olive fits
Open a role and see what the work shows
Building this in-house, the expensive parts are the answer key and the evidence trail behind every finding. Olive runs a role-grounded assignment across twelve occupations and returns six findings, each anchored to a timestamped excerpt from the session rather than to a level.
Rank your shortlistWhat does AI fluency actually mean?
Working with AI effectively, efficiently, ethically and safely, split into four named competencies. The AI Fluency Framework, written by Rick Dakan at Ringling College of Art and Design and Joseph Feller at University College Cork and turned into courses with Anthropic, calls them Delegation, Description, Discernment and Diligence 1. That is the version with authorship you can check, which is more than most circulating definitions offer.
In the framework's own words:
- Delegation is "creative vision and selection of the right AI tools and techniques to realize that vision" 1. In practice it is deciding which part of the job stays yours.
- Description is "effectively describing a vision and/or tasks to prompt useful AI behaviors and outputs" 1. What context went in before the ask.
- Discernment is "accurately assessing the usefulness of AI outputs" 1. Including the case where the output is fluent and wrong.
- Diligence is "taking responsibility and vouching for final products created using AI" 1. Whether the person stands behind what shipped and is straight about how it was made.
Two honest caveats before anyone builds a bar on it. The framework is a definition, not a measurement: it publishes no levels, no scoring anchors, no norms and no evidence that people who rate well on it perform better. And it is authored by two academics and co-produced with Anthropic, so calling it Anthropic's framework overstates the relationship. The four are worked through one at a time in what each of the four Ds looks like in real work.
Who decides what counts as fluent?
You do, and that is not a gap somebody forgot to fill. No board accredits AI fluency and no exam confers it. Even the EU AI Act, which does write an AI literacy duty into law, does not require an employer to measure or test anyone's knowledge of AI 2. So the bar exists wherever an employer writes it down, which is usually a job description nobody re-read.
The European Commission's guidance on that duty, revised in 2026, states that no certificate is needed, that no specific training is mandated, and that keeping an internal record of what was done is the suggested practice 2. It cuts both ways: nobody has to test staff, and no vendor's badge confers compliance either. That is guidance rather than statute, it has already been rewritten once, and anything touching an EU obligation belongs in front of counsel rather than in a posting.
The credential market fills the vacuum with things that sound general and are not. Microsoft's Azure AI Fundamentals is the credential most often listed as an entry-level AI qualification; its own exam page addresses someone "at the beginning of your career in AI solution development" and states that the candidate needs knowledge of Python syntax and familiarity with Azure resources, with the majority of the exam weight sitting on implementing in one vendor's platform 3. It is a real credential for what it covers. It is not a statement that its holder works well with AI on your material.
Which leaves the employer holding the pen. The requirement is only worth writing if it can be tested, which is the whole of what fluency has to mean on a job description.
Why can't you see fluency in the finished document?
Because the decisions happened before the file existed and left nothing behind in it. The brief shapes what came back, so a deliverable is partial evidence about one competency. It says nothing about what was handed over, what was thrown out, or whether anybody opened the source behind the claim the recommendation rests on. That silence is why the market fills up with proxies.
Every proxy in circulation is cheaper than the thing it stands in for, and each fails in a way worth naming out loud. A certificate says a course was completed. A tool list says somebody can type four product names. Years of AI experience says when they started. A self-rating says how confident they are, which is a genuine measurement of something and not of skill. None of the four survives the question a hiring manager actually has, which is whether this person will notice when the answer is wrong.
The cost of guessing wrong has been measured directly. In a pre-registered field experiment with 758 Boston Consulting Group consultants, on one task deliberately chosen to sit outside the model's capability, consultants using GPT-4 were 19 percentage points less likely to reach the correct answer: 84.5% of the control group got it right, against 60% and 70% in the two AI conditions 4. One task, one sample, a 2023 model, and the capability line moves with every release. What travels is that consultants at a top firm could not tell which side of the model's capability the task sat on.
What stays readable is the process. What a candidate kept for themselves, what an assistant produced that they refused, and what they opened in order to check a number are all things a person can describe or a session can record, and none of them can be inferred from a clean document. What being good at using AI looks like in a round turns that into questions somebody can ask on Monday.
Write the bar as four behaviors before you write the word
Turn the four competencies into four sentences about your own work, then delete the word fluency from the posting. A requirement naming a behavior can be tested and defended. A requirement naming a level cannot, because there is no scale underneath it and nothing to appeal to when two interviewers disagree about whether a candidate cleared it.
1. Delegation. "Decides which parts of the analysis to do without a model, and can say why." Satisfied when a candidate names one step they kept deliberately, with a reason attached to the work rather than to a policy. 2. Description. "Briefs a model with the context a colleague would need to do the task." Satisfied when the constraint, the audience and the source material go in before the request for output, rather than dribbling in over a correction loop. 3. Discernment. "Catches a confident claim that is wrong in this field." Satisfied by finding the error in your own material and naming what it was checked against. Not satisfied by saying it felt off. 4. Diligence. "Vouches for what ships and is straight about how it was made." Satisfied by a claim withdrawn or re-scoped rather than shipped unverified.
Who writes those four lines matters more than the wording does. The person currently doing the job knows which step should never be handed to a model and what a wrong answer looks like in this material; a recruiter working from a template does not, and a template is where a bare AI fluency requirement comes from in the first place. Twenty minutes with the incumbent produces four lines nobody has to argue about in the debrief, and the same twenty minutes produces the material the exercise gets built from.
The fourth item is the one most often dropped from summaries of the framework, and it is the expensive one. The framework's own sub-competency closest to an employer's concern covers verifying and vouching for AI-assisted output, including fact-checking and validating claims 1. That is a disposition rather than a technique, which is why it belongs in the requisition and not in the training plan.
Common questions
Is AI fluency the same thing as AI literacy?
No, and the distinction is worth keeping. Literacy is knowing what these systems are, roughly how they work, where they fail and what should never go into one. It is knowledge, and a written test measures it well. Fluency is what happens when a person with that knowledge sits down to a real task with a deadline and an assistant that will confidently produce something wrong. Literacy is a floor worth setting for everyone. Fluency is what you are actually hiring for in a role where the output carries a decision.
Does the AI fluency framework come with a score?
It does not. The published framework is a taxonomy: four competencies, a set of named sub-competencies under each, and three modalities of human-AI interaction. There are no levels, no scoring anchors, no proficiency thresholds and no norms attached to it, and no validated instrument has been published alongside it. Anyone selling a fluency score built on the four Ds added the scale themselves, and the scale is the part you should ask about.
Is the AI fluency framework Anthropic's?
Not exactly, and the shorthand causes real confusion. The AI Fluency Framework was written by two academics, Rick Dakan at Ringling College of Art and Design and Joseph Feller at University College Cork, and turned into course material with Anthropic. Attributing it to a model vendor makes it sound like a product specification rather than an academic definition, which changes how people weigh it. Cite the authors.
Should the phrase appear in a job posting at all?
Only if the next line says what it means in that role. On its own it is a signal to candidates that the employer has heard the term, and it invites resumes tuned to the phrase rather than to the work. If the posting says AI fluency and then names one thing the person will do with an assistant and one thing they will be expected to check, the phrase is doing no harm. If it stands alone, delete it and keep the behavior.
How long does it take someone to become fluent?
Nobody has published an answer, and the question hides a real asymmetry: the four parts move at very different speeds. Describing a task well is a habit, and habits respond quickly to practice. Noticing that a confident answer is wrong runs on domain knowledge, which accumulates slowly. So a single duration for fluency is meaningless, and a training plan that treats the four as equally teachable will spend most of its budget on the cheap one.
References
- 1. Framework for AI Fluency ringling.libguides.com The definition of AI fluency and the four competencies quoted in this article, plus the sub-competency covering verifying and vouching for AI-assisted output.
- 2. AI Literacy - Questions & Answers digital-strategy.ec.europa.eu Supports the claim that the EU AI Act's literacy duty requires no certificate, no mandatory training and no measurement of employees' AI knowledge.
- 3. Exam AI-901: Microsoft Azure AI Fundamentals learn.microsoft.com Supports the claim that a vendor AI fundamentals credential is a platform credential requiring Python knowledge, not a general statement about working with AI.
- 4. Navigating the Jagged Technological Frontier: Field Experimental Evidence of the Effects of Artificial Intelligence on Knowledge Worker Productivity and Quality (Working Paper 24-013) mitsloan.mit.edu Supports the 19-percentage-point accuracy drop on the one task placed outside the model's capability (84.5% control against 60% and 70%), and the finding that the consultants could not tell which side of that line the task sat on.
4 sources, numbered by first appearance. How Olive sources claims
General guidance for hiring teams. What works at one company and one volume may not transfer to yours.
Olive assesses how a person works with AI. It does not detect AI-written documents, and it never produces a score, a ranking, or a match percentage for a person. Candidates read the same report the employer reads.