Assessment design

Answer as Yourself at Work, Not the Ideal Employee

Answer as the version of yourself who shows up at work. Faking a questionnaire moves scores in instructed research studies, so the case for honesty is not that you would get caught. It is that a personality score is a weak basis for a decision on its own, that traits of the kind these tests measure have been challenged in a complaint as not clearly job-related, and that a profile you invented is one you then have to live out for as long as the job lasts.

The takeThe question deserves a better answer than either side of it gives. Prep vendors sell the ideal profile because a profile is a sellable product. Careers columns say "be yourself," which is true and costs nothing to say. Neither one tells you the useful part: the instrument is weak in both directions at once. Weak enough that a motivated answer moves it, and weak enough that moving it buys less than the worry suggests.

Where Olive fits

Open a role and see what the work shows

If the assessment an employer sends is Olive, there is no personality questionnaire in it: you work a role-grounded assignment openly with an AI assistant, and a person writes or edits six findings in words about how you framed the problem, what you delegated and what you verified. You are granted the identical report, free.

Assess your shortlist

Should You Answer Honestly or Say What They Want?

Answer honestly, in the narrow sense of answering as yourself at work rather than yourself on a Saturday. That is not a moral instruction. It is what leaves you with a process you can stand behind later. Where a questionnaire is followed by people who ask you to describe how you actually work, the answers have to belong to one person.

The pressure is real and worth naming. A hundred agree-disagree items where one response is plainly the preferred one does not feel like a measurement. It feels like a quiz with the key taped to the wall.

The research agrees with you about the key.

Where it stops agreeing is on what the key is worth. A questionnaire score is a thin instrument even when nobody shades it. The employer-side writing on this site is direct about one reason: a validity coefficient is measured against one job's performance data and travels no further. The number a vendor quotes may have been earned somewhere else, on other people, doing other work.

That guidance is worth reading in its own words. Do assessment scores still predict how someone performs once AI is in the workflow is written for the people buying the test, not for the people sitting it. That is part of why it is useful to you.

Nobody writes reassurance for an audience that is not in the room.

What the Faking Research Actually Found

Instructed faking moves scores, and by more than a little. Buehl and colleagues had 111 psychology students answer the same twenty-question structured interview twice, once honestly and once told to answer as an applicant would. Mean ratings rose from 3.20 to 3.62, a gap the authors report as a clear faking effect 1. Those were students with no job on the line.

That last clause is not a throwaway. It was a within-subjects design in a research setting, and the authors say their effect came out far larger than an earlier interview study's and put that down to how the conditions were built 1.

Read it as a direction that is real, not a size to expect.

The comparison that matters more here is between formats, because a questionnaire and an interview are not equally easy to shade. Van Iddekinge and colleagues ran mock structured interviews built to measure agreeableness, conscientiousness and emotional stability, and had the same people complete matching self-report scales under both honest and applicant-like instructions. Scores in the applicant-like condition rose significantly more for the self-report ratings than for the interviewer ratings 2. In that mock setting, the questionnaire was the easier of the two to inflate.

Employer-side guidance ranks a related set of formats, though for a different question: whether someone who cannot do the work passes anyway with an assistant open. Work sample, structured interview, or AI-skills assessment: which one catches AI dependence puts the unwatched take-home easiest and the structured interview hardest of the three, and no personality questionnaire is on that list.

So the prep vendors are not lying about the mechanism.

What they leave out is who the mechanism belongs to. In the Buehl study, the size of each person's gain was modestly related to cognitive ability and to how well they could identify what a question was assessing 1. That describes who gains, not a technique anyone can sell you.

It also points somewhere more useful than it first looks. Gains ran somewhat larger among people who understood what a question was reaching for, and that understanding is also what having done the work gives you. Someone who has run a project to a deadline knows what an item about planning is asking, and can answer it truthfully and specifically. The two routes end up in the same neighborhood, and only one of them holds up in the conversation that follows.

Will the Test Catch an Engineered Answer?

Nobody can tell you, and an answer that sounds certain in either direction is worth distrusting. The common claim is that a battery repeats each item in different words and scores you on the gap between the two. No verified source here documents which battery does that, or what it does with the result, and a vendor's description of its own product would not settle it.

What is documented sits next door, in research on cheating rather than faking. In one experiment, 315 participants took a knowledge test unproctored and then took it again proctored, and the self-report measures, including an honesty scale, predicted nothing about who had cheated 3.

The stakes there were entry into a gift-card draw rather than a job, and cheating was inferred from the score gap rather than observed 3.

The countermeasures on the employer's side have not been shown to close the gap either. The standard set is specific instructions, honor codes and announced follow-up tests. Reviewing them, the same authors report that a 2020 meta-analysis found those measures could not prevent score differences between proctored and unproctored ability tests 4, a null result that is weak evidence rather than proof that the measures do nothing.

An unproven countermeasure is still not a green light.

One large program tested the mechanism from the other end. Between 2006 and 2008, 71,985 applicants to a UK selection program sat unproctored reasoning tests, having signed an honesty contract and been told a supervised verification test would follow. Among those who reached that stage, the share scoring significantly below their earlier result ran from 0.3% to 2.2%, under the 2.5% that chance alone would put in that tail 5. Nothing in that system watched anyone during the test.

That was cognitive ability testing with rotating item banks, which is the easy case, and the authors are explicit that the result is descriptive rather than causal. Only about 5% of candidates reached the supervised stage, so nothing is known about the rest 5.

None of it transfers to a personality questionnaire, which has no verification form to sit. What transfers is the shape. An unsupervised stage held together in a system where a later stage existed and the same claim had to survive a second look.

For a personality questionnaire, the later stage that matters is any conversation where a person asks how you handle deadlines, disagreement and detail, in your own words.

Why the Engineered Profile Costs More Than It Buys

An engineered profile costs you a fit: you have described a different person to an employer, and the employer may then plan your first months around the description. If the profile says you are energized by constant interruption and cold calls and you are not, that shows up once the work starts, not during the hiring process.

The questionnaire is over in one sitting. The job is not.

A second cost belongs to the employer rather than to you. Traits of the kind many batteries ask about are the subject of a formal complaint. In May 2024 the ACLU filed a Federal Trade Commission complaint against Aon over marketing its hiring assessments as bias-free. The complaint argues that tools measuring traits such as positivity, emotional awareness and liveliness are not clearly job related for most jobs 6.

The sharper point in the same filing is that those traits are directly linked with core aspects of the medical understanding of autism and of conditions such as depression and anxiety 6. So a tool can be clean on race and sex and still fall hardest on one group.

That is an allegation, not a finding.

The ACLU's announcement reports no agency ruling, Aon disputes the characterization, and the FTC theory is about marketing claims rather than about whether the assessments discriminate. Job-relatedness is decided against a particular job, one at a time.

The engineered answer papers over a question that may not have been worth asking.

If an item is hard for you because of a disability rather than because you are trying to look good, that is different ground with a different route. Does asking for an accommodation hurt your chances covers where that request goes and what the panel is told.

Collapsing that question into this one costs people options they actually had.

On the day, answer as the person your last manager would recognize, at work, on an ordinary week. Then keep the examples ready, because the profile you hand in is a list of things somebody may ask you to prove.

See what gets scored

Common questions

Will a personality test know if I answer strategically?

Nobody can tell you for certain, and any source that sounds certain is worth distrusting. No verified source names which battery scores consistency, or what it does with the result, and a vendor describing its own product would not settle it. What is documented sits next door and is narrower: in one low-stakes study, self-report measures including an honesty scale did not predict who cheated on a separate knowledge test, which says nothing about whether a questionnaire spots shading in its own answers. The question worth more of your attention is what an engineered profile does to the interview that follows it.

Does faking a personality test actually raise the score?

In research settings, yes. Told to answer as an applicant would, students' structured-interview ratings rose from 3.20 to 3.62, and a separate study found self-report personality scales inflated significantly more than interviewer ratings of the same people. Both used instructed conditions rather than real applicants, so read the direction and not the size. It still is not a good move: gains ran somewhat larger among people who understood what each question was assessing, which is what honest experience gives you anyway.

What does answering honestly mean on an agree-disagree item?

It means answering as yourself at work, rather than yourself at home or yourself at your best. Read each item against your working week rather than against the job description, and pick the response your last manager would recognize. Where an item fits how you work only partly, the neutral option is a real answer and not a dodge; where it does not fit at all, disagreeing is the honest answer. Nobody is asking you to summarize your character, only how you tend to operate on an ordinary week.

Can a personality test screen me out because of a disability?

Whether a particular personality test does so is a live complaint rather than a settled question. In May 2024 the ACLU filed a Federal Trade Commission complaint against Aon arguing that traits such as positivity, emotional awareness and liveliness are not clearly job related for most jobs, and are directly linked with core aspects of the medical understanding of autism and of conditions such as depression and anxiety. The ACLU's announcement reports no agency ruling, and Aon disputes the characterization. If a format is a barrier for you because of a disability, the route is an accommodation request rather than a rewritten answer.

Is a structured interview harder to fake than a questionnaire?

The evidence points that way without saying an interview cannot be shaded at all. Under applicant-like instructions, self-report personality scores inflated significantly more than interviewer ratings of the same people. Interview scores did still rise, so this is a difference of degree rather than a format that cannot be moved. The gap is part of why an employer who cares about the answer runs a conversation instead of relying on the questionnaire alone.

What happens if my answers and my interview do not match?

No verified source here says what a particular employer does with that gap, and nobody should tell you otherwise. What you can foresee is the conversation: an interviewer given a profile may ask about it, so a trait you claimed becomes a request for an example you do not have. That conversation is awkward at best, and it is avoidable by answering about the working self you can describe.

References

  1. 1. Tell me sweet little lies: How does faking in interviews affect interview scores and interview validity? Journal of Business and Psychology, 34(1), 107-124 (Anne-Kathrin Buehl, Klaus G. Melchers, Therese Macan and Jana Kühnel); accepted-manuscript preprint hosted at Ulm University, 2018. uni-ulm.de The instructed-faking result this article states: 111 students answering the same twenty-question structured interview twice, mean ratings rising from 3.20 to 3.62, and gains tracking how well a person could identify what a question assessed.
  2. 2. Assessing personality with a structured employment interview: construct-related validity and susceptibility to response inflation. Journal of Applied Psychology, 90(3), 536-552 (Chad H. Van Iddekinge, Patrick H. Raymark and Philip L. Roth); abstract read from the PubMed record, 2005. pubmed.ncbi.nlm.nih.gov Supports the claim that self-report personality ratings inflate significantly more under applicant-like instructions than interviewer ratings of the same people do.
  3. 3. Caught in the Act: Predicting Cheating in Unproctored Knowledge Assessment Assessment, 28(3), 1004-1017 (Steger, Schroeders and Wilhelm); open copy at the German National Library, 2021. d-nb.info Supports the claim that self-report measures, including an honesty scale, predicted nothing about who cheated among 315 participants tested unproctored and then proctored, with the gift-card stakes and the inferred cheating label this article names.
  4. 4. Caught in the Act: Predicting Cheating in Unproctored Knowledge Assessment Assessment, 28(3), 1004-1017 (Steger, Schroeders and Wilhelm); open copy at the German National Library, 2021. d-nb.info Supports the claim that instructions, honor codes and announced follow-up tests were not able to prevent score differences between proctored and unproctored ability tests, per the 2020 meta-analysis the authors summarize.
  5. 5. Dealing with the threats inherent in unproctored Internet testing of cognitive ability: Results from a large-scale operational test program Journal of Occupational and Organizational Psychology, 84(4), 817-824 (Lievens and Burke); submitted version via CORE / Singapore Management University, 2011. core.ac.uk Supports the UK program figures this article uses: 71,985 applicants between 2006 and 2008, an honesty contract with an announced verification stage, a 0.3% to 2.2% share scoring significantly below their unproctored result against 2.5% by chance, and about 5% reaching the proctored stage.
  6. 6. ACLU Files FTC Complaint Against Major Hiring Technology Vendor for Deceptively Marketing Online Hiring Tests as “Bias Free” American Civil Liberties Union, 2024. aclu.org Supports the May 2024 FTC complaint against Aon this article describes, its contention that traits such as positivity, emotional awareness and liveliness are not clearly job related for most jobs, and the link it draws to autism, depression and anxiety.

6 sources, numbered by first appearance. How Olive sources claims

General guidance for hiring teams. What works at one company and one volume may not transfer to yours.

Olive assesses how a person works with AI. It does not detect AI-written documents, and it never produces a score, a ranking, or a match percentage for a person. Candidates read the same report the employer reads.

Back to answers

Open your first role Ten attempts a month against a live item bank, with a human-reviewed report on every one.