Covert racism: the voice inside the machine
Speech recognition throws away everything about how you said it and keeps only what you said. That discarded remainder is where dialect lives — and where bias survives every safety measure built to catch it.
Speech is one of humanity's earliest interfaces. Writing is a later technology layered on top of it. Yet much of contemporary AI has inverted that history, treating voice as though it were simply text delivered in audio form.
A speech system reduces what you said to generic text at the earliest possible stage, and the rest of the signal — timing, emphasis, self-repair, overlap, dialect — is discarded as noise. In low-stakes use that is a reasonable trade. Your assistant mishears you, you repeat yourself, you move on.
In a clinic, a classroom or an interview, the discarded remainder is the meaning.
People under pressure, with unequal power, speaking in linguistically diverse ways, convey meaning through pauses, emphasis and dialect rather than vocabulary alone. A system that collapses that into normalized text has quietly installed one way of speaking as the default and every other as an error. What follows is not a usability complaint. It is an allocational harm — who gets opportunity, care and trust.
The measurable half
The clearest evidence is the oldest and least contested: commercial speech recognition is substantially worse at Black speakers, and the gap is not about vocabulary.
Average word error rate across five commercial ASR systems. Koenecke et al., PNAS 2020.
One in five words, for white speakers
Across five commercial systems, the average word error rate for white speakers was 0.19 — roughly one word in five transcribed wrongly. That is the baseline, and it is already not good.
One in three, for Black speakers
The same five systems averaged 0.35 for Black speakers. Same task, same audio conditions, same measurement.
The relative figure is ours, not theirs
An 84% higher error rate is the number that travels — and it does not appear in the paper. It is (0.35 − 0.19) / 0.19, computed by us from two figures that are the paper's. The distinction matters enough that it is the first line of the receipts.
And it is not the words
The authors attribute the gap primarily to acoustic modeling rather than vocabulary or grammar. The systems are not failing to recognize unfamiliar words. They are failing to hear a voice.
A bar chart comparing average word error rate across five commercial speech recognition systems: 0.19 for white speakers and 0.35 for Black speakers, an 84% relative difference.
The half that survives the fix
Transcription error is the visible failure, and the one a vendor can be held to. The harder finding is what happens downstream, in the model that reads the transcript.
Hofmann and colleagues found that language models hold covert prejudice against African American English — assigning less-prestigious jobs, and convicting more often, on the basis of dialect alone, in scenarios where race is never mentioned and the statements have nothing to do with the decision.
The shape of the finding in Hofmann et al., Nature 2024. Illustrative — the paper reports the divergence, not these coordinates.
Overt bias goes down
Ask a model directly about a racial group and larger, better-aligned models answer more favourably than small ones. Measured on the surface, alignment is working.
Covert bias does not
Give the same model two statements identical in content but different in dialect, and the prejudice is still there. In the authors' words, human-feedback training "obscures the racism on the surface, but the racial stereotypes remain unaffected on a deeper level."
Which inverts the usual reassurance
Scale and safety tuning are supposed to be the answer. Here they make the problem harder to see without making it smaller — a model can pass every overt-bias test it is given and still allocate worse outcomes to a speaker because of how they speak.
Two diverging lines against model scale: overt racial bias falls as models get larger and better aligned, while covert dialect prejudice does not.
Why this is a hiring problem
Put the two halves together. A transcription layer that hears one group less accurately hands a degraded record to a decision layer that already treats dialect as a signal about the person. Neither layer announces what it did. Both are, individually, defensible engineering choices.
This is the argument that produced everything else we build. It is why prosody is never a score in our own assessment, why accent and pace and hesitation never reach an employer as a judgment, and why a typed path is not an accommodation bolted on afterwards but the same path, chosen at the start.
It is also the reason we treat measurement rather than screening as the deliverable. You cannot filter out a bias whose defining property is that it does not show up when you ask about it. You can only instrument the system so the disparity becomes visible, reproducible and arguable — and then argue about it.
This essay was the whole of olive.is until August 2026. It is reproduced here as the first post rather than retired, because the argument did not stop being true when the company's front page changed.
Receipts — where every figure came from 6
| Figure | How | Method | Source |
|---|---|---|---|
84% |
Computed | Relative difference between the two word error rates below: (0.35 − 0.19) / 0.19 = 84.2%. <strong>This figure is ours, not Koenecke et al.'s</strong> — the paper reports the two rates, not the relative gap. The previous olive.is printed it directly under the citation, which read as though the paper said it. | Derived |
0.35 |
Cited | Average word error rate for Black speakers across five commercial ASR systems. | Koenecke et al., PNAS 2020 |
0.19 |
Cited | Average word error rate for white speakers, same five systems, same study. | Koenecke et al., PNAS 2020 |
acoustic modeling |
Cited | The authors attribute the disparity primarily to the acoustic models rather than to lexical or grammatical differences. | Koenecke et al., PNAS 2020 |
covert vs overt divergence |
Cited | Dialect prejudice persists under human-feedback training while overt bias measures improve. We have not reproduced this and assert the direction, not a magnitude. | Hofmann et al., Nature 2024 |
race-based medicine |
Cited | All models tested produced examples of debunked race-based medical claims. Referenced as context for the stakes; no figure from it is quoted here. | Omiye et al., npj Digital Medicine 2023 |