Your New AI Hiring Tool Is a Discrimination Claim With a Really Nice Dashboard
📌 Riffing on a real one: r/humanresources — how are we actually using AI in HR work
The thread was 'how are we actually using AI in our HR work,' and the answers ranged from 'resume screening' to 'it writes my PIPs now,' and somewhere in the legal-department basement I felt a cold breeze. We need to talk about your robot.
The tool is not the one who gets sued (you are)
Here is the thing the vendor will never put on the sales deck: when an algorithm screens out a protected group at a higher rate, the legal liability does not live with the software company. It lives with you, the employer who deployed it. 'The AI did it' carries the exact same legal weight as 'the spreadsheet did it.' You chose the spreadsheet.
'We didn't know it was biased' is not a defense
Disparate impact doesn't require that you intended to discriminate. A tool trained on your past hiring will happily learn your past patterns — including the ones you'd be embarrassed to defend in a deposition — and then apply them at scale, faster, to far more people. The EEOC has been clear that existing civil-rights law applies to algorithmic tools, and a growing list of states and cities now pile bias-audit and candidate-notice requirements on top of that.
Bias audits and the paper trail
If you're going to let a model touch hiring decisions, you want documentation that you tested it for adverse impact, that you keep testing it, and that a human with actual judgment reviews what it produces. The bias audit isn't bureaucratic theater — it's the entire difference between 'we exercised reasonable care' and 'we deployed a black box and crossed our fingers.'
The questions to ask the vendor
Ask them, in writing: what data was this trained on, have you tested it for adverse impact and will you share the results, what accommodations exist for disabled candidates, and will you indemnify us when a regulator asks these same questions. Then watch how quickly the energy in the sales call changes.
Automate the tedious parts all you like — scheduling, reminders, the seventeenth status email. Just don't automate the part where a human being is accountable for who gets a job. The robot cannot be deposed. You can. Consult your employment attorney, ideally before you sign the order form. 📋