Many employers commonly use automated or AI-based tools as part of their hiring processes, including to advertise job opportunities, collect and filter applications, review resumes, conduct interviews, and more. These tools can enable or exacerbate discrimination in hiring based on race, sex, disability, or other protected characteristics, and applicants may not even know they are being used in the first place.
Because of a recently enacted law, employers in New York City using these technologies are now required to work with independent auditors to conduct “bias audits” of some of the tools they use and share certain results publicly. While employers are required to provide a link to relevant bias audits on their website, these audits can be very difficult to find, and some employers have posted and later removed this information. We think that for algorithmic audits to provide meaningful transparency, they should be easily accessible. That's why the ACLU and NYCLU created this repository, where you can find examples of bias audits employers have posted publicly, as well as links to Perma.cc captures of employers' bias audits.
If you know of Local Law 144 bias audits that employers have posted that we missed, you can email us to let us know.
| Deploying Entity* | Tool Vendor or Name | Auditor | Date of Audit | Original | Perma.cc Capture | Other Entities That Have Posted the Audit |
|---|---|---|---|---|---|---|
| ADP | ADP Profile Relevance and Candidate Relevancy | BLDS, LLC | 04/2023 | Removed from employer website | Capture from 11/06/23 | |
| ADP | ADP Profile Relevance and Candidate Relevancy | BLDS, LLC | 04/2024 | From ADP.com | Capture from 7/31/24 | |
| Bloomberg | PLUM Assessment | Resolution Economics, LLC | 7/3/2023 | From CDN | Capture from 11/03/23 | |
| BNP Paribas | pymetrics inc. (Harver) Soft Skills Platform | BABL AI | 6/29/2023 | From BNP Paribas Job Posting (see link to bias audit at the bottom of the page) | Capture from 1/03/24 | |
| Dover | Dover | Varun Ganesan | 6/23/23 | From CDN | Capture from 11/03/23 | |
| Eightfold.AI | Eightfold Matching Model | BABL AI | 6/16/2023 | Removed from employer website as of check on 9/30/24 | ||
| Eightfold.AI | Eightfold Matching Model | BABL AI | 4/03/2023 | From Eightfold.AI | Capture from 8/28/24 | |
| HackerRank | HackerRank Plagiarism Detection System | BABL AI | 6/30/2023 | Removed from employer website as of check on 9/30/24 | Capture from 11/02/23 | |
| HackerRank | HackerRank Plagiarism Detection System | BABL AI | 7/22/2024 | From HackerRank.com | Capture from 9/13/24 | |
| HackerRank | HackerRank Image Analysis System | BABL AI | 6/30/2023 | Removed from employer website as of check on 9/30/24 | Capture from 11/02/23 | |
| HackerRank | HackerRank Image Analysis System | BABL AI | 7/22/2024 | From HackerRank.com | Capture from 9/13/24 | |
| The Hartford | Unknown/Not Disclosed | DCI Consulting Group | 7/5/2023 | Removed from employer website as of check on 11/02/23 | Capture from 8/11/23 | |
| HiredScore | HiredScore | Unknown | 7/2/2023 | Removed from employer website as of check on 10/1/24 | Capture from 11/02/23 | |
| HiredScore | HiredScore | Unknown | 2/12/2024 | From HiredScore.com | Capture from 10/01/24 | |
| JetBlue | HireVue (various assessments) | DCI Consulting Group | 7/5/2023 | Removed from employer website as of check on 10/1/24 | Capture from 11/06/23 | |
| JetBlue | HireVue (various assessments) | DCI Consulting Group | 7/5/2024 | From JetBlue.com | Capture from 10/1/24 | |
| Morgan Stanley | Eightfold Matching Model | BLDS, LLC | 7/5/2023 | Removed from employer website as of check on 10/1/24 | Capture from 11/03/23 | |
| Morgan Stanley | Eightfold Matching Model | BLDS, LLC | 7/31/2024 | From MorganStanley.com | Capture from 10/1/24 | |
| NBCUniversal | SmartRecruiters SmartAssistant | Conductor AI | 7/11/2023 | Removed from Conductor AI's website as of check on 10/16/24 | Capture from 11/03/23 | AdTalem |
| NYU Langone Health | Talent Plus | Ambrose Consulting, LLC | 2023 | From CDN | Capture from 1/03/24 | |
| Paradox | Paradox's Olivia Chatbot | Holistic AI | 6/5/2023 | From Paradox.AI | Capture from 11/02/23 | |
| Paradox | Paradox's Conversational AI Platform | Holistic AI | 5/6/2024 | From Paradox.AI | Capture from 9/27/24 | |
| Paradox | Paradox's Traitify Tool | Holistic AI | 6/12/2023 | From Paradox.AI | Capture from 11/02/23 | |
| Paradox | Paradox's Traitify Tool | Holistic AI | 5/6/2024 | From Paradox.AI | Capture from 9/27/24 | |
| Pfizer | HireVue (various assessments) | DCI Consulting Group | 7/5/2023 | From CDN | Capture from 11/03/23 | |
| Plum | Plum Platform | Holistic AI | 8/23/2023 | From use.plum.io | ||
| Reejig | Reejig Ethical Talent AI | Holistic AI | 11/30/2023 | From Reejig.com | Capture from 1/03/24 | |
| RippleMatch | RippleMatch Fit Score Algorithm | BABL AI | 6/22/2023 | Removed from employer websites as of check on 10/1/24 | Capture from 11/03/23 | |
| RippleMatch | RippleMatch Fit Score Algorithm | BABL AI | 6/27/2024 | From Ripplematch.com | Capture from 9/24/2024 | |
| Sheppard Mullin | Suited Law Assessment | Holistic AI | 5/26/2023 | Removed from employer websites as of check on 10/1/24 | Capture from 11/02/23 | |
| Sheppard Mullin | Suited Law Assessment | Holistic AI | 3/11/2024 | From WellSuited | Capture from 10/1/2024 | |
| Wells Fargo | Unknown | DCI Consulting Group | 7/5/2023 | From WellsFargoJobs.com | Capture from 11/03/23 | |
| Covey | Covey | Conductor AI | 8/10/2023 | Removed from employer website as of check on 9/30/24 | Capture from 2/1/24 | Vannevar Labs |
| Covey | Covey | Idiro Analytics | 7/29/2024 | From getcovey.com | Capture from 9/27/24 | |
| Vervoe | Vervoe Assessment | Holistic AI | 3/21/2024 | From vervoe.com | Capture from 4/24/24 | |
| ZoomInfo | ZoomInfo | Unknown | 5/15/2023 | From ZoomInfo.com | Capture from 4/24/24 | |
| Burlington | HireVue (various assessments for Intern or new college graduate jobs) | DCI Consulting Group | 7/5/2023 | From CDN | Capture from 4/24/24 | |
| Burlington | HireVue (various assessments for Intern or new college graduate jobs) | DCI Consulting Group | 7/5/2024 | From CDN | Capture from 10/1/24 | |
| Burlington | HireVue assessment used for Allocation Analyst role | DCI Consulting Group | 11/1/2023 | From CDN | Capture from 4/24/24 | |
| Burlington | HireVue assessment used for Intern role | DCI Consulting Group | 11/1/2023 | From CDN | Capture from 4/24/24 | |
| Bryq | Bryq Talent Intelligence | Holistic AI | 5/15/2023 | From CDN | Capture from 4/24/24 | |
| Bryq | Bryq Talent Intelligence | Holistic AI | 5/17/2024 | From CDN | Capture from 10/1/24 | |
| Citizens | HireVue (various assessments) | DCI Consulting Group | 7/5/2023 | Removed from employer website as of check on 10/1/24 | Capture from 7/10/24 | |
| Citizens | HireVue (various assessments) | DCI Consulting Group | 7/5/2024 | From CitizensBank.com | Capture from 10/1/24 | |
| Cigna | Unknown | Unknown | 10/18/2023 | From Cigna.com | Capture from 10/16/24 | |
| Alidoro | Landed | Conductor AI | 6/27/2023 | From CDN | Capture from 10/16/24 | |
| SmartRecruiters | SmartAssistant | Conductor AI | 8/02/24 | From CDN | Capture from 10/16/24 | |
| Landed | Landed | Conductor AI | 6/26/2024 | From Employer.GotLanded.com | Capture from 10/16/24 | |
| Phenom | Phenom Fit Score | Conductor AI | 4/04/2024 | |||
| Beamery | AI Talent Match | Warden AI | 09/17/2024 | |||
| Sense | Sense Candidate Matching | Holistic AI | Unknown | From SenseHQ.com | Capture from 11/05/24 | |
| Sense | Sense Chatbot | Holistic AI | Unknown | From SenseHQ.com | Capture from 11/05/24 |
*The term "deploying entity" generally refers to the entity that posted the associated audit report on their website, which may be a tool vendor or an employer using a vendor's tool.
The tracker in this repository is licensed under CC BY-NC 4.0.