As an organization committed to using AI for social good, pymetrics strives to be transparent in our interactions with employers, candidates, and the general public. The models we build can have very real implications for people’s lives, so we believe we have a special responsibility to be forthcoming about our process. 
‍
We invited a group of AI auditing experts, Christo Wilson and Alan Mislove from Northeastern University, to conduct an independent, third-party audit of our codebase and platform for objectivity and fairness. They had access to the codebase, data, and a representative set of models, and ran their own statistical tests. The results were made fully public after peer-review by ACM FaccT 2021 public. We intend to set the industry precedent for how to conduct a third-party audit.