Categories: DisabilityRights

Disability rights advocates are worried about discrimination in AI hiring tools

Your ability to land your next job could depend on how well you play one of the AI-powered games that companies like AstraZeneca and Postmates are increasingly using in the hiring process.

Some companies that create these games, like Pymetrics and Arctic Shores, claim that they limit bias in hiring. But AI hiring games can be especially difficult to navigate for job seekers with disabilities.

In the latest episode of MIT Technology Review’s podcast “In Machines We Trust,” we explore how AI-powered hiring games and other tools may exclude people with disabilities. And while many people in the US are looking to the federal commission responsible for employment discrimination to regulate these technologies, the agency has yet to act.

To get a closer look, we asked Henry Claypool, a disability policy analyst, to play one of Pymetrics’s games. Pymetrics measures nine skills, including attention, generosity, and risk tolerance, that CEO and cofounder Frida Polli says relate to job success.

When it works with a company looking to hire new people, Pymetrics first asks the company to identify people who are already succeeding at the job it’s trying to fill and has them play its games. Then, to identify the skills most specific to the successful employees, it compares their game data with data from a random sample of players.

When he signed on, the game prompted Claypool to choose between a modified version—designed for those with color blindness, ADHD, or dyslexia—and an unmodified version. This question poses a dilemma for applicants with disabilities, he says.

“The fear is that if I click one of these, I’ll disclose something that will disqualify me for the job, and if I don’t click on—say—dyslexia or whatever it is that makes it difficult for me to read letters and process that information quickly, then I’ll be at a disadvantage,” Claypool says. “I’m going to fail either way.”

Polli says Pymetrics does not tell employers which applicants requested in-game accommodations during the hiring process, which should help prevent employers from discriminating against people with certain disabilities. She added that in response to our reporting, the company will make this information more clear so applicants know that their need for an in-game accommodation is private and confidential.   

The Americans with Disabilities Act requires employers to provide reasonable accommodations to people with disabilities. And if a company’s hiring assessments exclude people with disabilities, then it must prove that those assessments are necessary to the job.

For employers, using games such as those produced by Arctic Shores may seem more objective. Unlike traditional psychometric testing, Arctic Shores’s algorithm evaluates candidates on the basis of their choices throughout the game. However, candidates often don’t know what the game is measuring or what to expect as they play. For applicants with disabilities, this makes it hard to know whether they should ask for an accommodation.

Safe Hammad, CTO and cofounder of Arctic Shores, says his team is focused on making its assessments accessible to as many people as possible. People with color blindness and hearing disabilities can use the company’s software without special accommodations, he says, but employers should not use such requests to screen out candidates.

The use of these tools can sometimes exclude people in ways that may not be obvious to a potential employer, though. Patti Sanchez is an employment specialist at the MacDonald Training Center in Florida who works with job seekers who are deaf or hard of hearing. About two years ago, one of her clients applied for a job at Amazon that required a video interview through HireVue.

Sanchez, who is also deaf, attempted to call and request assistance from the company, but couldn’t get through. Instead, she brought her client and a sign language interpreter to the hiring site and persuaded representatives there to interview him in person. Amazon hired her client, but Sanchez says issues like these are common when navigating automated systems. (Amazon did not respond to a request for comment.)

Making hiring technology accessible means ensuring both that a candidate can use the technology and that the skills it measures don’t unfairly exclude candidates with disabilities, says Alexandra Givens, the CEO of the Center for Democracy and Technology, an organization focused on civil rights in the digital age.

AI-powered hiring tools often fail to include people with disabilities when generating their training data, she says. Such people have long been excluded from the workforce, so algorithms modeled after a company’s previous hires won’t reflect their potential.

Even if the models could account for outliers, the way a disability presents itself varies widely from person to person. Two people with autism, for example, could have very different strengths and challenges.

“As we automate these systems, and employers push to what’s fastest and most efficient, they’re losing the chance for people to actually show their qualifications and their ability to do the job,” Givens says. “And that is a huge loss.”

A hands-off approach

Government regulators are finding it difficult to monitor AI hiring tools. In December 2020, 11 senators wrote a letter to the US

Read More

News Bot

Share
Published by
News Bot

Recent Posts

Digital out-of-home deserves a seat at the adult table

The out-of-home (OOH) media industry has been quick to convert strategic billboards to digital displays…

32 mins ago

Is YouTube TV’s Price Increasing in 2021? Google Says No

PixieMe/Shutterstock.comYouTube TV has seen its share of price increases since it launched a few years…

35 mins ago

How to Disable the Print Spooler Service on Windows 10

FabrikaSimf/Shutterstock.comLooking to disable the print spooler service? Windows 10 runs the service to keep your…

35 mins ago

How to Change Your PlayStation 5’s Privacy Settings

Girts Ragelis / ShutterstockThe Sony PlayStation 5 offers a wide range of privacy settings—from hiding…

35 mins ago

Google Maps Makes It Easier to Share Your Location on iPhone

With the latest version of Google Maps for iPhone and iPad, you can share your…

35 mins ago

The 10 Best Comedy Movies on Amazon Prime Video

sdx15/Shutterstock.comComedic movies can be goofy, clever, tragic, depressing, or uplifting. If you’re looking for something…

35 mins ago