Check your artificial intelligence ‘bossware’ tools for bias, says U.S. agency head

May 18, 2023, 8:53 AM

FILE - The emblem of the U.S. Equal Employment Opportunity Commission is shown on a podium in Vail,...

FILE - The emblem of the U.S. Equal Employment Opportunity Commission is shown on a podium in Vail, Colo., Tuesday, Feb. 16, 2016, in Denver. Charlotte Burrows, chair of the Equal Employment Opportunity Commission, told The Associated Press, Thursday, May 18, 2023, that the agency is trying to educate employers and technology providers about their use of these surveillance tools as well as AI tools that streamline the work of evaluating job prospects. (AP Photo/David Zalubowski, File)

(AP Photo/David Zalubowski, File)

The head of the U.S. agency charged with enforcing civil rights in the workplace says artificial intelligence-driven “bossware” tools that closely track the whereabouts, keystrokes and productivity of workers can also run afoul of discrimination laws.

Charlotte Burrows, chair of the Equal Employment Opportunity Commission, told The Associated Press that the agency is trying to educate employers and technology providers about their use of these surveillance tools as well as AI tools that streamline the work of evaluating job prospects.

And if they aren’t careful with say, draconian schedule-monitoring algorithms that penalize breaks for pregnant women or Muslims taking time to pray, or allowing faulty software to screen out graduates of women’s or historically Black colleges – they can’t blame AI when the EEOC comes calling.

“I’m not shy about using our enforcement authority when it’s necessary,” Burrows said. “We want to work with employers, but there’s certainly no exemption to the civil rights laws because you engage in discrimination some high-tech way.”

The federal agency put out its latest set of guidance Thursday on the use of automated systems in employment decisions such as who to hire or promote. It explains how to interpret a key provision of the Civil Rights Act of 1964 known as Title VII that bars job discrimination based on race, color, national origin, religion or sex, which includes bias against gay, lesbian and transgender workers.

Burrows said one important example involves widely-used resumé screeners and whether or not they can produce a biased result if they are based on biased data.

“What will happen is that there’s an algorithm that is looking for patterns that reflect patterns that it’s already familiar with,” she said. “It will be trained on data that comes from its existing employees. And if you have a non-diverse set of employees currently, you’re likely to end up with kicking out people inadvertently who don’t look like your current employees.”

Amazon, for instance, abandoned its own resume-scanning tool to recruit top talent after finding it favored men for technical roles — in part because it was comparing job candidates against the company’s own male-dominated tech workforce.

sending similar warnings for the past year, with previous sets of guidance about how some AI tools could discriminate against people with disabilities and violate the Americans with Disabilities Act.

In some cases, the EEOC has taken action. In March, the operator of tech job-search website settled with the agency to end an investigation over allegations it was allowing job posters to exclude workers of U.S. national origin in favor of immigrants seeking work visas. To settle the case, the parent company, DHI Group, agreed to rewrite its programming to “scrape” for discriminatory language such as “H-1Bs Only,” a reference to a type of work visa.

Much of the EEOC’s work involves investigating the complaints filed by employees who believe they were discriminated against. And while it’s hard for job applicants to know if a biased hiring tool resulted in them being denied a job, Burrows said there is “generally more awareness” among workers about the tools that are increasingly being used to monitor their productivity.

Those tools have ranged from radio frequency devices to track nurses, to monitoring the minute-by-minute tightly controlled schedule of warehouse workers and delivery drivers, to tracking keystrokes or computer mouse clicks as many office employees started working from home during the pandemic. Some might violate civil rights laws, depending on how they’re being used.

Burrows noted that the National Labor Relations Board is also looking at such AI tools. The NLRB sent a memo last year warning that overly intrusive surveillance and management tools can impair the rights of workers to communicate with each other about union activity or unsafe conditions.

“I think that the best approach there — I’m not saying not to use it, it’s not per se illegal — but is to really think what it is that employers are looking to measure and maybe measure that directly,” Burrows said. “If you’re trying to see if the work is getting done, maybe check that the work is getting done.”

National News

FILE - A person, reflected in glass, walks near the Tropicana Las Vegas on May 16, 2023, in Las Veg...

Associated Press

Las Vegas ballpark pitch revives debate over public funding for sports stadiums

CARSON CITY, Nev. (AP) — Gov. Joe Lombardo wants to help build Major League Baseball’s smallest ballpark, arguing that the worst team in baseball can boost Las Vegas, a city striving to call itself a sports mecca. Debate about public funding for private sports clubs has been revived with the Oakland Athletics ballpark proposal. The […]

1 day ago

FILE - Coretta Scott King, widow of slain civil rights leader Martin Luther King Jr., speaks at an ...

Associated Press

Carter and the Kings: A friendship and alliance — but after MLK’s assassination

ATLANTA (AP) — The voice of Martin Luther King Sr., a melodic tenor like his slain son, carried across Madison Square Garden, calming the raucous Democrats who had nominated his friend and fellow Georgian for the presidency. “Surely, the Lord sent Jimmy Carter to come on out and bring America back where she belongs,” the […]

1 day ago

Last seasons plant stalks are seen at Seth Jacobs' marijuana planting field at his Slack Hollow far...

Associated Press

Slow start to New York’s legal pot market leaves farmers holding the bag

ARGYLE, N.Y. (AP) — Seth Jacobs has about 100 bins packed with marijuana flower sitting in storage at his upstate New York farm. And that’s a problem. There aren’t enough places to sell it. The 700 pounds (318 kilograms) of pungent flower was harvested last year as part of New York’s first crop of legally […]

1 day ago

FILE - Sen. Tammy Baldwin, D-Wis., speaks during a Senate Health, Education, Labor and Pensions con...

Associated Press

Wisconsin Republicans look for rebound, Democrats stay on offensive as 2024 fights loom

MADISON, Wis. (AP) — Wisconsin once again be a battleground. Democrats, recognizing that four of the past six presidential elections in the state have been decided by less than a percentage point, are trying not to become overconfident in the face of recent gains. They are gathering for their annual state convention starting June 10 […]

1 day ago

Associated Press

Michigan wildfire prompts evacuations, threatens multiple buildings

GRAYLING TOWNSHIP, Mich. (AP) — A wildfire in Michigan burned more than 1,000 acres (1.5 square miles) and prompted emergency evacuations and road closures Saturday, according to the Michigan Department of Natural Resources. The wildfire located within Grayling Township, about 4 miles (6.4 km) southeast of Grayling, is moving west and southwest and threatens multiple […]

1 day ago

Associated Press

16 South American migrants who entered US through Texas flown to California

SACRAMENTO, Calif. (AP) — Sixteen Venezuelan and Colombian migrants who entered the country through Texas were flown to California by chartered plane and dropped off outside a church in Sacramento, Gov. Gavin Newsom and migrant rights advocates said Saturday. The young men and women were dropped off Friday outside the Roman Catholic Diocese of Sacramento […]

1 day ago

Sponsored Articles

Men's Health Month...

Men’s Health Month: Why It’s Important to Speak About Your Health

June is Men’s Health Month, with the goal to raise awareness about men’s health and to encourage men to speak about their health.

Internet Washington...

Major Internet Upgrade and Expansion Planned This Year in Washington State

Comcast is investing $280 million this year to offer multi-gigabit Internet speeds to more than four million locations.

Compassion International...

Brock Huard and Friends Rally Around The Fight for First Campaign

Professional athletes are teaming up to prevent infant mortality and empower women at risk in communities facing severe poverty.

Emergency Preparedness...

Prepare for the next disaster at the Emergency Preparedness Conference

Being prepared before the next emergency arrives is key to preserving businesses and organizations of many kinds.

SHIBA volunteer...

Volunteer to help people understand their Medicare options!

If you’re retired or getting ready to retire and looking for new ways to stay active, becoming a SHIBA volunteer could be for you!

safety from crime...

As crime increases, our safety measures must too

It's easy to be accused of fearmongering regarding crime, but Seattle residents might have good reason to be concerned for their safety.

Check your artificial intelligence ‘bossware’ tools for bias, says U.S. agency head