New York regulator probes Apple Card algorithms for gender bias after viral tweets

The New York Department of Financial Services is opening a probe into the new Apple Card’s algorithms when determining credit limits after series of tweets from a technology entrepreneur in the past few days alleged gender discrimination.

The Apple Card is a joint venture between Apple Inc AAPL, +0.27%   and investment bank Goldman Sachs GS, -0.17%  which is responsible for all the credit decisions on the card.

A series of posts from David Heinemeier Hansson starting Thursday criticized the Apple Card for giving him 20 times the credit limit that his wife got. Hansson is known as being behind the popular programming tool Ruby on Rails. He’s a partner at Basecamp, a web-based software development firm.

Hansson didn’t disclose any income for himself or his wife but said they filed joint tax returns and that his wife has a better credit score than he does.

“The department will be conducting an investigation to determine whether New York law was violated and ensure all consumers are treated equally regardless of sex,” said a spokesman for Linda Lacewell, the superintendent of the New York Department of Financial Services, according to a Bloomberg report. “Any algorithm, that intentionally or not results in discriminatory treatment of women or any other protected class of people violates New York law.”

“Our credit decisions are based on a customer’s creditworthiness and not on factors like gender, race, age, sexual orientation or any other basis prohibited by law,” Goldman spokesman Andrew Williams said.

Hansson said Goldman’s response doesn’t explain what happened after he started airing his issues on social media.

“As soon as this became a PR issue, they immediately bumped up her credit limit without asking for any additional documentation,” he said in an interview. “My belief isn’t there was some nefarious person wanting to discriminate. But that doesn’t matter. How do you know there isn’t an issue with the machine-learning algo when no one can explain how this decision was made?”

Hansson said his posts had led to an internal review and that he was hopeful it would spark a conversation about black-box algorithms and the inherent biases in those systems.

The use of algorithms by lenders in credit decisions has drawn scrutiny in Congress. In June, the House Financial Services Committee heard about examples of algorithmic decision-making where researchers have found instances of bias targeting specific groups even when there was no intent to discriminate.

“Goldman and Apple are delegating credit assessment to a black box,” Hansson said. “It’s not a gender-discrimination intent but it is a gender-discrimination outcome.”

This is the second such action from the New York regulator in recent weeks. NY DFS opened a probe against health care giant UnitedHealth Group Inc. UNH, +0.20%  after a study found an algorithm favored white patients over black patients.

The tweets, many of which contain profanity, went viral on the internet.

Filed in: Top News Tags: 

You might like:

Gifts That Pay Off: This holiday gift could earn your child $52,927 Gifts That Pay Off: This holiday gift could earn your child $52,927
Market Snapshot: S&P 500, Nasdaq still on pace to set records as stock-market gains fade Market Snapshot: S&P 500, Nasdaq still on pace to set records as stock-market gains fade
Rex Nutting: Trump didn’t transform the economy — it’s mostly the same as it was under Obama Rex Nutting: Trump didn’t transform the economy — it’s mostly the same as it was under Obama
The Number One: If you majored in this in college, there’s a good chance you’re kicking yourself The Number One: If you majored in this in college, there’s a good chance you’re kicking yourself
Deep Dive: Sales winners in the third quarter include Netflix, Autodesk and PayPal Deep Dive: Sales winners in the third quarter include Netflix, Autodesk and PayPal
Tyson Foods says its Beyond Meat rival Raised & Rooted is now in 7,000 stores Tyson Foods says its Beyond Meat rival Raised & Rooted is now in 7,000 stores
Trump Today: Trump says U.S.-China deal could happen soon and speaks at New York fundraiser Trump Today: Trump says U.S.-China deal could happen soon and speaks at New York fundraiser
Capitol Report: Trump calls U.S.-China deal ‘close’ in speech where he blasts Fed and touts economic successes Capitol Report: Trump calls U.S.-China deal ‘close’ in speech where he blasts Fed and touts economic successes

Leave a Reply

Submit Comment
© 2019 Stock Investors News. All rights reserved. XHTML / CSS Valid.