ICYMI: Twitter conducted one of the largest platform audits ever (randomized trial on 58 million users) to assess "political bias" of their algorithm. In 6 of 7 countries, "the mainstream political right enjoys higher algorithmic amplification than the mainstream political left."
Deb Raji
6,209 posts
AI accountability, audits & eval. Keen on participation & practical outcomes. CS PhDing @UCBerkeley.
forever @AJLUnited, @hashtag_include ✝️
- These are the four most popular misconceptions people have about race & gender bias in algorithms. I'm wary of wading into this conversation again, but it's important to acknowledge the research that refutes each point, despite it feeling counter-intuitive. Let me clarify.👇🏾FOUR things to know about race and gender bias in algorithms: 1. The bias starts in the data 2. The algorithms don't create the bias but they do transmit it 3. There are a huge number of other biases. Race and gender bias are just the most obvious 4. It's fixable! 🧵👇
- One day we are going to wake up, after years of the consistent and pernicious pollution of critical information ecosystems, and deeply regret this era of thoughtless LLM deployment. A devastating loss of accuracy, clarity and conciseness -- for what?The internet has been progressively diluted with AI-generated slop. Are medical records headed for the same fate? 🧵 I just published a perspective in @NEJM with @AdamRodmanMD and Arjun Manrai on why rushing AI into medical documentation could be a mistake.
- ICYMI @jovialjoy + @AOC = 🔥🔥🔥 My fave exchange from House Oversight hearing on facial recognition: "We saw that these algorithms are effective to.. different degrees. Are they most effective on women?" "No" "Are they most effective on people of color?" "Absolutely not."
00:00 - We can't keep regulating AI as if it..works. Most policy interventions start with the assumption that the technology lives up to its claims of performance but policymakers & critical scholars need to stop falling for the corporate hype and should scrutinize these claims more.
- She didn't resign, a meta-thread. #IStandWithTimnitI understand the concern over Timnit’s resignation from Google. She’s done a great deal to move the field forward with her research. I wanted to share the email I sent to Google Research and some thoughts on our research process. docs.google.com/document/d/1f2…
- In our upcoming paper, we use a children's picture book to explain how bizarre it is that ML researchers claim to measure "general" model capabilities with *data* benchmarks - artifacts that are inherently specific, contextualized and finite. Deets here: arxiv.org/abs/2111.15366
- The troubling thing about data is that, if you're Black, it's likely to contain lies about you. This piece gets at the heart of something that so much alarmed me when I first got into the field, surrounded by people calling these lies "ground truth".
- I'm starting a CS PhD @Berkeley_EECS this Fall, working with @beenwrekt & @red_abebe! Doing a PhD is a casual decision for some - that wasn't the case for me. I appreciate everyone that respected me enough to understand this & continued to work with me to figure things out. 💕
- People keep talking about the Google search AI fiasco as if it is some kind of toy or sandbox pilot...This is a live product with billions of users. For every mess up that we're laughing at, there's millions un-ironically taking that AI spewed misinformation as fact. Unsettling.
- This reveals so much about how little we meaningfully discuss data choices in computer science education. Data are at the locus of pretty much every tech policy issue - labor, bias, environmental, copyright, privacy, security, toxicity, safety, etc. It is literally politics!I teach computer science and challenge him to find any politics in my class. When political opinions start meddling with scholarship, it ceases being science and becomes activism.
- If ML researchers want to be taken seriously, they should start by taking themselves seriously. The lack of thought around the tasks the field chooses to rally around astounds me - we need to begin critically reflecting on what kind of problems this tech can meaningfully solve.








