user avatar
Deb Raji
@rajiinio
AI accountability, audits & eval. Keen on participation & practical outcomes. CS PhDing @UCBerkeley. forever @AJLUnited, @hashtag_include ✝️
Berkeley, CA
Joined April 2018
Posts
  • user avatar
    ICYMI: Twitter conducted one of the largest platform audits ever (randomized trial on 58 million users) to assess "political bias" of their algorithm. In 6 of 7 countries, "the mainstream political right enjoys higher algorithmic amplification than the mainstream political left."
  • user avatar
    These are the four most popular misconceptions people have about race & gender bias in algorithms. I'm wary of wading into this conversation again, but it's important to acknowledge the research that refutes each point, despite it feeling counter-intuitive. Let me clarify.👇🏾
    FOUR things to know about race and gender bias in algorithms: 1. The bias starts in the data 2. The algorithms don't create the bias but they do transmit it 3. There are a huge number of other biases. Race and gender bias are just the most obvious 4. It's fixable! 🧵👇
  • user avatar
    One day we are going to wake up, after years of the consistent and pernicious pollution of critical information ecosystems, and deeply regret this era of thoughtless LLM deployment. A devastating loss of accuracy, clarity and conciseness -- for what?
    The internet has been progressively diluted with AI-generated slop. Are medical records headed for the same fate? 🧵 I just published a perspective in @NEJM with @AdamRodmanMD and Arjun Manrai on why rushing AI into medical documentation could be a mistake.
  • user avatar
    ICYMI @jovialjoy + @AOC = 🔥🔥🔥 My fave exchange from House Oversight hearing on facial recognition: "We saw that these algorithms are effective to.. different degrees. Are they most effective on women?" "No" "Are they most effective on people of color?" "Absolutely not."
    00:00
  • user avatar
    We can't keep regulating AI as if it..works. Most policy interventions start with the assumption that the technology lives up to its claims of performance but policymakers & critical scholars need to stop falling for the corporate hype and should scrutinize these claims more.
  • user avatar
    She didn't resign, a meta-thread. #IStandWithTimnit
    I understand the concern over Timnit’s resignation from Google. She’s done a great deal to move the field forward with her research. I wanted to share the email I sent to Google Research and some thoughts on our research process. docs.google.com/document/d/1f2…
  • user avatar
    In our upcoming paper, we use a children's picture book to explain how bizarre it is that ML researchers claim to measure "general" model capabilities with *data* benchmarks - artifacts that are inherently specific, contextualized and finite. Deets here: arxiv.org/abs/2111.15366
  • user avatar
    The troubling thing about data is that, if you're Black, it's likely to contain lies about you. This piece gets at the heart of something that so much alarmed me when I first got into the field, surrounded by people calling these lies "ground truth".
  • user avatar
    I'm starting a CS PhD @Berkeley_EECS this Fall, working with @beenwrekt & @red_abebe! Doing a PhD is a casual decision for some - that wasn't the case for me. I appreciate everyone that respected me enough to understand this & continued to work with me to figure things out. 💕
  • user avatar
    Replying to @rajiinio
    This is solid evidence to dismantle the "conservative bias" narrative being pushed in certain policy circles (ahem @elonmusk & crew). And it makes sense - right-wing creators disproportionately manipulate these rec engines to drive content engagement:
  • user avatar
    People keep talking about the Google search AI fiasco as if it is some kind of toy or sandbox pilot...This is a live product with billions of users. For every mess up that we're laughing at, there's millions un-ironically taking that AI spewed misinformation as fact. Unsettling.
  • user avatar
    This reveals so much about how little we meaningfully discuss data choices in computer science education. Data are at the locus of pretty much every tech policy issue - labor, bias, environmental, copyright, privacy, security, toxicity, safety, etc. It is literally politics!
    I teach computer science and challenge him to find any politics in my class. When political opinions start meddling with scholarship, it ceases being science and becomes activism.
  • user avatar
  • user avatar
    If ML researchers want to be taken seriously, they should start by taking themselves seriously. The lack of thought around the tasks the field chooses to rally around astounds me - we need to begin critically reflecting on what kind of problems this tech can meaningfully solve.