Mike Knoop (@mikeknoop) / X

Mike Knoop

4,099 posts

Mike Knoop

@mikeknoop

co-founder @ndea and @zapier @arcprize

sf bay area

Joined July 2009

Pinned
Mike Knoop
@mikeknoop
Mar 25
ARC-AGI-3 and ARC Prize 2026 are now live with $2,000,000 in prizes! As of today, version 3 is the world's only unsaturated agentic intelligence benchmark. Humans score 100% and frontier AI scores ~0%. Play here: arcprize.org/arc-agi/3 While no single version of ARC is
ARC-AGI-3
From arcprize.org
18K
Mike Knoop
@mikeknoop
Aug 27, 2024
Parent tip: you can upload a photo of your kids printed paper school calendar to ChatGPT and ask it to generate an .ics calendar file that you can directly import
1.2M
Mike Knoop
@mikeknoop
Jul 10, 2025
This is accurate. We verified Grok 4 using our semi-private ARC datasets.
Elon Musk
@elonmusk
Jul 10, 2025
Replying to @beffjezos
Important to note that ARC tested @grok 4 independently to achieve those results. Those results are not from us.
3.7M
Mike Knoop
@mikeknoop
Dec 20, 2024
o3 is really special and everyone will need to update their intuition about what AI can/cannot do. while these are still early days, this system shows a genuine increase in intelligence, canaried by ARC-AGI semiprivate v1 scores: * GPT-2 (2019): 0% * GPT-3 (2020): 0% * GPT-4
ARC Prize
@arcprize
Dec 20, 2024
New verified ARC-AGI-Pub SoTA! @OpenAI o3 has scored a breakthrough 75.7% on the ARC-AGI Semi-Private Evaluation. And a high-compute o3 configuration (not eligible for ARC-AGI-Pub) scored 87.5% on the Semi-Private Eval. 1/4
689K
Mike Knoop
@mikeknoop
Jan 3, 2025
has anyone yet demo'd an AI system equipped with a wallet and when prompted "go make me money" has earned >$0 dollars?
306K
Mike Knoop
@mikeknoop
Jan 15, 2025
AGI is the most important technology in the history of the world. That's why I'm going all in on a new adventure with @fchollet. We’re creating a new intelligence science lab -- Ndea. @ndeainc's ultimate goal is to compress science timelines. First by understanding intelligence,
148K
Mike Knoop
@mikeknoop
Nov 18, 2025
We just verified Gemini 3 Pro and Deep Think (Preview) are over 2X SOTA on ARC v2! This is really impressive and frankly a bit surprising. Impressive because many of the v2 solves indicate clear complexity scaling over v1. Such as tasks 65b59efc, e3721c99, and dd6b8c4b We’re
ARC Prize
@arcprize
Nov 18, 2025
Gemini 3 models from @Google @GoogleDeepMind have made a significant 2X SOTA jump on ARC-AGI-2 (Semi-Private Eval) Gemini 3 Pro: 31.11%, $0.81/task Gemini 3 Deep Think (Preview): 45.14%, $77.16/task
171K
Mike Knoop
@mikeknoop
Jan 29, 2025
just published my full @arcprize analysis of deepseek's r1-zero and r1. link below. key points: r1-zero is more important than r1. both r1-zero and r1 score ~15% on ARC-AGI-1. this is fascinating. it matches deepseek's own benchmarking showing comprable results in logical
139K
Mike Knoop
@mikeknoop
Jun 11, 2024
No one can beat the 2019 ARC-AGI benchmark. We've stalled. LLMs are not enough. Frontier research has gone closed source. We need new ideas. Maybe from you? Thrilled to announce @arcprize with @fchollet A $1,000,000 competition to beat ARC and re-start open AGI progress
00:00
259K
Mike Knoop
@mikeknoop
Sep 12, 2024
Many are asking how OpenAI's new o1 model performs against ARC-AGI. We just got access, expect initial results along with my notes in the next 24 hours.
102K
Mike Knoop
@mikeknoop
Apr 22, 2025
ARC-AGI o3 retest results are in! Takeaway: o3 (medium) is the industry leading AI reasoning system by large margin. 2X score and 1/20 cost compared to next leading chain-of-thought system as measured by ARC v1 semiprivate set scoring 57% for $1.5/task. On v2, o3 (medium)
283K
Mike Knoop
@mikeknoop
Jan 26, 2024
Over 30% of Zapier employees now have AI Zaps doing stuff automatically for them
336K
Mike Knoop
@mikeknoop
Dec 21, 2024
Raising visibility on this note we added to address ARC "tuned" confusion: > OpenAI shared they trained the o3 we tested on 75% of the Public Training set. This is the explicit purpose of the training set. It is designed to expose a system to the core knowledge priors needed to
178K
Mike Knoop
@mikeknoop
Feb 15, 2025
Very happy to share we welcomed our third daughter to the future!
29K