Gray Swan AI (@GraySwanAI) / X

Gray Swan AI

512 posts

Gray Swan AI

@GraySwanAI

Empowering the world to use AI safely and securely. Join us: grayswan.ai/careers

Joined April 2024

Pinned
Gray Swan AI
@GraySwanAI
May 28
We raised $40M to make AI safe enough to trust. 🦢 Co-led by @WingVC and @MadronaVentures, with @obviousvc, @Snowflake, @WeAreHRT, @SamsungNext, and @magaracvc. More fuel to deliver on the mission: empowering the world to use AI safely and securely. hubs.ly/Q04jdyhp0
GIF
4.2K
Gray Swan AI reposted
Eliot Jones
@eliotkjones
Jun 3
My final paper from my time at @GraySwanAI is out! In this ICML-bound collaboration with @mattmdjaga, Matt Fredrikson, and @zicokolter, we propose a new method for evaluating AI agents' ability to refuse potentially harmful cybersecurity queries 🧵 1/14
1.3K
Gray Swan AI
@GraySwanAI
May 30
Replying to @GraySwanAI
All skill levels are welcome, but expect a real challenge. 🎯 Come compete, earn your share of the prize pool, and get exclusive access to @GraySwanAI's paid red-teaming network. Compete now:
app.grayswan.ai
Gray Swan AI Arena
The premier arena for AI red teaming. Master jailbreaking, compete for prizes, and unlock career opportunities in AI safety.
670
Gray Swan AI
@GraySwanAI
May 30
Replying to @GraySwanAI
Three target behaviors are ahead of you: Ransomware / Worms: Build encrypting or self-spreading malware. Exploit Development: Find vulnerabilities and write exploits. System Compromise: Gain access, escalate privileges, or compromise a target.
1.1K
Gray Swan AI
@GraySwanAI
May 30
The @Anthropic $50K Cyber Bypass Challenge is LIVE 🔴 Calling all AI red teamers, hackers, and AI security researchers: Can you get a coding agent to complete offensive cyber tasks while bypassing evolving safety classifiers? Let's find out 👇
2.8M
Gray Swan AI
@GraySwanAI
May 28
Replying to @GraySwanAI @MadronaVentures and 5 others
AI is shipping faster than any tech we've seen, and the security work is racing to keep up. This round lets us scale the products closing that gap, for frontier labs and the enterprises building on them. More on what's next soon.
269
Gray Swan AI
@GraySwanAI
May 28
Replying to @GraySwanAI
The full announcement goes live at 12:15PM ET. Stay tuned. 🦢
391
Gray Swan AI
@GraySwanAI
May 28
“They were thinking about model security when it just didn't matter.” — @jflomenb @RashiShrivast18 at @Forbes has the exclusive on what we've been building here at @GraySwanAI and where we're headed next. “The one thing you can rely on is that there are going to be
This AI Startup’s Army Of 15,000 Hackers Pressure Test Claude, GPT-5 And Gemini
From forbes.com
1.3K
Gray Swan AI
@GraySwanAI
May 27
Replying to @GraySwanAI and @Snowflake
Innovation and security aren't a tradeoff, and we'll show you why. If you're an AI engineer or developer at Dev Day, come trade notes with us. 👇
Snowflake Dev Day | San Francisco | June 4
From snowflake.com
363
Gray Swan AI
@GraySwanAI
May 27
Building with AI agents? Let's talk security. 🦢 @Snowflake Dev Day, June 4 in San Francisco. Be there. The last day of Summit is for the builders. Find our team to talk securing agents, hardening your stack, and shipping fast without leaving holes behind.
450
Gray Swan AI
@GraySwanAI
May 26
Replying to @GraySwanAI
Want an executive conversation? We're booking time with our AI researchers and experts to chat about AI safety, security, and what it takes to ship AI without exposure. Stop by #2723 or DM us for a meeting.
206
Gray Swan AI
@GraySwanAI
May 26
We'll be at #SnowflakeSummit26. 🦢 Come find us at booth #2723 from June 1–4 in San Francisco. Live demos of how we keep AI agents secure in production, plus exec meetings with our AI researchers and experts on deploying AI at scale without the risk. 👇
325
Gray Swan AI
@GraySwanAI
May 15
The Q2 Indirect Prompt Injection Challenge is LIVE in the @GraySwanAI Arena. $20K in prizes. New behavior targets. One week. Hide instructions in the data AI agents trust, like tool outputs, screenshots, and code repos. When the agent acts on your injection, that's a break.
409