I believe the top question in most tech investors' minds is - "where are we in AI?"
I wrote a piece from the perspective of someone who spends a lot of time thinking about the public markets AND speaking with private companies
One of the coolest things about Altimeter is how open @altcap encourages us to be with our research process. In this interview w/ Jensen we asked him the questions we (as analysts) wanted to know - and sharing it with the community
Some of my takeaways:
1/ Nvidia is a full
BG2. Ep 17. Double $NVDA! System Level Comp Moat, “Insane Demand”, Inference Explosion 1 B x, Memphis Supercluster, OpenAI, X.ai & more. @altcap@_clarktang@bgurley
(00:00) Intro
(1:50) The Evolution of AGI and Personal Assistants
(06:03) NVIDIA's
Extra outtake clip from latest @BG2Pod with Jensen @altcap
Contrary to popular hypersensationalist rhetoric -- that we are in a massive AI glut -- we are likely in a stretch of structural compute shortage.
Google announced in May that tokens had grown 50x y/y, and doubled again
Wonder what 2.5D advanced packaging / CoWoS looks like? ASE showed off a super cool model in Taiwan that demonstrates the various components of an advanced package "XPU / GPU" and how it is bound together by CoWoS (Chip on wafer on substrate)
Center piece is the XPU logic die
What is the value of $NVDA software? Lot of jawboning about NVDA's 80% GM - not a lot of analysis..
Andy Jassy dropped a great nugget on $AMZN earnings yest- Trainium2 offers 30-40% price performance advantage over H100. Based on that, the "software value" of Nvidia warrants a
Normally I wouldn't respond to these kind of posts... but if you just read the definitions you would know that these are the folks assembling on behalf of Nvidia. Including Foxconn...
If the same definition were in Apple's 10K it would say they had "90% customer concentration"
Coming back from spending a week in Taiwan speaking to partners in the $NVDA supply chain, incrementally bullish on the GB200 / GB300 ramp this year.
The demand we’re seeing from AI labs / CSPs continues to accelerate sharply after the release of reasoning models. (See Microsoft
$NVDA - Colette
"On average Hyperscalers are deploying 1k GB200 NVL72 racks (72k GPUs) per week, and this rate is increasing" - run rate 4M GPUs a year and ramping...
WAY higher (maybe 2-3x0 than what supply chain was estimating
Interesting Jensen quotes at GTC Paris:
"we estimate around $1.5T of accelerated DC demand"
"do believe most of the ASIC projects will end up getting cancelled"
"We are going to sell hundreds of billions of GB200/300"
"RTX Pro is the biggest opportunity ex GB"
$NVDA
AWS report is out - seeing some reversal in incremental share gained from Azure to AWS (45% incremental share -> 41% / 30% -> 34%)
Recall - AWS is the bell weather for many SW stocks. Many of them will be up tomorrow!
$MSFT$AMZN
it's 1400 fully loaded, so 140 MW. there are definitely projects in place right now to build multiples of that.
hyperbolic comment but directionally correct that there isn't a ton of power just lying around and supply chain is focused on unlocking power right now
Listening to this podcast by @GavinSBaker and @patrick_oshag feels like a cheatcode / humbling when Gavin gives away (& distills efficiently) many of the hard earned insights you've been researching for months -- but that is the investment biz! Here are some highlights:
(1)
A 🤯🤯🤯 episode
If you love investing, you will not find someone as passionate AND knowledgeable as @GavinSBaker
I call him often with investing ?s because his thinking is so clear
Today, you get to hear him absolutely cook on semis, data centers, leaders & a ton more
Wow