Pinned
All products are now available to order! $45k for tinybox green with 5090s, and we have two variants of the tinybox pro v2, one with 5090s and one with RTX6000 Blackwells (that's a whopping 768 GB of RAM)
the tiny corp
4,259 posts
the tiny corp
@__tinygrad__
We make tinygrad; sell tinybox for the GPU middle class.
Our mission is to commoditize the petaflop.
- Replying to @__tinygrad__It's really nice to have a local Kimi, this is as good as the best models just 6 months ago, and you know nobody can take it away from you or stop you from finetuning so it'll never refuse your requests. With this cranked to 1000 tok/s it might even be the best experience.
- Up and benchmarking itself on 4xMI300X (this is with vLLM). Memory bandwidth says we should be able to go so much faster.
🌘 Kimi-K2.7-Code, our latest coding model, is now released and open-sourced! 🔷 Improved coding & agent performance over K2.6: +21.8% on Kimi Code Bench v2, +11.0% on Program Bench, and +31.5% on MLS Bench Lite. 🔷 Reasoning efficiency: Less overthinking, with 30% lower - A reminder to look past the hype and look at the numbers. Google is the largest owner of compute in the world. AI is not a race, it's a decentralized revolution that will take decades to play out.
Replying to @sundarpichaiModel weights available on Hugging Face under Apache 2.0 license, read more here: blog.google/innovation-and… - the tiny corp reposted
i look forward to our chinese brothers liberating the knowledge from within fable-5 and selling it to me at 5% the cost & 2x the speed - the tiny corp reposted
Concentration of power, capabilities and economic wealth is the biggest risk in AI. We need open science and open-source more than ever! - This makes me not want to waste any time using it. Who knows if it's silently sandbagging me. Is tinygrad close enough to frontier LLM for it to? Just makes the model completely untrustworthy.mythos will be bad ON PURPOSE on ai "frontier llm research" tasks, this is very very sad for the research community also the fact that this is un purpose not visible to the user is crazy
- Because it's the full stack from Tensors to MMIO, the ceiling on speed in tinygrad is higher than in any other framework.Replying to @ivanfioravantiI’m grinding away making inference faster on AMD using tinygrad and it’s super gratifying, also an incredible way to learn gpu programming
- tinygrad wants to make it as easy as possible to answer three questions about Tensor compute. What happens? Where does it happen? And when does it happen?
- tinygrad will write that C for you. Our new driver compiles all interaction with the GPU to C, so once it's running the CPU does next to nothing.SpaceX has almost finished writing V1.0 of an in-house AI training stack in C that exact-maps to 220k GB300s with 800G NICs, making heavy use of pipeline parallelism and getting as close to bare metal as possible. The potential speed improvement vs JAX for large training runs is
- 1 of 8 NVIDIA RTX PRO 6000 Blackwell being torn down for tinybox pro install. Don't worry, it's only $10,000 if you shear one of the ribbon cables.
- Replying to @__tinygrad__Prices updated. For those people who placed orders, you have 5 days to land payment or they will be cancelled and you'll have to reorder at the new price. I wish we could make these machines cheaper for you, but we're actually making even lower margins with these new prices.
