If this is accurate, then NVIDIA's grip on the tech industry has just vanished.
Matrix matrix multiplication (MatMul) is notoriously computationally difficult, which is why it's offloaded to GPUs.
If MatMul can be avoided, then it's not just leveling the playing field. It's
This is really a 'WOW' paper. ๐คฏ
Claims that MatMul operations can be completely eliminated from LLMs while maintaining strong performance at billion-parameter scales and by utilizing an optimized kernel during inference, their modelโs memory consumption can be reduced by more
Android 13 has ~1.5 million lines of Rust code, and zero memory safety vulnerabilities discovered in Androidโs Rust code have been found so far. This compares to 1 vuln per <1,000 lines code that Android has had historically. security.googleblog.com/2022/12/memoryโฆ
If New Zealand eliminates the virus again, that will be the biggest middle finger to Australia's PM saying that it's impossible. I think that's the kind of motivation we need. #nzpol#auspol#covid19nz