Pinned
Fabian Mentzer
434 posts
Fabian Mentzer
@mentzer_f
DeepMind during the day, modular synth guy at night: nerodiseppia.ch
- Very happy to finally show our latest work: VCT, a transformer for video compression 🤖 We radically simplify the video compression setup by getting rid of motion prediction, warping, and residuals. Instead, a transformer learns to model temporal redundancies purely from data:
- Check out our new paper on learned lossless compression: 30% smaller images than PNG, using a fully parallel probabilistic model that is orders of magnitude faster than PixelCNN! Oral @cvpr2019 w/ @etagust, @mtschannen, R. Timofte, L. Van Gool, @ETH_en.
- New paper! Using GANs, we obtain a generative image compression system that synthesizes fine details which are expensive to store. Our method remains visually close to the inputs and outperforms previous approaches -- Check out the demo at hific.github.io! (1/4)
- 🎉🎉🎉 Say goodbye to the VQ headache 🤕 - in our latest paper, we show a simple drop-in replacement for VQ based on scalar quantization that does not need any of the auxiliary losses and tricks from the VQ literature!
- Fun prompt to try on aistudio.google.com : "describe this image and create it again, but in anime style!"
- 1/ Excited to share that our work on masked transformers for compression has been accepted at #ICCV2023! We show two things: a) how a simple transformer based architecture can lead to state-of-the-art image compression results: arxiv.org/abs/2304.07313
- After our recent paper on simplifying VQ (arxiv.org/abs/2309.15505) we were like "why even quantize at all?!?". And so we did just that, in 🎁 GIVT: Generative Infinite Vocabulary Transformers We use the VQGAN+Transformer style to do image generation, but without VQ! 🎉
- Fun fact: TF and PyTorch seem to have different default leaks for their leaky ReLUs ✨ Glad papers report the alphas they use (they don't actually 😔).
- Our paper on ✨Neural Video Compression with GANs✨ was accepted at #ECCV2022 🎉🥳. We just uploaded the final version to arXiv, check it out: arxiv.org/abs/2107.12038
- Excited to start my summer internship at @Qualcomm Amsterdam today! Time to take the bike out and do some compression research 🎉
- 0/0 CVPR papers accepted 🤙
