The Salt - Curated AI
Subscribe
Sign in
Home
Notes
AI Notebooks
AI Repositories
Related Articles
deep dive
Archive
About
Why Can't We Compare the Perplexity of Two Different Models?
A very common evaluation mistake in scientific publications
Jul 24, 2024
•
Benjamin Marie
4
1
4
Your “Reasoning” Model Breaks as Soon as You Add Noise
The Weekly Salt #103
Jan 14
•
Benjamin Marie
2
Geometry, Precision, and KV Hacks: Three Ways We’re Rethinking LLM Internals
The Weekly Salt #102
Jan 7
•
Benjamin Marie
3
1
Most Popular
View all
LongRoPE: Towards Unlimited Context Length for the Transformer
Mar 6, 2024
•
Benjamin Marie
10
2
Qwen2.5-VL: High-Resolution Vision Encoding with Efficient Windowed Attention
Mar 6, 2025
•
Benjamin Marie
6
FineWeb-Edu: How to Make a Very High-Quality Dataset to Pre-train LLMs
Jun 12, 2024
•
Benjamin Marie
7
3
Online DPO with a Reward Model
Feb 4, 2025
•
Benjamin Marie
6
Qwen3 Technical Report: Reasoning in Pre-Training and Post-Training
May 16, 2025
•
Benjamin Marie
6
Evaluating AdEMAMix: A New Optimizer for Faster, More Efficient LLM Training
Oct 9, 2024
•
Benjamin Marie
6
Latest
Top
Discussions
JustRL: A Simple RL Recipe Just Works, No Tricks/Patches Needed
The Weekly Salt #101
Dec 23, 2025
•
Benjamin Marie
4
Qwen3-VL: DeepStack Fusion, Interleaved-MRoPE, and a Native 256K Interleaved Context Window
Understanding why Qwen3-VL are the best VLMs
Dec 18, 2025
•
Benjamin Marie
3
1
Making LLMs Think Longer: Context, State, and Post-Training Tricks
The Weekly Salt #100
Dec 17, 2025
•
Benjamin Marie
4
PretrainZero: Pretraining as RL Over Masked Spans
The Weekly Salt #99
Dec 10, 2025
•
Benjamin Marie
1
DeepSeek V3.2 Technical Report: DSA, Better Post-Training, and Agent "Generalization"
The Weekly Salt #98
Dec 4, 2025
•
Benjamin Marie
3
Many-in-One LLMs with Nemotron Elastic
The Weekly Salt #97
Nov 26, 2025
•
Benjamin Marie
2
Generative Adversarial Distillation for Easier Closed-Weight Model Distillation
The Weekly Salt #96
Nov 19, 2025
•
Benjamin Marie
4
See all
The Salt - Curated AI
The Salt offers weekly reviews and in-depth analyses of the latest AI papers. If you want to stay informed of recent progress in AI without reading much, The Salt is for you!
Subscribe
Recommendations
The Kaitchup – AI on a Budget
Benjamin Marie
The Salt - Curated AI
Subscribe
About
Archive
Recommendations
Sitemap
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
