Pinned
I have posted our recent ICML paper on ArXiv. In the recent work, we propose a hybrid replay strategy, a combination of model-based and data-based to overcome catastrophic forgetting with 10x less memory.
Milad Khademi Nori, PhD
6,115 posts
Milad Khademi Nori, PhD
@khademinori
- My 2024 wrapped: - achieved citizenship of Canada - defended my PhD in deep learning at Queen's University - published two high-quality papers in the top deep learning conferences - started a postdoctoral fellowship at Toronto Metropolitan University - received job offers from
my 2024 wrapped: - bought a house - remote job at a place i like - can research about ML/DL on weekends - built some cool things from scratch - started posting on X since August - grew more than 20k followers here - grew more than 18k followers on other socials - bonus: printing - Replying to @AlexGDimakisI'm afraid it's actually you, but since you didn't know the answer, you're pretending it was just a scammer.
- Replying to @growing_danielThe intellectual history of the Muslim world is a story of two opposing schools of thought: the rationalist Mu’tazilites and the traditionalist Ash’arites. These two perspectives not only shaped theology but also defined the course of Islamic education and intellectual life. The
- Replying to @miniapeurWhen you put in great effort and do the left a great deal and build a strong intuition of how math works, then you can do the math like the right effortlessly.
- Replying to @prajdabreYou write ✍️ papers. I reject them. We aren't the same.
- Professor Bengio (pioneer AI researcher) on ChatGPT: Bengio emphasized that while it is impressive, ChatGPT is a “very small step” scientifically and called it “mostly an engineering advance.” ChatGPT is more significant #OpenAIChatGPT
- Replying to @a_meratShe is the great (x43) granddaughter of the Prophet, if we can rely on the rather patchy genealogical records of early-medieval Spain. The key connections are these: In 1023, Abu al-Qasim Muhammad ibn Abbad became the ruler of Seville in al-Andalus.
- Replying to @TheNormanMuPerhaps I’m mistaken, but where I live, people say that pursuing a PhD isn’t about gathering credentials to land a job at OpenAI. Instead, it’s about contributing groundbreaking ideas that could transform the AI landscape—and possibly make OpenAI obsolete 🤷♂️.
- Replying to @jkronandIn other words, the brain makes predictions not just at the level of words/tokens, which is what LLMs do, but over multiple timescales and levels of representations. Indeed, there is a cortical hierarchy that encodes information at different scales and resolutions. #neuroscience
