Abhash Jha

Research Scientist

About

Hi, I'm Abhash. I am currently a Research Scientist at the ELLIS Institute Tübingen, contributing to the OpenEuroLLM project.

Previously, I completed my Masters in Informatik at the University of Freiburg. During my studies, I worked at the Machine Learning Lab under Frank Hutter, focusing on Neural Architecture Search (NAS) and AutoML.

Research Interests

My work sits at the intersection of efficient machine learning and Large Language Models:

AutoML & NAS: Previously focused on building upon differentiable NAS
Building LLM: Exploring resource-efficient pre-training and post-training pipelines.
Alignment & Safety: In future, I want to also explore on post-training alignment to make LLMs safe and robust.

Selected Publications

confopt: A Library for Implementation and Evaluation of Gradient-based One-Shot NAS Methods

Abhash Kumar Jha, Shakiba Moradian, Arjun Krishnakumar , Martin Rapp, Frank Hutter
AutoML Conference (ABCD Track)
[Preprint] [Code]

LoRA-DARTS: Low Rank Adaptation for Differentiable Architecture Search

Arjun Krishnakumar, Abhash Kumar Jha, Shakiba Moradian , Martin Rapp, Frank Hutter
AutoML Conference (Workshop Track)
[Preprint]

Contact & Connect

Email: abhash.kumar.jha@tue.ellis.eu
GitHub: github.com/abhash-er