Rajan Ghimire https://R4j4n.github.io/blogs/ Recent content on Rajan Ghimire Hugo -- gohugo.io en-us Sat, 07 Oct 2023 00:00:00 +0000 Transformers Optimization: Part 1 - KV Cache https://R4j4n.github.io/blogs/posts/kv/ Sat, 07 Oct 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/kv/ Understanding KV Cache, its working mechanism and comparison with vanilla architecture. Decoding Strategies in Language Models https://R4j4n.github.io/blogs/posts/text_decoding/ Fri, 15 Sep 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/text_decoding/ Exploring and implementing text decoding strategies in PyTorch Supercharge Your LLaMA: Fine-Tuning Made Effortless and Efficient 🚀 https://R4j4n.github.io/blogs/posts/apdapter/ Fri, 08 Sep 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/apdapter/ Efficiency and versatility of the LLaMA-Adapter from scratch. The Secret Sauce of LLaMA🦙 : A Deep Dive! https://R4j4n.github.io/blogs/posts/llama/ Sun, 20 Aug 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/llama/ Understanding the ins and outs of Meta's LLaMa(Open and Efficient Foundation Language Models) from scratch. Semantic Segmentation from scratch in PyTorch. https://R4j4n.github.io/blogs/posts/deeplab/ Tue, 25 Jul 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/deeplab/ Custom person segmenter from scratch. Quantization in PyTorch: Optimizing Architectures for Enhanced Performance https://R4j4n.github.io/blogs/posts/quantization/ Sat, 15 Jul 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/quantization/ Dissecting Static, Dynamic and Quantization Aware Training in PyTorch. LORA(Low Rank Adaptation) : A Deeper Dive https://R4j4n.github.io/blogs/posts/lora/ Mon, 06 Mar 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/lora/ Exploring and Implementating LoRA in PyTorch. Vision Transformer (ViT) https://R4j4n.github.io/blogs/posts/vit/ Mon, 06 Feb 2023 00:00:00 +0000 https://R4j4n.github.io/blogs/posts/vit/ ViT from scratch in pytorch https://R4j4n.github.io/blogs/about/ Mon, 01 Jan 0001 00:00:00 +0000 https://R4j4n.github.io/blogs/about/ I wanna sleep so much but this field is so damn interesting ! Hello! ¡Hola! Bonjour! Привет! こんにちは！ 你好！ 안녕하세요! مرحباً! नमस्ते! I’m Rajan Ghimire, a computer engineering graduate with a keen interest in implementing deep learning architectures and papers from scratch. My unique blend of theoretical knowledge and hands-on experience allows me to bridge the gap between academia and industry, crafting innovative solutions that push the boundaries of what’s possible.