{"id":1476,"date":"2025-01-31T14:38:06","date_gmt":"2025-01-31T14:38:06","guid":{"rendered":"https:\/\/setkyar.com\/?p=1476"},"modified":"2025-02-09T12:58:29","modified_gmt":"2025-02-09T12:58:29","slug":"learning-transformer","status":"publish","type":"post","link":"https:\/\/setkyar.com\/learning-transformer\/","title":{"rendered":"Learning Transformer"},"content":{"rendered":"\n<p>I am currently taking the <a href=\"https:\/\/www.coursera.org\/specializations\/generative-ai-engineering-with-llms\">Generative AI Engineering with LLMs Specialization from IBM<\/a>, and I&#8217;ve encountered some confusion, particularly regarding Transformers. To better understand the concepts, I&#8217;ve been exploring resources on YouTube. I&#8217;ve decided to compile a list of the videos I found helpful, so that others who are also confused or interested in learning can easily access these resources.<\/p>\n\n\n\n<p>Below is a list of YouTube videos that have significantly aided my learning. I will continue to update this list as I watch more videos<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Large Language Models explained briefly\" width=\"900\" height=\"506\" src=\"https:\/\/www.youtube.com\/embed\/LPZh9BOjkQs?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Visualizing transformers and attention | Talk for TNG Big Tech Day &#039;24\" width=\"900\" height=\"506\" src=\"https:\/\/www.youtube.com\/embed\/KJtZARuO3JY?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Intuition Behind Self-Attention Mechanism in Transformer Networks\" width=\"900\" height=\"506\" src=\"https:\/\/www.youtube.com\/embed\/g2BRIuln4uc?feature=oembed\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>The following is a YouTube Playlist.<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"A Visual Guide to Transformers Neural Networks: step by step explanation\" width=\"900\" height=\"506\" src=\"https:\/\/www.youtube.com\/embed\/videoseries?list=PL86uXYUJ7999zE8u2-97i4KG_2Zpufkfb\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p>I can not embed the following YouTube video. You should be able to watch directly from YouTube.<\/p>\n\n\n\n<p><a href=\"https:\/\/www.youtube.com\/watch?v=XfpMkf4rD6E\">Stanford CS25: V2 I Introduction to Transformers w\/ Andrej Karpathy<\/a><\/p>\n\n\n\n<p><a href=\"https:\/\/www.deeplearning.ai\/short-courses\/how-transformer-llms-work\/\">How Transformer LLMs Work<\/a> by deeplearning.ai short course.<\/p>\n\n\n\n<p>The following is a Youtube Playlist<\/p>\n\n\n\n<figure class=\"wp-block-embed is-type-video is-provider-youtube wp-block-embed-youtube wp-embed-aspect-16-9 wp-has-aspect-ratio\"><div class=\"wp-block-embed__wrapper\">\n<iframe loading=\"lazy\" title=\"Neural networks\" width=\"900\" height=\"506\" src=\"https:\/\/www.youtube.com\/embed\/videoseries?list=PLZHQObOWTQDNU6R1_67000Dx_ZCJB-3pi\" frameborder=\"0\" allow=\"accelerometer; autoplay; clipboard-write; encrypted-media; gyroscope; picture-in-picture; web-share\" referrerpolicy=\"strict-origin-when-cross-origin\" allowfullscreen><\/iframe>\n<\/div><\/figure>\n\n\n\n<p><\/p>\n","protected":false},"excerpt":{"rendered":"<p>I am currently taking the Generative AI Engineering with LLMs Specialization from IBM, and I&#8217;ve encountered some confusion, particularly regarding Transformers. To better understand the concepts, I&#8217;ve been exploring resources on YouTube. I&#8217;ve decided to compile a list of the videos I found helpful, so that others who are also confused or interested in learning [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_coblocks_attr":"","_coblocks_dimensions":"","_coblocks_responsive_height":"","_coblocks_accordion_ie_support":"","jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2}},"categories":[47],"tags":[],"class_list":["post-1476","post","type-post","status-publish","format-standard","hentry","category-learning"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_likes_enabled":false,"jetpack-related-posts":[{"id":230,"url":"https:\/\/setkyar.com\/notes-for-php-laravel-package-development\/","url_meta":{"origin":1476,"position":0},"title":"Notes for PHP\/Laravel Package Development","author":"universe","date":"April 3, 2020","format":false,"excerpt":"This is not a tutorial or guide. This is about how I learn package development and some notes for people who want to learn. My very first attempt to learn about the package development was this one from culttt.com and it was very helpful. And another one is also again\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/Crttq5WFPcM\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]},{"id":906,"url":"https:\/\/setkyar.com\/coding-puzzles\/","url_meta":{"origin":1476,"position":1},"title":"Coding Puzzles","author":"universe","date":"January 9, 2023","format":false,"excerpt":"Collection of tools that I use when I try solving coding puzzles. I will be updating regularly base on my explorations. Leetcode, I am trying to solve a minimum of one problem a day. I will try to consistent as I can. The last time I was training at codewars,\u2026","rel":"","context":"In &quot;Learning&quot;","block_context":{"text":"Learning","link":"https:\/\/setkyar.com\/category\/learning\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1864,"url":"https:\/\/setkyar.com\/learning-the-basics-of-tcm\/","url_meta":{"origin":1476,"position":2},"title":"Learning the Basics of TCM","author":"universe","date":"March 25, 2026","format":false,"excerpt":"Learning about Traditional Chinese Medicine (TCM) was never on my to-do list. I was having issues with a disc bulge and tried Western medicine first. The doctor told me to rest and do exercise, which felt like something I could have figured out myself by asking AI. It cost me\u2026","rel":"","context":"In &quot;Random&quot;","block_context":{"text":"Random","link":"https:\/\/setkyar.com\/category\/random\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":1516,"url":"https:\/\/setkyar.com\/youtube-video-summarizer\/","url_meta":{"origin":1476,"position":3},"title":"YouTube Video Summarizer","author":"universe","date":"February 12, 2025","format":false,"excerpt":"youtube-video-summarizer help you summarize youtube videos. Last night, I was watching a YouTube video. The video didn't cover the topic I wanted to study in depth. That's when I though I should summarize videos first to check if they're worth watching. I tried some existing video summary services, but they\u2026","rel":"","context":"In &quot;Tech&quot;","block_context":{"text":"Tech","link":"https:\/\/setkyar.com\/category\/tech\/"},"img":{"alt_text":"","src":"","width":0,"height":0},"classes":[]},{"id":155,"url":"https:\/\/setkyar.com\/learning-vim\/","url_meta":{"origin":1476,"position":4},"title":"Learning Vim","author":"universe","date":"January 27, 2020","format":false,"excerpt":"I know the basics of Vim. Like how to move around and stuff. But, I never try as my main editor. But, in the past few days, I wanted to try Vim as my main editor. [ yep this happened when my MacBook pro was so heated when I run\u2026","rel":"","context":"Similar post","block_context":{"text":"Similar post","link":""},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/setkyar.com\/wp-content\/uploads\/2020\/01\/image.png?resize=350%2C200&ssl=1","width":350,"height":200,"srcset":"https:\/\/i0.wp.com\/setkyar.com\/wp-content\/uploads\/2020\/01\/image.png?resize=350%2C200&ssl=1 1x, https:\/\/i0.wp.com\/setkyar.com\/wp-content\/uploads\/2020\/01\/image.png?resize=525%2C300&ssl=1 1.5x, https:\/\/i0.wp.com\/setkyar.com\/wp-content\/uploads\/2020\/01\/image.png?resize=700%2C400&ssl=1 2x, https:\/\/i0.wp.com\/setkyar.com\/wp-content\/uploads\/2020\/01\/image.png?resize=1050%2C600&ssl=1 3x"},"classes":[]},{"id":305,"url":"https:\/\/setkyar.com\/crush-course-economic\/","url_meta":{"origin":1476,"position":5},"title":"Crash Course Economic","author":"universe","date":"May 23, 2020","format":false,"excerpt":"I just finish up crush course economic in last few weeks. Plan to write about how and why I finish the course and it was dragging me with busy. But, today I decided to write about it and here is why and how. https:\/\/www.youtube.com\/playlist?list=PL8dPuuaLjXtPNZwz5_o_5uirJ8gQXnhEO Why Don't you wonder why we\u2026","rel":"","context":"In &quot;Learning&quot;","block_context":{"text":"Learning","link":"https:\/\/setkyar.com\/category\/learning\/"},"img":{"alt_text":"","src":"https:\/\/i0.wp.com\/img.youtube.com\/vi\/PL8dPuuaLjXtPNZwz5_o_5uirJ8gQXnhEO\/0.jpg?resize=350%2C200","width":350,"height":200},"classes":[]}],"_links":{"self":[{"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/posts\/1476","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/comments?post=1476"}],"version-history":[{"count":13,"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/posts\/1476\/revisions"}],"predecessor-version":[{"id":1513,"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/posts\/1476\/revisions\/1513"}],"wp:attachment":[{"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/media?parent=1476"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/categories?post=1476"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/setkyar.com\/wp-json\/wp\/v2\/tags?post=1476"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}