This website is a virtual proof that I'm awesome https://sudohainguyen.github.io/ To fit in your need and move forward with agility. - Data Lakehouse is a relatively new term, but not a new desire. It’s about flexibility, structure, and long-term scalability, all consolidated into an architecture. Let’s unpack what this architecture is solving and why it should be seen as a conscious architectural choice, not just a natural progression from traditional data... Thu, 15 Feb 2024 00:00:00 +0700 https://sudohainguyen.github.io/2024-02-15-data-lakehouse/ https://sudohainguyen.github.io/2024-02-15-data-lakehouse/ Compared to Conventional Ways to Build Data Models - You have probably heard the buzz about DBT in data engineering lately, but why was DBT even invented in the first place? I was struggling with pure SQL scripts but now I have been using it as my day-to-day work, let me share you how it’s revolutionizing the way we... Fri, 05 Jan 2024 00:00:00 +0700 https://sudohainguyen.github.io/2024-01-05-why-dbt/ https://sudohainguyen.github.io/2024-01-05-why-dbt/ To listen all the changes. - There are various ways to conduct data ingestion, depending on the strategy we want to use the ingested data. Change Data Capture (CDC) is one approach to implement data ingestion at low latency, which is suitable for near real-time data consumption. Quick access: Motivation Data Ingestion challenges Event sourcing approach... Mon, 20 Nov 2023 00:00:00 +0700 https://sudohainguyen.github.io/2023-11-20-change-data-capture/ https://sudohainguyen.github.io/2023-11-20-change-data-capture/ Simple but effective - Connection pooling is a simple technique that can significantly improve the performance of your application. However, to effectively apply and manage connection pooling, it is crucial to understand how it works and how it can be configured. Quick access: The Problem Understanding Database Connection Things go intensively Types of Connection... Fri, 11 Aug 2023 00:00:00 +0700 https://sudohainguyen.github.io/2023-08-11-understanding-connection-pooling/ https://sudohainguyen.github.io/2023-08-11-understanding-connection-pooling/ Challenging but rewarding - In today’s data-driven world, the demand for machine learning models has skyrocketed, leading organizations to invest heavily in their AI capabilities. However, building and deploying machine learning models efficiently is not a straightforward task. This is where MLOps (Machine Learning Operations) engineers come into play. In this blog post, I... Wed, 29 Mar 2023 00:00:00 +0700 https://sudohainguyen.github.io/2023-03-29-my-mlops-journey/ https://sudohainguyen.github.io/2023-03-29-my-mlops-journey/ Why don't you try? - To rapidly progress in your engineering career, it is advisable to learn from other engineers in your professional circle, such as colleagues, seniors, and friends especially when you are working on some immature area like MLOps. However, many individuals, myself included, often wonder how engineers from diverse companies, organizations, and... Thu, 02 Mar 2023 00:00:00 +0700 https://sudohainguyen.github.io/2023-03-02-oss-contribution/ https://sudohainguyen.github.io/2023-03-02-oss-contribution/ Yes, we need Feature Store, but how to use? - We have been working with Machine Learning models, cooking raw data into golden features for the models. Including me, we have been doing stuff manually and we also have been questioning where to put cooked features properly, like in our local machine? We have heard there is a Feature Store... Sun, 15 Jan 2023 00:00:00 +0700 https://sudohainguyen.github.io/2023-01-15-beyond-feature-store_p1/ https://sudohainguyen.github.io/2023-01-15-beyond-feature-store_p1/ Use your daily basis to power up your team - If you’ve been actively using git in your daily work, you might be familiar with the concept of Git commit convention. However, have you considered the potential benefits these messages hold for your future and the success of your team? In this article, I will explain how incorporating Git commit... Sat, 22 Oct 2022 00:00:00 +0700 https://sudohainguyen.github.io/2022-10-22-git-commit-practice/ https://sudohainguyen.github.io/2022-10-22-git-commit-practice/ Power your application with streamlined Dockerfiles - Docker has revolutionized the way we build, package, and deploy applications. It provides a lightweight and portable platform that enables developers to create isolated containers, encapsulating applications and their dependencies. One of the key components of Docker is the Dockerfile, a simple yet powerful tool for defining and automating the... Tue, 02 Aug 2022 00:00:00 +0700 https://sudohainguyen.github.io/2022-08-02-dockerfile-practices/ https://sudohainguyen.github.io/2022-08-02-dockerfile-practices/