Jaya Ganesh Kumar - Portfolio

About Me

As a dedicated data engineer, I thrive on the challenge of turning raw, complex datasets into valuable insights that drive business decisions. Experienced with a range of data tools and platforms, including Apache Spark, Hadoop, AWS, Apache Airflow, and SQL Server.

Proficient in data modeling, ETL processes, and modern data warehousing techniques. I leverage cloud-based platforms and big data technologies to deliver scalable, efficient data solutions that support data-driven decision making.

My Experience Download Resume

Professional Experience

May 2025 - Present

Bengaluru, Karnataka

Data Engineer

data warehouse engineer for Verifi Product, building scalable data infrastructure.
Architected and implemented 10+ Data Pipelines using PySpark, following the Medallion Architecture (Bronze, Silver, Gold) for robust data quality and lineage.
Designed and deployed 5+ Reporting Tables specifically to power dynamic UI widgets and dashboards.
Pioneered the use of ADLC (AI-Assisted Development Life Cycle) technologies to accelerate script development, significantly reducing coding turnaround time.

Jul 2023 - May 2025

Bengaluru, Karnataka

Data Analyst / Data Engineer 1

Designed & implemented web scraping solutions to extract data from 5+ websites, ensuring 98% data accuracy and reliability
Integrated scraped data into a database, reducing manual effort by 75%
Wrote and optimized 30+ SQL transformations to streamline the calculation of 10+ financial metrics, reducing manual intervention and error rates by 80%
Designed and implemented scalable data pipelines using Airflow and PySpark to extract, transform, and load data into Redshift for efficient analysis
Collaborated with four cross-functional teams to assess data needs and ensure that transformations provided accurate and relevant insights
Advanced data engineering role with increased responsibilities, leading complex data pipeline implementations and optimizations
Mentored junior team members on data engineering best practices
Implemented advanced ETL processes and data modeling techniques

Aug 2022 - Jan 2023

Remote

Data Analyst Intern

Developed an interactive dashboard using Tableau to monitor losses on day level and included filters for a deeper understanding of loss trends
Employed PySpark to optimize data processing, leading to a 40% increase in efficiency and timely data integration with Tableau
Worked on a User-experience Analytic project which predicts the number of good users blocked for a bad user
Utilized statistical models to forecast risks and guide strategic planning

Skills & Technologies

Python

SQL

Spark

Airflow

PySpark

ETL

Python

SQL

Spark

Airflow

Certifications

Build a Face Recognition Application using Python

Python Certification

Advanced Python programming with focus on computer vision and face recognition algorithms

Python Crash Course

Programming Fundamentals

Comprehensive Python programming course covering core concepts and best practices

Machine Learning with Python: Zero to GBMs

Jovian

Complete machine learning course covering algorithms, model training, and deployment

Problem Solving (Basic)

Algorithmic Thinking

Fundamental problem-solving skills and algorithmic thinking for programming challenges

My Projects

Driver Alertness Prediction

A computer vision capability to assess driver fatigue in real-time. Leverages OpenCV and Python to process video streams and detect signs of drowsiness, alerting drivers to prevent accidents.

View Project