Aditya Jha Senior Data Engineer Resume
Aditya Jha Senior Data Engineer Resume
Aditya Jha Senior Data Engineer Resume
Datalake
Data house Architecture, Delta-lake,
WORK EXPERIENCE
Data Designing Senior Data Engineer May 2022 - Present
Databases
Centralized Data Pipeline Migration
MySQL, PostgreSQL, MongoDB, Redis
Designed a data pipeline using Kafka to process structured MySQL and semi-
structured MongoDB and Cassandra data, integrating millions of records from 25
Cloud Platforms
sources.
AWS, Google Cloud Platform (GCP) Migrated data to a centralized database on GCP and MySQL, enhancing data
accessibility and analysis.
Tools & Frameworks Managed BigQuery migration, merging data at 6-hour intervals for -1 day
Apache Airflow, Docker reporting and enabling real-time reporting with MySQL.
Implemented efficient data processing and storage techniques, ensuring
Version Control performance and reliability.
Git, GitHub Collaborated with cross-functional teams to meet data requirements and deliver
accurate reports, optimizing decision-making and operational efficiency.
Backend Skills
Python Kafka consumer to process real-time data from MongoDB and
OOP’S Concepts, Data Structures and
Elasticsearch, handling CRUD events efficiently. Implement error handling and
Algorithms, ETL Pipelines, API
logging for data quality issues, ensuring reliable data processing and integrity
Development E D E D
Writing PySpark and python scripts to extract, transform and load data in
corresponding BigQuery,MYSQL database from native source.
Automated various ETL processes that ingested transactional and event data
EDUCATION
from various sources like SQL Database, Sharepoint and manual excels on a
B.Tech in Computer Science daily basis.
Manav Rachna International Institute Of Revamped reporting system by 30% after optimization of the queries. Providing
Research And Studies support for incoming ad-hoc requests including extensive troubleshooting and
2016 - 2020 data related queries.