// profile
Data Engineer with 4+ years of experience in building data architecture, optimizing and maintaining data pipelines to ensure seamless data flow and accessibility, empowering organizations to extract maximum value from their data assets.
Experience
Analytics Engineer
OCT 2022 — PRESENT
HRS Group · Chandigarh, India
- Designed and implemented data pipelines using Airflow and dbt SQL models, transferring data between Datalake and Exasol databases.
- Built MicroStrategy dashboards with KPIs to evaluate Exasol database performance and business metrics.
- Developed a backup/archival framework to optimize Exasol database size, enhancing MicroStrategy dashboard performance and migrating data to Data Lake.
- Implemented notification emails for long-running ETL jobs using Lua Script in Exasol, scheduling ETL jobs with Airflow DAGs.
- Utilized AWS S3, Managed Workflows for Apache Airflow (MWAA), and Athena for cloud data processing and analysis.
Airflow
dbt
Exasol
MicroStrategy
AWS S3
MWAA
Athena
Lua Script
Data Engineer
AUG 2019 — SEP 2022
E2open · Pune, India
- Developed and maintained end-to-end ETL processing using SQL and PySpark on Snowflake environment.
- Set up CI/CD pipelines using GitLab for continuous integration and deployment to production.
- Developed complex SQL scripts for data extraction using joins, window functions, date functions, merge statements, and case statements.
- Experience with AWS platform using AWS S3, IAM, and MWAA for cloud data workflows.
- Developed reports and dashboards using BI tools including MicroStrategy and Power BI.
PySpark
Snowflake
SQL
GitLab
AWS IAM
Power BI
Airflow DAGs