Senior Data Engineer - Google Cloud Platform

Responsibilities : - Design, develop, and maintain data pipelines and ETL processes on GCP. - Utilize GCP services such as BigQuery, Pub/Sub, Dataflow, Composer (DAGs), and Airflow. - Write complex SQL queries to transform and analyze data. - Perform data modeling and mapping. - Utilize Google Cloud SDK and API scripting. - Develop and maintain Python scripts for data processing and automation. - Collaborate with cross-functional teams to understand data requirements and deliver solutions. - Implement data quality checks and monitoring. - Follow Agile processes and DevOps methodologies. (Good to have) Qualifications : - Extensive experience (specify desired years of experience, e.g, 5 years, 7 years) as a Data Engineer, with a strong focus on GCP. - 3 years of hands-on experience with Google BigQuery, Pub/Sub, Dataflow, Composer DAGs, and Airflow. - Strong SQL skills, with the ability to translate complex scenarios into efficient queries. - Experience with data modeling and mapping. - Proficiency in using Google Cloud SDK and API scripting. - Strong programming skills in Python. Must-Have Skills : - GCP (Google Cloud Platform) - BigQuery - Pub/Sub - Dataflow - Composer (DAGs) - Airflow - SQL - Data Modeling - Google Cloud SDK - Python Good-to-Have Skills : - Agile - DevOps Bonus Points : - Experience with other cloud platforms (AWS, Azure). - Experience with data visualization tools. - Experience with machine learning and AI (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 4/15/2025