Data Engineer - Google Cloud Platform

Job Description : We are seeking a highly skilled GCP Data Engineer to join our team. The ideal candidate will have a strong foundation in data engineering principles, a deep understanding of the Google Cloud Platform (GCP), and a proven track record of designing, implementing, and maintaining robust data pipelines. Responsibilities : - Design, develop, and maintain scalable data pipelines using GCP services like Dataflow, Dataproc, and Cloud Functions. - Extract, transform, and load (ETL) data from various sources (e.g., databases, APIs, cloud storage) into GCP data warehouses and data lakes. - Implement data quality checks and monitoring mechanisms to ensure data accuracy and integrity. - Design and implement data models optimized for analytics and reporting. - Create and maintain data warehouses and data marts using BigQuery and other GCP data warehousing solutions. - Optimize data storage and query performance to meet business requirements. - Provision and manage GCP resources (e.g., Compute Engine, Cloud Storage, Cloud SQL) using Infrastructure as Code (IaC) tools like Terraform. - Monitor and optimize cloud resource utilization to minimize costs. - Ensure the security and compliance of data and infrastructure. - Collaborate with data analysts and data scientists to understand business requirements and translate them into technical solutions. - Conduct data analysis and generate insights to drive data-driven decision-making. - Visualize data using tools like Data Studio and Looker. - Identify and troubleshoot data pipeline and infrastructure issues. - Stay up-to-date with the latest trends and technologies in the data engineering field. - Proactively suggest innovative solutions to improve data processes and systems. Required Skills and Experience : - 6 years of experience in data engineering or a related field - Strong proficiency in GCP services, including Dataflow, Dataproc, BigQuery, Cloud Storage, and Cloud Functions - Expertise in Java programming language - Solid understanding of data warehousing, data modeling, and ETL processes - Experience with SQL and other data querying languages - Knowledge of data pipeline orchestration tools (e.g. , Airflow) - Experience with cloud infrastructure and security best practices - Strong problem-solving and analytical skills - Excellent communication and collaboration skills Preferred Skills : - Experience with machine learning and AI frameworks - Knowledge of Python programming language - Certifications in GCP or other relevant technologies (ref:hirist.tech)

Location: in, IN

Posted Date: 11/27/2024