Data Engineer - Python/SQL

Job Description : We are looking for a skilled Data Engineer to join our team. The ideal candidate will have strong expertise in designing, implementing, and managing large-scale data infrastructure, responsible for handling data pipelines, ETL processes, and optimizing data workflows across cloud platforms. Responsibilities : - At least 5 years of relevant experience. - Build, monitor, and optimize data pipelines using Redshift, Kinesis Data Stream, Kinesis Firehose, AWS S3, AWS Glue, and Apache Airflow. - Write and optimize complex SQL queries for efficient data extraction and transformation. - Develop solutions using Python to support ETL processes and data analysis. - Collaborate with cross-functional teams to ensure data accuracy and integrity. Nice to Have : - Experience with message broker platforms like Pulsar and Kafka. - Knowledge of MongoDB for NoSQL database : - Proven experience with AWS cloud services, data pipelines, and large datasets. - Strong knowledge of SQL and data management tools. What you'll be doing : - Foster the growth and development of a team of data engineers who exhibit strong motivation and work behaviors, facilitating the acquisition of new data and enhancing current data sources. - Design, build, and launch new data models and pipelines in production. - Act as a player-coach, blending hands-on expertise with leadership to amplify the effects of your team's work. - Foster connections with diverse teams to comprehend data requirements and drive successful project outcomes. - Help develop and support your team in areas such as technical architecture, collaborating with relevant parties, managing projects, and enhancing product knowledge. - Define processes to achieve operational excellence in project management and system reliability. - Set direction for the team, anticipating strategic and scaling-related challenges. - Foster a healthy and collaborative culture that embodies our values. (ref:hirist.tech)

Location: Noida, IN

Posted Date: 10/30/2024