AWS Data Engineer - SQL/Python

Job Details : Hyderabad, Bangalore Exp : 4 to 8 Years Notice Period : Max 30 days / Serving Notice / Immediate Joiners Mandatory Requirements : SQL, Python, AWS, AWS Services(EC2, Lambda and other : - Develop, test, and deploy software to generate data assets (relational, non-relational) for use by downstream BI engineers and data scientists - Work with big data and cloud technologies such as EC2, Lambda, AWS Glue, Airflow, dbt, Redshift etc. - Work closely with stakeholders to ensure successful data asset design and development - Create software artifacts and patterns for reuse within the Data Engineering team. - Ensure data pipelines are scalable, resilient and produced with the highest quality standards, metadata and validated for completeness and accuracy - Work on a cross-functional Agile team responsible for end-to-end delivery of business needs - Help improve data management processes - acquiring, transforming and storing massive volumes of structured and unstructured data - Work closely with development teams to learn about needs, current processes and to promote best Qualifications : - University degree in Computer Science, Mathematics, Engineering, or related field. - 5 years of experience in software engineering with strong focus on data. - Experience working with Cloud data platforms, preferably AWS (Lambda, Step Functions, S3, AWS Glue, Athena, Redshift). - An expert in Python and SQL, including query optimization for relational, NoSQL and columnar databases. - Sound knowledge of CI workflows and build/test/deploy automation. - Strong understanding of data modelling concepts and best practices. - Relevant experience with IaC (Terraform, CloudFormation) - Relevant experience with modern big data processing and orchestration tools such as dbt and Airflow. - A great teammate and self-starter, strong detail orientation is critical in this role. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 12/25/2024