Oneture Technologies - Data Engineer - SQL/Python

Location : Mumbai Experience : 1 to 3 yrs Technologies/Skills : Advanced SQL, ETL pipelines development and optimization, Data Modelling, Spark Python, Airflow, Flink, Trino, AKS, Azure, AWS Job Overview : We are seeking a motivated and technically skilled Data Engineer with 1-3 years of experience to join our team. You will be responsible for designing, building, and optimizing data solutions that support analytics and real-time processing needs. This role offers the opportunity to work on large-scale data engineering projects, initially leveraging Azure for a leading financial institution, with future flexibility to work across cloud platforms like AWS or GCP whenever required. Core areas of focus include advanced SQL, ETL pipelines, data modeling, and distributed computing frameworks such as Spark and Flink. Responsibilities : - Working closely with business teams to understand their requirements and develop reporting or analytic solutions - Producing and automating delivery of key metrics and KPIs to the business. In some cases, this will focus on making data available and others will be developing full reports for end users - Managing stakeholder demand and backlog of reporting requirements and needs - Actively working with users to understand data issues, tracing back data lineage and helping the business put appropriate data cleansing and quality processes in place - Managing secure access to data sets for the business Education level : Bachelor's degree (B.E/ B.Tech) in Computer Science or equivalent from reputed institute Experience : - 1 to 3 years hands-one as a Data Engineer. - Financial services industry experience or familiarity with the stock exchange/capital market domain will be an added advantage. Required Technical Skills : - Advanced SQL and Python knowledge is a must. - Data-Modelling and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases. - ETL Pipelines : Design, develop, and optimize ETL/ELT pipelines for batch and streaming data using Python, Airflow, Spark, and Flink. - Data Modeling : Build efficient data models and optimize advanced SQL queries for analytics and reporting. - Cloud Engineering : Implement scalable data solutions on Azure (AKS, Data Lake, Data Factory) and AWS (S3, Glue, Athena). - Distributed Computing : Use Spark for large-scale data processing and Flink for real-time streaming. - Query Optimization : Leverage Trino for distributed SQL querying over large datasets. - Automation & Orchestration : Manage data workflows and scheduling with Airflow. - Scalability : Deploy and manage containerized applications using Docker and Kubernetes. - Build processes supporting data transformation, data structures, metadata, dependency and workload management. - Good understanding of Git workflow, Test-case driven development and using CICD is good to have (ref:hirist.tech)

Location: mumbai, IN

Posted Date: 2/5/2025