Senior Data Engineer - SQL/Python

Role : Senior Data Engineer Exp : 4-5 Years Location : Hyderabad CTC : 15-18LAKHS PER ANNUM Mandate Skills : AWS,Python,Pyspark and Airflow Job Description : Data Engineer, responsible for expanding and optimization of data and data pipeline architecture. The Data Engineer will be responsible to develop,construct, test and maintain data pipeline for various initiatives. The ideal candidate is an experienced data pipeline builder who will support re-designing organizations' data architecture to support our next generation of products and data initiatives. Responsibilities : - Assemble complex data sets that meet functional /non-functional business requirements - Identify, design, and implement optimized data delivery with high level of automation for greater scalability - Build Analytics tools and products that utilizes data infrastructure to provide actionable insights - Participate in development to build scalable product and platforms for commercialization - Respond to and resolve to production issues Qualifications : - Bachelors degree in Computer Science, Information Systems or Engineering is required, or in lieu, a demonstrated equivalence in work experience; MS in Computer Science is desirable - A minimum of 4-5 years of experience in software development in Core Java, Python, NoSQL and/or RDBMS database environment Required technical skills : - Core Java, Python, spark, pySpark, SQL (PostgreSQL Preferred), NoSQL (Elastic and or any document database preferred), Messaging system (Kafka preferred), Distributed Data Processing system (Apache Spark preferred) Desirable technical skills : - Data-pipeline job scheduling and monitoring tools (Apache Airflow preferred), Micro-services, Knowledge of math/statistical libraries and operationalization of statistical and machine learning model - Experienced working in Cloud environment (AWS preferred) for development and production operationalization - Strong understanding of system architecture, object-oriented design, functional constructs, and distributed architectures - Good financial industry knowledge. Knowledge with Market & fundamental Data added advantage - Working knowledge and strong analytical skill working with semi-structured and unstructured datasets - Experience with software development lifecycle (SDLC) methodologies (Agile preferred) - Proficiency in the development environment, including IDE, source control system, unit-testing tool and defect management tool using automated build and deployment (CI/CD) - Excellent communication skills are essential, with strong verbal and writing proficiencies (ref:hirist.tech)

Location: hyderabad, IN

Posted Date: 11/24/2024