Recro - Data Engineer - ETL/Python

We are looking for a passionate and innovative individual to join our Data Science team. This role offers you the chance to work in a dynamic, industry-neutral environment with cutting-edge technologies. You will play a pivotal role in enriching and maintaining our central repository of datasets, enabling advanced data analytics and machine learning techniques to drive actionable insights. If you are someone who loves a challenge and enjoys collaborating with cross-functional teams, this is the role for you The core responsibilities for the job include the following : ETL Development : - Design, develop, and maintain efficient ETL processes for multi-scale data sets. - Optimize data transformation and validation processes to ensure data accuracy and consistency. - Collaborate with cross-functional teams to understand data requirements and implement business logic. Data Pipeline Architecture : - Architect and build scalable, high-performance data pipelines. - Continuously evaluate and implement new technologies for pipeline efficiency and reliability. - Develop scraping pipelines for acquiring sector-specific datasets. Data Modeling : - Design and implement data models to support analytics and reporting needs. - Optimize database structures for performance and scalability. Data Quality and Governance : - Implement robust data quality checks and governance processes to maintain data integrity. - Collaborate with stakeholders to define and enforce data quality and Communication : - Maintain detailed documentation of ETL processes, data models, and system architectures. - Effectively communicate complex technical concepts to non-technical Collaboration : - Work closely with the Quant team and developers to refine and optimize data pipelines. - Liaise with external stakeholders to gather requirements for cloud database : - Bachelor's degree in Computer Science, Information Technology, or a related field. - Proven experience (3 years) as a Data Engineer with expertise in ETL techniques is a MUST. - Strong programming skills in Python, Java, or Scala. - Proficiency in web scraping and transforming publicly available data. - Hands-on experience with cloud platforms such as AWS, Azure, or GCP. - Strong knowledge of SQL, relational, and non-relational databases. - Understanding of data warehousing concepts and architectures. - Familiarity with big data tools like Hadoop, Spark, and Kafka. - Expertise in data modeling tools and techniques. - Excellent problem-solving, analytical, and communication skills. Preferred Qualifications : - Master's degree or equivalent in Computer Science/Data Science. - Knowledge of data streaming and real-time processing. - Familiarity with data governance and security best practices. (ref:hirist.tech)

Location: bangalore, IN

Posted Date: 1/15/2025