Python & Big Data Developer - Code Generation Frameworks

Job Opportunity : Python Developer - Big Data & Code Generation Framework We are looking for a skilled and experienced Python Developer to join our team and contribute to building a Python-based code generation framework and runtime engine that interacts with a Business Rules repository. Note : Please read the JD carefully before applying- Key Responsibilities : - Design and develop a Python-based code generation framework and runtime engine. - Work with large-scale Big Data environments, leveraging frameworks like SparkSQL and SparkStreaming. - Implement advanced graph algorithms and recursion techniques for efficient data processing. - Develop and optimize Python applications, ensuring scalability and high performance. - Collaborate with cross-functional teams to ensure seamless integration with various data sources and services, including HIVE, YARN, Kafka, HBase, and MongoDB. - Generate and parse XML/JSON documents, and manage REST API : - 3 years of experience in building and deploying Big Data applications using SparkSQL and SparkStreaming in Python. - Strong expertise in graph algorithms and advanced recursion techniques. - 5 years of hands-on experience in designing, building, and deploying Python-based applications. - 3 years of experience working with HIVE, YARN, Kafka, HBase, MongoDB. - Proficient in XML/JSON parsing and working with REST APIs. - Bachelor's degree in a quantitative field (e.g., Engineering, Computer Science, Statistics, Econometrics) and a minimum of 5 years of industry experience. - Extensive experience handling complex, large-scale Big Data environments, preferably with datasets over 20TB. - Solid hands-on experience writing complex SQL queries and working with data export/import utilities. (ref:hirist.tech)

Location: delhi, IN

Posted Date: 2/21/2025