Airflow Administrator

Job Responsibilities : Airflow Administration and Data Analytics : - Administer and manage Airflow for scheduling and monitoring complex data workflows. - Utilize open-source technologies like Docker, Kubernetes, and container-based microservices to develop scalable solutions. - Provide installation and support for Business Intelligence systems such as SAP BODS, Collibra, HVR (Fivetran), Qlik Replicate, SAP SLT, and SAP BOXI (BOBI). Database Administration and Development : - Install, configure, and maintain databases like PostgreSQL, MongoDB, and RabbitMQ across cloud platforms such as Azure and AWS. - Develop ETL processes to extract, transform, and load data from various sources into data warehouse systems or other systems. - Administer and ensure the security and integrity of databases, complying with regulatory standards and validation processes. Data Analysis and Reporting : - Apply statistical analysis and data mining techniques to uncover trends, patterns, and correlations within data sets. - Build dashboards and reports to communicate data insights and findings to business stakeholders. DevOps Integration : - Implement DevOps methodologies and manage CI/CD pipelines using GitLab or GitHub for efficient development and deployment processes. - Integrate PowerShell, SQL, and PL/SQL scripting to automate and enhance data workflows. Technical Installations and Configurations : - Manage technical installations and configurations of enterprise applications on cloud instances, supporting both development and production environments. - Collaborate with cross-functional teams to translate business requirements into technical solutions and ensure seamless data integrations. IT Governance and Data Security : - Ensure data governance principles and best practices are followed for data integrity and compliance with data security and privacy regulations. - Participate in IT regulatory validation processes to ensure all systems comply with industry standards. - Cross-Functional Collaboration and Leadership: - Work closely with business, IT teams, and stakeholders to align data systems and tools with organizational goals. - Provide leadership in development projects and mentor junior team members, driving technical and process improvements. Required Qualifications : Experience : - 8 years of experience in Information Technology supporting Business Intelligence, Warehouse, and Analytics systems. - Extensive knowledge of Airflow administration, Docker, Kubernetes, and container-based microservices. - Hands-on experience with databases like Postgres, MongoDB, and RabbitMQ. - Proficiency with ETL development, SQL, PL/SQL, and PowerShell scripting. Technical Skills : - Experience with cloud platforms such as Azure and AWS for database management and administration. - Knowledge of DevOps integration with CI/CD pipelines. - Experience with data governance and security best practices. - Familiarity with statistical analysis and data mining techniques. Soft Skills : - Strong problem-solving and analytical skills. - Excellent communication skills for presenting data insights to stakeholders. - Ability to manage multiple tasks in a dynamic environment. - Willingness to learn and adapt to modern technologies and methodologies. Preferred Skills : - Experience with SAP BODS, Collibra, HVR (Fivetran), SAP SLT, and SAP BOXI (BOBI). (ref:hirist.tech)

Location: India, IN

Posted Date: 10/31/2024