Big Data Administrator - Hadoop/Spark

As a Big Data Admin, you will play a crucial role in ensuring the smooth operation and optimization of our Hadoop and Spark infrastructure. Your responsibilities will include : Hadoop Installation and Deployment : - Install Hadoop in Linux environments. - Deploy and maintain Hadoop clusters. - Monitor cluster health to ensure continuous uptime. - Analyze storage data volume and allocate space in HDFS. - Manage cluster resources, including node creation and removal. - Configure NameNode for high availability. Hadoop Administration : - Implement and administer Hadoop infrastructure on an ongoing basis. - Deploy and configure required hardware and software. - Expand existing Hadoop environments. - Install and configure software components. - Perform database backup, recovery, and security measures. - Monitor and optimize database performance. - Manage and optimize disk space for data handling. - Install patches and upgrade software as needed. - Automate manual tasks for improved : - 7 years of experience as a Big Data Admin. - In-depth knowledge of Hadoop and Spark ecosystems. - Strong Linux administration skills. - Experience with distributed file systems (HDFS). - Familiarity with big data tools and technologies (Hive, Pig, Impala, etc.). - Understanding of data warehousing and data modeling concepts. - Excellent problem-solving and analytical skills. - Ability to work independently and as part of a team. Preferred Qualifications : - Experience with cloud platforms (AWS, GCP, Azure). - Knowledge of scripting languages (Python, Bash). - Certification in Hadoop or Spark. (ref:hirist.tech)

Location: in, IN

Posted Date: 11/22/2024