Big Data Developer

Big Data Developer Miejsce pracy: Warszawa Technologies we use Expected Scala Spark Hadoop Hive Oozie Kafka Docker Kubernetes About the project We are looking for a talented Scala/Spark/Hadoop/Big Data Developer to help deliver a cutting-edge global reporting solution. As part of a large financial institution, we are undergoing a major transformation in our technology stack. We are developing a new customer account reporting engine that will replace legacy reporting solutions across various markets. The project involves consolidating all customer account and payment transaction data into Hadoop, requiring integration with numerous data formats and systems. The goal is to deliver reports to millions of customers, processing billions of transactions each month. Your responsibilities Design and implement a high-performance, flexible, scalable, and easily maintainable global reporting solution. Collaborate closely with Product Owners, Solution Architects, Analysts, Testers, and Developers. Work in an Agile environment, applying the SAFe framework. Manage complex data integrations and ensure seamless performance with Spark and Hadoop-based technologies. Our requirements 3 years of hands-on experience with Scala and functional programming. Proven expertise in writing Spark-based applications in Scala. Familiarity with the Hadoop technology stack (Hive, Oozie, Kafka). Experience with containerized technologies like Docker and Kubernetes. Optional Deep understanding of distributed systems principles. Experience in data engineering and building ETL/ELT pipelines. Experience in performance tuning for Hadoop/Spark solutions. Experience in developing RESTful services. Familiarity with web application development using Bootstrap and ReactJS. Experience working in Agile environments and applying Agile principles. This is how we organize our work This is how we work at the client's site you have influence on the technological solutions applied you have influence on the product Team members project manager Benefits sharing the costs of sports activities private medical care Recruitment stages Rozmowa z rekruterem Rozmowa z klientem B2B.NET S.A. B2Bnetwork jest polską firmą, specjalizującą się w obszarze Quality Assurance oraz Outsourcingu specjalistów IT. Od 2015r. zarządzamy w całości procesami testowymi u naszych klientów oraz wspieramy w znalezieniu odpowiednich kompetencji w innych obszarach IT. Aplikując, wyraża Pani/Pan zgodę na przetwarzanie przez B2BNetwork swoich danych osobowych zawartych w niniejszym kwestionariuszu aplikacyjnym i aplikacji na potrzeby rekrutacji. Jednocześnie oświadczasz, że podanie przez Panią/Pana danych wykraczających poza katalog określony w Kodeksie pracy i innych właściwych ustaw jest dobrowolne i dla Pani/Pana korzystne.

Location: Warszawa, PL

Posted Date: 4/19/2025