Data Engineer (Azure / Databricks)

Data Engineer (Azure / Databricks) Miejsce pracy: Kraków Technologies we use Expected Microsoft Azure SQL Spark SQL BigQuery Python Optional Azure Databricks Git Operating system Windows Linux About the project As a SQL Engineer, you will be working for our client, a global financial institution engaged in modernizing its financial IT systems to meet critical regulatory requirements. The project involves preparing core finance applications for seamless operation on a new cloud infrastructure. You will be supporting the migration and transformation of large-scale ETL workflows and complex SQL logic from one cloud provider to another, with a strong emphasis on automation, performance optimization, and quality assurance. You will work alongside cross-functional teams to ensure the project’s success in a dynamic and fast-paced environment. Join us, and transform complex queries into elegant solutions Kraków - based opportunity with hybrid work model (6 days per month in the office). Your responsibilities Migrating complex BigQuery SQL transformations to Azure Spark SQL Building and executing ETL workflows using Azure Databricks Creating automation tools for data and code migration between cloud platforms Analyzing existing SQL logic and transforming it for new cloud environments Writing Python scripts to support migration utilities and ETL automation Documenting processes to support production readiness and handover Collaborating with developers, product owners, and technical leads Identifying and resolving performance bottlenecks in SQL workflows Supporting the CI/CD process by integrating SQL and ETL components Participating in Agile ceremonies and contributing to team planning Our requirements Experience working with at least one cloud provider, preferably Microsoft Azure Strong expertise in SQL, particularly Spark SQL or BigQuery SQL Hands-on experience building and maintaining complex ETL pipelines Proficiency in Python programming Understanding of SQL coding standards and performance optimization techniques Familiarity with CI/CD pipelines and automation tools Strong problem-solving skills and adaptability Ability to manage time effectively under tight deadlines Experience working within Agile development teams Excellent communication and documentation skills Optional Prior experience with Azure Databricks Background in financial IT systems or regulatory projects Knowledge of data migration tools and strategies Experience with version control tools like Git Familiarity with big data tools and ecosystems Exposure to production support and post-deployment processes This is how we organize our work This is how we work agile scrum This is how we work on a project Continuous Deployment Continuous Integration What we offer Stable and long-term cooperation with very good conditions Enhance your skills and develop your expertise in the financial industry Work on the most strategic projects available in the market Define your career roadmap and develop yourself in the best and fastest possible way by delivering strategic projects for different clients of ITDS over several years Participate in Social Events, training, and work in an international environment Access to attractive Medical Package Access to Multisport Program Access to Pluralsight Flexible hours & remote work Benefits sharing the costs of sports activities private medical care remote work opportunities flexible working time fruits integration events corporate gym mobile phone available for private use computer available for private use saving & investment scheme no dress code coffee / tea drinks christmas gifts birthday celebration sharing the costs of a streaming platform subscription access to 100 projects access to Pluralsight Recruitment stages first online interview second online interview GETREADY to meet with us ITDS Business Consultants is involved in many various, innovative and professional IT projects for international companies in the financial industry in Europe. We offer an environment for professional, ambitious, and driven people. We would like to meet you. If you are interested please apply and attach your CV in English or Polish, including a statement that you agree to our processing and storing of your personal data. ITDS’s Whistleblower Procedure You can report violations in accordance with ITDS’s Whistleblower Procedure available here: https://itds.pl/wp-content/uploads/2025/03/INFORMATION-ON-PROCEDURE-FOR-REPORTING-BREACHES-AND-PROTECTION-OF-WHISTLEBLOWERS-AT-ITDS-POLSKA.pdf ITDS Polska Sp. z o.o. ITDS supports financial service providers to take the next steps. We identify what’s possible, every day. Opportunities in the areas of technology, organization, and digitization. We see where banks, insurers, payment companies, or fintech can go and how they can get there. That’s why we want to stimulate you to ramp up your ambition. Forget what you perceive as restraints and step towards the new reality. ITDS in Poland - Pure player in new Technologies & Financial Industry 300 IT implementation professionals 20 clients in the Banking, Insurance, Payment & Fintech Industry ITDS excels in digital strategy delivery and implementation of best-of-breed lending solutions. ITDS has delivered successful strategic projects throughout Europe since 1998. We combine the experience we’ve accumulated with in-depth knowledge of technologies, business processes, and EU legislation to unlock new business opportunities. Informujemy, że administratorem danych jest ITDS z siedzibą w Warszawie, ul. Złota 59 (dalej jako "administrator"). Masz prawo do żądania dostępu do swoich danych osobowych, ich sprostowania, usunięcia lub ograniczenia przetwarzania, prawo do wniesienia sprzeciwu wobec przetwarzania, a także prawo do przenoszenia danych oraz wniesienia skargi do organu nadzorczego. Dane osobowe przetwarzane będą w celu realizacji procesu rekrutacji. Podanie danych w zakresie wynikającym z ustawy z dnia 26 czerwca 1974 r. Kodeks pracy jest obowiązkowe. W pozostałym zakresie podanie danych jest dobrowolne. Odmowa podania danych obowiązkowych może skutkować brakiem możliwości przeprowadzenia procesu rekrutacji. Administrator przetwarza dane obowiązkowe na podstawie ciążącego na nim obowiązku prawnego, zaś w zakresie danych dodatkowych podstawą przetwarzania jest zgoda. Dane osobowe będą przetwarzane do czasu zakończenia postępowania rekrutacyjnego i przez okres możliwości dochodzenia ewentualnych roszczeń, a w przypadku wyrażenia zgody na udział w przyszłych postępowaniach rekrutacyjnych - do czasu wycofania tej zgody. Zgoda na przetwarzanie danych osobowych może zostać wycofana w dowolnym momencie. Odbiorcą danych jest serwis Hello HR oraz inne podmioty, którym powierzyliśmy przetwarzanie danych w związku z rekrutacją. Naruszenia można zgłaszać zgodnie z Procedurą zgłaszania nieprawidłowości ITDS dostępną tutaj:https://itds.pl/wp-content/uploads/2025/03/INFORMATION-ON-PROCEDURE-FOR-REPORTING-BREACHES-AND-PROTECTION-OF-WHISTLEBLOWERS-AT-ITDS-POLSKA.pdf

Location: Kraków, PL

Posted Date: 4/19/2025