Senior Data Engineer (Azure) @ GetInData | Part of Xebia in GetInData | Part of Xebia

A Data Engineer's role involves the design, construction, and upkeep of data architecture, tools, and procedures facilitating an organization's collection, storage, manipulation, and analysis of substantial data volumes. This position involves erecting data platforms atop commonly provided infrastructure and establishing a streamlined path for Analytics Engineers who rely on the system. Proficiency in a programming language like Python / Scala or Java Knowledge of Lakehouse platforms - Databricks Experience working with messaging systems - Kafka Familiarity with Version Control Systems, particularly GIT Experience as a programmer and knowledge of software engineering, good principles, practices, and solutions Extensive experience in Microsoft Azure Knowledge of at least one orchestration and scheduling tool, for example, Airflow, Azure Data Factory, Prefect, Dagster Familiarity with DevOps practices and tools, including Docker, Terraform, CI/CD, Azure DevOps Ability to actively participate/lead discussions with clients to identify and assess concrete and ambitious avenues for improvement A Data Engineer's role involves the design, construction, and upkeep of data architecture, tools, and procedures facilitating an organization's collection, storage, manipulation, and analysis of substantial data volumes. This position involves erecting data platforms atop commonly provided infrastructure and establishing a streamlined path for Analytics Engineers who rely on the system. ,[Working together with Platform Engineers to assess and choose the most suitable technologies and tools for the project, Development and committing of new functionalities and open-source tools, Executing intricate data intake procedures, Implementing and enacting policies in line with the company's strategic plans regarding utilized technologies, work organization, etc., Ensuring compliance with industry standards and regulations in terms of security, data privacy applied in the data processing layer, Conducting training and knowledge-sharing] Requirements: Python, Databricks, Kafka, Git, Airflow, Docker, Terraform, CI/CD, Microsoft Azure, Azure DevOps Tools: Jira, GitLab, GIT, Jenkins / GitLab, Agile. Additionally: Sport subscription, Private healthcare, Flat structure, Small teams, International projects, Team Events, Training budget, Free coffee, Gym, Bike parking, Playroom, Free snacks, Free beverages, In-house trainings, Startup atmosphere, No dress code, Kitchen.