Senior Python Data Engineer (SK-1256) in Nortal

Senior Python Data Engineer (SK-1256) Київ, Львів, віддалено Nortal welcomes anexperienced Senior Python (Data) Engineer tojoin the project team ofour client— the international mining industry giant! The company isre-imagining and digitalizing the mining process, using the latest and most innovativeIT technologies, tocreate sustainable value across anintegrated value chain. About our client Our client isaglobal mining company with aworld-class portfolio ofproducts that are used byabillion consumers every day. Our client relies ondata and cutting-edge data science toenhance their operations. They also use advanced machine learning and artificial intelligence tooptimize their processes. About the project Our client isagiant corporation with 90000 employees globally. They have their own innovativeIT department handling the whole cycle ofdevelopment ofthe products used bythe organization. You will work inaninternational expert team todevelop sophisticated software solutions that have adirect impact onalmost every aspect ofmodern life. You will use the innovative practices and the latest technologies todeliver safe and sustainable products totheir customers around the world. Data Analytics isanew discipline inthe Technical and Sustainability function ofour client. The company isgoing togenerate more data than ever before, and itneeds tobuild the systems tosupport this and for making better decisions. Mission Work closely with the Data Engineering Lead todevise effective data ingestion strategies aligned with business objectives Define and implement robust data ingestion patterns and processes toensure efficient and reliable data flow into the organization’s data platform Develop and maintain reusable data engineering orETL pipelines and codebase using Python, PySpark, Databricks, Airflow, REST APIs, and the Azure cloud platform Design and implement robust data APIs using Python frameworks such asFastAPIor Flask and deploy them onAzure App Service Collaborate with cross-functional teams tounderstand data requirements and provide scalable data engineering solutions Design and implement batch and streaming data architectures leveraging Azure cloud services like Azure Data Factory and Azure Databricks Contribute tothe development and deployment ofApache Airflow onAzure Kubernetes Service (AKS) Ensure adherence tosoftware engineering best practices, including version control, testing, and continuous integration/continuous deployment (CI/CD) processes Participate incode reviews, technical discussions, and knowledge-sharing sessions within the team Requirements : Good experience inPython programming language Proven experience with Apache Airflow and its deployments onAzure Kubernetes Service Hands-on experience with Python frameworks like FastAPIor Flask and deploying REST APIs onAzure App Service Strong understanding ofcore data engineering concepts and principles Solid experience with Azure cloud services, including Azure Data Factory and Azure Databricks Proficiency inwriting PySpark code for data processing and transformation Ability todesign and implement reusable and scalable data engineering pipelines and codebase Soundunderstanding ofsoftware engineering development practices, including version control, testing, and continuous integration/continuous deployment (CI/CD) Experience indesigning batch and streaming data architectures using Azure cloud platform services Effective problem-solving skills and the ability totroubleshoot complex data engineering issues Commitment tocontinuous learning and staying updated with industry trends and best practices indata engineering Strong communication and collaboration skills with English language proficiency Ability towork effectively inateam environment, provide training, and document processes Nice tohave: Familiarity with Python tools like Pytest, tox, poetry Familiarity with Python testing frameworks like pytest and build tools like tox and poetry Experience inbuilding CI/CD pipelines and working with Git-based version control systems Knowledge ofcontainerization technologies such asDocker and Kubernetes Nortal offers Family-like environment and personal attention toeach specialist Direct cooperation with European and USA clients and their innovative products Competitive salary and regular reviews The work-life balance you deserve: 24working days ofpaid vacations Educational reimbursement, funded language classes, certifications "Benefit Cafe with various categories like sport, leisure, books, fuel, etc. Health care: 10paid sick leaves, on-demand medical insurance, vaccinations Cozy workplace and WFH opportunities Exciting events and lovely gifts for your family Ondemand relocation assistance toPoland Inyour resume please allow our company touse your personal data.