Senior Python Data Engineer (SK-1256) in Nortal

Nortal welcomes anexperienced Senior Python (Data) Engineer tojoin the project team ofour client— the international mining industry giant! The company isre-imagining and digitalizing the mining process, using the latest and most innovativeIT technologies, tocreate sustainable value across anintegrated value chain.About our clientOur client isaglobal mining company with aworld-class portfolio ofproducts that are used byabillion consumers every day. Our client relies ondata and cutting-edge data science toenhance their operations. They also use advanced machine learning and artificial intelligence tooptimize their processes.About the projectOur client isagiant corporation with 90000 employees globally. They have their own innovativeIT department handling the whole cycle ofdevelopment ofthe products used bythe organization. You will work inaninternational expert team todevelop sophisticated software solutions that have adirect impact onalmost every aspect ofmodern life. You will use the innovative practices and the latest technologies todeliver safe and sustainable products totheir customers around the world. Data Analytics isanew discipline inthe Technical and Sustainability function ofour client. The company isgoing togenerate more data than ever before, and itneeds tobuild the systems tosupport this and for making better decisions.MissionWork closely with the Data Engineering Lead todevise effective data ingestion strategies aligned with business objectivesDefine and implement robust data ingestion patterns and processes toensure efficient and reliable data flow into the organization’s data platformDevelop and maintain reusable data engineering orETL pipelines and codebase using Python, PySpark, Databricks, Airflow, REST APIs, and the Azure cloud platformDesign and implement robust data APIs using Python frameworks such asFastAPIor Flask and deploy them onAzure App ServiceCollaborate with cross-functional teams tounderstand data requirements and provide scalable data engineering solutionsDesign and implement batch and streaming data architectures leveraging Azure cloud services like Azure Data Factory and Azure DatabricksContribute tothe development and deployment ofApache Airflow onAzure Kubernetes Service (AKS)Ensure adherence tosoftware engineering best practices, including version control, testing, and continuous integration/continuous deployment (CI/CD) processesParticipate incode reviews, technical discussions, and knowledge-sharing sessions within the teamRequirements:Good experience inPython programming languageProven experience with Apache Airflow and its deployments onAzure Kubernetes ServiceHands-on experience with Python frameworks like FastAPIor Flask and deploying REST APIs onAzure App ServiceStrong understanding ofcore data engineering concepts and principlesSolid experience with Azure cloud services, including Azure Data Factory and Azure DatabricksProficiency inwriting PySpark code for data processing and transformationAbility todesign and implement reusable and scalable data engineering pipelines and codebaseSound understanding ofsoftware engineering development practices, including version control, testing, and continuous integration/continuous deployment (CI/CD)Experience indesigning batch and streaming data architectures using Azure cloud platform servicesEffective problem-solving skills and the ability totroubleshoot complex data engineering issuesCommitment tocontinuous learning and staying updated with industry trends and best practices indata engineeringStrong communication and collaboration skills with English language proficiencyAbility towork effectively inateam environment, provide training, and document processesNice tohave:Familiarity with Python tools like Pytest, tox, poetryFamiliarity with Python testing frameworks like pytest and build tools like tox and poetryExperience inbuilding CI/CD pipelines and working with Git-based version control systemsKnowledge ofcontainerization technologies such asDocker and KubernetesNortal offersFamily-like environment and personal attention toeach specialistDirect cooperation with European and USA clients and their innovative productsCompetitive salary and regular reviewsThe work-life balance you deserve: 24working days ofpaid vacationsEducational reimbursement, funded language classes, certifications"Benefit Cafe with various categories like sport, leisure, books, fuel, etc.Health care: 10paid sick leaves, on-demand medical insurance, vaccinationsCozy workplace and WFH opportunitiesExciting events and lovely gifts for your familyOndemand relocation assistance toPolandInyour resume please allow our company touse your personal data.