Senior Big Data Engineer in EPAM Systems

Do you have a passion for the ever-evolving beauty industry and a drive to push boundaries?Join the team of professionals for one of the beauty industry leader! Our customer is not only the best-in-class product and service provider but a pioneer who are constantly seeking new ways to redefine beauty and create unforgettable experiences for its customers.Their "try then buy" philosophy is exemplified through its in-store beauty stations where customers can test products and receive personalized advice from knowledgeable staff members.We are looking for an experienced senior developer who will be deeply involved in aggregation of commercial purchases, marketing campaigns, catalog data, etc from various sources into the data lake.ResponsibilitiesArchitect and maintain our code base for ETL and ELT pipelines, large batch/micro batch processing and streaming systemsBuild out the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using ADF, Spark, Kafka, or similar technologiesIdentify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etcFor the top management and stakeholders - act as a single point of responsibility over any delivery-related matters, including escalations, upsells, ramp-downs, etcAccountable for the technical leadership regarding the delivery. Ensuring a sound and future-proof architecture is planned and the implementation meets the technical quality standardsComfortable writing stories and associated acceptance criteria for agile/scrum workflowCoordinate between multiple disciplines, stakeholdersEnsure that projects are delivered in line with our client processes and methodologies; Well-versed in different delivery models, with focus on agile approachesEstablish a strategy of continuous delivery risk management that enables proactive decisions and actions throughout the delivery life cycleMeasure and improve delivery productivityServe as a consultant to the Data Engineers in support of quality and timely delivery of workPerform production support and deployment activitiesRequirements Must have:SQLSparkScalaNice to have:Spark StreamingAzureDatabricksStrong interpersonal and communications skillsEnglish level – B2+ (It’s crucial due to the direct communication with the client)We OfferCompetitive compensation depending on experience and skillsIndividual career pathUnlimited access to LinkedIn learning solutionsSick leave and regular vacationEnglish classes with certified English teachersFlexible work hoursAbout EPAMEPAM is a leading global provider of digital platform engineering and development services. We are committed to positively impacting our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to learn and grow continuously. You will join a dedicated, creative, and diverse community that will help you discover your fullest potential. EPAM is committed to providing our global team of 53,150+ EPAMers with inspiring careers. EPAMers lead with passion and honesty and think creatively. Our people are the source of our success, and we value collaboration, try always to understand our customers' business, and strive for the highest standards of excellence Show more Show less Position level Senior secondary level Type of employment Full-time Job responsibilities Engineering and Information Technologies Industries IT services and IT Consulting