Lead Data Engineer in EPAM Systems

DescriptionOur client is an American video game company.ResponsibilitiesMigrate current Data pipelines and DAGs from GCP BigQuery stored procedures into AWS RedshiftPerform necessary data backfills and validate the quality and integrity during and post-migrationDesign, develop, and maintain data pipelines using AWS services such as Amazon Redshift (or any MPP solution), Amazon S3, dbt and Apache AirflowUtilize SQL and ETL/ELT solutions to transform and load data from various sources into data warehouses and data lakesOptimize data workflows and processes to ensure efficiency, scalability, and reliabilityImplement auto-updated mechanisms to keep data pipelines and systems up-to-date with the latest dataCollaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needsMonitor and troubleshoot data pipelines to identify and resolve issues in a timely mannerPerform data assessments and analytics to provide insights and recommendations for data-driven decision-makingRequirements5+ years of experience as a Data EngineerAdvanced SQL, PLSQL, TSQL for data transformation and optimizationExperience with writing ETL/ELT code, managing and deploying DAGs using DBT or AirflowHands-on experience working with AWS RedShift, if not have you worked with similar Cloud EDW systemsUpper-Intermediate level of English, both spoken and written (B2+)Nice to haveFamiliarity with Google Cloud Platform (GCP) and Google Cloud BigQuery for data storage and analyticsKnowledge of AWS migration tools for transitioning data and workloads from Google Cloud Platform to AWSExperience with analytics and data assessment techniques to evaluate data quality, integrity, and usabilityProficiency in BI testing methodologies and tools for validating business intelligence reports and dashboardsBackground in data analytics engineering with a focus on building scalable and efficient data solutionsWe OfferCompetitive compensation depending on experience and skillsIndividual career pathUnlimited access to LinkedIn learning solutionsSick leave and regular vacationEnglish classes with certified English teachersFlexible work hours Show more Show less Посадовий рівень Старший середній рівень Тип зайнятості Повний робочий день Посадові обов’язки Інформаційні технології Галузі ІТ-послуги та ІТ Консалтинг