Lead Data Engineer in EPAM Systems, Inc.

Lead Data Engineer Description

Our client is an American video game company.

Responsibilities

• Migrate current Data pipelines and DAGs from GCP BigQuery stored procedures into AWS Redshift
• Perform necessary data backfills and validate the quality and integrity during and post-migration
• Design, develop, and maintain data pipelines using AWS services such as Amazon Redshift (or any MPP solution), Amazon S3, dbt and Apache Airflow
• Utilize SQL and ETL/ELT solutions to transform and load data from various sources into data warehouses and data lakes
• Optimize data workflows and processes to ensure efficiency, scalability, and reliability
• Implement auto-updated mechanisms to keep data pipelines and systems up-to-date with the latest data
• Collaborate with cross-functional teams to understand data requirements and deliver solutions that meet business needs
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner
• Perform data assessments and analytics to provide insights and recommendations for data-driven decision-making

Requirements

• 5+ years of experience as a Data Engineer
• Advanced SQL, PLSQL, TSQL for data transformation and optimization
• Experience with writing ETL/ELT code, managing and deploying DAGs using DBT or Airflow
• Hands-on experience working with AWS RedShift, if not have you worked with similar Cloud EDW systems
• Upper-Intermediate level of English, both spoken and written (B2+)

Nice to have

• Familiarity with Google Cloud Platform (GCP) and Google Cloud BigQuery for data storage and analytics
• Knowledge of AWS migration tools for transitioning data and workloads from Google Cloud Platform to AWS
• Experience with analytics and data assessment techniques to evaluate data quality, integrity, and usability
• Proficiency in BI testing methodologies and tools for validating business intelligence reports and dashboards
• Background in data analytics engineering with a focus on building scalable and efficient data solutions

We offer

• Work on a flexible schedule remotely or from any of our comfortable offices or coworking spaces in Ukraine
• Receive the necessary equipment to perform your work tasks
• Change projects and technology stacks within EPAM
• Gain experience in various business domains (Insurance, E-commerce, Healthcare, Finance, Travelling, Media, Artificial Intelligence, and more)
• Consider relocation options in over 30 countries worldwide
• Participate in volunteer, charity programs and communities (both technical and interest-based)
• You can plan your individual career path together with your manager
• Receive regular feedback from colleagues
• Improve your English for free with certified teachers (Speaking Clubs, client interview preparation courses, etc.)
• Get the opportunity to undergo free training and certification in AWS, GCP, or Azure Clouds
• Use the internal E-learn training program (18,200+ specialized training and mentoring programs)
• Access corporate accounts on LinkedIn Learning, Get Abstract and other partner resources
• Study at EPAM Solution Architecture School with the instructors who are practicing architects
• Develop as a leader, join Delivery Management, Resource Management, Leadership Essentials school and more
• Participate in internal communities (500+ meetups, technical discussions, brainstorming sessions, online events and conferences annually)
• Vacation and sick leave (including a sick leave without a medical certificate)
• A wide range of Voluntary Medical Insurance programs providing both medical treatment and various preventive options (including sports activities)
• Medical insurance for family members at corporate rates
• Company support during significant life events (childbirth or adoption, marriage, etc.)
• Support for psychological comfort: discounts on services from mental health specialists or coaches, thematic training
• E-kids program - a free programming language training program for EPAMers' children

EPAM strives to provide its global team of over 52,800+ professionals in more than 55 countries with opportunities for professional growth from day one of collaboration. Our colleagues are the source of EPAM's success, so we value cooperation, strive to always understand our clients' business and aim for the highest quality standards. No matter where you are, you will join a dedicated, diverse community that will help you realize your potential to the fullest.