Remote Senior Data Engineer (#1421) in N-iX

N-iX is a software development service company that helps businesses across the globe develop successful software products. During 20 years on the market and by leveraging the capabilities of Easter Europe talents, the company has grown to 2000+ professionals with a broad portfolio of customers in the area of Fortune 500 companies as well as technological start-ups. With its headquarters in Lviv, Ukraine, the company also has multiple development offices in the East European region and representative entities in the United States of America, Sweden, and Malta. We are actively looking for Senior Data Engineer to join our team! Our customer is one of the largest operators of non-franchised collision repair centers and one of the major retail auto glass operators in North America in terms of number of locations and sales. The Company currently operates locations in Canada and in the U.S. . 6+ years of experience working with enterprise data platforms, building and managing data lakes and using big data technologies 5+ years of experience working with relational and non-relational / NoSQL databases, advanced knowledge of SQL 4+ years of experience working with AWS platform. Experience with solutioning on AWS infrastructure using services like AWS IAM, S3, API Gateway, Lambda, Glue, Lake formation, Redshift, DynamoDB, RDS 4+ years of experience with using Python for data engineering and developing high performance and scalable data pipeline 2+ years of experience working with Apache Airflow for orchestrating analytics workload 2+ years of experience with IaC solutions like terraform, cloud formation Strong understanding of concepts around data warehousing, BI, data security, data quality and profiling Prior experience with traditional ETL tools like Talend Open Studio, Informatica, Pentaho or something similar Prior experience with working in a SQL server based environment and utilizing technologies like SSIS, TSQL, SSRS, .Net, C# Have to be a team player and open to working with newer technologies as well as supporting legacy systems Confident knowledge of Agile methodologies Upper-Intermediate level of English Nice to have: Experience AWS EKS service, setting up and managing Kubernetes clusters Cloud DevOps experience utilizing products like Gitlab, Bitbucket or similar ones Good understanding and experience working with various products in the big data ecosystem like Spark, EMR, Hive, Presto, NoSQL databases like DynamoDB, MongoDB N-iX is a software development service company that helps businesses across the globe develop successful software products. During 20 years on the market and by leveraging the capabilities of Easter Europe talents, the company has grown to 2000+ professionals with a broad portfolio of customers in the area of Fortune 500 companies as well as technological start-ups. With its headquarters in Lviv, Ukraine, the company also has multiple development offices in the East European region and representative entities in the United States of America, Sweden, and Malta. We are actively looking for Senior Data Engineer to join our team! Our customer is one of the largest operators of non-franchised collision repair centers and one of the major retail auto glass operators in North America in terms of number of locations and sales. The Company currently operates locations in Canada and in the U.S. . ,[Conduct analysis of existing data systems, identify areas for improvement, and provide recommendations for architectural enhancements, Develop data models, data flows, and data integration strategies to ensure seamless and efficient data management across various systems and platforms, Provide guidance and technical expertise to development teams in implementing data solutions, ensuring compliance with best practices and industry standards, Perform data profiling, data quality assessments, and data governance activities to ensure data accuracy, integrity, and security, Collaborate with data scientists and analysts to enable analytics and data-driven insights through the implementation of appropriate data structures and algorithms, Stay up-to-date with emerging trends, technologies, and industry best practices in data architecture, analytics, and cloud computing, Provide strategic recommendations and guidance on data-related initiatives., Communicate with internal product owners, stakeholders, and external providers] Вимоги: SQL, AWS, Data Lake, Big Data, NoSQL, AWS IAM, AWS S3, API, Gateway, AWS Lambda, Glue, Redshift, AWS DynamoDB, Amazon RDS, Python, Data engineering, Airflow, IaC, Pentaho, SQL Server, SSIS, SSRS, AWS EKS, Spark, Amazon EMR, Hive, Presto, MongoDB Інструменти: Agile, Scrum. Бонуси та переваги: International projects, English lessons, Flexible working hours and remote work possibility, Active tech community, Mentoring program, Referral program, Training budget, Kitchen, Modern office, Free coffee, Friendly atmosphere.