Senior Big Data Engineer (Web and Mobile unit needs) in Sigma Software Group

Company DescriptionAre you looking for a team of professionals on top of cutting-edge technologies? Are you looking for a place to boost your Big Data career? We invite you to join our Big Data Competence Center, part of Sigma Software’s complex organizational structure that combines various clients, interesting projects, and activities to grow your professional skills.CUSTOMERWe’re acting in various business domains and working with the top range of clients (those without NDAs can be found here: sigma.software/case-studies).Our team highly supports employees’ freedom, independence in decision-making, and the desire to deeply understand client’s request and see the root of the problem. We believe that people striving toward this mindset are bound to succeed as acclaimed professionals & driving force of Big Data development in Ukraine.PROJECTBig Data Competence Center is where we collect the best engineering practices and unite them into one knowledge base to provide the best technical excellence services for our clients.We’re not just a team gathered to write code. We all are willing to contribute to the field by participating in the life of Big Data Unit or by constantly growing our skills. In our unit, you can be a Big Data engineer/team lead/architect, or you can become a mentor, or a person behind all the new technologies in the team, or an active listener if you will. Whatever you decide, be sure that you’re not alone. Whether it’s a difficult task, an unordinary client request, or your next project to choose, you’ll always have a mentor & teammates with likewise mindsets to come up with the best solution.We’re using an unusual approach, hiring people not for a specific project, but, first and foremost, to join our team. This gives us a chance to know you better and ensure that we’ll provide a perfect match between the client’s needs & your professional interests.If you have the courage to become a part of the top-notch Big Data community in Ukraine, grab your chance, and let’s make some history together!Job DescriptionContributing to new technologies investigations and complex solutions design, supporting a culture of innovation considering matters of security, scalability, and reliability with the focus on building out our ETL processesWorking with a modern data stack, producing well-designed technical solutions and robust code, and implementing data governance processesWorking and professionally communicating with the customer’s teamTaking up responsibility for delivering major solution featuresParticipating in requirements gathering & clarification process, proposing optimal architecture strategies, leading the data architecture implementationDeveloping core modules and functions, designing scalable and cost-effective solutionsPerforming code reviews, writing unit and integration testsScaling the distributed system and infrastructure to the next levelBuilding data platform using the power of modern cloud providers (AWS/GCP/Azure)Extra ResponsibilitiesThese responsibilities will help you to grow professionally and can vary depending on the project and the desire to extend your role in the companyBeing in the AWS cloudteam and actively contributing to the partnershipDeveloping the Micro Batch/Real-Time streaming pipelines (Lambda architecture)Working on POCs for validating proposed solutions and migrationsLeading the migration to modern technology platforms, providing technical guidanceAdhering to CI/CD methods, helping to implement best practices in the teamContributing to unit growth, mentoring other members of the team (optional)Owning the whole pipeline and optimizing the engineering processesDesigning complex ETL processes for analytics and data management, driving the massive implementationQualifications5+ years of experience with Python and SQLExperience with AWS, specifically API Gateway, Kinesis, Athena, RDS, and AuroraExperience building ETL pipelines for analytics and internal operationsExperience building internal APIs and integrating with external APIsWorking with Linux operational systemEffective communication skills, especially for explaining technical concepts to nontechnical business leadersDesire to work in a dynamic, research-oriented teamExperience with distributed application concepts and DevOps toolingExcellent writing and communication skillsTroubleshooting and debugging abilityWILL BE A PLUS2+ years of experience with Hadoop, Spark, and AirflowExperience with DAGs and orchestration toolsPractical experience with developing Snowflake-driven data warehousesExperience with developing event-driven data pipelines Show more Show less Посадовий рівень Старший середній рівень Тип зайнятості Повний робочий день Посадові обов’язки Інженерія і Інформаційні технології Галузі Розробка програмного забезпечення