Senior Big Data Engineer in Brainence

Senior Big Data Engineer віддалено Aboutus Brainence isasoftware development company with 7+years ofexperience building powerful products and scaling development teams. We’ve collaborated with 50+startups and enterprises, helping them build their MVPs, augment their engineering teams, and launch their products successfully. Our expertise spans across industries such ashealthcare, edtech, real estate, retail, construction, logistics, insurance, and more. About the project Brainence iscurrently seeking a Senior Big Data Engineer tojoin our team. You’ll work on the only journey advertising SaaS platform that integrates media planning and buying. Its journey automation technology streamlines planning and buying processes and provides real-time insights, creating aunified solution for digital ads, and optimizing advertising budgets. Responsibilities ● Design, develop, and maintain large-scale data processing solutions using Apache Spark and Scala ● Develop ETL pipelines toprocess, clean, and transform data from various sources ● Optimize Spark jobs for performance and scalability ● Develop and maintain APIs tofacilitate data access and integration ● Ensure data accuracy, consistency, and completeness throughout the entire data pipeline ● Collaborate with data scientists, analysts, and other cross-functional teams to understand data requirements and deliver high-quality solutions Requirements ● 5+years ofexperience inScala programming and Spark development ● Strong understanding ofSpark architecture and internals ● Experience with distributed computing technologies (e.g., Hadoop, Hive, Kafka)● Experience with database technologies and SQL ● Experience with developing and consuming APIs ● Solid understanding ofdata monitoring, alerting, and logging systems Work details ● Long-term project: 1year ormore ● Probationary period: yes, reviewed after three months ● Remote work: yes, with the option for onsite work inLviv ● Work schedule: full-time with flexible working hours ● Salary: paid bythe 10th ofeach month inUSD Weoffer ● 18paid vacation days ● 10paid sick days ● 2unpaid days off per month ● Flexible hours with the option towork remotely worldwide ● Comfortable office space with parking and anonsite masseur, just 5minutes from Lviv city center ● Necessary equipment, or$200 equipment compensation per year ● Accounting services ● Lviv ITCluster discount card