Sr. Dara Engineer (Scale) in Sigma Software

Join our dynamic team as a Senior Data Engineer and be part of a cutting-edge journey toward solving complex challenges in the world of data engineering and innovation.As a Senior Data Engineer with us, you’ll play a pivotal role in developing and enhancing our core systems and product services using the latest technologies. Dive into the realm of big data as you tackle unique challenges that push the boundaries of what’s possible.From the outset, we’ve been committed to crafting a resilient and scalable infrastructure capable of handling massive amounts of data. Currently processing terabytes per second with millions of writes, our system is poised for exponential growth, offering you the opportunity to make a significant impact.In our company, innovation thrives. Whether you’re passionate about implementing new ideas or eager to explore cutting-edge technologies, you’ll find the perfect environment to fuel your creativity.If it’s all about you and you want to become a part of our stellar team, let’s try!CUSTOMEROur client operates in a dynamic environment, relying on a robust engineering infrastructure powered by Google Cloud Platform (GCP). They utilize cutting-edge technologies, including Bigtable, BigQuery, Apache Spark, and more, to drive their business forward. As part of our team, you’ll have the opportunity to collaborate directly with them, understanding their unique challenges and crafting innovative solutions that meet their evolving needs.REQUIREMENTSProficiency in various non-relational schema models (e.g., Column Family, Graph, Document, Object)Experience with advanced architectural design concepts such as KAPPA and LAMBDA architecturesStrong background in Scala or similar JVM-based languages, and proficiency in PythonFamiliarity with high-throughput systems is essential, and experience in Go would be a valuable assetStrong communication skills and proficiency in EnglishBachelor’s degree or higher in Computer Science or related field PERSONAL PROFILEStrong feeling of ownership and responsibilityDetail-oriented approach to ensure high-quality and error-free software developmentRESPONSIBILITIESUtilize Apache Spark for both batch and real-time streaming data processing at scaleDevelop Scala microservices hosted on Kubernetes (GKE) to bolster our product offeringsHarness the power of MlLib and Tensorflow on Vertex AI to tackle forecasting, simulations, and many machine learning challengesDrive the deployment of new models and engines, enabling groundbreaking analyses and insights