Senior Data Engineer in Smart Arbitrage Technologies

Senior Data Engineer віддалено About Weare looking for astrong Data Engineer tojoin our development team and helpus build the new highly scalable and highly available version ofanAlgorithmic Trading Platform. AsaData Engineer you will participate inplatform’s architecture aswell asinimplementation ofETL services forit. You will also develop data warehousing and data processing systems, tools toempower our research team inaccessing the huge amounts ofdata efficiently. The ideal candidate should have astrong background inPython, SQL, ETL, distributed data analytics, HAand HLsystems. This isanew project with anew foundation, giving the ability tofully utilise your experience without looking back atany legacy orprevious technical choices. Stack Python, Java, Scala, Go Spark, Flink, Pandas, Numpy, FastAPI Kafka, NATS, gRPC Postgres, Redis, ClickHouse Zookeeper, Consul, etcd Docker, Ansible, Vault, GHA Prometheus, AM, Grafana, ELK AWS Requirements 5+years ofwork experience asaData Engineer. Proficiency inPython and using itasthe primary development language inrecent years. Practical knowledge ofatleast one other programming language: Java, Scala, Go, Rust, etc. Experience working with Big Data. Proficiency inSQL and relational databases: Postgres, MySQL, etc. Proficiency inNoSQL: Redis, Zookeeper, Hadoop, Consul, etc. Proficiency with column-oriented DBMS: ClickHouse, Vertica, Snowflake, etc. Ability todesign complex data models: normalized, multidimensional, etc. Experience implementing distributed, scalable and fault-tolerant systems. Experience developing, maintaining, and debugging problems inlarge server-side code bases. Good knowledge ofengineering best practices and testing. Ability toshare knowledge and mentor others. Responsibilities Improve existing Data Engineering infrastructure tomake itscalable and prepare itfor anticipated Big Data volumes. Create maintainable and fault-tolerant ETLpipelines, data services. Solve complicated technical problems regarding stability, availability, latency and throughput. Conduct R&D work with new technology. Maintain high-quality coding standards within the team. Identify, design and implement process improvements. Maintain good engineering culture, help others tolearn and grow. Take ahigh degree ofownership and freedom toexperiment with new technologies toimprove our software. Terms Minimum bureaucracy, the ability toeasily communicate with all levels ofmanagement. Westrive tomake decisions quickly, without months ofdiscussions. Anopportunity tobeatthe forefront oftrading technology, impacting major investment decisions. Acollaborative, innovative environment where your contributions make adifference.