Senior Apache Kafka Developer in Brainberry Group LLC

Senior Apache Kafka Developer

віддалено

BrainBerry Group is expanding its team and is looking for a new Senior Apache Kafka Developer with a passion for new technologies to join an exciting and growing project.

The senior Kafka Steam developer will be responsible for building, deploying a stateful Kafka streams application for OSO clients. You will be working with a range of data from multiple data sources which needs to be joined and combined in a materialized view. As an experienced Kafka developer you will already have a strong foundation in Java, big dataand event driven applications.

Key Responsibilities

● Design, architect and code Kafka Streams JAva based applications.

● Integrate application in deployment pipeline and ensure scalability in high volume, low

latency transactional systems, with ability to plan Apache Kafka cluster sizing based on peak capacity to ensure economic service provision with a 5 9s expectation in Cloud environments is ideal.

Required experience

Essential

● Bachelors’ degree or equivalent experience in computer science / distributed computing.

● 4+ years Kafka work experience, using Apache Kafka, Confluent, MSK / etc

● Experience and detailed understanding of all public cloud vendors

● Supporting, debugging and troubleshooting Apache Kafka clusters.

● Deployment, configuration, security and performance tuning of Apache Kafka.

● Knowledge of scalability levers in high volume, low latency transactional systems, with ability to plan

baseline and peak capacity to ensure economic service provision with a 5 9s expectation in Cloud environments is ideal

● Certificate generation, validation and debugging issues.

● Experience working in both Agile and DevOps environments, with planning sessions, estimation and retrospectives, ensuring that all operational tasks are recorded in ticketing systems.

Desirable

● Confluent certification

● AWS / Azure / GCP certification

● Implemented High Availability and Disaster Recovery infrastructure.

● Experience in all aspects of the software development lifecycle including: requirements gathering, design, coding, testing, source control and production support and leadership in setting of standards for these.

● Strong Unix or Linux engineering and administration background and has moved into real-time data.

● Performed, training and managed technical support teams.

Skills and Abilities

Essential

● Java Kafka Streams

● Spring

● Apache Kafka

● Confluent

● Git / DevOps best practices

● Kubernetes

● Zookeeper

● Kafka Connect

● Ansible

● Confluent platform

● Docker

● AWS / Azure / GCP / OpenShift

Desirable

● Quarkus

● Jenkins / Nexus / GitHub actions

● Avro / Json schemas

● Understanding of Kafka open source tooling

What we are looking for in our engineers

● Proven experience of understanding complex data platforms to technical and business stakeholders

● Ability to work on own initiative

● Excellent interpersonal, communication, writing and documentation skills

● Ability to achieve targets and meet deadlines

● Ability to work with key external engineers