Description:
We are looking for an experienced Kafka administrator to join a team of engineers with closely with our clients. The ideal candidate is someone who has a track record of high-quality delivery, combined with a keen appetite to support software developments teams.
This is an operations/system administrator role. The successful candidate will be specifically looking after the provisioning and maintenance of the Kafka cluster; there will be a need to also work on Qlik (Attunity) a CDC (change Data Capture) tool.
- Manage large scale multi-nodes Kafka cluster environments residing on AWS or on-prem.
- Handle all Kafka environment upgrades, including capacity planning, cluster setup, performance tuning and ongoing monitoring.
- Perform high-level, day-to-day operational maintenance, support for the Kafka Cluster.
- Configure and manage Qlik (Attunity).
- System Administrator tasks.
- Implement solutions as per technical design and participate in design activities.
- Planning and estimation of tasks as part of the SCRUM team and strive for accuracy while meeting deadlines.
- Participate in changes, and continuous improvements to existing processes.
- Ability to work hands on in an agile work environment supporting your colleagues as required.
- Ability to work in a team and collaborate with multiple business and technical teams.
- Strong experience in designing and building highly available high-volume messaging infrastructure with Apache Kafka on AWS (e.g. stretch cluster, active/active or active/passive) using Mirror Maker or other replication tools.
- Good experience with Schema Registry, Kafka connectors (source and sink) and KSQL, have worked with Kafka brokers, Zookeeper, Topics, connectors for Setup and administration.
- Strong experience in setting up monitoring and management with tools.
- Working knowledge of monitoring, management tools and data growth management.
- Preferred experience in Kafka security (Encryption and Authentication with SSL, SASL, ACLs).
- Experience in one of the Kafka Administration tools: Confluent Center, Kafka HQ, Kafka UI.
- Good working knowledge of CI/CD, GitOps, methodologies and tools.
- Experience with IaC scripting E.G Terraform, Chef, Puppet
- Experience working in a cross functional Scrum team in an agile environment.
- A willingness and enthusiasm to improve and develop new skills and learn new technologies.
- Excellent problem solving and communication skills both written and verbal.
- Effective communication with all team members and a positive and constructive attitude.
- Constant improvement of products, through feedback and input on the product pipeline and roadmap.
- Related degree qualification (comp sci, engineering, etc).