Компания "inDrive"
We are seeking Senior Infrastructure Engineer in Data Management Platform to manage and deploy Kafka, NATS and Clickhouse clusters worldwide, build and monitor written code in CI, and interact with microservice developers.
As a global company we are spanning all continents. It’s a big challenge to deliver data between our data centers in AWS for dozens of microservices. The streaming unit is part of a data management platform that is developing a streaming direction.
Responsibilities:
- Maintain and deploy dozens of Kafka clusters worldwide (over 10 regions) under high load and on top of kubernetes
- Maintain and deploy dozens of NATS clusters at high load and on top of Kubernetes
- Maintain and deploy Clickhouse installations
- Develop Kubernetes operators
- Develop automation in Python
- Interact with microservice developers
- Automation: acl/ssl certificates/topics/export data
- Build written code in CI and write helm charts for Argo CD to implement the concept of Kafka as code
- Monitoring (define golden signals/response scripts for duty operators, export data for monitoring)
- On-call duty
Qualifications:
- Experience with Kubernetes
- Experience writing Helm charts
- Excellent understanding of how Kafka and everything around it works (MM2, Kafka Connect, Cruise Control)
- Experience in Python (or other languages)
- Experience in developing microservices for orchestration systems (preferably kubernetes)
- Good understanding of Linux
- Understanding of the principles of CI/CD-systems
- Experience with AWS
Nice to have:
- Experience in developing Java plugins for Kafka connect
- Experience with ArgoCD
- Knowledge of Clickhouse
- Knowledge of NATS
- Experience with other streaming technologies
- Experience working independently on large projects (with a cycle of up to several months). From idea to result.
Conditions & Benefits:
- Stable salary, official employment
- Health insurance
- Hybrid work mode and flexile schedule
- Relocation package offered for candidates from other regions
- Access to professional counseling services including psychological, financial, and legal support
- Discount club membership
- Diverse internal training programs
- Partially or fully payed additional training courses
- All necessary work equipment