Senior Kafka Developer

Hays · Melbourne VIC · Full time
Posted 3d ago

Senior Kafka Developer

KEY POINTS WE FOUND
  • Develop custom integration code using Java / Spring Boot for source system connectivity.
  • Build and maintain Kafka producers / consumers and event-driven services on Confluent Cloud.
  • Implement integration with Schema Registry and support HTTP/API-based integrations.

Senior Kafka Developer || Excellent Pay with Hybrid Flexibility

Senior Kafka Developer || Hybrid (3 Days/Week In Office)

Role: Senior Kafka Developer
Location: Melbourne, VIC (3 Days/Week In Office)

Responsibilities:

  • Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable
  • Build and maintain Kafka producers / consumers, topic integration logic, and event-driven services on Confluent Cloud / NGIP.
  • Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing, and de-duplication.
  • Implement integration with Schema Registry, topic schemas, and message validation controls.
  • Support HTTP/API-based integrations through Kong Gateway for NGIP to target application communication
  • Configure and support HTTP Sink delivery patterns, payload mapping, retries, and failure handling
  • Perform unit / component testing for custom code, Flink jobs, and interface logic.
  • Support SIT, pipeline testing, defect fixing, replay, and root-cause analysis during test execution
  • Support E2E testing with downstream teams and resolve integration issues across connectors, transformations, APIs, and Kafka topics
  • Work with GitLab CI/CD pipelines for build, deployment, regression automation, and release support

Must-have Skills:

  • Develop custom integration code using Java / Spring Boot for source system connectivity where managed connectors are not applicable.
  • Build and maintain Kafka producers / consumers, topic integration logic, and event-driven services on Confluent Cloud / NGIP.
  • Develop and maintain Flink SQL / stream processing logic for transformation, enrichment, validation, routing, and de-duplication.
  • Implement integration with Schema Registry, topic schemas, and message validation controls.
  • Support HTTP/API-based integrations through Kong Gateway for NGIP to target application communication.
  • Configure and support HTTP Sink delivery patterns, payload mapping, retries, and failure handling.

Good-to-Have Skills:

  • Confluent Certified Developer/Administrator
  • Experience with stream governance, RBAC, and tiered storage
  • Background in data engineering, ETL, or microservices architecture
  • Familiarity with traditional messaging systems and data warehouses
  • Experience in Agile methodologies and DevOps practices

What you need to do now

If you're interested in this role send your updated CV at arjun.singh@hays.com.au
At Hays, we value diversity and are passionate about placing people in a role where they can flourish and succeed. We actively encourage people from diverse backgrounds to apply!

If you're interested in this role, click 'apply now' to forward an up-to-date copy of your CV, or call us now.

If this job isn't quite right for you, but you are looking for a new position, please contact us for a confidential discussion on your career.

Stay Safe While Job Hunting

We vet all employer accounts and do our best to keep job ads safe, but scams can still occur. Be cautious when sharing personal information — never provide financial details or make payments during the application process. For extra security, use the Apply button on our site when proceeding.

Skills

0 of 27 matched
Agile methodologiesApi-based integrationsConfluent cloudData engineeringData warehousesDevops practicesEtl processesEvent-driven architectureFlink sqlGitlab ci/cdHttp/api integrationsJavaJava / spring boot developmentKafkaKafka producers/consumersKong gatewayMessaging systemsMicroservices architecturePipeline testing and defect fixingRbac (role-based access control)Root-cause analysisSchema registrySpring bootStream governanceStream processingTiered storageUnit / component testing

Licenses & certifications

0 of 1 matched
Confluent certified developer/administrator