Is there a way for me to expose a rest api to which systems can push data to, which in turn creates topics and updates the avro schema registry without manually writing a custom connector?

CodePudding user response：

Sure. You can write an HTTP server in any language you're comfortable with and wrap KafkaProducer with Avro serializer and AdminClient to create topics.

The Confluent REST Proxy already does this, partially.

Kafka Connect doesn't accept records over HTTP, anyway, so a custom connector wouldn't do any good.