Wednesday 27 September 2017

Goldengate for Kafka : how to send Tokens to Kafka from Goldengate

Requirement -

Recently i got one request from client to provide one unique identifier of the Source table to Kafka mostly Source Table name. 

As we do not have any Column in the table which can provide this information to the Kafka by simple Goldengate Mapping. 

To full-fill this requirement i Used Goldengate Tokens to give Source Table name with each generated topic to Kafka. 

for this configuration below changes are required. 



Source Side (Goldengate)

we need to add Token to the goldengate extract parameter file.  

TABLE Hr.Emp , tokens (SOURCE_TABLE = "Emp") ;




Target Side (Kafka)

we need to make below changes to kafka.props file at target goldengate configuration side 

gg.handler.kafkahandler.includeTokens=true



Note: before implementing above solution in to production please do testing of your requirement by your own in non production ENV . above solution is based on my requirement and experience.