New function to add timestamp to output

[sgaragan]

Our analytics team is looking for timestamps at each stage of the processing of messages from when they are generate to when they are stored. One request was to have Candyfloss generate a timestamp when it gets a message via the transformation spec. It could go into a default spec or a new type of spec, but just a way to set a timestamp so we know when each message is picked up from Kafka and processed in Candyfloss.

For example, it could be something like:

"operation": "default", "spec": { "*": { "version": "1.1.0", "cf-timestamp": "=timestamp", ... } }
Thanks,
Sean

[ahassany]

That definitely would be a great feature. You can see example of custom functions at https://github.com/network-analytics/cosmos-candyfloss/tree/main/json-transformation/src/main/java/com/swisscom/daisy/cosmos/candyfloss/transformations/jolt