[CMDCT-3956] Kafka + Rates

[BearHanded]

Description

Taking over the original PR because now there's a pile more.

• Adds rates to the postKafka triggers and streams (thanks Aileen)
• Adds Kafka topic creation and cleanup... :|
• Updates existing kafka post library to the same version we use for .ts in other apps. This lets us use the same namespace pattern for cleanup.
• Now handles missing NewImage when it is a delete operation

Related ticket(s)

CMDCT-3956

---

How to test

The logs on the postKafkaData lambda should be running without error.
It's very chatty with errors when it can't connect to bigmac or send a message.
Deployed branch for reference and manual interactions: https://d1i3grrahy03ww.cloudfront.net/

Notes

---

Pre-review checklist

• I have added thorough tests, if necessary
• I have updated relevant documentation, if necessary
• I have performed a self-review of my code
• I have manually tested this PR in the deployed cloud environment

---

Pre-merge checklist

Review

• Design: This work has been reviewed and approved by design, if necessary
• Product: This work has been reviewed and approved by product owner, if necessary

Security

If either of the following are true, notify the team's ISSO (Information System Security Officer).

• These changes are significant enough to require an update to the SIA.
• These changes are significant enough to require a penetration test.

---

convert to a different template: test → val | val → prod

[codeclimate]

Code Climate has analyzed commit 95bcb70 and detected 0 issues on this pull request.

The test coverage on the diff in this pull request is 0.0% (90% is the threshold).

This pull request will bring the total coverage in the repository to 86.5% (-1.5% change).

View more on Code Climate.

[ailZhou]

lgtm! tested by adding values to a measure and checking for a success in aws lambda monitor.