Refactor message serialisation and deserialisation#197

Merged

milanmlft merged 36 commits intormg/parquet_inpfrom mm/serialised-message-class

Dec 20, 2023

+253-241

Commits on Dec 19, 2023

Commits on Dec 20, 2023

Use jsonpickle for (de)serializing messages
milanmlft
committed
Fix test_deserialise_datetime() so it uses the Message class to assert the study_datetime
milanmlft
committed
Add study_datetime property for Message
milanmlft
committed
No need to test deserialising individual fields, already covered by test_deserialise() which deserialises the entire object
milanmlft
committed
Remove study_date_from_serialised(), use the class attribute study_datetime instead
milanmlft
committed
Revert "Add study_datetime property for Message"
milanmlft
committed
Remove Messages class, use list[Message] instead
milanmlft
committed
Add type checking for messages parsed from parquet input
milanmlft
committed
Update test_messages_from_parquet() to use JSON strings instead of bytes
milanmlft
committed
Update PixlProducer.publish() to use a list of Message objects and handle serialisation
milanmlft
committed
Convert JSON string to bytes when serialising
milanmlft
committed
Revert "Update test_messages_from_parquet() to use JSON strings instead of bytes"
milanmlft
committed
PixlProducer.publish() should take a list[Message] as input in tests
milanmlft
committed
Update EHR API to use new Message design
milanmlft
committed
Update imaging API to use new Message design
milanmlft
committed
Update deserialise function to accept bytes-encoded JSON string
milanmlft
committed
Assert messages against list of Messages
milanmlft
committed
Print dataclass in logs
milanmlft
committed
jsonpickle.decode() can handle bytes so no need to decode first
milanmlft
committed
Make deserialisable a keyword only argument
milanmlft
committed
Copilot forgot to convert dates to datetimes 🥲
milanmlft
committed
Refactor PixlConsumer run method to accept Message object as callback parameter and deserialise
milanmlft
committed
Update consumer in test_subscriber to accept Message object instead of bytes
milanmlft
committed