TidesDB v0.5.0b

[guycipher]

TidesDB v0.5.0 BETA

Lots of work went into this minor to assure stability, pass all tests and more!
There were some issues with the hash table implementation and some windows support that were corrected among other issues found in testing and debugging. We are getting closer to TidesDB 1. Thank you for those whom contributed.

Features

• ACID transactions are atomic, consistent, isolated, and durable. Transactions are tied to their respective column family.
• Concurrent multiple threads can read and write to the storage engine. Column families use a read-write lock thus allowing multiple readers and a single writer per column family. Transactions on commit block other threads from reading or writing to the column family until the transaction is completed. A transaction is thread safe.
• Column Families store data in separate key-value stores. Each column family has their own memtable and sstables.
• Atomic Transactions commit or rollback multiple operations atomically. When a transaction fails, it rolls back all operations.
• Cursor iterate over key-value pairs forward and backward.
• WAL write-ahead logging for durability. Column families replay WAL on startup. This reconstructs memtable if the column family did not reach threshold prior to shutdown.
• Multithreaded Compaction manual multi-threaded paired and merged compaction of sstables. When run for example 10 sstables compacts into 5 as their paired and merged. Each thread is responsible for one pair - you can set the number of threads to use for compaction.
• Bloom Filters reduce disk reads by reading initial blocks of sstables to check key existence.
• Compression compression is achieved with Snappy, or LZ4, or ZSTD. SStable entries can be compressed as well as WAL entries.
• TTL time-to-live for key-value pairs.
• Configurable column families are configurable with memtable flush threshold, data structure, if skip list max level, if skip list probability, compression, and bloom filters.
• Error Handling API functions return an error code and message.
• Easy API simple and easy to use api.
• Multiple Memtable Data Structures memtable can be a skip list or hash table.
• Multiplatform Linux, MacOS, and Windows support.

What's Changed

• hashtable: cursor correction on iteration to skip empty buckets on ne… by @guycipher in hashtable: cursor correction on iteration to skip empty buckets on ne… #205
• minor method prefix void where return does not matter too much for co… by @guycipher in minor method prefix void where return does not matter too much for co… #206
• Remove compat.h from src by @toge in Remove compat.h from src #207
• adjustment on hashtable LOAD_FACTOR to be 0.50 which speeds up writes… by @guycipher in adjustment on hashtable LOAD_FACTOR to be 0.50 which speeds up writes… #208
• simplify CMakeLists.txt by linking tidesdb lib only by @toge in simplify CMakeLists.txt by linking tidesdb lib only #209
• • added more comments to hash table by @guycipher in - added more comments to hash table #210
• tidesdb_column_family_t to not use void pointer for memtable as causi… by @guycipher in tidesdb_column_family_t to not use void pointer for memtable as causi… #211
• tidesdb__tests.c cleaner output removing useless prints by @guycipher in tidesdb__tests.c cleaner output removing useless prints #212
• hash_table__tests.c corrections after hash_table_new reformat by @guycipher in hash_table__tests.c corrections after hash_table_new reformat #213
• minor rearrangement of hash table includes by @guycipher in minor rearrangement of hash table includes #214
• rid cmake build warnings on gcc version 12.3.0 (Ubuntu 12.3.0-1ubuntu1~23.04) by @guycipher in rid cmake build warnings on gcc version 12.3.0 (Ubuntu 12.3.0-1ubuntu1~23.04) #215
• • Pass all tidesdb__tests by @guycipher in - Pass all tidesdb__tests #216

Full Changelog: v0.4.0b...v0.5.0b

---

This discussion was created from the release v0.5.0b.

[thegtproject]

You guys are doing awesome. Great job!

[guycipher]

Thank you!