Skip to content

Multiprocess Safe File Locking System for C++23 with a Python Wrapper

License

Notifications You must be signed in to change notification settings

jowillianto/file-lock

Repository files navigation

File Lock

A multithreaded multiprocessed file locking mechanism compatible with std::unique_lock and std::shared_lock. A caveat to this FileLock system is that :

  • Multithreaded file sharing have to be done on the same FileLock object.

Requirements

Since this process uses C++ modules, the following are the requirements :

cmake >= 3.28
clang >= 17 or equivalent gcc (with modules support p1689)
ninja >= 1.11.1

If your system does not satisfy the requirement, you can use the docker container to build python bindings if that is what you need. The python bindings have been tested to work under ubuntu22.04

Constructing a File Lock

To construct a file

#include <filesystem>
#include <unique_lock>
#include <shared_lock>
import file_lock;

namespace mf = moderna::file_lock;

auto file_path = std::filesystem::path {R"(some path to your file)"};
auto lock = mf::file_mutex { file_path };
lock.lock(); // Locks the file for writing (blocking)
lock.unlock(); // Unlocks the file
/*
  Try to lock the file (nonblocking), returns true if the file is successfully locked
  otherwise returns false.
*/
lock.try_lock(); 

// Shared version
lock.lock_shared();
lock.unlock_shared();
lock.try_lock_shared();

// Also works with unique_lock and shared_lock RAII based locks
std::unique_lock unique_lock { lock };
std::shared_lock shared_lock { lock };

Running Tests

In the build folder, run the following to test

ninja multiprocessing_file_lock_tests
./multiprocessing_file_lock_tests

Currently there is a bug in the test that causes the child process to not exit. If you encounter such a condition during testing. Please just restart the test and see if it works.

Linking via CMake

target_link_libraries(<target> multiprocessing_fileLock)

Compiling for a Python Build

CXX=$(<path to your clang>) cmake -B build -DCMAKE_BUILD_TYPE=Release -GNinja
cd build
ninja multiprocessing_file_lock_python

The above commands will produce a file_lock.so file which you can import into a python application.

Python API Documentation

Assume that file_lock.so contains the following python definition with strict type definitions.

class FileMutex:
    def __init__(self, file_path : str):
        ...
      
    def lock() -> None:
        ...
    def unlock() -> None:
        ...
    def try_lock() -> bool:
        ...
    def lock_shared() -> None:
        ...
    def unlock_shared() -> None:
        ...
    def try_unlock_shared() -> bool:
        ...
    def file_path() -> str:
        ...