Skip to content

v0.3.1
Compare
Choose a tag to compare
@mellis13 mellis13 released this 24 Jun 22:57
· 168 commits to master since this release
v0.3.1
a213a41

Released on June 24, 2022

Description

Version 0.3.1 adds new functionality in the form of DataSet aggregation lists for pipelined retrieval of data, convenient support for multiple GPUs, and the ability to delete scripts and models from the backend database. It also introduces multithreaded execution for certain tasks that span multiple shards of a clustered database, and it incorporates a variety of internal improvements that will enhance the library going forward.

Detailed Notes

  • Implemented DataSet aggregation lists in all client languages, for pipelined retrieval of data across clustered and non-clustered backend databases. (PR258) (PR257) (PR256) (PR248) New commands are:

    • append_to_list()
    • delete_list()
    • copy_list()
    • rename_list()
    • get_list_length()
    • poll_list_length()
    • poll_list_length_gte()
    • poll_list_length_lte()
    • get_datasets_from_list()
    • get_dataset_list_range()
    • use_list_ensemble_prefix()

  • Implemented multithreaded execution for parallel dataset list retrieval on clustered databases. The number of threads devoted for this purpose is controlled by the new environment variable SR_THERAD_COUNT. The value defaults to 4, but may be any positive integer or special value zero, which will cause the SmartRedis runtime to allocate one thread for each available hardware context. (PR251) (PR246)

  • Augment support for GPUs by implementing multi-GPU convenience functions for all client languages. (PR254) (PR250) (PR244) New commands are:

    • set_model_from_file_multigpu()
    • set_model_multigpu()
    • set_script_from_file_multigpu()
    • set_script_multigpu()
    • run_model_multigpu()
    • run_script_multigpu()
    • delete_model_multigpu()
    • delete_script_multigpu()

  • Added API calls for all clients to delete models and scripts from the backend database. (PR240) New commands are:

    • delete_script()
    • delete_model()

  • Updated the use of backend RedisAI API calls to discontinue use of deprecated methods for model selection (AI.MODELSET) and execution (AI.MODELRUN) in favor of current methods AI.MODELSTORE and AI.MODELEXECUTE, respectively. (PR234)

  • SmartRedis will no longer call the C runtime method srand() to ensure that it does not interfere with random number generation in client code. It now uses a separate instance of the C++ random number generator. (PR233)

  • Updated the way that the Fortran enum_kind type defined in the fortran_c_interop module is defined in order to better comply with Fortran standard and not interfere with GCC 6.3.0. (PR231)

  • Corrected the spelling of the word "command" in a few error message strings. (PR221)

  • SmartRedis now requires a CMake version 3.13 or later in order to utilize the add_link_options CMake command. (PR217)

  • Updated and improved the documentation of the SmartRedis library. In particular, a new SmartRedis Integration Guide provides an introduction to using the SmartRedis library and integrating it with existing software. (PR261) (PR260) (PR259) (SSPR214)

  • Added clustered Redis testing to automated GitHub check-in testing. (PR239)

  • Updated the SmartRedis internal API for building commands for the backend database. (PR223) This change should not be visible to clients.

  • The SmartRedis example code is now validated through the automated GitHub checkin process. This will help ensure that the examples do not fall out of date. (PR220)

  • Added missing copyright statements to CMakeLists.txt and the SmartRedis examples. (PR219)

  • Updated the C++ test coverage to ensure that all test files are properly executed when running "make test". (PR218)

  • Fixed an internal naming conflict between a local variable and a class member variable in the DataSet class. (PR215) This should not be visible to clients.

  • Updated the internal documentation of methods in SmartRedis C++ classes with the override keyword to improve compliance with the latest C++ standards. (PR214) This change should not be visible to clients.

  • Renamed variables internally to more cleanly differentiate between names that are given to clients for tensors, models, scripts, datasets, etc., and the keys that are used when storing them in the backend database. (PR213) This change should not be visible to clients.

Assets 2
Loading