Cache

[ZhongliGao]

For storage systems, the cache is a very important issue because it has a huge impact on performance. I want to design an adaptive, machine learning caching algorithm. For example, combining different caching algorithms to face a variety of different data models.

[PsiACE]

Good idea, I am very interested in learn-based cache and configurable cache.

like:

• https://www.usenix.org/system/files/conference/hotstorage18/hotstorage18-paper-vietri.pdf
• https://github.com/menmos/menmos/tree/master/crates/lfan

[ZhongliGao]

Thanks. My idea is to design a dynamic adaptive algorithm, a caching algorithm that changes according to changes in the model. These caching algorithms can be LRU, LIRS, LFU, etc., or a combination of several caching algorithms.

[ZhongliGao]

like :
https://www.usenix.org/system/files/fast21-rodriguez.pdf

[PsiACE]

My idea is to design a dynamic adaptive algorithm, a caching algorithm that changes according to changes in the model.

I am sure it is feasible, and this idea has given birth to a number of works. But the details of the implementation need to be carefully considered and evaluated.

[PsiACE]

like : https://www.usenix.org/system/files/fast21-rodriguez.pdf

Thanks for the additional information, I will check it out later

[ZhongliGao]

My idea is to design a dynamic adaptive algorithm, a caching algorithm that changes according to changes in the model.

I am sure it is feasible, and this idea has given birth to a number of works. But the details of the implementation need to be carefully considered and evaluated.

Yes, there are many details to consider. For example, stability, threshold setting, etc. all require enough scenarios and experiments to determine.

[huachaohuang]

The idea of an adaptive cache algorithm sounds very interesting.
We may need an algorithm to predict the cache miss ratio according to cache size. The OSCA paper provides a promising algorithm.

[ZhongliGao]

I would like to split the cache into two modules to do cache management and cache. The cache management is mainly responsible for policy and the cache module is only responsible for the cache.

[huachaohuang]

Can you elaborate a bit about what does "policy" means for cache? Maybe you can describe your idea in more detail before implementing it. It may be hard to understand what you are trying to do here.

[ZhongliGao]

Can you elaborate a bit about what does "policy" means for cache? Maybe you can describe your idea in more detail before implementing it. It may be hard to understand what you are trying to do here.
The cache management piece is mainly responsible for doing cache replacement and cache selection. Later, we will also consider putting the training data module here.

[ZhongliGao]

For example https://github.com/menmos/menmos/tree/master/crates/lfan/src

[PsiACE]

The cache management piece is mainly responsible for doing cache replacement and cache selection. Later, we will also consider putting the training data module here.

In my opinion:

• cache -> cache and cache replacement
• cache management - > cache selection & training data module(user access patterns and data features)

[huachaohuang]

Thanks for your explanation.

[ZhongliGao]

The cache management piece is mainly responsible for doing cache replacement and cache selection. Later, we will also consider putting the training data module here.

In my opinion:

• cache -> cache and cache replacement
• cache management - > cache selection & training data module(user access patterns and data features)

Thank you for your advice. Do you know any good examples of open-source caching? I would like to learn about it.