CloudTier S3 Intelligent-Tiering demo

The CloudTier Storage Tiering SDK integrates S3 Intelligent-Tiering cloud storage with on-premise storage systems seamlessly, creating a hybrid storage environment. So it allows on-premise applications to access S3 file objects transparently, just as they would access on-premise regular files. There is no interruption to move or restore your on-premise files to/from the cloud storage, so you don’t need to change your existing applications and infrastructure to be compatible with the cloud environment.

The CloudTier S3 demo is a C# demo project, it demonstrates how to connect the S3 storage from your on-premise storage, and how to generate the test files in on-premise storage and S3 storage. It demonstrates how to browse and read the S3 files as a local regular files. When you launch the CloudTier S3 demo, it will generate a few test stub files in your application folder’s sub folder “TestStubFolder”, the file’s content was stored in the sub folder “TestSourceFolder”, when you read the stub file, the file content will be retrieved from the source file, if your file content was stored in the S3 storage, then it will be retrieved from the S3, it can demonstrate how the storing tiering is working with this simple project.

A stub file looks and acts like a regular file. It has the same file attributes with the original physical file (file size, creation time, last write time, last access time). It also keeps the original file’s security. The difference between the stub file and the normal physical file is the stub file doesn’t take any physical space, looks like a 0 kb file.

How to run the CloudTierS3 demo?

1. Excluded the process Id from the filter driver: the excluded processes can’t access the stub file. It can prevent the unwanted processes from downloading the data from the cloud storage.
2. Filter connection threads: the number of the threads to handle the read requests of the stub files.
3. Connection timeout: the maximum time of the filter driver waiting for the data return from your application.
4. Cache folder path: the folder to store the cache files which download from the cloud storage.
5. The return data type: a. return block data on read: return the block of the requested read data if you have the block of the data. b. return cache file on read: return the cache file name if the whole file was downloaded. c. rehydrate file on first read: the file was downloaded to the cache folder, and the stub file will be rehydrated to the regular file.
6. Amazon S3 site settings: before you can test the S3 connection, you need to have an S3 account with the access key, then you can create a test bucket with the intelligent tiering enabled in Amazon S3 console.
7. To browse the files in s3 or upload/download the files to/from S3, you can go to the S3 explorer. After the files were uploaded to the S3, then you can create the stub file from the S3 explorer.
8. Read the S3 files: after the files were uploaded to the S3 cloud storage, you can replace your original file with the stub file based on your retention policies. You can create S3 stub file in S3 explorer. For example, to read the stub file by copying the stub file to another folder, you will see the S3 file will be downloaded to the cache folder from the S3 storage, after that the cache file will be returned to your local file system through the CloudTier filter driver, then the read request to the S3 file will be completed successfully.

EaseFilter File System Filter Driver SDK Reference

Product Name	Description
CloudTier Storage Tiering SDK	EaseFilter Storage Tiering Filter Driver SDK Introduction.
File Monitor SDK	EaseFilter File Monitor Filter Driver SDK Introduction.
File Control SDK	EaseFilter File Control Filter Driver SDK Introduction.
File Encryption SDK	EaseFilter Transparent File Encryption Filter Driver SDK Introduction.
Registry Filter SDK	EaseFilter Registry Filter Driver SDK Introduction.
Process Filter SDK	EaseFilter Process Filter Driver SDK Introduction.
EaseFilter SDK Programming	EaseFilter Filter Driver SDK Programming.

EaseFilter SDK Sample Projects

Sample Project	Description
CloudTier Storage Tiering Demo	A HSM File System Filter Driver Demo.
CloudTier S3 Intelligent Tiering Demo	CloudTier S3 Intelligent Tiering Demo.
Amazon S3 File Explorer Demo	Amazon S3 File Explorer Demo.
Auto File DRM Encryption	Auto file encryption with DRM data embedded.
Transparent File Encrypt	Transparent on access file encryption.
Secure File Sharing with DRM	Secure encrypted file sharing with digital rights management.
File Monitor Example	Monitor file system I/O in real time, tracking file changes.
File Protector Example	Prevent sensitive files from being accessed by unauthorized users or processes.
FolderLocker Example	Lock file automatically in a FolderLocker.
Process Monitor	Monitor the process creation and termination, block unauthorized process running.
Registry Monitor	Monitor the Registry activities, block the modification of the Registry keys.
Secure Sandbox Example	A secure sandbox example, block the processes accessing the files out of the box.
FileSystemWatcher Example	File system watcher, logging the file I/O events.

Filter Driver Reference

• Understand MiniFilter Driver
• Understand File I/O
• Understand I/O Request Packets(IRPs)
• Filter Driver Developer Guide
• MiniFilter Filter Driver Framework
• Isolation Filter Driver

Support

If you have questions or need help, please contact support@easefilter.com

Home | Solution | Download | Demos | Blog | Programming