922 - ESE: Performance

Through the use of technologies like 256-bit AES-GCM encryption, OpenSSL data transmission, LZ4 compression, speed and efficiency are at the core of Redstor Pro's data integrity.

Data Integrity

Both the Enterprise Server Edition (ESE) Agent and the Storage Platform use OpenSSL to encrypt and decrypt data using 256-bit AES-GCM. OpenSSL is optimised to be extremely fast, and both encryption and decryption are super fast. 

For a more elaborate explanation, see an overview of the ESE's data integrity measures here.

Compression

Performance is further improved by using the LZ4 compression algorithm, which provides good compression but is especially impressive with decompression speeds.

Hashing

Both MD5 and SHA256 are used to calculate file thumbprints. The combined approach is effectively as fast as MD5 on its own. 

Multi-processing

The above processes only keep a single CPU core busy per disk being processed. The ESE Agent is therefore only limited by the disk and network speeds.

In addition, a 16MB buffer is used for network data transmission while any of the above occurs. This balances out the latency caused by opening files.

A note regarding performance degradation: The time needed to open a file is most evident when there are many small files. If the disk and network are fast but you're not getting the expected throughput, performance degradation could be due to the Storage Platform being busy with other tasks or serving other Agents.