tidwall/cache-benchmarks: Benchmarking Memcache, Redis, Valkey, Dragonfly, and Garnet caching software.

These benchmarks measure thoughput, latency, and CPU cycles for
Memcache,
Redis,
Valkey,
Dragonfly, and
Garnet.

• Persistance is turned off for all caches, no disk operations.
• All connections are local, UNIX named pipes.
• The hardware is an AWS c8g.8xlarge (32 core non-NUMA ARM64).
• The benchmarking tool is memtier_benchmark.
• Includes pipelining for 1, 10, 25, and 50.
• Each benchmark has 31 runs. About 15K total runs.
• The median of the 31 is used for graphing.
• Latency is measured in 50th, 90th, 99th, 99.9th, 99.99th percentiles.
• Latency also includes MAX, the absolute slowest single request.
• CPU cycles are measured using the perf Linux utility.
• All graphs are a logarithmic scale.

The “Threads” at the bottom of each graph represents the number of I/O Threads
that the caching server software is configured to use for that specific benchmark.
All caching software benchmarked has some type of multithreaded networking support through
the following startup flags.

• Memcache: -t
• Redis: --io-threads
• Valkey: --io-threads
• Dragonfly: --proactor_threads
• Garnet: --miniothreads/maxiothreads --minthreads/maxthreads

For each benchmark, a fresh instance of the cache server software is started,
which is dedicated to 16 cores using taskset -c 0-15.
The memtier_benchmark tool uses the other 16 cores taskset -c 16-31.
Of those 16 cores, there are 256 clients spread evenly between 16 threads.
Those clients perform 100K SET and 100K GET operations, each.

There’s a warmup stage that occurs at the start of each run, just after the
cache software is started. It performs a dry run of all SET operations.
This warmup is not a part of the measurements.

The ./bench-all.sh scripts starts running the benchmarks and produces results
that are placed in the results directory.
Expect it to take about two weeks from start to finish to complete all runs.

All graphs are a logarithmic scale.

Pipeline 1 : Throughput,
Latency 50th Percentile,
Latency 90th Percentile,
Latency 99th Percentile,
Latency 99.9th Percentile,
Latency 99.99th Percentile,
Latency MAX,
CPU Cycles

Pipeline 10: Throughput,
Latency 50th Percentile,
Latency 90th Percentile,
Latency 99th Percentile,
Latency 99.9th Percentile,
Latency 99.99th Percentile,
Latency MAX,
CPU Cycles

Pipeline 25: Throughput,
Latency 50th Percentile,
Latency 90th Percentile,
Latency 99th Percentile,
Latency 99.9th Percentile,
Latency 99.99th Percentile,
Latency MAX,
CPU Cycles

Pipeline 50: Throughput,
Latency 50th Percentile,
Latency 90th Percentile,
Latency 99th Percentile,
Latency 99.9th Percentile,
Latency 99.99th Percentile,
Latency MAX,
CPU Cycles

Keep your files stored safely and securely with the SanDisk 2TB Extreme Portable SSD. With over 69,505 ratings and an impressive 4.6 out of 5 stars, this product has been purchased over 8K+ times in the past month. At only $129.99, this Amazon’s Choice product is a must-have for secure file storage.

Help keep private content private with the included password protection featuring 256-bit AES hardware encryption. Order now for just $129.99 on Amazon!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!