rorosen/zeekstd: Rust implementation of the Zstandard Seekable Format

A Rust implementation of the Zstandard Seekable Format.

The seekable format splits compressed data into a series of independent “frames”, each compressed
individually, so that decompression of a section in the middle of an archive only requires zstd to
decompress at most a frame’s worth of extra data, instead of the entire archive.

Zeekstd makes additions to the seekable format by implementing an updated version of the
specification, however, it is fully compatible with the
initial version of the seekable format.

A seekable Encoder will start new frames automatically at 2MiB of uncompressed data. See
EncodeOptions to change this and other compression parameters.

use std::{fs::File, io};
use zeekstd::Encoder;

fn main() -> zeekstd::Result()> {
    let mut input = File::open("data")?;
    let output = File::create("seekable.zst")?;
    let mut encoder = Encoder::new(output)?;
    io::copy(&mut input, &mut encoder)?;
    // End compression and write the seek table to the end of the seekable
    encoder.finish()?;

    Ok(())
}

By default, the seekable Decoder decompresses everything, from the first to the last frame, but
can also be configured to decompress only specific frames.

use std::{fs::File, io};
use zeekstd::Decoder;

fn main() -> zeekstd::Result()> {
    let input = File::open("seekable.zst")?;
    let mut output = File::create("decompressed")?;
    let mut decoder = Decoder::new(input)?;
    // Decompress everything
    io::copy(&mut decoder, &mut output)?;

    let mut partial = File::create("partial")?;
    // Decompress only specific frames
    decoder.set_lower_frame(2);
    decoder.set_upper_frame(5);
    io::copy(&mut decoder, &mut partial)?;

    Ok(())
}

This repo also contains a CLI tool that uses the library.

• The zstd C library is under a dual BSD/GPLv2 license.
• Zeekstd is under a BSD 2-Clause License.

Keep your files stored safely and securely with the SanDisk 2TB Extreme Portable SSD. With over 69,505 ratings and an impressive 4.6 out of 5 stars, this product has been purchased over 8K+ times in the past month. At only $129.99, this Amazon’s Choice product is a must-have for secure file storage.

Help keep private content private with the included password protection featuring 256-bit AES hardware encryption. Order now for just $129.99 on Amazon!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!