Sqlite-zstd

lastmod 2022-08-22created 2022-08-102 edits

Row-level compression extension with random access support

Features

• Dictionary-based row-by-row compression; slightly larger than whole-file compression, but allows random access
• 2.2GB DB storing 7 million IMDB titles as JSON
  • Whole-file compression gives 200MB, but no random access
  • sqlite-zstd compression gives 550MB with random access
• Around 80% space savings depending on the data. Performance is nearly the same, sometimes even faster (because less is read from disk)

See also

• sqlite
• zstd

Favorite site

• Github - sqlite-zstd