Benchi
lastmod 2025-05-11created 2025-05-111 edits
A benchmark automation tool
About
- A lightweight benchmarking framework designed to run performance benchmarks with minimal configuration, developed to simplify measuring application and infrastructure performance
- Benchmark environments are defined through Docker Compose configuration files, and container status monitoring and result collection are automated
- Measured metrics are saved in CSV format,
- Supports various metric collectors such as Prometheus, Docker, Kafka, and Conduit
Key features
- Docker integration: defines and runs the test environment through a Compose file
- CSV metric collection: collected performance metrics are saved as CSV for easy post-processing, and the average is computed with a trimmed mean that drops the top and bottom 5%
- Custom hooks: hooks can be set to run custom commands at each stage (e.g. pre-infra, post-test)
- Real-time status monitoring: container status and collected metrics can be checked during a benchmark