Releases: redis/redis-benchmarks-specification
Version 0.1.62
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
- Updated the benchmark SPEC to include command priority. Included --dry-run and --tests-priority-upper-limit in redis-benchmarks-spec-client-runner @filipecosta90 (#184)
Version 0.1.61
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
- Added support for ZREVRANK, ZRANK, ZINCRBY and ZREM @slice4e (#182)
- Fixed stats checker @filipecosta90 (#181)
- Added HINCRBY, HMSET, MGET, ZSCORE, EVALSHA, GETBIT, EXISTS, EXPIRE, EXPIREAT, PEXPIRE, SCAN, TOUCH, TTL, and ZRANGEBYSCORE benchmarks @filipecosta90 (#177)
- Added execution and updated installation section to Readme @markovamaria (#175)
- Fix value bug @slice4e (#179)
- Added support for BITFIELD command. @slice4e (#178)
- Added command ZREVRANGEBYSCORE @slice4e (#174)
- Added support for MULTI EXEC @filipecosta90 (#176)
- Added FPADD command testcase. @slice4e (#172)
- Validated SPEC fields uppon PR and commit @filipecosta90 (#173)
- Avoid RDB usage on unit tests @filipecosta90 (#145)
- Fixed runner tests according to test cases @filipecosta90 (#170)
- Enable RESP 3 support in benchmark-tools @ofekshenawa (#169)
- Introduced --tests-regex flag to ease the process of running a subsetof tests @filipecosta90 (#168)
- Fix issue 130 @slice4e (#167)
- Fix bug 87 @slice4e (#142)
- Included ZCARD and HMGET tests @filipecosta90 (#144)
- Formatted all yml test-suite files @filipecosta90 (#143)
- Extended runner functional coverage @filipecosta90 (#138)
- Added GEOSEARCH BYBOX variation @filipecosta90 (#140)
- Enforcing keyspace length check and checking for datasets within scc @filipecosta90 (#136)
Version 0.1.59
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
- Updated README with visuals and making reference to Intel @filipecosta90 (#135)
- Updated README with visuals @filipecosta90 (#134)
- Fixed CLI commit date conversion issue @filipecosta90 (#133)
- Included memtier_benchmark-2keys-lua-eval-hset-expire test case for EVAL perf tracking @filipecosta90 (#127)
- Fixing CI integration @filipecosta90 (#126)
Tooling changes: Benchmark artifacts builder
- Added -g -fno-omit-frame-pointer to gcc:8.5.0-amd64-debian-buster-default @filipecosta90 (#128)
Version 0.1.53
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
- Updated min python version to 3.7 poetry and CI scripts @filipecosta90 (#124)
- Included double and long score ZSET ingestion benchmarks @filipecosta90 (#122)
- Added API healthcheck endpoints @filipecosta90 (#123)
Version 0.1.50
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
- Fixed self contained coordinator circular dependency import @filipecosta90 (#121)
Version 0.1.41
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
- Fixed linting issues @filipecosta90 (#115)
Tooling changes: Benchmark artifacts builder
- Added --docker-air-gap to builder and scc @filipecosta90 (#116)
Tooling changes: Self-contained coordinator
- Added --docker-air-gap to builder and scc @filipecosta90 (#116)
Tooling changes: Setup agnostic cli benchmark runner (solely client)
Version 0.1.39
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
Version 0.1.35
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
Tooling changes: Self-contained coordinator
- Added consumer-id to self contained coordinator. Enables multi consumers @filipecosta90 (#110)
Version 0.1.34
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
Tooling changes: Self-contained coordinator
- Fixed self_contained_coordinator r.ping() using 6379 port and not redis_proc_start_port @filipecosta90 (#109)
Version 0.1.33
Redis performance and observability spec change
Project status:
The following is a high level status report for currently available specs and tools.
- Benchmark platforms specification: Experimental components are released and available for beta testing.
- Benchmark topologies specification: Experimental components are released and available for beta testing.
- Benchmark artifacts builder specification: Experimental components are released and available for beta testing.
- Test-suites specification: Experimental components are released and available for beta testing.
- Spec tool implementation: API: Experimental components are released and available for beta testing.
- Spec tool implementation: Benchmark artifacts builder: Experimental components are released and available for beta testing.
- Spec tool implementation: Self-contained coordinator: Experimental components are released and available for beta testing.
- Spec tool implementation: Large scale coordinator: Draft components are under design, and have not been added to the specification.
- *Spec tool implementation: Setup agnostic cli benchmark runner (solely client): contains the client utility that triggers the actual benchmarks against an endpoint provided. This tool is setup agnostic and expects the DB to be properly spinned beforehand.
Release changes:
Tooling changes: Self-contained coordinator
- Enabled to specify redis_proc_start_port on self contained coordinator; Include merge-base commit tests on API trigger @filipecosta90 (#106)