v0.9.0

Note that there has been a lot of breaking changes since the last release. We are working on a stable release, but until then breaking changes will be common.

What's Changed

• Produce URLs and lexicons when partitioning by @elshize in #356
• Add ABOUT page by @JMMackenzie in #359
• Updated TBB by @amallia in #360
• Shard tools by @elshize in #358
• Refactoring by @amallia in #361
• Verbose flag for BP by @elshize in #362
• Stem queries by @amallia in #365
• Unify document reordering in one tool by @elshize in #363
• Update .travis.yml by @amallia in #371
• Implement CLI scorer params by @JMMackenzie in #366
• Change app to allow quantization with optional scorer by @JMMackenzie in #374
• Compile Headers workflow by @elshize in #375
• Fix for reorder tool not printing new identifier order by @JMMackenzie in #386
• Clean up wand requirements by @JMMackenzie in #388
• Fix CLI issue where quantization is not considered by @JMMackenzie in #389
• Fix deprecated TBB calls by @JMMackenzie in #387
• Krovetz thread by @JMMackenzie in #390
• Streaming index compression for block index by @elshize in #384
• Minor bug in app by @JMMackenzie in #394
• Refactor cursor interface by @elshize in #376
• Stream builder for quantized case by @elshize in #391
• Move most test to Actions by @elshize in #377
• Maxscore perf by @elshize in #395
• Reduce number of test queries by @JMMackenzie in #405
• MacOS GH actions by @amallia in #408
• Added kth_threshold tool by @amallia in #406
• clang-6 & code coverage by @elshize in #409
• Remove optimal_hybrid_index by @elshize in #412
• Use TBB thread local storage by @elshize in #378
• Create docker.yml by @amallia in #413
• Regression experiment documentation by @amallia in #354
• More robust memory mapping by @elshize in #370
• Update progress.hpp by @amallia in #417
• Update badge by @amallia in #414
• Fix variable name and change tests to use MemorySource by @elshize in #420
• Fix BP memory issue by @elshize in #424
• Fix bug of top-k threshold task by @amallia in #426
• Update kth_threshold.cpp by @amallia in #427
• Catch and log NoSuchFile error by @elshize in #428
• Fix lexicon issue in term processor and refactor binary search by @elshize in #434
• Make NoSuchFile inherit from std::exception by @elshize in #436
• AOL query extractor by @amallia in #296
• Taily stats by @elshize in #430
• Update documentation by @elshize in #438
• Fix reading bytes from bit vector by @elshize in #443
• Read collection with lexicon by @elshize in #437
• Use env files in CI by @elshize in #451
• Modify count-postings tool by @elshize in #450
• Return times when extracting taily scores by @elshize in #452
• Enable counting postings by term by @elshize in #453
• Extract maxscores by @elshize in #454
• Explicitly use Ubuntu 18.04 in CI by @elshize in #457
• Fix CI problems by @elshize in #461
• Add CMake options for fPIC by @JMMackenzie in #460
• Make parsing libraries private dependencies by @elshize in #463
• Add inline to free function in header by @elshize in #466
• Add patch for accepting non-trec identifiers from WARC files by @JMMackenzie in #468
• Remove PSTL by @elshize in #472
• Paralelize algorithms by @elshize in #473
• Obey query term weights by @JMMackenzie in #467
• Fix MacOS build by @JMMackenzie in #477
• Move forward index builder implementation to cpp by @elshize in #478
• Use DocId and Score aliases by @elshize in #476
• Fix threshold logic by @JMMackenzie in #429
• Extract invert functions to cpp by @elshize in #479
• Move implementation to cpp files by @elshize in #480
• Separates bit_vector_builder from bit_vector by @elshize in #481
• Throw exception when write fails for block_freq_index by @elshize in #484
• Handle I/O errors with exception by @elshize in #485
• Remove std iterator by @elshize in #487
• Multiply block max score by term weight in cursor (#474) by @elshize in #488
• Move TemporaryDirectory to pisa namespace (#419) by @elshize in #489
• Update GCC version for MacOS build by @elshize in #491
• Whitespace tokenizer by @elshize in #496
• CLI option to configure log level by @elshize in #497
• Improve block codecs by @elshize in #492
• Selecting tokenizer at query time by @elshize in #499
• Implement TextAnalyzer by @elshize in #503
• Custom sift down for binary heap by @elshize in #507
• Fix log of zero by @elshize in #510
• Address Codacy warnings by @elshize in #512
• Rank start from 1 instead of 0 by @amallia in #516
• C++20 Support by @elshize in #513
• Bug fixes by @elshize in #517
• Lib updates by @elshize in #518
• Accumulator concept by @elshize in #519
• Upgrade Google Benchmark to 1.7.1 by @elshize in #520
• Split CI into push, trunk, and PR flows by @elshize in #523
• Use thread local, as opposed to static, lexer by @elshize in #528
• Pass last_level by value by @elshize in #529
• Upgrade to the latest Porter2 version by @elshize in #530
• Remove UB and read-after-buffer in varintgb by @elshize in #531
• Fix TREC run format by @amallia in #522
• Add missing bound check in score_opt_partition by @elshize in #532
• Update test Docker images for Clang by @elshize in #534
• Use rapidcheck to test codecs by @elshize in #535
• oneTBB & other updates by @elshize in #538
• Allow for system Boost installation by @elshize in #540
• Replace boost::variant with std::variant by @elshize in #544
• thread_local Porter2 by @elshize in #542
• Add byte padding to block index after postings by @elshize in #545
• Migrate to mdBook documentation by @elshize in #549
• Fix unaligned read in bitvector by @elshize in #550
• Add Release build to CI on trunk by @elshize in #551
• Upgrade CLI11 to 2.3.2 by @elshize in #546
• Benchmark docker by @elshize in #548
• Update docs about algorithms by @elshize in #552
• Add new line for proper formatting by @pombredanne in #554
• Remove assert from next_geq by @elshize in #555
• Remove configuration.hpp by @elshize in #556
• Update clang-format rules by @elshize in #559
• Add stdc++fs to target_link_libraries by @elshize in #560
• Add metric evaluation to benchmark Docker by @elshize in #564
• Warn about missing terms and removed stopwords by @elshize in #563
• Query refactoring by @elshize in #561
• Source setvars.sh when installing TBB from package by @elshize in #567
• Append sourcing setvars.sh to .bashrc by @elshize in #568

New Contributors

• @pombredanne made their first contribution in #554

Full Changelog: v0.8.2...v0.9.0