Code

Rust compaction#1360

Code

Merged

patchwork01 merged 170 commits intodevelopgchq/sleeper:developfrom 1359-accelerated-compaction-supportgchq/sleeper:1359-accelerated-compaction-supportCopy head branch name to clipboardJul 12, 2024

+10,551-91

Commits

Commits on Sep 22, 2023

• Rust compaction update

  m09526

  committed
  9409fea

• Update NOTICES

  m09526

  committed
  5bd6c73

Commits on Oct 6, 2023

• Merge branch 'main' into 1359-accelerated-compaction-support

  m09526

  committed
  f0fe466

• Update code to remove min/max key

  m09526

  committed
  85175d0

• Remove unused imports

  m09526

  committed
  1305497

• Better logging and no code rebuilding

  m09526

  committed
  6479ddb

• Update error code

  m09526

  committed
  9db8ad4

• Update error code

  m09526

  committed
  e65bde8

• Add debug

  m09526

  committed
  110af1e

Commits on Oct 10, 2023

• Log from app

  m09526

  committed
  f79f106

• More debug

  m09526

  committed
  bcfaa17

• Even more debug

  m09526

  committed
  388fd75

• Put parameters back

  m09526

  committed
  3c33deb

• Fix double comma

  m09526

  committed
  67a69e9

Commits on Oct 13, 2023

• Removed debug and fixed bug

  m09526

  committed
  c99633e

Commits on Oct 25, 2023

• Less schema code

  m09526

  committed
  33474a7

• Merge branch 'main' into 1359-accelerated-compaction-support

  m09526

  committed
  7e69c4c

Commits on Nov 1, 2023

• Merge branch 'main' into 1359-accelerated-compaction-support

  m09526

  committed
  ff509f0

• Rust code fix

  m09526

  committed
  7802bc5

• Logging for object store

  m09526

  committed
  c771fbe

Commits on Nov 2, 2023

• Better cache implementation

  m09526

  committed
  c163d09

• Better cache implementation

  m09526

  committed
  65d24a0

Commits on Nov 3, 2023

• Merge branch 'main' into 1359-accelerated-compaction-support

  m09526

  committed
  f210e0b

Commits on Nov 6, 2023

• version bump

  m09526

  committed
  433cf65

Commits on Nov 10, 2023

• Merge branch 'main' into 1359-accelerated-compaction-support

  m09526

  committed
  8c18253

Commits on Feb 5, 2024

• Remove Cargo lock from ignore

  m09526

  committed
  5b66c94

• Add cargo lcok

  m09526

  committed
  1407536

Commits on Apr 16, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  9f78ca5

• First update of some versions

  m09526

  committed
  f3e9759

• Update sketches library

  m09526

  committed
  175e944

• Remove rust compiler errors

  m09526

  committed
  df19ed6

• Minor improvement

  m09526

  committed
  6b37336

Commits on Apr 17, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  23cf179

Commits on Apr 18, 2024

• Updated struct for Java bridge

  m09526

  committed
  4e848cb

• WIP refactor compaction

  m09526

  committed
  d19bfa3

Commits on Apr 19, 2024

• Refactor Java compaction

  m09526

  committed
  c16fc6a

• Tests fixed

  m09526

  committed
  39f28c4

• Class added

  m09526

  committed
  93fa066

• Modified for checkstyle

  m09526

  committed
  aa0d717

• Refactor for method selection

  m09526

  committed
  2cf2967

• Checkstyle fixes

  m09526

  committed
  ec89df4

• More checkstyle

  m09526

  committed
  a1d7236

• Update SSL fix for cross compilation

  m09526

  committed
  833ddd4

• Better validation

  m09526

  committed
  2e664dd

Commits on Apr 22, 2024

• Finished FFI bridge

  m09526

  committed
  6174029

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  690ddd6

• Checkstyle modifications

  m09526

  committed
  28d14e2

• Most bridging code complete

  m09526

  committed
  93ed49c

• Bridge complete

  m09526

  committed
  79add9e

Commits on Apr 23, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  d847bec

• Rust side of bridge done

  m09526

  committed
  b600cda

• Clippy warnings

  m09526

  committed
  237b9ac

• Remove old code

  m09526

  committed
  69aaf11

• License changes

  m09526

  committed
  b1f76dd

• DataFusion skeleton ready

  m09526

  committed
  33ce895

• WIP datafusion code

  m09526

  committed
  8e9595c

Commits on Apr 24, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  c6215a4

• DataFusion done

  m09526

  committed
  d21eb19

• clippy warnings

  m09526

  committed
  f4ac9be

• Compaction links up

  m09526

  committed
  4cf2ffc

• Partitions work

  m09526

  committed
  e55e8f7

Commits on Apr 25, 2024

• better region coding

  m09526

  committed
  72922e8

Commits on Apr 26, 2024

• Tidied some comments and test behaviour

  m09526

  committed
  43a40f6

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  0df2eff

• compiles with sketches

  m09526

  committed
  e06240d

• Clippy warnings

  m09526

  committed
  c36c4d3

• Sketches work

  m09526

  committed
  7d84edc

Commits on Apr 29, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  7813c22

Commits on Apr 30, 2024

• Fixed log messages

  m09526

  committed
  6484759

• Null upper bounds now supported

  m09526

  committed
  8196b0f

• Update name of UDF

  m09526

  committed
  c022773

• Some changes in preparation for memory limiting

  m09526

  committed
  c8f7582

• Write CPU numbers out

  m09526

  committed
  82118d7

Commits on May 2, 2024

• Memory limit expr.

  m09526

  committed
  13fc821

• Remove memory management code

  m09526

  committed
  1e6e974

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  fbc82f7

• Fix

  m09526

  committed
  9974ce7

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  d02c6ca

Commits on May 3, 2024

• Refactor

  m09526

  committed
  41b4d6a

• Minor improvements to DF

  m09526

  committed
  3d7f3b3

• Deadlock removed

  m09526

  committed
  b1565ea

• Typo

  m09526

  committed
  c3c72e6

• Formatting

  m09526

  committed
  19cc6c5

• Uppercase selection

  m09526

  committed
  3996446

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  9594d42

Commits on May 8, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  eb72387

• Moved

  m09526

  committed
  f1a511e

• Checkstyle

  m09526

  committed
  18c8b66

Commits on May 10, 2024

• Merge develop

  m09526

  committed
  a28df4a

• Add

  m09526

  committed
  82e052b

Commits on May 13, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  8f9b4ec

• Merge fixes

  m09526

  committed
  1a82e0b

• Compiler error fix

  m09526

  committed
  d490a50

• Checkstyle check

  m09526

  committed
  4419140

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  368cae6

• versions update

  m09526

  committed
  754e490

• Read row counts from physical plan

  m09526

  committed
  b1cf1f2

• Cliipy warnings removed

  m09526

  committed
  e08de8f

• Cliipy warnings removed

  m09526

  committed
  91e3ec5

• refactor

  m09526

  committed
  e153c70

Commits on May 14, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  c3ab87c

Commits on May 15, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  7f459c2

• Spot bug fix

  m09526

  committed
  82f1e3e

• SQL and aggregation check. Not sorting correctly!

  m09526

  committed
  747c415

Commits on May 16, 2024

• DF test

  m09526

  committed
  fd16a3c

• update

  m09526

  committed
  cfe2475

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  f1b48f4

• Sort bug fixed

  m09526

  committed
  50521ad

Commits on May 17, 2024

• Remove sql

  m09526

  committed
  3475175

• Standard compact

  m09526

  committed
  7ea6214

• Rust aggregation

  m09526

  committed
  2036f21

• Add simple hack to make Java double compaction workload

  m09526

  committed
  3ffa5c0

• Fix bug for not implementing iterators

  m09526

  committed
  9b919a6

Commits on May 21, 2024

• Remove aggregation

  m09526

  committed
  e26b094

Commits on May 23, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  0e0ec1a

Commits on May 28, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  ddfb999

Commits on May 31, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  d52b354

Commits on Jun 3, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  20dd5ea

Commits on Jun 4, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  b6e53f8

• Update Rust compaction pom

  m09526

  committed
  c154690

Commits on Jun 5, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  718e3bf

Commits on Jun 6, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  b2d22a1

• Checkstyle fixes

  m09526

  committed
  4a349d1

• Fix chunk build error

  m09526

  committed
  688a128

• Added packages to ensure Rust builds inside nix shell

  m09526

  committed
  86834db

Commits on Jun 7, 2024

• Add cross to chunk.yaml

  m09526

  committed
  34bcc15

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  7dff8c3

• Add to full maven build workflow

  m09526

  committed
  f4069cd

Commits on Jun 10, 2024

• Add Rust plugins

  m09526

  committed
  3b9bbd5

Commits on Jun 11, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  fb447f4

• Enable Rust and Cross in dependency check

  m09526

  committed
  8426154

• Re-generate template properties

  m09526

  committed
  d6f4866

• Fix dependency docker

  m09526

  committed
  2890799

• Add Rust to docker image build Action

  m09526

  committed
  a280a96

• Refactor to deal with configuration object in defaultselector

  m09526

  committed
  b7773a1

• Fix message in templates

  m09526

  committed
  8b14a5d

Commits on Jun 12, 2024

• Try deleting some things to save space

  m09526

  committed
  6c2fe01

• Update year

  m09526

  committed
  c8cd0f3

• Update year

  m09526

  committed
  57fe8e7

Commits on Jun 13, 2024

• Change check order for readability

  m09526

  committed
  a9996de

Commits on Jun 24, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  64018a4

Commits on Jun 26, 2024

• Code review changes

  m09526

  committed
  efd1d8c

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  666b8a8

• SkipRust on compile

  m09526

  committed
  526b3e8

• Lock Rustc version

  m09526

  committed
  4813dbf

• Update crate

  m09526

  committed
  f94576b

Commits on Jun 27, 2024

• Fix nullable column bug

  m09526

  committed
  0cba565

• Logging added to multipart upload

  m09526

  committed
  2b6f7be

Commits on Jun 28, 2024

• Fixed schema bug

  m09526

  committed
  1b026a1

Commits on Jul 1, 2024

• Merge remote-tracking branch 'origin/develop' into 1359-accelerated-compaction-support

  patchwork01

  committed
  b811312

• Better schema handling and multipart upload shim

  m09526

  committed
  a3e1379

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  9ba0bcb

• Fix a typo

  m09526

  committed
  1311690

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  8b5abcc

• Variable names and remove un-needed qualifier

  m09526

  committed
  1d0e15b

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  3afd1d1

Commits on Jul 2, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  authored
  2b0816a

• Adaptable multipart sizes

  m09526

  committed
  29ad329

• Merge branch '1359-accelerated-compaction-support' of github-m09526:gchq/sleeper into 1359-accelerated-compaction-support

  m09526

  committed
  b3a595c

• Output store should be set

  m09526

  committed
  f08d8d4

Commits on Jul 3, 2024

• Extra memory protection

  m09526

  committed
  c8e40bf

• Remove memory constraint

  m09526

  committed
  4c92f60

Commits on Jul 8, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  b7e2438

Commits on Jul 9, 2024

• Merge branch 'develop' into 1359-accelerated-compaction-support

  m09526

  committed
  a57a5ad

Commits on Jul 10, 2024

• Some code review changes

  m09526

  committed
  de0514c

Commits on Jul 11, 2024

• Merge remote-tracking branch 'origin/develop' into 1359-accelerated-compaction-support

  patchwork01

  committed
  0e0905d

• Remove Rust from GitHub workflows that don't currently use it

  patchwork01

  committed
  861d92d

• Move Rust install to builder Docker image

  patchwork01

  committed
  8226547

• Skip Rust in dependency check workflow

  patchwork01

  committed
  c46f109

• Skip Rust in chunk.yaml test step

  patchwork01

  committed
  217b214