Code

scale-up#103

Code

Open

galsalomon66 wants to merge 7 commits intomasterceph/s3select:masterfrom scaleupceph/s3select:scaleupCopy head branch name to clipboard

+921-109

Commits

Commits on Sep 4, 2022

• adding capability to execute the same query across different input-stream(CSV in this case), and to merge results of each of the streams and return it to caller as a single one. the different execu…

  Show description for b646492
  galsalomon66

  committed
  b646492

  Copy full SHA for b646492

• oops

  Show description for 32ff728
  galsalomon66

  committed
  32ff728

  Copy full SHA for 32ff728

Commits on Sep 5, 2022

• adding the aggregation flow for scale-up processing. each aggregation node (sum,max ...) has 2 state to handle, first-phase(processing query), second-phase(aggregate results of all participants).

  Show description for 3bbc699
  galsalomon66

  committed
  3bbc699

  Copy full SHA for 3bbc699

• adding csv_streamer to enable the processing of a single query on multiple execution flows for aggregation and non aggregation flow. bug fixes.

  Show description for 3c436b6
  galsalomon66

  committed
  3c436b6

  Copy full SHA for 3c436b6

• bug fix. add pthread to scaleup app

  Show description for 0919c34
  galsalomon66

  committed
  0919c34

  Copy full SHA for 0919c34

• adding spiliting functionality. i.e. spliting an input into equal parts to be processed simultaneously

  Show description for 0fc3e73
  galsalomon66

  committed
  0fc3e73

  Copy full SHA for 0fc3e73

• rebase. adding json flow

  Show description for 974593d
  galsalomon66

  committed
  974593d

  Copy full SHA for 974593d