Code

Dev2 jb WIP#1

Code

Open

jbreckman wants to merge 22 commits intoZJONSSON:dev2ZJONSSON/parquetjs:dev2from jbreckman:dev2-jbjbreckman/parquetjs:dev2-jbCopy head branch name to clipboard

+1,965-286

Commits

Commits on Mar 7, 2018

• Path reader somewhat works

  jbreckman

  committed
  a355953

  Copy full SHA for a355953

• Path reader works, beginning to cache

  jbreckman

  committed
  510bfe5

  Copy full SHA for 510bfe5

• Add LRU cache

  jbreckman

  committed
  dfd22ea

  Copy full SHA for dfd22ea

• Remove more goofy half baked caching

  jbreckman

  committed
  6806013

  Copy full SHA for 6806013

Commits on Mar 8, 2018

• Going oldschool. Removed all filters, maps, forEach, asyncs, and awaits

  jbreckman

  committed
  7a0a4d2

  Copy full SHA for 7a0a4d2

• Removed a bunch of async/awaits

  jbreckman

  committed
  c2c7579

  Copy full SHA for c2c7579

• More async removal, higher default concurrency, and more joining of things in the buffered reader

  

  ZJONSSON

  authored and

  jbreckman

  committed
  7065860

  Copy full SHA for 7065860

Commits on Mar 9, 2018

• Temporary solution! Row groups are min-max by string, but pages are min-max by numbers.... This is not ideal

  jbreckman

  committed
  42dd27a

  Copy full SHA for 42dd27a

• Fix bad memoize

  jbreckman

  committed
  f724365

  Copy full SHA for f724365

Commits on Mar 15, 2018

• More fixes

  jbreckman

  committed
  8edc690

  Copy full SHA for 8edc690

Commits on Mar 16, 2018

• Better gitignore

  jbreckman

  committed
  00410ea

  Copy full SHA for 00410ea

• Refactor the shredder to enable a fast materialization of values that should hopefully churn the GC way less

  jbreckman

  committed
  ed9c0c9

  Copy full SHA for ed9c0c9

Commits on Mar 18, 2018

• Path streamer is starting to do a thing

  jbreckman

  committed
  3ae8078

  Copy full SHA for 3ae8078

• Better field loading, plus post script options

  jbreckman

  committed
  2c42652

  Copy full SHA for 2c42652

Commits on Mar 19, 2018

• It works! ish

  jbreckman

  committed
  ac3a16e

  Copy full SHA for ac3a16e

• Concurrency of 1 doesn't do anyone any favors

  jbreckman

  committed
  70fe179

  Copy full SHA for 70fe179

• Fix tests and move to smaller files

  jbreckman

  committed
  739b05f

  Copy full SHA for 739b05f

• Got the LRU working

  jbreckman

  committed
  1309fa3

  Copy full SHA for 1309fa3

• Add index and offset priming options

  jbreckman

  committed
  9c3c0fe

  Copy full SHA for 9c3c0fe

• Remove 'search'

  jbreckman

  committed
  4ada2d8

  Copy full SHA for 4ada2d8

• Add "in" clause support

  jbreckman

  committed
  e68157a

  Copy full SHA for e68157a

Commits on Mar 20, 2018

• Bloom filter stab

  jbreckman

  committed
  e71abc5

  Copy full SHA for e71abc5