Code

Speed optimizations#17

Code

Closed

vmenger wants to merge 20 commits intomainvmenger/docdeid:mainfrom speed-optimizationsvmenger/docdeid:speed-optimizationsCopy head branch name to clipboard

+432-211

Commits

Commits on Nov 30, 2023

• Rename tokenize module

  vmenger

  committed
  a684463

• Add token index

  vmenger

  committed
  4b02432

Commits on Dec 1, 2023

• Add frozendict dependency

  vmenger

  committed
  6fb99e0

• Speedup annotation sorting

  vmenger

  committed
  a178872

• Speedup regexp annotator

  vmenger

  committed
  2e01493

• Speedup single token annotator

  vmenger

  committed
  903f540

• Fix test

  vmenger

  committed
  949ec06

• Speedup multi token lookup annotator

  vmenger

  committed
  1dae5f3

• Add offset option

  vmenger

  committed
  7e91a06

• Add repr for string processor

  vmenger

  committed
  e66c038

• Move link token logic

  vmenger

  committed
  dde29cb

• Add token lookup logic with matching pipeline

  vmenger

  committed
  ab5cc70

• Update offset to start_i

  vmenger

  committed
  b0c493f

• Update previous and next tests

  vmenger

  committed
  608c3f5

• Update get_words and token_lookup tests

  vmenger

  committed
  3ef03ee

• Formatting

  vmenger

  committed
  79f6190

• Cleanup annotator code

  vmenger

  committed
  eeffb20

• Cleanup tokenizer code

  vmenger

  committed
  280e7a8

• Formatting

  vmenger

  committed
  f4d21ef

• Rename instance var

  vmenger

  committed
  fcc8873