First draft of field based pseudonymization (#187)

* First draft of field based pseudonymization * Use valid test FNR's * Add field metadata model 'PseudoMetadata' * Pass keyset information to API if supplied * Run field requests in parallel and store metadata for each response * Update and add tests * Move common mock setup of 'do_pseudonymize_field' to a function * Remove metadata class * Add docs & ypdate processing of response to match changes in pseudo service * Revert "Merge branch 'main' into use-field-endpoint" This reverts commit 70957c7, reversing changes made to 3ab150a. * Revert "Revert "Merge branch 'main' into use-field-endpoint"" This reverts commit 41f9fbe. * Add missing timeout * Update function name * Update API mock response in test_builder_pandas_pseudonymize_minimal_call * Simplify _pseudonymize_field by removing a layer of nesting. * Update cryptography and pygments as recommended by Safety * Fix error in pseudonymize_field_runner doc * Add tests for _post_to_field_endpoint * Strip notebook * Add from_polars method * Fix mypy * Adjust codecov targets --------- Co-authored-by: Anders Lunde <[email protected]> Co-authored-by: Anders Lunde <[email protected]>
statisticsnorway · Aug 16, 2023 · fe71814 · fe71814
1 parent 7f7f57e
commit fe71814
Show file tree

Hide file tree

Showing 10 changed files with 489 additions and 126 deletions.
diff --git a/codecov.yml b/codecov.yml
@@ -3,7 +3,7 @@ coverage:
   status:
     project:
       default:
-        target: "100"
+        target: "90"
     patch:
       default:
-        target: "100"
+        target: "98"
diff --git a/poetry.lock b/poetry.lock
diff --git a/pyproject.toml b/pyproject.toml
@@ -25,9 +25,11 @@ pyhumps = "^3.8.0"
 types-requests = "^2.28.11"
 python-magic = "^0.4.27"
 pylibmagic = "^0.2.2"
-cryptography = "39.0.1"
+cryptography = ">41.0.0"
 dapla-toolbelt = "^1.7.0"
 fsspec = "^2023.5.0"
+polars = "^0.18.2"
+pygments = ">2.15.0"
 
 [tool.poetry.group.dev.dependencies]
 Pygments = ">=2.10.0"