Skip to content

Releases: fiboa/cli

v0.7.0

24 Aug 18:52
Compare
Choose a tag to compare

Added

  • Converter for Luís Eduardo Magalhães (LEM) and other municipalities in the west of Bahia state, Brazil (br_ba_lem)
  • Converter for Denmark (dk)
  • Additional converters for EuroCrops datasets: ec_be_vlg, ec_nl_crop
  • New parameter --geoparquet1 to generate GeoParquet 1.0 without bbox column instead of GeoParquet 1.1 with bbox column

Changed

  • CLI creates GeoParquet 1.1 with bbox column by default
  • The function signature in the convert function of the converters has changed to a simpler more future-proof variant.
  • The EuroCrops converters extend the original converters

Fixed

  • fiboa convert: Create output folder if it doesn't exist
  • Strip whitespaces/newlines from created STAC collections
  • fiboa create-geojson: Don't write FeatureCollections to folder if a filename is given

v0.6.0

25 Jul 15:01
Compare
Choose a tag to compare

Added

  • Added a SHORT_NAME variable to the converter template
  • Added a FILE_MIGRATION variable to the converter template for per-file migrations
  • Added a LAYER_FILTER variable to the converter template for loading specific layers from a file
  • Added -i parameter to specify input files for converters
  • fiboa converters output can be customized with options -p, -s and -v.
  • fiboa convert reads JSON file with custom logic, which allows to access nested objects through dot notation
  • Converter for Slovenia via EuroCrops (ec_lv)
  • Converter for Planet's Automated Field Boundary (planet_afb)
  • Converter for Portugal (pt)
  • Converter for DigiFarm (digifarm)
  • Converter for AI4SmallFarms in Cambodia and Vietnam (ai4sf)
  • Further tests

Changed

  • The BBOX is optional in the converter template as it will be computed automatically from the data.
  • The PROVIDER_NAME and PROVIDER_URL variables in the converter template were replaced by PROVIDERS
  • fiboa converters is more readable by default
  • Upgraded to geopandas 1.0.0, which migrates from fiona to pyogrio for data loading
  • The EuroCrops converters (prefix: ec_) use the HCAT fiboa extension

Fixed

  • Fixed schema issue for the tk10 column in de_bb converter
  • jsonschema library doesn't warn against external references any longer

v0.5.0

17 Jun 13:53
Compare
Choose a tag to compare

Added

  • Basic support for patternProperties in GeoParquet creation
  • The converter template accepts multiple input URLs
  • Added parameter to explode multipolygons to polygons (explode_multipolygon, default: False)
  • Converter for Belgium, Flanders (be_vlg)
  • Converter for Belgium, Wallonia (be_wa)
  • Converter for Finland (fi)
  • Converter for France (fr)
  • Converter for The Netherlands (nl and nl_crops)
  • Converter for Slovenia via EuroCrops (ec_si)

Changed

  • The --cache option for the convert command asks for a folder instead of a file
  • The cache_file parameter in converters has been renamed to cache (requires changes in the converter templates)
  • The converter template allows for more detailed source information
  • The URI constant in the template was renamed to SOURCES (requires changes in the converter templates)

Fixed

  • Extensions were not correctly displayed in describe and validate command
  • Fixed regular expressions for email and uuid in data validation

v0.4.0

09 May 22:15
Compare
Choose a tag to compare

Added

  • Converter for EuroCrops France dataset
  • fiboa create-geojson: Show conversion progress
  • fiboa jsonschema and fiboa validate: Support geometryTypes for geometry data type in GeoJSON
  • fiboa validate:
    • Basic validation for objects, geometries and bounding boxes in GeoParquet files

Fixed

  • fiboa validate-schema: The -m option is applied correctly if $schema is present in schema
  • fiboa validate and fiboa validate-schema: Don't stop validation after the first file.
  • fiboa validate:
    • Is more robust against invalid collections and doesn't abort if not needed
    • Check NULL values correctly in case of arrays
    • Throw an error if no files were provided
  • fiboa create-geojson:
    • Handles GeoParquet bbox correctly
    • Converts numpy arrays
    • Doesn't export empty collections
  • Fix recursive import

v0.3.10

06 May 14:47
Compare
Choose a tag to compare

Added

  • fiboa convert:
    • Added step that allows to set constant values (ADD_COLUMNS)
    • Support for reading GeoParquet files
    • Help lists all available converters
  • fiboa converters: More detailed list of available converters/datasets

Changed

  • fiboa convert:
    • determination_datetime is not required any longer
    • Default compression changed from brotli to zstd

v0.3.9

01 May 21:43
Compare
Choose a tag to compare

Fixed

  • JSON Schema and GeoJSON validation also errors when the data doesn't comply to the given formats

v0.3.8

27 Apr 20:20
Compare
Choose a tag to compare

Added

  • Converter for Thuringia, Germany (de_th)

Fixed

  • Fixed GeoJSON to GeoParquet conversion of the date data type

v0.3.7

25 Apr 15:45
Compare
Choose a tag to compare

Fixed

  • Small fixes in CLI output and docs

v0.3.6

24 Apr 11:26
Compare
Choose a tag to compare

Added

  • fiboa describe: New parameters --column and --num

Changed

  • fiboa create-geoparquet: Allow collection creation based on parameters and define clear priority of collection inputs

Fixed

  • fiboa describe: Show all columns / don't hide data with ...
  • fiboa validate: Warn more clearly if no schema is defined for a column

v0.3.5

22 Apr 21:49
Compare
Choose a tag to compare

Added

  • Converters: Allow to filter rows with pandas Series operations easily

Fixed

  • Support converting to array data type