Skip to content

Latest commit

 

History

History
489 lines (399 loc) · 22.5 KB

RELEASES.md

File metadata and controls

489 lines (399 loc) · 22.5 KB
Raw

See also GitHub releases https://github.com/lucmoreau/ProvToolbox/releases

2.2.2-SNAPSHOT

2.2.1

  • service-metrics: a service to gather metrics on provenance, using MetricsCalculator.java
  • prov-typemap: incremental construction of type map
  • service-metrics: report and plot
  • prov-model: fixed issue in anonymous collection construction in IndexedDocument
  • prov-model: rules: traffic light for triangles
  • prov-service-core: generic url processing, generating document or document resource.
  • prov-service-core: generic file processing, generating document or document resource.
  • prov-service-core: generic statement processing, generating document or document resource.
  • service-metrics: added validation report
  • service-metrics: added traffic lights
  • service-metrics: computing composite traffic lights
  • service-metrics: rating report
  • prov-template-compiler: generated code for jsweet/jsweet.sh to ensure compatibility with latest jdk
  • service-metrics: added signature to metrics
  • validator: fixed issue with namespaces declaration in validation report
  • service-metrics: inserting (instead of overriding) type maps to maintain full history
  • service-metrics: type rating: traffic light for (lack of) attribution
  • service-metrics: type rating: traffic light for derivation length
  • service-metrics: added weight to traffic lights

2.2.0

  • docker-service-templates: deployed dictionary for explanations, build for intel and arm platforms
  • provman: testing ptm explanations from command line
  • plead-composite-responsibility explanation with aggregate
  • prov-sparql-query: small utility, based on Jena, to run sparql queries on prov-jsonld
  • prov-query: changed syntax of SET aggregator
  • prov-dot: added annotation to qualified relations (requires displayAnnotations to be true)
  • prov-jsonld: compatibility with prov-jsonld w3c member submission. As a result, this version will not be able to read previously saved prov-jsonld.

2.1.1

  • prov-template-compiler: getRelations method for encoding of template relations
  • service-templates: generation of sql for template relations
  • service-templates: asynchronous generation of sql for template relations
  • nlg-spec-transformer: better support for pre/post modifiers
  • service-templates: preliminary explanations for templates
  • prov-query: left join support
  • nlg-spec-transformer: support for optional statements returned by left join

2.1.0

  • service-template: returning hash code and location of submitted record
  • service-template: verifying hash from the command line
  • prov-dot: allows for dot:style to be specified
  • service-templates: navigation tab: prov and entities
  • prov-toolbox-js-embedding: support for js builder
  • module-info introduced for all modules up to toolbox (and prov-toolbox-polyglot)

2.0.8

  • module-tools: prov-template-archetype and prov-toolbox-plugin
  • prov-template-compiler: record index with principal
  • service-template: simple and composite queries with access control
  • service-template: queries with access control, incl browsing and navigation
  • service-template: hash of record, post-processing of record
  • service-template: browsing tab, with links to hash of record and template
  • prov-template-compiler: fixed issue with composite, post processing
  • service-template: hash for composite records
  • service-template: record browser tab now listing composites

2.0.7

  • prov-jsonld: fixed context url
  • prov-model: builder for bundles
  • prov-template-compiler: generating outstanding sql methods and tables
  • prov-template-archetype: work in progress

2.0.6

  • prov-template-compiler: introduced sqlify for a few more keywords
  • prov-template-compiler: fixed json schema generation for float/double
  • prov-template-library: updated plead templates to support sql backend, with ID being keys
  • service-templates: deployment of prov-template-library as a service
  • service-templates: submission of csv with json results and reconstructed csv_log
  • service-templates: visualising prov for a template instantiation
  • service-templates: plead workflow, run locally and remotely
  • service-templates: extracting provenance of a workflow run
  • prov-template-library: added composite template plead_transforming_composite
  • prov-template-compiler: documentation for composite templates
  • prov-template-compiler: forms for composite templates (work in progress)
  • prov-template-compiler: composite templates conversion to csv
  • service-templates: form interface to support composite templates (csv or json)
  • service-templates: composite templates are persisted as record linking to composed instances
  • service-templates: provenance generation for composite templates
  • prov-template-compiler: generation of insert_plead_transforming_composite_composite_and_linker sql method
  • prov-template-compiler: search records function
  • service-templates: search records functionality
  • service-templates: browser tab
  • service-templates: navigation between templates
  • service-templates: recursive traversal query
  • service-templates: navigation tab
  • prov-template-compiler: getting level0 types for template variables
  • service-templates: displaying level0 types colours for template variables
  • service-templates: viewing template instance value by property
  • service-templates: browsing template tab
  • prov-template-compiler: sql generation for retrieving record for base_relation(id)
  • prov plugin for maven
  • service-templates: security configuration, oidc and keycloak
  • docker-service-templates: dockerisation of service-templates
  • service-templates: security configuration file
  • prov-toolbox-plugin: a maven plugin to wrap up provconvert and other utilities
  • prov-template: a schema for bindings files (and maven plugin)
  • prov-toolbox-plugin: a maven plugins to validate bindings and process templates
  • prov-template: refined definition of template transformation file and defined schema for it
  • prov-template-compiler: JSON schema for template project and goal validate-template-project in prov-toolbox-plugin
  • prov-template-compiler: input/output info in template documentation
  • prov-template-compiler: refactored invocation of jsweet, conditional on presence of jdk12
  • prov-model: provenance statistics
  • prov-model: fixed issue with IndexedDocument (and named relations)
  • service-translator and prov-service-translator: metrics for provenance
  • prov-template: updated mongo storage to Bindings, replacing deprecated BindingsBean
  • prov-storage-mongodb: updated mongo storage to Bindings, replacing deprecated BindingsBean
  • service-translator, service-templates: introduced storage configuration file
  • prov-storage-mongodb, prov-jsonld: fixed issue with handling of bundle Id and date options
  • docker-service-templates: a secure docker image for templates service
  • prov-template-archetype: skeleton
  • prov-jsonld: fixed incompatibility issues with jsonld1.1
  • prov-service-security-pac: created sub-module
  • prov-dot: displays qualification patterns
  • prov-model: extension of builder to support book example

2.0.5

  • prov-template-library: cleaned up pom.xml
  • prov-template-compiler: allowing for @sql.type in NameDescriptor
  • provtoolbox compiles with jdk 21 and 22, but requires jdk12 for jsweet

2.0.4

  • prov-explanations: restructured explanation system, introduced interfaces separating components
  • prov-query: refactored the query engine
  • prov-model: removed dependency on ObjectFactory, included classes for Dictionary
  • prov-model: added builder for prov model
  • provman: refactored commandline
  • prov-template: support for variables in property names
  • prov-template-library: first templates: generic and plead mlpipeline
  • prov-template-library: support for variables in property names
  • prov-template-library: templates fork, join, transform, collection-extension,
  • prov-template-library: support for ops/plead templates
  • prov-dot: display of prov:location property
  • prov-query: aggegate count function
  • prov-json: fixed issue #217, no longer serializing/experting _ prefix
  • prov-template-compiler: dynamic loading of InteropFramework to avoid compile-time dependency in generated code.
  • prov-template-library: generating provenance of expanded templates
  • provapi service: exposing prov-template-library and provenance
  • prov-template-library: template binaryop, templaes pokemon-go simulator
  • prov-template-library: initial compilation to python
  • prov-template-library: python assembly

2.0.3

  • issue #209:

    • fixing issue with timezone information preservation
    • ability to control timezone information from provconvert
    • ability to control timezone information from a web service client

  • issue #210:

    • provx (de)serialization namespace issue
    • refining test suite
    • default namespace support and testing

  • refactoring of InteropFramework with

    • readDocument methods
    • writeDocument methods

  • further refactoring

  • provapi configuration information /provapi/configuration

2.0.2

  • summarisation code
  • type library code
  • summarisation demonstrator service
  • upgrade of scala code to scala library 2.13
  • explanations code imported
  • provman code imported

2.0.1

  • validator code (satisfied w3c interoperability tests)
  • validator service
  • updated docker container

2.0.0

  • made the vanilla beans (in org.openprovenance.prov.vanilla) the default implementation of the prov data model (org.openprovenance.prov.model) instead of the xml-oriented beans
  • dropped prov-xml, as it relied on jaxb, which is not supported in Java 11
  • dropped prov-sql, as it relied on jaxb, and was never properly tested. Is also totally supersed by the sql support through the prov-template-compiler
  • dropped prov-json which was based on the Gson library
  • dropped prov-rdf which was based on the Sesame library, which introduced many dependencies.
  • use of jackson to serialize vanilla beans to prov-json, prov-jsonld, prov-xml.
  • core modules consists of:
    • prov-model: vanilla beans, interfaces, and core factory functionality
    • prov-jsonld with support for serialisations to prov-jsonld, prov-json
    • prov-jsonld-xml with support for serialisations to prov-xml (using jackson, and some custom code)
    • prov-n with support for serialisations to prov-n
    • prov-model-scala consisting of an alternate implementation of the prov data model in scala, and serialization of prov-jsonld
  • prov-dot
    • refactoring, and dropped lots of (unused) configuration options dating back from the OPM time (13 years old)
  • prov-template
    • using the json representation of bindings as the sole representation for user
    • dropping the prov representation of bindings
    • refactored testing
  • tutorials upgraded to support the above
    • tutorial4: uses json representation for bindings
  • service-translator upgraded to Jakarta EE (servlet5)
    • solved recurring dependency conficts
    • jetty using web-jar target, with webapp.filtering
    • upgraded webjar dependencies, html filtered according to versions in pom.xml
  • docker image with tomcat 10 and docker compose

1.0.0

  • Bumped up versions for many dependencies
  • Final distribution of ProvToolbox with all its modules
  • No intention to keep on maintaining all these modules as some are outdated and not properly tested.
  • Future development will be on 2.0.0 ....

0.9.25 to 0.9.31

  • prov-template-compiler: mostly bug fixes and minor improvement
  • fix a few issues in tracker

0.9.25

  • prov-template-compiler: allow for instance data to be gathered with provenance types (idata field in structured representation)

0.9.24

  • prov-template-compiler: refactored type propagation
  • prov-template-compiler: fixed issue with relation indexing (no transitive closure)

0.9.23

  • prov-template-compiler: added type numbers to structured type description
  • prov-template-compiler: allowing for relation filtering when computing provenance types

0.9.22

  • prov-template-compiler: structured provenance types

0.9.21

  • prov-template-compiler: avoid emitting code for tmpl:activity attribute
  • upgraded to log4j 2.17.1

0.9.20

  • prov-template-compiler: allow for collections of level0 application specific types

0.9.19

  • further upgrade to log4j 2.17.0 (following log4shell vulnerability)
  • prov-template-compiler: allows for level0 type to be added to all levels (option -addLevel0)
  • prov-tempalte-compiler: allows for domain specific types to be added from properties (option -propertyConverters)

0.9.18

  • further upgrade to log4j 2.16.0 (following log4shell vulnerability)
  • prov-template-compiler: -levelNumber option to determine type inference level
  • prov-template-compiler: traversal of further relations (specialization and membership)

0.9.17

  • upgraded to log4j 2.15.0 (following log4shell vulnerability)
  • prov-template-compiler: support for type inference (variation of provenance kernel approach for templates)

0.9.16

  • prov-n: support for qualified specialization/alternate/membership in prov-n parser with provext: namespace prefix
  • prov-template-compiler: conditional link tmpl:if='var:xxx' (support for hadMember)
  • prov-template-compiler: fixed script generation (class path definition)
  • removed dependency CamelCase (apache common text instead of google guava, as it was already present)

0.9.15

  • support for qualified specialization/alternate/membership in prov-json
  • prov-template-compiler: conditional link tmpl:if='var:xxx' (currently for invalidation only)

0.9.5

  • TODO: changelog

0.9.4

  • TODO: changelog

0.9.3

  • TODO: changelog

0.9.2

  • multi-threading issue with jedis

0.9.1

  • prov-model now contains a vanilla implementation of prov interfaces
  • new serialization (using jackson) to prov-json, prov-jsonld, prov-xml
  • prov-model-scala: alternate implementation of the prov data model in scala
  • refactoring of translator/template expansion service
  • storage component (used by service) to store prov documents in filesystem or mongodb
  • indexing of documents: in memory or using redis

0.8.0

  • port to JDK 12
  • restructuring of prov-template
  • preliminary compiler of template to java code
  • fixed some javadoc comments
  • prov-json: closing buffers when reading files
  • prov-xml: changed QualifiedNameUtils instance to be statically declared in QualifiedName
  • prov-n, prov-xml, prov-json: Escaping in qualified names: a couple of corner cases handled, and in particular, after gaining a better understanding of qualified name in prov-json
  • prov-n, prov-xml, prov-json: Escaping in strings.

0.7.3

  • prov-model: in extension namespace, support for Qualified versions of alternate, specialization, membership, to allow summariser to annotate these relations with weight information. Serialization to xml and provn is work in progress, not supported in prov-json and prov-sql yet. No parsing yet.
  • prov-template: support for JSON bindings, bindings bean generator, new tutorials partial template extension. Support functionality in paper submission.
  • bug fixes ** #149: dependency update ** printing to html

0.7.2

  • prov-json: fixed prov:InternationalizedString and refactoring
  • test suite generation for SSI interoperability harness
  • fixed bug with rdf:XMLLiteral
  • prov-template: option to filter out statements in which (non-attributes) variables have not been expanded
  • prov-template: added return code for unexpanded variables (when using -allpanded option)
  • changed name of artifact: toolbox -> provconvert
  • installer for provconvert on macosx

0.7.1

  • Debian package .deb binary release
  • prov-dot: update of visualization to support summaries size of nodes/edges
  • prov-dot: updated provtoolbox namespace
  • prov-xml: updated sql persistence, xml local name encoding

0.7.0

  • comparator function exposed in provconvert
  • better support for syntax checking of qualified names and QNames
  • made the xsd schema URI as known by RDF (with a hash) the default namespace
  • tests for unicode and internationalization
  • prov-dot: support for visualization of some prov attributes
  • provconvert -compare and -outcompare options
  • fixed issues with prov:QUALIFIED_NAME, and remove QNames except for xml import/export
  • tutorial 4
  • bug fixes ** prov:InternationalizedString #133 ** incorrect prefix declaration in export #132 ** parsing relative uris with input stream in ttl #122 ** prov-n qualified names written as "ex:foo" %% prov:QUALIFIED_NAME #109 ** warning for prov:label non-string value #104 ** escaping of characters in Qualifed Names and QNames #120 ** visualisation of prov:value #71 ** conversion to dot #67

0.6.2

  • tutorial2 and tutorial3
  • toolbox: provconvert -version option now showing version!
  • toolbox: provconvert now supports merging (and optional flattening) of multiple documents, with options -merge (and -flatten)
  • toolbox: provconvert use - as a filename to use unix-style stdio (use in conjunction with specifying format)
  • toolbox: provconvert option to specify format of input/output files without relying on extension
  • toolbox: provconvert supports indexing and flattening of Document (options: -index -flatten)
  • toolbox: now rpm generation
  • toolbox: provconvert now supports conversion to png,jpeg,pdf
  • toolbox: provconvert -formats reports supported formats
  • prov-model: introduced IndexedDocument as a mechanism to index the content of a document (testing in prov-xml)
  • prov-n: issue #112: adding newline at the end of provn file.
  • prov-dot: misc bug fixing in ProvToDot and minor improvements
  • prov-json: fixed bug in json parser for bundle id and namespaces
  • prov-template: properly computes transitive closure for link relation
  • prov-template: test for tmpl:time, etc
  • prov-template: by default, prov-template no longer adds tmpl:order attributes in expanded document. Introduced -genorder option in provconvert
  • prov-xml: introduced non-standard convention to serialize local names starting with digit tmpl:2dvalue -> tmpl:_2dvalue
  • refreshed some maven dependencies

0.6.1

  • support for maven central (Sonatype OSS)
  • updated tutorial (removed repository declaration)
  • removed dependency on jaxb2_common
  • renamed NamedBundle to Bundle (fairly unused Bundle was renamed to BundleEntity)

0.6.0

  • First tutorial
  • Fixed collection of issues #61, #86, #88, #89, #90, #91, #94, #95, 96, #99, #101.
  • Cleaned up dependency management
  • Embedded jvnet.Equals/ToString interfaces and implementation in prov-xml to avoid nasty artifact class.
  • Fixed a bug with xsd namespace when parsing rdf.
  • Made sure exceptions in Interop Framework were properly chained.
  • Integrated Jamal's random generator code. Can be called from command line with -generator option
  • First version of prov-template
  • Support for interoperability across representation: cfr writeDocument, readDocument, and content negotiation support in prov-convert
  • Extensive work on prov-sql, in particular roundtrip testing
  • Testing through validator and translator at https://provenance.ecs.soton.ac.uk/validator/

0.5.0

  • Continued refactorization of Beans ** Introduced class QualifiedName ** All beans in prov-model now refer to QualifiedName (no reference to IDRef anymore)
  • New "visitor" interface StatementAction (and StatementActionValue) replacing RecordAction( and Record Value)
  • Chaining of Namespace objects to support nesting of bundle inside document
  • Reimplemented utility getter/setter without reflection. Moved them to prov-model
  • Replaced old 'visitor' interface (RecordAction) by new one (StatementAction)
  • prov-n/prov-json/prov-rdf/prov-dot depend only of prov-model
  • Documentation: see http://openprovenance.org/java/site/0_5_0/apidocs/
  • Systematic Testing of Keys in dictionary insertions
  • Updated JSON Schema (thanks Dong!) to support compact version of dictionaries

0.4.0

  • Extensive refactorization of Beans ** moved away from default jaxb serialization of attributes since it didn't handle qnames properly. Custom serializer used instead. ** Introduced explicit classes for all attributes Location, Role, Value, Type, Other ** Changed the beans to handle serializations of attributes: it now relies on a sorted list of all attributes. ** extensive testing of attributes ** support for rdf 1.1 data types ** beans no longer generated automatically ** removed getAny() replaced by getOther() ** Defined method getKind on all beans

  • Bug fixes ** Support for multi-line strings in provn ** issue #82 ** issue #83 ** issue #81

  • Namespace management ** Introduced Namespace class for management of namespaces ** Defined function to collect all namespaces (and associated prefixes) in a document

  • Introduced a class DOMProcessing grouping all dom-related processing

  • Defined enumerated type for all types of statements

  • Defined new interface StatementAction to define statement specific processing. Classes implementing this interfaces can be used by ProvUtilities to operate on any statement.

  • prov-sql (preliminary release) ** Added prov-sql package, an ORM mapping generated by JAXB. ** Currently, no support for dictionary, and extensions. ** Feedback welcome on the SQL Schema and mapping.

0.3.0

  • significant refactoring in view of ORM based persistence
  • introduced package prov-model specifying the interface of beans, and core factory functionality
  • prov-xml (and future prov-sql) to implement these interfaces
  • redefined the interface to location/value/role/typ. Instead of returning arbitrary objects, they return instances of Location/Value/Role/Type, all subclasses of TypedValue
  • minimized patching of auto-generated beans by configuring bindings.xjc
  • nice accessors to statements in bundles/documents
  • better alignment with w3c schema (though no support for extensions)
  • using IDRef instead of XXRef

0.2.3

  • display of bundles in prov-dot
  • title option in prov-dot

0.2.2

  • aligned schema for prov-dictionary

0.2.1

  • bug fix

0.2.0

  • support for latest prov-xml schema
  • support for prov-dictionary in Java, prov-n, prov-json, and prov-xml
  • conversion of prov-dictionary from Java to rdf
  • Various bug fixes

0.1.3

  • in prov-convert, support for namespace prefix declaration
  • in prov-convert, pdf output
  • prov-dot improvements

0.1.2 (CR implementation release)

0.1.1 (Xmas release)

  • Refactor converters to/from Rdf
  • Aligned xml schema for specialization/alternate
  • Membership support in rdf

0.1.0

  • Refactored converters
  • Deprecated old traversal classes. They will be deleted in next release.

0.0.3

  • Version included in prov-translator service, launched on Dec 17th