Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

DRILL-8474: Add Daffodil Format Plugin #2836

Closed
wants to merge 8 commits into from

Commits on Dec 22, 2023

  1. Adding Daffodil to Drill as a 'contrib'

    3.7.0-SNAPSHOT of Daffodil which has metadata support we're
    using.
    
    New format-daffodil module created
    
    Still uses absolute paths for the schemaFileURI.
    (which is cheating. Wouldn't work in a true distributed
    drill environment.)
    
    We have yet to work out how to enable Drill to provide
    access for DFDL schemas in XML form with include/import
    to be resolved.
    
    The input data stream is, however, being accessed in the
    proper Drill manner. Gunzip happened automatically. Nice.
    
    Note: Fix boxed Boolean vs. boolean problem. Don't use
    boxed primitives in Format config objects.
    
    Test show this works for data as complex as having
    nested repeating sub-records.
    
    These DFDL types are supported:
    
    - int
    - long
    - short
    - byte
    - boolean
    - double
    - float (does not work. Bug DAFFODIL-2367)
    - hexBinary
    - string
    
    apache#2835
    mbeckerle committed Dec 22, 2023
    Configuration menu
    Copy the full SHA
    ca709af View commit details
    Browse the repository at this point in the history

Commits on Jan 4, 2024

  1. Uses ScalarWriter now for typed setters for all DFDL types

    Date, Time, DateTime, Boolean, Unsigned integers, Integer, NonNegativeInteger,Decimal, float, double, hexBinary.
    mbeckerle committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    13183ac View commit details
    Browse the repository at this point in the history
  2. Code reformatting and reorg

    I imported the dev-support/formatter/eclipse settings and used them to reformat the code in IntelliJ IDEA.
    
    No functional changes in this commit.
    mbeckerle committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    225504a View commit details
    Browse the repository at this point in the history
  3. Remove catches of Exception and test printing

    Also a few code cleanups.
    mbeckerle committed Jan 4, 2024
    Configuration menu
    Copy the full SHA
    b80e74a View commit details
    Browse the repository at this point in the history

Commits on Jan 21, 2024

  1. Factored common MapBuilderLike out of SchemaBuilder and MapBuilder

    This significantly simplifies the metadata walking to convert Daffodil metadata to drill
    metadata.
    mbeckerle committed Jan 21, 2024
    Configuration menu
    Copy the full SHA
    ab567d9 View commit details
    Browse the repository at this point in the history

Commits on Feb 13, 2024

  1. Update to latest flavor of Daffodil Metadata

    Uses JPrimType now, not strings.
    mbeckerle committed Feb 13, 2024
    Configuration menu
    Copy the full SHA
    ad25972 View commit details
    Browse the repository at this point in the history

Commits on Feb 14, 2024

  1. Configuration menu
    Copy the full SHA
    7567911 View commit details
    Browse the repository at this point in the history

Commits on Apr 27, 2024

  1. Configuration menu
    Copy the full SHA
    e15707a View commit details
    Browse the repository at this point in the history