Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Add jsonl #89

Open
ross-spencer opened this issue Nov 15, 2024 · 0 comments
Open

Add jsonl #89

ross-spencer opened this issue Nov 15, 2024 · 0 comments

Comments

@ross-spencer
Copy link
Contributor

Format name

JSON Lines

Version number

N/A

Extensions

*.jsonl

MIME/Media Type

Not yet standardised, but could be application/jsonl according to the docs.

Description

A format for storing structured JSON data and processing it one record (line) at a time. The format is useful for data-processing pipelines that output records one at a time, e.g. text-processing tools and shell pipelines.

There are three requirements to JSONL:

  1. UTF-8 Encoding
  2. Each Line is a Valid JSON Value
  3. Line Separator is '\n'

Format type

Text (Structured)

Vendor

Independent: Ian Ward (https://github.com/wardi/jsonlines)

File format identification signatures

N/A.

(Might not easily be possible with DROID style syntax). It is also recommended that some systems implementing this format use bzip2 or gzip2 to compress data. This conversely might open up some additional ways of identifying the format, e.g. via container.

Relevant links, documentation, extra information

https://jsonlines.org/

Credit

Ross Spencer

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant