Skip to content

Home

Jump to bottom
Lyle Johnson edited this page Jan 11, 2017 · 9 revisions

The Transcoder

The application polysync-transcode converts the binary PolySync logfile (plog) flat to external formats used in industry standard data science and machine learning tools. It can also query, slice and dice, and re-encode the plog format.

The Transcoder consists of several components:

  • Command line tool polysync-transcode, inspired by the industry standard HDF5 workflow including h5ls and h5dump
    • Installed to /usr/local/bin/polysync-transcode
  • Set of output plugins tailored to a specific external format like plog
    • Coming soon: plugins to convert to HDF5 and rosbag
    • Installed to /usr/local/lib/polysync-transcoder/plugin/
  • Set of data model descriptions that describe the layout of arbitrary binary blobs
    • A TOML data model description must be written that describes the sensor protocol
    • The library of existing data model descriptions is installed to /usr/local/share/polysync-transcoder/
  • C++14 library to write custom data science tools
    • By default the resources are located in /usr/local/include/polysync/ and /usr/local/lib/libtranscode.so
  • Coming soon: Python binding extension to write applications that can easily encode and decode plogs

While this Transcoder tool is open source, PolySync is licensed software. Contact us at PolySync to inquire about a license.

Installation

Install instructions

List and Dump commands

The most useful application of the transcoder is to explore and query plog files written by PolySync Core. Users can print both the file's data model, and the data itself in human readable formats.

Query Commands Tutorial

Write TOML models

The plog decoder can interpret arbitrary binary blobs stored in standard PolySync message types like ps_byte_array_msg and ps_can_frame_msg. The data models are described using TOML.

TOML Modeling Tutorial

Write TOML detectors

Most plog message types are sequences of subtypes. Detectors are configurations that teach the transcoder how the subtypes follow one another.

TOML Detector Tutorial

Encode new plog files

The transcoder can re-encode plog files, typically after filtering by message number or message type. This is useful for making plog files smaller, removing unused messages, or isolating a particular message type.

plog Encoding Tutorial

Clone this wiki locally