You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
We should improve how we handle input data dependencies and code.
A continual source of confusion for model authors requesting peer review is how to refer to the data files the submit (in the data slot).
Right now code is placed in
./code/model.py
and data is placed in
./data/quux.asc
In order for model.py to access quux.asc it needs to use the relative path ../data/quux.asc. Frequently source code will use ./data/quux.asc or something along those lines though.
We could try adding a symlink in the ./code/ directory to the data directory if the ./code/data/ directory doesn't already exist.
E.g.,
.
├── code
│ ├── data -> ../data
│ └── model.py
└── data
└── quux.asc
This would let model authors continue to refer to their data via the relative path ./data/quux.asc. Thoughts @comses/editors?
alee
changed the title
consider building a data symlink in the download archive to ../data in the /code directory
improve data / code archive organization
Sep 14, 2020
alee
changed the title
improve data / code archive organization
improve data / code organization in the archive
Sep 14, 2020
We should improve how we handle input data dependencies and code.
A continual source of confusion for model authors requesting peer review is how to refer to the data files the submit (in the data slot).
Right now code is placed in
./code/model.py
and data is placed in
./data/quux.asc
In order for
model.py
to accessquux.asc
it needs to use the relative path../data/quux.asc
. Frequently source code will use./data/quux.asc
or something along those lines though.We could try adding a symlink in the
./code/
directory to the data directory if the./code/data/
directory doesn't already exist.E.g.,
This would let model authors continue to refer to their data via the relative path
./data/quux.asc
. Thoughts @comses/editors?Then the technical part about putting a symlink in the zip archive we build is a bit hairy but seems possible: https://stackoverflow.com/questions/35782941/archiving-symlinks-with-python-zipfile
The text was updated successfully, but these errors were encountered: