-
Notifications
You must be signed in to change notification settings - Fork 6
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Prepare tools for icenet #60
base: master
Are you sure you want to change the base?
Prepare tools for icenet #60
Conversation
tools/preprocess/preprocess.xml
Outdated
echo "regridding is done" && | ||
mkdir "data/network_datasets" && | ||
mkdir "data/network_datasets/dataset1" && | ||
mv $norm_file "data/network_datasets/norm_params.json" && |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
norm_file should be single-quoted
tools/preprocess/preprocess.xml
Outdated
echo "preprocessing is done" | ||
]]></command> | ||
<inputs> | ||
<param name="config_file" type="data" label="config file" format="json"/> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
The labels should be enhanced. A user potentially do not know how such a config file looks like or where to obtain it.
tools/preprocess/preprocess.xml
Outdated
<param name="vas_file" type="data" label="vas netcdf file" format="netcdf"/> | ||
</inputs> | ||
<outputs> | ||
<collection name="collection1" type="list"> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
better name than just collection
tools/preprocess/preprocess.xml
Outdated
</tests> | ||
<help><![CDATA[ | ||
|
||
This tool is a wrapper to preprocess icenet data (netcdf files). |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
That could be enhanced.
tools/preprocess/preprocess.xml
Outdated
This tool is a wrapper to preprocess icenet data (netcdf files). | ||
]]></help> | ||
<citations> | ||
<citation type="bibtex"> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
here you can use the type="doi"
tools/preprocess/preprocess.xml
Outdated
<citation type="bibtex"> | ||
@misc{https://doi.org/10.5281/zenodo.5176573, | ||
doi = {10.5281/ZENODO.5176573}, | ||
url = {https://zenodo.org/record/5176573}, | ||
author = {Andersson, Tom R.}, | ||
title = {Code associated with the paper: 'Seasonal Arctic sea ice forecasting with probabilistic deep learning'}, | ||
publisher = {Zenodo}, | ||
year = {2021}, | ||
copyright = {Open Access} | ||
} |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
<citation type="bibtex"> | |
@misc{https://doi.org/10.5281/zenodo.5176573, | |
doi = {10.5281/ZENODO.5176573}, | |
url = {https://zenodo.org/record/5176573}, | |
author = {Andersson, Tom R.}, | |
title = {Code associated with the paper: 'Seasonal Arctic sea ice forecasting with probabilistic deep learning'}, | |
publisher = {Zenodo}, | |
year = {2021}, | |
copyright = {Open Access} | |
} | |
<citation type="doi">10.5281/zenodo.5176573 |
tools/preprocess/preprocess.xml
Outdated
@@ -0,0 +1,222 @@ | |||
<tool id="preprocess" name="Preprocess Icenet Data" version="0.1.0+galaxy0" python_template_version="3.5" profile="21.05"> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
<tool id="preprocess" name="Preprocess Icenet Data" version="0.1.0+galaxy0" python_template_version="3.5" profile="21.05"> | |
<tool id="preprocess" name="Preprocess Icenet Data" version="0.1.0+galaxy0" profile="21.05"> |
@@ -16,43 +16,46 @@ | |||
</requirements> | |||
<command detect_errors="exit_code"><![CDATA[ |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
if $test_tool:
prepare_era5_data.py -h
repare_era5_data.py -h
else:
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
<param name="test_data_manager" type="hidden" value=""/>
<test expect_num_outputs="1">
<param name="test_data_manager" value="--test"/>
@@ -57,43 +57,43 @@ | |||
<outputs> | |||
<data name="siconca_EASE_file" format="netcdf" from_work_dir="data/obs/siconca_EASE.nc"/> | |||
<collection name="siconca_dataset" type="list"> | |||
<discover_datasets pattern="__name_and_ext__" directory="data/network_datasets/dataset1/obs/siconca/abs"/> | |||
<discover_datasets pattern="__name__" format="binary" directory="data/network_datasets/dataset1/obs/siconca/abs"/> |
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Why binary? What is this in real? Can we not output here a real standard fileformat?
@annefou do you want to take a look here? |
Yes we need to finalise this tool. I can work on it next week (19-24 November 2023) |
No description provided.