Skip to content
This repository has been archived by the owner on Sep 7, 2023. It is now read-only.

Log more metrics #50

Open
1 of 2 tasks
JackKelly opened this issue Jul 10, 2021 · 2 comments
Open
1 of 2 tasks

Log more metrics #50

JackKelly opened this issue Jul 10, 2021 · 2 comments

Comments

@JackKelly
Copy link
Member

JackKelly commented Jul 10, 2021

  • Log timeseries of validation data (predicted PV over several hours, and actual PV)
  • Separately, create video of the clouds for that validation sequence? Or maybe log that video to Neptune too. But don't need to re-create every run (as long as the validation data never changes)

https://docs.google.com/document/d/1E9pccSVVIfn8m14fUqBCVLWKNiU1dUe_zgTcurqLWww/edit#

@peterdudfield
Copy link
Contributor

I would like to add a weighted mae / mse, where first time step is weighted a lot more heavily than the last.
The weights could exponentially decay, and the loss could be shorted to mae_exp2 = mae which weights decaying by half.

peterdudfield added a commit that referenced this issue Sep 2, 2021
@peterdudfield
Copy link
Contributor

PR: #73

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Projects
None yet
Development

No branches or pull requests

2 participants