Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Trying to Tune Alpha and Change Parameter Bounds #27

Merged
merged 5 commits into from
Jun 24, 2024

Conversation

ptrscll
Copy link
Collaborator

@ptrscll ptrscll commented Jun 21, 2024

I tried to tune alpha and also tried using an even larger box for parameter bounds. Ultimately, these efforts produced some minor improvements in temperature accuracy at the cost of even worse performance on the CO2 data (since so far I've still been using NMSE with uncertainty as my error function). These trends can be seen in the plot below:

alpha_initial_comparison_plots

Interestingly, the optimal values of alpha were all quite close to 1, and for the larger box sizes, they were actually slightly less than 1. Based on this, would it make sense to try doing a sensitivity test for alpha like we did for S and ocean heat diffusivity?

(This PR is relevant to #8 )

@ptrscll ptrscll mentioned this pull request Jun 21, 2024
@kdorheim
Copy link
Collaborator

@ptrscll yes let's try doing an sensitivity analysis with alpha!

@ptrscll
Copy link
Collaborator Author

ptrscll commented Jun 21, 2024

Just did a sensitivity analysis - it looks like changing alpha is working as expected and (quite substantially) affecting Hector's output, as shown in this graph:

alpha_sens_plots

Based on the graph, I'm guessing the reason why optimal alpha values haven't been super high is that higher alpha values produce very cold and unrealistic temperatures for the recent past, offsetting any error reduction from cooler temperatures in the earlier historical period.

@ptrscll ptrscll merged commit b7746cd into main Jun 24, 2024
1 check passed
@ptrscll ptrscll deleted the further_param_experiments branch July 11, 2024 20:20
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants