Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

JP-3242: Proper Handling of Timing for Final Slope Computation for only 0th Good Group Ramps #7612

Merged
merged 8 commits into from
Jun 24, 2023

Conversation

kmacdonald-stsci
Copy link
Contributor

@kmacdonald-stsci kmacdonald-stsci commented Jun 21, 2023

Resolves JP-3242

This PR addresses special handling of timing for ramps that have only good 0th group in a ramp. The addition of this special case only properly computed the variances. The timing division for the final slope computation still used the group time, which is not correct for certain special cases. All timing divisions have been pushed back to the segment calculations, so there is no longer one final divide. There is also the further subset special case for only 0th good group with the use of ZEROFRAME.

These corrections have been made in STCAL, which affects the CI tests in JWST. The ramp fitting CI tests have been updated. The STCAL PR spacetelescope/stcal#173 needs to be merged first before this PR.

Checklist for maintainers

  • added entry in CHANGES.rst within the relevant release section
  • updated or added relevant tests
  • updated relevant documentation
  • added relevant milestone
  • added relevant label(s)
  • ran regression tests, post a link to the Jenkins job below.
    How to run regression tests on a PR
  • Make sure the JIRA ticket is resolved properly

@hbushouse
Copy link
Collaborator

Started regtest, using stcal/main, at https://plwishmaster.stsci.edu:8081/job/RT/job/JWST-Developers-Pull-Requests/754/

@hbushouse hbushouse added this to the Build 9.3 milestone Jun 22, 2023
@hbushouse
Copy link
Collaborator

regtest run showed mostly unrelated differences, except for 1 ramp_fit unit test that's also failing in the CI runs. "No module named 'general_funcs'"

@codecov
Copy link

codecov bot commented Jun 23, 2023

Codecov Report

Patch coverage has no change and project coverage change: -0.83 ⚠️

Comparison is base (6db53ff) 77.43% compared to head (4d5fd22) 76.61%.

❗ Current head 4d5fd22 differs from pull request most recent head 34d5172. Consider uploading reports for the commit 34d5172 to get more accurate results

Additional details and impacted files
@@            Coverage Diff             @@
##           master    #7612      +/-   ##
==========================================
- Coverage   77.43%   76.61%   -0.83%     
==========================================
  Files         451      456       +5     
  Lines       35702    36819    +1117     
==========================================
+ Hits        27647    28209     +562     
- Misses       8055     8610     +555     
Flag Coverage Δ *Carryforward flag
nightly 77.43% <ø> (ø) Carriedforward from 88ed717

*This pull request uses carry forward flags. Click here to find out more.

see 76 files with indirect coverage changes

☔ View full report in Codecov by Sentry.
📢 Do you have feedback about the report comment? Let us know in this issue.

@hbushouse
Copy link
Collaborator

Looks to me like all the CI failures are due to the use of stcal==1.3.8, so it isn't picking changes from the PR recently merged to stcal/main. Guess we need an stcal release to fix that situation. Although a regtest run making use of stcal/main should get around that.

@hbushouse
Copy link
Collaborator

Another regtest run started at https://plwishmaster.stsci.edu:8081/job/RT/job/JWST-Developers-Pull-Requests/757 using stcal/main.

@kmacdonald-stsci
Copy link
Contributor Author

Looks to me like all the CI failures are due to the use of stcal==1.3.8, so it isn't picking changes from the PR recently merged to stcal/main. Guess we need an stcal release to fix that situation. Although a regtest run making use of stcal/main should get around that.

I ran the ramp fitting tests locally using the latest STCAL main and they passed.

@hbushouse
Copy link
Collaborator

Still has a code style failure for the opedal variable in the unit tests.

@hbushouse
Copy link
Collaborator

Latest regtest run shows only a few unrelated differences. Looks good.

CHANGES.rst Outdated Show resolved Hide resolved
Copy link
Collaborator

@hbushouse hbushouse left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Everything looks good now, except of course for the CI tests that won't pass because they're using the released version of stcal, rather than stcal/main. All tests pass in the regtest environment when build with stcal/main.

@hbushouse hbushouse merged commit 04332ea into spacetelescope:master Jun 24, 2023
9 of 16 checks passed
mairanteodoro pushed a commit to mairanteodoro/jwst that referenced this pull request Jun 28, 2023
@kmacdonald-stsci kmacdonald-stsci deleted the jp_3242 branch June 29, 2023 12:23
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants