Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Step -1.2: PRISim Validation #36

Open
steven-murray opened this issue Oct 21, 2019 · 0 comments
Open

Step -1.2: PRISim Validation #36

steven-murray opened this issue Oct 21, 2019 · 0 comments
Assignees
Labels
formal-test A formal Validation Test simcmp:fg:gleam Simulation Component: GLEAM simcmp:fg:gsm Simulator Component: Global Sky Model simulator:prisim Uses the PRISim simulator simulator:pyuvsim Uses the pyuvsim simulator status:accepted A formal test that has been accepted as valid, but not yet actively worked on

Comments

@steven-murray
Copy link
Contributor

This should be a formal test of PRISim. It should be based heavily on the tests done here: RadioAstronomySoftwareGroup/pyuvsim#211, but made into a formal validation test.

  • Simulation Component: GSM, GLEAM
  • Simulators: PRISim, pyuvsim
  • Pipeline Components: None
  • Depends on: Ideally, will depend on the automatic -1 notebook being worked on by @piyanatk.

Why this test is required

PRISim is currently not being used for many validation tests, but it will be very useful when validating against 21cm simulations (eg. from 21cmFAST), as it has built-in support for this.
Thus it should be validated in the same way as all the simulators.

Summary

A brief step-by-step description of the proposed test follows:

  • Construct visibilities from increasing-complexity sky models, both with PRISim and pyuvsim.
  • Compare visibilities explicitly, and report on the level of absolute and relative error between simulators, especially as a function of frequency.

Simulation Details

  • Freq. range:
  • Channel width:
  • Baseline/antenna configuration:
  • Total integration time:
  • Number of realisations:

Criteria for Success

  • Visibilities match to 1% between simulators across all frequencies, baselines and LSTs.
@steven-murray steven-murray added the formal-test A formal Validation Test label Oct 21, 2019
@steven-murray steven-murray added simcmp:fg:gleam Simulation Component: GLEAM simcmp:fg:gsm Simulator Component: Global Sky Model simulator:prisim Uses the PRISim simulator simulator:pyuvsim Uses the pyuvsim simulator labels Oct 21, 2019
@steven-murray steven-murray added this to the H1C IDR2 milestone Oct 21, 2019
@steven-murray steven-murray added the status:accepted A formal test that has been accepted as valid, but not yet actively worked on label Oct 28, 2019
@steven-murray steven-murray removed this from the H1C IDR2 milestone Oct 12, 2021
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
formal-test A formal Validation Test simcmp:fg:gleam Simulation Component: GLEAM simcmp:fg:gsm Simulator Component: Global Sky Model simulator:prisim Uses the PRISim simulator simulator:pyuvsim Uses the pyuvsim simulator status:accepted A formal test that has been accepted as valid, but not yet actively worked on
Projects
None yet
Development

No branches or pull requests

3 participants