Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Step 2.2: Validation of reference model construction #28

Open
TashaleeB opened this issue Sep 11, 2019 · 0 comments
Open

Step 2.2: Validation of reference model construction #28

TashaleeB opened this issue Sep 11, 2019 · 0 comments
Assignees
Labels
formal-test A formal Validation Test pipeline:abscal Tests the abscal pipeline component pipeline:casa Tests CASA calibration as part of the pipeline pipeline:redcal Tests the redcal pipeline component simcmp:eor:powerlaw Uses a power-law P(k) for EoR signal simcmp:sys:gains Simulation Component: Gains simcmp:sys:noise Simulation Component: Thermal noise simulator:rimez Uses the RIMEz simulator status:active A formal test that is being actively worked on

Comments

@TashaleeB
Copy link
Contributor

TashaleeB commented Sep 11, 2019

The purpose of this notebook is to detail Validation Step 2.2.

Below is a picture illustrating the third test of the hera_cal scheme.
https://github.com/HERA-Team/hera_opm/blob/master/pipelines/h1c/idr2/v2/Analysis_Flowchart.pdf
Screen Shot 2019-09-10 at 6 18 19 PM

GOAL

The overall goal is to validate the link between the externally calibrated visibilities from CASA and the Omnical calibrated visibilities.

SIMULATOR

RIMEz

SIMULATION COMPONENTS

  • GLEAM (point sources)
  • eGSM (diffuse sources)
  • ATeam (bright sources not found in GLEAM)
  • Built with only sources that have known spectrum
  • 1024 channels, 100-200 MHz
  • LST range of around 21~10 hr
  • Noise (simulation has no noise but I will add)

There will be two parts to this test.

  1. The first part involves adopting the work done by Josh Dillon (https://nbviewer.jupyter.org/github/HERA-Team/hera-validation/blob/test-2.1.0/test-series/2/test-2.0.0.ipynb). Instead of using data from pyuvsim, I will use data simulated with RIMEz and push it through the Redcal and Omnical pipeline to produce visibilities.

  2. Then I will calibrate the RIMEz data with added artifacts using Nick Kern's CASA pipeline (https://github.com/HERA-Team/casa_imaging) and compare these externally calibrated visibilities to the ones made with Redcal.

I propose that this validation step consists of adding realistic gains (using hera_sim) to the simulation (eGSM + GLEAM + noise). I will use the tools available in hera_sim.sigchain to introduce gains (phase offsets, delay, bandpass) to the simulated visibilities. The resulting visibilities will be pushed through Redcal (redcal + omnical).

CASA requires that I provide it with a model to calibrate the visibilities to in the form of either a componentlist or a CASA .image file. Nick has a gleam FITS file that is fed into a model making script that makes an image cube. Because this model is only of GLEAM and not eGSM + GLEAM + noise this could affect things. The other option is to calibrate the simulation with gains added to the same simulation but with no gains added. These are the true visibilities.

Finally, I will compare the calibrated visibilities from Abscal to the calibrated visibilities from CASA.

@TashaleeB TashaleeB self-assigned this Sep 11, 2019
@steven-murray steven-murray added this to the H1C IDR2 milestone Sep 27, 2019
@steven-murray steven-murray added the formal-test A formal Validation Test label Sep 27, 2019
@steven-murray steven-murray changed the title Step 2.2 Description: Validation of reference model construction Step 2.2: Validation of reference model construction Sep 27, 2019
@steven-murray steven-murray added pipeline:abscal Tests the abscal pipeline component pipeline:casa Tests CASA calibration as part of the pipeline pipeline:redcal Tests the redcal pipeline component simcmp:eor:powerlaw Uses a power-law P(k) for EoR signal simcmp:sys:gains Simulation Component: Gains simcmp:sys:noise Simulation Component: Thermal noise simulator:rimez Uses the RIMEz simulator status:active A formal test that is being actively worked on labels Oct 28, 2019
@steven-murray steven-murray removed this from the H1C IDR2 milestone Feb 10, 2020
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
formal-test A formal Validation Test pipeline:abscal Tests the abscal pipeline component pipeline:casa Tests CASA calibration as part of the pipeline pipeline:redcal Tests the redcal pipeline component simcmp:eor:powerlaw Uses a power-law P(k) for EoR signal simcmp:sys:gains Simulation Component: Gains simcmp:sys:noise Simulation Component: Thermal noise simulator:rimez Uses the RIMEz simulator status:active A formal test that is being actively worked on
Projects
None yet
Development

No branches or pull requests

2 participants