Skip to content

Commit

Permalink
paper_candidates potential format workaround
Browse files Browse the repository at this point in the history
I created reformatted versions of the csv files for the paper to more closely match the standard ingested format, as I noticed only one file was properly imported. I think this might have something to do with the way two of the provided csv files were formatted in that they had a different order for the data and different column labels. This *might* have something to do with the way data is processed in the nmma package (see [this function](https://github.com/nuclear-multimessenger-astronomy/nmma/blob/3f5a43c82649808af148945c0a03b6288939fd87/nmma/em/utils.py#L201)  which is referenced [here](https://github.com/nuclear-multimessenger-astronomy/nmma/blob/3f5a43c82649808af148945c0a03b6288939fd87/nmma/em/analysis.py#L471) in analysis.py), but I'd have to investigate the specific behavior in more depth.

This also exposes an issue with how candidate names for data are processed in nmma_fitter, which I have submitted as an [issue](#5). As a stopgap in this case, I've simply removed the second underscore in the formatted file

As for the actual Reformatting, I need to double check whether the correct data is being labelled as mag and mag_unc in this instance; I renamed "magpsf" to "mag" and "sigmapsf" to "mag_unc" though I'm not sure if I should be using the "magzpsci" and "magzpsciunc" columns in this instance. Additionally, these files do not contain an equivalent to limmag as far as I could identify. I've submitted it as an issue [here](#7)
  • Loading branch information
tylerbarna committed Aug 15, 2022
1 parent 82dc13b commit e96e762
Show file tree
Hide file tree
Showing 6 changed files with 122 additions and 0 deletions.
4 changes: 4 additions & 0 deletions candidate_data/paper_candidates/Formatted/lc_ZTF20abwysqy.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,4 @@
,jd,mag,mag_unc,filter,limmag,programid,magzpsci,magzpsciunc
1,2459087.899,20.84799957,0.075998999,g,,2,28.69300079,1.38E-06
2,2459087.899,20.84800529,0.075998873,g,,2,28.69300461,1.38E-06
3,2459087.918,20.69689941,0.078282364,r,,2,28.84189987,8.14E-06
88 changes: 88 additions & 0 deletions candidate_data/paper_candidates/Formatted/lc_ZTF21abotose.csv
Original file line number Diff line number Diff line change
@@ -0,0 +1,88 @@
,jd,mag,mag_unc,filter,limmag,programid,magzpsci,magzpsciunc
1,2459422.818,18.73139954,0.092235997,i,,2,25.62639999,1.30E-06
2,2459422.818,18.7313633,0.092236087,i,,2,25.62636375,1.30E-06
3,2459423.716,18.67378044,0.085748442,g,,1,26.20778084,6.17E-06
4,2459423.716,18.67379951,0.085748002,g,,1,26.20779991,6.17E-06
5,2459425.695,19.11349297,0.126216918,r,,1,26.24549294,2.55E-06
6,2459425.695,19.1135006,0.126216993,r,,1,26.24550056,2.55E-06
7,2459425.695,19.1135006,0.126216993,r,,1,26.24550056,2.55E-06
8,2459425.728,19.27882385,0.134361163,g,,1,26.19482422,6.21E-06
9,2459425.728,19.27879906,0.134360999,g,,1,26.19479942,6.21E-06
10,2459425.728,19.27879906,0.134360999,g,,1,26.19479942,6.21E-06
11,2459425.775,19.46240044,0.170251995,i,,2,25.36039925,1.21E-05
12,2459425.775,19.46240234,0.170251846,i,,2,25.36040115,1.21E-05
13,2459426.72,19.93250084,0.178471997,g,,3,26.10050011,5.98E-06
14,2459426.72,19.93253136,0.178472057,g,,3,26.10053062,5.98E-06
15,2459427.694,19.69020081,0.13741,r,,1,26.2451992,3.11E-06
16,2459427.694,19.69015884,0.137410149,r,,1,26.24515915,3.11E-06
17,2459427.694,19.69020081,0.13741,r,,1,26.2451992,3.11E-06
18,2459427.733,19.78036308,0.16007036,g,,1,26.22136307,5.70E-06
19,2459427.733,19.78039932,0.160070002,g,,1,26.22139931,5.70E-06
20,2459429.755,20.17619514,0.174937621,g,,1,26.21919441,5.07E-06
21,2459429.755,20.17620087,0.174937993,g,,1,26.21920013,5.07E-06
22,2459434.714,19.54163933,0.127432331,g,,1,26.24463844,5.13E-06
23,2459434.714,19.54159927,0.127432004,g,,1,26.2446003,5.13E-06
24,2459435.677,19.35219955,0.131027997,i,,2,25.66220093,1.88E-06
25,2459435.677,19.35221672,0.131028131,i,,2,25.66221619,1.88E-06
26,2459436.714,19.03034782,0.109503098,r,,1,26.19034767,2.90E-06
27,2459436.714,19.03030014,0.109503001,r,,1,26.19029999,2.90E-06
28,2459436.714,19.03030014,0.109503001,r,,1,26.19029999,2.90E-06
29,2459436.736,19.17609978,0.119600996,g,,1,26.11310005,5.36E-06
30,2459436.736,19.17606544,0.119601339,g,,1,26.11306572,5.36E-06
31,2459439.677,19.18048096,0.13766098,g,,1,26.00448036,7.24E-06
32,2459439.677,19.18050003,0.137660995,g,,1,26.00449944,7.24E-06
33,2459441.673,18.56010056,0.066714004,r,,1,26.0230999,9.51E-06
34,2459441.673,18.56010056,0.066714004,r,,1,26.0230999,9.51E-06
35,2459441.673,18.56005859,0.066713952,r,,1,26.02305984,9.51E-06
36,2459441.745,18.96816063,0.121095307,g,,1,26.01515961,2.17E-05
37,2459441.745,18.96820068,0.121095002,g,,1,26.01519966,2.17E-05
38,2459443.693,19.05844116,0.207407713,g,,1,25.9134407,1.47E-05
39,2459443.693,19.0583992,0.207407996,g,,1,25.91340065,1.47E-05
40,2459443.693,19.0583992,0.207407996,g,,1,25.91340065,1.47E-05
41,2459443.763,18.68600082,0.145976007,r,,1,25.90999985,7.15E-06
42,2459443.763,18.68601418,0.14597556,r,,1,25.9100132,7.15E-06
43,2459444.695,19.0909996,0.249445006,g,,2,25.8010006,1.94E-05
44,2459447.706,18.76460838,0.133195817,r,,1,26.18560791,4.02E-06
45,2459447.706,18.76460075,0.133195996,r,,1,26.18560028,4.02E-06
46,2459447.706,18.76460075,0.133195996,r,,1,26.18560028,4.02E-06
47,2459447.707,18.61928558,0.123831227,r,,3,26.18728447,4.54E-06
48,2459447.707,18.61930084,0.123830996,r,,3,26.18729973,4.54E-06
49,2459448.664,19.43059921,0.245536998,g,,2,26.21559906,9.31E-06
50,2459448.664,19.43059921,0.245536998,g,,2,26.21559906,9.31E-06
51,2459448.716,18.73815346,0.148722023,r,,2,26.20015335,4.66E-06
52,2459448.716,18.73819923,0.148721993,r,,2,26.20019913,4.66E-06
53,2459448.716,18.73819923,0.148721993,r,,2,26.20019913,4.66E-06
54,2459448.717,18.77716827,0.113808542,r,,3,26.1961689,5.35E-06
55,2459449.661,18.80684853,0.101330571,r,,2,26.22084808,3.20E-06
56,2459449.661,18.80680084,0.101331003,r,,2,26.2208004,3.20E-06
57,2459450.675,18.84799957,0.111890003,r,,1,26.08099937,3.91E-06
58,2459450.675,18.84796906,0.111890122,r,,1,26.08097076,3.91E-06
59,2459450.694,19.43099976,0.236517996,g,,1,25.88899994,1.30E-05
60,2459451.671,19.04292679,0.103801996,r,,2,26.23992538,3.86E-06
61,2459451.671,19.04290009,0.103802003,r,,2,26.23990059,3.86E-06
62,2459451.671,19.04290009,0.103802003,r,,2,26.23990059,3.86E-06
63,2459451.693,19.63287735,0.205433086,g,,2,26.1318779,6.79E-06
64,2459451.693,19.63290024,0.205432996,g,,2,26.13190079,6.79E-06
65,2459454.659,19.04640007,0.112971999,i,,2,25.71839905,1.22E-06
66,2459454.659,19.04643822,0.112971663,i,,2,25.7184391,1.22E-06
67,2459454.686,20.44729996,0.256040007,g,,1,26.26530075,5.08E-06
68,2459454.686,20.44729996,0.256040007,g,,1,26.26530075,5.08E-06
69,2459454.77,19.07124329,0.10726504,r,,1,26.18924332,4.02E-06
70,2459454.77,19.07119942,0.107265003,r,,1,26.18919945,4.02E-06
71,2459457.722,20.05629921,0.254177988,g,,1,26.01129913,9.58E-06
72,2459460.705,19.45409966,0.123218998,r,,1,26.25009918,2.92E-06
73,2459460.705,19.45412636,0.123218946,r,,1,26.25012779,2.92E-06
74,2459462.697,19.51320076,0.170347005,r,,1,26.27120018,3.23E-06
75,2459462.697,19.51316643,0.170347273,r,,1,26.27116776,3.23E-06
76,2459464.726,19.50643158,0.156883717,r,,1,26.19143295,3.31E-06
77,2459464.726,19.50639915,0.156884,r,,1,26.19140053,3.31E-06
78,2459464.726,19.50639915,0.156884,r,,1,26.19140053,3.31E-06
79,2459466.651,19.67210007,0.204829007,r,,1,26.23609924,3.48E-06
80,2459466.651,19.67209435,0.204829171,r,,1,26.23609352,3.48E-06
81,2459469.646,19.66603661,0.195063606,i,,2,25.68403625,1.17E-06
82,2459469.646,19.66600037,0.195063993,i,,2,25.68400002,1.17E-06
83,2459470.641,19.68231392,0.200278789,r,,1,26.27031326,3.29E-06
84,2459470.641,19.68230057,0.200278997,r,,1,26.27029991,3.29E-06
85,2459484.651,19.93980026,0.076785997,r,,2,28.47179985,1.99E-06
86,2459484.651,19.93976021,0.076785602,r,,2,28.4717598,1.99E-06
87,2459485.647,19.94483376,0.099795282,r,,2,28.07983208,1.89E-06
Original file line number Diff line number Diff line change
@@ -0,0 +1,30 @@
,jd,mag,mag_unc,filter,limmag,programid
0,2459093.8194792,99.0,99.0,i,20.1930040329727,2.0
1,2459093.8692477,99.0,99.0,r,20.2652919822565,3.0
2,2459093.9564005,99.0,99.0,g,20.1072437408889,3.0
3,2459094.9062269,99.0,99.0,r,19.8335518866989,3.0
4,2459094.9712616,99.0,99.0,g,19.8380249196409,3.0
5,2459095.8543519,99.0,99.0,g,19.909915058499,3.0
6,2459095.9474306,99.0,99.0,r,20.0973288457695,3.0
7,2459080.9446296,99.0,99.0,g,21.236449132704,3.0
8,2459081.9252431,99.0,99.0,r,21.3517838891343,3.0
9,2459081.9667477,99.0,99.0,g,21.1673713377695,3.0
10,2459082.923287,99.0,99.0,g,21.1805584225423,3.0
11,2459082.9689468,99.0,99.0,r,20.9551668469215,3.0
12,2459084.9401852,99.0,99.0,g,21.4580668720648,3.0
13,2459084.9887269,99.0,99.0,r,21.2949607947242,3.0
14,2459085.8814815,99.0,99.0,g,21.5047092869414,3.0
15,2459085.9678009,99.0,99.0,r,21.4649111986624,3.0
16,2459086.9011343,99.0,99.0,r,21.3340000417439,3.0
17,2459086.9696759,99.0,99.0,g,21.3146931204435,3.0
18,2459087.8986458,20.8627145431835,0.0478435922563854,g,22.50504088107,2.0
19,2459087.9181366,20.6917332011505,0.05031909171505,r,22.2792870070574,2.0
20,2459087.965162,20.957405203615,0.168099234156307,g,21.2353766556046,3.0
21,2459088.8340046,22.7526415189624,0.2649488216544,g,22.5366223271704,2.0
22,2459088.9038889,99.0,99.0,r,21.3072897790994,3.0
23,2459088.9761574,99.0,99.0,g,21.214577147838,3.0
24,2459089.9295602,99.0,99.0,r,21.2876431968757,3.0
25,2459090.9191782,99.0,99.0,g,21.4726501506481,3.0
26,2459090.9418056,99.0,99.0,r,21.2434641604847,3.0
27,2459091.94625,99.0,99.0,g,21.329475034026,3.0
28,2459091.9652894,99.0,99.0,r,21.4766066226714,3.0

0 comments on commit e96e762

Please sign in to comment.