Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

WIP: Cubewcs mosaic and dask reproject #894

Draft
wants to merge 67 commits into
base: master
Choose a base branch
from
Draft

WIP: Cubewcs mosaic and dask reproject #894

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
67 commits
Select commit Hold shift + click to select a range
e3613bf
enhance the cube header determinator by checking the spectral dimension
keflavich Mar 9, 2023
354b903
add option to specify header
keflavich Mar 13, 2023
4e0ff86
try to make convolution possible _and_ use memmap'd output
keflavich Mar 13, 2023
2f55c83
need non-array truthiness
keflavich Mar 13, 2023
2236c26
just raise the exception as is, don't wrap it
keflavich Mar 13, 2023
2fec7d6
refactor cube mosaicing to use reproject.coadd
keflavich Mar 13, 2023
908b181
refactor to allow for direct FITS output
keflavich Mar 13, 2023
1112321
bitpix dtype
keflavich Mar 13, 2023
6e0bcdf
getdata doesn't support mode
keflavich Mar 13, 2023
527384e
force overwrite
keflavich Mar 13, 2023
7b6078d
force overwrite
keflavich Mar 13, 2023
b64da3c
mode for fits
keflavich Mar 13, 2023
ab4f487
hdu0
keflavich Mar 13, 2023
8b34227
refactor to use output_array
keflavich Mar 13, 2023
012845f
allow setting no spectral block size
keflavich Mar 13, 2023
5893f79
add flush
keflavich Mar 13, 2023
64846bf
need to flush occasionally
keflavich Mar 13, 2023
291d4ee
allow channel-by-channel mosaicing instead of cube-by-cube
keflavich Mar 14, 2023
6d71e6d
add progressbar & frequent flush callback
keflavich Mar 14, 2023
9b0b2b3
fix some critical typos and enable resuming from partly-written file …
keflavich Mar 14, 2023
87acc6e
restructure a bunch of things that are being done too expensively and…
keflavich Mar 14, 2023
76659b4
more verbosity & parallelism
keflavich Mar 14, 2023
7b2437f
this is very verbose now, but still trying to make verbosity flexible
keflavich Mar 15, 2023
993e956
allow weights to be included
keflavich Mar 15, 2023
66c1cd9
add explanations of some choices
keflavich Mar 20, 2023
6bada0a
when operating on lists of cubes, some may be out of range, and they …
keflavich Sep 4, 2023
63605b9
need more checks for cubes to be in range
keflavich Sep 5, 2023
0a39d2d
have to account for more corner cases for missing data
keflavich Sep 5, 2023
27fc708
fix more bugs with keep
keflavich Sep 6, 2023
7840f95
refactor neighboring channel chooser
keflavich Sep 8, 2023
7f91eab
WIP: try making dask do reprojection
keflavich Oct 5, 2022
2723fe4
move reproject to top-level dask class
keflavich Sep 9, 2023
7b9c2c1
pass kwargs
keflavich Sep 10, 2023
1f1d392
comment out the wrapper
keflavich Sep 12, 2023
20eb062
add some debug things
keflavich Nov 10, 2023
f074100
allow a threshold to be specified for spectral agreement in cube
keflavich Dec 2, 2023
70a1f42
logical bugfix
keflavich Dec 2, 2023
96b8952
update use of reproject kwargs
keflavich Dec 3, 2023
a32e421
fix typo in header creation
keflavich Dec 3, 2023
c60958d
fix logical error: if the spectral axis is reversed, keeping CRPIX an…
keflavich Dec 3, 2023
09eafd2
force dtype in memory-based merge
keflavich Dec 8, 2023
5095237
sanity checks, dtype forcing
keflavich Dec 9, 2023
d15c107
add some more checks that the output file is float
keflavich Dec 9, 2023
34ba7c6
add an explicit warning
keflavich Dec 9, 2023
5422470
dtypes are a pain
keflavich Dec 9, 2023
faf1240
Add handling for VRSC -> SC with common beam; optional return footprint
e-koch Dec 29, 2023
f4dffee
Expand test_mosaic_cubes
e-koch Dec 29, 2023
3666055
Keep the original projection when combining headers
e-koch Dec 29, 2023
4979e9c
Ensure combined header updates units appropriately
e-koch Dec 29, 2023
316b156
The -1 for the combined spectral axis is returning the wrong shape. L…
e-koch Dec 29, 2023
784774b
Add test for mosaicking in spectral dimension
e-koch Dec 29, 2023
f484de9
Remove CASABM after convolving to a common beam
e-koch Dec 29, 2023
14757e8
Drop the units check when one cube is dimensionless
e-koch Dec 29, 2023
119cd3f
add common beam hack
keflavich Dec 20, 2023
b3fd5e7
remove typo
keflavich Dec 20, 2023
a779f44
Add dask[distributed] to required packages
e-koch Dec 29, 2023
75beb4f
some robustness against beams, better error messaging
keflavich Dec 29, 2023
18c5054
Allow passing specific dask distributed clients as a kwarg
e-koch Jan 5, 2024
8f59fe8
Don't start a dask client as a kwarg
e-koch Jan 5, 2024
a4f214b
Remove unused taper kwarg
e-koch Jan 6, 2024
61257d7
make progressbar a little more sensible and add debugging things around
keflavich Feb 12, 2024
83317a7
add failure_returns_pointlike for beam deconvolution
keflavich Jun 15, 2024
a736eed
pass intermediate_memmap to reproject_and_coadd
keflavich Jun 15, 2024
64efd61
add descs
keflavich Jun 16, 2024
0a3cffc
reproject_and_coadd does not accept progressbar any more
keflavich Jul 15, 2024
c636655
argmax/argmin need to return ints [some test code was removed]
keflavich Oct 18, 2024
8320826
if how=slice or ray, we do NOT want to fail!
keflavich Oct 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
1 change: 1 addition & 0 deletions setup.cfg
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@ install_requires =
numpy>=1.8.0
radio_beam>=0.3.3
dask[array]
dask[distributed]
joblib
casa-formats-io
packaging
Expand Down
Loading
Loading