Feature/grid tiles #393
Merged
Feature/grid tiles #393
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
added 4 commits
May 9, 2023 14:00
Add OSR SpatialRef method to IndexSystem. Add CustomIndexSystem with CRS support. Define RST_GridTiles. Add support for osrTransformCRS for MosaicGeometry. Add extent method to MosaicGeometry. Add isEmpty to MosaicRaster. Define MosaicRasterChip. Add support for getRasterForCell to MosaicRaster. Define RasterClipByVector operator. Define RasterTessellate operator. Define RST_GridTiles expression. Define SpatialRefUtils.
- Add GDALBinaryFileFormat that supports manipulating rasters in memory. - Add GDALWarp operator that parses single line gdalwarp operation. - Introduce storage location concept for rasters, in-memory vs disk. - Simplify tiling logic through usage of gdalwarp. - Remove saveCheckpoint logic. - Add writeToPath and writeToBytes logic for rasters. - Update RST_ReTile to support both in-memory and disk. - Define RST_GridTiles that tessellate raster into grid based rasters. - Add VectorClipper that generates in-memory .shp clip file. Minor changes: - Add _tmp to gitignore. - Add logic for easy testing of display in local Jupyter.
added 4 commits
June 4, 2023 22:16
- Update GDALBinaryFileFormat to be able to read rasters both as paths and as byte arrays. - Update all RasterExprs to support rasters both as paths and as byte arrays. - Update tests to test for 2 types of rasters. Minor changes: - Remove large tif test file. - Remove python tif test. - Make ZIP resolution automatic.
- Consolidate GDALFileFormat and GDALBinaryFileFormat.scala to a single API. - Fix the way ZIPs are handled in memory. Minor changes: - Remove large tif test file. - Remove python tif test. - Make ZIP resolution automatic.
Add Mosaic UUID to raster metadata at readtime. Unify unlink and cleanup into cleanup. Update tests.
added 2 commits
June 11, 2023 13:52
# Conflicts: # docs/source/usage/kepler.ipynb
…n x/y ratio. Add GDALBuildVRT for executing build VRT programs. Add GDALTranslate for executing translate programs. Add GDALWarp for executing warp programs. Refactor GDALFileFormat to support ReadStrategies. Handle Axis Orientation in IndexSystem. Add MergeRasters operator. Add PathUtils to centralise all the path handling for GDAL and FUSE locations. Add RasterChipType. Add RasterCleaner for handling deletion and flushing of rasters between stages. Add RST_Tessellate expression. Add RST_Merge and RST_MergeAgg expressions. Add ReTileOnRead read strategy. Add ReadAsPath read strategy. Add ReadInMemory read strategy.
Add demo notebooks for prototype.
Fix flushing in operators.
Add functionality for band stacking.
Fix SR transformations in MosaicGeometry. Add NDVI and Clip expressions. Fix projection issues in RST_Tessellate.
* fix H3 geometry constructor * fix function names * add test for str function * lint with scalafmt * add comments (cherry picked from commit 8a83eed)
Improve data download. Add NDVI function. Add SAM example.
added 6 commits
October 20, 2023 11:10
Codecov Report
@@ Coverage Diff @@
## main #393 +/- ##
==========================================
- Coverage 95.02% 92.14% -2.89%
==========================================
Files 198 243 +45
Lines 5692 6671 +979
Branches 175 234 +59
==========================================
+ Hits 5409 6147 +738
- Misses 283 524 +241
|
Update GDALWarp to use starts with instead of split. Update pythong mosaic_context to not depend on raster API. Use -wo CUTLINE_ALL_TOUCHED=TRUE for clipping.
- Remove references to RasterAPI in the non-expression-based R methods - Fix and simplify the R package build automation, including updating failing tests. The R packages will now appear with our release artefacts 👍 - Added caching and use of Posit public package manager in Github actions to avoid downloading Spark source every time and building R package dependencies from source - Skip coverage checks if being run _outside_ of the main build workflow
Add GDALCalc support. Change NDVI to use GDALCalc. Add code docs. Add support for Pixel Functions via VRTs. Update tests. Change all gdal rasters to be passed by name.
sllynn
approved these changes
Oct 30, 2023
|
Merging this since builds are passing and this minor dip in coverage still has us above 90%. |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
No description provided.