-
Notifications
You must be signed in to change notification settings - Fork 66
New issue
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
Feature/grid tiles #393
Feature/grid tiles #393
Commits on May 9, 2023
-
milos.colic committed
May 9, 2023 Configuration menu - View commit details
-
Copy full SHA for e0fab1e - Browse repository at this point
Copy the full SHA e0fab1eView commit details
Commits on May 30, 2023
-
Add CRS method to Index Systems.
Add OSR SpatialRef method to IndexSystem. Add CustomIndexSystem with CRS support. Define RST_GridTiles. Add support for osrTransformCRS for MosaicGeometry. Add extent method to MosaicGeometry. Add isEmpty to MosaicRaster. Define MosaicRasterChip. Add support for getRasterForCell to MosaicRaster. Define RasterClipByVector operator. Define RasterTessellate operator. Define RST_GridTiles expression. Define SpatialRefUtils.
milos.colic committedMay 30, 2023 Configuration menu - View commit details
-
Copy full SHA for f6cb725 - Browse repository at this point
Copy the full SHA f6cb725View commit details
Commits on Jun 4, 2023
-
- Add GDALBinaryFileFormat that supports manipulating rasters in memory. - Add GDALWarp operator that parses single line gdalwarp operation. - Introduce storage location concept for rasters, in-memory vs disk. - Simplify tiling logic through usage of gdalwarp. - Remove saveCheckpoint logic. - Add writeToPath and writeToBytes logic for rasters. - Update RST_ReTile to support both in-memory and disk. - Define RST_GridTiles that tessellate raster into grid based rasters. - Add VectorClipper that generates in-memory .shp clip file. Minor changes: - Add _tmp to gitignore. - Add logic for easy testing of display in local Jupyter.
milos.colic committedJun 4, 2023 Configuration menu - View commit details
-
Copy full SHA for fc4f415 - Browse repository at this point
Copy the full SHA fc4f415View commit details -
milos.colic committed
Jun 4, 2023 Configuration menu - View commit details
-
Copy full SHA for f0eef62 - Browse repository at this point
Copy the full SHA f0eef62View commit details -
- Update GDALBinaryFileFormat to be able to read rasters both as paths and as byte arrays. - Update all RasterExprs to support rasters both as paths and as byte arrays. - Update tests to test for 2 types of rasters. Minor changes: - Remove large tif test file. - Remove python tif test. - Make ZIP resolution automatic.
milos.colic committedJun 4, 2023 Configuration menu - View commit details
-
Copy full SHA for 94effd2 - Browse repository at this point
Copy the full SHA 94effd2View commit details
Commits on Jun 5, 2023
-
- Consolidate GDALFileFormat and GDALBinaryFileFormat.scala to a single API. - Fix the way ZIPs are handled in memory. Minor changes: - Remove large tif test file. - Remove python tif test. - Make ZIP resolution automatic.
milos.colic committedJun 5, 2023 Configuration menu - View commit details
-
Copy full SHA for abf3f24 - Browse repository at this point
Copy the full SHA abf3f24View commit details -
Properly name the raster column in the schema.
Add Mosaic UUID to raster metadata at readtime. Unify unlink and cleanup into cleanup. Update tests.
milos.colic committedJun 5, 2023 Configuration menu - View commit details
-
Copy full SHA for 964cfbc - Browse repository at this point
Copy the full SHA 964cfbcView commit details -
milos.colic committed
Jun 5, 2023 Configuration menu - View commit details
-
Copy full SHA for f772460 - Browse repository at this point
Copy the full SHA f772460View commit details
Commits on Jun 11, 2023
-
Merge branch 'main' into feature/grid_tiles
# Conflicts: # docs/source/usage/kepler.ipynb
milos.colic committedJun 11, 2023 Configuration menu - View commit details
-
Copy full SHA for 35e0fef - Browse repository at this point
Copy the full SHA 35e0fefView commit details
Commits on Jun 24, 2023
-
Add BalancedSubdivision for dividing rasters into pieces that maintai…
…n x/y ratio. Add GDALBuildVRT for executing build VRT programs. Add GDALTranslate for executing translate programs. Add GDALWarp for executing warp programs. Refactor GDALFileFormat to support ReadStrategies. Handle Axis Orientation in IndexSystem. Add MergeRasters operator. Add PathUtils to centralise all the path handling for GDAL and FUSE locations. Add RasterChipType. Add RasterCleaner for handling deletion and flushing of rasters between stages. Add RST_Tessellate expression. Add RST_Merge and RST_MergeAgg expressions. Add ReTileOnRead read strategy. Add ReadAsPath read strategy. Add ReadInMemory read strategy.
milos.colic committedJun 24, 2023 Configuration menu - View commit details
-
Copy full SHA for cfe0a04 - Browse repository at this point
Copy the full SHA cfe0a04View commit details
Commits on Jul 24, 2023
-
Update the way GDAL is installed.
Add demo notebooks for prototype.
milos.colic committedJul 24, 2023 Configuration menu - View commit details
-
Copy full SHA for 789b170 - Browse repository at this point
Copy the full SHA 789b170View commit details
Commits on Jul 26, 2023
-
Add new installable and new example notebook to prototypes.
Fix flushing in operators.
milos.colic committedJul 26, 2023 Configuration menu - View commit details
-
Copy full SHA for 4ee50f9 - Browse repository at this point
Copy the full SHA 4ee50f9View commit details
Commits on Jul 27, 2023
-
Fix aux.xml issues with rasters in mosaic.
milos.colic committedJul 27, 2023 Configuration menu - View commit details
-
Copy full SHA for 23fb47f - Browse repository at this point
Copy the full SHA 23fb47fView commit details -
Fix aux.xml issues with rasters in mosaic.
milos.colic committedJul 27, 2023 Configuration menu - View commit details
-
Copy full SHA for bb85cb3 - Browse repository at this point
Copy the full SHA bb85cb3View commit details
Commits on Jul 28, 2023
-
milos.colic committed
Jul 28, 2023 Configuration menu - View commit details
-
Copy full SHA for dbaebc2 - Browse repository at this point
Copy the full SHA dbaebc2View commit details -
milos.colic committed
Jul 28, 2023 Configuration menu - View commit details
-
Copy full SHA for ee80140 - Browse repository at this point
Copy the full SHA ee80140View commit details
Commits on Aug 10, 2023
-
Add examples for stacking bands into a single raster.
Add functionality for band stacking.
milos.colic committedAug 10, 2023 Configuration menu - View commit details
-
Copy full SHA for e4588ea - Browse repository at this point
Copy the full SHA e4588eaView commit details
Commits on Aug 11, 2023
-
milos.colic committed
Aug 11, 2023 Configuration menu - View commit details
-
Copy full SHA for f220d75 - Browse repository at this point
Copy the full SHA f220d75View commit details
Commits on Sep 8, 2023
-
Fix missing spatial reference when generating index geom.
Fix SR transformations in MosaicGeometry. Add NDVI and Clip expressions. Fix projection issues in RST_Tessellate.
milos.colic committedSep 8, 2023 Configuration menu - View commit details
-
Copy full SHA for cd47656 - Browse repository at this point
Copy the full SHA cd47656View commit details -
fix H3 geometry constructor (#374)
* fix H3 geometry constructor * fix function names * add test for str function * lint with scalafmt * add comments (cherry picked from commit 8a83eed)
Thomas Maschler authored and milos.colic committedSep 8, 2023 Configuration menu - View commit details
-
Copy full SHA for 076bdc2 - Browse repository at this point
Copy the full SHA 076bdc2View commit details
Commits on Sep 11, 2023
-
Improve data download. Add NDVI function. Add SAM example.
milos.colic committedSep 11, 2023 Configuration menu - View commit details
-
Copy full SHA for ed9d80e - Browse repository at this point
Copy the full SHA ed9d80eView commit details
Commits on Sep 13, 2023
-
milos.colic committed
Sep 13, 2023 Configuration menu - View commit details
-
Copy full SHA for c3025bc - Browse repository at this point
Copy the full SHA c3025bcView commit details
Commits on Sep 26, 2023
-
Fix NDVI and missing pixel issues.
milos.colic committedSep 26, 2023 Configuration menu - View commit details
-
Copy full SHA for ddab8cc - Browse repository at this point
Copy the full SHA ddab8ccView commit details
Commits on Oct 4, 2023
-
Clean up raster disposing. Clean up duplicated expressions.
milos.colic committedOct 4, 2023 Configuration menu - View commit details
-
Copy full SHA for 43e483f - Browse repository at this point
Copy the full SHA 43e483fView commit details
Commits on Oct 11, 2023
-
Add the concept of raster-tile to the schema and types.
Update the logic of expressions and file readers. Update tests.
milos.colic committedOct 11, 2023 Configuration menu - View commit details
-
Copy full SHA for 3d6b648 - Browse repository at this point
Copy the full SHA 3d6b648View commit details -
milos.colic committed
Oct 11, 2023 Configuration menu - View commit details
-
Copy full SHA for e2455b1 - Browse repository at this point
Copy the full SHA e2455b1View commit details -
Merge branch 'main' into feature/grid_tiles
Milos Colic authoredOct 11, 2023 Configuration menu - View commit details
-
Copy full SHA for 8e18317 - Browse repository at this point
Copy the full SHA 8e18317View commit details -
Use null for non-specified cell ids.
milos.colic committedOct 11, 2023 Configuration menu - View commit details
-
Copy full SHA for cfacf5f - Browse repository at this point
Copy the full SHA cfacf5fView commit details -
Merge remote-tracking branch 'origin/feature/grid_tiles' into feature…
…/grid_tiles
milos.colic committedOct 11, 2023 Configuration menu - View commit details
-
Copy full SHA for 30f8b31 - Browse repository at this point
Copy the full SHA 30f8b31View commit details
Commits on Oct 12, 2023
-
Configuration menu - View commit details
-
Copy full SHA for 2a7c34c - Browse repository at this point
Copy the full SHA 2a7c34cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 35526c0 - Browse repository at this point
Copy the full SHA 35526c0View commit details -
Configuration menu - View commit details
-
Copy full SHA for 509cf31 - Browse repository at this point
Copy the full SHA 509cf31View commit details -
milos.colic committed
Oct 12, 2023 Configuration menu - View commit details
-
Copy full SHA for bef9f04 - Browse repository at this point
Copy the full SHA bef9f04View commit details -
Configuration menu - View commit details
-
Copy full SHA for 1f886ab - Browse repository at this point
Copy the full SHA 1f886abView commit details -
Configuration menu - View commit details
-
Copy full SHA for ee1a4ac - Browse repository at this point
Copy the full SHA ee1a4acView commit details -
Configuration menu - View commit details
-
Copy full SHA for 41b9dae - Browse repository at this point
Copy the full SHA 41b9daeView commit details -
Configuration menu - View commit details
-
Copy full SHA for 6d4067c - Browse repository at this point
Copy the full SHA 6d4067cView commit details -
Configuration menu - View commit details
-
Copy full SHA for 9b79122 - Browse repository at this point
Copy the full SHA 9b79122View commit details
Commits on Oct 13, 2023
-
Remove redundant UUID definitions.
Remove Murmur hashing of UUIDs. Add a check for tests to warning prints. Fix data types in MergeAgg and RasterExpressionSerialization.
milos.colic committedOct 13, 2023 Configuration menu - View commit details
-
Copy full SHA for 7170697 - Browse repository at this point
Copy the full SHA 7170697View commit details -
Merge remote-tracking branch 'origin/feature/grid_tiles' into feature…
…/grid_tiles
milos.colic committedOct 13, 2023 Configuration menu - View commit details
-
Copy full SHA for 19773fe - Browse repository at this point
Copy the full SHA 19773feView commit details
Commits on Oct 17, 2023
-
Add back the UUIDs. Change GDAL configs. Add ST_BufferCapStyle.
milos.colic committedOct 17, 2023 Configuration menu - View commit details
-
Copy full SHA for 27e5870 - Browse repository at this point
Copy the full SHA 27e5870View commit details -
Merge remote-tracking branch 'origin/feature/grid_tiles' into feature…
…/grid_tiles # Conflicts: # src/main/scala/com/databricks/labs/mosaic/core/raster/api/RasterAPI.scala # src/main/scala/com/databricks/labs/mosaic/core/raster/operator/gdal/GDALBuildVRT.scala
milos.colic committedOct 17, 2023 Configuration menu - View commit details
-
Copy full SHA for b9b1856 - Browse repository at this point
Copy the full SHA b9b1856View commit details -
milos.colic committed
Oct 17, 2023 Configuration menu - View commit details
-
Copy full SHA for b7f856d - Browse repository at this point
Copy the full SHA b7f856dView commit details
Commits on Oct 19, 2023
-
milos.colic committed
Oct 19, 2023 Configuration menu - View commit details
-
Copy full SHA for 742045a - Browse repository at this point
Copy the full SHA 742045aView commit details
Commits on Oct 20, 2023
-
Remove base traits for RasterAPI. Centralize around GDAL as the only RasterAPI. Propagate class name changes. Update the init script for testing to the new tarball scripts. Rename RST_Tile to RST_FromFile. Rename RST_MergeBands to RST_FromBands.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 5e1a47b - Browse repository at this point
Copy the full SHA 5e1a47bView commit details -
Fix github test install of GDAL.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 5cb0a9e - Browse repository at this point
Copy the full SHA 5cb0a9eView commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 9f462eb - Browse repository at this point
Copy the full SHA 9f462ebView commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for b47a731 - Browse repository at this point
Copy the full SHA b47a731View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 4747771 - Browse repository at this point
Copy the full SHA 4747771View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 00063ce - Browse repository at this point
Copy the full SHA 00063ceView commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 624dba6 - Browse repository at this point
Copy the full SHA 624dba6View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 58e6160 - Browse repository at this point
Copy the full SHA 58e6160View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 3a66513 - Browse repository at this point
Copy the full SHA 3a66513View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 7b3c084 - Browse repository at this point
Copy the full SHA 7b3c084View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 1b0cb9d - Browse repository at this point
Copy the full SHA 1b0cb9dView commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 529c95f - Browse repository at this point
Copy the full SHA 529c95fView commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 76b8044 - Browse repository at this point
Copy the full SHA 76b8044View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 366f430 - Browse repository at this point
Copy the full SHA 366f430View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for b3141d5 - Browse repository at this point
Copy the full SHA b3141d5View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for a50399b - Browse repository at this point
Copy the full SHA a50399bView commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 093f005 - Browse repository at this point
Copy the full SHA 093f005View commit details -
Add GDAL jni path to LD_LIBRARY_PATH.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 9625eb0 - Browse repository at this point
Copy the full SHA 9625eb0View commit details -
Remove copying of shared objects.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 8b53c22 - Browse repository at this point
Copy the full SHA 8b53c22View commit details -
milos.colic committed
Oct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for c1a6e6b - Browse repository at this point
Copy the full SHA c1a6e6bView commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for c235b34 - Browse repository at this point
Copy the full SHA c235b34View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for b7e0144 - Browse repository at this point
Copy the full SHA b7e0144View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 1c36512 - Browse repository at this point
Copy the full SHA 1c36512View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 9df305c - Browse repository at this point
Copy the full SHA 9df305cView commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for b7eaba5 - Browse repository at this point
Copy the full SHA b7eaba5View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 3e7d421 - Browse repository at this point
Copy the full SHA 3e7d421View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for e20c0d8 - Browse repository at this point
Copy the full SHA e20c0d8View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 2355885 - Browse repository at this point
Copy the full SHA 2355885View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 9c2d6e5 - Browse repository at this point
Copy the full SHA 9c2d6e5View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for af15929 - Browse repository at this point
Copy the full SHA af15929View commit details -
Set env variable in actions for DATABRICKS_ROOT_VIRTUALENV_ENV
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 525afd5 - Browse repository at this point
Copy the full SHA 525afd5View commit details -
Remove scala side script installation.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for 79213a1 - Browse repository at this point
Copy the full SHA 79213a1View commit details -
Add _agg aliases for _aggregate functions.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for cdd9b0d - Browse repository at this point
Copy the full SHA cdd9b0dView commit details -
Remove duplicate python bindings.
Update GDALWarp to use starts with instead of split. Update pythong mosaic_context to not depend on raster API. Use -wo CUTLINE_ALL_TOUCHED=TRUE for clipping.
milos.colic committedOct 20, 2023 Configuration menu - View commit details
-
Copy full SHA for ccf39bb - Browse repository at this point
Copy the full SHA ccf39bbView commit details
Commits on Oct 26, 2023
-
- Remove references to RasterAPI in the non-expression-based R methods - Fix and simplify the R package build automation, including updating failing tests. The R packages will now appear with our release artefacts 👍 - Added caching and use of Posit public package manager in Github actions to avoid downloading Spark source every time and building R package dependencies from source - Skip coverage checks if being run _outside_ of the main build workflow
Configuration menu - View commit details
-
Copy full SHA for b7dedf7 - Browse repository at this point
Copy the full SHA b7dedf7View commit details
Commits on Oct 29, 2023
-
Add GDALCalc support. Change NDVI to use GDALCalc. Add code docs. Add support for Pixel Functions via VRTs. Update tests. Change all gdal rasters to be passed by name.
milos.colic committedOct 29, 2023 Configuration menu - View commit details
-
Copy full SHA for 3aabd8f - Browse repository at this point
Copy the full SHA 3aabd8fView commit details -
Merge remote-tracking branch 'origin/feature/grid_tiles' into feature…
…/grid_tiles
milos.colic committedOct 29, 2023 Configuration menu - View commit details
-
Copy full SHA for 74195ce - Browse repository at this point
Copy the full SHA 74195ceView commit details
Commits on Oct 31, 2023
-
milos.colic committed
Oct 31, 2023 Configuration menu - View commit details
-
Copy full SHA for aa47d9c - Browse repository at this point
Copy the full SHA aa47d9cView commit details -
Remove the wheel from the examples.
milos.colic committedOct 31, 2023 Configuration menu - View commit details
-
Copy full SHA for d9c3b5c - Browse repository at this point
Copy the full SHA d9c3b5cView commit details