[pull] master from OSGeo:master #51
Merged
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
![pull[bot]](https://avatars.githubusercontent.com/in/12910?s=60&v=4){kind=small}
…rray as a VRTRasterBand source and through the use of a <DerivedArray> make it possible to create a 2D array from a 3D or more multidimensional one, by slicing, transposing, resampling, gridding, etc.
…to run importFromWkb() on the same object and limiting the number of dynamic memory (re)allocations - For lines, we keep track of the maximum capacity of the point array, with a new member variable. So doing setNumPoints(10), then setNumPoints(3), then setNumPoints(9) just allocates an array of size 10. - For polygons, if importing a WKB for a single ring polygon on top of an existing single ring polygon, reuse the existing ring (and benefit from the previous optimization) - For multipolygons, if importing a WKB for a single part multipolygon on top of an existing single part multipolygon, reuse the existing polygon (and benefit from the previous optimization) - Similar for multilinestring
…ect to save memory allocations
…FastGetArrowStream, even if the output driver doesn't declare OLCFastWriteArrowBatch This helps in a notable way for Parquet -> GPKG or GPKG -> GPKG when disabling the creation of the spatial index which is now the major time consumer. Now (using Arrow API): ``` $ time ogr2ogr out.gpkg nz-building-outlines.gpkg -lco spatial_index=no -progress 0...10...20...30...40...50...60...70...80...90...100 - done. real 0m12,868s user 0m13,338s sys 0m1,843s ``` Without use of Arrow API: ``` $ time ogr2ogr out.gpkg nz-building-outlines.gpkg -lco spatial_index=no -progress --config OGR2OGR_USE_ARROW_API NO 0...10...20...30...40...50...60...70...80...90...100 - done. real 0m17,625s user 0m15,917s sys 0m1,704s ```
Fix a deadlock encountered with gdalwarp test1.tif test2.tif -co COMPRESS=LZW -co TILED=YES -co BLOCKXSIZE=256 -co BLOCKYSIZE=256 -co BIGTIFF=YES -multi -co NUM_THREADS=ALL_CPUS out.tif -overwrite on the test datasets provided in #8470 (comment)
…TA for Byte/UInt16/Int16 data types Add a specialization when a VRTComplexSource has only a <NODATA> value and no other processing (scaling, color table expansion, LUT), and that the source data type is Byte, UInt16, Int16 On a 3-band 20791x22938 Byte VRT, "gdal_translate in.vrt out.tif" goes from 9.8s to 4s
GTiff: DirectIO(): fix integer overflow when requesting more than 2 GB at once
GTiff multithreaded reading/writing: fix a deadlock situation
…ndler user data when walking through the error stack
… in different buckets
…ed returned value
…an 1 GB RAM available
…of list/string/binary arrays do not saturate their capacity (2 billion elements)
…code path" This partially reverts commit fb92aa5. No longer needed since previous commit
GetNextArrowArray() implementations: automatically adjust batch size …
… all drivers, including virtual group returned by GDALGroup::SubsetDimensionFromSelection()
…le with GENERIC_WRITE only if access=w or wb
Arrow read/write: add GDAL specific field metadata
…ed by output driver
ogr2ogr Arrow code path: do not expand coded field domains if supported by output driver
GDALMDArray::GetResampled(): make GLT orthorectification available to…
cpl_vsil_win32: check return value of FlushFileBuffers(), and open file with GENERIC_WRITE only if access=w or wb
…ith anadonda-client
… issue with anadonda-client" This reverts commit 7665912.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
See Commits and Changes for more details.
Created by
pull[bot]
Can you help keep this open source service alive? 💖 Please sponsor : )