-
Notifications
You must be signed in to change notification settings - Fork 0
/
RELEASENOTES.txt
1136 lines (1025 loc) · 51.4 KB
/
RELEASENOTES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
================================================================================
2.0.0
================================================================================
Changes of Note
===============
- Python support now requires at least version 3.5+ of Python and
version 1.13 of Numpy.
- ``filters.icp`` is no longer a plugin and provides options not
previously available.
- Linear algebra that was using single-precision math is now using
double-precision math.
- Support was added for GDAL version 3+.
- PCL support has been removed. PCD read/write and ``filters.icp`` is
now natively supported. The PCL filters have been moved to the
`unsupported-plugins <https://github.com/PDAL/unsuppported-plugins>`__
repository for those that might need functionality they provided.
- PDAL now uses a JSON library that doesn’t support comments. If your
pipelines contains non-standard JSON, they will no longer be
accepted.
- PDAL now supports GCC 9.2, clang 8.0.1 and Visual Studio 17
New Stages
==========
- ``filters.covariancefeatures`` computes statistics about features of
points in a neighborhood. (#2455 - Thanks
`Helix.re <http://https://helixre.com/>`__!)
- ``readers.e57`` reads the E57 format. (#2442 - Thanks
`Helix.re <http://https://helixre.com/>`__!)
- ``writers.e57`` writes the E57 format. (#2442 - Thanks
`Helix.re <http://https://helixre.com/>`__!)
- ``writers.gltf`` provides simple glTF mesh output support. (#2643)
- ``filters.reciprocity`` computes the percentage of points that are
considered uni-directional. (#2504 - @chambbj)
- ``filters.miniball`` computes a criterion for neighbors based on the
miniball algorithm. (#2504 - @chambbj)
- ``filters.planefit`` computes a deviation of a point from a manifold
approximating its neighbors. (#2504 - @chambbj)
- ``readers.memory`` provides an API interface for direct reading of
row-oriented point data. (#2620)
- ``filters.projpipeline`` processes point through a `PROJ
pipeline <https://proj.org/operations/transformations/deformation.html>`__.
(#2626 - Thanks @vilaa!)
Deprecated Stages
=================
- readers.sqlite (will be moved to
`unsupported-plugins <https://github.com/PDAL/unsuppported-plugins>`__
in a future release)
- writers.sqlite (will be moved to
`unsupported-plugins <https://github.com/PDAL/unsuppported-plugins>`__
in a future release)
- readers.geowave (will be moved to
`unsupported-plugins <https://github.com/PDAL/unsuppported-plugins>`__
in a future release)
- writers.geowave (will be moved to
`unsupported-plugins <https://github.com/PDAL/unsuppported-plugins>`__
in a future release)
Removed Stages
==============
- ``filters.mongus``
- ``filters.kdistance``
- ``readers.greyhound``
Enhancements
============
- ``readers.mrsid`` now supports more recent versions of the Mr. Sid
SDK. (#2460)
- ``readers.tiledb`` and ``writers.tiledb`` now support stream mode
processing. It also supports an ``append`` option.
- ``readers.ept`` now accepts an optional ``\<spatial reference>``
after the bounds specification in the ``bounds`` option to indicate
the SRS of the provided boundary. (#2295)
- ``filters.hag`` now supports interpolation from a TIN (triangulated
network) of points. (#2520 - Thanks `James
McClain <https://github.com/jamesmcclain>`__!)
- ``filters.poisson`` now properly applies an inverse transform to
points it creates. (#1840)
- ``pdal --drivers`` now shows the file extensions associated with each
driver. It also shows when stages are streamable. (#2571, #2528)
- Some threaded execution has been added to ``readers.ept``.
- Alternate dimension names have been added for “Red”, “Green” and
“Blue” to better support PLY input. (#2570)
Bug Fixes
=========
- Fixed a problem where data in a forwarded LAS VLR would be lost.
(#2542)
- Clear dimension list in ``filters.colorization`` to eliminate the
possibility of writing invalid data. (#2487)
- Delete code that removed control characters when converting to JSON.
(#2355)
- Fixed an issue where nested geometries were being written as invalid
WKT in ``filter.hexbin``. (#2507)
- Fixed a segmentation fault in ``readers.bpf`` if the specified file
didn’t exist. (#2515)
- Fixed an issue in ``writers.gdal`` where interpolation would
terminate if the process hit the raster edge. (#2545)
- Fixed an issue writing JSON when characters needed to be escaped.
(#2558)
- Delaunay triangulation no longer segfaults with fewer than three
points. (#2513)
- Issues with reading binary data with ``filters.ept`` have been fixed.
(#2585)
- ``pdal`` now errors if an option is provided that wasn’t expected.
(#2574)
- Forwarding for scale with multiple LAS inputs was fixed. (#2663)
================================================================================
1.9.1
================================================================================
Version 1.9.1 is a bug fix release.
Bug Fixes
---------
- When writing numerous LAS files with the PDAL API, an internal list
of fields to forward could grow excessively. This has been fixed.
(#2452)
- A computation in ``writers.gdal`` that could overflow with very large
rasters has been fixed. (#2454)
- A bug that could result in the same pipeline tag name being used for
multiple stages of the same type has been fixed. (#2458)
- A potential segmentation fault in ``pdal density`` has been fixed.
(#2461)
- A segmentation fault in ``filters.chipper`` when processing multiple
inputs has been fixed. (#2479)
- An issue with ``readers.ept`` overwriting temporary files before they
weren’t needed has been fixed. (#2474)
- Fixed an issue where ``filters.icp`` would create data that appeared
invalid due to the precision of data when positions weren’t located
near the origin. (#2492)
================================================================================
1.9.0
================================================================================
Changes of Note
===============
- PDAL now requires at least version 2.2 of GDAL.
- Pipelines can optionally be specified as an array of stages (without
an encapsulating “pipeline” object).
- The location of installed cmake files has been changed to match the
cmake convention.
- ``filters.delaunay`` now uses the delaunator library instead of
geogram.
- PDAL no longer depends on the GEOS library. However, some polygon
functions will not work if PDAL isn’t built with a version of the
GDAL library that has GEOS support.
- PDAL now uses the standard cmake script to locate the necessary GDAL
files when building.
- ``readers.sbet`` now reads angles as degrees rather than radians.
(#2354)
- The ``tindex`` command now requires one of the subcommands ``create``
or ``merge``. It no longer accepts the ``merge`` option, which has
been replaced by the ``merge`` subcommand.
- The argument for the function ``PipelineManager::executeStream`` is
now of type ``StreamPointTable&`` instead of ``FixedPointTable&``.
Enhancements
============
- All readers now accept the ``default_srs`` and ``override_srs``
options. ``override_srs`` is an alias for the existing
``spatialreference`` option. ``default_srs`` applies only if no
spatial reference exists in the source file. (#2194, #2195)
- Added some dimension detection capability to ``readers.pts``. (#2317)
- Hardened API use of LASzip in ``writers.las`` for points with data
format 6 and above and set the extended_point_type variable. (#2320,
#2329)
- Support the ``libgeotiff`` path suffix when searching for the geotiff
library with cmake.
- Added a ``resolution`` option to ``readers.ept`` to limit the number
of points read. (#2331)
- ``readers.rxp`` now supports stream mode.
- Added the ``invert`` option to ``filters.head`` and ``filters.tail``.
- Added support for subcommands in kernels. (#2293)
New stages
==========
- ``filters.mongo`` - Filtering of points using the mongo expression
language.
- ``readers.tiledb`` - Reads points from the tileDB database.
- ``writers.tiledb`` - Writes points to the tileDB database.
- ``writers.ept_addon`` - Adds sidecar data to an existing EPT dataset.
Deprecated stages
=================
- ``filters.kdistance`` - Replaced by ``filters.nndistance``.
``filters.kdistance`` will be removed in the next PDAL release.
- ``filters.mongus`` - Replaces by ``filters.pmf`` and ``filters.smrf``
Bug fixes
=========
- The tindex command now uses sufficient precision when using the
``fast_boundary`` option (#2271)
- ``filters.smrf`` and ``filters.pmf`` now process all points if the
``NumberOfReturns`` or ``ReturnNumber`` dimension is missing. This
fixes a regression introduced with PDAL 1.8. (#2275)
- The density command is now found by pdal. This fixes a regression
introduced with PDAL 1.8. (#2378)
- The ``scale=auto`` and ``offset=auto`` options now work with
``writers.bpf`` in stream mode. (#1983)
- Pipelines with diamond shapes now properly re-execute ancestor
stages. This fixes a regression introduced with PDAL 1.8. (#2290)
- ``filters.crop`` now uses the correct logic when the ``outside``
option is used in standard mode. (#2305)
- A bug in ``writers.gdal`` with streaming mode that caused an improper
location shift in some instances has been fixed. (#2292)
- Added an explicit dependency on the arbiter library for curl. This
fixes build issues on some Unix platforms. (#1822)
- Fixed a bug in ``filters.icp`` introduced by a change in PCL (see:
https://github.com/PointCloudLibrary/pcl/issues/2724) that improperly
removed a function call. (#2319)
- ``readers.tindex`` now provides a default of “EPSG:4326” for the
``filter_srs`` option. (#2316)
- Points in buffer corners are now properly placed in tiles in
``filters.splitter``. (#2372)
- Fixed reference counting in ``filters.python`` that might have caused
a crash in some circumstances.
- Generalized the python library re-loaded by PDAL when being used as a
python extension. This is only relevant on some Unix distributions.
================================================================================
1.8.0
================================================================================
Changes of Note
===============
- PointTableRef is now publicly accessible from PointView (#1926)
- Minimum CMake version is now 3.5
- ``filters.hexbin`` is now a built-in stage, rather than a plugin.
(#2001)
- Removed support for ``ght`` compression in ``writers.pgpointcloud``.
(#2148)
- On OSX, plugins are now installed with ID of ``@rpath`` rather than
``@loader_path/../lib``
Enhancements
============
- Added ``denoise`` and ``reset`` options to ``pdal ground``. (#1579)
- ``readers.gdal`` now supports stream mode and provides the ``header``
option to map dimensions. It also supports fetching bounds without
reading the entire file. (#1819)
- ``readers.mbio`` added ``datatype`` option to support reading
sidescan data. (#1852)
- ``filters.stats`` was computing expensive kurtosis and skewness
statistics by default. These statistics are now available with the
``advanced`` option. (#1878)
- Added backtrace support for alpine linux-based Docker containers.
(#1904)
- Added a ``condition`` option for ``filters.assign`` to limit
assignment. (#1956)
- Add access to artifact manager keys. (#2026)
- Added support for LAZ compression in ``writers.pgpointcloud`` (#2050)
- Replaced ``last`` option with ``returns`` to support more flexible
segmentation in ``filters.smrf`` and ``filters.pmf``. (#2053)
- ``writers.text`` now supports stream mode. (#2064)
- Added ``pdal tile`` kernel with streaming support to conveniently
tile data. (#2065)
- A KD-tree used in one filter will now be reused in subsequent filters
when possible. (#2123)
- ``writers.ply`` now has a ``precision`` option to specify output
precision. (#2144)
- ``filters.smrf`` and ``filters.pmf`` supports complete range syntax
for the ``ignore`` option. (#2157)
- ``filters.hexbin`` now supports stream mode. (#2170)
- ``readers.numpy`` now has the ``order`` option, which replaces the
previous ``x``, ``y`` and ``z`` options. It also supports structured
numpy arrays and maps values to the X, Y and Z dimensions
accordingly.
- All readers now support setting a spatial reference to override any
in the data with the ``spatialreference`` option.
- Add support for unicode filenames in pipelines on Windows platforms.
- Added NumpyReader::setArray() to support direct setting of a numpy
array into ``readers.numpy``.
- Added StreamPointTable::setNumPoints() and support in
Streamable::execute() allowing custom point tables to know the number
of points in each pass through the point table.
- Added SpatialReference::isProjected() to allow callers to determine
if a spatial reference specifies a projection. Also added
SpatialReference::identifyHorizontalEPSG() and
SpatialReference::identifyVerticalEPSG() to return an EPSG code from
a spatial reference if possible.
- Added support for reading BPF files stored remotely.
New stages
==========
- ``readers.rdb`` - Support reading RIEGL RDB data.
- ``readers.i3s`` - Support reading of web service-style Esri I3S point
clouds.
- ``readers.slpk`` - Support reading of file-based I3S-style point
clouds.
- ``writers.fbx`` - Experimental Unity engine (SDK required) support.
(#2127)
- ``filters.nndistance`` - Replaces ``filters.kdistance`` and adds
average distance support. (#2071)
- ``filters.dem`` - Filter data based on bounds relative to a raster
value. (#2090)
- ``filters.delaunay`` - Create a delauany triangulation of a point
cloud. (#1855)
- ``filters.info`` - Generate metadata about an input point set. Used
by ``pdal info``.
Deprecated stages
=================
- ``filters.kdistance`` - Replaced by ``filters.nndistance``.
Bug fixes
=========
- Fixed an incorrect error message suggesting there were multiple SRSs
in some cases when reading multiple inputs. (#2009)
- Fixed a problem in ``filters.reprojection`` in stream mode that would
improperly reproject when there were multiple input sources with
differing SRSs. (#2058)
- Fixed a problem in stream mode where a stage with no SRS would
override the active SRS during processing. (#2069)
- Fixed a problem in ``writers.gdal`` where output would be aggregated
if multiple inputs were provided. (#2074)
- The ``count`` option was not respected in stream mode. It now
properly limits the number of points read. (#2086)
- Fixed an off-by-one error that could create improper values in
``writers.gdal``. Most data differences were small and not usually
problematic. (#2095)
- Multiple option values can be specified on the command line by
repeating the option assignment. (#2114)
- Added a missing initialization in ``filters.returns`` that could
cause more point views to be returned than requested. (#2115)
- Emit an error if the ``count`` option isn’t set for ``readers.faux``.
(#2128)
- PipelineManager::getStage() now returns a proper leaf node. (#2149)
- Fixed logic for ``filters.crop`` in streaming mode with multiple crop
areas that could return too few points. (#2198)
- Added the ``minimal`` option for ``readers.rxp`` that was documented
but not fully implemented. (#2225)
- Fixed an error in failing to read all points in ``readers.rxp``
exposed with a newer SDK. (#2226)
- Fixed an error in fetching floating point data from a PointContainer
when the value was NaN. (#2239)
================================================================================
1.7.0
================================================================================
Changes of Note
===============
- ``filter.ferry`` now creates output dimensions with the same type as
the input dimension. It also takes an arrow ‘=>’ in addition to ‘=’
in the ``--dimension`` specification.
- ``filters.hexbin`` now falls back to slow boundary creation if no
bounds information exists to do fast boundary creation.
- Dimension names can now contain the forward slash (‘/’) character.
- ``readers.gdal`` and ``filters.colorization`` now attempt to create
dimensions with the type of the associated raster.
- The Python PDAL extension code was removed from the PDAL source tree
to its own `repository <https://github.com/PDAL/python>`__.
- The JAVA PDAL interface was remove from the PDAL source tree to its
own `repository <https://github.com/PDAL/java>`__.
- ``pdal pipeline``\ and ``pdal translate`` now use stream mode if the
operation being performed is streamable. An option ``--nostream`` has
been added to both commands to prevent the use of stream mode. The
``--stream`` option of ``pdal pipeline`` is now obsolete and ignored.
- A new interface has been provided for the creation of plugins
requiring less boilerplate code. There has been no API change.
- Stages and pipelines can now be tested to check whether they are
streamable.
Enhancements
============
- Added options ``--timegap`` and ``--speedmin`` to ``readers.mbio`` to
allow configuration of which points should be read.
- Added support for compression schemes (xz, lzma, zstd) and created a
standardized interface (#1722).
- ``writers.bpf`` now supports the option ``auto`` for the ``coord_id``
option to allow the UTM zone to be set from the spatial reference if
possible (#1723).
- Added the ability read stage-specific options from a file with the
``--option_file`` option (#1641).
- Replace the GDAL point-in-polygon with a much faster implementation
in ``filters.crop``.
- Add a ``--reverse`` option to ``filters.mortonorder`` to provide a
point ordering for good dispersal.
- ``readers.bpf`` now supports the TCR (ECEF - earth centered, earth
fixed) coordinate system.
- Added option ``--use_eb_vlr`` to allow ``readers.las`` to interpret
an extra bytes VLR as if the file were version 1.4 even if it’s using
an earlier LAS version.
- ``readers.text`` added options ``--header`` and ``--skip`` to provide
an alternative header line and to allow skipping lines before reading
the header, respectively.
- ``writers.text`` now supports the ability to specify individual
dimension precision using a colon (‘:’) and integer following the
dimension name in the ``--order`` option.
- ``readers.numpy`` adds support for reading from Numpy (.npy) save
files.
- ``pdal info`` now provides the ``--enumerate`` option. See the
documentation for
`filters.stats <https://pdal.io/stages/filters.stats.html>`__ for
details.
- Added a general option ``--logtiming`` to cause log output to contain
the elapsed time from the start of the program. (#1882)
Documentation
=============
- Added a description of the Alpine Linux environment used for Travis
and Docker.
- Updated the documentation for building PDAL on Windows.
- Added an example of how to loop files with PowerShell.
- Corrected output shown in the documentation for ``filters.hexbin``.
- Reorganized the stages landing page to make it easier to find.
(#1880)
New stages
==========
- ``readers.greyhound`` - Allows reading points from a source using the
`greyhound <https://github.com/hobu/greyhound>`__ protocol.
- ``filters.neighborclassifier`` - Re-classifies points based on the
classification of neighboring points.
Removed stages
==============
- ``filters.computerange`` - Use ``filters.python`` to simulate the
functionality.
Bug fixes
=========
- ``filters.range`` now always rejects NaN values as out of range.
- Changed the default ``--timegap`` value in ``readers.mbio`` from 0 to
1 second.
- Fixed a bug when reading pointers from metadata on some OSX systems.
- Fixed a problem in ``pdal translate`` where overriding a reader or
writer from a pipeline wouldn’t create the proper pipeline.
- Fixed a problem where multiple LASzip VLRs would get written to LAS
files (#1726).
- Fixed an installation problem with the Python extension.
- Fixed a bug in ``writers.tindex`` that could cause a crash if the
output file wasn’t LAS.
- Fixed JSON output from ``filters.hexbin`` when density/area can’t be
calculated.
- Fixed a problem where output might be tagged with the wrong SRS when
using ``filters.reprojection`` in stream mode. (#1877)
- PDAL_DRIVER_PATH would be improperly parsed on Windows systems when
the path contained colons. Windows builds now use the semicolon as
the path separator. (#1889)
- Convert NaN and infinite double values to proper strings for output
as JSON.
- Synthetic, keypoint and withheld flags are now added to the
classification dimension for version 1.0 - 1.3 files in
``readers.las``.
- Support missed case supporting points with color but no density in
``filters.poisson``.
- Throw an error if the input file can’t be opened in ``readers.ply``.
- The ``--stdin`` option for ``kernels.tindex`` didn’t work. Now it
does. Various other fixes were made.
- ``writers.gdal`` now throws an error if an attempt is made to write
an output file with no points available.
- A build error that would be generated if lazsip was not found, even
if it was not requested, has been resolved.
- A build error that would be generated if Python was found but not
requested has been resolved.
- PDAL defaults to using `normal CMake
interface <https://cmake.org/cmake/help/v3.11/policy/CMP0022.html>`__
linking (#1890)
- Fixed an issue where dimensions from ``readers.pcd`` and
``writers.pcd`` could get confused with dimensions from
``readers.sbet`` and ``writers.sbet``.
- Fixed index computation in ``filters.voxelcentroidnearestneighbor``
and ``filters.voxelcenternearestneighbor`` #1901
- Fixed libdl linking #1900
================================================================================
1.6.0
================================================================================
Changes of Note
===============
- PDAL's Travis CI configuration is now based on Alpine Linux.
- PDAL is now built into containers with Alpine linux in addition to
Ubuntu linux. `Tags <https://hub.docker.com/r/pdal/pdal/tags/>`__
exist for each release, starting with 1.4, as well as the master
branch.
- Pipeline tag names can now contain capital letters. They can also
contain underscores after the first character.
- Replace ``filters.programmable`` and ``filters.predicate`` with the
more general ``filters.python``.
- Add support for Matlab with ``filters.matlab``\ (#1661).
- Remove the ``approximate`` option from ``filters.pmf`` and add an
``exponential`` option.p
- Placed base64 encoded VLR data in a subnode of the VLR itself with
the key "data" rather than duplicate the VLR node itself (#1648).
- XML pipelines are no longer supported (#1666).
- The number of proprietary dimensions in ``readers.text`` was expanded
from 255 to 4095 (#1657).
- API hooks have been added to support the use of PDAL with JVM
languages such as Java or Scala.
- Added support for LASzip 1.4 and switch to use the new LASzip API.
(#1205). LASzip support in PDAL will require LASzip.org release 3.1.0
or greater.
- The cpd kernel has been replaced with ``filters.cpd``.
- No more warnings about ReturnNumber or NumberOfReturns for LAS
permuations (#1682).
- The KernelFactory class has been removed. Its functionality has been
moved to StageFactory.
- Built-in eigen support has changed from version 3.2.8 to 3.3.4
(#1681).
Enhancements
============
- API users can now create synonyms for existing arguments to a stage.
- ``filters.splitter`` can now create buffered tiles with the
``buffer`` option.
- ``writers.ply``\ can now be made to write faces of an existing mesh
(created with ``filters.greedyprojection`` or ``filters.poisson``) if
the ``faces`` option is used. An option ``dims`` has also been added
that allows specification of the dimensions to be written as PLY
elements. The writer also now supports streaming mode.
- ``readers.text`` is now automatically invoked for .csv files.
- PDAL\_PLUGIN\_INSTALL\_PATH can now be set via override when building
PDAL from source.
- Changed the use of null devices to eliminate potentially running out
of file descriptors on Windows.
- ``filters.randomize`` can now be created by the stage factory
(#1598).
- Provide the ability to specify a viewpoint and normal orientation in
``filters.normal`` (#1638).
- ``readers.las`` now provides the ``ignore_vlr`` option to allow named
VLRs to be dropped when read (#1651).
- Allow ``writers.gdal`` to write output rasters of type other than
double (#1497).
- ``filters.sqlite`` is now invoked automatically for .gpkg files.
- ``filters.colorinterp`` can now be used in streaming mode in some
cases (#1675).
- Pointers can now be stored as metadata.
- ``filters.ferry`` can now create new dimensions without copying data
(#1694).
Documentation
-------------
- Remove some leftover references to the ``classify`` and ``extract``
options that were removed from ``filters.ground`` in the last
release.
- Add a note about running pgpointcloud tests.
- Added a tutorial on filtering data with python.
- Remove lingering XML pipeline examples and replace with JSON.
- Many updates and corrections to the workshop.
- Added to the FAQs and entry about why a stage might not be found.
- Added information to stage docs to indicate whether or not they were
buit-in rather than plugins (#1612).
- Added information to stage docs to indicate when they are streamable
(#1606).
New filters
===========
- ``filters.greedyprojection`` - Performs triangulation of points
(surface reconstruction) based on the greedy projection algorithm.
- ``filters.poisson`` - Performs triangulation of points (surface
reconstruction) based on the algorithm of Kazhdan.
- ``filters.head`` - Passes through only the first N points.
- ``filters.tail`` - Passes through only the last N points.
- ``filters.cpd`` - Calculates and applies a transformation to align
two datasets using the `Coherent Point
Drift <https://sites.google.com/site/myronenko/research/cpd>`__
registration algorithm.
- ``filters.icp`` - Calculates and applies a transformation to align
two datasets using the `Iterative Closest
Point <http://docs.pointclouds.org/trunk/classpcl_1_1_iterative_closest_point.html>`__
registration algorithm.
- ``filters.voxelcenternearestneighbor`` - Finds points closest to the
center of a voxel (#1597).
- ``filters.voxelcentroidnearestneighbor`` - Finds points closest to
the controid of points in a voxel (#1597).
- ``filters.python`` - Replaces ``filters.predicate`` and
``filters.programmable``.
- ``filters.matlab`` - Provides support for matlab manipulation of PDAL
points and metadata (#1661).
New readers
===========
- Add ``readers.osg`` to support Open Scene Graph format.
- Add ``readers.matlab`` to support reading data from a user-defined
Matlab array struct. The same structure is written by
``writers.matlab``.
Bug fixes
=========
- Fixed a case where\ ``kernels.tindex`` would unconditionally set the
spatial reference on a feature from the ``a_srs`` option. The spatial
reference stored in ``a_srs`` is now only used if explicitly set or
no spatial reference was present.
- Fixed a case where 'writers.gdal\` could fail to check for an
out-of-bounds point, potentially leading to a crash.
- Fix an error in 'filters.cluster' where the points wouldn't properly
be placed in the first cluster because the starting cluster number
was incorrect.
- Fixed an error in freeing OGR features that could cause a crash when
running "pdal density".
- Fix potential memory leaks when creating OGRSpatialReference objects.
- Make sure the ``global_encoding`` option is initialized to 0 in
``writers.las`` (#1595).
- Fix eigen::computeCovariance to compute the correct sample
covariance.
- In some cases, the ``filters.crop`` would attempt to treat a 2D
bounding box as 3D, yeilding a NULL bounding box and an error in
behavior (#1626).
- Fixed potential crash when using PDAL with multiple threads by
providing locking for gdal::ErrorHandler (#1637)
- Made sure that an uncompressed LAS file would be properly read even
if the ``compression`` option was provided.
- Throw an exception instead of crash when attempting to access a
non-existent color ramp. (#1688)
================================================================================
1.5.0
================================================================================
Changes of Note
===============
- PCL ``--visualize`` capability of the ``pdal`` command line
application has been removed.
- ``writer.derivative`` has been removed. Use
`gdaldem <http://www.gdal.org/gdaldem.html>`__ for faster and more
featureful equivalent functionality.
- GeoTIFF and Proj.4 are now required dependencies.
- ``writers.p2g`` has been removed. It was replaced by ``writers.gdal``
in 1.4, but the P2G writer was essentially unmaintained and we will
be using the GDAL one going forward.
- ``filters.attribute`` was split into ``filters.assign`` and
``filters.overlay`` to separate their functionalities
- ``filters.pmf`` and ``filters.outlier`` have dropped the ``classify``
and ``extract`` options. They now only classify points and leave it
downstream filters to ignore/extract classifications as needed.
- ``filters.outlier`` has changed the default classification for noise
points from ``18`` to ``7`` to match the LAS classification code for
"Low point (noise)".
Enhancements
============
- ``pdal pipeline`` now supports a ``--stream`` option which will
default to one-at-a-time or chunk-at-a-time point processing when all
stages in the pipeline support it. You can use this option to control
memory consumption -- for example when interpolating a very large
file with ``writers.gdal``
- ``filters.crop`` was enhanced to support transformed filter polygons,
streaming, and radius cropping.
- ``readers.greyhound`` updated to support greyhound.io 1.0 release,
with the most significant enhancement being support for passing
downstream JSON filters.
- ``user_data`` JSON object can be applied to any PDAL pipeline object
and it will be carried through processing. You can use this mechanism
for carrying your own information in PDAL pipelines without having to
sidecar data. #1427
- ``writers.las`` now can write ``pdal_metadata`` and ``pdal_pipeline``
VLRs for processing history tracking. #1509 #1525
- ``metadata``, ``schema``, and ``spatialreference`` objects added to
global module for ``filters.programmable`` and ``filters.predicate``
Python filters.
- ``pdalargs`` option for ``filters.programmable`` and
``filters.predicate`` allow you to pass in a JSON dictionary to your
Python module for override or modification of your script
- Stage tags can be used in pipeline override scenarios
- User-settable VLRs in ``writers.las`` #1542
- ``filters.sort`` now supports descending order and uses
``std::stable_sort`` #1530 (Thanks to new contributor @wrenoud )
- ``pdal tindex`` will now use data bounds if ``filters.hexbin`` cannot
be loaded for boundaries #1533
- ``filters.pmf`` and ``filters.smrf`` improved performance #1531 and
#1541
- ``filters.assign`` now supports
`Range <https://pdal.io/stages/filters.range.html>`__-based
filters
- ``filters.outlier`` now accepts a user-specified ``class`` to
override the default value of ``7`` for points deemed outliers. #1545
- ``filters.pmf`` and ``filters.smrf`` now accept a
`Range <https://pdal.io/stages/ranges.html#ranges>`__ via the
``ignore`` option to specify values that should be excluded from
ground segmentation. #1545
- ``filters.pmf`` and ``filters.smrf`` now consider only last returns
(when return information is available) as the default behavior. The
``last`` option can be set to ``false`` to consider all returns.
#1545
Documentation
-------------
- New `About page <https://pdal.io/about.html>`__ adapted from
`workshop <https://pdal.io/workshop/>`__
- New `LAS reading and writing <https://pdal.io/tutorial/las.html>`__
tutorial
- Consolidation of `Python <https://pdal.io/python.html>`__ information
New filters
-----------
- ``filters.cluster`` - Perform Euclidean cluster extraction, and label
each point by its cluster ID. By @chambbj.
- ``filters.groupby`` - Split incoming PointView into individual
PointViews categorically, e.g., by Classification. By @chambbj.
- ``filters.locate`` - Locate and return the point with the minimum or
maximum value for a given dimension. By @chambbj.
- ``filters.emf`` - Extended Local Maximum filter. By @chambbj.
New readers
-----------
- ``readers.mbio`` Bathymetric point cloud support for formats
supported by the
`MB-System <https://www.ldeo.columbia.edu/res/pi/MB-System/>`__
software library
Bug fixes
---------
- ``writers.pgpointcloud`` needed to treat table schema correctly
https://github.com/PDAL/PDAL/pull/1540 (thanks @elemoine)
- ``pdal density`` kernel now supports overriding ``filters.hexbin``
options #1487
- Arbiter embedded library updated to support setting Curl options
(certificate settings, etc).
- Provided a default value for ``radius`` in ``writers.gdal`` #1475
- ``writers.ply`` broken for non-standard dimensions #1556
- No EVLRs for ``writers.las`` for files < LAS 1.4 #1551
- LAS extra dims handling for standard PDAL dimension names #1555
- LASzip defines #1549
================================================================================
1.4.0
================================================================================
Changes of Note
===============
- GeoTIFF is now required to compile PDAL
- ``--scale`` and ``--offset`` kernel options are no longer supported.
Specify using stage-specific options as needed.
- The ``--validate`` option of the ``pdal pipeline`` command now
invokes the preparation portion of the pipeline to force validation
of options.
- The ``--verbose`` option to ``pdal`` now accepts log level names
("Error", "Warning", "Info", "Debug", "Debug1", "Debug2", "Debug3",
"Debug4" and "Debug5") in addition to the corresponding numeric
values (0 - 8).
Enhancements
============
New filters
-----------
- ```filters.colorinterp`` <http://pdal.io/stages/filters.colorinterp.html>`__
- Ramp RGB colors based on a specified dimension. By @hobu
- ```filters.mad`` <http://pdal.io/stages/filters.mad.html>`__ - Filter
outliers in a given dimension by computing Median Absolute Deviation
(MAD). By @chambbj
- ```filters.lof`` <http://pdal.io/stages/filters.lof.html>`__ -Filters
outliers by Local Outlier Factor (LOF). By @chambbj
- ```filters.estimaterank`` <http://pdal.io/stages/filters.estimaterank.html>`__
- Estimate rank of each neighborhood of k-nearest neighbors. By
@chambbj
- ```filters.eigenvalues`` <http://pdal.io/stages/filters.eigenvalues.html>`__
- Compute pointwise Eigenvalues. By @chambbj
- ```filters.iqr`` <http://pdal/io/stages/filters.iqr.html>`__ - Filter
outliers in a given dimension by computing Interquartile Range (IQR).
By @chambbj
- ```filters.kdistance`` <http://pdal.io/stages/filters.kdistance.html>`__
- Compute pointwise K-distance. By @chambbj
- ```filters.radialdensity`` <http://pdal.io/stages/filters.radialdensity.html>`__
- Compute pointwise radial density. By @chambbj
- ```filters.outlier`` <http://pdal.io/stages/filters.outlier.html>`__
- Radius and statistical outliers. By @chambbj
New writers
-----------
- ```writers.gdal`` <http://pdal.io/stages/writers.gdal.html>`__ -
`points2grid <http://github.com/crrel/points2grid>`__ replacement. By
@abellgithub
New kernels
-----------
- ```kernels.hausdorff`` <http://pdal.io/apps/hausdorff.html>`__ -
Compute `Hausdorff
distance <https://en.wikipedia.org/wiki/Hausdorff_distance>`__
between two point clouds. By @chambbj
Improvements
------------
- `Filename
globbing <http://man7.org/linux/man-pages/man7/glob.7.html>`__ is now
supported in the JSON pipeline specification of reader input files.
Note that tilde expansion is NOT supported.
- Source tree reorganization
https://lists.osgeo.org/pipermail/pdal/2016-December/001099.html
- CMake updates to utilize ``target_include_directory`` and
``target_link_libraries``.
- JSON output for ``pdal --showjson --drivers`` and
``pdal --showjson --options`` to support application builders being
able to fetch active lists of stages, kernels, and options.
https://github.com/PDAL/PDAL/issues/1315
- Stacktrace logging to stderr on Unix systems
https://github.com/PDAL/PDAL/pull/1329
- Geometry ingestion enhancements now support using
`GeoJSON <http://geojson.org>`__ or WKT in pipeline options
https://github.com/PDAL/PDAL/pull/1339.
- Significant Python extension refactor
https://github.com/PDAL/PDAL/pull/1367 including ability to fetch
data schema, log, and pipeline information. Common utility classes to
support the Python extension were refactored in support of the Java
extension.
- Java extension by `Azavea <https://www.azavea.com/>`__ to support
using PDAL in `Spark <http://spark.apache.org/>`__ and friends.
https://github.com/PDAL/PDAL/pull/1371
- ```kernels.density`` <http://pdal.io/stages/kernels.density.html>`__
- Density kernel now supports writing into an existing OGR datasource
https://github.com/PDAL/PDAL/pull/1396
- ```readers.greyhound`` <http://pdal.io/stages/readers.greyhound.html>`__
- Greyhound reader refactor.
- Multi-threaded read support
- Server-side filtering pass-through
- ```writers.derivative`` <http://pdal.io/stages/writers.derivative.html>`__
- Derivative writer refactor.
- ``slope_d8``
- ``slope_fd``
- ``aspect_d8``
- ``aspect_fd``
- ``contour_curvature``
- ``profile_curvature``
- ``tangential_curvature``
- ``hillshade``
- ``total_curvature``
- Output to any GDAL-writable format
https://github.com/PDAL/PDAL/issues/1146
- ```filters.crop`` <http://pdal.io/stages/filters.crop.html>`__ -
Radial cropping https://github.com/PDAL/PDAL/issues/1387
- ```filters.stats`` <http://pdal.io/stages/filters.stats.html>`__ -
Optional per-dimension median and MAD computation
- Support was added for the recently added cartesian coordinate in BPF
files.
- ```writers.p2g`` <http://pdal.io/stages/writers.p2g.html>`__ now uses
the InCoreInterp method of the points2grid code. This uses more
memory but runs faster and doesn't crash.
- The application now provides better error feedback on command-line
errors by indicating the invoked kernel when an error is detected.
- PDAL now searches by default in the following locations for plugins:
``"." "./lib", "../lib", "./bin", "../bin"``. Use
``PDAL_DRIVER_PATH`` to explicitly override the plugin search
location.
- Vector-based command-line arguments now accept default values in the
API.
- JSON parsing errors of pipeline files now provide more detailed
messages.
- Writers now add output filenames to metadata.
- Stage names provided as input to other stages in pipelines can now be
specified as strings or arrays of strings. The previous version
required single input stage names to be placed in an array.
- Added ``--smooth`` option to
```filters.hexbin`` <http://pdal.io/stages/filters.hexbin.html>`__ to
allow user control of boundary smoothing.
Bug fixes
---------
- Well-known text provided as a spatial reference isn't interpreted by
GDAL unless necessary.
- ```filters.hexbin`` <http://pdal.io/stages/filters.hexbin.html>`__
now returns ``MULTIPOLYGON EMPTY`` when it is unable to compute a
boundary.
- Reading a not a number (nan) value from a text file now works
properly.
- The ``--compression`` option for
```writers.pcd`` <http://pdal.io/stages/writers.pcd.html>`__ has been
fixed so that the writer actually compresses as requested.
- The stage manager (and hence, pipelines) now properly recognizes the
text reader as
```readers.text`` <http://pdal.io/stages/readers.text.html>`__.
- ```readers.text`` <http://pdal.io/stages/readers.text.html>`__ now
detects the case when a dimension has been specified more than once
in an input file.
- Fixed a problem where
```filters.splitter`` <http://pdal.io/stages/filters.splitter.html>`__
could create cells larger than requested about the X and Y axes.
- ```writers.nitf`` <http://pdal.io/stages/writers.nitf.html>`__ now
errors if it attempts to write an FTITLE field that exceeds the
allowable length.
- If PDAL is build with LAZperf but without LASzip, the program now
properly defaults to using LAZperf.
- Fixed a problem where
```filters.sort`` <http://pdal.io/stages/filters.sort.html>`__ could
fail to properly order points depending on the implementation of the
C++ sort algorithm.
- Fixed a problem in pgpostgres readers and writers where a failure in
a query could lead to a crash.
================================================================================
1.3.0
================================================================================
Changes of Note
================================================================================
- Command line parsing has been reworked to cause invalid options to emit
an error message. Stage options specified in pipelines and on the command
line are handled similarly.
- The dimension PlatformHeading has been renamed to Azimuth. When looking
up a dimension by name, the string "platformheading" is still accepted and
returns Azimuth.
- Errors detected by GDAL are no longer thrown as exceptions. A log message
is emitted instead.
- Well-known dimensions are now added to PDAL by editing a JSON file,
Dimension.json.
- Linking with PDAL using CMake no longer requires explicit linking with
curl, jsoncpp or arbiter libraries.
- PDAL now searches for plugins in the following locations and order by
default: ./lib, ../lib, ../bin, the location where PDAL was installed.
- The '--debug' and '--verbose' options are no longer supported as stage
options. The '--verbose' option is accepted on the PDAL command line. The
'--debug' option is deprecated, and if specified on the command line is
equivalent to '--verbose=3'. One can enable logging programmatically by
calling setLog() on a PipelineManager or a specific stage.
- pdal::Dimension types are now C++11 enumeration classes. The change may
require editing any Stage implementations you might have and removing the
extraneous ::Enum type specification.
Enhancements
================================================================================
- Pipelines can now be read directly from standard input.
- Files can now be read from Amazon S3 buckets by providing an appropriate
URL.
- Many new filters have been added: filters.approximatecoplanar,
filters.eigenvalues, filters.estimaterank, filters.hag, filters.normal,
filters.outlier, filters.pmf, filters.sample. Most of these are algorithm
extractions from the PCL library, with the hope of eliminating the need
for PCL in some future PDAL release.
- The PLY reader now loads dimensions that aren't predefined PDAL dimensions.
- A '--driver' option has been added to allow a specific driver to be loaded
for a file without regard to its extension.
- The PDAL_DRIVER_PATH environment variable now accepts a list of locations
to search for drivers.
- Beta release quality drivers improvements in readers.greyhound
- Beta quality implementation of Mongus and Zalik ground filter
- Experimental implementation of Pingel et al. ground filter
- writers.pcd enhancements by Logan Byers (binary, compression) -- requires
PCL
- Docker images upgraded to Ubuntu Xenial
- Cyclone PTS reader -- readers.pts
- skewness, kurtosis, stddev, and variance added to filters.stats output
- Python API now available https://pypi.python.org/pypi/pdal
Fixes
================================================================================
- A failure that may have resulted when using filters.hexbin to calculate
density in the southern hemisphere has been corrected.
- A failure to create the index file with 'pdal tindex' and GDAL 2.X has
been fixed.
- The '--tindex' option for the 'pdal tindex' command is now a positional
option as specified in the documentation.
- The icebridge reader now reads the X dimension as longitude and forces
the value in the range (-180, 180]. It also properly uses the dimension
Azimuth instead of ScanAngleRank.
- An error in writers.pgpointcloud where it ignored SQL to be run at the end
of the stage has been fixed.
- An error that might incorrectly write values stored internally as bytes
when written as a different data type has been fixed.
- A problem where 'pdal info' wouldn't properly report dimension names not
predefined by PDAL has been fixed.
- A bug in filters.crop that wouldn't properly transform coordinates when