forked from apache/bigtop
-
Notifications
You must be signed in to change notification settings - Fork 0
/
Copy pathCHANGES.txt
2891 lines (2738 loc) · 183 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
# Licensed to the Apache Software Foundation (ASF) under one or more
# contributor license agreements. See the NOTICE file distributed with
# this work for additional information regarding copyright ownership.
# The ASF licenses this file to You under the Apache License, Version 2.0
# (the "License"); you may not use this file except in compliance with
# the License. You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.
Bigtop Changelog
* Release 1.6.0 (unreleased)
* Release 1.5.0 (2020-12-07)
Release Notes - Bigtop - Version 1.5.0
** Sub-task
* [BIGTOP-3165] - Bump Spark to 2.4.5
* [BIGTOP-3188] - Bump Zeppelin to 0.8.1
* [BIGTOP-3215] - Failed to build bigtop/puppet image for OpenSuSE
* [BIGTOP-3220] - Add support for Elasticsearch deb build
* [BIGTOP-3221] - Add support for Elasticsearch rpm build
* [BIGTOP-3222] - Add puppet deployment for Elasticsearch
* [BIGTOP-3223] - Add smoke tests for Elasticsearch
* [BIGTOP-3276] - Update supported distros in the toolchain manifests for v1.5.0
* [BIGTOP-3279] - Bump Zookeeper to 3.4.13
* [BIGTOP-3281] - Bump Tez to 0.9.2
* [BIGTOP-3282] - Bump Hive to 2.3.6
* [BIGTOP-3285] - Bump Kafka to 2.4.0
* [BIGTOP-3286] - Bump Ignite to 2.7.6
* [BIGTOP-3287] - Bump Hadoop to 2.10.0
* [BIGTOP-3288] - Update supported distros in the Docker build scripts for v1.5.0
* [BIGTOP-3289] - Bump Tomcat to 8.5.50
* [BIGTOP-3297] - Bump HBase to 1.5.0
* [BIGTOP-3298] - Bump Phoenix to 4.15.0-HBase-1.5
* [BIGTOP-3305] - Bump Flume to 1.9.0
* [BIGTOP-3306] - Bump Giraph to 1.2.0
* [BIGTOP-3313] - Bump solor to 6.6.6
* [BIGTOP-3315] - Bump Alluxio to 1.8.2
* [BIGTOP-3343] - Add Debian 10 and Ubuntu 18.04 support to the Docker provisioner
* [BIGTOP-3356] - Add CentOS 8 support to the Docker provisioner
* [BIGTOP-3363] - Drop Apex, Hama and Tajo in the 1.5.0 release
* [BIGTOP-3375] - Bump Livy to 0.7.0 and build it with Python3
** Bug
* [BIGTOP-2742] - broken zeppelin init script
* [BIGTOP-3029] - "--parser" is invalidated in puppet v4.x. Affects Debian-9 builds
* [BIGTOP-3208] - Exception in master branch (and branch-1.4): kafka-server failed to launch due to missing zookeeper AsyncCallback.MultiCallback
* [BIGTOP-3216] - Flink smoke test failed on Debian-9
* [BIGTOP-3261] - Fix broken BPS Dockerfile
* [BIGTOP-3265] - Fix TEZ build error
* [BIGTOP-3266] - Rat check failed for one file with unapproved/unknown licenses
* [BIGTOP-3290] - Fix build failure of Oozie
* [BIGTOP-3291] - Fix build failure of Sqoop
* [BIGTOP-3292] - Fix service configuration of sqoop2-server
* [BIGTOP-3295] - Fix build failure of hadoop-2.10.0 on CentOS 8
* [BIGTOP-3296] - Creating apt repository fails on Ubuntu 18.04
* [BIGTOP-3299] - Fix Zookeeper build to make other build success
* [BIGTOP-3302] - init scripts using su do not work on recent systemd
* [BIGTOP-3303] - Fix build failure of hbase-1.5.0 on Ubuntu
* [BIGTOP-3304] - Fix build failure of Flume against hive-2.3.6
* [BIGTOP-3308] - Openssl fails to load in hadoop checknative -a on Debian 9
* [BIGTOP-3309] - Missing build target for Debian 10 in BigTop 1.5
* [BIGTOP-3310] - URL of maven and ant package list page is changed
* [BIGTOP-3311] - Fix Alluxio build failure with upgraded hadoop version
* [BIGTOP-3312] - Fix Ambari build failure due to maven repo requires https now
* [BIGTOP-3314] - Fix flink build failure with upgraded hadoop version
* [BIGTOP-3316] - Fix HBase build failure on Arm platform
* [BIGTOP-3317] - Oozie sharedlib create command fails when uploading to HDFS
* [BIGTOP-3327] - Fix Zeppelin build issue after upgrading Spark-2.4.5
* [BIGTOP-3330] - oozie and oozie-client deb packages try to install the same jars in the same dir
* [BIGTOP-3331] - Provisioner Deployment failed on Fedora
* [BIGTOP-3332] - Add new provisioner yaml configuration for Fedora 31
* [BIGTOP-3333] - Fix Hive build after upgrading Spark to 2.4.5
* [BIGTOP-3334] - Fix Oozie build after upgrading Spark to 2.4.5
* [BIGTOP-3335] - Fix Mahout build after upgrading Spark to 2.4.5
* [BIGTOP-3336] - Fix Livy build on CentOS and Fedora
* [BIGTOP-3338] - Fix `./gradlew repo` to work with GPDB and QFS on Ubuntu 18.04
* [BIGTOP-3339] - Fix Ambari build failure due to using old Bower
* [BIGTOP-3341] - Support for Openssl 1.1.1
* [BIGTOP-3347] - Fix failures of Hive ProxyFileSystem against Hadoop 2.10.0
* [BIGTOP-3348] - Fix Hive test failures caused by NoSuchMethodError of ApplicationId.fromString
* [BIGTOP-3351] - Fix sqoop build error on Ubuntu 18.04
* [BIGTOP-3352] - Fix qfs build error on Ubuntu 18.04
* [BIGTOP-3355] - [Puppet] Make GPG check for repos a configuration and default to true
* [BIGTOP-3359] - Fix failure of installing Hadoop due to conflicting .build-id entry on CentOS 8
* [BIGTOP-3361] - No libcrypt.so.1 in Fedora-31
* [BIGTOP-3364] - Zeppelin build failed in Ubuntu16.04/18.04 and CentOS7
* [BIGTOP-3372] - Building Spark fails on Debian 9 and Ubuntu 16.04
* [BIGTOP-3376] - Make Mpack as a standalone component in Bigtop
* [BIGTOP-3377] - Fix deployment failures on Fedora 31
* [BIGTOP-3378] - Fix Livy deployment failure on Debian and Ubuntu
* [BIGTOP-3379] - Fix Spark build failure on CentOS 8
* [BIGTOP-3380] - Bump Tomcat to 8.5.57
* [BIGTOP-3386] - Building GPDB fails on CentOS 8
* [BIGTOP-3387] - Building QFS fails on CentOS 8
* [BIGTOP-3390] - Building Alluxio fails on Fedora 31
* [BIGTOP-3392] - All packaging jobs are failing on Fedora 31 for aarch64 and ppc64le
* [BIGTOP-3394] - Building Logstash is failing on CentOS 8, Debian 10 and Ubuntu 18.04
* [BIGTOP-3395] - Building Kafka is failing on Fedora 31 for ARM64
* [BIGTOP-3396] - Building Ambari is failing on Fedora 31 for ARM64
* [BIGTOP-3397] - Building Spark is failing on CentOS 7 for ARM64 and PPC64
* [BIGTOP-3398] - Fix GPDB puppet manifest to work
* [BIGTOP-3399] - Fix bigtop-groovy build failure
* [BIGTOP-3401] - Failed to build Centos-8 docker images for Arm64
* [BIGTOP-3406] - Fix Oozie smoke test to work
* [BIGTOP-3407] - Ensure the procps package is installed in Debian 10
* [BIGTOP-3408] - docker-hadoop.sh generates broken site.yaml from config.yaml containing multiple components
* [BIGTOP-3410] - Fix bigtop-tomcat build failure due to downloading problem
* [BIGTOP-3413] - QFS doesn't work with Hadoop's TeraGen
* [BIGTOP-3414] - Fix the default value of GPDB configuration for smoke test
* [BIGTOP-3416] - Fix YCSB to work with CentOS 8 and Fedora 31
* [BIGTOP-3418] - Fix Ambari deployment on CentOS 8, Fedora 31 and Debian 10
* [BIGTOP-3422] - Fix ambari-server setup failure due to PostgreSQL initdb error
* [BIGTOP-3425] - Deploying Ambari fails on Fedora 31
* [BIGTOP-3426] - Flink smoke test fails with fedora-31 and debian-10 on arm64
* [BIGTOP-3427] - Deploying GPDB fails due to the paramiko installation on some distros
* [BIGTOP-3429] - QFS smoke test fails on Ubuntu 16.04
* [BIGTOP-3430] - QFS smoke test fails on Fedora 31/arm64
* [BIGTOP-3437] - Building Logstash fails due to amazing_print version mismatch
* [BIGTOP-3439] - Oozie's smoke test fails on CentOS and Fedora
* [BIGTOP-3440] - Building flume fails on all distros
* [BIGTOP-3443] - Building Spark fails on Ubuntu 16.04
* [BIGTOP-3444] - Bump Hadoop to 2.10.1
* [BIGTOP-3446] - Fix toolchain task failure due to undefined variable in renv.pp
* [BIGTOP-3448] - Building Alluxio fails on all distros
* [BIGTOP-3449] - Failed to build Haddop-2.10.1 on Arm64
* [BIGTOP-3451] - Fix smoke test for SparkR
* [BIGTOP-3455] - Hive 2.2.x bug with DBTokenStore
* [BIGTOP-3458] - Fix broken dependency on groovy-all in the test framework
* [BIGTOP-3459] - Deploying GPDB fails on ARM64 CentOS 7
* [BIGTOP-3462] - Deploying Livy fails if the SPARK_HOME directory doesn't exist
** New Feature
* [BIGTOP-2961] - Add Apache Livy (incubating) to Bigtop stack
* [BIGTOP-3219] - Add Elasticsearch as component
* [BIGTOP-3293] - Add hadoop-kms package
* [BIGTOP-3319] - Add Logstash as Bigtop component
* [BIGTOP-3320] - Add Kibana as Bigtop component
* [BIGTOP-3325] - Spark LICENSE files should be exempted by RAT check
* [BIGTOP-3411] - Disable unnecessary scm check in Buildnumber-maven-plugin for Mpack
** Improvement
* [BIGTOP-3092] - kafka charm: support juju storage
* [BIGTOP-3168] - Kafka smoke tests implementation
* [BIGTOP-3214] - Install python libraries for Livy
* [BIGTOP-3217] - Add smoke tests for Apache Livy
* [BIGTOP-3234] - TEZ smoke tests implementation
* [BIGTOP-3236] - Zeppelin smoke tests implementation
* [BIGTOP-3237] - Add smoke tests for YCSB
* [BIGTOP-3259] - Update the default stack version for docker-provisioner to 1.4.0
* [BIGTOP-3300] - Add puppet manifests for hadoop-kms
* [BIGTOP-3301] - Add smoke-tests for hadoop-kms
* [BIGTOP-3337] - Remove Node.js from the toolchain
* [BIGTOP-3353] - hive.hwi.war.file configuration is no longer needed
* [BIGTOP-3358] - get_roles() function should fail if a component is not in roles_map
* [BIGTOP-3362] - Unable to install spark-python package on CentOS8 due to lack of python package
* [BIGTOP-3369] - RHEL8 does not have PowerTools repo but CodeReady Builder
* [BIGTOP-3371] - Unable to build Apache Ambari on RHEL8
* [BIGTOP-3374] - Add dependencies on the utilities provided by Bigtop to bigtop.bom
* [BIGTOP-3389] - Extend timeout for installing protobuf and R packages
* [BIGTOP-3391] - Support GPDB on Perl 5.30+ environment
* [BIGTOP-3405] - Make gpg_check in docker-hadoop.sh configurable
* [BIGTOP-3415] - Extend timeout for Spark smoke test
* [BIGTOP-3431] - Update github Readme.md to be more newbie friendly
* [BIGTOP-3441] - Suppress YCSB smoke test output
* [BIGTOP-3460] - Extend timeout for Ambari Server setup
** Wish
* [BIGTOP-3268] - Add ability to change limits for nagios checks in charm
** Task
* [BIGTOP-3015] - hadoop-spark bundle correction
* [BIGTOP-3123] - Define Bigtop 1.5.0 release BOM
* [BIGTOP-3318] - Use secure repo in bigtop-tests
* [BIGTOP-3322] - Lintian Warnings in Hadoop
* [BIGTOP-3340] - Add Masatake Iwasaki to team list
* [BIGTOP-3409] - Move bigtop website off from CMS: staging
* [BIGTOP-3419] - Automate Deployment to asf-site
* Release 1.4.0 (2019-03-24)
Release Notes - Bigtop - Version 1.4.0
** Sub-task
* [BIGTOP-2012] - Add new tests for webhdfs
* [BIGTOP-2993] - Switch to gradle XXX-pkg-ind feature developed in BIGTOP-2949 for Bigtop CI
* [BIGTOP-2994] - Document the new feature added in BIGTOP-2949
* [BIGTOP-2995] - Add example CI pipeline to build end-to-end from a commit to smoke test
* [BIGTOP-2996] - Update Smoke Test CI matrix against Bigtop master Distros
* [BIGTOP-3009] - Add gradle repo-ind
* [BIGTOP-3110] - [Puppet] Hive metastore can not startup successfully
* [BIGTOP-3114] - [Test] HBase Importtsv smoke tests are failing
* [BIGTOP-3115] - [Puppet] Alluxio master/worker can not startup successfully
* [BIGTOP-3117] - [Puppet] Can't run spark commands for Spark on Yarn deployment
* [BIGTOP-3118] - [Puppet] Failed to deploy GPDB
* [BIGTOP-3120] - [Puppet] Annoying warning message from Ambari snippet
* [BIGTOP-3121] - [Provisioner] Can't create docker containers after using Docker Provisioner on Amazon Linux
* [BIGTOP-3122] - CI matrix for smoke tests
* [BIGTOP-3124] - Remove package installation in provisioner/utils/smoke-tests.sh and polish the script
* [BIGTOP-3126] - [Puppet] Failed to deploy QFS due to Permission denied error at initailization
* [BIGTOP-3129] - Failed to run QFS smoke test
* [BIGTOP-3130] - Failed to run Alluxio smoke test
* [BIGTOP-3131] - Apex smoke test requires mvn to compile test jar
* [BIGTOP-3132] - Bump Alluxio up to 1.8.1
* [BIGTOP-3133] - [Puppet] Add a module to deploy bigtop-utils
* [BIGTOP-3134] - [Puppet] An upgrade to deploy Alluxio 1.8.1
* [BIGTOP-3136] - [Provisioner] Local built repo should have higher priority
* [BIGTOP-3138] - Maven installation failed on debian-9
* [BIGTOP-3139] - Failed to deploy Ambari on CentOS/Fedora cause no service command available
* [BIGTOP-3140] - [Test] TestHadoopExamples.groovy can have $USER = null when running in Docker
* [BIGTOP-3141] - Release number is not honored by the build system
* [BIGTOP-3142] - Better user expereince when calling docker-hadoop.sh -d with no cluster running
* [BIGTOP-3144] - [Test] QFS smoke test failed on multi-node cluster
* [BIGTOP-3146] - gradlew is not available in bigtop-tests/smoke-tests for running run_itest.sh
* [BIGTOP-3147] - Nexus proxy cache configuration is broken
* [BIGTOP-3148] - Error out when configure-nexus encounter any issue
* [BIGTOP-3149] - Support to enable Nexus proxy for Docker Provisioner
* [BIGTOP-3150] - [Provisioner] Raise proper exit code and error messages when provisioning failed
* [BIGTOP-3153] - Switch to docker cp based solution to build inside containers
* [BIGTOP-3154] - [Provisioner] Failed to bootstrap provisioning environment on Debian/Ubuntu
* [BIGTOP-3155] - Setup manual smoke test for Pull Requests
* [BIGTOP-3157] - Failed to start Ambari server and agent on Fedora 26
* [BIGTOP-3158] - [Test] Fix test specification with maven failsafe plugin
* [BIGTOP-3159] - Failed to deploy Alluxio due to Puppet compatibility issue
* [BIGTOP-3160] - [Provisioner] Treat both exit code 0 and 2 as success for Puppet execution
* [BIGTOP-3161] - Upgrade to Puppet 5.X
* [BIGTOP-3163] - Bump Hadoop to 2.8.5
* [BIGTOP-3164] - Bump Kafka to 1.1.1
* [BIGTOP-3166] - Update Kerberos module to comply with Puppet's syntax
* [BIGTOP-3167] - Nexus is always enabled for ./gradlew XXX-ind
* [BIGTOP-3169] - Enable local repo is not working on yum systems
* [BIGTOP-3170] - Loop and wait for daemon to be started up for Alluxio
* [BIGTOP-3171] - Update Kafka Puppet module for version 1.1.1
* [BIGTOP-3172] - [Provisioner] Support to specify components and smoke-tests when launching Docker Provisioner
* [BIGTOP-3173] - Fix bugs and improve usability of COMPONENT-pkg-ind
* [BIGTOP-3174] - ./gradlew repo-ind failed on Bigtop build slaves
* [BIGTOP-3175] - [Build] Support to specify commit SHA1 when building packages
* [BIGTOP-3176] - [Build] Support non X86 archs for COMPONENT-pkg-ind
* [BIGTOP-3177] - [Build] Exit w/o container left dangling when running docker in gradle wrapper
* [BIGTOP-3179] - Connection refused by www-us.apache.org mirror site
* [BIGTOP-3180] - Gradle 5 incompatible issue
* [BIGTOP-3181] - Build as non-root for COMPONENT-pkg-ind
* [BIGTOP-3182] - Helper message and documentation of new XXX-ind features
* [BIGTOP-3183] - Zeppelin build failed
* [BIGTOP-3185] - Bump Kafka to 2.1.1
* [BIGTOP-3186] - Bump Spark to 2.2.3
* [BIGTOP-3187] - Bump Flume to 1.9.0
* [BIGTOP-3189] - Allow to specify more properties/options at command line for docker provisioner
* [BIGTOP-3190] - Compatibility issue for Zeppelin with Spark 2.2.3
* [BIGTOP-3191] - Old Gradle version causes Kafka 2.1.1 build failed
* [BIGTOP-3192] - Remove Spark 1.6 from the stack
* [BIGTOP-3193] - Add REPO and MEMORY as options for docker-provisioner
* [BIGTOP-3195] - Add pkgs-ind to package all artifacts inside docker
* [BIGTOP-3196] - Drop Apache Crunch in Bigtop distribution
* [BIGTOP-3197] - [Docker] Treat both exit code 0 and 2 as success for Puppet execution
* [BIGTOP-3198] - [Sandbox] Support AARCH64/PPC64LE
* [BIGTOP-3199] - Can not run smoke test inside docker-provisioner
* [BIGTOP-3200] - Bugfix Integration test framework 2.0 and documentation
* [BIGTOP-3203] - [Sandbox] Architecture string is a mess for Distributions
* [BIGTOP-3206] - Missing /etc/init.d/functions when deploying Alluxio on Fedora 26
* [BIGTOP-3207] - [Provisioner] Do not exit when destroying got no cluster exists
* [BIGTOP-3209] - Revert Kafka to 0.10.2.2 and Flume to 1.8.0
* [BIGTOP-3210] - Missing /lib/lsb/init-functions when deploying Flink on Fedora 26
* [BIGTOP-3212] - Deploy QFS client failed due to no such directory error
* [BIGTOP-3213] - Bugs in pom.xml files when releasing Bigtop 1.4.0
** Bug
* [BIGTOP-2595] - Make Spark1 and Spark2 coexist
* [BIGTOP-2892] - The download page should provide instructions to check hashes and signatures
* [BIGTOP-2986] - Oozie build is failing
* [BIGTOP-3099] - Fix oozie build
* [BIGTOP-3102] - docker-hadoop.sh WARNING: The scale command is deprecated
* [BIGTOP-3107] - QFS cannot compile with newer Oracle SDK
* [BIGTOP-3112] - Update release KEYS file from dist.apache.org to apache.org/dist
* [BIGTOP-3113] - Update previous releases links to the archive.apache.org in the download page
* [BIGTOP-3125] - [provisioner] sbin/init is missed in puppet:opensuse-42.3
* [BIGTOP-3151] - Add flink smoke test
* [BIGTOP-3184] - URLConnection check fails with exception when it should return false
* [BIGTOP-3194] - Phoneix QueryServer PID file name in svc file is inconsistent with that in QueryServer's execution script
** New Feature
* [BIGTOP-2947] - Project Frontier: Bigtop Integration Test Framework 2.0
** Improvement
* [BIGTOP-1227] - Deploy artifacts to maven repository
* [BIGTOP-3085] - Hello world example for adding a new package
* [BIGTOP-3135] - Remove deprecated giraph-site.xml
* [BIGTOP-3152] - No need to Force the use of Netty over Hadoop RPC in Giraph
* [BIGTOP-3204] - Upgrade flink from 1.4.2 to 1.6.0 or higher
** Task
* [BIGTOP-3098] - Update maven plugins for project pom
* [BIGTOP-3105] - Sync up site changes from branch 1.3 to master
* [BIGTOP-3106] - Update links in download page
* [BIGTOP-3108] - Update version strings to 1.3.0 in the master
* [BIGTOP-3109] - Overhaul the deployment and testing modules
* [BIGTOP-3128] - Switch to new gitbox repository
* [BIGTOP-3162] - Define Bigtop 1.4.0 release BOM
* [BIGTOP-3178] - Fix two insecure maven repositories
* Release 1.3.0 (2018-8-16)
Release Notes - Bigtop - Version 1.3.0
** Sub-task
* [BIGTOP-2833] - [puppetize.sh] Support centos-7-aarch64 support
* [BIGTOP-2893] - Bump Hadoop to 2.8.1
* [BIGTOP-2894] - Bump HBASE to 1.3.1
* [BIGTOP-2895] - Bump Pig to 0.17.0
* [BIGTOP-2897] - Bump Phoenix to 4.11-HBASE-1.3
* [BIGTOP-2898] - Bug: regression in Phoenix build after BIGTOP-2895
* [BIGTOP-2899] - Bug: regression in Oozie build after BIGTOP-2895
* [BIGTOP-2949] - Add gradle task which leverage bigtop-ci/build.sh to build packages
** Bug
* [BIGTOP-2101] - ignite-hadoop contains an arch-dependent shared lib
* [BIGTOP-2213] - tez build downloads amd64 nodejs executable
* [BIGTOP-2292] - Remove Centos 6 Support
* [BIGTOP-2503] - Solr packaging is broken on both DEB and RPM
* [BIGTOP-2634] - package perl-Env does not exist in centos 6
* [BIGTOP-2679] - Streamline CI Jobs
* [BIGTOP-2723] - Fix asciidoctor-maven-plugin for HBase build on AArch64
* [BIGTOP-2737] - Spark charm doesn't handle HA or examples well
* [BIGTOP-2738] - spark-worker fails to start
* [BIGTOP-2748] - Fix a puppet compatibilty issue
* [BIGTOP-2749] - puppet: use jessie package on jessie, not trusty
* [BIGTOP-2750] - puppet: increase compatibility with future versions
* [BIGTOP-2753] - Initial support for Debian-9
* [BIGTOP-2754] - Revert BIGTOP-2730: Upgrade Zookeeper to version 3.4.10
* [BIGTOP-2804] - Drop Solr package and Puppet snippets
* [BIGTOP-2818] - Ambari downloads jdk
* [BIGTOP-2826] - Zeppelin RPM is broken: "missing" osgi package deps
* [BIGTOP-2829] - [iTest] build failed during Maven integration test phase
* [BIGTOP-2832] - Toolchain failed to install on Debian 8
* [BIGTOP-2835] - puppet fails when bigtop::jdk_preinstalled is true
* [BIGTOP-2836] - charm metric collector race condition
* [BIGTOP-2838] - Support ARM64 for packages.gradle
* [BIGTOP-2841] - Failed to build bigtop/slaves-ubuntu-16.04-aarch64
* [BIGTOP-2844] - zeppelin charm: spark config should match zeppelin spark config
* [BIGTOP-2847] - Building from git is broken
* [BIGTOP-2850] - Not able to build bigtop/slaves image for OpenSuSE 42.1
* [BIGTOP-2859] - Missing HIVE_VERSION when build hive rpms
* [BIGTOP-2860] - Fix TestSpark.groovy syntax error
* [BIGTOP-2863] - Test build failed for incompatible JavaDoc format with JDK-8-121 and later
* [BIGTOP-2864] - Tez with "Class path contains multiple SLF4J bindings" warnings
* [BIGTOP-2866] - Fix rmr depricated and people* No such file or directory error
* [BIGTOP-2878] - Download task does not work for git repositories
* [BIGTOP-2881] - Greenpulm 5.0 got released - lets switch the Bigtop to it
* [BIGTOP-2885] - gpdb: disable gpcloud on CentOS 6
* [BIGTOP-2890] - Download page must not link to snapshots / nightly builds
* [BIGTOP-2891] - Download page must link to ASF mirrors
* [BIGTOP-2903] - update protobuf rpm links
* [BIGTOP-2906] - Failed to start solr-server service using bigtop-deploy
* [BIGTOP-2907] - upgrading Ambari from 2.5.0 to 2.5.2
* [BIGTOP-2908] - giraph charm: release audit failure
* [BIGTOP-2909] - ppc64le: Zeppelin 0.7.2 build is failing
* [BIGTOP-2911] - Change Solr service ports to default 8983/8984
* [BIGTOP-2912] - Intialize dataset for solr smoke test
* [BIGTOP-2915] - Some files are missing ALv2 header
* [BIGTOP-2917] - Ignite smoke test failed with JDK8
* [BIGTOP-2926] - introduce bigtop version into bigtop/puppet images
* [BIGTOP-2929] - Fix typo in opensuse version name
* [BIGTOP-2930] - sqoop fedora26 : rsync missing
* [BIGTOP-2931] - hadoop debian-9 : Unmet build dependencies: libssl-dev
* [BIGTOP-2932] - hadoop fedora26: openssl in native code problem
* [BIGTOP-2934] - Consolidate puppet usage by installing puppet from distro
* [BIGTOP-2935] - provisioner: Use proper command line depending on puppet version
* [BIGTOP-2942] - update tez to 0.9
* [BIGTOP-2943] - hbase does not compile with maven-3.5.2
* [BIGTOP-2944] - Update hbase and fix compilation issue
* [BIGTOP-2950] - BIGTOP-2869 breaks RAT check
* [BIGTOP-2953] - qfs is not buildable under Debian 9
* [BIGTOP-2957] - Upgrade YCSB to 0.12.0
* [BIGTOP-2958] - Tez should use appropriate profile for Hadoop shims
* [BIGTOP-2968] - Bump Hive version to 2.3.2
* [BIGTOP-2973] - Hama packaging is broken with Hadoop 2.8+
* [BIGTOP-2976] - zookeeper-rest missing dependency on lsb-base
* [BIGTOP-2979] - JAVA_HOME inconsistent on non-x86 architectures
* [BIGTOP-2980] - Hama does not build on DEB type systems
* [BIGTOP-2981] - Packaging SparkR is broken due to BIGTOP-2959
* [BIGTOP-2984] - Rat check failed after BIGTOP-2698
* [BIGTOP-2987] - Phoenix build break
* [BIGTOP-2990] - Upgrade Phoenix version to 4.13.1-HBase-1.3
* [BIGTOP-2991] - Bump up Spark version to 2.2.1
* [BIGTOP-3001] - Change uid and gid for jenkins user in bigtop-toolchain
* [BIGTOP-3003] - Ant-1.9.9 tarball is removed from Apache mirrors
* [BIGTOP-3004] - Fix HBase build failure on Debian/Fedora
* [BIGTOP-3013] - kafka charm: fail to deploy using Bigtop-trunk-repos
* [BIGTOP-3014] - juju: use charm-env for shebangs
* [BIGTOP-3018] - detect-javahome script has a typo in variable name
* [BIGTOP-3023] - Bump qfs to 2.0.0
* [BIGTOP-3024] - Zeppelin build is failed after Spark is bumpped to 2.2.1
* [BIGTOP-3025] - ci.bigtop.apache.org certificate is expired and causes errors
* [BIGTOP-3026] - 404 error: http://ci.bigtop.apache.org/view/Packages/job/Bigtop-trunk-packages/
* [BIGTOP-3027] - Wrong Leveldbjni native binary for aarch64
* [BIGTOP-3030] - Fix Ambari build failure on non-x86 platforms
* [BIGTOP-3033] - Spark build on OpenSUSE is failed
* [BIGTOP-3035] - Provisioner failed because init is missed in Debian-9
* [BIGTOP-3036] - Download gradle and groovy via TLS and do signature checking on ant
* [BIGTOP-3037] - Download maven securely
* [BIGTOP-3040] - Solr's default configsets doesn't work with smoke test cases
* [BIGTOP-3041] - Failed to init hadoop hdfs using init-hdfs.sh
* [BIGTOP-3042] - HDFS TestHDFSQuota doesn't match Hadoop's definition
* [BIGTOP-3044] - Fix docker build command for simple sh
* [BIGTOP-3045] - Remove insecure maven repository URL from gradle config
* [BIGTOP-3046] - Not correct auto find latest maven dist
* [BIGTOP-3048] - Revert BIGTOP-3001 to bring packaging CI back
* [BIGTOP-3050] - cgroups: cannot found cgroup mount destination: unknown
* [BIGTOP-3052] - Maven version is fixed in security verification code
* [BIGTOP-3053] - Tez failed to build due to bower version is deprecated
* [BIGTOP-3054] - Missing Spark archive caused Zeppelin build failure
* [BIGTOP-3061] - Crunch build failure
* [BIGTOP-3076] - QFS build failed on ppc64le
* [BIGTOP-3077] - OpenSuse-42.3 packages install error
* [BIGTOP-3078] - ignite-shmem failed to build on ppc64le
* [BIGTOP-3081] - Update HBase/Ignite-hadoop arch info
* [BIGTOP-3082] - Fix build failure with flume-1.8+kafka-0.10.2.2
* [BIGTOP-3083] - HBase and iginite-hadoop build failed on Fedora-26 due to BIGTOP-3081
* [BIGTOP-3088] - provisioner failed to run puppet deployment on CentOS-7
* [BIGTOP-3089] - Update provision config files with changes in 1.3.0 release
* [BIGTOP-3090] - provisioner failed on fedora-26 when deploying jdk
* [BIGTOP-3091] - Set Bigtop repo to higher priority
** New Feature
* [BIGTOP-2868] - Travis integration for Jar files.
* [BIGTOP-3007] - expose hive config options for zookeeper
** Improvement
* [BIGTOP-2698] - Build/install protobuf-2.5 from source
* [BIGTOP-2730] - Bump zookeeper to 3.4.10
* [BIGTOP-2784] - Bump version of Solr to 6.5.1
* [BIGTOP-2787] - [bigtop-slaves] Support of CentOS 7 ARM64 bigtop-slaves
* [BIGTOP-2794] - [bigtop-puppet] Support CentOS 7 AArch64 bigtop puppet
* [BIGTOP-2809] - Support R integration for Spark
* [BIGTOP-2810] - Support R integration for Zeppelin
* [BIGTOP-2811] - Add R to toolchain for Spark and Zeppelin
* [BIGTOP-2819] - Polish the README.md for 1.2.1 release
* [BIGTOP-2824] - [sandbox] Support CentOS 7 AArch64 sandbox
* [BIGTOP-2825] - Upgrade gradle to the latest 4.0
* [BIGTOP-2834] - spark charm: refactor for restricted networks; lib cleanup
* [BIGTOP-2839] - Bump Hadoop version to 2.7.4
* [BIGTOP-2843] - Add provisioner config yaml for ubuntu-16.04-aarch64
* [BIGTOP-2846] - Add DSL documentation for GIT-based builds
* [BIGTOP-2848] - Add provisioner docker yaml config file CentOS-7 AArch64
* [BIGTOP-2851] - [bigtop-puppet] Add Debian 8 AArch64 bigtop puppet
* [BIGTOP-2852] - [bigtop-slaves] Add Debian 8 AArch64 bigtop-slaves
* [BIGTOP-2853] - [sandbox] Add Debian 8 AArch64 sandbox
* [BIGTOP-2854] - Add provisioner docker yaml config file Debian 8 AArch64
* [BIGTOP-2856] - [sandbox] Add a condition in detect_repo()
* [BIGTOP-2857] - Add aarch64 support for fedora-25
* [BIGTOP-2858] - Add AArch64 support for Debian 9
* [BIGTOP-2867] - spark charm: make bigtop version configurable
* [BIGTOP-2869] - Bump solr to 6.6.0
* [BIGTOP-2872] - Replace aarch64 orgnanization with the more-specific arm64v8 organization in Official docker
* [BIGTOP-2874] - juju bundle refresh (august 2017)
* [BIGTOP-2875] - giraph charm: update metadata/readme
* [BIGTOP-2882] - Bump Hadoop and all dependencies to actual releases
* [BIGTOP-2889] - Remove HADOOP_HOME_WARN_SUPPRESS setting
* [BIGTOP-2910] - zeppelin charm: support bigtop upgrade
* [BIGTOP-2914] - GPDB 5.1.0 has been release. Let's bump that
* [BIGTOP-2916] - fix deprecated gradle syntax
* [BIGTOP-2918] - Update distributions for Bigtop-1.3
* [BIGTOP-2919] - Update maven to 3.5.2
* [BIGTOP-2920] - Cleanup puppet recipies: remove deprecated platforms
* [BIGTOP-2922] - Drop arch specific bigtop-* images
* [BIGTOP-2925] - Missing license header for .travis.yml
* [BIGTOP-2936] - Add RedHat default Oracle Java install location to detection script
* [BIGTOP-2959] - Add SPARK_DIST_CLASSPATH to include libraries for HDFS and YARN
* [BIGTOP-2974] - Add puppet code to deploy SparkR package
* [BIGTOP-2989] - Building Hadoop with a pre-downloaded Tomcat
* [BIGTOP-2992] - Building Pig with pre-arranged Forrest
* [BIGTOP-3002] - For Kafka, it should be possible to set the broker.id config and log.dirs config.
* [BIGTOP-3005] - Add zkpeer-relation-changed hook to zookeeper charm.
* [BIGTOP-3010] - juju bundle refresh (feb 2018)
* [BIGTOP-3011] - zookeeper: support autopurge.purgeInterval and autopurge.snapRetainCount.
* [BIGTOP-3031] - Auto find latest maven dist
* [BIGTOP-3038] - Add rollingupgrade option in hadoop-hdfs-namenode.svc
* [BIGTOP-3039] - Change git browse link to Github
* [BIGTOP-3047] - Add nagios monitoring to zookeeper charm.
* [BIGTOP-3055] - Bump GPDB to 5.10.0
* [BIGTOP-3058] - Bump flume to 1.8.0
* [BIGTOP-3059] - Bump Ambari to 2.6.1
* [BIGTOP-3060] - juju bundle refresh (august 2018)
* [BIGTOP-3062] - Bump flink to 1.4.2
* [BIGTOP-3064] - Bump HBase to 1.3.2
* [BIGTOP-3065] - Bump Hadoop to 2.8.4
* [BIGTOP-3066] - Bump tez to 0.9.1
* [BIGTOP-3067] - Bump Hive to 2.3.3
* [BIGTOP-3068] - Bump Hama to 0.7.1
* [BIGTOP-3069] - Bump crunch to 0.15.0
* [BIGTOP-3103] - Update download page to comply with Apache announcement requirements
** Test
* [BIGTOP-2865] - HBase smoke test implementation
** Task
* [BIGTOP-2739] - refresh juju bundles with latest charm revs
* [BIGTOP-2877] - Drop Kite packaging
* [BIGTOP-2884] - Upgrade gcc to support C++11 on CentOS 6
* [BIGTOP-2924] - Bring back 1.2.1 changes into master
* [BIGTOP-2945] - Define Bigtop 1.3 release BOM
* [BIGTOP-2969] - Bump up Spark version to 2.2.0
* [BIGTOP-2970] - Bump Zeppelin version to 0.7.3
* [BIGTOP-3006] - Add Jun He to team list
* [BIGTOP-3063] - [Umbrella] Efforts for 1.3.0 release
* [BIGTOP-3074] - Drop oozie packaging
* [BIGTOP-3075] - Drop pig packaging
* [BIGTOP-3106] - Update links in download page
* Release 1.2.1 (2017-10-24)
Release Notes - Bigtop - Version 1.2.1
** Sub-task
* [BIGTOP-2165] - ignite-hadoop service doesn't start
* [BIGTOP-2396] - Create CI jobs for new Docker Provisioner
* [BIGTOP-2758] - [Sandbox] Support dryrun in build script
* [BIGTOP-2760] - [Sandbox] Upgrade to Bigtop 1.2
* [BIGTOP-2761] - Remove bigtop-deploy image build scripts
* [BIGTOP-2767] - Auto detect repo does not need OS code name since 1.2.0
* [BIGTOP-2769] - OS_TO_CODE_NAME has been removed in BIGTOP-2767
* [BIGTOP-2772] - [Sandbox] Add --dryrun mode into helper script and document
* [BIGTOP-2814] - Make provisioner config names be consistent with OS names in CI
* [BIGTOP-2815] - Puppet should be able to generate multiple repo files
* [BIGTOP-2816] - Fix provisioner config name for ubuntu-16.04
** Bug
* [BIGTOP-2295] - Docker tests should consume current builds
* [BIGTOP-2679] - Streamline CI Jobs
* [BIGTOP-2716] - Solr build failed when OpenJDK8u_121 is used
* [BIGTOP-2729] - AMBARI-20686: Add ID to allow compilation with recent maven
* [BIGTOP-2737] - Spark charm doesn't handle HA or examples well
* [BIGTOP-2738] - spark-worker fails to start
* [BIGTOP-2740] - hbase 1.1.3 does not work on ppc64le
* [BIGTOP-2743] - hbase shell does not work on ppc64le
* [BIGTOP-2748] - Fix a puppet compatibilty issue
* [BIGTOP-2749] - puppet: use jessie package on jessie, not trusty
* [BIGTOP-2750] - puppet: increase compatibility with future versions
* [BIGTOP-2751] - ambari: Storm 1.1.0-SNAPSHOT is no longer available, use released version
* [BIGTOP-2753] - Initial support for Debian-9
* [BIGTOP-2754] - Revert BIGTOP-2730: Upgrade Zookeeper to version 3.4.10
* [BIGTOP-2755] - Gradle needs cacerts file in place on fedora
* [BIGTOP-2756] - Get rid of Permission Denied when creating/destroying Docker Provisioner cluster
* [BIGTOP-2762] - Zeppelin installation failed due to JDK not installed
* [BIGTOP-2763] - Add /user/zeppelin directory for running Spark job on YARN in Zeppelin
* [BIGTOP-2764] - deployment failure when roles include spark::common and spark::yarn*
* [BIGTOP-2765] - fix roles logic for spark/zeppelin charms
* [BIGTOP-2766] - [Puppet] Spark worker startup failed due to default master_url is yarn
* [BIGTOP-2771] - ambari: build failed due to using third-party ConcurrentHashMap instead of the standard one unnecessarily
* [BIGTOP-2774] - gradlew toolchain does not work on Ubuntu 16.04.2/Puppet 3.8.5
* [BIGTOP-2775] - Make open jdk 8 available on bigtop/puppet:debian-8
* [BIGTOP-2781] - [Provisioner] 127.0.0.1 does not successfully inserted after BIGTOP-2756
* [BIGTOP-2788] - Corrects Apex patch for version 3.6.0
* [BIGTOP-2789] - Ambari: installing ODPi mpack fails due to changing its file name
* [BIGTOP-2790] - Ambari: deploying cluster fails due to ambari-agent version mismatch
* [BIGTOP-2793] - BIGTOP-2790 broke Ambari build on rpm-based system
* [BIGTOP-2796] - Bigtop Zookeeper(3.4.6) package conflict with Ubuntu 16.04 Zookeeper(3.4.8)
* [BIGTOP-2797] - zeppelin charm external role handling
* [BIGTOP-2798] - Apex component has duplicate slf4j binding
* [BIGTOP-2799] - [Puppet] Flink deployment failure on all supported OS
* [BIGTOP-2800] - provisioner fails for kerberos on centos-7
* [BIGTOP-2801] - charm race condition when gathering metrics
* [BIGTOP-2803] - Minor issues in bigtop.bom
* [BIGTOP-2805] - ycsb: turn of autodetection of dependencies by rpm
* [BIGTOP-2806] - hue is not installable on debian, ubuntu
* [BIGTOP-2808] - Handle deletion of symlinks: update gradle
* [BIGTOP-2826] - Zeppelin RPM is broken: "missing" osgi package deps
* [BIGTOP-2829] - [iTest] build failed during Maven integration test phase
* [BIGTOP-2832] - Toolchain failed to install on Debian 8
* [BIGTOP-2850] - Not able to build bigtop/slaves image for OpenSuSE 42.1
* [BIGTOP-2870] - testHCFS should be using USER_NAME for expected output
* [BIGTOP-2871] - Make run_itest report Standard Error from tests to stderr
* [BIGTOP-2873] - A few cosmetic changes to run_itest.sh output
* [BIGTOP-2879] - BIGTOP-2749 breaks deployments on Debian-8
* [BIGTOP-2890] - Download page must not link to snapshots / nightly builds
* [BIGTOP-2891] - Download page must link to ASF mirrors
* [BIGTOP-2900] - Crunch build failed because of OS OOM killer on OpenJDK 1.8.0-144
* [BIGTOP-2901] - disable GPDB because of build failure on OpenSuSE 42.1
* [BIGTOP-2903] - update protobuf rpm links
* [BIGTOP-2908] - giraph charm: release audit failure
** Improvement
* [BIGTOP-2355] - Update Mahout version to 0.13.0
* [BIGTOP-2677] - layer-spark: Improve sparkpi action output
* [BIGTOP-2730] - Bump zookeeper to 3.4.10
* [BIGTOP-2770] - Juju charm/bundle refresh
* [BIGTOP-2777] - make hbase charm more robust
* [BIGTOP-2778] - Delete PermSize / MaxPermsize options, no longer support by Java 8
* [BIGTOP-2783] - new charm icons for zookeeper and zeppelin
* [BIGTOP-2795] - spark charm: fix sparkpi and rework start/stop logic
* [BIGTOP-2802] - Some packages don't create necessary groups on debian-based system if the users correspond to them already exist
* [BIGTOP-2807] - Upgrade Spark to 2.1.1
* [BIGTOP-2812] - Upgrade Zeppelin version to 0.7.2
* [BIGTOP-2819] - Polish the README.md for 1.2.1 release
* [BIGTOP-2821] - expose extra config options for spark
* [BIGTOP-2827] - juju bundle refresh (june 2017)
* [BIGTOP-2828] - Since BIGTOP-2775 JDK version has been specified by Bigtop Puppet
** New Feature
* [BIGTOP-2253] - Rewrite Bigtop Docker Provisioner to use native solutions and support multi-host cluster deployment
* [BIGTOP-2779] - new hive charm
* [BIGTOP-2822] - spark charm: leverage puppet config, gpu enablement
** Task
* [BIGTOP-2739] - refresh juju bundles with latest charm revs
* [BIGTOP-2747] - new charm revs for bigtop-1.2
* [BIGTOP-2776] - Bump Apache Apex version to 3.6.0
* [BIGTOP-2785] - Define Bigtop 1.2.1 release BOM
* [BIGTOP-2786] - Push Bigtop 1.2.1 Docker build slaves to Docker Hub
* [BIGTOP-2877] - Drop Kite packaging
* Release 1.2.0 (2017-04-04)
Release Notes - Bigtop - Version 1.2.0
** Sub-task
* [BIGTOP-1406] - package Ambari in Bigtop
* [BIGTOP-1408] - create basic end-to-end tests for Ambari integration
* [BIGTOP-1409] - consider using ambari shell
* [BIGTOP-1624] - Add puppet recipes for deploying kafka
* [BIGTOP-2179] - Apache Tajo to bigtop: packaging as deb/rpm
* [BIGTOP-2180] - Apache Tajo to bigtop: make tests
* [BIGTOP-2224] - Let's bump groovy version for smokes to 2.4.10
* [BIGTOP-2254] - Replace the Docker orchestration tool from Vagrant to Docker Compose
* [BIGTOP-2285] - Add qfs rpm and debian packaging code
* [BIGTOP-2293] - Add puppet recipes for qfs components
* [BIGTOP-2312] - Add environment check
* [BIGTOP-2314] - Added deb and rpm package of Apache Apex to bigtop.
* [BIGTOP-2315] - Add smoke test for apex
* [BIGTOP-2316] - Add apex puppet receipes
* [BIGTOP-2317] - Add smoke tests for QFS
* [BIGTOP-2319] - Build initial smoke-tests distribution
* [BIGTOP-2326] - Build salves need to have the toolchain run again to install qfs dependencies
* [BIGTOP-2345] - Create Flink packaging
* [BIGTOP-2357] - Create puppet recipes
* [BIGTOP-2468] - Add Juju hadoop-processing bundle
* [BIGTOP-2469] - Add cloud-weather-report test plan
* [BIGTOP-2491] - Update provisioner/docker-hadoop.sh to bind with provisioner/utils
* [BIGTOP-2492] - Split flink debian packaging
* [BIGTOP-2505] - Support systemd containers, clean up hiera.yaml handling, fix exec (-e) flag
* [BIGTOP-2518] - Add node to the build slave configuration
* [BIGTOP-2526] - Bump flink version to 1.1.3
* [BIGTOP-2530] - Create Greenplum packages
* [BIGTOP-2531] - Create Greenplum deployment scripts
* [BIGTOP-2532] - Create Greenplum test
* [BIGTOP-2600] - Bump Groovy version to 2.4.10
* [BIGTOP-2601] - Bump Ignite to 1.9
* [BIGTOP-2613] - create bigtop/puppet docker image or fedora 25
* [BIGTOP-2614] - create bigtop/slave docker image for fedora 25
* [BIGTOP-2620] - Bump oozie version to 4.3.0
* [BIGTOP-2624] - Bump Phoenix version to 4.9.0
* [BIGTOP-2625] - update crunch for JAVA 8
* [BIGTOP-2626] - HBase build fails when JAVA 8 is used
* [BIGTOP-2627] - Kite 1.1.0 build fails when JAVA 8 is used
* [BIGTOP-2646] - Move Vagrant Provisioner from bigtop-deploy/vm to provisioner directory
* [BIGTOP-2647] - Clean up code under bigtop-deploy/vm after everything moved to provisioner directory
* [BIGTOP-2657] - Upgrade to Hue 3.11.0
* [BIGTOP-2668] - Polish and update Docker Provisioner configurations
* [BIGTOP-2672] - Update gradle wrapper for Docker Provisioner
* [BIGTOP-2700] - Adding tests to test the doas feature of httpfs
* [BIGTOP-2701] - Update hcfs tests so it can work in both casers where fs.trash.interval is disabled or enabled.
* [BIGTOP-2702] - Fix Sandbox creation script
* [BIGTOP-2704] - Include ODPi runtime tests option into the battery of smoke tests
* [BIGTOP-2705] - provide puppet deployment code for Ambari
** Bug
* [BIGTOP-976] - package deployment tests are CDH specific: _has_ to be removed or fixed
* [BIGTOP-1533] - failed to load/initialize native-bzip2 library system-native
* [BIGTOP-2047] - detect JAVA_HOME for JDK8, remove obsolete detection code (JDK6/oracle JDK)
* [BIGTOP-2133] - Running BPSGenerator using fat-jar fails on Mac OS X
* [BIGTOP-2134] - Wrong package name in bigpetstore-mapreduce/arch.dot
* [BIGTOP-2135] - PigCSVCleaner fails due to the lack of the dependent jar
* [BIGTOP-2136] - A comment about parameter substitution in BPS_analytics.pig is slightly wrong
* [BIGTOP-2138] - deb: make bigtop-jsvc a wrapper package for jsvc package
* [BIGTOP-2220] - flume-agent.init incorrectly handles flume.conf
* [BIGTOP-2225] - Bump toolchain gradle to 2.10
* [BIGTOP-2229] - bigtop deploy to support centos-7
* [BIGTOP-2231] - build.gradle carries one too many sets of repositories
* [BIGTOP-2261] - adding bigtop/puppet:fedora-22 build support for ppc64le
* [BIGTOP-2274] - CLONE - rpm: need to make bigtop-jsvc a wrapper package for jsvc package
* [BIGTOP-2301] - Bigtop Homepage shows wrong url to CI
* [BIGTOP-2302] - Use apt instead of yum in setup-env-debian.sh
* [BIGTOP-2303] - Fix the indentation in docker-hadoop.sh
* [BIGTOP-2308] - Clean up build directory after sucessfull build of package
* [BIGTOP-2318] - Release assembly needs to be updated
* [BIGTOP-2340] - BIGTOP-2319 is incomplete: the code for smoke-tests is missing
* [BIGTOP-2342] - Set yarn.log.server.url to point to JH server
* [BIGTOP-2346] - Do not use gradle delete() for sources and build directories
* [BIGTOP-2347] - Clean up build directory after sucessfull build of package (2nd try)
* [BIGTOP-2350] - HCatalog WebHCat server's default file incorrectly specifies HCAT_PREFIX AND HADOOP_PREFIX
* [BIGTOP-2353] - fix qfs suse build
* [BIGTOP-2354] - qfs does not build on fedora
* [BIGTOP-2358] - Update the URL for Bigtop-trunk-packages job on README
* [BIGTOP-2359] - Add .DS_Store to .gitignore
* [BIGTOP-2362] - Enabling bigtop docker provisioner for ppc64le (ubuntu 15.04)
* [BIGTOP-2366] - Support https:// repositories for DEB systems
* [BIGTOP-2367] - QFS packages do not handle /var/run/qfs properly
* [BIGTOP-2372] - Puppet deploy README points to non-existing repo
* [BIGTOP-2373] - kinit path is not correctly configured in hue.ini template for CentOs by puppet module
* [BIGTOP-2374] - Toolchain needs clear warning for Puppet <3
* [BIGTOP-2376] - Update Tomcat and remove obsolete downloads
* [BIGTOP-2377] - Update to Hadoop 2.7.2
* [BIGTOP-2378] - Do not use archive.apache.org for ant download
* [BIGTOP-2379] - update maven to 3.3.9 and refactor toolchain
* [BIGTOP-2380] - support opensuse-42.1 (leap)
* [BIGTOP-2382] - Parameterise and expose "default_hdfs_superuser" for hue.ini
* [BIGTOP-2399] - Maven artifacts are still on 2.6.0 version of Apache Hadoop
* [BIGTOP-2400] - Get groovy plugins used by Maven in sync with Bigtop groovy runtime
* [BIGTOP-2401] - a commiter name is missing in the "Who we are" page
* [BIGTOP-2402] - yet another commiter name is missing in the "Who we are" page
* [BIGTOP-2404] - puppetize.sh fails on Ubuntu 14.04 because of the lack of apt-get update
* [BIGTOP-2405] - Rollback BIGTOP-2049 as the original issue was fixed in the upstream
* [BIGTOP-2406] - init scripts do not work reliable on systemd systems
* [BIGTOP-2412] - arm dockerfile breaks RAT
* [BIGTOP-2413] - QFS README.md breaks RAT
* [BIGTOP-2419] - Fix symlinks on packaging Crunch rpm and deb
* [BIGTOP-2421] - Ignite RPM is broken: "missing" osgi package deps
* [BIGTOP-2423] - Fix hard-coded port number in Sqoop smokes
* [BIGTOP-2425] - crunch needs JDK8 javadoc
* [BIGTOP-2427] - jsvc build not recognizing ARM as valid platform
* [BIGTOP-2430] - Adding Dockerfile to build puppet image for ubuntu-16.04-ppc64le
* [BIGTOP-2431] - Adding Dockerfile to build slaves image for ubuntu-16.04-ppc64le
* [BIGTOP-2433] - mvn is missing in Bigtop Toolchain
* [BIGTOP-2434] - Change Spark test to unpack jar file and retrieve resources
* [BIGTOP-2439] - flink: fix adduser and register init.d scripts on DEB systemes
* [BIGTOP-2441] - spark smoke test doesn't work relying on yarn-client submittion
* [BIGTOP-2445] - Adding Dockerfile to build deploy image for ubuntu-16.04-ppc64le
* [BIGTOP-2448] - Adding Dockerfile to build puppet image for ubuntu-16.04-arm
* [BIGTOP-2449] - Adding Dockerfile to build slaves image for ubuntu-16.04-x86
* [BIGTOP-2450] - Adding Dockerfile to build slaves image for ubuntu-16.04-arm
* [BIGTOP-2460] - docker-hadoop.sh fails when deploying on ubunt 16.04 images
* [BIGTOP-2463] - Regression: bigtop-jsvc build fails on ppc64le architecture
* [BIGTOP-2464] - Outdated descriptions in vagrant-puppet-vm/README.md
* [BIGTOP-2471] - qfs does not build on opensuse:42.1
* [BIGTOP-2472] - zeppelin puppet module needs to expose ZEPPELIN_WAR_TEMPDIR
* [BIGTOP-2473] - Mahout puppet script fails to find Package[hadoop]
* [BIGTOP-2474] - Improve handling of gradle home
* [BIGTOP-2487] - Alluxio /var/log/alluxio is not created
* [BIGTOP-2488] - Redundant zookeeper/lib directory
* [BIGTOP-2494] - Use systemd within bigtop/deploy docker image for debian-8, centos-7, fix centos-7 provisioner
* [BIGTOP-2495] - hive-hbase package is broken
* [BIGTOP-2509] - Path error in bigtop-packages/src/common/solr/tomcat-deployment.sh
* [BIGTOP-2512] - Wrong help message in docker-hadoop.sh
* [BIGTOP-2513] - Some RAT exclude rules defined in build.gradle are not defined in pom.xml
* [BIGTOP-2523] - Incorrect cycle dependency during puppet deployment causes error at Debian 8
* [BIGTOP-2527] - Recreate all bigtop docker images and install "host" on debian
* [BIGTOP-2528] - provisioner fails to add short host name
* [BIGTOP-2529] - Vagrant Provisioner failed to start up daemons
* [BIGTOP-2533] - Use TLS for downloading sources
* [BIGTOP-2535] - frontend-maven-plugin fails on ppc64le
* [BIGTOP-2536] - tarball.destination is ignored when set
* [BIGTOP-2537] - Hive smoke test identifies as org.apache.bigtop.itest.hadoop.mapreduce
* [BIGTOP-2542] - Some files related to docker provisioner breaks RAT
* [BIGTOP-2543] - Some minor problems on provisioner/docker/docker-hadoop.sh
* [BIGTOP-2545] - Add ZOOKEEPER-2594 to bigtop
* [BIGTOP-2546] - Make debian/ubuntu toolchain install more resistent agains failures
* [BIGTOP-2549] - "Expected" and "actual" values are mistakenly switched in some JUnit method invocation
* [BIGTOP-2551] - docker-hadoop.sh --create fails with "Error: Could not match |$index" message
* [BIGTOP-2553] - namenode ports are not configured for non-HA mode
* [BIGTOP-2556] - Building Hadoop fails because Tomcat 6.0.45 is not downloadable from Apache mirror
* [BIGTOP-2557] - BIGTOP-2536 broke DataFu, QFS and YCSB
* [BIGTOP-2558] - Add ppc64le and arm64 node to the build slave configuration
* [BIGTOP-2559] - Revert JIRA BIGTOP-2535
* [BIGTOP-2560] - Spark charm failing automated tests
* [BIGTOP-2563] - zeppelin build fails on ppc64le
* [BIGTOP-2564] - HBase build fails on Power
* [BIGTOP-2565] - upgrade Spark to version 1.6.2
* [BIGTOP-2566] - Specify KAFKA_VERSION in build command for Flume
* [BIGTOP-2569] - Spark 2.0
* [BIGTOP-2570] - ease hadoop charm debugging
* [BIGTOP-2582] - Adding Spark1 components for Spark 1.x family
* [BIGTOP-2585] - Zookeeper service does not start if kerberos is disabled
* [BIGTOP-2587] - vagrant-puppet-vm fails with "Could not find class node_with_components"
* [BIGTOP-2588] - Spark 2.0.1 installation fails on DEB
* [BIGTOP-2589] - spark1 build break
* [BIGTOP-2590] - Flume build break on RPM
* [BIGTOP-2591] - Fix bug in BIGTOP-2569
* [BIGTOP-2593] - Build fail caused by tomcat 6.0.45 version
* [BIGTOP-2594] - Workaround to fix Hive Build, by using SPARK1 Version
* [BIGTOP-2596] - Phoenix build fails
* [BIGTOP-2597] - crunch build failed
* [BIGTOP-2599] - Zeppelin 0.6.2 build fails on Power
* [BIGTOP-2602] - ignite-hadoop build break
* [BIGTOP-2603] - NN/RM charm should include a spark user/group
* [BIGTOP-2604] - Build flink-dist with proper shading
* [BIGTOP-2605] - Addendum for BIGTOP-2514
* [BIGTOP-2606] - spark1 build fails when RPM is sellected
* [BIGTOP-2608] - upgrade Hadoop to 2.7.3
* [BIGTOP-2609] - upgrade Kafka to version 0.10.0.0
* [BIGTOP-2610] - upgrade mahout to version 0.12.2
* [BIGTOP-2612] - Need bigtop/puppet image for Fedora-25
* [BIGTOP-2618] - bigtop-jsvc build fails with OpenJDK-1.8
* [BIGTOP-2621] - JAVA_HOME is not set on Fedora-25+JAVA-1.8 for x86
* [BIGTOP-2623] - Zeppelin 0.6.2 build fails on all platforms
* [BIGTOP-2628] - sqoop2 build fails when JAVA 8 is used
* [BIGTOP-2632] - bigtop 1.1.0 sqoop2 wrote rpm error
* [BIGTOP-2635] - ubuntu on ppc64le is missing a apt-get update
* [BIGTOP-2636] - Fix giraph after upgrade to Hadoop-2.7.3
* [BIGTOP-2637] - Fix flume because of kafka 0.10 update
* [BIGTOP-2638] - Update to kafka 0.10.1.0
* [BIGTOP-2640] - Incomplete patch BIGTOP-2635 - Bigtop stack build fails on Ubuntu 16.04-ppc64le
* [BIGTOP-2643] - Force giraph to compile by removing findbugs from all pom.xml
* [BIGTOP-2644] - CI compiles random greenplum source
* [BIGTOP-2648] - Gradle 2.7 SSL Problems
* [BIGTOP-2649] - Default Java8 blocks default debian jdk
* [BIGTOP-2650] - Docker build should pull up to date packages
* [BIGTOP-2651] - Delete obsolete docker images and build files.
* [BIGTOP-2652] - tajo rpm packaging seriously broken
* [BIGTOP-2653] - upgrading to Spark 2.1
* [BIGTOP-2654] - spark 2.1 binaries need either SPARK_HOME or non existing find-spark-home exe
* [BIGTOP-2655] - Help spark find the native hadoop libs
* [BIGTOP-2656] - regression - spark 2.1 upgrade breaks rpm packaging
* [BIGTOP-2661] - Docker deploy images should pull upstream images
* [BIGTOP-2662] - provisioner: Add support for JDK8 on debian
* [BIGTOP-2663] - puppet hadoop module: Consolidate memory resource settings
* [BIGTOP-2664] - create provisioner test for trunk packages with jdk8
* [BIGTOP-2665] - Fix hue for opensuse
* [BIGTOP-2669] - Create bigtop-1.2 repository
* [BIGTOP-2673] - Need to back port HADOOP-11628 for JDK8
* [BIGTOP-2674] - docker-hadoop option -C does not work correctly any more
* [BIGTOP-2675] - [Puppet] Kafka can only be deployed on master node
* [BIGTOP-2676] - Smoke test fails on Spark 2
* [BIGTOP-2678] - Add hive-hbase role to install hive-hbase rpm
* [BIGTOP-2689] - Upgrade Zeppelin to version 0.7
* [BIGTOP-2690] - gradlew toolchain fails trying to download Ant 1.9.8
* [BIGTOP-2692] - Flume init script should load only '.conf' extension files
* [BIGTOP-2693] - Update readme for build and configuring git repo for packages
* [BIGTOP-2695] - arch.dot for bigpetstore-spark is outdated
* [BIGTOP-2699] - Zeppeling CI build is broken
* [BIGTOP-2707] - localhost is missing in docker provisioner instances
* [BIGTOP-2708] - puppet code always installs hdfs by default
* [BIGTOP-2710] - qfs debian build is breaking because it is confused about Maven home
* [BIGTOP-2711] - fix rat problems
* [BIGTOP-2715] - Tiny typo in the README.md
* [BIGTOP-2718] - Mark tez package as arch dependent
* [BIGTOP-2719] - Mark zeppelin package as arch dependent
* [BIGTOP-2721] - libsnappy reference path is not correct for hadoop/ubuntu16 build
* [BIGTOP-2724] - putting a final nail in Java's 7 coffin
* [BIGTOP-2725] - a few usability improvements to run_itest.sh
* [BIGTOP-2726] - Bump ambari version to 2.5
* [BIGTOP-2727] - fix deployment tasks
** Improvement
* [BIGTOP-1608] - Create Unified testing solution: Smoke-Tests and Test-Artifacts
* [BIGTOP-1843] - Upgrade Sqoop to 1.4.6
* [BIGTOP-2077] - Bump HBase version to 1.1
* [BIGTOP-2118] - Update HBase to 0.98.17
* [BIGTOP-2306] - Add support for specifying git repository access credentials
* [BIGTOP-2309] - Update submodules after git clone
* [BIGTOP-2327] - Bump up Phoenix to 4.7.0
* [BIGTOP-2330] - Bump Tachyon version to 0.8.2
* [BIGTOP-2332] - Upgrade Tajo version to 0.11.1
* [BIGTOP-2333] - Make Apache Pig work with HBase 1.1 on Hadoop 2
* [BIGTOP-2337] - Fix script to make deb in Tajo
* [BIGTOP-2351] - Vagrant VM is missing /user/vagrant HDFS directory
* [BIGTOP-2352] - Packaged Vagrant box has incorrect host info on restart
* [BIGTOP-2370] - Upgrade DataFu version to 1.3.0
* [BIGTOP-2381] - Making Zookeeper hosts templatize in puppet module of hue
* [BIGTOP-2384] - Refactor toolchain code to extract packages version out of every action
* [BIGTOP-2385] - Reformat bigtop_toolchain/manifests/packages.pp to ease maintenance
* [BIGTOP-2393] - Add ARM64 support for build environment
* [BIGTOP-2395] - Create separate page to point "Download now" link to
* [BIGTOP-2403] - Remove affiliation column in the team list
* [BIGTOP-2407] - Making "force_username_lowercase" variable templatize in puppet module of hue
* [BIGTOP-2408] - group_filter variable value is not templatize in puppet module of hue
* [BIGTOP-2409] - nt_domain configuration option for hue to connect to Active Directory
* [BIGTOP-2410] - Making "ldap_username_pattern" variable templatize in puppet module of hue
* [BIGTOP-2411] - Add OS-neutral wrappers to build all native packages and repositories
* [BIGTOP-2416] - Upgrade Crunch to 0.13.0
* [BIGTOP-2429] - Add Solr to gradle smokes
* [BIGTOP-2443] - inject unzip method to ZipInputStream, accepting regex for include
* [BIGTOP-2455] - support pre-installed java environment
* [BIGTOP-2458] - Add option to disable IP hostname checking for DataNode registration
* [BIGTOP-2459] - Add option to disable vmem check for NodeManager
* [BIGTOP-2466] - HBase puppet scripts co-deploy ZK and Datanode along with HBase
* [BIGTOP-2478] - Zookeeper does not have any smoke tests
* [BIGTOP-2479] - Update qfs maintainer to kstinson
* [BIGTOP-2490] - Spark in HA when Zookeeper is available
* [BIGTOP-2504] - Kafka should be able to bind to something other than 0.0.0.0/the default interface
* [BIGTOP-2506] - Zookeeper: non default interface for client
* [BIGTOP-2507] - Make buildstamp configurable by a bom file
* [BIGTOP-2516] - Add Zeppelin Charm
* [BIGTOP-2521] - Problem with deprecated methods in puppet code with puppet option parser=future
* [BIGTOP-2522] - Add spark processing juju bundle
* [BIGTOP-2547] - Don't render ip-hostname-check in hdfs-site.xml if default
* [BIGTOP-2548] - Refresh charms for Juju 2.0 and Xenial
* [BIGTOP-2554] - expose bind-host options in hieradata
* [BIGTOP-2555] - hadoop charms should use bind-host overrides
* [BIGTOP-2561] - add juju bundle for hadoop-spark
* [BIGTOP-2571] - cwr driven updates to the zeppelin juju charm
* [BIGTOP-2575] - zk charm test updates
* [BIGTOP-2576] - For small clusters it is useful to turn replace-datanode-on-failure off
* [BIGTOP-2577] - kafka charm test updates
* [BIGTOP-2578] - Puppet needs to be updated for Hive Server2
* [BIGTOP-2579] - Puppet needs to be updated for Hive Metastore service
* [BIGTOP-2611] - Adding Fedora-25 with Java 1.8 support
* [BIGTOP-2616] - refresh juju hadoop-processing bundle
* [BIGTOP-2617] - refresh juju spark-processing bundle
* [BIGTOP-2682] - update juju bundles with recent charm revs
* [BIGTOP-2688] - Add flag for provisioning of Yum Repo
* [BIGTOP-2694] - Added Hernan Vivani (hvivani) as elasticsearch maintainer
* [BIGTOP-2696] - Build out VM for sandboxes
* [BIGTOP-2697] - Back port HADOOP-12366 into Bigtop
* [BIGTOP-2712] - Juju CI driven updates
* [BIGTOP-2714] - Update Groovy in the toolchain to 2.4.10
** New Feature
* [BIGTOP-1641] - Add packaging for Apache Tajo
* [BIGTOP-2282] - Define Bigtop 1.2 release BOM
* [BIGTOP-2296] - Provide a way to build Docker container with functional stack
* [BIGTOP-2339] - add centos-7 to the provisioiner matrix
* [BIGTOP-2435] - Add Juju charms for hadoop component
* [BIGTOP-2451] - Adding Ubuntu 16.04 support to Bigtop
* [BIGTOP-2452] - Adding Dockerfile to build deploy image for ubuntu-16.04-x86
* [BIGTOP-2476] - Add Zookeeper Charm
* [BIGTOP-2477] - Add Juju charm for spark component
* [BIGTOP-2481] - Add HBase Charm
* [BIGTOP-2482] - Adding Pig charm
* [BIGTOP-2483] - Add Mahout Charm
* [BIGTOP-2486] - Add Kafka Charm
* [BIGTOP-2524] - Add Greenplum component
* [BIGTOP-2615] - Provide a tool to build pseudo cluster docker images
* [BIGTOP-2660] - Add Giraph Charm
** Task
* [BIGTOP-2289] - Set master version to 1.2.0-SNAPSHOT
* [BIGTOP-2334] - Update latest release link on the website
* [BIGTOP-2335] - ci link should use https:// authority
* [BIGTOP-2368] - OpenStack config bigtop repo-url changes.
* [BIGTOP-2371] - Add Oozie to gradle smoke tests
* [BIGTOP-2414] - Rename Tachyon to Alluxio
* [BIGTOP-2415] - readme spelling error
* [BIGTOP-2456] - Update Apache Apex version to 3.4.0
* [BIGTOP-2497] - Upgrade Apache Phoenix to 4.8.1
* [BIGTOP-2500] - Remove hadoop jars from TEZ_HOME/lib and create appropriate symlinks
* [BIGTOP-2525] - committer test: add myself to team-list.xml
* [BIGTOP-2538] - Bump version of Solr to 4.10.4
* [BIGTOP-2550] - Update juju hadoop bundle for Juju 2.0 and Xenial
* [BIGTOP-2567] - Upgrade Flume version to 1.7.0
* [BIGTOP-2568] - Upgrade Kafka version to 0.9.0.1
* [BIGTOP-2592] - Upgrade to Spark 2.0.2
* [BIGTOP-2622] - Add Kengo Seki to team list
* [BIGTOP-2629] - Add Jonathan Kelly to team list
* [BIGTOP-2670] - Bump up Apache Apex version to 3.5.0
* [BIGTOP-2687] - Remove /usr/share/java/*.jar from Sqoop2 catalina.properties
* [BIGTOP-2703] - refresh juju charms/bundles with metric and CI support
* [BIGTOP-2722] - Remove workaround allowing build by root in Tez
** Test
* [BIGTOP-2534] - Flume tests fail with java.lang.NoClassDefFoundError: org/apache/commons/io/Charsets
** Wish