Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

CC-22130 Enable code coverage based PR gating for Bigquery #318

Draft
wants to merge 140 commits into
base: 1.6.x
Choose a base branch
from
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
140 commits
Select commit Hold shift + click to select a range
d9577fa
Fix Docker integration test to create retriever.tar
criccomini Nov 2, 2016
d07e56a
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Dec 5, 2016
7ae57bb
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Dec 13, 2016
ce7e08c
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Aug 18, 2017
2a587e3
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Oct 27, 2017
30f29c5
release version 1.1.0
whynick1 Apr 27, 2018
3ecfd8e
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Aug 28, 2018
8f52dc0
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Sep 21, 2018
011b871
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Sep 27, 2018
0194a8a
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Sep 28, 2018
9e84f04
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Oct 1, 2018
2a22c23
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Jun 23, 2019
bc20a83
Merge pull request #119 from jgao54/close-executor
Jul 30, 2018
ebb5750
Prevent context update after/while rebalancing (#161)
nicolasguyomar Jun 20, 2019
96846d6
release version 1.1.2
criccomini Jun 26, 2019
e155285
Merge branch 'master' of github.com:wepay/kafka-connect-bigquery
criccomini Jul 1, 2019
4514a2f
release version 1.2.0
criccomini Jul 1, 2019
31ffaa8
Bump to next snapshot version for 1.1.x
C0urante Sep 10, 2020
9cedaeb
Bump to next snapshot version for 1.2.x
C0urante Sep 10, 2020
4931d3f
Bump to next snapshot version for 1.3.x
C0urante Sep 10, 2020
3f3a329
Bump to next snapshot version for 1.4.x
C0urante Sep 10, 2020
dbbe599
Bump to next snapshot version for 1.5.x
C0urante Sep 10, 2020
603e3a3
Bump to next snapshot version for 1.6.x
C0urante Sep 10, 2020
1f7950a
Merge branch '1.1.x' into 1.2.x
C0urante Sep 15, 2020
2ab60d3
Merge branch '1.2.x' into 1.3.x
C0urante Sep 15, 2020
1d8fed3
Merge branch '1.3.x' into 1.4.x
C0urante Sep 15, 2020
91f092a
Merge branch '1.4.x' into 1.5.x
C0urante Sep 15, 2020
b1112ff
Merge branch '1.5.x' into 1.6.x
C0urante Sep 15, 2020
d9f602d
GH-32: Switch from Gradle to Maven for build tool (#34)
C0urante Sep 23, 2020
41f6c42
Manual merge 1.1.x into 1.2.x
C0urante Sep 23, 2020
37716f3
Manual merge 1.2.x into 1.3.x
C0urante Sep 23, 2020
90eba19
Manual merge 1.3.x into 1.4.x
C0urante Sep 23, 2020
ae8bdcb
Manual merge 1.4.x into 1.5.x
C0urante Sep 23, 2020
114b0b9
Manual merge 1.5.x into 1.6.x
C0urante Sep 23, 2020
b6e8298
MINOR: Add Jenkinsfile (#35)
C0urante Sep 23, 2020
e476c57
Merge branch '1.1.x' into 1.2.x
C0urante Sep 23, 2020
441a491
Merge branch '1.2.x' into 1.3.x
C0urante Sep 23, 2020
d653ae7
Merge branch '1.3.x' into 1.4.x
C0urante Sep 23, 2020
58656ba
Merge branch '1.4.x' into 1.5.x
C0urante Sep 23, 2020
4bee3ab
Merge branch '1.5.x' into 1.6.x
C0urante Sep 23, 2020
f0ec339
MINOR: Fix BigQueryWriterTest unit test (#36)
C0urante Sep 23, 2020
4eee99e
GH-39: Fix NPE when null inner values are encountered with field sani…
C0urante Oct 2, 2020
e8b9bbc
Merge branch '1.3.x' into 1.4.x
C0urante Oct 2, 2020
2809ac0
Merge branch '1.4.x' into 1.5.x
C0urante Oct 2, 2020
a401e95
Merge branch '1.5.x' into 1.6.x
C0urante Oct 2, 2020
4ab4917
MINOR: Modify license headers, add automated license header generatio…
C0urante Oct 6, 2020
aa36960
Manual merge 1.1.x into 1.2.x
C0urante Oct 6, 2020
bdbc97e
Manual merge 1.2.x into 1.3.x
C0urante Oct 6, 2020
c351c2c
Manual merge 1.3.x into 1.4.x
C0urante Oct 6, 2020
faefe01
Manual merge 1.4.x into 1.5.x
C0urante Oct 6, 2020
95d3c83
Manual merge 1.5.x into 1.6.x
C0urante Oct 6, 2020
63ecc65
CC-12157: Throw nicer exception on detecting cycle in schema (#47)
ncliang Oct 16, 2020
f24c75d
MINOR: Catch 'request payload exceeds size' errors from BigQuery and …
C0urante Oct 17, 2020
b56fb36
1.6.x backports (#58)
atrbgithub Nov 23, 2020
506233d
[maven-release-plugin] prepare release v1.6.6
C0urante Nov 23, 2020
65eae70
[maven-release-plugin] prepare for next development iteration
C0urante Nov 23, 2020
dc87644
Update docs URL path (#66)
tikimims Jan 8, 2021
ca13178
Merge branch '1.2.x' into 1.3.x
C0urante Jan 8, 2021
f644db7
Merge branch '1.3.x' into 1.4.x
C0urante Jan 8, 2021
5576b30
Merge branch '1.4.x' into 1.5.x
C0urante Jan 8, 2021
e6170c3
Merge branch '1.5.x' into 1.6.x
C0urante Jan 8, 2021
8f163b0
MINOR: Remove outdated properties (#107)
C0urante May 5, 2021
00a1dd6
Merge branch '1.1.x' into 1.2.x
C0urante May 5, 2021
282b6f7
Merge branch '1.2.x' into 1.3.x
C0urante May 5, 2021
a552e4b
Merge branch '1.3.x' into 1.4.x
C0urante May 5, 2021
ce05794
Merge branch '1.4.x' into 1.5.x
C0urante May 5, 2021
ed22f2c
Merge branch '1.5.x' into 1.6.x
C0urante May 5, 2021
a672fcd
GH-65: Add support for Kafka logical Time type (#112)
C0urante May 11, 2021
ec09e3e
[maven-release-plugin] prepare release v1.6.7
C0urante Sep 2, 2021
0986d11
[maven-release-plugin] prepare for next development iteration
C0urante Sep 2, 2021
85b8de3
Register TimestampConverter in DebeziumLogicalConverters. (#137)
C0urante Sep 8, 2021
7232276
[maven-release-plugin] prepare release v1.6.8
C0urante Sep 9, 2021
98c7c62
[maven-release-plugin] prepare for next development iteration
C0urante Sep 9, 2021
986995e
adding table and column information to help debugging (#152)
fuxiao224 Sep 24, 2021
a3fa7c4
GH-139: Move all user-visible configuration properties to single conf…
C0urante Nov 1, 2021
1a9bfbd
[GH-161] Fixed cast error of Long in debezium time converter (#162)
subkanthi Nov 2, 2021
15fe0f5
[maven-release-plugin] prepare release v1.6.9
C0urante Nov 12, 2021
4c68def
[maven-release-plugin] prepare for next development iteration
C0urante Nov 12, 2021
d8fc535
GH-149: Improve error messages on write thread failure (#150)
C0urante Nov 17, 2021
5280d0e
GH-139: Improve preflight config validation (#153)
C0urante Nov 17, 2021
56aa0cf
CCDB-4929: Fixing "Code scanning"/CodeQL warnings. (#229)
ManasjyotiSharma Aug 4, 2022
e03b76f
Merge branch '1.1.x' into 1.2.x by ManasjyotiSharma
ConfluentJenkins Aug 4, 2022
ee7c76e
Merge branch '1.2.x' into 1.3.x by ManasjyotiSharma
ConfluentJenkins Aug 4, 2022
053be4c
Merge branch '1.3.x' into 1.4.x by ManasjyotiSharma
ConfluentJenkins Aug 4, 2022
36340c8
Merge branch '1.4.x' into 1.5.x by ManasjyotiSharma
ConfluentJenkins Aug 4, 2022
4f18cbe
Merge branch '1.5.x' into 1.6.x by ManasjyotiSharma
ConfluentJenkins Aug 4, 2022
c129f21
Updating the debeziumLogicalConverters to honor the leading 0 in micr…
shaikzakiriitm Dec 5, 2022
ea510fe
Merge pull request #249 from confluentinc/rcca-9963
kapilchhajer Dec 8, 2022
7d41807
Merge branch '1.1.x' into 1.2.x by kapilchhajer
ConfluentJenkins Dec 8, 2022
c28d8c7
Merge branch '1.2.x' into 1.3.x by kapilchhajer
ConfluentJenkins Dec 8, 2022
b55ceba
Merge branch '1.3.x' into 1.4.x by kapilchhajer
ConfluentJenkins Dec 8, 2022
57dede6
Merge branch '1.4.x' into 1.5.x by kapilchhajer
ConfluentJenkins Dec 8, 2022
a7a4c14
Merge branch '1.5.x' into 1.6.x by kapilchhajer
ConfluentJenkins Dec 8, 2022
4557b21
[CCDB-5307] Upgrade protobuf-java to 3.19.6
sp-gupta Jan 11, 2023
ef274dd
Merge pull request #259 from confluentinc/CCDB-5307-vulnerable-depend…
sp-gupta Jan 16, 2023
c35bdba
Merge branch '1.1.x' into 1.2.x
sp-gupta Jan 16, 2023
706f095
Merge branch '1.2.x' into 1.3.x by sp-gupta
ConfluentJenkins Jan 16, 2023
91d3514
Merge branch '1.3.x' into 1.4.x by sp-gupta
ConfluentJenkins Jan 16, 2023
966315b
Merge branch '1.4.x' into 1.5.x by sp-gupta
ConfluentJenkins Jan 16, 2023
ce386fd
Merge branch '1.5.x' into 1.6.x by sp-gupta
ConfluentJenkins Jan 16, 2023
d42320d
Merge Conflict Resolution from 1.1.x to 1.2.x
sp-gupta Jan 16, 2023
6c8c6f8
Merge pull request #262 from sp-gupta/1.2.x
sp-gupta Jan 17, 2023
4f28f0f
Merge branch '1.2.x' into 1.3.x by sp-gupta
ConfluentJenkins Jan 17, 2023
10d5c94
Merge branch '1.3.x' into 1.4.x by sp-gupta
ConfluentJenkins Jan 17, 2023
29523a7
Merge branch '1.4.x' into 1.5.x
sp-gupta Jan 17, 2023
3d492c5
Merge pull request #264 from sp-gupta/1.5.x
sp-gupta Jan 17, 2023
2a08684
Merge branch '1.5.x' into 1.6.x
sp-gupta Jan 17, 2023
441e0f2
Merge pull request #266 from sp-gupta/1.6.x
sp-gupta Jan 17, 2023
a61e528
[maven-release-plugin] prepare release v1.1.3
sp-gupta Jan 17, 2023
8e3c66d
[maven-release-plugin] prepare for next development iteration
sp-gupta Jan 17, 2023
5bed5d5
Merge branch '1.1.x' into 1.2.x (using strategy ours)
sp-gupta Jan 17, 2023
0f1ab84
Merge branch '1.2.x' into 1.3.x (using strategy ours)
sp-gupta Jan 17, 2023
1f0964c
Merge branch '1.3.x' into 1.4.x (using strategy ours)
sp-gupta Jan 17, 2023
5f2a04a
Merge branch '1.4.x' into 1.5.x (using strategy ours)
sp-gupta Jan 17, 2023
af08df0
Merge branch '1.5.x' into 1.6.x (using strategy ours)
sp-gupta Jan 17, 2023
36bee9e
[maven-release-plugin] prepare release v1.3.1
sp-gupta Jan 17, 2023
c606c54
[maven-release-plugin] prepare for next development iteration
sp-gupta Jan 17, 2023
c91c68b
Merge branch '1.3.x' into 1.4.x (using strategy ours)
sp-gupta Jan 17, 2023
2b74ee3
Merge branch '1.4.x' into 1.5.x (using strategy ours)
sp-gupta Jan 17, 2023
8cb7542
Merge branch '1.5.x' into 1.6.x (using strategy ours)
sp-gupta Jan 17, 2023
8210d2e
[maven-release-plugin] prepare release v1.2.1
sp-gupta Jan 17, 2023
2e27544
[maven-release-plugin] prepare for next development iteration
sp-gupta Jan 17, 2023
cffcd98
Merge branch '1.2.x' into 1.3.x (using strategy ours)
sp-gupta Jan 17, 2023
ebf5fd1
Merge branch '1.3.x' into 1.4.x (using strategy ours)
sp-gupta Jan 17, 2023
66349cd
Merge branch '1.4.x' into 1.5.x (using strategy ours)
sp-gupta Jan 17, 2023
e9ed4d3
Merge branch '1.5.x' into 1.6.x (using strategy ours)
sp-gupta Jan 17, 2023
a1c7499
[maven-release-plugin] prepare release v1.6.10
sp-gupta Jan 17, 2023
bb24587
[maven-release-plugin] prepare for next development iteration
sp-gupta Jan 17, 2023
d5fbf14
[maven-release-plugin] prepare release v1.4.2
sp-gupta Jan 19, 2023
e636726
[maven-release-plugin] prepare for next development iteration
sp-gupta Jan 19, 2023
62aaf75
Merge branch '1.4.x' into 1.5.x (using strategy ours)
sp-gupta Jan 19, 2023
a6eba80
Merge branch '1.5.x' into 1.6.x (using strategy ours)
sp-gupta Jan 19, 2023
31998bc
[maven-release-plugin] prepare release v1.5.3
sp-gupta Jan 19, 2023
7055e42
[maven-release-plugin] prepare for next development iteration
sp-gupta Jan 19, 2023
db332ed
Merge branch '1.5.x' into 1.6.x (using strategy ours)
sp-gupta Jan 19, 2023
c525134
[CCDB-4843] Register TimestampConverter in DebeziumLogicalConverters …
sp-gupta Mar 10, 2023
143b1d2
Merge pull request #287 from confluentinc/CCDB-4843
sp-gupta Mar 16, 2023
c2aa14b
CC-22130 : Adding jacoco code coverage limits
amitr17 Aug 28, 2023
a7be655
CC-22130 : Removed jacoco code coverage limits
amitr17 Aug 28, 2023
188428b
CC-22130 : Added jacoco code coverage limits
amitr17 Aug 28, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 3 additions & 1 deletion .gitignore
Original file line number Diff line number Diff line change
@@ -1,8 +1,10 @@
bin/
build/
target/
*.class
*.jar
*.tar
*.zip

.gradle

Expand All @@ -22,6 +24,6 @@ build/
key.json

test.conf
kcbq-connector/src/integration-test/resources/test.properties
kcbq-connector/src/test/resources/test.properties
kcbq-connector/test/docker/connect/properties/
kcbq-connector/out/
32 changes: 0 additions & 32 deletions .travis.yml

This file was deleted.

25 changes: 25 additions & 0 deletions Jenkinsfile
Original file line number Diff line number Diff line change
@@ -0,0 +1,25 @@
#!/usr/bin/env groovy
/*
* Copyright 2020 Confluent, Inc.
*
* This software contains code derived from the WePay BigQuery Kafka Connector, Copyright WePay, Inc.
*
* Licensed under the Apache License, Version 2.0 (the "License");
* you may not use this file except in compliance with the License.
* You may obtain a copy of the License at
*
* http://www.apache.org/licenses/LICENSE-2.0
*
* Unless required by applicable law or agreed to in writing,
* software distributed under the License is distributed on an
* "AS IS" BASIS, WITHOUT WARRANTIES OR CONDITIONS OF ANY
* KIND, either express or implied. See the License for the
* specific language governing permissions and limitations
* under the License.
*/
common {
slackChannel = '#connect-warn'
nodeLabel = 'docker-oraclejdk8'
publish = false
downStreamValidate = false
}
10 changes: 5 additions & 5 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -41,24 +41,24 @@ save the properties file.
Once you get more familiar with the connector, you might want to revisit the `connector.properties`
file and experiment with tweaking its settings.

### Building and Extracting a Tarball
### Building and Extracting a Confluent Hub archive

If you haven't already, move into the repository's top-level directory:

```bash
$ cd /path/to/kafka-connect-bigquery/
```

Begin by creating a tarball of the connector with the Confluent Schema Retriever included:
Begin by creating Confluent Hub archive of the connector with the Confluent Schema Retriever included:

```bash
$ ./gradlew clean distTar
$ mvn clean package -DskipTests
```

And then extract its contents:

```bash
$ mkdir -p bin/jar/ && tar -C bin/jar/ -xf kcbq-confluent/build/distributions/kcbq-confluent-*.tar
$ mkdir -p bin/jar/ && cp kcbq-connector/target/components/packages/wepay-kafka-connect-bigquery-*/wepay-kafka-connect-bigquery-*/lib/*.jar bin/jar/
```

### Setting-Up Background Processes
Expand Down Expand Up @@ -196,7 +196,7 @@ cannot occupy more than one line** (this inconvenience is due to limitations in
Console Producer, and may be addressed in future commits).

To specify data verification, add a new JUnit test to the file
`src/integration-test/java/com/wepay/kafka/connect/bigquery/it/BigQueryConnectorIntegrationTest.java`.
`src/test/java/com/wepay/kafka/connect/bigquery/it/BigQueryConnectorIntegrationTest.java`.
Rows that are retrieved from BigQuery in the test are only returned as _Lists_ of _Objects_. The
names of their columns are not tracked. Construct a _List_ of the _Objects_ that you expect to be
stored in the test's BigQuery table, retrieve the actual _List_ of _Objects_ stored via a call to
Expand Down
Loading