v0.39.0

What's Changed

• feat: optimize docker image for #470 by @dmachard in #492
• feat: new length-unit attribute for text-format #478 by @dmachard in #491
• feat: add sampling rate to downsampled items (first shot) by @dmachard in #480
• feat #481 : add compression support for kafka logger by @dmachard in #482
• feat: #453 introduced metrics etldplusone_total and etldplusone_top by @kabenin in #465
• feat: syslog: support batch mode to send logs by @dmachard in #489
• feat #499 : detect go version in a dynamic way for Makefile by @dmachard in #502
• fix #509 : logger prometheus - fix panic error with invalid qname by @dmachard in #514
• fix #461 : regression - closing dnstap stream on bind 9 very slow by @dmachard in #472
• fix #483 : syslog logger - remove NULL char in qname by @dmachard in #484
• refactor: add more linters to golangci-lint by @pieterlexis-tomtom in #456
• refactor: code factory on multiplexer mode by @dmachard in #497
• refactor: code factory on config part to prepare future versions by @dmachard in #498
• doc: update README.md by @dmachard in #479
• chore(deps): bump github.com/miekg/dns from 1.1.56 to 1.1.57 by @dependabot in #476
• chore(deps): bump github.com/cilium/ebpf from 0.12.2 to 0.12.3 by @dependabot in #463
• chore(deps): bump golang.org/x/net from 0.17.0 to 0.18.0 by @dependabot in #464
• chore(deps): bump golang from 1.21.3-alpine3.17 to 1.21.4-alpine3.17 by @dependabot in #462
• chore(deps): bump github.com/segmentio/kafka-go from 0.4.44 to 0.4.45 by @dependabot in #485
• chore(deps): bump github.com/klauspost/compress from 1.17.2 to 1.17.3 by @dependabot in #487
• chore(deps): bump alpine from 3.18.4 to 3.18.5 by @dependabot in #493
• chore(tests): 25 more unit tests for regression added
• chore(ci): bump actions/setup-go and checkout from 2 to 5 by @dependabot in #469 #501 #468
• chore(ci): bump actions/setup-python from 4 to 5 by @dependabot in #500

Full Changelog: v0.38.0...v0.39.0

Bug reporters

• @HackBeiChen
• @johnhtodd
• @james-stevens

v0.38.0

What's Changed

• feat: add badges through github-actions to track test counts and lines of code by @dmachard in #466
• feat: dnstap collector: new settings to disable the embedded dns parser by @dmachard in #458
• feat: support full reload of the configuration on SIGHUP signal by @dmachard in #440
• feat: some code factory in TLS client config and new package for processors by @dmachard in #440 #445
• feat: syslog logger: add new settings to support custom hostname and program name by @dmachard in #442
• feat: syslog logger: rename format settings with formatter (breacking change) by @dmachard in #442
• feat: syslog logger: add new framer option by @dmachard in #442
• feat: add mTLS support on all loggers by @dmachard in #442
• feat: set flat-json as default format on tcp and redispub logger by @dmachard in #445
• fix: powerdns collector: replace go/dnsmessage by miekg/dns by @dmachard in #460
• fix: #450 update tcpclient logger to use flush interval by @mattb-nn in #452
• fix: #434 improve logging in publicsuffix transform by @dmachard in #439
• fix: avoid blocking situation during stop in the ReadFromConnection function on redispub and backport to tcpclient and fluentd loggers by @dmachard in #445
• docs: update loggers settings by @dmachard in #445
• chore(deps): bump github.com/google/uuid from 1.3.1 to 1.4.0 by @dependabot in #444
• chore(deps): replace unmaintained RackSec/srslog by dmachard/go-clientsyslog by @dmachard in #442
• chore(deps): bump github.com/cilium/ebpf from 0.12.0 to 0.12.2 by @dependabot in #435
• chore(deps): bump github.com/klauspost/compress from 1.17.1 to 1.17.2 by @dependabot in #438
• chore(deps): bump github.com/fsnotify/fsnotify from 1.6.0 to 1.7.0 by @dependabot in #437
• chore(deps): bump github.com/prometheus/common from 0.44.0 to 0.45.0 by @dependabot in #436

New Contributors

• @step-security-bot made their first contribution in #447
• @mattb-nn made their first contribution in #452

Full Changelog: v0.37.0...v0.38.0

v0.37.0

What's Changed

• feat: prometheus logger: change on build_info metric by @dmachard in #426
• feat: disable debug informations to get smaller binary by @dmachard in #427
• feat: enable multiarch builds with Dockerfile by @dmachard in #428
• feat: support building for FreeBSD by @pieterlexis-tomtom in #420
• feat: syslog logger: add tag and framing support by @dmachard in #422
• fix: redispub logger: reading redis responses and potential fix for #353 by @gallypette in #411
• fix: ci/gh-actions: fix failing loggers tests by @dmachard in #418
• docs: update logger_restapi.md by @brankomijuskovic in #431
• chore(deps): bump github.com/prometheus/client_golang from 1.16.0 to 1.17.0 by @dependabot in #409
• chore(deps): bump alpine from 3.18.3 to 3.18.4 by @dependabot in #408
• chore(deps): bump golang from 1.21.1-alpine3.17 to 1.21.2-alpine3.17 by @dependabot in #416
• chore(deps): bump golang.org/x/net from 0.15.0 to 0.17.0 by @dependabot in #415 #419
• chore(deps): bump github.com/prometheus/client_model to 0.5.0 by @dependabot in #413
• chore(deps): bump github.com/cilium/ebpf from 0.11.0 to 0.12.0 by @dependabot in #421
• chore(deps): bump github.com/segmentio/kafka-go from 0.4.43 to 0.4.44 by @dependabot in #425

New Contributors

• @brankomijuskovic made their first contribution in #431

Full Changelog: v0.36.0...v0.37.0

v0.36.0

What's Changed

• feat: elasticsearch logger: change op_type to allow sending to Data Streams by @ruffy91 in #400
• feat: support golang 1.21 by @dmachard in #399
• fix: decouple keep-query-ip from drop-query-ip to fix filtering by @arvchristos in #405
• fix: panic error in docker because of go 1.21 by @dmachard in #402
• chore(ci): update github-actions by @dmachard in #404
• chore(deps): bump github.com/miekg/dns from 1.1.55 to 1.1.56 by @dependabot in #398
• chore(deps): bump github.com/klauspost/compress from 1.16.7 to 1.17.0 by @dependabot in #397
• chore(deps): bump golang from 1.21.0-alpine3.17 to 1.21.1-alpine3.17 by @dependabot in #396
• chore(deps): bump github.com/segmentio/kafka-go from 0.4.42 to 0.4.43 by @dependabot in #406

New Contributors

• @ruffy91 made their first contribution in #400

Full Changelog: v0.35.0...v0.36.0

v0.35.0

What's Changed

• [ENHANCEMENT] Refactor ElasticSearch logger for bulk requests support by @arvchristos in #382
• [ENHANCEMENT] Github CI: add dnstap test for coredns v1.11.1 with TLS support by @dmachard in #384
• [ENHANCEMENT] DNSTAP collector: add extra field support by @dmachard in #388
• [ENHANCEMENT] New transform to add features for machine learning by @dmachard in #358
• [ENHANCEMENT] Add rdata ip filtering by @arvchristos in #377
• [ENHANCEMENT] Introduce configurable prometheus labels by @kabenin in #383
• [BUGFIX] RESTful logger: fix minor error in swagger.yml by @dmachard in #390
• [DOCS] Fix and documentations improvements by @dmachard in #364
• [DEPENDENCY] Update Makefile dependencies by @dmachard in #389
• [DEPENDENCY] Bump github.com/dmachard/go-dnstap-protobuf from 0.5.0 to 0.6.0 by @dependabot in #368
• [DEPENDENCY] Bump github.com/dmachard/go-powerdns-protobuf from 0.1.0 to 0.2.0 by @dependabot in #356
• [DEPENDENCY] Bump github.com/segmentio/kafka-go from 0.4.40 to 0.4.42 by @dependabot in #354
• [DEPENDENCY] Bump golang.org/x/sys from 0.9.0 to 0.10.0 by @dependabot in #355
• [DEPENDENCY] Bump golang.org/x/net from 0.10.0 to 0.14.0 by @dependabot in #357 #367
• [DEPENDENCY] Bump golang from 1.20.6-alpine3.17 to 1.21.0-alpine3.17 by @dependabot in #372
• [DEPENDENCY] Bump github.com/cilium/ebpf from 0.10.0 to 0.11.0 by @dependabot in #365
• [DEPENDENCY] Bump alpine from 3.18.2 to 3.18.3 by @dependabot in #373
• [DEPENDENCY] Bump github.com/prometheus/client_golang from 1.15.1 to 1.16.0 by @dependabot in #385
• [DEPENDENCY] Bump github.com/google/uuid from 1.3.0 to 1.3.1 by @dependabot in #386
• [DEPENDENCY] Bump github.com/oschwald/maxminddb-golang from 1.11.0 to 1.12.0 by @dependabot in #387

New Contributors

• @arvchristos made their first contribution in #377

Full Changelog: v0.34.0...v0.35.0

v0.34.0

What's Changed

• [ENHANCEMENT] prometheus logger further performance improvements by @kabenin in #330
• [ENHANCEMENT] add parsing for SVCB and HTTPS by @pieterlexis-tomtom in #347
• [ENHANCEMENT] add basic config validation by @pieterlexis-tomtom in #348
• [ENHANCEMENT] transform Reducer: add cumulative length and more options by @dmachard in #359
• [BUGFIX] syslog logger: remove uneeded carriage return by @dmachard in #352
• [BUGFIX] issue #360 - Bad timestamp on PowerDNS collector by @dmachard in #361
• [DOC] document basic-auth-enable for Prometheus logger by @pieterlexis-tomtom in #346
• [DEPENDENCY] bump github.com/prometheus/common from 0.43.0 to 0.44.0 by @dependabot in #320
• [DEPENDENCY] bump alpine from 3.18.0 to 3.18.2 by @dependabot in #340
• [DEPENDENCY] bump github.com/miekg/dns from 1.1.54 to 1.1.55 by @dependabot in #342
• [DEPENDENCY] bump github.com/oschwald/maxminddb-golang from 1.10.0 to 1.11.0 by @dependabot in #341
• [DEPENDENCY] bump github.com/klauspost/compress from 1.16.5 to 1.16.7 by @dependabot in #345
• [DEPENDENCY] bump golang from 1.20.5-alpine3.17 to 1.20.6-alpine3.17 by @dependabot in #350

New Contributors

• @kabenin made their first contribution in #330

Full Changelog: v0.33.0...v0.34.0

v0.33.0

What's Changed

• [ENHANCEMENT] Update documentations by @dmachard in #329
• [ENHANCEMENT] Remove unneeded flags in binary arguments by @dmachard in #335
• [ENHANCEMENT] Update build directives to support FreeBSD by @dmachard in #334
• [ENHANCEMENT] Console logger: add PCAP output mode by @dmachard in #328
• [ENHANCEMENT] Prometheus logger redesign to support high load, new dashboard by @dmachard in #325
• [BUGFIX] XDP collector: fix harcoded device name by @dmachard in #339
• [BUGFIX] Pdns collector: fix packing question with segment length too long by @dmachard in #331
• [BUGFIX] Dnstap/Pdns collector: fix to avoid a memory leak with massive connections by @dmachard in #322
• [BUGFIX] PowerDNS collector: fix race condition under high load by @dmachard in #324
• [BUGFIX] Transforms/reducer - performance improved with a complexity O(1) by @dmachard in #326 #323
• [BUGFIX] Fix loggers to avoid channel lock with traffic reducer by @dmachard in #327
• [DEPENDENCY] Bump golang from 1.20.4-alpine3.17 to 1.20.5-alpine3.17 by @dependabot in #337

Full Changelog: v0.32.0...v0.33.0

v0.32.0

What's Changed

• [ENHANCEMENT] Dnstap/Powerdns collector: improve log messages, track connId by @dmachard in #321
• [ENHANCEMENT] Allow reading of basic auth password for loki logger from file by @ReneHollander in #317
• [ENHANCEMENT] Suspicious transformer: support whitelist domains by @dmachard in #315
• [ENHANCEMENT] RestAPI logger: return array instead of dict (breaking changes) by @dmachard in #313 #314
• [ENHANCEMENT] Dnstap/Powerdns collector: new setting to reset tcp connection by @dmachard in #308
• [ENHANCEMENT] Update docs, more config examples added by @dmachard in #294 #302 #309
• [ENHANCEMENT] Implement relabeling functionality in the Loki logger by @ReneHollander in #286
• [ENHANCEMENT] New Falco plugin logger by @SysdigDan in #289
• [ENHANCEMENT] New Kafka logger by @dmachard in #291
• [BUGFIX] Dnstap/Powerdns collector: fix to avoid tcp zero window size by @dmachard in #316 #318 #319
• [BUGFIX] Add missing support for latency check in suspicious transformer by @flz in #304
• [BUGFIX] Suspicious directive not working in text format by @dmachard in #293
• [BUGFIX] Goreleaser github assets renaming in #287
• [BUGFIX] Fix reducer (breaking changes) by @dmachard in #305
• [BUGFIX] Fix to apply transformers properly on all loggers by @dmachard in #305
• [DEPENDENCY] Bump alpine from 3.17.3 to 3.18.0 by @dependabot in #310
• [DEPENDENCY] Bump golang from 1.20.3-alpine3.17 to 1.20.4-alpine3.17 by @dependabot in #296
• [DEPENDENCY] Bump github.com/prometheus/common from 0.42.0 to 0.43.0 by @dependabot in #298
• [DEPENDENCY] Bump golang.org/x/sys from 0.7.0 to 0.8.0 by @dependabot in #301
• [DEPENDENCY] Bump golang.org/x/net from 0.8.0 to 0.9.0 by @dependabot in #272
• [DEPENDENCY] Bump github.com/prometheus/client_golang from 1.14.0 to 1.15.0 by @dependabot in #273
• [DEPENDENCY] Bump github.com/miekg/dns from 1.1.53 to 1.1.54 by @dependabot in #290
• [DEPENDENCY] Bump Loki to 2.8.2 and Prometheus to 0.43.1 by @dmachard in #303
• [DEPENDENCY] Bump github.com/segmentio/kafka-go from 0.4.39 to 0.4.40 by @dependabot in #297

New Contributors

• @ReneHollander made their first contribution in #286
• @SysdigDan made their first contribution in #289

Full Changelog: v0.31.0...v0.32.0

v0.31.0

What's Changed

• [ENHANCEMENT] add Scalyr logger by @pieterlexis-tomtom in #256

• [ENHANCEMENT] support custom delimiter and boundary on text format by @dmachard in #261

• [ENHANCEMENT] add makefile for the project by @dmachard in #280

• [ENHANCEMENT] new transform to detect duplicated traffic by @dmachard in #282

• [ENHANCEMENT] add flatjson to loggers by @dmachard in #268 thanks to @pieterlexis-tomtom

• [ENHANCEMENT] add base64 DNS response in text-format and new transform by @gallypette in #274 #281

• [ENHANCEMENT] new redis pubsub logger by @gallypette in #278

• [BUGFIX] text format - add delimiter when using spaces in the qname field. for #254 by @dmachard

• [BUGFIX] sniffer collector - regression with outdated timestamp since v0.30 by @dmachard in #284

• [BUGFIX] sniffer collector - added handling for EINTR on syscall.Recvmsg by @djcode in #279

• [BUGFIX] dnstap, tcpclient, fluentd logger - add buffer to avoid memory leak by @dmachard in #267 #269 #262

• [BUGFIX] dnstap collector - to support large dnstap frame, up to 65Kb by @dmachard in #270

• [BUGFIX] dnstap logger - bad timestamp convert float64 to int64 by @dmachard in #285

• [DEPENDENCY] update github.com/dmachard/go-dnstap-protobuf from 0.4.0 to 0.5.0 by @dependabot in #258

• [DEPENDENCY] update github.com/miekg/dns from 1.1.52 to 1.1.53 by @dependabot in #259

• [DEPENDENCY] update alpine from 3.17.2 to 3.17.3 by @dependabot in #257

• [DEPENDENCY] update golang from 1.20.2-alpine3.17 to 1.20.3-alpine3.17 by @dependabot in #263

• [DEPENDENCY] update golang.org/x/sys from 0.6.0 to 0.7.0 by @dependabot in #265

• [DEPENDENCY] update github.com/grafana/loki from 2.4.1 to 2.8.0 by @dmachard in #266

• [DEPENDENCY] update github.com/dmachard/go-powerdns-protobuf from 0.0.4 to 0.1.0 by @dependabot in #260

• [DEPENDENCY] update github.com/klauspost/compress from 1.16.3 to 1.16.5 by @dependabot in #271

New Contributors

• @gallypette made their first contribution in #274
• @djcode made their first contribution in #279

Full Changelog: v0.30.0...v0.31.0

v0.30.0

What's Changed

• Logger Prometheus: add basic-auth-enable settings by @dmachard in #251
• New transform to add latency and unanswered queries by @dmachard in #248
• Logger File: convert doh/dot traffic to pcap file by @dmachard in #249 Issue #157
• Logger Prometheus: add basic auth support, it's enabled by default by @dmachard in #246 fix issue #236
• Bump github.com/miekg/dns from 1.1.50 to 1.1.52 by @dependabot in #234 #244 #250
• Bump google.golang.org/protobuf from 1.28.1 to 1.30.0 by @dependabot in #247 #242
• Bump golang from 1.20.1-alpine3.17 to 1.20.2-alpine3.17 by @dependabot in #243
• Bump golang.org/x/net from 0.7.0 to 0.8.0 by @dependabot in #239
• Bump github.com/klauspost/compress from 1.15.15 to 1.16.3 by @dependabot in #235 #245
• Ingestor/Sniffer collector: IP defrag and TCP reassembly support on PCAP files or network interfaces by @dmachard in #237 #241, fix issues #240 #167

Full Changelog: v0.29.0...v0.30.0