Application Layer Dashboard #523
There are no files selected for viewing
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,119 @@ | ||
| { | ||
| "annotations": { | ||
| "list": [ | ||
| { | ||
| "builtIn": 1, | ||
| "datasource": { | ||
| "type": "datasource", | ||
| "uid": "grafana" | ||
| }, | ||
| "enable": true, | ||
| "hide": true, | ||
| "iconColor": "rgba(0, 211, 255, 1)", | ||
| "name": "Annotations & Alerts", | ||
| "target": { | ||
| "limit": 100, | ||
| "matchAny": false, | ||
| "tags": [], | ||
| "type": "dashboard" | ||
| }, | ||
| "type": "dashboard" | ||
| } | ||
| ] | ||
| }, | ||
| "editable": true, | ||
| "fiscalYearStartMonth": 0, | ||
| "graphTooltip": 0, | ||
| "id": 11, | ||
| "links": [], | ||
| "liveNow": false, | ||
| "panels": [ | ||
| { | ||
| "datasource": { | ||
| "type": "grafana-clickhouse-datasource", | ||
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "gridPos": { | ||
| "h": 14, | ||
| "w": 11, | ||
| "x": 0, | ||
| "y": 0 | ||
| }, | ||
| "id": 2, | ||
| "targets": [ | ||
| { | ||
| "datasource": { | ||
| "type": "grafana-clickhouse-datasource", | ||
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "meta": { | ||
| "builderOptions": { | ||
| "fields": [], | ||
| "limit": 100, | ||
| "mode": "list" | ||
| } | ||
| }, | ||
| "queryType": "sql", | ||
| "rawSql": "SELECT CONCAT(sourcePodNamespace, '/', sourcePodName) as srcPod,\nCONCAT(destinationPodNamespace, '/', destinationPodName) as dstPod,\nsourceTransportPort as srcPort,\ndestinationTransportPort as dstPort,\ndestinationServicePort as dstSvcPort,\ndestinationServicePortName as dstSvc,\ndestinationIP as dstIP,\nSUM(octetDeltaCount) as bytes,\nSUM(reverseOctetDeltaCount) as revBytes,\negressNetworkPolicyName,\negressNetworkPolicyRuleAction,\ningressNetworkPolicyName,\ningressNetworkPolicyRuleAction\nfrom flows_policy_view\nWHERE sourcePodNamespace NOT IN ('kube-system', 'flow-visibility', 'flow-aggregator')\n AND destinationPodNamespace NOT IN ('kube-system', 'flow-visibility', 'flow-aggregator')\n AND l7ProtocolName!=''\n AND $__timeFilter(flowEndSeconds)\nGROUP BY srcPod, dstPod, srcPort, dstPort, dstSvcPort, dstSvc, dstIP, egressNetworkPolicyName, egressNetworkPolicyRuleAction, ingressNetworkPolicyName, ingressNetworkPolicyRuleAction\nHAVING bytes > 0\norder by bytes DESC\n", | ||
| "refId": "A" | ||
| } | ||
| ], | ||
| "title": "Cumulative Bytes of Flows with L7 NetworkPolicy Information", | ||
| "type": "theia-grafana-chord-plugin" | ||
| }, | ||
| { | ||
| "datasource": { | ||
| "type": "grafana-clickhouse-datasource", | ||
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "gridPos": { | ||
| "h": 18, | ||
| "w": 24, | ||
| "x": 0, | ||
| "y": 14 | ||
| }, | ||
| "id": 4, | ||
| "options": { | ||
| "seriesCountSize": "sm", | ||
| "showSeriesCount": false, | ||
| "text": "Default value of text input option" | ||
| }, | ||
| "targets": [ | ||
| { | ||
| "datasource": { | ||
| "type": "grafana-clickhouse-datasource", | ||
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "meta": { | ||
| "builderOptions": { | ||
| "fields": [], | ||
| "limit": 100, | ||
| "mode": "list" | ||
| } | ||
| }, | ||
| "queryType": "sql", | ||
| "rawSql": "SELECT sourceIP, sourceTransportPort, destinationIP, destinationTransportPort, httpVals\nFROM flows\nWHERE l7ProtocolName!=''\nORDER BY flowEndSeconds DESC", | ||
| "refId": "A" | ||
| } | ||
| ], | ||
| "title": "HTTP Values", | ||
| "type": "theia-grafana-http-table-plugin" | ||
| } | ||
| ], | ||
| "schemaVersion": 37, | ||
| "style": "dark", | ||
| "tags": [], | ||
| "templating": { | ||
| "list": [] | ||
| }, | ||
| "time": { | ||
| "from": "now-30m", | ||
| "to": "now" | ||
| }, | ||
| "timepicker": {}, | ||
| "timezone": "", | ||
| "title": "application_layer_dashboard", | ||
| "uid": "tCTkERMSk", | ||
| "version": 1, | ||
| "weekStart": "" | ||
| } |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
|
|
@@ -21,8 +21,8 @@ | |
| "editable": true, | ||
| "fiscalYearStartMonth": 0, | ||
| "graphTooltip": 0, | ||
| "id": 6, | ||
| "iteration": 1695808205600, | ||
| "links": [], | ||
| "liveNow": false, | ||
| "panels": [ | ||
|
|
@@ -32,15 +32,56 @@ | |
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "gridPos": { | ||
| "h": 22, | ||
| "w": 10, | ||
| "x": 0, | ||
| "y": 0 | ||
| }, | ||
| "id": 4, | ||
| "options": { | ||
| "color": "yellow", | ||
| "groupByPodLabel": false, | ||
| "layerFour": true | ||
| }, | ||
| "targets": [ | ||
| { | ||
| "datasource": { | ||
| "type": "grafana-clickhouse-datasource", | ||
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "meta": { | ||
| "builderOptions": { | ||
| "fields": [], | ||
| "limit": 100, | ||
| "mode": "list" | ||
| } | ||
| }, | ||
| "queryType": "sql", | ||
| "rawSql": "SELECT sourcePodName, sourcePodLabels, sourcePodNamespace, sourceNodeName, destinationPodName, destinationPodLabels, destinationNodeName, destinationServicePortName, octetDeltaCount FROM flows\nWHERE sourcePodNamespace NOT IN ('kube-system', 'flow-visibility', 'flow-aggregator')\nAND destinationPodNamespace NOT IN ('kube-system', 'flow-visibility', 'flow-aggregator')\nAND ( destinationPodName != '' OR sourcePodName != '' )\nAND octetDeltaCount != 0\nAND httpVals == ''\nAND $__timeFilter(flowEndSeconds)\nORDER BY flowEndSeconds DESC", | ||
|
There was a problem hiding this comment. Do we want to exclude the ns There was a problem hiding this comment. I've already added that into #488, i'll remove it from this PR, don't know why it's showing up as a change |
||
| "refId": "A" | ||
| } | ||
| ], | ||
| "title": "Layer 4 Topology", | ||
| "type": "theia-grafana-dependency-plugin" | ||
| }, | ||
| { | ||
| "datasource": { | ||
| "type": "grafana-clickhouse-datasource", | ||
| "uid": "PDEE91DDB90597936" | ||
| }, | ||
| "description": "The different colors of the lines mean different codes, but are labelled by the content length of the flow.\nGreen: Success", | ||
| "gridPos": { | ||
| "h": 22, | ||
| "w": 10, | ||
| "x": 10, | ||
| "y": 0 | ||
| }, | ||
| "id": 2, | ||
| "options": { | ||
| "color": "yellow", | ||
| "groupByLabel": false, | ||
| "groupByPodLabel": false, | ||
| "layerFour": false, | ||
| "seriesCountSize": "sm", | ||
| "showSeriesCount": false, | ||
| "text": "Default value of text input option" | ||
|
|
@@ -60,11 +101,11 @@ | |
| } | ||
| }, | ||
| "queryType": "sql", | ||
| "rawSql": "SELECT sourcePodName, sourcePodLabels, sourcePodNamespace, sourceNodeName, sourceIP, sourceTransportPort, destinationPodName, destinationPodLabels, destinationNodeName, destinationServicePortName, destinationIP, destinationTransportPort, octetDeltaCount, httpVals FROM flows\nWHERE sourcePodNamespace NOT IN ('kube-system', 'flow-visibility', 'flow-aggregator')\nAND destinationPodNamespace NOT IN ('kube-system', 'flow-visibility', 'flow-aggregator')\nAND ( destinationPodName != '' OR sourcePodName != '' )\nAND octetDeltaCount != 0\nAND httpVals != ''\nAND $__timeFilter(flowEndSeconds)\nORDER BY flowEndSeconds DESC", | ||
|
|
||
| "refId": "A" | ||
| } | ||
| ], | ||
| "title": "Layer 7 Topology", | ||
| "type": "theia-grafana-dependency-plugin" | ||
| } | ||
| ], | ||
|
|
@@ -102,6 +143,6 @@ | |
| "timezone": "", | ||
| "title": "network_topology_dashboard", | ||
| "uid": "yRVDEad4k", | ||
| "version": 3, | ||
| "weekStart": "" | ||
| } | ||
|
|
||
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,13 @@ | ||
| --Alter table to drop new columns | ||
| ALTER TABLE flows | ||
| DROP COLUMN l7ProtocolName, | ||
| DROP COLUMN httpVals; | ||
| ALTER TABLE flows_local | ||
| DROP COLUMN l7ProtocolName, | ||
| DROP COLUMN httpVals; | ||
| ALTER TABLE flows_policy_view | ||
| DROP COLUMN l7ProtocolName String, | ||
| DROP COLUMN httpVals String; | ||
| ALTER TABLE flows_policy_view_local | ||
| DROP COLUMN l7ProtocolName String, | ||
| DROP COLUMN httpVals String; |
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
| Original file line number | Diff line number | Diff line change |
|---|---|---|
| @@ -0,0 +1,13 @@ | ||
| --Alter table to add new columns | ||
| ALTER TABLE flows | ||
| ADD COLUMN l7ProtocolName String, | ||
| ADD COLUMN httpVals String; | ||
| ALTER TABLE flows_local | ||
| ADD COLUMN l7ProtocolName String, | ||
| ADD COLUMN httpVals String; | ||
| ALTER TABLE flows_policy_view | ||
| ADD COLUMN l7ProtocolName String, | ||
| ADD COLUMN httpVals String; | ||
| ALTER TABLE flows_policy_view_local | ||
| ADD COLUMN l7ProtocolName String, | ||
| ADD COLUMN httpVals String; |
Oops, something went wrong.
Oops, something went wrong.
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
There was a problem hiding this comment.
Choose a reason for hiding this comment
The reason will be displayed to describe this comment to others. Learn more.
Shouldn't it be based on the l7ProtocolName instead of httpvals?