You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
By default, Comet outputs the exception details specific for Comet.
100
+
101
+
```scala
102
+
scala> spark.sql("my_failing_query").show(false)
103
+
104
+
24/03/05 17:00:07 ERROR Executor: Exception in task 0.0 in stage 0.0 (TID 0)/ 1]
105
+
org.apache.comet.CometNativeException: Internal error: MIN/MAX is not expected to receive scalars of incompatible types (Date32("NULL"), Int32(15901)).
106
+
This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker
107
+
at org.apache.comet.Native.executePlan(Native Method)
108
+
at org.apache.comet.CometExecIterator.executeNative(CometExecIterator.scala:65)
109
+
at org.apache.comet.CometExecIterator.getNextBatch(CometExecIterator.scala:111)
110
+
at org.apache.comet.CometExecIterator.hasNext(CometExecIterator.scala:126)
111
+
112
+
```
113
+
114
+
There is a verbose exception option by leveraging DataFusion [backtraces](https://arrow.apache.org/datafusion/user-guide/example-usage.html#enable-backtraces)
115
+
This option allows to append native DataFusion stacktrace to the original error message.
116
+
To enable this option with Comet it is needed to include `backtrace` feature in [Cargo.toml](https://github.com/apache/arrow-datafusion-comet/blob/main/core/Cargo.toml) for DataFusion dependencies
117
+
118
+
```
119
+
datafusion-common = { version = "36.0.0", features = ["backtrace"] }
120
+
datafusion = { default-features = false, version = "36.0.0", features = ["unicode_expressions", "backtrace"] }
121
+
```
122
+
123
+
Then build the Comet as [described](https://github.com/apache/arrow-datafusion-comet/blob/main/README.md#getting-started)
This was likely caused by a bug in DataFusion's code and we would welcome that you file an bug report in our issue tracker
147
+
at org.apache.comet.Native.executePlan(NativeMethod)
148
+
at org.apache.comet.CometExecIterator.executeNative(CometExecIterator.scala:65)
149
+
at org.apache.comet.CometExecIterator.getNextBatch(CometExecIterator.scala:111)
150
+
at org.apache.comet.CometExecIterator.hasNext(CometExecIterator.scala:126)
151
+
(reduced)
152
+
153
+
```
154
+
Note:
155
+
- The backtrace coverage in DataFusion is still improving. So there is a chance the error still not covered, if so feel free to file a [ticket](https://github.com/apache/arrow-datafusion/issues)
156
+
- The backtrace evaluation comes with performance cost and intended mostly for debugging purposes
0 commit comments