[EPIC] Improve performance of TPC-DS queries

[andygrove]

What is the problem the feature request solves?

This issue is for tracking issues to perform Comet's performance when running benchmarks derived from TPC-DS.

Highest Priority

• Add InSubqueryExec support (to support DPP) #121 to support DPP
• Support sort merge join with a join condition #398
• Support RangePartitioning with native shuffle #458

Other

• [EPIC] Improve shuffle performance #1123
• Add option to replace SortMergeJoin with ShuffleHashJoin #1006
• Add support for bloom_filter_agg #846
• Add support for date_add - feat: date_add and date_sub functions #910
• stddev_sample disabled by default due to performance issue - Improve performance of standard deviation aggregate #824
• concat is not supported
• Unsupported result expressions found in: Vector(MakeDecimal(sum(UnscaledValue(sales_price#3737))#3873L,17,2) AS sales#3747, ...
• unsupported Spark data type: StructType(StructField(count(1),LongType,false),StructField(avg(ss_ext_discount_amt),DecimalType(11,6),true),StructField(avg(ss_net_profit),DecimalType(11,6),true))
• Window not supported natively but no reason given

Describe the potential solution

No response

Additional context

No response