Support save WithCTE for insertRepartitionBeforeWrite

[ic4y]

🔍 Description

Issue References 🔗

First, I'd like to thank @wForget for the help with this issue.

When using the "save to HDFS" feature, queries ending with an ORDER BY sometimes lose their sort order in the results. Upon investigating the code, I discovered that when using WITH statements and saving SQL results with toDF.write.save, a WithCTE node is generated after the Sort node. This causes the canInsertRepartitionByExpression check to fail, leading to an incorrect Repartition node insertion after the Sort node, which ultimately disrupts the sort order.

However, this issue does not occur when using INSERT INTO TABLE with WithCTE nodes.

The provided unit test can reproduce this issue, but after using toDF.write.save, I am unable to access the complete execution plan to assert whether a Repartition node is present. Therefore, the current test is ineffective.

Hope someone can help figure out how to write this unit test.

Describe Your Solution 🔧

Please include a summary of the change and which issue is fixed. Please also include relevant motivation and context. List any dependencies that are required for this change.

Types of changes 🔖

• Bugfix (non-breaking change which fixes an issue)
• New feature (non-breaking change which adds functionality)
• Breaking change (fix or feature that would cause existing functionality to change)

Test Plan 🧪

Behavior Without This Pull Request ⚰️

Behavior With This Pull Request 🎉

Related Unit Tests

---

Checklist 📝

• This patch was not authored or co-authored using Generative Tooling

Be nice. Be informative.

[codecov-commenter]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 0.00%. Comparing base (d3520dd) to head (00fc1fa).
Report is 62 commits behind head on master.

Additional details and impacted files

@@           Coverage Diff            @@
##           master   #6783     +/-   ##
========================================
  Coverage    0.00%   0.00%             
========================================
  Files         687     688      +1     
  Lines       42439   44124   +1685     
  Branches     5793    6123    +330     
========================================
- Misses      42439   44124   +1685     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.

[ulysses-you]

lgtm if tests pass

[wForget]

There is an issue with the logic of check write in base unit test. Please wait #6793

[github-actions]

Thanks for the PR! This PR is being closed due to inactivity. This isn't a judgement on the merit of the PR in any way. If this is still an issue with the latest version of Kyuubi, please reopen it and ask a committer to remove the Stale tag!

Thank you for using Kyuubi!