You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
I had searched in the issues and found no similar issues.
Description
Backgroud
Currently, Spark Load is integrated into the Doris core, which brings the following problems:
Due to the reliance on Spark-related dependencies, the security issues of Spark itself will cause security issues in Doris
When modifying the content of Spark ETL, it also depends on the version release of Doris, which is not conducive to rapid expansion and problem repair
The reliance on Hadoop ecosystem also increases the complexity of the Doris system
Therefore, separating the task submission, management, and Spark DPP processing of Spark Load from the Doris core will help reduce the complexity of the Doris core and also help unify Doris's Spark ecosystem tools.
Search before asking
Description
Backgroud
Currently,
Spark Loadis integrated into theDoriscore, which brings the following problems:Sparkitself will cause security issues inDorisSpark ETL, it also depends on the version release ofDoris, which is not conducive to rapid expansion and problem repairHadoopecosystem also increases the complexity of theDorissystemTherefore, separating the task submission, management, and
Spark DPPprocessing of Spark Load from theDoriscore will help reduce the complexity of theDoriscore and also help unify Doris's Spark ecosystem tools.Use case
No response
Related issues
No response
Are you willing to submit PR?
Code of Conduct
The text was updated successfully, but these errors were encountered: