[Feature] Reuse connections

[nqvuong1998]

Is this your first time submitting a feature request?

• I have read the expectations for open source contributors
• I have searched the existing issues, and I could not find an existing issue for this feature
• I am requesting a straightforward extension of existing dbt-spark functionality, rather than a Big Idea better suited to a discussion

Describe the feature

The current implementation of dbt-spark closes the connection after each model is run, leading to the following issues:

• Excessive login time to the remote Spark server.
• When using Kyuubi (CONNECTION mode), it creates too many Spark applications.

In the future, it is anticipated that dbt-spark will support a reuse_connections option, similar to what is available in dbt-snowflake

Describe alternatives you've considered

No response

Who will this benefit?

Any users who use Spark Thrift Server or Kyuubi

Are you interested in contributing this feature?

Yes

Anything else?

No response