replace lakefs_client with lakefs-sdk in Spark integration test harness #13297

Job	Run time
Build lakeFS HadoopFS	39s
Generate code from latest lakeFS app	14s
Prepare Spark Apps	35s
Check if secrets are available.	1s
Build and push rclone export Docker image	0s
login-to-amazon-ecr	0s
Build and push Docker image	0s
Test lakeFS multipart upload with Hadoop S3A	0s
Test lakeFS Hadoop FileSystem	0s
Test lakeFS rclone export functionality	0s
Test metastore client commands using trino	0s
Build metadata client for Spark 3.x	0s
Run latest lakeFS app on AWS S3	0s
Run latest lakeFS app on AWS S3 DynamoDB KV	0s
Run latest lakeFS app on Azure with Azure blobstore	0s
Run latest lakeFS app on Google Cloud Platform and Google Cloud Storage	0s
E2E - DynamoDB Local - Local Block Adapter	0s
Test lakeFS against the python wrapper client	0s
Run latest lakeFS app on Azure with Azure Data Lake Storage Gen2 and CosmosDB	0s
Quickstart	0s
Run latest lakeFS app on AWS S3 + Basic Auth	0s
Test lakeFS metadata client export with Spark 3.x	0s
Test unified gc	0s
Test lakeFS with Spark ${{ matrix.spark.tag }}.X	0s
	1m 29s

Provide feedback