Problem: PIPs bigger than 4GB show errors when decompressed with 7zip in Archivematica

[jraddaoui]

Is your feature request related to a problem? Please describe.

Related issue in the temporal-activities repository:

artefactual-sdps/temporal-activities#37

Describe the solution you'd like

As an initial solution, I'd like to optionally send unzipped bags to Archivematica.

Describe alternatives you've considered

Make zipped PIPs bigger that 4GB work between Enduro and Archivematica, see the related issue for more info about the actual issue in Go creating those ZIP files.

Additional context

Already implemented in #1110 and #1133.

[jraddaoui]

After the lates PR this seems to work with compressed ZIPs but it fails deleting the transfer from the SFTP server at the end:

2025-02-25T17:15:15.495Z	V(2)	enduro-am-worker.temporal-client	log/with_logger.go:79	error	{"Namespace": "default", "TaskQueue": "am", "WorkerID": "1@enduro-am-77978d78d9-qmprm@", "WorkflowID": "processing-workflow-df7ee783-2ce0-4e8d-87d0-b2a1bf610ca3", "RunID": "05dbbf27-c0f5-42bf-a8bf-854f3f6bf630", "ActivityType": "DeleteTransferActivity", "Attempt": 2, "Error": "delete transfer: path: \"bag-7537ab2c-4e6b-4820-95bf-bd2c577351c3\": SFTP: unable to remove file \"bag-7537ab2c-4e6b-4820-95bf-bd2c577351c3\": failure (SSH_FX_FAILURE)", "error": "Activity error."}
go.temporal.io/sdk/log.(*withLogger).Error
	go.temporal.io/[email protected]/log/with_logger.go:79
go.temporal.io/sdk/internal.(*activityTaskHandlerImpl).Execute
	go.temporal.io/[email protected]/internal/internal_task_handlers.go:2246
go.temporal.io/sdk/internal.(*activityTaskPoller).ProcessTask
	go.temporal.io/[email protected]/internal/internal_task_pollers.go:1080
go.temporal.io/sdk/internal.(*baseWorker).processTaskAsync.func1
	go.temporal.io/[email protected]/internal/internal_worker_base.go:446

[jraddaoui]

I've fixed the issue noted in the previous comment and a couple more in the PR mentioned above.