Some issue with TiTiler when using it as a server

[alphajae11]

Hi,

I’ve been using TiTiler as a server (uploaded through Docker build) hosted on Google Cloud Run for a project that involves uploading .tiff files to Deck.gl (I finetuned all variables as suggested here: https://developmentseed.org/titiler/advanced/performance_tuning/#gdal_data). TiTiler serves as a preprocessing step to provide the necessary data for the Deck.gl layer. While the setup works seamlessly with 1 or 2 users, I’ve encountered an issue when there are more than 5 simultaneous client requests.

When there are more than 5 concurrent requests, I’ve observed the server stops working for one of them 1 with following error in the GCS logs:

payload: "payloadNotSet"

Currently, I am not really sure what is the exact cause of this issue (although I suspect it may be the memory issue on GCS side but I could not really prove this). I have attempted to reduce GDAL_CACHEMAX, CPL_VSIL_CURL_CACHE_SIZE, VSI_CACHE_SIZE below the recommended levels from https://developmentseed.org/titiler/advanced/performance_tuning/#gdal_data. However, this causes errors for any files that is bigger than 200MB in size.

I was hoping if anyone who faced this issue before or knows about this can share about how to deal with this issue. Thanks in advance.