Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

What is the Durable function "isolated" mode alternative for "extendedSessionsEnabled" ? #2905

Open
Shakeebmm opened this issue Aug 29, 2024 · 3 comments

Comments

@Shakeebmm
Copy link

Shakeebmm commented Aug 29, 2024

I have a .NET 8 based "isolated" mode durable function which implements the fan out/fan in pattern.
image

Expected F2 count is 100k activity function calls, which is getting executed in batch of 20 F2 calls.
image

Delay between each batch getting increased along with the execution and function app memory also increasing consistently.
image

This was resolved by enabling extendedSession in "in-proc" mode.. By enabling the extended session, 20 hours of execution was reduced to 1.5 hours.
{ "extensions": { "durableTask": { "extendedSessionsEnabled": true, "extendedSessionIdleTimeoutInSeconds": 30 } } }

But in "isolated" mode, extended sessions are not supported.
https://learn.microsoft.com/en-us/azure/azure-functions/durable/durable-functions-perf-and-scale#language-runtime-considerations
image

What is the solution/work around in "isolated" mode?

@cgillum cgillum transferred this issue from Azure/durabletask Aug 29, 2024
@davidmrdavid
Copy link
Contributor

Hi @Shakeebmm: Unfortunately, there's no direct equivalent of "extended sessions" in the isolated model yet. What's the performance difference you're seeing in the isolated mode?

@davidmrdavid davidmrdavid added Needs: Author Feedback Waiting for the author of the issue to respond to a question and removed Needs: Triage 🔍 labels Sep 9, 2024
@Shakeebmm
Copy link
Author

Shakeebmm commented Sep 12, 2024

Hi @davidmrdavid, There are 100k+ activity functions which are getting executed in batch of10 activities at a time.

Without extended session: gap between each batch getting increased. At the end of 100k activities, the gap is 3+ minutes. Orchestration trigger takes time to get the tracking details when the execution progress.

With extended session: Gap between each batch is consistent to couple of secs as the data is kept in session for 30 secs

@microsoft-github-policy-service microsoft-github-policy-service bot added Needs: Attention 👋 and removed Needs: Author Feedback Waiting for the author of the issue to respond to a question labels Sep 12, 2024
@davidmrdavid
Copy link
Contributor

Thank you @Shakeebmm. FYI @lilyjma, in case this factors in to our prioritization for next semester

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants