How to stop agent execution?

[elupanov]

What is the correct way to stop (abort, terminate) graph execution at a specific point in time? It is a common scenario in applications when a user wants to stop generation and regenerate a response later. I haven't found any solution for LangGraph in Python. The only information I found is the implementation for the JS version.

[david1542]

I'm also interested in this functionality. I've opened another discussion here with some reproducible code.

[hinthornw]

If i understand the question correction, this is solved by the "double texting" native feature of LangGraph python.

As you could imagine, we implement this using queue workers and by cancelling the tasks upon request. The way to implement yourself would be via asyncio tasks. There's an example here.

[elupanov]

This feature is available only in LangGraph Cloud, not in the open source version. However, it may be possible to implement something similar on top of LangGraph execution. The only unclear aspect is whether it is possible to stop execution in the middle of node processing.

[hinthornw]

The code that david shared is actually pretty close to correct (I'm following up with them in the linked discussion).

Assuming values are checkpointed and you cancel a task in the middle of the node, you'd end up with the last checkpoint being the state of your graph before it entered the node itself.

Are you looking to go even further and capture the intermediate state of the node when it's cancelled (so you can e.g., save a partial LLM completion)?

[elupanov]

For my case, starting over from a checkpoint before a node is acceptable. I'm just wondering if it is possible to stop inside a node, as you mentioned, for example, when the LLM is generating content. Thanks for the hint!