Refactor society-wide AI component #2326
Draft
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Description
Fixes #2321
Fixes #2325
Depends upon review and merging of PolicyEngine/policyengine-api#2136; will remain in draft until they are merged.
Changes
This PR consumes changes made in the linked API PR, altering how we fetch AI prompts and output. It also handles the API PR's transition away from streaming for responses already present in our database, refactors front-end visuals to improve UX, and adds better error handling to prevent endless spinners.
Screenshots
AwesomeScreenshot-1_29_2025.6_26_28PM.webm
Tests
None have yet been added