Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Orient to Caltrans Step 2: Look for performance optimizations #341

Open
jkarpen opened this issue Aug 7, 2024 · 0 comments
Open

Orient to Caltrans Step 2: Look for performance optimizations #341

jkarpen opened this issue Aug 7, 2024 · 0 comments
Assignees

Comments

@jkarpen
Copy link
Collaborator

jkarpen commented Aug 7, 2024

Look through both the “Nightly” build jobs and CI jobs to see which models are costing the most time and money (note: some use larger Snowflake warehouses than others, so time and money are not directly related here). There may be some quick wins to save money and improve developer experiences by:

  • Making some models incremental
  • Selecting less data in dev
  • Reordering joins to do less of them

Don’t necessarily do a complete overhaul (unless you see a great opportunity!), but if there are some relatively low lifts to save time and money, please document them and submit some pull requests.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

2 participants