Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Build Streamlit app for looking and interacting with results #32

Open
ngupta23 opened this issue Jan 15, 2023 · 0 comments
Open

Build Streamlit app for looking and interacting with results #32

ngupta23 opened this issue Jan 15, 2023 · 0 comments

Comments

@ngupta23
Copy link
Collaborator

Add a Streamlit app that can be used to compare results as well as filter to a subset of the benchmarks for viewing (filters)

Use Cases

  • Comparison between Keys (for filtering)
    • os
    • python_version
    • library
    • library_version
    • dataset
    • group
    • model
    • model_engine
    • model_engine_version
    • execution_engine
    • execution_engine_version
    • execution_mode
    • execution_mode_version
    • num_cpus
    • backup_model
  • Comparison over time
  • If no env changes, but pycaret settings change (in setup or create_model), do results become better or worse?
  • Comparison of Ray and Spark
  • Comparison of Native vs. Fugue
  • Compare the performance of Pycaret across different python versions
  • How does pycaret/ray/spark scale with the number of CPUs
  • Running performance tests (nightly/weekly) - if nothing changes, performance should not change
  • Metrics when a new version of pycaret is released (compared to the previous version)

Related to #10

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant