Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

quit saving evaluation result as file #45

Open
1 of 3 tasks
yuki-mt opened this issue Mar 29, 2019 · 2 comments
Open
1 of 3 tasks

quit saving evaluation result as file #45

yuki-mt opened this issue Mar 29, 2019 · 2 comments
Assignees

Comments

@yuki-mt
Copy link
Member

yuki-mt commented Mar 29, 2019

Motivation

dashboard saves evaluation result to db (result column of evaluation_result table),
so not need to save as file

Goal

  • quit saving evaluation result as file
  • refer db entry to get evaluation result

Implementation

  • quit saving evaluation result as file in rekcurd-python
  • change gRPC protocol spec
  • refer only db entry to get evaluation result in dashboard
@keigohtr
Copy link
Member

keigohtr commented Apr 1, 2019

@yuki-mt
Quitting saving evaluation result as file need to be considered. I think saving them to DB is not good compared with saving them to file.

@keigohtr
Copy link
Member

keigohtr commented Apr 3, 2019

We need roadmap for this.

  • 1. Use DB and save json string which includes precison/recall/fvalue
  • 2. Change DB schema to store precision/recall/fvalue separately

And we need additional functionalities.

  • Visualize ROC curve
  • Visualize multi-class classification results
  • Visualize other metic (e.g. BLEU score)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants