Skip to content

Commit

Permalink
Update checklist.yml (#171)
Browse files Browse the repository at this point in the history
  • Loading branch information
glipstein authored May 3, 2024
1 parent 4bef7e5 commit 66ff008
Showing 1 changed file with 2 additions and 2 deletions.
4 changes: 2 additions & 2 deletions deon/assets/checklist.yml
Original file line number Diff line number Diff line change
Expand Up @@ -61,14 +61,14 @@ sections:
line_summary: Explainability
line: Can we explain in understandable terms a decision the model made in cases where a justification is needed?
- line_id: D.5
line_summary: Communicate bias
line_summary: Communicate limitations
line: Have we communicated the shortcomings, limitations, and biases of the model to relevant stakeholders in ways that can be generally understood?
- title: Deployment
section_id: E
lines:
- line_id: E.1
line_summary: Monitoring and evaluation
line: How are we planning to monitor the model and its impacts after it is deployed (e.g., performance monitoring, regular audit of sample predictions, human review of high-stakes decisions, reviewing downstream impacts of errors or low-confidence decisions, testing for concept drift)?
line: Do we have a clear plan to monitor the model and its impacts after it is deployed (e.g., performance monitoring, regular audit of sample predictions, human review of high-stakes decisions, reviewing downstream impacts of errors or low-confidence decisions, testing for concept drift)?
- line_id: E.2
line_summary: Redress
line: Have we discussed with our organization a plan for response if users are harmed by the results (e.g., how does the data science team evaluate these cases and update analysis and models to prevent future harm)?
Expand Down

0 comments on commit 66ff008

Please sign in to comment.