Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Consider adding a set of LLM-specific considerations (or a worked example w an LLM) #167

Open
hannahmoro opened this issue Feb 16, 2024 · 2 comments

Comments

@hannahmoro
Copy link

hannahmoro commented Feb 16, 2024

We may want to elaborate on the default checklist items, create a new checklist, or add an example that focuses on ethical considerations that are unique to LLMs or that are particularly acute with LLMs. For example, considerations related to privacy (sending private data to an API endpoint, de-anonymization via embeddings), misinformation, hateful or offensive speech,...

@hannahmoro hannahmoro changed the title Consider adding a set of LLM-specific considerations Consider adding a set of LLM-specific considerations (or a worked example w an LLM) Feb 16, 2024
@leannmendoza
Copy link

Great idea to consider adding AI Guardrails to the checklist, especially for LLM development. Some considerations to be added to the checklist are defined here: https://github.com/guardrails-ai/guardrails.git

@klwetstone
Copy link
Contributor

I think our existing list of questions is high level enough that it covers most of what needs to be discussed for LLMs. I like the idea of a tool-specific list of key ethical considerations, but I'm not sure where it would go in the current Deon structure. It may be a broader resource we want to add, and could include LLMs and other model types / tools - maybe we add another section under "custom checklists" with "Tool-specific considerations"

I'd break this down as :

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests

3 participants