Leverage Generative AI across Open Food Facts (tracker)

[teolemon]

What

What

• Investigate writing a script to augment taxonomy files using the ChatGPT API
• Prompts like:
  translate this in as many languages as possible: en:PE - Polyethylene, Polyethylene
can you format the list with the format "2 letter langcode:translation"
  "Summarise in 3 sentences the production of material X, how it is used in food packaging and and how it is recycled"
  might be useful
• This would be particularly useful for Open Products Facts 26000 category system (from the UNSPC) which is currently in English, without synonyms, without links to Wikidata, and without translations
• Given the sheer amount of content to review, we'd need a system to do that entry per entry, create a git branch, commit, and create a PR.
• @alexgarel has proposed a Taxonomy Editor integration, but that's longer term

Where

• Taxonomy Editor (Allow to augment taxonomies using ChatGPT like models taxonomy-editor#233)
  • Schema definition: https://openfoodfacts.slack.com/archives/C03MEM1CMJ4/p1676631826269169
  • Subcategories: https://openfoodfacts.slack.com/files/U02KZKKA5/F04Q4ENDBR8/image.png
• IDE used for taxonomy edition
• Odoo Connect (https://twitter.com/PaulUheet/status/1630203943140687874?t=qbwmOWfIu9ZNIWYBk0bgYw)
• Mobile App: Explore using the on-device LLM for various tasks smooth-app#5009

How

• Short term: Using the closed/paid for ChatGPT Python API
• Migrating to a fully open stack ASAP

Leverage Generative AI across Open Food Facts (tracker)

Preview Give feedback

1. Allow to augment taxonomies using ChatGPT like models taxonomy-editor#233
   +0
2. Use LLMs to parse a natural language complex meal into foods with nutritional values for nutrition/environment tracking #304
   LLMs +1
3. Use LLMs to retrieve food wine pairings #305
   LLMs 🍷 wine +2
4. Turbocharge the mobile app using LLMs and Multimodal models #307
   LLMs +1

LLMs for data quality

Preview Give feedback

1. Use LLMs to spellcheck/lowercase ingredient lists #297
   LLMs ✨ enhancement +2

LLMs for annotation work

Preview Give feedback

No tasks being tracked yet.

LLMs for Data Quality

Preview Give feedback

1. Use LLMs to perform Data Quality analysis of products, and propose remediation steps #342
   LLMs 🧽 Data quality +2

LLMs for predictions/analysis

Preview Give feedback

1. Use LLMs to predict a category from nutrition facts #291
   LLMs +1
2. Use LLMs to parse ingredients lists #292
   LLMs +1
3. Use LLMs to determine the status of ingredients lists #293
   ⭐ top issue LLMs +2

LLMs for data extraction

Preview Give feedback

1. Use LLMs to extract ingredient lists from raw text #309
   LLMs LLMs - Data extraction +2
2. Recognize Nutrition tables using multimodal models (GPT4) #306
   LLMs - Data extraction nutrition facts +2
3. Use large language models (LLM) to perform ingredient list spellcheck #314
   LLMs ingredients spellcheck +3
   
4. Use LLMs to detect origin of ingredients #312
   LLMs LLMs - Data extraction 📍Origins +3

LLMs for highly structured content generation

Preview Give feedback

1. Use LLMs to create data models for Open Products Facts categories #296
   LLM - Taxonomies LLMs 📸 Open Products Facts +3
2. Use LLMs to create properly formatted taxonomy entries #294
   LLM - Taxonomies LLMs +2
3. Use LLMs to retrieve properties on ingredients/additives #298
   LLMs +1
4. Use LLMs to find subcategories for taxonomies #295
   LLM - Taxonomies LLMs +2
5. Use LLMs to put all categories in plural #290
   LLMs +1
6. Using ChatGPT to complete entries in different languages from wikidata. #288
   LLMs +1

LLMs for semi-structured/unstructured content generation

Preview Give feedback

1. Use LLMs to summarize labels
2. Use LLMs to generate tweets based on specific categories / tags… #300
   LLMs +1
3. Use LLMs to summarise long texts about Quality Schemes #303
   LLM - Summarization LLMs 📖 Knowledge panels +3
4. Use LLMs to generate tweets based on specific categories / tags… #299
   LLMs +1

LLMs for Open Food Facts teams productivity

Preview Give feedback

1. Use LLMs in Odoo Connect #301
   LLMs +1
2. Use LLMs in Odoo Connect #302
   LLMs +1

Ensuring Open Food Facts is leveraged by LLMs/stays relevant

Preview Give feedback

1. Turn the OpenAPI file into a ChatGPT plugin (.well-known/ai-plugin.json) openfoodfacts-server#8447
   .well-known OpenAPI ⏰ Stale +3