From d95f854add091e9c321ae9a8b0289b12e95e1b42 Mon Sep 17 00:00:00 2001 From: Edward Brown Date: Mon, 21 Oct 2024 09:55:31 +0100 Subject: [PATCH] Add AI tools to README --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 78080e9..8b2c695 100644 --- a/README.md +++ b/README.md @@ -80,6 +80,8 @@ MissingExtraError: The current module is missing dependencies. To install them, The included modules, plus any extra requirements, are as follows: +- `tools.ai`: Manages bulk inference for LLMs using dynamic batching. Includes classes for managing prompt encoding, generating outputs, and handling tool calls, with support for both local and remote models. Uses Pytorch and Transformers for model operations, and provides functionality for encoding prompts, generating responses, and applying tool functions. + - Extras: `ai` - `tools.config`: Base config class with overridable field processors. - Extras: None - `tools.dataclass`: Utilities for extracting and filtering fields and metadata from dataclasses, with support for applying filters and retrieving enabled fields based on metadata attributes.