Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

# Epic: New parameters in metadata.yml #57

Open
hahuyhoang411 opened this issue Nov 7, 2024 · 0 comments
Open

# Epic: New parameters in metadata.yml #57

hahuyhoang411 opened this issue Nov 7, 2024 · 0 comments
Assignees
Labels
P0: critical Mission critical

Comments

@hahuyhoang411
Copy link
Collaborator

Purpose

To improve user experience by providing better organization and filtering capabilities for models in the model hub.

Current Parameters

version: 1 # Increment from v1 to indicate new schema
name: string  # Unique identifier for the model
default: string  # Default quantization/variant of the model

New Parameters - Model Capabilities

context_length: integer  # Maximum context window size
modalities:  # Supported input/output types
  type: array
  enum: 
    - text
    - vision 
    - speech
    - multimodal

series: string  # Model architecture family (e.g., Llama, Mistral, Phi)
base_model: string  # Original base model name
license: string  # Model license type
release_date: date  # Initial release date of this version (mm/dd/yyyy)

categories:  # Primary use cases/strengths
  type: array
  enum:
    - general
    - coding
    - math
    - roleplay
    - analysis
    - creative
    - chat

supported_engines:  # Compatible inference engines
  type: array
  enum:
    - llama.cpp
    - onnx
    - tensorrt-llm
    - api

tool_support:  # Function calling/tool usage capabilities
  type: object
  properties:
    enabled: boolean
    supported_tools:
      type: array
      items: string  # e.g., "web_search", "code_interpreter"

Example

version: 1
name: amd-olmo
default: 1b-gguf-q4-km

# Capabilities
context_length: 8192
modalities: 
  - text

# Information
series: olmo
base_model: olmo-1b
license: apache-2.0
release_date: 10/30/2024

# Categories
categories:
  - general
  - coding

# Technical
supported_engines:
  - llama.cpp

tool_support:
  enabled: false
  supported_tools: []
@hahuyhoang411 hahuyhoang411 self-assigned this Nov 7, 2024
@hahuyhoang411 hahuyhoang411 added the P0: critical Mission critical label Nov 7, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
P0: critical Mission critical
Projects
Status: In Review
Development

No branches or pull requests

1 participant