rullm

Yet another Rust library and CLI for interacting with LLMs.

🚀 Quick Start

CLI Usage

# Basic query
rullm "What is the capital of France?"

# Use different models with aliases
rullm --model gpt4 "Explain quantum computing"
rullm --model claude "Write a poem about the ocean"
rullm --model gemini "What's the weather like?"

# Use templates for structured queries ({{input}} placeholder is automatically filled)
rullm -t code-review "Review this function"

# Interactive chat
rullm chat --model claude

rullm "Tell me a story"
rullm --model gpt4 "Explain quantum computing in detail"
rullm chat --model claude

# Disable streaming for buffered output
rullm --no-streaming "Write a poem about the ocean"
rullm chat --no-streaming --model gemini

# Set up your API keys
rullm keys set openai
export OPENAI_API_KEY="your-key-here"

🔧 CLI Commands

Model Management

# List available models
rullm models list

# Manage aliases
rullm alias list
rullm alias add my-fast "openai/gpt-3.5-turbo"
rullm alias show claude

# API key management
rullm keys set openai
rullm keys list

📝 Templates

Template Usage

# Use a template ({{input}} is replaced by your query)
rullm -t my-template "input text"

Template Format

Templates are stored as TOML files in ~/.config/rullm/templates/ (or your system's config directory):

name = "code-review"
description = "Template for code review requests"
# You can include multi-line prompts using TOML triple-quoted strings:
system_prompt = """
You are a senior Rust engineer.

Provide a thorough review with the following structure:
1. Summary
2. Strengths
3. Weaknesses
4. Suggestions
"""
user_prompt = "Please review this code: {{input}}"

Template Placeholders

• {{input}} – Automatically filled with the user's query text.

Built-in Model Aliases

Alias	Full Model
gpt4	openai/gpt-4
gpt4o	openai/gpt-4o
turbo	openai/gpt-3.5-turbo
claude	anthropic/claude-3-5-sonnet-20241022
sonnet	anthropic/claude-3-5-sonnet-20241022
opus	anthropic/claude-3-opus-20240229
gemini	google/gemini-1.5-pro
gemini-flash	google/gemini-1.5-flash

Shell Completion

To enable shell completion, generate the completion script for your shell:

# fish
source (COMPLETE=fish ./target/debug/rullm | psub)

# bash
source <(COMPLETE=bash ./target/debug/rullm)

# zsh
source <(COMPLETE=zsh ./target/debug/rullm)