Skip to content

Commit

Permalink
docs: implement sidebar and add FAQs and groq integrations guide (#2273)
Browse files Browse the repository at this point in the history
docs: implement sidebar and add FAQs and groq integrations guide
  • Loading branch information
henryh0x1 authored Mar 9, 2024
2 parents acd0e79 + 59cf970 commit 40128ea
Show file tree
Hide file tree
Showing 4 changed files with 325 additions and 6 deletions.
83 changes: 80 additions & 3 deletions docs/docs/guides/faq.mdx
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,83 @@ keywords:
]
---

:::caution
This is currently under development.
:::
## General Issues

- **Why can't I download models like Pandora 11B Q4 and Solar Instruct 10.7B Q4?**
- These models might have been removed or taken down. Please check the [Pre-configured Models](models-list.mdx) for the latest updates on model availability.

- **Why does Jan display "Apologies, something's amiss" when I try to run it?**
- This issue may arise if you're using an older Intel chip that does not fully support AVX instructions required for running AI models. Upgrading your hardware may resolve this issue.

- **How can I use Jan in Russia?**
- To use Jan in Russia, a VPN or [HTTPS - Proxy](./advanced-settings/http-proxy.mdx) is recommended to bypass any regional restrictions that might be in place.

- **I'm experiencing an error on startup from Nitro. What should I do?**
- If you encounter errors with Nitro, try switching the path to use the Nitro executable for the version 12-0. This adjustment can help resolve path-related issues.

## Download and Installation Issues

- **What does "Error occurred: Unexpected token" mean?**
- This error usually indicates a problem with your internet connection or that your access to certain resources is being blocked. Using a VPN or [HTTPS - Proxy](./advanced-settings/http-proxy.mdx) can help avoid these issues by providing a secure and unrestricted internet connection.

- **Why aren't my downloads working?**
- If you're having trouble downloading directly through Jan, you might want to download the model separately and then import it into Jan. Detailed instructions are available on [here](install.mdx).

- **Jan AI doesn't open on my Mac with an Intel processor. What can I do?**
- Granting the `.npm` folder permission for the user can resolve issues related to permissions on macOS, especially for users with Intel processors.

- **What should I do if the model download freezes?**
- If a model download freezes, consider importing the models manually. You can find more detailed guidance on how to do this at [Manual Import](./models/import-models.mdx) article.

- **I received a message that the model GPT4 does not exist or I do not have access. What should I do?**
- This message typically means you need to top up your credit with OpenAI or check your access permissions for the model.

- **I can't download models from "Explore the Hub." What's the solution?**
- Uninstalling Jan, clearing the cache, and reinstalling it following the guide provided [here](install.mdx) may help. Also, consider downloading the `.gguf` model via a browser as an alternative approach.

## Technical Issues and Solutions

- **How can I download models with a socks5 proxy or import a local model file?**
- Nightly builds of Jan offer support for downloading models with socks5 proxies or importing local model files.

- **My device shows no GPU usage and lacks a Settings folder. What should I do?**
- Using the nightly builds of Jan can address issues related to GPU usage and the absence of a Settings folder, as these builds contain the latest fixes and features.

- **Why does Jan display a toast message saying a model is loaded when it is not actually loaded?**
- This issue can be resolved by downloading the `.gguf` file from Hugging Face and replacing it in the model folder. This ensures the correct model is loaded.

- **How to enable CORS when running Nitro?**
- By default, CORS (Cross-Origin Resource Sharing) is disabled when running Nitro. Enabling CORS can be necessary for certain operations and integrations. Check the official documentation for instructions on how to enable CORS if your workflow requires it.

## Compatibility and Support

- **How to use GPU AMD for Jan?**
- Jan now supports AMD GPUs through Vulkan. This enhancement allows users with AMD graphics cards to leverage GPU acceleration, improving performance for AI model computations.

- **Is Jan available for Android or iOS?**
- Jan is primarily focused on the Desktop app and does not currently offer mobile apps for Android or iOS. The development team is concentrating on enhancing the desktop experience.

## Development and Features

- **Does Jan support Safetensors?**
- At the moment, Jan only supports GGUF. However, there are plans to support `.safetensor` files in the future.

- **I hope to customize the installation path of each model. Is that possible?**
- Yes you can customize the installation path. Please see [here](https://jan.ai/guides/advanced-settings/#access-the-jan-data-folder) for more information.

## Troubleshooting

- **What should I do if there's high CPU usage while Jan is idle?**
- If you notice high CPU usage while Jan is idle, consider using the nightly builds of Jan

- **What does the error "Failed to fetch" mean, and how can I fix it?**
- The "Failed to fetch" error typically occurs due to network issues or restrictions. Using the nightly builds of Jan may help overcome these issues by providing updated fixes and features.

- **What should I do if "Failed to fetch" occurs using MacBook Pro with Intel HD Graphics 4000 1536 MB?**
- Ensure that the model size is less than 90% of your available VRAM and that the VRAM is accessible to the app. Managing the resources effectively can help mitigate this issue.

:::info[Assistance and Support]

If you have questions, please join our [Discord community](https://discord.gg/Dt7MxDyNNZ) for support, updates, and discussions.

:::
84 changes: 84 additions & 0 deletions docs/docs/guides/integration/groq.mdx
Original file line number Diff line number Diff line change
@@ -0,0 +1,84 @@
---
title: Groq
sidebar_position: 10
slug: /guides/integration/groq
description: Learn how to integrate Groq API with Jan for enhanced functionality.
keywords:
[
Groq API,
Jan,
Jan AI,
ChatGPT alternative,
conversational AI,
large language model,
integration,
Groq integration,
API integration
]
---

## How to Integrate Mistral AI with Jan

This guide provides step-by-step instructions on integrating the Groq API with Jan, enabling users to leverage Groq's capabilities within Jan's conversational interface.

Before proceeding, ensure you have the following:
- Access to the Jan Application
- Groq API credentials

## Integration Steps

### Step 1: Obtain Groq API Credentials

If you haven't already, sign up for the Groq API and obtain your API credentials.
Obtain Groq API keys from your [Groq Console](https://console.groq.com/keys).

### Step 2: Configure Jan Settings

1. Insert the Groq AI API key into `~/jan/engines/openai.json`.

```json title="~/jan/engines/openai.json"
{
"full_url": "https://api.groq.com/openai/v1/chat/completions",
"api_key": "<your-groq-api-key>"
}
```

### Step 3: Enable Groq Integration

To set up the configuration for Groq in Jan, follow these steps:

1. Navigate to `~/jan/models`.
2. Create a folder named `groq`.
3. Inside the groq folder, create a model.json file with the specified settings:
```json title="~/jan/models/groq/model.json
{
"id": "mixtral-8x7b-32768",
"object": "model",
"name": "Groq Integration",
"version": "1.0",
"description": "Integration with Groq API for enhanced functionality.",
"format": "api",
"sources": [],
"settings": {},
"parameters": {},
"metadata": {
"author": "Mistral",
"tags": ["Groq Integration"]
},
"engine": "openai"
}
```

### Step 4: Start the Model

1. Restart Jan and navigate to the **Hub**.
2. Locate your model and click the **Use** button.

## Troubleshooting

If you encounter any issues during the integration process or while using Groq with Jan, consider the following troubleshooting steps:

- Double-check your API credentials and ensure they are correctly entered.
- Verify that the Groq integration is enabled within Jan's settings.
- Check for any error messages or logs that may provide insight into the issue.
- Reach out to Groq API support for assistance if needed.
122 changes: 120 additions & 2 deletions docs/sidebars.js
Original file line number Diff line number Diff line change
Expand Up @@ -150,10 +150,128 @@ const sidebars = {
],
},
],
// guidesSidebar: [
// {
// type: "autogenerated",
// dirName: "guides",
// },
// ],
guidesSidebar: [
{
type: "autogenerated",
dirName: "guides",
type: "category",
label: "Get Started",
collapsible: false,
className: "head_Menu",
items: [
"guides/quickstart",
"guides/install",
"guides/start-server",
"guides/models-list"
]
},
{
type: "category",
label: "Guides",
collapsible: false,
className: "head_Menu",
items: [
"guides/best-practices",
"guides/thread",
]
},
{
type: "category",
label: "Advanced Features",
collapsible: false,
className: "head_Menu",
items: [
{
type: "category",
label: "Advanced Model Setup",
className: "head_SubMenu",
link: {
type: 'doc',
id: "guides/models/README",
},
items: [
"guides/models/customize-engine",
"guides/models/import-models",
"guides/models/integrate-remote",
]
},
{
type: "category",
label: "Extensions",
className: "head_SubMenu",
link: {
type: 'doc',
id: "guides/extensions/README",
},
items: [
"guides/extensions/import-ext",
"guides/extensions/setup-ext",
]
},
{
type: "category",
label: "Integrations",
className: "head_SubMenu",
link: {
type: 'doc',
id: "guides/integration/README",
},
items: [
"guides/integration/azure",
"guides/integration/discord",
"guides/integration/groq",
"guides/integration/lmstudio",
"guides/integration/mistral",
"guides/integration/ollama",
"guides/integration/openinterpreter",
"guides/integration/openrouter",
"guides/integration/raycast",
"guides/integration/vscode",
]
},
]
},
{
type: "category",
label: "Troubleshooting",
collapsible: false,
className: "head_Menu",
items: [
{
type: "category",
label: "Error Codes",
className: "head_SubMenu",
link: {
type: 'doc',
id: "guides/error-codes/README",
},
items: [
"guides/error-codes/how-to-get-error-logs",
"guides/error-codes/permission-denied",
"guides/error-codes/something-amiss",
"guides/error-codes/undefined-issue",
"guides/error-codes/unexpected-token",
]
},
{
type: "category",
label: "Common Error",
className: "head_SubMenu",
link: {
type: 'doc',
id: "guides/common-error/README",
},
items: [
"guides/common-error/broken-build",
"guides/common-error/not-using-gpu",
]
},
"guides/faq"
]
},
],
developerSidebar: [
Expand Down
42 changes: 41 additions & 1 deletion docs/src/css/custom.css
Original file line number Diff line number Diff line change
@@ -1,8 +1,48 @@
/* Hide descriptions in cards without a description */
.DocCardList--no-description .card p {
display: none;
}

/* For dark theme */
[data-theme="dark"] .DocSearch {
[data-theme='dark'] .DocSearch {
--docsearch-hit-active-color: #090a11; /* Keep the color unchanged */
}
/* Sidebar styles based on Docusaurus light theme */
[data-theme='light'] .head_Menu div {
font-weight: bold;
background-color: var(--ifm-background-color);
margin-left: 0.7rem;
font-size: larger;
color: var(--ifm-font-color-base);
}

[data-theme='light'] .head_Menu li {
font-weight: normal;
background-color: var(--ifm-background-color);
margin-bottom: 5px;
color: var(--ifm-font-color-base);
}

[data-theme='light'] .head_SubMenu div {
font-weight: normal;
background-color: var(--ifm-background-color);
margin-left: 0rem;
font-size: medium;
color: var(--ifm-font-color-base);
}

/* Dark mode styles based on Docusaurus dark theme */
[data-theme='dark'] .head_Menu div {
background-color: var(--ifm-background-color);
color: var(--ifm-font-color-base);
}

[data-theme='dark'] .head_Menu li {
background-color: var(--ifm-background-color);
color: var(--ifm-font-color-base);
}

[data-theme='dark'] .head_SubMenu div {
background-color: var(--ifm-background-color);
color: var(--ifm-font-color-base);
}

0 comments on commit 40128ea

Please sign in to comment.