diff --git a/404/index.html b/404/index.html index 86054977..0751499c 100644 --- a/404/index.html +++ b/404/index.html @@ -1 +1 @@ -

LMSYS ORG

404 - Not Found

Go back home
\ No newline at end of file +

LMSYS ORG

404 - Not Found

Go back home
\ No newline at end of file diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/donations.json b/_next/data/6Uids9ohZdels5vN1IEvv/donations.json deleted file mode 100644 index defde413..00000000 --- a/_next/data/6Uids9ohZdels5vN1IEvv/donations.json +++ /dev/null @@ -1 +0,0 @@ -{"pageProps":{"frontmatter":{"title":"Donations"},"content":" \nLMSYS Org primarily relies on university grants and donations.\n\nWe welcome diverse forms of donations and sponsorships, including cash, GPU hardware and hours, cloud credits, other computing resources, and more.\nIf you would like to support our research and development efforts on large models, please contact us at [lmsys.org@gmail.com](mailto:lmsysorg@gmail.com?subject=Donation%20to%20LMSYS%20Org).\n\n### Current Sponsors\n[Kaggle](https://www.kaggle.com/), [MBZUAI](https://mbzuai.ac.ae/), [a16z](https://a16z.com/), [Together](https://www.together.ai/), [Hyperbolic](https://hyperbolic.xyz), [AnyScale](https://www.anyscale.com/), [HuggingFace](https://huggingface.co/)\n"},"__N_SSG":true} \ No newline at end of file diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/about.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/about.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/about.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/about.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-03-30-vicuna.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-03-30-vicuna.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-03-30-vicuna.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-03-30-vicuna.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-05-03-arena.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-05-03-arena.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-05-03-arena.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-05-03-arena.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-05-10-leaderboard.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-05-10-leaderboard.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-05-10-leaderboard.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-05-10-leaderboard.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-05-25-leaderboard.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-05-25-leaderboard.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-05-25-leaderboard.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-05-25-leaderboard.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-06-09-api-server.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-06-09-api-server.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-06-09-api-server.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-06-09-api-server.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-06-22-leaderboard.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-06-22-leaderboard.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-06-22-leaderboard.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-06-22-leaderboard.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-06-29-longchat.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-06-29-longchat.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-06-29-longchat.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-06-29-longchat.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-07-20-dataset.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-07-20-dataset.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-07-20-dataset.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-07-20-dataset.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-10-30-toxicchat.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-10-30-toxicchat.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-10-30-toxicchat.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-10-30-toxicchat.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-11-14-llm-decontaminator.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-11-14-llm-decontaminator.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-11-14-llm-decontaminator.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-11-14-llm-decontaminator.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-11-15-slora.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-11-15-slora.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-11-15-slora.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-11-15-slora.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-11-21-lookahead-decoding.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-11-21-lookahead-decoding.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-11-21-lookahead-decoding.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-11-21-lookahead-decoding.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2023-12-07-leaderboard.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-12-07-leaderboard.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2023-12-07-leaderboard.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2023-12-07-leaderboard.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-01-17-sglang.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-01-17-sglang.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-01-17-sglang.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-01-17-sglang.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-02-05-compressed-fsm.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-02-05-compressed-fsm.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-02-05-compressed-fsm.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-02-05-compressed-fsm.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-03-01-policy.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-03-01-policy.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-03-01-policy.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-03-01-policy.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-04-19-arena-hard.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-04-19-arena-hard.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-04-19-arena-hard.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-04-19-arena-hard.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-05-02-kaggle-competition.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-05-02-kaggle-competition.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-05-02-kaggle-competition.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-05-02-kaggle-competition.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-05-08-llama3.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-05-08-llama3.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-05-08-llama3.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-05-08-llama3.json diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/blog/2024-05-17-category-hard.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-05-17-category-hard.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/blog/2024-05-17-category-hard.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/blog/2024-05-17-category-hard.json diff --git a/_next/data/mB5kttiB4CFr2nvhvZ7CB/donations.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/donations.json new file mode 100644 index 00000000..4778cdc5 --- /dev/null +++ b/_next/data/mB5kttiB4CFr2nvhvZ7CB/donations.json @@ -0,0 +1 @@ +{"pageProps":{"frontmatter":{"title":"Donations"},"content":" \nLMSYS Org primarily relies on university grants and donations to serve models and support infrastructure. We welcome diverse forms of donations and sponsorships, including cash, GPU hardware and hours, cloud credits, computing resources, and more. To donate, please contact us at [lmsys.org@gmail.com](mailto:lmsysorg@gmail.com?subject=Donation%20to%20LMSYS%20Org).\n\n## Current Sponsors and Supporters\n\nWe thank the following sponsors for supplying resources for supporting our infrastructure. All resources supplied are gifts with no strings attached.\n\n[Kaggle](https://www.kaggle.com/), [MBZUAI](https://mbzuai.ac.ae/), [a16z](https://a16z.com/), [Together](https://www.together.ai/), [Hyperbolic](https://hyperbolic.xyz), [RunPod](https://www.runpod.io/), [NVIDIA](https://build.nvidia.com/), [Anyscale](https://www.anyscale.com/), [HuggingFace](https://huggingface.co/)\n\nWe also thank the following companies which provide API credits to serve their models on Chatbot Arena:\n[Alibaba](https://www.alibabacloud.com/en/solutions/generative-ai/qwen), [Anthropic](https://www.anthropic.com/api), [Cohere](https://cohere.com/), [Databricks](https://www.databricks.com/), [Google](https://ai.google.dev/), [Mistral](https://mistral.ai/), [OpenAI](https://www.openai.com/), [Reka](https://www.reka.ai/), [Zhipu AI](https://open.bigmodel.cn/), [01ai](https://www.01.ai/)"},"__N_SSG":true} \ No newline at end of file diff --git a/_next/data/6Uids9ohZdels5vN1IEvv/vicuna_eval.json b/_next/data/mB5kttiB4CFr2nvhvZ7CB/vicuna_eval.json similarity index 100% rename from _next/data/6Uids9ohZdels5vN1IEvv/vicuna_eval.json rename to _next/data/mB5kttiB4CFr2nvhvZ7CB/vicuna_eval.json diff --git a/_next/static/6Uids9ohZdels5vN1IEvv/_ssgManifest.js b/_next/static/6Uids9ohZdels5vN1IEvv/_ssgManifest.js deleted file mode 100644 index 1714580a..00000000 --- a/_next/static/6Uids9ohZdels5vN1IEvv/_ssgManifest.js +++ /dev/null @@ -1 +0,0 @@ -self.__SSG_MANIFEST=new Set(["\u002Fabout","\u002Fdonations","\u002Fvicuna_eval","\u002Fblog","\u002Fblog\u002F[slug]"]);self.__SSG_MANIFEST_CB&&self.__SSG_MANIFEST_CB() \ No newline at end of file diff --git a/_next/static/6Uids9ohZdels5vN1IEvv/_buildManifest.js b/_next/static/mB5kttiB4CFr2nvhvZ7CB/_buildManifest.js similarity index 100% rename from _next/static/6Uids9ohZdels5vN1IEvv/_buildManifest.js rename to _next/static/mB5kttiB4CFr2nvhvZ7CB/_buildManifest.js diff --git a/_next/static/6Uids9ohZdels5vN1IEvv/_middlewareManifest.js b/_next/static/mB5kttiB4CFr2nvhvZ7CB/_middlewareManifest.js similarity index 100% rename from _next/static/6Uids9ohZdels5vN1IEvv/_middlewareManifest.js rename to _next/static/mB5kttiB4CFr2nvhvZ7CB/_middlewareManifest.js diff --git a/_next/static/mB5kttiB4CFr2nvhvZ7CB/_ssgManifest.js b/_next/static/mB5kttiB4CFr2nvhvZ7CB/_ssgManifest.js new file mode 100644 index 00000000..3ee7ebdb --- /dev/null +++ b/_next/static/mB5kttiB4CFr2nvhvZ7CB/_ssgManifest.js @@ -0,0 +1 @@ +self.__SSG_MANIFEST=new Set(["\u002Fabout","\u002Fblog","\u002Fvicuna_eval","\u002Fdonations","\u002Fblog\u002F[slug]"]);self.__SSG_MANIFEST_CB&&self.__SSG_MANIFEST_CB() \ No newline at end of file diff --git a/about/index.html b/about/index.html index cc006ec4..5eec0a5f 100644 --- a/about/index.html +++ b/about/index.html @@ -1,4 +1,4 @@ -About | LMSYS Org

LMSYS ORG

ABOUT

Large Model Systems Organization (LMSYS Org) is an open research organization founded by students and faculty from UC Berkeley in collaboration with UCSD and CMU.

+About | LMSYS Org

ABOUT

Large Model Systems Organization (LMSYS Org) is an open research organization founded by students and faculty from UC Berkeley in collaboration with UCSD and CMU.

We aim to make large models accessible to everyone by co-development of open models, datasets, systems, and evaluation tools. Our work encompasses research in both machine learning and systems. We train large language models and make them widely available, while also developing distributed systems to accelerate their training and inference.

Members

Student Team
@@ -13,4 +13,4 @@

Contact us

  • Join us on discord.
  • Follow us on twitter.
    • -
    \ No newline at end of file +
    \ No newline at end of file diff --git a/blog/2023-03-30-vicuna/index.html b/blog/2023-03-30-vicuna/index.html index db88eb50..330ecb2e 100644 --- a/blog/2023-03-30-vicuna/index.html +++ b/blog/2023-03-30-vicuna/index.html @@ -1,4 +1,4 @@ -Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality | LMSYS Org

    LMSYS ORG

    Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

    by: The Vicuna Team, Mar 30, 2023

    We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.

    +Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality | LMSYS Org

    Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

    by: The Vicuna Team, Mar 30, 2023

    We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.

    Vicuna (generated by stable diffusion 2.1)

    *According to a fun and non-scientific evaluation with GPT-4. Further rigorous evaluation is needed.

    @@ -171,4 +171,4 @@

    Judging LLM-as-a-judge with MT-Bench and Chatbot Arena.

    -

    \ No newline at end of file +
    \ No newline at end of file diff --git a/blog/2023-05-03-arena/index.html b/blog/2023-05-03-arena/index.html index 4fc6f680..22e9ebf8 100644 --- a/blog/2023-05-03-arena/index.html +++ b/blog/2023-05-03-arena/index.html @@ -1,4 +1,4 @@ -Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings | LMSYS Org

    LMSYS ORG

    Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

    by: Lianmin Zheng*, Ying Sheng*, Wei-Lin Chiang, Hao Zhang, Joseph E. Gonzalez, Ion Stoica, May 03, 2023

    We present Chatbot Arena, a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner. In this blog post, we are releasing our initial results and a leaderboard based on the Elo rating system, which is a widely-used rating system in chess and other competitive games. We invite the entire community to join this effort by contributing new models and evaluating them by asking questions and voting for your favorite answer.

    +Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings | LMSYS Org

    Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

    by: Lianmin Zheng*, Ying Sheng*, Wei-Lin Chiang, Hao Zhang, Joseph E. Gonzalez, Ion Stoica, May 03, 2023

    We present Chatbot Arena, a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner. In this blog post, we are releasing our initial results and a leaderboard based on the Elo rating system, which is a widely-used rating system in chess and other competitive games. We invite the entire community to join this effort by contributing new models and evaluating them by asking questions and voting for your favorite answer.

    -
    \ No newline at end of file +
    \ No newline at end of file