diff --git a/404/index.html b/404/index.html index e283e30a..e1324862 100644 --- a/404/index.html +++ b/404/index.html @@ -1 +1 @@ -

LMSYS ORG

404 - Not Found

Go back home
\ No newline at end of file +

LMSYS ORG

404 - Not Found

Go back home
\ No newline at end of file diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/about.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/about.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/about.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/about.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-03-30-vicuna.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-03-30-vicuna.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-03-30-vicuna.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-03-30-vicuna.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-05-03-arena.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-05-03-arena.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-05-03-arena.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-05-03-arena.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-05-10-leaderboard.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-05-10-leaderboard.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-05-10-leaderboard.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-05-10-leaderboard.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-05-25-leaderboard.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-05-25-leaderboard.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-05-25-leaderboard.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-05-25-leaderboard.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-06-09-api-server.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-06-09-api-server.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-06-09-api-server.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-06-09-api-server.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-06-22-leaderboard.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-06-22-leaderboard.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-06-22-leaderboard.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-06-22-leaderboard.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-06-29-longchat.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-06-29-longchat.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-06-29-longchat.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-06-29-longchat.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-07-20-dataset.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-07-20-dataset.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-07-20-dataset.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-07-20-dataset.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-10-30-toxicchat.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-10-30-toxicchat.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-10-30-toxicchat.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-10-30-toxicchat.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-11-14-llm-decontaminator.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-11-14-llm-decontaminator.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-11-14-llm-decontaminator.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-11-14-llm-decontaminator.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-11-15-slora.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-11-15-slora.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-11-15-slora.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-11-15-slora.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-11-21-lookahead-decoding.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-11-21-lookahead-decoding.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-11-21-lookahead-decoding.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-11-21-lookahead-decoding.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-12-07-leaderboard.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-12-07-leaderboard.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2023-12-07-leaderboard.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2023-12-07-leaderboard.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-01-17-sglang.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-01-17-sglang.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-01-17-sglang.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-01-17-sglang.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-02-05-compressed-fsm.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-02-05-compressed-fsm.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-02-05-compressed-fsm.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-02-05-compressed-fsm.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-03-01-policy.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-03-01-policy.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-03-01-policy.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-03-01-policy.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-04-19-arena-hard.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-04-19-arena-hard.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-04-19-arena-hard.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-04-19-arena-hard.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-05-02-kaggle-competition.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-05-02-kaggle-competition.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-05-02-kaggle-competition.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-05-02-kaggle-competition.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-05-08-llama3.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-05-08-llama3.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-05-08-llama3.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-05-08-llama3.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-05-17-category-hard.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-05-17-category-hard.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-05-17-category-hard.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-05-17-category-hard.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-06-27-multimodal.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-06-27-multimodal.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-06-27-multimodal.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-06-27-multimodal.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-07-01-routellm.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-07-01-routellm.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-07-01-routellm.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-07-01-routellm.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-07-25-sglang-llama3.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-07-25-sglang-llama3.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/blog/2024-07-25-sglang-llama3.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/blog/2024-07-25-sglang-llama3.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/donations.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/donations.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/donations.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/donations.json diff --git a/_next/data/myo2bpmwrF9j4tLQW71wL/vicuna_eval.json b/_next/data/8yNmkU2-cP1rtQOQHvOGy/vicuna_eval.json similarity index 100% rename from _next/data/myo2bpmwrF9j4tLQW71wL/vicuna_eval.json rename to _next/data/8yNmkU2-cP1rtQOQHvOGy/vicuna_eval.json diff --git a/_next/static/myo2bpmwrF9j4tLQW71wL/_buildManifest.js b/_next/static/8yNmkU2-cP1rtQOQHvOGy/_buildManifest.js similarity index 100% rename from _next/static/myo2bpmwrF9j4tLQW71wL/_buildManifest.js rename to _next/static/8yNmkU2-cP1rtQOQHvOGy/_buildManifest.js diff --git a/_next/static/myo2bpmwrF9j4tLQW71wL/_middlewareManifest.js b/_next/static/8yNmkU2-cP1rtQOQHvOGy/_middlewareManifest.js similarity index 100% rename from _next/static/myo2bpmwrF9j4tLQW71wL/_middlewareManifest.js rename to _next/static/8yNmkU2-cP1rtQOQHvOGy/_middlewareManifest.js diff --git a/_next/static/myo2bpmwrF9j4tLQW71wL/_ssgManifest.js b/_next/static/8yNmkU2-cP1rtQOQHvOGy/_ssgManifest.js similarity index 100% rename from _next/static/myo2bpmwrF9j4tLQW71wL/_ssgManifest.js rename to _next/static/8yNmkU2-cP1rtQOQHvOGy/_ssgManifest.js diff --git a/about/index.html b/about/index.html index e7297b45..7bb9a195 100644 --- a/about/index.html +++ b/about/index.html @@ -1,4 +1,4 @@ -About | LMSYS Org

LMSYS ORG

ABOUT

Large Model Systems Organization (LMSYS Org) is an open research organization founded by students and faculty from UC Berkeley in collaboration with UCSD and CMU.

+About | LMSYS Org

ABOUT

Large Model Systems Organization (LMSYS Org) is an open research organization founded by students and faculty from UC Berkeley in collaboration with UCSD and CMU.

We aim to make large models accessible to everyone by co-development of open models, datasets, systems, and evaluation tools. Our work encompasses research in both machine learning and systems. We train large language models and make them widely available, while also developing distributed systems to accelerate their training and inference.

Members

Student Team
@@ -13,4 +13,4 @@

Contact us

  • Join us on discord.
  • Follow us on twitter.
    • -
    \ No newline at end of file +
    \ No newline at end of file diff --git a/blog/2023-03-30-vicuna/index.html b/blog/2023-03-30-vicuna/index.html index 98520384..7590c94b 100644 --- a/blog/2023-03-30-vicuna/index.html +++ b/blog/2023-03-30-vicuna/index.html @@ -1,4 +1,4 @@ -Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality | LMSYS Org

    LMSYS ORG

    Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

    by: The Vicuna Team, Mar 30, 2023

    We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.

    +Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality | LMSYS Org

    Vicuna: An Open-Source Chatbot Impressing GPT-4 with 90%* ChatGPT Quality

    by: The Vicuna Team, Mar 30, 2023

    We introduce Vicuna-13B, an open-source chatbot trained by fine-tuning LLaMA on user-shared conversations collected from ShareGPT. Preliminary evaluation using GPT-4 as a judge shows Vicuna-13B achieves more than 90%* quality of OpenAI ChatGPT and Google Bard while outperforming other models like LLaMA and Stanford Alpaca in more than 90%* of cases. The cost of training Vicuna-13B is around $300. The code and weights, along with an online demo, are publicly available for non-commercial use.

    Vicuna (generated by stable diffusion 2.1)

    *According to a fun and non-scientific evaluation with GPT-4. Further rigorous evaluation is needed.

    @@ -171,4 +171,4 @@

    Judging LLM-as-a-judge with MT-Bench and Chatbot Arena.

    -

    \ No newline at end of file +
    \ No newline at end of file diff --git a/blog/2023-05-03-arena/index.html b/blog/2023-05-03-arena/index.html index 9802ee4e..75a8a787 100644 --- a/blog/2023-05-03-arena/index.html +++ b/blog/2023-05-03-arena/index.html @@ -1,4 +1,4 @@ -Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings | LMSYS Org

    LMSYS ORG

    Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

    by: Lianmin Zheng*, Ying Sheng*, Wei-Lin Chiang, Hao Zhang, Joseph E. Gonzalez, Ion Stoica, May 03, 2023

    We present Chatbot Arena, a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner. In this blog post, we are releasing our initial results and a leaderboard based on the Elo rating system, which is a widely-used rating system in chess and other competitive games. We invite the entire community to join this effort by contributing new models and evaluating them by asking questions and voting for your favorite answer.

    +Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings | LMSYS Org

    Chatbot Arena: Benchmarking LLMs in the Wild with Elo Ratings

    by: Lianmin Zheng*, Ying Sheng*, Wei-Lin Chiang, Hao Zhang, Joseph E. Gonzalez, Ion Stoica, May 03, 2023

    We present Chatbot Arena, a benchmark platform for large language models (LLMs) that features anonymous, randomized battles in a crowdsourced manner. In this blog post, we are releasing our initial results and a leaderboard based on the Elo rating system, which is a widely-used rating system in chess and other competitive games. We invite the entire community to join this effort by contributing new models and evaluating them by asking questions and voting for your favorite answer.

    -
    \ No newline at end of file +
    \ No newline at end of file