Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Benchmark Code #27

Open
wants to merge 23 commits into
base: main
Choose a base branch
from
Open

Benchmark Code #27

wants to merge 23 commits into from

Commits on Aug 6, 2024

  1. update new model list with new reuploaded model and ipex option in mo… 

    …delui
    @szeyu
    szeyu committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    50f4c34 View commit details
    Browse the repository at this point in the history

  2. fix the typo of mistral repo id

    @szeyu
    szeyu committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    ec2f421 View commit details
    Browse the repository at this point in the history

  3. edit to the latest version of models available

    @szeyu
    szeyu committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    dbdefa0 View commit details
    Browse the repository at this point in the history

  4. change the context length of 128k to 131072

    @szeyu
    szeyu committed Aug 6, 2024
    Configuration menu
    Copy the full SHA
    0965d51 View commit details
    Browse the repository at this point in the history

Commits on Aug 12, 2024

  1. Merge branch 'main' into szeyu-autoloader-1

    @szeyu
    szeyu committed Aug 12, 2024
    Configuration menu
    Copy the full SHA
    b905aa9 View commit details
    Browse the repository at this point in the history

Commits on Aug 13, 2024

  1. onnx auto download model if repo id is provided as model path

    @szeyu
    szeyu committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    5dbf495 View commit details
    Browse the repository at this point in the history

  2. formated with black

    @szeyu
    szeyu committed Aug 13, 2024
    Configuration menu
    Copy the full SHA
    fb2c63e View commit details
    Browse the repository at this point in the history

Commits on Aug 14, 2024

  1. fixed with flake8

    @szeyu
    szeyu committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    f8c8f27 View commit details
    Browse the repository at this point in the history

  2. add openvino description and the device gpu

    @szeyu
    szeyu committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    d54b4d8 View commit details
    Browse the repository at this point in the history

  3. update openvino in modelui list

    @szeyu
    szeyu committed Aug 14, 2024
    Configuration menu
    Copy the full SHA
    1c3b393 View commit details
    Browse the repository at this point in the history

Commits on Aug 15, 2024

  1. first commit of benchmark code

    @szeyu
    szeyu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    75eff7c View commit details
    Browse the repository at this point in the history

  2. update for the markdown to teach about benchmark code usage

    @szeyu
    szeyu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    608670c View commit details
    Browse the repository at this point in the history

  3. Rename benchmark.md to README.md

    @szeyu
    szeyu authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    21d95aa View commit details
    Browse the repository at this point in the history

  4. Update README.md

    @szeyu
    szeyu authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    a038376 View commit details
    Browse the repository at this point in the history

  5. fixed the bias for encode and output_token_length for openvino

    @szeyu
    szeyu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    ca93ba9 View commit details
    Browse the repository at this point in the history

  6. Merge branch 'szeyu-benchmark-2' of https://github.com/EmbeddedLLM/em… 

    …beddedllm into szeyu-benchmark-2
    @szeyu
    szeyu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    79af320 View commit details
    Browse the repository at this point in the history

  7. Update loop_ellm_benchmark.py

    @szeyu
    szeyu authored Aug 15, 2024
    Configuration menu
    Copy the full SHA
    632d651 View commit details
    Browse the repository at this point in the history

  8. add prompt bias to fix the token encode margin error for directml

    @szeyu
    szeyu committed Aug 15, 2024
    Configuration menu
    Copy the full SHA
    e51527d View commit details
    Browse the repository at this point in the history

Commits on Aug 16, 2024

  1. Update ellm_benchmark.py

    @szeyu
    szeyu authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    013adc4 View commit details
    Browse the repository at this point in the history

  2. Update loop_ellm_benchmark.py

    @szeyu
    szeyu authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    62e0b2c View commit details
    Browse the repository at this point in the history

  3. Update README.md

    @szeyu
    szeyu authored Aug 16, 2024
    Configuration menu
    Copy the full SHA
    03cc6b7 View commit details
    Browse the repository at this point in the history

Commits on Sep 2, 2024

  1. update the benchmark loop to loop without having the model load again… 

    … in every loop
    @szeyu
    szeyu committed Sep 2, 2024
    Configuration menu
    Copy the full SHA
    4998e2c View commit details
    Browse the repository at this point in the history

  2. Update loop_ellm_benchmark.py

    @szeyu
    szeyu authored Sep 2, 2024
    Configuration menu
    Copy the full SHA
    769e558 View commit details
    Browse the repository at this point in the history