Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Faster data downloads #123

Open
wants to merge 4 commits into
base: main
Choose a base branch
from
Open

Faster data downloads #123

wants to merge 4 commits into from

Commits on Mar 3, 2024

  1. faster downloads with wget 

    Updated scripts in /scripts. Note that only download_checkpoints.sh and download_data.sh are included. To update download_pretrained_sd.sh, it would be better to do a version where huggingface-cli and hf-transfer are required, as this would use the native download wrappers.
    @sealad886
    sealad886 committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    d421bd8 View commit details
    Browse the repository at this point in the history

  2. update to pretrained data 

    Okay, I went ahead and just updated that script but checked if HF_HUB_ENABLE_HF_TRANSFER was set first otherwise just left the original curl in place.
    @sealad886
    sealad886 committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    6dfdfbf View commit details
    Browse the repository at this point in the history

  3. Revert "update to pretrained data" 

    This reverts commit 6dfdfbf.
    @sealad886
    sealad886 committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    0f713ac View commit details
    Browse the repository at this point in the history

  4. update to pretrained data 

    Okay, I went ahead and just updated that script but checked if HF_HUB_ENABLE_HF_TRANSFER was set first otherwise just left the original curl in place.
    @sealad886
    sealad886 committed Mar 3, 2024
    Configuration menu
    Copy the full SHA
    5a330c3 View commit details
    Browse the repository at this point in the history