Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Custom LFS Sever #970

Merged
merged 4 commits into from
Dec 6, 2024
Merged

Custom LFS Sever #970

merged 4 commits into from
Dec 6, 2024

Conversation

refringe
Copy link
Contributor

@refringe refringe commented Dec 5, 2024

We've created our own Git Large File Storage (LFS) server due to the excessive cost of GitHub's bandwidth. Did you know all of their Ethernet cables are actually gold coated diamonds?

This PR reverses the work done in #954 to compress large location JSON files into a 7zip archive and handle the (de)compression of the archive.

Only JSON files within the project/assets/database/ directory that are larger than 5MB have been included in LFS. This translates to all of the looseLoot.json files. The rest are small enough to be included in the base repo.

A .lfsconfig file has been added to the root of the project to alert git to the presence of the custom LFS server. This public server is read-only. Write access is only available to developers within the Single Player Tarkov GitHub organization.

This commit reverts the compression code that was added to lower the amount of LFS bandwidth that is used. We have spun up a custom LFS server, so we can safely bring back the raw JSON files as we're not as concerned about bandwidth.
Oh JSON, my structured delight,
In curly braces, you shine so bright.
Keys and values, a dance so neat,
A coder's joy, both terse and sweet.

Your syntax sings in nested rhyme,
Parsing truths in real-time.
Arrays and objects, a seamless stream,
You hold the data of every dream.

Through RESTful calls, you traverse the air,
A universal format, beyond compare.
Oh JSON, my digital muse,
In you, a world of logic I choose.
@refringe refringe added the enhancement New feature or request label Dec 5, 2024
@refringe refringe added this to the 3.10.2 milestone Dec 5, 2024
@refringe refringe self-assigned this Dec 5, 2024
@refringe
Copy link
Contributor Author

refringe commented Dec 5, 2024

Son of a... All of the workflows use an action that doesn't support custom LFS servers. It needs a manual touch. Don't merge this yet!

We good. 👍

The `actions/checkout@v4` action does not support `.lfsconfig` files, which means that our custom LFS server can't be used with this action. The work around is to disable the LFS operation in the action then manually pull the LFS files in a step after the normal repo is pulled down.
@DrakiaXYZ
Copy link
Contributor

From what we tested the other day, this seems like it should work, hopefully

@chompDev chompDev merged commit 6c9e4fd into 3.10.2-dev Dec 6, 2024
0 of 4 checks passed
@refringe refringe deleted the lfs-server branch December 7, 2024 18:56
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
enhancement New feature or request
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants