Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Enable user loading model with external data from memory buffer #23557

Merged
merged 6 commits into from
Feb 6, 2025

Conversation

HectorSVC
Copy link
Contributor

@HectorSVC HectorSVC commented Jan 31, 2025

Add session option to enable user loading model with external data from memory buffer. User want to set the folder path for the external data files.

Description

For some cases user load the model from memory buffer, but they can't load the external files into memory. They need to have a way to set the folder path for the external data files so that Ort can figure out the external data location.

…rom memory buffer, and the model depend on external data. User want to set the folder path for the external data files.
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can commit the suggested changes from lintrunner.

include/onnxruntime/core/session/onnxruntime_cxx_api.h Outdated Show resolved Hide resolved
HectorSVC and others added 4 commits January 31, 2025 12:53
Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
…s configure key-value pair instead of adding new API
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

You can commit the suggested changes from lintrunner.

include/onnxruntime/core/session/onnxruntime_cxx_api.h Outdated Show resolved Hide resolved
@HectorSVC HectorSVC changed the title Add API to enable user loading model with external data from memory buffer Enable user loading model with external data from memory buffer Feb 5, 2025
@HectorSVC HectorSVC merged commit 649ced4 into main Feb 6, 2025
100 checks passed
@HectorSVC HectorSVC deleted the external_data_path branch February 6, 2025 06:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants