Text generation application using ML offloading. #363
Conversation
This file contains bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
This patch adds tizen web application template from tizen studio. Signed-off-by: Yelin Jeong <[email protected]>
This patch adds pipeline for query client. Also, buttons and input box are added. Signed-off-by: Yelin Jeong <[email protected]>
This patch adds nsd service. Tizen only has native nsd related api, so native service is needed to find ip and port. Signed-off-by: Yelin Jeong <[email protected]>
This patch uses nsd to find llama service provided by android device. Signed-off-by: Yelin Jeong <[email protected]>
This patch adds README of text generation tizen web example. Signed-off-by: Yelin Jeong <[email protected]>
niley7464
requested review from
jaeyun-jung,
myungjoo,
again4you,
leemgs,
wooksong,
gichan-jang and
anyj0527
as code owners
|
📝 TAOS-CI Version: 1.5.20200925. Thank you for submitting PR #363. Please a submit 1commit/1PR (one commit per one PR) policy to get comments quickly from reviewers. Your PR must pass all verificiation processes of cibot before starting a review process from reviewers. If you are new member to join this project, please read manuals in documentation folder and wiki page. In order to monitor a progress status of your PR in more detail, visit http://ci.nnstreamer.ai/. |
taos-ci
approved these changes
Oct 21, 2024
There was a problem hiding this comment.
@niley7464, 💯 All CI checkers are successfully verified. Thanks.
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR adds text generation tizen web application.
Use ML offloading to retrieve the results of the llm model, which is difficult to operate on the RPI.
Self evaluation: