Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

[Java] Add FP16 Support for Java Client #79

Open
wants to merge 1 commit into
base: main
Choose a base branch
from

Conversation

du00cs
Copy link

@du00cs du00cs commented Mar 3, 2022

Also change the minimum retryCnt to 0, retry can sometimes be expensive. If it is not acceptable, I will remove that.

@gaojiansen
Copy link

请问java把图片的rgb数组传到推理服务后,服务器需要的格式是uint8格式 java中把获取的r,g,b三个参数转成byt并添加到byte数组后 是有符号的二进制 那需要怎么才能转成无符号的二进制传呢?

@matthewkotila
Copy link
Contributor

@jbkyang-nvi can you review this code? I think you were the one who mainly worked on the java client. If I'm mistaken, can you recommend someone who is familiar with it?

@jbkyang-nvi
Copy link
Contributor

@krishung5 can you take a look? I can review sometimes next week.
@du00cs can you send us the CLA? ref: https://github.com/triton-inference-server/server/blob/main/CONTRIBUTING.md

Copy link
Contributor

@krishung5 krishung5 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@du00cs Thanks for the contribution! Only a minor comment, otherwise LGTM. Apart from the changes, could you rebase onto the main branch as well? I will be testing these changes on our CI.

@@ -269,6 +269,50 @@ public double[] getOutputAsDouble(String output) {
return (double[])getOutputImpl(out, double.class, ByteBuffer::getDouble);
}

public float[] getOutputFp16AsFloat(String output) {
Copy link
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Could you add the comments for this function like the other ones just for the consistency?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Development

Successfully merging this pull request may close these issues.

5 participants