Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

expose posenet {Part}Confidence and PoseConfidence #32

Open
wr200m opened this issue Mar 3, 2020 · 2 comments
Open

expose posenet {Part}Confidence and PoseConfidence #32

wr200m opened this issue Mar 3, 2020 · 2 comments

Comments

@wr200m
Copy link

wr200m commented Mar 3, 2020

Describe the desired feature
Currently only the configuration properties of MinPartConfidence and MinPoseConfidence can be queried? Would like to see PoseConfidence and {Part}Confidence to be available for all parts.

Give an example of how this feature would be used

// the following callback only works when the pose detection passes MinPoseConfidence 
// so I would want to paint the canvas whether there's a pose inside the camera feed or not,
// and meanwhile I want the pose analysis to start only when the picture has an actual pose in it.
when posenetExtension.PoseUpdated {
    canvas.setBackgroundImageInBase64(posenetExtension.backgroundImage);
    if (posenetExtension.PoseConfidence > 0.4) {
        // analyze the pose
    }
}

Same thing goes for {Part}Confidence properties but that can wait.

Why doesn't the current App Inventor system address this use case?
As in the example, currently I have to set a low MinPoseConfidence so that I can paint the canvas's background image on every frame, that means I would have to compute inside the callback each time whether there's a real pose inside the frame or not. This is not good.

Why is this feature beneficial to App Inventor's educational mission?

@ewpatton
Copy link
Member

ewpatton commented Mar 5, 2020

Why not just increase the minimum confidence in this case?

@wr200m
Copy link
Author

wr200m commented Mar 9, 2020

I would like to paint the canvas even when no body is detected in the frame. Currently as I understand, the only event for me to paint the canvas is when PoseUpdated() {}. With a high min confidence, this event would not trigger and I would not get a chance paint the canvas with nobody in it.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants