Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Object recognition has some limitations #152

Open
fire-eggs opened this issue Sep 14, 2024 · 1 comment
Open

Object recognition has some limitations #152

fire-eggs opened this issue Sep 14, 2024 · 1 comment

Comments

@fire-eggs
Copy link

image

image

image

image

On the other hand, sometimes works very well:
image

Sometimes it's fun!
image

@xemle
Copy link
Owner

xemle commented Sep 14, 2024

Hi.

Object detection uses ML/AI and relies on work of giants. So the basic functionality is not possible to implement by your own and relies on heavy trained neural networks by others. The used ML model is cocoSsd with mobilenet v2 (see api-server/src/model-config.js.

The result is kind of 'take it or leave it' and the only setting is the probability score of a detected object. The min score is currently set to 0.6, see (database/src/media/objects.js)[https://github.com/xemle/home-gallery/blob/master/packages/database/src/media/objects.js#L26].

Maybe you play around with different min scores and check which value fits you best.

FYI Since v1.16.0 HomeGallery supports plugins and you can implement your own extractor and database mapper. With it you can maybe explore other ML solutions and integrate it to your gallery. Also other self hosted galleries might offer you a similar ML server like the ApiServer for HomeGallery - I have not checked it but the chances are quite high, since all the galleries needs to do the same thing regarding fancy ML stuff which is most probably dockerized. ... and if you find some promising solution, please share it ;-)

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants