detection gone weird

[Mrdindon]

I know it's not directly related to bi-aidetection but I hope someone can give me some input / hints...
Lately, deepstack is thinking that my flowers are about 80% human (that's with and without the dirt bags on the picture). I never had that kind of issue before. I could indeed increase the minimum accuracy but doing so I now miss a few positive hits. Would you have any other workaround I could configure ?
I also already have a good draw mask but these flowers are in the path where people take the stairs when they arrive.

[VorlonCD]

Make a smaller mask. Remove bags.