Does this model only detect one type of target at a time?
#23
by zgh1997 - opened
How can I detect multiple targets in one inference?
The expensive part of inference is prefilling the image tokens. You can cache that, and reuse it for multiple detections:
https://huggingface.co/moondream/moondream3-preview#caching-image-encodings-advanced