๐ Retail Shelf Stock Monitor
CLIP gates empty shelves โ Grounding DINO detects products โ post-processing gives stock level + misplaced flag
1. CLIP (zero-shot classification) โ decides if the shelf is empty.
2. Grounding DINO โ detects grocery items with bounding boxes.
3. Post-processing โ filters false positives, deduplicates, counts products, and flags misplaced items via spatial outlier detection.
4. Output โ annotated image/video with stock status and misplaced highlights.
CLIP acts as a fast gate โ only non-empty shelves trigger object detection.
Record a short webcam clip. The app analyzes one completed clip at a time and waits before the next run.
๐ About This Demo
Combines CLIP and Grounding DINO to estimate shelf stock, count products, and flag possible misplaced items.
โก Runtime Note
Runs on CPU โ slower for videos. For a faster GPU-backed walkthrough, use the Colab notebook.
๐ค Author
Suresh Lama
Website ยท Hugging Face ยท GitHub