Glass Pantry: your fridge, from photos
Checking…Pick your fridge, trace each compartment over a photo, then photograph each shelf, drawer or door bin to fill it.
You place the corners and shelf lines by hand; OpenCV straightens the opening and checks every shelf reading; you confirm everything.
Before you start
- Photos go to this engine on AWS, and shelf and fridge photos also to Anthropic's Claude model, to be read. Your photos are not kept on the server.
- Your fridge, and the last photo of each shelf, are kept in this browser on this device until you forget them, so you can come back and photograph a shelf again. Anyone using this browser can see them.
- Leave people, documents and anything personal out of the frame.
1. Your fridge
Photograph the model sticker (usually inside, on a side wall) or the whole fridge. The AI reads it; you choose.
2. Your fridge, as it stands
Tap a shelf, drawer or door bin to fill it from a photo. Use Trace on a compartment to fit its shelves to your fridge.
Unplaced
Things from a shelf you removed or from a fridge you replaced. Nothing is ever thrown away.
Trace
Photograph the whole compartment with the door fully open. Step back until all four edges of the opening are in the frame.
Fill
Top: the last photo. Bottom: the new one. Each line joins a point OpenCV 5 found in both. ■ still there ■ moved ■ not seen where it was: you are asked ▭ looks new
| Keep | What it looks like | Label | Count | Close-up check |
|---|
Experimental. OpenCV 5 lines this photo up with the last one (ALIKED + LightGlue) and checks each thing on its own. On our six test pairs the annotated removals, arrivals and the move were covered; the two unchanged shelves had no false item flags but 2 and 1 false "new" spots, and two other pairs had 3 and 4 false flags, over the limit we set, so this stays experimental. Every flag is a question: nothing leaves this shelf unless you say so.
Read in the marked spots
Tick what is new on this shelf. Things already here are left out.
| Keep | What it looks like | Label | Count |
|---|