INDUSTRY FIELD GUIDE
How warehouses can prepare pick-and-pack data for AI
A warehouse can demonstrate a useful task without filming a live shift.
NAICS 493110 · General Warehousing and Storage
A warehouse can demonstrate a useful task without filming a live shift. Start with a training bay, mock orders and several ways a pick can go wrong. Figure describes logistics centers among the environments in its human task collection program. Google DeepMind’s Open X-Embodiment work separately shows how robot demonstrations from many systems can support robot learning. These are different data paths. A head-mounted video can show an action and outcome, while a robotics policy dataset may also need robot state and control signals. Figure Index · Open X-Embodiment
Build one benchmark around a wrong pick
Set up three bin locations with similar-looking items, unbranded cartons and mock labels. Start each example at the point where a worker receives the pick instruction. Record the expected location and count, the item selected, the verification event and whether the order clears, gets corrected, or needs escalation. Include lookalike packaging and a partly obscured label. For an evaluation set, hold back one shelf layout and some item instances so the test measures transfer to a new setup.
A useful row might read Order T17 · aisle C · expected two blue clips · one blue and one green clip picked · operator checks count and color · corrected before packing. An overhead view can capture the packing surface while a first-person view shows the search. Ask the buyer which stream actually matters before paying for both.
Keep the capture inside the training area
Warehouse filming can expose shipment records, carrier labels, client inventories, staff identities, floor plans and system screens. Use mock data, agree on the filming boundary with the facility, obtain permission from recorded participants and keep the exercise away from loading docks and powered equipment. OSHA identifies the mix of vehicles, workers and changing conditions as a central warehousing hazard. OSHA warehousing hazards
What to share first. Describe the site permission, the controlled task, the number of variants and whether you can export labels with the recordings. Wait for a confirmed project and capture requirements before collecting a full batch. Describe your collection capabilities
Original Fiund exercise
Track a wrong pick, a correction and an unverified pack
A training bay uses inert mock items, original labels and fabricated orders. The exercise stays away from docks, powered equipment and live shipments.
| Record | Source | What it records |
|---|---|---|
| ORDER-W1 | Original pick instruction | Order T17 requests two blue practice clips from bin C. |
| TAKE-W2 | Observed first pick | The operator selects one blue and one green clip, then checks the instruction. |
| TAKE-W3 | Observed correction | The green clip is returned and a second blue clip is visibly selected. |
| PACK-W4 | Incomplete endpoint | The final carton interior is hidden, and no independent packing confirmation is supplied. |
Question for the model
Which pick correction is documented, and does the packet prove the final packed contents?
Show the reference answer and checks
W2 documents the initial color mismatch and verification step. W3 documents replacing green with a second blue clip, matching the requested pick. The hidden carton and absent confirmation do not establish the final packed contents. Preserve a corrected pick and an unverified pack as different outcomes. The intended order cannot substitute for evidence of the final handoff.
- Losing the initial error when labeling only the final corrected pick.
- Treating the corrected selection as proof of unseen packed contents.
Fields to preserve
- Order, bin and requested quantity
- Retain the exact pick target.
- Observed item and count
- Record what each view supports.
- Verification and correction time
- Preserve the transition that resolves the wrong pick.
- Packing evidence
- Keep an independently confirmed endpoint or an explicit gap.
Test another case
Use a different shelf layout and label design with a fully visible packing check. Hold out the item instances and layout together.
Use a controlled approved bay and consenting adults. Exclude carrier labels, client inventory, live system screens, real floor plans and shipment information.
Discuss a contribution
Describe the sources you control, the task they could support and what has already been checked. Use the existing-data assessment for an archive or the collection brief for a new recording project. The contributor agreement defines Fiund’s licensing authority and compensation. A guide or fictional exercise does not establish an accepted collection or a sale.