TRAIN AND TEST ROBOTS IN THE REAL WORLD

Real homes.Real chores.Real training data.

Egocentric training data and real world robot pilots, from home service professionals on paid jobs in Bay Area homes and offices.

Request a sample Pilot your robot

Or book a 15 minute call

Simulated view, rendered live in your browser. Not real footage.

OUR PARTNER NETWORK

How we collect data

We work with top tier Bay Area home service businesses and independent professional cleaners. They wear our camera on real, paid jobs, not staged demos, and the footage goes straight to our platform to be anonymized and annotated.

Join the network
Run a Bay Area service business?
Cleaning, organizing, repairs, maintenance or other hands on work in homes and offices. Your team wears our camera during the jobs they already do. We provide the gear and handle consent and privacy.
Become a capture partner →

new hours of footage every week, growing with our partners: 100
at 60 fps from one calibrated head mounted rig: 2.7K
3D keypoints per hand, plus 6DoF wrist pose: 21
of homes and businesses opted in, each with a consent record: 100%

01 / WHY

Labs are tidy. Homes are not.

Staged demos miss real clutter, lighting and layouts. We capture skilled people doing real work where your robot will operate.

Real variety

New layouts, lighting, clutter, pets and surfaces in every session.

Expert demonstrations

Professional cleaners on paid jobs, not staged or scripted tasks.

Long horizon tasks

Full sessions, labeled as tasks and subtasks.

02 / PROCESS

From a real job to your training set.

01
Step / 01
Consent
Each household and business opts in before any recording.
02
Step / 02
Capture
Professional cleaners, from partner businesses and independent pros, wear a head mounted camera during real jobs.
03
Step / 03
Process
Audio removed. Faces, screens and documents blurred. Sessions segmented and captioned, with Precision labels checked by a person.
04
Step / 04
Deliver
Shipped in your format, with a datasheet for every batch.

03 / OFFER

Two ways to work with us.

Training data

Egocentric video from real paid cleanings in homes and offices, ready for training.

Audio removed. Faces, screens and documents blurred.
Subtask labels, captions and 3D hand pose.
Scale and Precision tiers, or custom collection.

Request a sample

Pilot program for frontier labs

Test your robot in real homes and offices

For labs ready to leave the lab. Your robot works live service jobs in Bay Area homes and offices, alongside professional crews.

We match homes and offices to your tasks and robot.
We handle consent, scheduling and the crew on site.
Your team operates the robot, under your insurance.
Every run recorded on our head camera, with success and intervention reports.

Apply for a pilot

04 / DATA

Scale or precision. Same rig.

Breadth for pretraining, or expert labels for post training.

Scale

For pretraining

Full sessions across many homes and offices.
Automated subtask segments and captions.
100 new hours every week, priced per hour.

Discuss volume

Precision

For post training and evaluation

Human reviewed subtask labels with success flags.
21 3D hand keypoints and 6DoF wrist pose per frame.
Collected to the tasks and rooms you specify.

Request a sample

Sample annotation, Precision tierep_0042 · kitchen · clean kitchen

sponge · 0.96document blurredep_0042 · 00:21.40 · 60 fpsBay Area, Californiaboth hands wipe kitchen counter with sponge

Subtask: 3 / 4 · wipe counter
Hand pose: 2 × 21 joints · 60 fps
Privacy: Audio removed · 1 region blurred
Review: Human reviewed
success: ✓ success

Illustrative frame, generated for this page. Not customer footage.

reach8.0 → 12.4 sframes 480 → 744
right hand reaches toward sink
hand right · reach · sink · ✓ success
pick up12.4 → 18.9 sframes 744 → 1134
right hand picks up sponge from sink
hand right · pick up · sponge · ✓ success
wipe counter18.9 → 31.2 sframes 1134 → 1872
both hands wipe kitchen counter with sponge
hand both · wipe · counter · ✓ success
rinse31.2 → 38.0 sframes 1872 → 2280
right hand rinses sponge at sink
hand right · rinse · sponge · ✓ success

{"episode_id": "ep_0042","room": "kitchen","task": "clean kitchen","fps": 60,"calibration": "cam_01.json","subtasks": "ep_0042_subtasks.jsonl","hand_pose": "ep_0042_hands.parquet","consent_record": "cr_0042","human_reviewed": true}

frame	hand	wrist xyz	wrist quat	keypoints
744	right	0.21 0.18 0.43	0.97 0.06 0.21 0.08	21 × 3
745	right	0.21 0.18 0.42	0.97 0.06 0.21 0.09	21 × 3
746	right	0.22 0.17 0.42	0.96 0.07 0.22 0.09	21 × 3
747	right	0.22 0.17 0.41	0.96 0.07 0.22 0.10	21 × 3

One row per hand per frame. Keypoints are 21 × 3 in meters, camera frame.

ep_0042.mp4 · frame 1284

Capture: Head mounted wide angle camera at 2.7K and 60 fps. Fixed settings, calibrated lens.
Content: Full cleaning sessions: vacuuming, surfaces, dishes, beds, desks, trash and tidying.
Labels: Subtasks of 1 to 20 seconds with timestamps, hand, verb, object, caption and success. Room and scene metadata.
Optional: Camera trajectory, depth, object masks.
Formats: MP4, JSON, Parquet, datasheet and manifest. LeRobot or RLDS on request.
Licensing: Nonexclusive. Custom collection available.

05 / PRIVACY

Consent first. Privacy by default.

Opt in consent from every home and business, with a record for every episode.
No audio. Faces, screens, documents and addresses blurred.
Recorded only in Bay Area homes and offices, stored on AWS US West.
Deletion requests honored.

06 / CONTACT

Get a sample.

Tell us what you are training. We will send a sample episode with its annotations.

Or email hello@firsthandrobotics.com