Hack the North 2026
The whole world
is your kit.
Put on a Meta Quest 3 and the everyday objects in front of you become holograms you can build with. Ask Kit what to build, and it designs something out of exactly what's on your table, then walks you through making it.
Six steps, from the camera to the hologram ↓
-
1
It takes one photo
You look at the table and ask Kit what you can build. The headset takes a single photo through its passthrough camera. That one photo is the only picture anything in Kitbash ever sees.
- 1 photo
- 1280 × 960
- the headset's own camera
-
2
It fires 12,288 depth rays through that photo
A grid of rays goes out through the photo's pixels into the headset's live depth map. Every ray that lands comes back as a point in the room. Because each ray goes through a pixel, every point knows exactly where it sits in the picture.
- 128 × 96 rays
- 1,024 per frame, so nothing stutters
- Meta's depth, no extra sensor
-
3
Points become objects with real sizes
Points that face up and share a height are the table. Points above it that sit side by side in the grid are one object. Each object is fitted as a box or an upright cylinder, which gives its position and its size in centimetres. That is its digital twin.
- a surface: 60 points, 45 cm across
- an object: 8 points, 1.5 cm tall
- no AI in this step
-
4
Kit names everything it sees
Kit gets the photo with a numbered marker on each object, along with every measured size. In a single look it names them, says which ones are round, splits two things the depth merged into one, and adds anything the depth missed. Known items snap to their exact size, so a tall can is 6.6 by 15.7 centimetres.
- one call
- up to 24 objects
- Qwen3.5-Omni or OpenAI
-
5
Kit designs with exactly what you have
Ask for something and Kit designs it out of those objects. Nothing is imagined: every piece in a design is a thing on your table. Before you ever see it, each piece is placed flat on what holds it, and a balance check makes sure the weight lands inside its support. Designs that would topple never reach you.
- pieces meet within 2 mm
- cans stay upright
- the weight must land on its support
-
6
You build it, Kit talks you through it
The holograms lift off your real objects and fly into the shape of the design. One piece glows at a time while Kit reads the step out loud, so your hands stay free. You build by putting the real object inside its hologram. Say done, and the next piece lights up.
- one step at a time
- spoken in an ElevenLabs voice
- half real, half hologram
What's live, and what isn't
A demo should say which parts are thinking and which parts are remembering.
Live, every time
The scan, the objects it finds, their measured sizes, the names, the balance check and Kit's voice. Ask for something new and Kit designs it there and then.
Remembered
Once Kit has designed for a set of objects, those designs are kept, so asking the same thing again is instant. Move the objects and the design is fitted to where they are now.
Never staged
Nothing is placed in advance. Kitbash has no idea what is on your table, or where, until it looks.
What it's made of
Everything the headset shows is drawn by our own hologram shader, at true size, in the real room.
- Meta Quest 3 passthrough and depth
- Unity 6 with the Meta XR SDK
- Qwen3.5-Omni hears, sees and answers
- OpenAI names objects and designs builds
- ElevenLabs gives Kit its voice
- Node and Fastify on a laptop, no cloud server