Jarvis Lite
Wave your hands in the air and control any screen. You know how Tony Stark waves his hands and controls holographic displays? That's what we built at Hack the North.
We had two cameras, each running MediaPipe for hand gesture recognition. Each camera spots your hand, and we match the joint positions between the two views to figure out where your hand is in 3D space. We made custom gestures so you could click, scroll, move the cursor, all by waving your hand around in mid-air.
The best moment was during our demo for the judges. We brought everything we needed into this tiny room... except the remote that controls the projector. So the projector was on, but stuck on its home screen. Couldn't get HDMI from the laptop. A little awkward. But thinking quick, I said, "You know what, let's try it on my laptop screen instead." We pointed the cameras at the laptop, ran the ArUco calibration (which we had never tested in this setup; we'd always been on the projector), and it just worked. Perfectly. The cursor moved exactly where it should. That's the kind of robustness you hope for but never expect.