Moses Turner
February 24, 2023
Share this post:
Reading time:
In our previous blog post, I teased our new optical hand tracking pipeline, codenamed Mercury. Work on this tracking method began around January 2022.
Now, after a little over a year of development, it's finally ready for the public to use!
Mercury currently works on Valve Index, Windows Mixed Reality headsets (Reverb G2 v2 shown below), Oculus Rift S (early support), and Luxonis cameras (video shows a OAK-D Pro W Dev mounted on a North Star). It estimates hand pose accurately, supports limited hand-over-hand interactions, tracks fast hand movements, and is useable for drawing, typing and UI interaction.
Usage documentation is here if you want to run it in Monado. Expect in the coming few weeks some improvements to hand tracked-state stability, reductions to background jitter, a SteamVR driver so you can use it on Windows, and a much more detailed blog post showcasing the work we did to get here!
15/01/2026
With openwrt-one-debian, you can now install and run a full Debian system leveraging the OpenWrt One’s NVMe storage, enabling everything…
13/01/2026
At this year's edition of FOSDEM Collabora will be present with 6 talks! Join us to get the latest on video capture on Rockchip SoCs, Tyr,…
24/12/2025
A deep dive on the current status of Chromium enablement on MediaTek Genio SoCs, including what the numbers look like when MediaTek’s hardware…
Whether writing a line of code or shaping a longer-term strategic software development plan, we'll help you navigate the ever-evolving world of Open Source.
한국어 버전의 Collabora.com 보기
Acesse Collabora.com em Português