ML Project of the Week – Real-Time Scene Depth Estimation
A project by an engineer from Poland showcases the ability to estimate scene depth in real-time using a neural network. Utilizing the TypeGPU library, it achieves impressive results directly in the browser.
ML Project of the Week – Real-Time Scene Depth Estimation
A project by an engineer from Software Mansion (Poland) has garnered 7.4 million views in just one day. It works with TypeGPU – a library that allows writing GPU shaders directly in TypeScript.
The author launched a neural network that reconstructs a depth map of a scene from a regular 2D image, achieving this in about 8 ms on an M4 Pro chip.
A video frame at 60 fps lasts about 16.7 ms, making it a full real-time experience right in the browser. Additionally, everything from the neural network to the final render with lighting operates in a single GPU pipeline, without data transfer back and forth between the CPU and GPU.
The demo looks particularly impressive, but the code is not open-source (it might be sold to Zoom for several million).
Why it matters
AnalysisThis project showcases new possibilities in real-time image processing, which could significantly impact the development of web technologies and AI. The use of GPU shaders in TypeScript opens new horizons for developers.
Discuss in community
Share your questions and insights with developers
Related in Ecosystem
Practical guides, core terminology, and agent skills
Reddit user explains why Claude Code weekly limits are burning almost 4x faster
A Reddit user compared token usage across two weeks and found that each 1% of Claude Code's weekly limit now yields far fewer output tokens, pointing to subagents, reasoning time, and UI refresh requests as likely causes.
JSON — Structured Data for Programs, APIs, and AI Agents
A complete hands-on guide to JSON: syntax specifications, serialization via parse and stringify, REST API consumption, JSON Schema validation, and structured outputs for LLMs.
DOCX and XLSX Formats: When AI Needs to Deliver Production-Ready Documents
A comprehensive hands-on guide to generating and processing DOCX documents and XLSX workbooks with AI: comparing against Markdown and CSV, prompt engineering, formula design, and code automation.
Binance publishes investigation into $6.3 billion theft
Binance’s investigation links the theft to a modified Homebrew download, a fake interview and abuse of an internal AI tool.