What It Took to Bring My Game Engine to Apple Vision Pro

What does it take to bring a traditional game engine into mixed reality?

When I started developing Apple Vision Pro support for Untold Engine, I didn't even own a headset. Thanks to a generous sponsor and the contributions of some amazing developers, we began the journey of bringing our Swift and Metal game engine into spatial computing.

But getting the engine running on Vision Pro was only the beginning.

In this video, I share some of the engineering challenges we encountered along the way:

  • Adapting our rendering architecture to Vision Pro's compositor-driven rendering lifecycle.
  • Implementing spatial input and gesture interactions.
  • Addressing anti-aliasing challenges using tile-based deferred rendering (TBDR), MSAA, and later TAA.
  • Improving performance with LZ4 geometry compression, ASTC textures, static batching, and foveated rendering.
  • Solving rendering issues involving transparency, lighting, and mixed reality.

These improvements eventually helped make experiences like our tabletop soccer game possible.

And the exciting part is that these capabilities aren't limited to games. They open the door to all kinds of interactive spatial applications.

Custom Rendering & Spatial Computing Development

Building an application that requires specialized rendering, GPU optimization, or immersive 3D capabilities?

We offer custom rendering and development services for companies building graphics-intensive applications.

Let's discuss your project: https://www.untoldengine.com/contact-us

About Untold Engine

Untold Engine is an open-source game engine built with Swift and Metal for creating games and immersive experiences on Apple platforms.

If you're interested in computer graphics, game development, or spatial computing, check it out!

Website: https://www.untoldengine.com

GitHub: https://github.com/untoldengine/UntoldEngine

A special thanks to everyone contributing to Untold Engine and helping make projects like this possible.

I Turned My Dining Table into a Soccer Stadium

What if you could turn your dining table into a miniature soccer stadium?

I've always loved soccer and computer graphics, so I've been developing a soccer game on my Mac whenever I find some free time.

But after seeing a tabletop basketball game at an XR conference, I started wondering: could I bring my soccer game into mixed reality?

At the time, Untold Engine wasn't quite ready for that. But thanks to the contributions of some amazing collaborators, the engine has evolved to the point where we can now bring that experience to Apple Vision Pro.

In this video, I share the story behind the project, how the idea came about, and what we've been able to build.

About Untold Engine

Untold Engine is an open-source game engine built with Swift and Metal for creating games and immersive experiences on Apple platforms.

If you're interested in computer graphics, game development, or spatial computing, check it out!

Website: https://www.untoldengine.com

GitHub: https://github.com/untoldengine/UntoldEngine

A special thanks to everyone contributing to Untold Engine and helping make projects like this possible.

Building Games with Untold Engine | State of the Engine Oct 2026

What can you build with Untold Engine?

Over the past six months, Untold Engine has evolved significantly, bringing together rendering, animation, physics, and spatial computing to power increasingly interactive games and immersive experiences.

In this State of Untold Engine update, we're showcasing what six months of development, experimentation, and collaboration have made possible.

What's new in Untold Engine:

  • Rendering improvements, including lighting, anti-aliasing, and performance
  • Gaussian splatting with progressive streaming
  • Advanced animation with GPU compute skinning, inverse kinematics, and morph targets
  • Expanded physics integration
  • Swift Code Components and engine extensibility
  • A redesigned Untold Editor with improved scene-building workflows

Throughout the video, you'll see demos showcasing these capabilities, from tabletop mixed-reality games to immersive spatial interactions.

A huge thank you to everyone contributing to Untold Engine. Your ideas, code, and experiments are helping shape its future.

About Untold Engine

Untold Engine is an open-source game engine built with Swift and Metal for macOS, iOS, and visionOS.

Our vision is simple:

An engine that empowers creativity and never stands in its way.

Explore the engine, build something new, or join the development!

https://www.untoldengine.com

What can you build with the Untold Engine?

The Untold Engine is an open-source 3D engine built with Swift and Metal, designed for creating interactive 3D experiences on macOS, iOS, and Apple Vision Pro.

In this video, I'm showcasing a collection of demos highlighting what Untold Engine can do today, from immersive mixed-reality experiences to realistic 3D environments and interactive applications.

The showcase includes:

  • Mixed-reality experiences on Apple Vision Pro, including interactive lightsabers, hand tracking, and virtual objects in real-world environments.
  • Realistic 3D environments and Gaussian splat rendering.
  • Untold Editor, demonstrating how developers can build and edit 3D scenes.
  • Architectural visualization and interactive interior environments.
  • Real-time rendering, lighting, reflections, and other graphics capabilities.

Untold Engine is built around the idea that an engine should empower creativity and never stand in its way.

My goal is to build a reliable, accessible 3D engine that allows developers to focus on creating immersive experiences rather than troubleshooting the tools they depend on.

The engine is under active development, and this showcase represents some of the capabilities and improvements we've been working on.

If you're interested in computer graphics, Metal rendering, game engine development, or spatial computing, I invite you to explore the project, try the demos, and follow along as the engine continues to evolve.

Explore Untold Engine

Untold Engine (source code):

https://github.com/untoldengine/UntoldEngine

Untold Editor:

https://github.com/untoldengine/UntoldEditor

UntoldArcade (demo collection):

https://github.com/untoldengine/UntoldArcade

If you enjoy seeing the development of a 3D engine from the ground up, consider subscribing for future updates, technical breakdowns, and new demos.

Special thanks to the collaborators for making these demos possible.

The Performance Fix That Accidentally Solved Anti-Aliasing

A few weeks ago I ran into a frustrating problem in the Untold Engine.

Thin geometry would shimmer noticeably on Apple Vision Pro, and no matter what I tried, I couldn't get the results I wanted. I experimented with SMAA, explored a few other options, and eventually reached a point where I wasn't sure what to do next.

So I stopped working on the problem.

Instead, I focused on performance.

What happened next surprised me.

A renderer optimization led me down the path of implementing Tile-Based Deferred Rendering, and somewhere along the way I realized that the architectural changes might finally allow me to use MSAA in the engine.

This video is the story of how a performance project unexpectedly became the solution to a completely different rendering problem.

Building a game engine is funny sometimes. You spend weeks looking for an answer in one place, only to discover it while working on something else entirely.

If you're interested in rendering, engine development, and the lessons learned while building the Untold Engine, consider subscribing for future devlogs.

Untold Engine is a Swift + Metal renderer and engine focused on XR, streaming, and real-time rendering for Apple platforms.

Untold Engine: https://github.com/untoldengine/UntoldEngine

If you enjoy engine development, rendering architecture, XR rendering, or graphics programming, consider subscribing.