NEWSync VR with Kiiroo β€”

PassthroughTube
All posts

How AR Passthrough Porn Works: A Technical Explanation

May 31, 2026 9 min read

AR passthrough adult content is the most-technically-complex experience modern consumer VR delivers. Every frame requires camera capture, real-time noise reduction, depth estimation, alpha-channel decoding of the scene file, spatial anchoring against your room map, stereoscopic composition for both eyes, and final display β€” all in under 11 milliseconds. This guide walks through the pipeline so the technology stops being magic and starts being something you can reason about when it doesn't work right.

The full stack, in one diagram

Every frame goes through this pipeline:

  1. Quest 3 cameras capture your room (~3ms).
  2. Image processor denoises, white-balances, prepares passthrough feed (~2ms).
  3. Scene file's current frame is decoded β€” RGBA video data (~1ms with hardware decode).
  4. Spatial map provides current anchor position (~1ms lookup).
  5. Compositor blends passthrough (background) with scene RGBA (foreground) using alpha as mask (~2ms).
  6. Per-eye stereoscopic rendering β€” different perspective for left and right eyes (~2ms).
  7. Display output (~0.5ms).

Total: roughly 11.5ms per frame end-to-end. At 90 fps the frame budget is 11.1ms, so the pipeline is fully consumed each frame. There's no headroom for dropped or delayed steps without visible stutter.

Step 1: Camera capture and processing

Quest 3 has 18MP RGB sensor cameras pointing forward. They capture at 30 fps (yes β€” 30, not 90; the passthrough feed is interpolated to higher fps in the image processor). Each captured frame goes through:

  • Noise reduction (more aggressive in dim light).
  • White balance correction.
  • Slight gamma adjustment to match the panel's response curve.
  • Color saturation tuned for skin tones (Meta-tuned).

This is the "passthrough feed" that becomes the background of your AR scene. Quality depends heavily on your room lighting β€” bright even light produces clean feed; dim light increases noise and grain.

Step 2: Alpha-channel decoding

AR-native scene files are encoded as RGBA β€” red, green, blue, and alpha. The alpha channel is a 0–255 value per pixel indicating "how opaque is this pixel" (0 = fully transparent, 255 = fully opaque). The codec (HEVC main10 with alpha, or AV1 with alpha) packs this information into the video stream alongside the RGB color data.

Quest 3 hardware-decodes RGBA via its video decoder. The output is a per-pixel RGBA frame the compositor can use directly. Software decoding is also possible but slower β€” most players fall back to it only for codecs Quest 3 doesn't hardware-decode.

Without alpha channel, you only have RGB. The compositor has no way to know which pixels are "actor" vs "background." That's why VR scenes without alpha can't be cleanly composited into your real room β€” there's no transparency information to use.

Step 3: Spatial mapping and anchoring

Quest 3 builds a 3D map of your room from the tracking cameras (the smaller cameras on the sides, separate from passthrough cameras). The map identifies:

  • Floor plane.
  • Walls and ceiling.
  • Large furniture (couches, tables β€” recognized as obstacles).
  • Boundary you set during initial setup.

When you place an AR scene anchor (Heresphere lets you drag the anchor to a specific spot), the headset records 3D coordinates in this map. As you move your head, the map updates and the anchor stays fixed in absolute space β€” the actor doesn't drift around your room as you look from different angles.

This is the spatial component of AR. Pure VR doesn't have this β€” it has only the orientation of your head and the camera position in the virtual scene.

Step 4: Stereoscopic composition

Both passthrough and the scene overlay must be stereoscopic β€” different views for left and right eyes. The compositor handles this:

  • Each Quest 3 passthrough camera renders to a different eye.
  • Scene files are stereoscopic (180Β° SBS or top-bottom) β€” the alpha channel is also stereoscopic, so per-eye masking is automatic.
  • The compositor blends passthrough-left + scene-left for the left eye, passthrough-right + scene-right for the right eye.

The result is depth perception for both your real room (perceived via passthrough's stereoscopic captures) and the scene (perceived via the file's stereoscopic encoding). The actor appears at a specific depth in front of you, integrated with the depth of real objects.

The 11ms latency budget

Why 11ms matters: human visual system processes movement at roughly 11ms per "frame" of perception. Below this, motion looks instantaneous. Above, you perceive lag β€” even a few milliseconds of lag at the edges of fast head movement produces motion sickness in some users.

The end-to-end passthrough pipeline targets under 11ms for this reason. When it slips (heavy scene load, app bug, dim room forcing aggressive noise reduction), you may notice:

  • Slight "drift" of the actor's position when you turn your head quickly.
  • Brief stutter in passthrough during scene loads.
  • Occasional rebroadcast of stale frame edges on fast motion.

Why it breaks (and what fixes it)

Common failure modes and root causes:

  • Ghosting at actor edges β€” alpha-channel quality issue from production. Studio-side problem; you can sometimes mitigate by adjusting Heresphere's edge softening per scene.
  • Actor floats through furniture β€” your room's spatial map is incomplete. Re-do Quest's room scan with better lighting.
  • Actor scale feels wrong β€” scene's intended scale doesn't match your real space. Heresphere lets you per-scene scale-adjust (0.9Γ— to 1.1Γ— usually fixes it).
  • Anchor drifts during scene β€” spatial map drift, more common in larger rooms. AR Player Pro has tighter anchoring than Heresphere for this case.
  • Passthrough looks grainy/blue β€” dim room lighting. The image processor boosts gain in low light, introducing noise. Add a warm bulb.
  • Scene visibly lags head movement β€” pipeline saturation. Close other Quest apps, lower scene resolution, or restart the headset.

FAQ

What is alpha channel and why does it matter?

Alpha channel is the transparency information encoded alongside RGB color. A 4-channel video (RGBA) tells the renderer which pixels are 'solid actor' (alpha = 1) vs 'transparent background' (alpha = 0). Without alpha, every pixel is opaque and there's nothing for the player to know to make transparent. AR-native scenes ship with alpha; pure VR scenes don't.

Does Quest 3's passthrough have measurable latency?

Yes β€” about 12ms from camera capture to display. Below human perception threshold for most use cases, but enough that fast head movements briefly show a 'tail' of the previous frame on edges. Vision Pro is around 8ms (faster). Quest 2's monochrome was 20+ms.

How does the headset know where to anchor a scene in my room?

Quest 3 maintains a real-time 3D map of your room using its tracking cameras. AR players query this map for surfaces (walls, floor, large furniture) and pin the scene anchor to a chosen position. The map updates continuously as you move, so anchoring stays stable.

Why do some passthrough scenes have ghosting at actor edges?

Two causes. First, low-quality alpha-channel extraction during production β€” actor edges weren't cleanly separated. Second, your headset's chromatic aberration on the lens edges affecting alpha blending. The first is studio-side; the second can be slightly improved by IPD calibration.

Is AR passthrough rendered in stereoscopic 3D?

Yes β€” both the passthrough feed and the AR overlay are stereoscopic. Each eye sees a slightly different view, producing depth perception for both your real room and the actor overlaid in it. The actor appears at a specific depth determined by the scene's stereoscopic format, integrated with the real-world depth from passthrough.

Related on PassthroughTube

For pure VR (without the passthrough pipeline complexity), see VRTubbies' VR quality tips for VR-specific optimization.

#technical#passthrough#explanation

Related guides

Popular passthrough scenes

See all β†’

Top studios