Toward zero latency XR devices: How smart microdisplay help to solve XR problems

XR (Extended Reality) glasses have many problems to overcome, such as MTP (Motion-To-Photon) delay and optical artifacts. We introduced a hardware and software co-design approach to solving the MTP issue. We applied it successfully to FSC (Field Sequential Color) LCoS (Liquid Crystal on Silicon) micro-display controller SoC (System on a Chip) design to reduce the MTP latency significantly down to less than 5 msec and to mitigate color break-up. A commercial AR (Augmented Reality) device available in the market embeds our solution. Our near-zero MTP delay display solution shows that smartphone/compute device tethered XR viewers or HMDs (Head Mounted Displays) could enhance user experience along with SLAM (simultaneous localization and mapping) or image processor. A localized optic artifact compensation scheme has also been applied to a waveguide optic, reducing AR optic design iterations.