Arm introduces AI-enhanced graphics upscaling to mobile devices

Arm introduces its new AI to upscale mobile graphics, enhancing quality swiftly.

: Arm unveiled 'Neural Super Sampling', which enhances mobile graphics by doubling resolution with minimal rendering time. This method allows developers to create 540p frames that deliver 1080p quality, cutting GPU workload by up to 50% for better efficiency. In comparison to Nvidia's DLSS, Arm leverages AMD's FSR2 to further enhance their previous method ASR, bringing PC-level graphics quality to mobile devices. Developers can access this technology and more via Arm's new Neural Graphics Development Kit, which includes an Unreal Engine plugin and a Vulkan API, all aiming for a broader AI-driven graphics ecosystem by 2026.

Arm, known for its innovations in mobile technology, has recently announced a groundbreaking advancement in mobile graphics technology aimed at significantly improving gaming experiences. This step brings a technology to mobile devices that has been prevalent in modern PCs and consoles, where machine learning plays a vital role in enhancing 3D graphics. Arm's newly unveiled Neural Super Sampling (NSS) can upscale real-time graphics with considerable efficiency.

Neural Super Sampling offers the capability to potentially double the resolution of visual content with only an additional 4 milliseconds of rendering time per frame. Specifically, the technology allows graphics initially rendered at 540p to appear nearly as clear as native 1080p, effectively reducing the GPU's workload by as much as half. This efficiency either results in decreased power consumption or enables much higher frame rates, an advantage crucial for gaming performance on mobile devices.

Arm's approach takes cues from Nvidia's Deep Learning Super Sampling (DLSS), which was implemented in GeForce RTX cards starting in 2019. Arm's NSS mirrors similar capabilities to those offered by DLSS 1.0 and 2.0 but further builds on its prior upscaling technique, Accuracy Super Resolution. This method, heavily influenced by AMD's FidelityFX Super Resolution (FSR) 2, has already made its mark in popular gaming titles like 'Fortnite' and 'Infinity Nikki'.

To ensure broad adaptability across mobile devices, Arm is releasing a Neural Graphics Development Kit. This includes various tools such as an Unreal Engine plugin, a Vulkan emulator based on PC architecture, and machine learning extensions for the Vulkan APIs. Furthermore, Arm plans to release AI models of this technology on open-source platforms like GitHub and Hugging Face. This measure indicates Arm's commitment to advancing mobile gaming technologies and offering it to developers for enhanced access.

Beyond just NSS, Arm is preparing additional AI-driven graphics technologies, notably Neural Frame Rate Upscaling and Denoising with path tracing methods. While the full hardware support for these innovations is anticipated by 2026, developers will have early access to ensure a prepared approach to app development. This further demonstrates Arm's strategic planning to secure a foothold in mobile gaming markets while ensuring future-ready technology applications.

Sources: Arm Holdings, Techspot

AIMobileGame Development