NVIDIA introduced NVIDIA Studio during COMPUTEX event in 2019. After five years and over 500 NVIDIA RTX-accelerated applications and games, it is expanding AI capabilities to a broader audience with a range of new RTX technologies introduced this week at COMPUTEX 2024.
Newly revealed NVIDIA GeForce RTX AI laptops — such as the ASUS ProArt PX13 and P16 plus MSI Stealth 16 AI+ laptops — will incorporate specialized RTX Tensor Cores for boosting AI performance and energy-efficient systems-on-a-chip featuring Windows 11 AI PC capabilities. They will join the existing lineup of over 200 laptops already powered by RTX AI technology.
NVIDIA RTX Video, a suite of technologies that includes RTX Video Super Resolution and RTX Video HDR to enrich video content streamed on browsers like Google Chrome, Microsoft Edge, and Mozilla Firefox, will soon be integrated into the popular VLC Media Player. Additionally, starting in June, creators can experience these AI-enhanced video effects in widely-used creative applications such as DaVinci Resolve and Wondershare Filmora for the first time.
DaVinci Resolve and Cyberlink PowerDirector are incorporating NVIDIA’s new H.265 Ultra-High-Quality (UHQ) mode that utilizes NVIDIA NVENC to enhance high-efficiency video coding (HEVC) and encoding efficiency by 10%.
NVIDIA RTX Remix, a platform for revamping classic games with RTX, will soon be open-source, allowing more modders to streamline asset replacements and scene relighting. RTX Remix will also be accessible through a new REST application programming interface (API) to integrate the platform with other modding tools like Blender and Hammer.
Creative applications are increasingly embracing AI-powered NVIDIA DLSS for superior ray-traced visuals in the viewport, with 3D modeling platform Womp being the latest to incorporate DLSS 3.5 with Ray Reconstruction.
NVIDIA unveiled Project G-Assist, a demonstration of RTX-powered AI-assistant technology that offers context-aware assistance for PC games and applications.
The latest Game Ready Driver and NVIDIA Studio Driver are now available for download and installation.
Transformative AI Video Enhancements
RTX Video is an array of real-time, AI-driven video improvements — powered by RTX GPUs featuring AI Tensor Cores — that significantly enhance video quality.
It includes RTX Video Super Resolution — a scaling technology that eliminates compression artifacts and generates extra pixels to enhance video sharpness and clarity up to 4K — and RTX Video HDR, which converts standard dynamic range videos into striking high-dynamic range visuals on HDR10 displays.
NVIDIA has introduced the RTX Video software development kit, enabling developers to include RTX Video effects in their creative workflows.
Blackmagic Design’s DaVinci Resolve, a robust video editing application with color correction, visual effects, graphics, and audio post-production capabilities, will be among the first to integrate RTX Video. The integration is being showcased at the COMPUTEX exhibition.
Wondershare Filmora, a video editing tool with AI features and advanced social media video editing functions, will soon support RTX Video HDR.
VLC Media Player — a versatile, open-source media player compatible with various platforms, now includes RTX Video HDR in its latest beta release, following its recent support extension for Mozilla Firefox.
NVIDIA has also introduced a new UHQ mode in NVENC, a specialized hardware encoder found on RTX GPUs, for the HEVC video compression standard (also referred to as HEVC). This enhances…referred to as H.265). The fresh mode boosts compression by 10% sans compromising quality, rendering NVENC HEVC 34% more effective than the commonly used x264 Medium compression standard.
In their next updates, DaVinci Resolve and Cyberlink PowerDirector video editing software will incorporate backing for the innovative UHQ mode. Stay tuned for the official launch dates.
RTX Remix Unveils Creator Toolkit as Open Source
NVIDIA RTX Remix empowers modders to effortlessly capture game assets, enhance materials automatically with generative AI tools, and craft remarkable RTX remasters with complete ray tracing.
The RTX Remix open beta recently introduced support for DLSS 3.5 featuring Ray Reconstruction, an AI model that generates superior-quality images for demanding ray-traced games and apps.
In the upcoming weeks, NVIDIA is set to release the RTX Remix Toolkit as open source, granting more modders the ability to streamline asset replacement and scene relighting. Additionally, the company plans to expand the supported file formats for RTX Remix’s asset ingestor and reinforce RTX Remix’s AI Texture Tools with novel models.
NVIDIA is also widening access to the capabilities of RTX Remix through a robust new REST API, empowering modders to seamlessly connect RTX Remix with other DCC tools like Blender and modding utilities such as Hammer. Furthermore, NVIDIA is supplying an SDK for the RTX Remix runtime to enable modders to integrate RTX Remix’s renderer into applications and games beyond the realm of DirectX 8 and 9 classics.
Embrace Ray Tracing Advancements
NVIDIA DLSS 3.5 with Ray Reconstruction enriches the quality of ray-traced visuals on NVIDIA RTX and GeForce RTX GPUs by replacing manual denoisers with an AI network trained on an NVIDIA supercomputer, generating superior pixels amid sampled rays.
Previewing content in the viewport, despite having high-end hardware, sometimes results in subpar image quality due to the necessity of manual denoiser adjustments for each scene. With DLSS 3.5, the AI neural network comprehends a wide array of scenes, producing top-notch preview images and significantly reducing rendering time.
The free browser-based 3D modeling platform Womp has integrated DLSS 3.5 to amplify interactive, photorealistic modeling experiences within the viewport.
Chaos Vantage and D5 Render, two renowned professional-grade 3D applications featuring real-time ray tracing preview modes, have observed substantial performance enhancements with DLSS 3.5 — experiencing up to a 60% acceleration from Ray Reconstruction and 4x from all DLSS technologies.
Tools for Accelerating AI Applications
The extensive array of open-source AI models currently accessible is typically pre-trained for generic uses and operate in data centers.
To fabricate more efficient app-specific AI utilities that operate on local PCs, NVIDIA has introduced the RTX AI Toolkit — a comprehensive workflow for tailoring, optimizing, and deploying AI models on RTX AI PCs.
Partnering with companies like Adobe, Topaz, and Blackmagic Design, NVIDIA is integrating the RTX AI Toolkit into their esteemed creative applications to boost AI performance on RTX PCs.
Developers can delve deeper into this on the NVIDIA Technical Blog.
