Boost AMD Ryzen System Performance with ASUS AI Cache Boost
Large Language Models (LLMs) require a significant amount of memory – so much so that AI enthusiasts often use multi-GPU configurations to increase the available video memory for their AI applications. However, due to the extremely large volumes of LLMs, even this approach has its limits. In some cases, the GPU (GPU) transfers the calculation to the central processor (CPU), and then the performance of the CPU cache and random access memory (DRAM) comes to the fore. This means that for the efficiency of AI applications, it is not only important GPU, but also the entire chain of connections GPU с CPU and DRAM modules. Accordingly, there are opportunities to optimize these components for increased performance.
This is exactly what was demonstrated during the research in the R&D labs of ASUS using the latest AMD Ryzen processors. AMD recently introduced two new Ryzen processors with AMD 3D V-Cache technology - AMD Ryzen 9 9950X3D and AMD Ryzen 9 9900X3D, taking the Ryzen series to a new level. After extensive testing of various optimizations in a wide range of workloads, a set of settings was identified that provide tangible benefits for AI applications. The results of these studies were embodied in a new BIOS feature - AI Cache Boost. In real-world scenarios with large LLMs, AI Cache Boost provides a performance increase of up to 12,75%.
Ready for AMD Ryzen Processors with AMD 3D V-Cache Technology
To activate AI Cache Boost, you need an ASUS AMD 800 series motherboard and an AMD Ryzen 9000 Granite Ridge processor. In the UEFI BIOS, go to the tab Extreme Tweaker and enable the corresponding function - the system will be ready to work.
The AI Cache Boost feature enables a number of optimizations, including overclocking the Infinity Fabric clock (FCLK) frequency to 2100 MHz. Increasing the FCLK is a key factor, as it increases the bandwidth between cores. CPU, cache and memory modules – which is especially important for working with large LLMs.
For users who use one system for both AI applications and games, please note: Enabling AI Cache Boost has virtually no impact on gaming performance. The feature can be left enabled when switching between different types of loads. If desired, the FCLK frequency can be manually reduced to a more conservative value after activation to improve stability in games.
Performance with AI Cache Boost
The test configuration used the ROG Crosshair X870E Hero motherboard, NVIDIA GeForce RTX 5090 graphics card and 2x16 GB of DDR5 RAM. Several processors with AMD 3D V-Cache were tested: Ryzen 9 9950X3D, 9900X3D and 9800X3D. The first test was Geekbench AI with the ONNX DirectML framework, which measures the performance GPU.
Depending on the configuration, the performance gain ranged from 4% to 8%. This is significant for users who work with AI workloads on a daily basis, especially considering the ease of activation of the function.
Since the NVIDIA RTX 50 series is new to the market, additional testing was done on the previous generation of graphics cards - in particular with NVIDIA RTX 4090.
In the Geekbench AI test with RTX 4090 Activating AI Cache Boost allowed us to achieve a performance increase of up to 7,57% with AMD Ryzen 7 9800X3D, which showed the highest result among the tested processors.
Similar dynamics were shown by the UL Procyon AI Computer Vision Benchmark test, where Ryzen 7 9800X3D achieved 12,75% performance improvement with the feature enabled.
Adding Turbo Game Mode
High scores Ryzen 7 9800X3D The tests show that AMD 3D V-Cache provides a greater advantage in some AI scenarios than the higher core counts of the Ryzen 9 9950X3D and 9900X3D. For a more detailed analysis, additional tests were conducted with both AI Cache Boost and Turbo Game Mode enabled.
Turbo Game Mode, available on ASUS AM5 motherboards, optimizes the system in two ways:
- Disables the second CCD (Core Complex Die) - relevant for processors with two CCDs. This allows you to reduce delays in applications that do not use all cores.
- Turns off SMT (Simultaneous Multithreading) – simultaneous multithreading. In some scenarios, disabling SMT allows to increase efficiency in loads that do not require a large number of threads.
Due to the significant impact on multi-threaded performance, Turbo Game Mode is recommended to be enabled only when necessary.
With AI Cache Boost and Turbo Game Mode enabled, the Ryzen 9 9950X3D delivers the highest performance gain of all tested options, up 19,85% over base settings.
These results indicate that for users of AI applications that do not use all available threads, CPU, combining two BIOS functions can be very beneficial. Both functions are available on the tab Extreme Tweaker BIOS, which makes their use convenient even for less experienced users.
AI Ambition Takes a New Level with ASUS and AI Cache Boost
The AMD Ryzen 9 9950X3D and 9900X3D processors open up new possibilities for PC enthusiasts. With 32 and 24 threads respectively, they deliver powerful multi-threaded performance and also benefit from AMD 3D V-Cache technology.
ASUS AMD 800 series motherboards help to maximize the potential of these processors through BIOS optimizations. In particular, AI Cache Boost is a very effective tool for increasing performance in AI workflows using LLM.
To get the most out of AMD's new processors, it's worth checking out the full line of ASUS AM5 motherboards, from the flagship X870E and X870 to the more affordable B850 and B840.