Llama.cpp AI Performance With The GeForce RTX 5090 Review

In beginning the NVIDIA Blackwell Linux testing with the GeForce RTX 5090 compute performance, besides all the CUDA/OpenCL/OptiX benchmarks delivered last week a number of readers asked about AI performance and in particular the Llama.cpp performance with the RTX 5090 flagship graphics card. Here are some initial benchmarks looking at the GeForce RTX 5090 performance in Llama.cpp compared to prior RTX 40 and RTX 30 graphics cards.

Over the weekend I carried out some initial tests of Llama.cpp as well as re-testing the higher-end GeForce RTX 30 and RTX 40 graphics cards. All tests were carried out using the NVIDIA 570.86.10 Linux driver on Ubuntu 24.10 with the Linux 6.11 kernel. The graphics cards tested included:

– GeForce RTX 3090

– GeForce RTX 4070

– GeForce RTX 4070 SUPER

– GeForce RTX 4080

– GeForce RTX 4080 SUPER

– GeForce RTX 4090

– GeForce RTX 5090

Llama.cpp with Llama 3.1 and Mistral 7B were used for the initial runs with text generation and prompt processing . More Llama.cpp benchmarks against the NVIDIA GeForce RTX 50 graphics cards to come with enough reader interest. For now let’s continue on with this initial look.

Keep your files stored safely and securely with the SanDisk 2TB Extreme Portable SSD. With over 69,505 ratings and an impressive 4.6 out of 5 stars, this product has been purchased over 8K+ times in the past month. At only $129.99, this Amazon’s Choice product is a must-have for secure file storage.

Help keep private content private with the included password protection featuring 256-bit AES hardware encryption. Order now for just $129.99 on Amazon!

Help Power Techcratic’s Future – Scan To Support

If Techcratic’s content and insights have helped you, consider giving back by supporting the platform with crypto. Every contribution makes a difference, whether it’s for high-quality content, server maintenance, or future updates. Techcratic is constantly evolving, and your support helps drive that progress.

As a solo operator who wears all the hats, creating content, managing the tech, and running the site, your support allows me to stay focused on delivering valuable resources. Your support keeps everything running smoothly and enables me to continue creating the content you love. I’m deeply grateful for your support, it truly means the world to me! Thank you!