This article shows the CPU-only inference with a modern server processor – AMD Epyc 9554. For the LLM model the Qwen 2.5 Coder 32B with…
Tag: AMD EPYC
llama-bench the Qwen2 32B (QwQ-32B) and AMD EPYC 9554 CPU
This article shows the CPU-only inference with a modern server processor – AMD Epyc 9554. For the LLM model the Qwen2 32B (QwQ-32B) with different…
llama-bench the DeepSeek R1 Distill Llama 70B and dual AMD EPYC 7282
This article shows the CPU-only inference with a relatively old server processor – AMD Epyc 7282. For the LLM model the DeepSeek R1 Distill Llama…
llama-bench the DeepSeek R1 Distill Llama 70B and AMD EPYC 9554 CPU
This article shows the CPU-only inference with a modern server processor – AMD Epyc 9554. For the LLM model the DeepSeek R1 Distill Llama 70B…
LLM inference benchmarks with llamacpp and AMD EPYC 7282 CPU
LLMs or large language models are really popular these days and many people and organization begin to rely on them. This article continues in the…
LLM inference benchmarks with llamacpp and AMD EPYC 9554 CPU
LLMs or large language models are really popular these days and many people and organization begin to rely on them. Of course, the most easiest…
Supermicro H11DSU-iN and dual AMD EPYC 7282 with Linux installed – system (GCC flags),kernel and device information
Here is what you can expect if you have new Linux kernel 5.5.11 installed on with AMD EPYC 7282. 8x SATA Controllers – SATA controller:…
Supermicro H11SSL-i and AMD EPYC 7351P with Linux installed – system (GCC flags),kernel and device information
Here is what you can expect if you have new Linux kernel 5.0.1 installed on H11SSL-i with AMD EPYC 7351P. Here you can see what…
Supermicro H11SSL-i BIOS screenshot review – AMD EPYC 7351P 16-Core Processor
This article is just a bunch of screenshots with a short description of the Supermicro H11SSL-i BIOS. This setup is AMD based and uses one…