This article shows the CPU-only inference with a modern server processor – AMD Epyc 9554. For the LLM model the Mistral Large Instruct 123B 2411…
Tag: EPYC
LLM inference benchmarks with llamacpp and AMD EPYC 7282 CPU
LLMs or large language models are really popular these days and many people and organization begin to rely on them. This article continues in the…
LLM inference benchmarks with llamacpp and AMD EPYC 9554 CPU
LLMs or large language models are really popular these days and many people and organization begin to rely on them. Of course, the most easiest…
Supermicro H11SSL-i BIOS screenshot review – AMD EPYC 7351P 16-Core Processor
This article is just a bunch of screenshots with a short description of the Supermicro H11SSL-i BIOS. This setup is AMD based and uses one…