CPU Cores are the new Megahertz

AmpereOne and AMD are duking it out for the most cores in a single socket. Links to the things I mentioned in this video: - Supermicro MegaDC ARS-211ME-FNR: https://www.supermicro.com/en/products/system/megadc/2u/ars-211me-fnr - My AmpereOne A192-32X Test Results: https://github.com/geerlingguy/sbc-reviews/issues/52 - N+1 Fan Redundancy: https://mainstream-corp.com/n-plus-1-vs-n-minus-1-redundancy/ - What is Edge Computing? https://stlpartners.com/articles/edge-computing/what-is-edge-computing/ - NEBS Level 3: https://en.wikipedia.org/wiki/Network_Equipment-Building_System - Open RAN: https://www.keysight.com/us/en/assets/7121-1103/ebooks/The-Essential-Guide-for-Understanding-O-RAN.pdf - AWS Graviton Arm CPU: https://aws.amazon.com/ec2/graviton/ - Google Axion Arm CPU: https://cloud.google.com/blog/products/compute/introducing-googles-new-arm-based-cpu - Nvidia 4090 HPL FP64 Results: https://www.pugetsystems.com/labs/hpc/NVIDIA-RTX4090-ML-AI-and-Scientific-Computing-Performance-Preliminary-2382/#HPL_Linpack - Ampere-optimized llama.cpp: https://github.com/AmpereComputingAI/llama.cpp - AmpereOne Aurora 512-core CPU announcement: https://amperecomputing.com/blogs/introducing-ampereone-aurora - Phoronix AmpereOne review: https://www.phoronix.com/review/ampereone-a192-32x - Phoronix AmpereOne vs AMD Epyc Turin: https://www.phoronix.com/review/amd-epyc-9965-ampereone - ServeTheHome review: https://www.servethehome.com/ampere-ampereone-a192-32x-review-a-192-arm-core-supermicro-nvidia-broadcom-kioxia-server-cpu/ - ChipsAndCheese architecture overview: https://chipsandcheese.com/p/ampereone-at-hot-chips-2024-maximizing-density Ampere and Supermicro sent the AmpereOne server used in this video for testing. They did not pay for this video nor have any say in the content of the video. See my sponsorship policies: https://github.com/geerlingguy/youtube?tab=readme-ov-file#sponsorships Support me on Patreon: https://www.patreon.com/geerlingguy Sponsor me on GitHub: https://github.com/sponsors/geerlingguy Merch: https://www.redshirtjeff.com 2nd Channel: https://www.youtube.com/@GeerlingEngineering 3rd Channel: https://www.youtube.com/@Level2Jeff Contents: 00:00 - 192 Cores 01:07 - Massive core counts, and a strange era 02:46 - What's in front 04:20 - What's in back (only fans) 05:49 - What's inside 07:32 - What it's for (Edge ORAN) 09:31 - Racking and repairing RAM 10:30 - Benchmarking hits different (why not Geekbench?) 14:16 - An excuse for 25G on the Arm NAS 15:57 - Benchmarking 192 Arm cores 17:00 - Arm-native workloads 18:19 - Other benchmarks 19:04 - The only game in town 20:30 - Arm's all grown up 21:44 - Myths about x86 and Arm