ServeTheHome provides insights and analysis delivered to you since 2009. We specialize in the data center industry with servers, storage, and networking.
The AMD Instinct MI300 was shown at CES 2023 this year along with new details about the multi-chip CPU, GPU, and HBM3 memory part. That is a big chip!
@AMD
@AMDServer
The ASRock Rack ALTRAD8U-1L2T is set to bring 128 Ampere Altra Max Arm cores to new places in this mATX form factor motherboard. This is awesome for Arm developers.
@ASROCKRACK
@ampere
@arm
#ISC23
STH turns 14 today so a few thank yous and quick updates are in order. It is hard to believe STH has been around this long! From a side project while doing consulting to serving millions of folks each month.
We saw the AMD Instinct MI300A (giant APU) and MI300X (GPU) at SC23 and learned new things about AMD's new AI and HPC platforms
@AMD
@AMDServer
@GIGABYTEUSA
#SC23
AMD EPYC 9004 Genoa Gaps Intel Xeon with 96 cores and a massive new platform. This gen/gen performance and efficiency gain is almost unheard of in the industry. We get deep in the details. Grab some popcorn and dig in:
@AMD
@AMDServer
@AMDNews
We deep-dive into the 4th Generation Intel Xeon Scalable processors, codenamed Sapphire Rapids, to see a huge leap in Xeon capabilities
@Intel
@intelnews
@IntelBusiness
The Intel Xeon Max 9480 is a crazy CPU. Not only is it a HPC focused part with 64GB of HBM2e onboard and 8x DDR5 channels, but you can even do things like pull all of the DDR5 and it just works booting OSes and even running VMs
@Intel
@IntelBusiness
The new AMD EPYC Bergamo will have 128 cores, 256 threads per socket meaning a common 2U 4-node platform will have 2048 threads. This is a processor segment that we expect will account for more than 25% of all data center processor sales within 5 years, so it is a huge deal.…
There are Intel Silicon Photonics 100G QSFP28 2km CWDM4 optics out there for under $6 that appear to have come from a hyper-scaler. It is fun to see these optics available after we first covered them in 2017.
@Intel
Broadcom said it will support AMD XGMI or "Infinity Fabric" on its next-gen PCIe switches and we expect future XGMI NICs in a big counter to NVIDIA as the MI300X is selling like crazy
@Broadcom
@AMD
@AMDServer
@NVIDIA
$AMD
The Apple M3 family of chips launched with some advancements but also intentionally shaky performance claims that should warrant a look by consumer protection agencies
@Apple
We get hands-on with the AMD Pensando DSC2-100G Elba DPU in a secret lab to see the hardware and how VMware integrates the 100GbE cards into vSphere
@AMD
@AMDNetworking
@VMware
@MyVMUG
@Dell
At SC23, we saw the Cornelis Networks 576-port 400Gbps Omni-Path CN5000 director switch with a whopping 48kW of power supplies
@CornelisHPC
#SC23
@Supercomputing
We take a look at the MikroTik CRS504-4XQ-IN and see how this sub $699 (street price)/ 45W switch may be the perfect SMB and
#homelab
100GbE and 25GbE switch. This is an impressive and compact package.
@mikrotik_com
@MarvellTech
We go into why an entire line of high-end
@Dell
switches and possibly even a
@HPE_Cray
US military supercomputer have misspelled stickers that say American "MegatrAnds". This prompts big questions on how well the supply chain is being checked.
#SupplyChain
Intel announced Thunderbolt 5 with 80Gbps-120Gbps of connectivity for higher-end displays, storage, networking, and eGPU connectivity
@intelnews
@intel
We can now publish a few photos of the physical NVIDIA H100 SXM card from a visit to NVIDIA HQ about a month ago. Hello Hopper!
@NVIDIA
@NVIDIADC
@NVIDIAAI
#AI
Intel Performance Strategy Team Publishing Intentionally Misleading Benchmarks - We dissect a single result to see what Intel is doing to make the Platinum 9282 series look acceptable. How did this pass muster?
The new MikroTik CRS310-8G+2S+IN is an 8-port 2.5GbE switch with two SFP+ ports and a beefy Marvell switch chip. Finally MikroTik 2.5GbE! Now hoping we can get one soon-ish to add to the 2.5GbE switch Buyer's Guide
@mikrotik_com
@MarvellTech
We take a look at the 4th Generation Intel Xeon Scalable CPUs with onboard HBM2E codenamed the Intel Sapphire Rapids HBM shown at Vision 2022
@Intel
@IntelBusiness
#IntelON
ASRock Rack did it! In our ASRock Rack 1U4LW-B650/2L2T review we see why this AMD Ryzen server offers a huge power/performance gap over Intel's alternatives in this space. This is AWESOME!
@ASROCKRACK
@AMD
@AMDRyzen
This new R86S Pro now has twice as many cores and twice the RAM, twice the onboard eMMC, 3x 2.5GbE, 2x 25GbE, and WiFi. This will revolutionize the portable/ home lab space
@Intel
@NVIDIANetworkng
We delve into the new AMD Instinct MI300X GPU, MI300A APU, and see how AMD has built packages to go head-to-head with the NVIDIA H100 and win
@AMD
@AMDServer
#AI
AMD announced the date for the EPYC 7003 series codenamed "Milan". We cracked the code how
@AMDServer
may or may not have coordinated with a popular cookie brand to communicate the March 15 date prior to today's announcement. Very clever
@LisaSu
and
@AMD
This is a new fanless low-power homelab system with a 6W TDP Intel CPU. If you want way more performance and I/O than a Raspberry Pi 5 or ZimaBoard in about the same price band, then this is peerless in today's market
In our HighPoint SSD7540 review, we see how this PCIe Gen4 x16 card lets you add 8x M.2 NVMe SSDs to a system. Featuring 8x Sabrent Rocket 4 Plus NVMe SSDs
@Sabrent
This fanless server might have EVERYTHING including an Intel Atom C3758, 4x SFP+ 10GbE, 2.5GbE, SSD slots, and external HDD connections. If you are making a NAS, firewall, or virtualization host this can save over $1000 and is silent
We take a look at the massive Microsoft Azure HBv4 heatsink that cools two AMD EPYC 9004 "Genoa" CPUs dwarfing others we have seen
@Microsoft
@Azure
@AMD
@AMDServer
We test the new Intel N100 Alder Lake-N 4x 2.5GbE fanless firewall and virtualization appliance to find a MASSIVE generational performance jump and a number of quality upgrades
@Intel
We take a look at the massive Micron 9400 30.72TB and see how this is not just a large PCIe Gen4 NVMe SSD, it is also perhaps the fastest of its kind
@MicronTech
We saw the 150W and 75W Intel Arctic Sound-M data center GPUs at Intel Vision 2022 and heard a bit about the target applications
@Intel
@IntelGraphics
#IntelON
We get hands-on with the massive Intel LGA7529 socket at OCP Summit 2023. This is the 12-channel DDR5 socket for Intel's 2024 generation CPUs
@OpenComputePrj
@intel
In our AMD EPYC 7371 review, we show how this frequency optimized processor is now the fastest 16 core x86 CPU around. It will change the narrative of AMD EPYC (Naples) versus Intel Xeon (Skylake-SP) in a market shifting manner.
@AMDServer
We take a look at the 64-port 400GbE Broadcom Tomahawk 4 switch chip and the LGA8371 socket it uses to show some fun networking hardware. Very few get to see these cool chips!
@Broadcom
We take a look at the awesome ASRock Rack AM5D4ID-2T/BCM motherboard that brings 10Gbase-T networking to a compact AMD Ryzen AM5 platform
@ASROCKRACK
@AMD
@AMDRyzen
@Broadcom
We tested WD Red SMR v CMR drives to see if there was indeed a significant impact with the change simply using them as replacement drives. We found SMR can put data at risk 13-16x longer than CMR.
@westerndigital
@freenas
#ZFS
Intel showed its GPU Max 1550 series at SC23 but it also expects to have a 144GB class Gaudi3 AI accelerator in 2024 to compete with NVIDIA's newly announced 141GB H200
@Intel
@Intelnews
@IntelBusiness
#AI
#SC23
At Intel Innovation 2022, Intel confirmed it will have 4 and 8 socket 4th Gen Xeon platforms for up to 480 cores and 960 threads per server
@Intel
#IntelON
Our AMD EPYC 7702P benchmarks and review. Redefining what is possible in a single socket with 64 cores and 128 threads. The TCO impacts are enough to see massive socket consolidation on 3-year and 5-year replacement cycles.
@AMDServer
STH had a great visit with
@AmpereComputing
today and was able to hold an 80-core Altra
@Arm
processor. Here it is next to a strategically placed Diet Coke can for scale. This is a big package that dwarfs current Xeon socketed parts.
Today Intel and Argonne National Labs announced that the Intel Xeon Max and GPU Max Aurora supercomputer blade installation is complete. That means over 63K "spaceship" GPUs, combining dozens of tiles from different fabs each, actually work.
@Intel
We take a look at the NVIDIA DGX GB200 NVL72, NVIDIA's new liquid cooled ultra AI machine that will be shipping later this year
@NVIDIA
@NVIDIAAI
#GTC24
The HPE ProLiant RL300 Gen11 is a new leadership cloud-native Ampere Altra Max Arm platform bringing 128 Arm cores to the ProLiant ecosystem
@HPE
@HPE_News
@AmpereComputing
@Arm
In our ASUS ESC4000A-E10 review, we see how this server combines a single AMD EPYC 7002 and 4x GPUs (NVIDIA Quadro RTX 6000 passively cooled in our case) to provide a unique GPU compute solution
@ASUS
@ASUSUSA
@AMDServer
@NVIDIADC
@NVIDIAAI
We show an insane and popular 48-port 2.5GbE switch with 10GbE/ 25GbE. Designed to be sold at retailers for under $400 this switch is powering hotels and e-Sports cafes in China and we cannot get anything like it in the US/ EU
@MicrochipTech
@MicronTech
Downfall is a new vulnerability targeting Intel's AVX2 and AVX-512 pipelines. This impacts modern Intel desktop and server CPUs up to Ice Lake Xeon server CPUs that were the best you could buy at the start of 2023
@Intel
We delve into the new Intel Xeon W-3400 and Xeon W-2400 series bringing PCIe Gen5 lanes, DDR5, and more cores to the workstation market. This is a big move by Intel, and so we get into how these chips are created.
@Intel
@IntelBusiness
The ASRock Rack GENOAD8UD-2T/X550 is perhaps the smallest AMD EPYC 9004 "Genoa" platform with PCIe Gen5, 10Gbase-T, and more... it is very cool.
@ASROCKRACK
@AMD
@AMDServer
We delve into the 5th Gen Intel Xeon Scalable "Emerald Rapids" generation and talk both the performance and platform gains around the new chips. We cover everything from how they are made, to how fast they are, SKUs, and more
@Intel
@IntelBusiness
Since we got asked for this a lot, and because it is a holiday weekend: 2x AMD EPYC 7742 set Geekbench 4 world record beating 4x Intel Xeon Platinum 8180M's by over 20%
@geekbench
@AMDServer
The new Noctua NH-D9 AMP-4926 4U and NH-U14S AMP-4926 are the last pieces needed to make Ampere Altra Arm development desktops and desktop servers viable
@AmpereComputing
@Noctua_at
@ASROCKRACK
@Arm
We explore AMD EPYC Bergamo, the company's 128 core CPU and show how it offers 5:1 server consolidation ratios. Or more topically, 3x Bergamo servers replace 15x 2019-2021 era servers and free power and cooling for an 8x GPU system
@AMD
@Supermicro
We bought AMD's 64-core value monster EPYC 7C13 new in servers. This seems to follow cloud pricing with similar performance as the AMD EPYC 7713P but at 60% lower cost. Unlike most cloud SKUs, we found it listed on AMD's website
@AMD
@AMDServer
We have longed for the MikroTik CRS310-8G+2S+IN switch for years, now we get to review this Marvell-powered 2.5GbE and 10GbE SFP+ switch with MikroTik management
@mikrotik_com
@MarvellTech