Data Center ToR Switch Selection: Key Specs and Comparison Guide

Buying the right ToR (Top-of-Rack) switch decides the performance, reliability and upgrade path of your entire data center rack - yet most procurement decisions are made on port count alone. This guide walks through the specs that actually matter: port density and speeds, switching capacity vs real throughput, buffer depth for lossless workloads, latency, L2/L3 feature set (MLAG, VXLAN/EVPN), optics compatibility, management and total cost of ownership. A comparison of common 25G/100G ToR models is included as a starting point for your own shortlist.

The Specs That Matter

1. Port Density and Speeds

• 48 × 10/25G downlink ports is the current sweet spot for server connectivity.
• Uplinks: 6-8 × 100G (or 400G on newer platforms) toward the spine.
• Breakout support (100G → 4×25G, 40G → 4×10G) gives flexibility for mixed server generations.

2. Switching Capacity and Forwarding Rate

Compare real throughput, not marketing numbers: a 48×25G + 8×100G switch should forward ~3.2-4 Tbps non-blocking. Check the forwarding rate (Mpps) matches the capacity at minimum frame size.

3. Buffer Depth

Storage (NVMe-oF, RoCE) and AI workloads are loss-sensitive. Larger shared buffers (16-32 MB) absorb micro-bursts; look for per-port QoS and PFC (Priority Flow Control) support for lossless Ethernet.

4. Latency

Cut-through vs store-and-forward: most data center switches do cut-through at sub-microsecond port-to-port latency. For HPC/AI fabrics, latency matters; check the vendor's published numbers.

5. L2/L3 Feature Set

• MLAG (multi-chassis LAG) for active-active ToR pairs - mandatory in production racks.
• VXLAN/EVPN for overlay fabrics - required for any modern leaf/spine design.
• BGP/OSPF, PIM, ACLs, sFlow/NetFlow, and a programmable API (e.g., EOS eAPI, NX-API, REST).

Comparison of Common ToR Switches

Optics and Cabling

• Match optics to reach: DAC (1-5 m intra-rack), AOC (5-30 m), SR4/SR8 multimode (100 m), LR4/LR8 single-mode (2-10 km).
• Check the vendor's supported transceiver list - using unsupported optics may void support and lock features.
• Consider 400G-ready uplinks even if you start at 100G - the optics can be cheaper than a full switch swap later.

Management and Automation

Evaluate the management story: CLI quality, REST/gRPC APIs, telemetry (streaming), integration with Ansible/Terraform, and the vendor's automation platform (CloudVision, NDFC, NetEdit). A switch that is painful to automate will hurt for years.

TCO Checklist

• List price vs street price; factor optics, stack cables, licenses.
• Power and cooling: per-port watts at full load, airflow direction vs your rack layout.
• Warranty and support: NBD vs 4-hour; software subscription costs.
• Fleet consistency: standardize one ToR model per rack type to simplify spare parts and automation.

Related: Leaf-spine two-tier design and 400G spine / 100G leaf link consistency.

原文链接：https://www.arista.com/en/solutions/