Follow

SDMZ 100G AMD EPYC DTN Servers Tuning

Overview

  • OS: RHEL/Centos 7 

OS kernel configuration

Install ml-kernel 

 

Disable at boot 

  • amd_iommu=off

SYSCTL Config

  • net.ipv4.tcp_congestion_control=bbr
  • net.ipv4.tcp_mtu_probing=1
  • net.core.rmem_max=2147483647
  • net.core.wmem_max=2147483647
  • net.ipv4.tcp_rmem=4096 87380 2147483647
  • net.ipv4.tcp_wmem=4096 65536 2147483647
  • net.core.default_qdisc=fq
  • net.ipv4.conf.default.rp_filter=0
  • net.ipv4.conf.all.rp_filter=0
  • net.ipv4.ip_forward=0
  • net.core.netdev_max_backlog=250000
  • net.ipv4.tcp_no_metrics_save=1
  • fs.pipe-max-size=4194304
  • fs.pipe-user-pages-soft=65536

Network Interface Settings

  • sudo ethtool -C <network interface> adaptive-rx off
  • sudo ethtool -L <network interface> combined <attached core count>
  • sudo ethtool -G <network interface> rx 8192 tx 8192

Affinity

  • sudo service irqbalance stop
  • sudo set_irq_affinity_cpulist.sh <cores attached to interface> <interface>

Reference: