Difference between revisions of "EJFAT UDP General Performance Considerations"
Jump to navigation
Jump to search
(Created page with "<font size="+2"> === Effect of NIC queues on UDP transmission === === Jumbo Frames === </font>") |
|||
| Line 3: | Line 3: | ||
=== Effect of NIC queues on UDP transmission === | === Effect of NIC queues on UDP transmission === | ||
| + | [https://www.kernel.org/doc/html/latest/networking/scaling.html Scaling in the Linux Networking Stack] | ||
| + | : Contemporary NICs support multiple receive and transmit descriptor queues. On reception, a NIC can send different packets to different queues to distribute processing among CPUs. Find out how many NIC queues there are on your node by looking at the '''combined''' property: | ||
| + | |||
| + | <blockquote> | ||
| + | <pre> | ||
| + | // See how many queues there are | ||
| + | sudo ethtool -l enp193s0f1np1 | ||
| + | </pre> | ||
| + | </blockquote> | ||
| + | |||
| + | : In the case of ejfat nodes, there are a max of 63 queues even though there are 128 cores. It seems odd to me that there isn't 1 queue per cpu, and it does not appear to be changeable so most likely it's built into the kernel when first created. | ||
Revision as of 15:32, 21 December 2023
Effect of NIC queues on UDP transmission
Scaling in the Linux Networking Stack
- Contemporary NICs support multiple receive and transmit descriptor queues. On reception, a NIC can send different packets to different queues to distribute processing among CPUs. Find out how many NIC queues there are on your node by looking at the combined property:
// See how many queues there are sudo ethtool -l enp193s0f1np1
- In the case of ejfat nodes, there are a max of 63 queues even though there are 128 cores. It seems odd to me that there isn't 1 queue per cpu, and it does not appear to be changeable so most likely it's built into the kernel when first created.
Jumbo Frames