1C-202_FlexTOE Flexible TCP Offload with Fine-Grained Parallelism.PDF

1、FlexTOEFlexTOE:Flexible TCP Offload with Fine-Grained ParallelismRajath Shashidhara1,Tim Stamler2,Antoine Kaufmann3,Simon Peter11University of Washington,2UT Austin,3MPI-SWSSan Jose,CA April 26-28,2022High CPU Overhead of TCP TCP remains the default protocol in the datacenter But TCP stacks have hig

2、h CPU overhead Even with modern optimized stacks(TAS,Snap,)CPU profile of Memcached with 32B requests/responsesTo go further,we need to offload2only 26%San Jose,CA April 26-28,2022Need for FlexibleFlexibleTCP Offload Flexibility:Datacenter networks evolve rapidly Operators need flexibility for agile

3、 development Existing TOEs are hardwired:slow upgrade cyclesCPU profile of Memcached with Chelsio Terminator TOE3only 16%San Jose,CA April 26-28,2022TCP Offload:TCP Offload:Can we get Can we get flexibilityflexibility and and performanceperformance?4San Jose,CA April 26-28,2022FlexTOEFlexTOE:Flexibl

4、e,High Performance TCP Offload Eliminates all host TCP stack overheads Supports POSIX-sockets,DCTCP/Timely congestion control Fully extensible(software development velocity),with eBPF support553%San Jose,CA April 26-28,2022TCP Offload to SmartNICs-ChallengesSmartNICs are flexible but restrictive:Eg:

5、Netronome Agilio,Mellanox BlueField,Pensando DSC,Fungible DPU,Parallel architectures geared towards stateless offloads Many wimpy cores with limited memoriesTCP connections are processed sequentially:Stateful code paths track in-flight segments Stringent per-packet time budgets Sensitive to reorderi

6、ngTraditional TCP stacks perform poorly on Traditional TCP stacks perform poorly on SmartNICsSmartNICs6San Jose,CA April 26-28,2022FlexTOEFlexTOE:Flexible,High-Performance TCP Offload with Fine-grained ParallelismTo provide high performance and flexibility,FlexTOE leverages:Modularity:fine-grained m