- people - netdevconf.info

0x14: Travel consideration update
by Jamal Hadi Salim 12 Feb '20

12 Feb '20

It has been brought to our attention that there are countries which may impose outbound travel restrictions of their residents as a counter-measure to coronavirus (2019-nCov). Our understanding is this applies mostly to our colleagues in Asia who want to attend netdev 0x14. It is also likely that by the time we get close to the conference things will be under better control than they are right now. We would like to optimistically keep on moving forward with registration. Please register and take advantage of the early bird rates. We will reimburse 100% of the rate to any registered attendee who is unable to travel because of government imposed travel restrictions. This rule applies whether you register at early bird rates or later. See you in Vancouver! cheers, jamal (on behalf of the NetDev Society)

1 0

0x14: New Bronze sponsor! Mellanox
by Jamal Hadi Salim 11 Feb '20

11 Feb '20

We are pleased to announce Bronze sponsorship from our friends at Mellanox! Mellanox has been a consistent supporter of the netdev conference. Thank you! Mellanox Technologies (https://www.mellanox.com/) is a leading supplier of end-to-end Ethernet and InfiniBand intelligent interconnect solutions and hyper-converged infrastructure. Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

Enjoy a hockey game in Canada!
by Christie Geldart 11 Feb '20

11 Feb '20

Hello everyone, A few people have been asking so I wanted to share this information with everyone. There will be two home games for the Vancouver Canucks before and during our conference. The first one Sunday March 15th & the second on Wednesday March 18th. The Rogers Stadium is a 25 minute walk from the conference location. If you are interested in seeing a hockey game here are a few links to where you can buy tickets: Winnipeg Jets at Vancouver Canucks Sun. Mar 15, 2020 5:00 PM - Rogers Arena, Vancouver, BC, CA https://www1.ticketmaster.ca/vancouver-canucks-vs-winnipeg-jets/event/11005… <https://www1.ticketmaster.ca/vancouver-canucks-vs-winnipeg-jets/event/11005…> https://www.vividseats.com/nhl-hockey/vancouver-canucks-tickets/canucks-3-1… <https://www.vividseats.com/nhl-hockey/vancouver-canucks-tickets/canucks-3-1…> Tampa Bay Lightning at Vancouver Canucks Wed. Mar 18, 2020 7:00 PM - Rogers Arena, Vancouver, BC, CA https://www1.ticketmaster.ca/vancouver-canucks-vs-tampa-bay-lightning/event… <https://www1.ticketmaster.ca/vancouver-canucks-vs-tampa-bay-lightning/event…> https://www.vividseats.com/nhl-hockey/vancouver-canucks-tickets/canucks-3-1… <https://www.vividseats.com/nhl-hockey/vancouver-canucks-tickets/canucks-3-1…> Don’t forget to buy your ticket at the early bird rate ending February 17th. Best regards, Christie Geldart Event Coordinator, NETDEV 0x14 https://netdevconf.info/0x14/

1 0

Re: [NetDev-People] 2 hotel guest rooms available
by Christie Geldart 10 Feb '20

10 Feb '20

Hi All, These are now spoken for. For those of you who have contacted me and not heard back, you are the next in line if the person in front of you has changed their minds. Thank you, Christie > On Feb 10, 2020, at 9:35 AM, Christie Geldart via people <people(a)netdevconf.info> wrote: > > Hello everyone, > > I have 2 guest room on hold for at the Pinnacle Harbourfront Hotel where our conference is taking place. > > I will make these a first come first serve the rate is $259CAD per night. For anyone who is interested please send me an email. > > Best regards, > > Christie Geldart > Event Coordinator, NETDEV 0x14 > https://netdevconf.info/0x14/ <http://94py.mjt.lu/lnk/AMwAAGPiUboAAAAAAAAAAAKNIYoAAYCsBU0AAAAAAAwWzABeQWpr…> > > > > > > _______________________________________________ > people mailing list > people(a)netdevconf.org > https://lists.netdevconf.info/cgi-bin/mailman/listinfo/people

1 0

0x14: New Gold sponsor! Cumulus
by Jamal Hadi Salim 10 Feb '20

10 Feb '20

We are pleased to announce that Cumulus is back as a gold sponsor for netdevconf 0x14! Cumulus has sponsored _every_ single netdev conference since inception. This conference continues to thrive because of such generosity. Thank you Cumulus! More info about Cumulus: https://netdevconf.info/0x14/news.html?gold-sponsor-cumulus-networks Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

2 hotel guest rooms available
by Christie Geldart 10 Feb '20

10 Feb '20

Hello everyone, I have 2 guest room on hold for at the Pinnacle Harbourfront Hotel where our conference is taking place. I will make these a first come first serve the rate is $259CAD per night. For anyone who is interested please send me an email. Best regards, Christie Geldart Event Coordinator, NETDEV 0x14 https://netdevconf.info/0x14/

1 1

0x14: nutsnbolts, The Path To TCP 4K MTU and RX ZeroCopy
by Jamal Hadi Salim 09 Feb '20

09 Feb '20

If you are a big shop like Google you are always looking to squeeze all the performance juice you can out of your CPUs. Given the large number of machines deployed, a 1% performance improvement could mean millions of $$ in savings in both capital and operational costs. In this talk, monsieur Eric Dumazet - the man sometimes refered to in passing as some form of ninja - will describe changes introduced by Google that help double TCP receiver efficiency in their datacentres. Eric will discuss various issues that had to be overcome and a variety of tuning that was needed to achieve these performance improvements. More info: https://netdevconf.info/0x14/session.html?talk-the-path-to-tcp-4k-mtu-and-r… cheers, jamal

1 0

0x14: nutsnbolts, What to do with 1/2 a bit? L4S, SCE, or ?
by Jamal Hadi Salim 08 Feb '20

08 Feb '20

Imagine you have only one more bit left in the world! Scratch that. Imagine there is only a half bit left in the world. Then imagine there are multiple causes vying for this half bit. Who would you give it to and why? Yes, these things happen;-> A lot easier when it is between developers and a lot harder when it is to decide a standard that shall be cast in stone. The Internet Engineering Task Force (ietf) Transport Area Working Group (tsvwg) has such a struggle going. There are presently 2 proposals before for the last unused code point in the IPv4/6 header - one by the Low Latency Low Loss Scalable throughput (L4S) folks (see Netdev 0x13 for L4S talks) and another from the Some Congestion Experienced (SCE) folks. In this talk, Rodney Grimes will describe the two solutions and their prototype kernel implementations; what changes are made to both TCP and IP layers, etc. Rod is then going to pose the $1M question and solicit feedback: is one approach better than the other or do we need a new outlook? More info: https://netdevconf.info/0x14/session.html?talk-what-to-do-with-half-a-bit-L… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, XDP in Open vSwitch
by Jamal Hadi Salim 07 Feb '20

07 Feb '20

Being able to marry new Linux technology with existing "legacy" infra is valuable to allow for continuity. XDP is a relatively new technology introduced in Linux networking which enables more efficient packet processing. A common desire is to allow "legacy" packet processing functions to take advantage of the speed advantages offered by XDP. In addition to the efficiency factor, XDP also provides a time-to-market advantage: new network packet processing features can be added without need to go through the complexity of the upstreaming process. Toshiaki Makita and William Tu are still in pursuit of getting openvswitch to use XDP. In this talk Toshiaki and William attempt to marry OVS to XDP via: 1. Attaching XDP from kernel through UMH (user mode helper), 2. Reusing TC HW acceleration interface 3. Attaching XDP from OVS userspace daemon The authors will describe their approaches and challenges faced. More info: https://netdevconf.info/0x14/session.html?talk-XDP-in-open-vswitch Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, Using Upstream MPTCP in Linux Systems
by Jamal Hadi Salim 06 Feb '20

06 Feb '20

The Multipath TCP community started its engagement with netdev conf 0.1 (https://netdevconf.info/0.1/sessions/16.html) and have shown up to multiple other netdev confs after to solicit for feedback and report progress. After all that hard work MPTCP has finally been merged! In this talk Mat Martineau, Ossama Othman and Peter Krystad will provide advice to developers, ops and distros how to make good use of the upstreamed MPTCP. They will discuss kernel considerations, report on upstream merge progress to date, and introduce the Multipath TCP Daemon(mptcpd) to the Linux networking community. More info: https://netdevconf.info/0x14/session.html?talk-using-upstream-MPTCP-in-linu… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, Hardware offload for K8s container networking
by Jamal Hadi Salim 05 Feb '20

05 Feb '20

Kubernetes(k8s) Container Network Interface (CNI) is a specification for managing network resources on a kubernetes cluster. CNI enables plugin-based networking solution for containers ranging in functionality from IP address management to access control policy management, QOS, etc. Operators can pick and choose from the many packaged and open CNI implementations that exist or could create custom CNIs to serve their needs. In this talk Rony Efraim and Liel Shoshan describe how they approach hardware network offload enabling in k8s. Rony and Liel will illustrate offloading with a bunch of CNIs that can be used in conjunction with OVS. In addition, they will also describe how to offload for other K8s use cases like pod-to-pod intra networking and enhancing ingress service load balancing via dp_hash. And last but not least the speakers will describe challenges faced and future work. More info: https://netdevconf.info/0x14/session.html?talk-hardware-offload-for-k8s-con… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, Evaluation of TCP Congestion Control Algorithms over mmWave (5G) Mobile Networks
by Jamal Hadi Salim 05 Feb '20

05 Feb '20

As the commercials say - 5G(Fifth Generation) networking is here. Why is that a big deal? One appealing aspect: How do you like getting multi-gigabit bandwidth to your mobile device(s)? How does that work? For the first time in commercial mobile networking history a vast untapped spectrum has been made available for mass user consumption in the millimeter wave length range; in the 5G world it is refered to as "mmWave". The spectrum in mmWave links makes possible the multi-Gbps data rates on the 5G cellular networks. The problem with mmWave links is they are, like most high-frequency signals, susceptible to blockage. Basic obstructions like trees, snow, rain, buildings, etc interfere with the signal. A technique called beamforming helps but doesnt solve the problem entirely. To put this in context: Think of having a link that is very high speed but is constantly fluctuating in capacity. Then the question is: "How does TCP congestion control work in this kind of setup?" In this talk Feng Li, Jae Won Chung and Jamal Hadi Salim[1] will present results of a study to evaluate how various Linux TCP congestion control algorithm implementation fare over mmWave links. The authors claim this is _the first ever_ such study on a real commercial 5G network! The study was carried on the Verizon 5G deployment network. Feng et al will present data on comparing popular TCP congestion control algorithms, including NewReno, Cubic, BBR and BBRv2 (prepatch) etc. The results show that the performance of TCP on mmWave links is still highly dependent on the combination of TCP algorithm and socket buffer sizes. Without a doubt mmWave links impose new challenges on future transport layer design and the authors hope this talk will incentivize more discussions in the community. [1] Refered to in the third person. More info: https://netdevconf.info/0x14/session.html?talk-preliminary-evaluation-of-TC… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, It is Batching All the Way Down!
by Jamal Hadi Salim 04 Feb '20

04 Feb '20

It is turtles^wbatching all the way down folks! Several parts of the kernel network stack use batching for performance enhancement. Maciej Fijałkowski, Bjorn Topel and Krzysztof Kazimierczak feel we could do a little more. They borrow ideas from other high performance packet processing solutions, such as DPDK, and tweak those ideas to an "XDP first" design - meaning drivers that are optimized for the case when all packets are processed by XDP. In this talk, they describe how they enabled batching at both the driver and XDP level to improve performance for two sample drivers Intel i40e and ice. Maciej et all will share the performance improvements gained and propose some ideas how these batching ideas can equally be applied at other BPF hooks (socket send/recv, traffic control, etc) More info: https://netdevconf.info/0x14-staging/session.html?talk-it-is-batching-all-t… cheers, jamal

1 0

0x14: nutsnbolts, Reducing Kernel Queuing Delays with TCP Window Space Events
by Jamal Hadi Salim 04 Feb '20

04 Feb '20

Existing performance enhancing mechanisms such as TCP auto-tuning or programmatic async(epoll, etc) events such as "ready to send" help applications to sustain high throughput even under high Bandwith-Delay product scenarios. But: the folks at the Tor project have found that when you have thousands of active TCP sockets transmitting high volumes of data, many of which are simultenous (as it is the case in Tor anonymity network) then these mechanisms are insufficient. Local buffer bloat becomes a hindrance. In this talk, David Goulet and Rob Jansen introduce a new async event that helps applications overcome these issues. The new event supplements and extends the current write "ready to send" event that triggers when a socket buffer has free space. David and Rob will present data and go into more detailed description of the problem and then show the effect that such a change could have on performance through a small scale simulation. More info: https://netdevconf.info/0x14-staging/session.html?talk-reducing-kernel-queu… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, Time-travel Linux (network) simulation
by Jamal Hadi Salim 04 Feb '20

04 Feb '20

There are times when you want to recreate a network test that would typically take a while to complete. In addition, when you run the tests, you want the results to be consistent in different runs. In this talk, Johannes Berg and Richard Weinberger describe their solution to this requirement. They introduce a mechanism to do "time travel" in User Mode Linux(UML) with a virtual clock. The time travel mode allows for reproducible testing at significantly faster test execution times; as an example, on a relatively slow laptop: two simulated machines in such a setup can simulate 61 pings, at a default 1 second interval, in about 1.6 seconds real time (as opposed to 61 seconds). More info: https://netdevconf.info/0x14/session.html?talk-time-travel-linux-network-si… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, 5 years of iwd - lessons learned about Linux wireless subsystem
by Jamal Hadi Salim 03 Feb '20

03 Feb '20

The iNet Wireless Daemon aka iwd was created to be an alternative to wpa_supplicant. Iwd provides a more complete solution set for WiFi compared to wpa_supplicant - with a much longwe list of features. Marcel Holtmann will provide insights into iwd architecture and how it takes advantage of kernel features to provide good user experience. In addition, Marcel will go over lessons learned since inception of iwd in the last 5 years. More info: https://netdevconf.info/0x14/session.html?talk-5-years-of-iwd-lessons-learn… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts, devlink enhancements for sub functions management
by Jamal Hadi Salim 03 Feb '20

03 Feb '20

New virtualization deployments call out for high density virtual functions with more frequent lifetime recycling. Unfortunately, PCIe SR-IOV has limited function count and large instantiation overhead. A solution to these challenges is to take a PCIE device and "split" it into multiple subdevices. Each subdevice gets its own virtual port(s), queues as well as named resources; Combined with TC and switchdev offloads this approach overcomes the SR-IOV limitations. In this talk Parav Pandit introduces devlink enhancements to manage such sub functions. Parav first discusses how devlink is used to life cycle, configure and deploy accelerated sub functions with eswitch offloads support. He then discusses the plumbing done using virtbus to achieve persistence naming of netdevices and rdma devices. Parav will also cover how such model addresses smartnic use case where a sub-function NIC is hot plugged in host system in a secure manner. More info: https://netdevconf.info/0x14/session.html?talk-devlink-enhancements-for-sub… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: Moonshot talks + Workshop, Machine Learning For Networking
by Jamal Hadi Salim 02 Feb '20

02 Feb '20

Sorry to dissapoint folks, but we are _not_ going to have any talks on blockchain in 0x14! If this statement infuriates you then please demonstrate your outrage by submiting a proposal when the CFS for 0x15 opens up! Now that we got that out the way... What is Machine Learning? Machine learning (ML) is a subset of artificial intelligence(AI) that lets computer systems solve a specific task without using explicit instructions, relying on patterns and inference instead of human intervention. But How Does ML Apply To Networking? Machine learning can be used to observe patterns in network traffic or configuration and use the resulting data for a variety of things, some sample space: - dynamic congestion control (goodbye named congestion control algos!), see for example applicability of: https://netdevconf.info/0x12/session.html?restructuring-endpoint-congestion… - improve datapath performance - path optimization - anomaly detection from a baseline expectation and using the resulting data either for security or optimization end goals - etc. At 0x14 we have two moonshot talks that look at using ML for networking on Linux. These talks will be part of the ML workshop which is debutting in 0x14. We hope to able to solicit discussions and feedback on the subject and hopefully have this workshop as a fixture in future netdev confs. In the first moonshot talk Marta Plantykow, Piotr Raczynski, Maciej Machnikowski and Pawel Szymanski will discuss an approach to optimize networking performance alongside CPU utilization with ML. Marta et al propose an approach which will use ML to study RSS patterns and the CPU spread and then react dynamically to modify RSS hash parameters to improve CPU spread. The authors will go over the challenges they overcame, show some performance numbers and solicit feedback. More info: https://netdevconf.info/0x14/session.html?talk-performance-optimization-usi… Our second talk is from Maciej Paczkowski, Aleksandra Jereczek, and Patrycja Kochmanska. In this talk Maciej et al integrate into FRR to understand how to best optimize the path selection in an environemnt with multiple simultenous link faults and incestant link flapps. Could routing decisions better helped with ML hooks in the kernel/datapath? Could we make use of offloading some of the algos to AI hardware? The authors will go over the challenges they overcame, and solicit feedback. More info: https://netdevconf.info/0x14/session.html?talk-machine-learning-in-packet-r… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: extending TC with 5-tuple hash offload (dp_hash)
by Jamal Hadi Salim 31 Jan '20

31 Jan '20

In this moonshot talk Rony Efraim Roni, Bar Yanai and Yossi Kuperman come up with a clever way to do efficient forwarding by introducing an offloaded TC hash action. An example use case of this feature is closely emulating what Equal Cost Multipath (ECMP) based forwarding does. ECMP-like can be achieved by enabling policy which will: - First create a hash on a classical 5 tuple in hardware - Kernel s/ware receives the hashid as metadata - Use the resulting hashid as a tc filter chain id and jump to that filter chain - within the destination chain lookup a much smaller set of tc flower rules (in the equivalent 5 tuple space) and execute the associated leaf action(s) such as setting the next hop mac address, etc. Roni et al will suggest the TC extension semantics to define the hash offload and solicit feedback from the community. They will further discuss the challenges involved. More info: https://netdevconf.info/0x14/session.html?talk-extending-tc-with-5-tuple-ha… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts talk, SynGate: Issuing SYN cookies in XDP
by Jamal Hadi Salim 31 Jan '20

31 Jan '20

Lets start with some context. The Problem: TCP SYN DDOS attack. TCP SYN attacks flood a targetted server with SYN requests. Each SYN request received by the server is responded to with a SYN ACK which results in a connection state being created and put in a half-open (SYN RCVD) TCP state awaiting an ACK to come back. *The ACK response never comes* and the SYN requests keep coming in resulting in more half-open state creation in the backlog... At some point, during this attack, there will be a lot of TCP half-open state such that the targeted server's ability to respond to new SYN requests is lost because all the available port resources have been exhausted... How does one defend against SYN flood attack? A popular defense against SYN attacks uses what is known as SYN cookies. So, how do SYN cookies work? When the server sees the TCP SYN, it constructs the SYN ACK using a sequence # created from a cryptographic hash of some of the flow attributes. The computed ACK sequence # has enough flow attributes encoding in it such that can be later (on response to this sequence #) used to reconstruct the original SYN request should the original sender response. Two possibilities on responses: 1) If this was an attack, then the server will never receive a response. It is no big deal since we are not storing any half-open info in the backlog; and therefore no server resources are wasted in anticipation of that response. 2) This is legit client request - in which case there will be a response coming back. When the ACK is received, we look at the ACK sequence # and reconstruct the SYN queue entry using the information that was originally encoded in the SYN ACK. SYN cookies are effective, but: the operation requires the packets traverse the TCP/IP layers all the way up. For a busy server, the extra code path and the hash computation constrains how fast you can issue SYN cookies back. In this talk, Petar Penkov, Eric Dumazet and Stanislav Fomichev discuss SynGate, an XDP-based approach to handling SYN cookies. By moving the response lower in the stack it enables the system to increase the rate at which a host can issue SYN cookies and therefore improving its resilience to SYN flood attacks. Petar et al will detail the design of this solution, the advantages eBPF provided them and, challenges faced during development of of SynGate and finally they will discuss areas they are considering for improvement. More info: https://netdevconf.info/0x14/session.html?talk-issuing-SYN-cookies-in-XDP Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutsnbolts talk, Taking Control of your SmartNIC
by Jamal Hadi Salim 30 Jan '20

30 Jan '20

SmartNICs are introducing a new paradigm in hardware offload/acceleration world - that of introducing additional general purpose processors in the NIC. So try to visualize the NIC as almost its own machine connected to your host. Meaning you can, for example, move your control plane to the NIC. In this talk, Or Gerlitz and Andy Gospodarek start by describing high level view of this class of NICs. They will then explore common deployment methods and models and help us understand better how this new class of NICs operate by exploring: - what is out there in terms of networking open source code/features - automation recipes and scripts to onboard software infra - common kernel offload techniques in use - upstream kernel and distro SoC support Or and Andy will iterate a few working examples that are available for use across devices from multiple, open SmartNIC vendors. They will also discuss approaches of integrating into known cloud orchestration systems like OpenStack and Kubernetes. More info: https://netdevconf.info/0x14/session.html?talk-taking-control-of-your-Smart… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: nutnbolts talk, Application Device Queues (ADQ) for system-level network I/O performance improvements
by Jamal Hadi Salim 30 Jan '20

30 Jan '20

ADQ(Application Device Queues) support has been in the kernel for a while now. ADQ enables network application data to be isolated to specific (symmetric rx/tx) hardware netdevice queue pair(s). Application specific-data is ingressed towards these dedicated queues and rate controlled in the egress direction - all using policy definitions. ADQ uses standard Linux interfaces to achieve its goals. In this talk, Amritha Nambiar, Kiran Patil and Sridhar Samudrala will: - dig into the details of ADQ architecture and operations. - illustrate collected data on how ADQ helps to improve predictability by reducing jitter, lowering latency and improving throughput. - show, via an example application, how developers can take advantage of ADQ. Amritha et al will also discuss future plans for ADQ such as enabling busy polling on AF_XDP sockets by associating a NAPI_ID to an AF_XDP socket at bind time. More info: https://netdevconf.info/0x14/session.html?talk-ADQ-for-system-level-network… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

0x14: Bronze Sponsor, IPv4 Unicast Extensions Project
by Jamal Hadi Salim 29 Jan '20

29 Jan '20

New Sponsor, the IPv4 Unicast Extensions Project. We are grateful for your support! Thank you. IPv4 Unicast Extensions Project is working on extending the unicast portion of the IPv4 address space, including hundreds of millions of addresses that are currently reserved, or are very underutilized. This extension will make more IPv4 addresses usable for providing globally reachable services during the long transition to IPv6, reducing the price of IPv4 addresses to end users. cheers, jamal

1 0

0x14: Moonshot talk, Linux Kernel Network Scripting with Lua
by Jamal Hadi Salim 29 Jan '20

29 Jan '20

I'll spend a bit more time summarizing this talk because it will no doubt generate passions in (some) people and curiosity in others. If you thought that eBPF is the only approach to extend the kernel, think again. In this talk, Lourival Vieira Neto et al describe a framework, Lunatik, which facilitates dynamically injecting Lua scripts into the kernel to extend kernel mechanisms. Some context: what is Lua? 1) It is a scripting language that is very widely deployed as an embededable _extension language_. Game programming in particular predominantly uses it for extensions. Openwrt uses it as config language and there are many others listed here: https://en.wikipedia.org/wiki/List_of_applications_using_Lua. Wide deployment means it has seen exposure in many environments. The _extension 2) It is a tiny language (the whole language is about 200KB) that is designed to be easy to embed - in particular in C 3) It is considered relatively secure. Despite the wide deployment over many years there have been very few CVEs reported against Lua in more than a decade. See: https://www.cvedetails.com/product/28436/LUA-LUA.html?vendor_id=13641). Why scripting? Extending kernels with scripts is nothing new. But: The simple answer to this question is to compare a compiler driven approach (think C) vs a scripting language(think Bash or python). The former requires a complex development environment (think eBPF needing latest clang, gcc, correct libbpf, etc) while the later provides faster turnarounds to development and deployment (you need a kernel with the Lua VM but not much after that in terms of tooling) and of course, a much simpler and stable ABI. Script based execution is often not as performant but often more usable relatively speaking. And back to the talk... The Lunatik framework has rich coverage across different kernel hooks and has been used to script different Linux subsystems such as CPUfreq, Sockets, RCU, ULP, Netfilter, and now XDP. Lunatik has been around for a while, just not upstreamed - and to give a little sample space of its deployment: NFLua is currently deployed _in production in over 20 million home routers_! You dont want a rogue script kill your kernel and system. Lourival et al will discuss the challenges and approach taken in allowing script injection into the kernel while still maintaining correctness, isolation, and liveness. They will then describe NFLua and introduce XPDLua, which allows users to extend XDP with Lua. XDPLua aims to replace NFLua. The authors will detail how Lua can be used within XDP: as a standalone to directly invoke currently exposed eBPF helpers or alternatively have eBPF programs invoke Lua scripts. And last but not least: Lourival et al will provide comparison performance data for packet filtering between with Iptables, eBPF, NFLua and XDPLua. sounds exciting? Come to the conference, listen, learn, and engage the speakers! More info: https://netdevconf.info/0x14/session.html?talk-linux-network-scripting-with… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

2 1

0x14: nutsnbolts talk, Storage application performance boost with zero thrashing networking stack
by Jamal Hadi Salim 29 Jan '20

29 Jan '20

There has been an ongoing effort in the community to get Zero-copy working over the last few years - with much success. While both MSG_ZEROCOPY (zero copy transmit) and socket mmap (zero copy receive) have been out in the wild for sometime now, there are no known high scale open source application consumers of these interfaces. In this talk, Or Gerlitz will describe how he makes use of these interfaces to integrate into spdk(https://spdk.io/) - an open source storage framework which uses sockets for nvme-over-tcp in a smart NIC environment. The goal is to use kernel uAPIs while achieving high scale performance. Or will delve into MSG_ZEROCPOY and the challenges that he had to deal with. He will describe the need for an app author to understand and how to best tie-in their app state machine to the interfaces: to address both transactions responses from the peer app and zero-copy notifications from the local socket provider. Should the app use ZC with all or nothing approach or sometimes yes and other-times no? Come to the talk to get the answer and advise on how to effectively use these interfaces. In addition Or will spend time going into the performance analysis details correlating I/O performance visavis CPU cost (which is often tricky to get right with traditional tools like profiler/flame-graphs). More info: https://netdevconf.info/0x14/session.html?talk-storage-application-performa… Reminder, registration is now open and early bird is still in effect. https://netdevconf.info/0x14/registration.html cheers, jamal

1 0

2025

2024

2023

2022

2021

2020

2019

2018

people