rump kernels and why how we got here
play

RUMP KERNELS and {why,how} we got here New Directions in Operating - PowerPoint PPT Presentation

Mar 23, 2023 •339 likes •697 views

RUMP KERNELS and {why,how} we got here New Directions in Operating Systems November 2014, London Antti Kantee, Fixup Software Ltd. pooka@rumpkernel.org @anttikantee Motivations want to run an application, not an OS want a better

  1. RUMP KERNELS and {why,how} we got here New Directions in Operating Systems November 2014, London Antti Kantee, Fixup Software Ltd. pooka@rumpkernel.org @anttikantee

  2. Motivations ● want to run an application, not an OS ● want a better operating system ● “operating system gets in the way”

  3. FIRST HALF what is an operating system

  4. Summary of OS's ● drivers – for enabling applications to run – n*10 6 LoC ● optional goop defining relation between drivers and applications – for protection, resource sharing, ... – 10 3 – 10 5 LoC

  5. application application driver driver driver kernel driver driver

  6. application application driver driver Server (“OS”) driver kernel driver driver

  7. application application server server driver driver server driver kernel

  8. application application application driver driver driver cpu core cpu core cpu core

  9. application driver driver driver driver kernel

  10. application application driver driver driver kernel driver driver

  11. SECOND HALF what is a rump kernel

  12. callers (i.e. “clients”) file systems device drvs syscalls ... TCP/IP rump kernel hypercall interface hypercall implementation platform

  13. rump (n): small or inferior remnant or offshoot; especially: a group (as a parliament) carrying on in the name of the original body after the departure or expulsion of a large number of its members

  14. rump kernel (n): small or inferior remnant or offshoot; specifically: a monolithic OS kernel carrying on in the name of the original body after the departure or expulsion of a large number of its subsystems

  15. A rump kernel does not provide threads, a scheduler, exec, or virtual memory, nor does it require privileged mode (or emulation of it) or interrupts > runs anywhere > integrates into other systems

  16. Wait, that doesn't explain where the drivers come from < anykernel (NetBSD)

  17. AN EXAMPLE! same thread throughout entire stack application(s) unmodified POSIX userspace code (10 n lines) userspace libraries libc rump kernel calls syscall traps unmodified NetBSD code (~10 6 lines) file systems device drvs syscalls ... TCP/IP rump kernel Platform-independent glue code glue code (~10 4 lines) hypercall interface platform-specific hypercall implementation code (~10 3 lines) e.g. Genode OS, Xen, platform userspace, bare-metal,

  18. THIRD HALF (with operating systems, expect the unexpected) how rump kernels happened

  19. Step 1: RUMP (2007) userspace fs framework application (userspace part) rump kernel VFS emustub unmodified file system driver ad-hoc shims hypercall implementation NetBSD userspace userspace syscalls, VFS, etc. kernel userspace fs framework file system (kernel part) driver

  20. Step 2: UKFS (2007) application (e.g. fs-utils) UKFS rump kernel VFS emustub Q: how hard can implementing unmodified file system driver a few syscalls be? ad-hoc shims A: very hypercall implementation userspace userspace kernel

  21. Step 3: a lot application / service (2008 - 2011) hijack ● support for all driver syscalls, vfs, etc. subsystems ● isolation from the host ● stable hypercall interface file systems device drvs syscalls ... TCP/IP ● anykernel completed rump ● production quality kernel ● rump kernels used for glue code testing NetBSD ● no libc for rump kernels, hypercall interface applications ran partially on the host hypercall implementation userspace

  22. Step 3.5: visions (not an actual step) ca. turn of the year 2011/2012: “An anykernel architecture can be seen as a gateway from current all-purpose operating systems to more specialized operating systems running on ASICs. The anykernel enables the device manufacturer to provide a compact hypervisor and select only the critical drivers from the original OS for their purposes. The unique advantage is that drivers which have been used and proven in general purpose systems, e.g. the TCP/IP stack, may be included without modification as standalone drivers in embedded products.”

  23. Step 4: portability to POSIX 2007-2012, 2012- buildrump.sh (2012-)

  24. 4.4STEP: beyond POSIX (201[234])

  28. Step 5.1: rumprun file systems device drvs syscalls ... (2013, 2014) TCP/IP rump kernel glue code hypercall interface hypercall implementation platform

  29. application(s) userspace libraries libc rump kernel calls syscall traps Step 5.2: rumprun file systems device drvs syscalls ... (2013, 2014) TCP/IP rump kernel glue code hypercall interface hypercall implementation platform

  30. FINAL HALF conclusions & other tidbits

  31. All le gory technical details: http://book.rumpkernel.org/ 2 nd edition is work in progress Will be available as free pdf, hopefully printed too

  32. Community ● http://rumpkernel.org/ ● http://repo.rumpkernel.org/ – BSD-licensed source code ● http://wiki.rumpkernel.org/ ● rumpkernel-users@lists.sourceforge.net ● #rumpkernel on irc.freenode.net ● @rumpkernel

  33. The actual conclusions

  34. You can make an omelette without breaking the kitchen!

Recommend

Rumprun for Rump Kernels: Instant Unikernels for POSIX applications Martin Lucina, @matolucina 1

Rumprun for Rump Kernels: Instant Unikernels for POSIX applications Martin Lucina, @matolucina 1

Rumprun for Rump Kernels: Instant Unikernels for POSIX applications Martin Lucina, @matolucina 1 / 8 So many Kernels, what are they? Monolithic kernel, Microkernel: standard stuff. Rump kernel: an existing monolithic kernel componentized into

215 views • 8 slides
Overview: Kernels for Sequences and Graphs String Kernels 8 Example Sequence Classification

Overview: Kernels for Sequences and Graphs String Kernels 8 Example Sequence Classification

Memorial Sloan-Kettering Cancer Center Overview: Kernels for Sequences and Graphs String Kernels 8 Example Sequence Classification Position-(In)dependent Kernels Advanced Kernels Easysvm Kernels on Graphs 9 Basics Random Walks Subtrees

1.8k views • 148 slides
Rump kernel based QEMU stubdomain Wei Liu Seattle August 17-18, 2015 Agenda Xen 4.6

Rump kernel based QEMU stubdomain Wei Liu Seattle August 17-18, 2015 Agenda Xen 4.6

Rump kernel based QEMU stubdomain Wei Liu Seattle August 17-18, 2015 Agenda Xen 4.6 timeline Development update Xen 4.6 Retrospective Agenda Background Introduction to rump kernel Why rump kernel What are required for QEMU

534 views • 15 slides
2 More Paper Goals The L4 Microkernel Is this actually useful? Is the Operations:

2 More Paper Goals The L4 Microkernel Is this actually useful? Is the Operations:

A short history of kernels Early kernel: a library of device drivers, support for threads (QNX) Operating System Kernels Monolithic kernels: Unix, VMS, OS 360 Unstructured but fast Over time, became very large

319 views • 10 slides
The Gray Code Kernels The Gray Code Kernels The Gray Code Kernels Gil Ben-Artzi Hagit Hel-Or

The Gray Code Kernels The Gray Code Kernels The Gray Code Kernels Gil Ben-Artzi Hagit Hel-Or

The Gray Code Kernels The Gray Code Kernels The Gray Code Kernels Gil Ben-Artzi Hagit Hel-Or Yacov Hel-Or Bar-Ilan University Haifa University IDC 1 Motivation Motivation Image filtering with a successive set of kernels is very

1.06k views • 58 slides
Scalable Machine Learning 6. Kernels Alex Smola Yahoo! Research and ANU

Scalable Machine Learning 6. Kernels Alex Smola Yahoo! Research and ANU

Scalable Machine Learning 6. Kernels Alex Smola Yahoo! Research and ANU http://alex.smola.org/teaching/berkeley2012 Stat 260 SP 12 6. Kernels Outline Kernels Hilbert Spaces Regularization theory Kernels on strings,

2.07k views • 171 slides
Kernels on structures Andrea Passerini passerini@disi.unitn.it Machine Learning Kernels on

Kernels on structures Andrea Passerini passerini@disi.unitn.it Machine Learning Kernels on

Kernels on structures Andrea Passerini passerini@disi.unitn.it Machine Learning Kernels on structures Kernels on structures Similarity between structured data Kernels allow to generalize notion of dot product (i.e. similarity) to arbitrary

396 views • 37 slides
T RUMP N ATIONAL D ORAL Covered Pathway DJT BALLROOM DJT NORTH FOYER DJT GRAND PATIO T HE D

T RUMP N ATIONAL D ORAL Covered Pathway DJT BALLROOM DJT NORTH FOYER DJT GRAND PATIO T HE D

T RUMP N ATIONAL D ORAL Covered Pathway DJT BALLROOM DJT NORTH FOYER DJT GRAND PATIO T HE D ONALD J. T RUMP G RAND B ALLROOM T HE B OBBY J ONES V ILLA BYRON NELSON M AIN C LUBHOUSE , L OWER L EVEL THE WHITE AND GOLD BALLROOM M AIN C LUBHOUSE ,

189 views • 18 slides
SVM Kernels COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning SVM Kernels 1 /

SVM Kernels COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning SVM Kernels 1 /

SVM Kernels COMPSCI 371D Machine Learning COMPSCI 371D Machine Learning SVM Kernels 1 / 27 Outline 1 Linear Separability and Feature Augmentation 2 Sample Complexity 3 Computational Complexity 4 Kernels and Nonlinear SVMs 5 Mercers

600 views • 27 slides
GRAPH MINING AND GRAPH KERNELS Part II: Graph Kernels Karsten Borgwardt^ and Xifeng Yan*

GRAPH MINING AND GRAPH KERNELS Part II: Graph Kernels Karsten Borgwardt^ and Xifeng Yan*

Graph Mining and Graph Kernels GRAPH MINING AND GRAPH KERNELS Part II: Graph Kernels Karsten Borgwardt^ and Xifeng Yan* ^University of Cambridge *IBM T. J. Watson Research Center August 24, 2008 | ACM SIG KDD, Las Vegas Graph Mining and

1.16k views • 48 slides
Beta kernels and transformed kernels applications to copulas and quantiles Arthur Charpentier

Beta kernels and transformed kernels applications to copulas and quantiles Arthur Charpentier

Arthur CHARPENTIER, transformed kernels and beta kernels Beta kernels and transformed kernels applications to copulas and quantiles Arthur Charpentier Universit Rennes 1 arthur.charpentier@univ-rennes1.fr http

1.18k views • 96 slides
Kernel methods and Graph kernels Social and Technological Networks Rik Sarkar University of

Kernel methods and Graph kernels Social and Technological Networks Rik Sarkar University of

Kernel methods and Graph kernels Social and Technological Networks Rik Sarkar University of Edinburgh, 2019. Kernels Kernels are a type of measures of similarity Important technique in Machine learning Used to increase power of many

568 views • 25 slides
Kernel methods and Graph kernels Social and Technological Networks Rik Sarkar University of

Kernel methods and Graph kernels Social and Technological Networks Rik Sarkar University of

Kernel methods and Graph kernels Social and Technological Networks Rik Sarkar University of Edinburgh, 2018. Kernels Kernels are a type of measures of similarity Important technique in Machine learning Used to increase power of many

359 views • 19 slides
Kernel on Automata Cousins of String Kernels and Dynamic Systems Kernels? S.V.N. Vishy

Kernel on Automata Cousins of String Kernels and Dynamic Systems Kernels? S.V.N. Vishy

Kernel on Automata Cousins of String Kernels and Dynamic Systems Kernels? S.V.N. Vishy Vishwanathan vishy@csa.iisc.ernet.in Indian Insitutute of Science Bangalore, India Joint work with Alex Smola S.V.N. Vishy Vishwanathan:

388 views • 16 slides
Welcome to my rump :) Introduction : why am I here ? Psychology student interested in hacking

Welcome to my rump :) Introduction : why am I here ? Psychology student interested in hacking

Welcome to my rump :) Introduction : why am I here ? Psychology student interested in hacking Applications : social engineering, but also politics, marketing, religious sects, etc. Introduce you to manipulation techniques 1. Same

451 views • 7 slides
L ibe l a nd Priva c y L a w Prime r in the T rump E ra Ric ha rd C. Ba lo ug h Ba lo ug h L

L ibe l a nd Priva c y L a w Prime r in the T rump E ra Ric ha rd C. Ba lo ug h Ba lo ug h L

L ibe l a nd Priva c y L a w Prime r in the T rump E ra Ric ha rd C. Ba lo ug h Ba lo ug h L a w Offic e s, L L C F e b rua ry 14, 2018 Ba lo ug h L a w Offic e s, L L C Our c urre nt lib e l la ws a re a sha m a nd a disg ra

285 views • 28 slides
Launching Kernels Dr Eric McCreath Research School of Computer Science The Australian National

Launching Kernels Dr Eric McCreath Research School of Computer Science The Australian National

Launching Kernels Dr Eric McCreath Research School of Computer Science The Australian National University Launching Kernels To maintain high occupancy you need to launch kernels that have many blocks (or work groups) with each block having

551 views • 17 slides
Machine Learning Fall 2017 Kernels (Kernels, Kernelized Perceptron and SVM) Professor Liang

Machine Learning Fall 2017 Kernels (Kernels, Kernelized Perceptron and SVM) Professor Liang

Machine Learning Fall 2017 Kernels (Kernels, Kernelized Perceptron and SVM) Professor Liang Huang (Chap. 12 of CIML) Nonlinear Features x4: -1 x1: +1 x2: -1 x3: +1 Concatenated (combined) features XOR: x = (x 1 , x 2 , x 1 x 2 )

478 views • 36 slides
Variably scaled kernels M. Bozzini jointed with L. Lenarduzzi, M. Rossini, R. Schaback Maia

Variably scaled kernels M. Bozzini jointed with L. Lenarduzzi, M. Rossini, R. Schaback Maia

Variably scaled kernels Variably scaled kernels M. Bozzini jointed with L. Lenarduzzi, M. Rossini, R. Schaback Maia 2013, Erice, September 25-30, 2013 Variably scaled kernels Native Spaces Background See e.g [Buhmann 2003], [Fasshauer 2007],

404 views • 37 slides
Sleeping in the volcano ECC Rump Session Damien Robert (Slides done under pressure by Ben

Sleeping in the volcano ECC Rump Session Damien Robert (Slides done under pressure by Ben

Sleeping in the volcano ECC Rump Session Damien Robert (Slides done under pressure by Ben looking for guinea pigs for the xtomato program) 19/09/2011 (Nancy) Sleep sort New breakthrough algorithm for sorting a list of integers. #!/bin/sh for

458 views • 11 slides
On enumerating the kernels in a bipolar valued digraph Raymond Bisdorff University of Luxembourg

On enumerating the kernels in a bipolar valued digraph Raymond Bisdorff University of Luxembourg

Kernels in bipolar-valued digraphs Enumerating kernels in crisp digraphs Solving the bipolar-valued case Conclusion On enumerating the kernels in a bipolar valued digraph Raymond Bisdorff University of Luxembourg Paris, Saturday, October 28,

1.41k views • 128 slides
Mehlers Formula, Branching Processes, and Compositional Kernels of Deep Neural Networks

Mehlers Formula, Branching Processes, and Compositional Kernels of Deep Neural Networks

Mehlers Formula, Branching Processes, and Compositional Kernels of Deep Neural Networks Tengyuan Liang Hai Tran-Bach May 26, 2020 Motivations &amp; Questions DNN and Kernels (Rahimi, Recht 08; Belkin et al 18; Jacot et al 19) .

964 views • 32 slides
Modelling covariance kernels for nonstationary random fields Christopher G. Small University of

Modelling covariance kernels for nonstationary random fields Christopher G. Small University of

Modelling covariance kernels for nonstationary random fields Christopher G. Small University of Waterloo University of Guelph, October 2007 0-0 1. Random fields and covariance kernels 2. The role of covariance kernels in semiparametric

971 views • 52 slides
A Timing Attack on Hyperelliptic Curve Cryptosystems Asiacrypt 2003 rump session on Dec. 2 nd ,

A Timing Attack on Hyperelliptic Curve Cryptosystems Asiacrypt 2003 rump session on Dec. 2 nd ,

A Timing Attack on Hyperelliptic Curve Cryptosystems Asiacrypt 2003 rump session on Dec. 2 nd , 2003 M.Katagi, I.Kitamura, T.Akishita, and T. Takagi(*) Sony Corporation (*)Technische Universitaet Darmstadt Introduction Optimization of

229 views • 5 slides

More recommend