OpenVZ Virtuozzo Containers Wiki - User contributions [en]

Containers/Mini-summit 2008 notes

2008-07-22T14:49:10Z

Hallyn:

Intros (8:36am)

Dave Hansen
Eric Biederman
Jason Byron redhat
Joe Rusio - evergreen
Joe McDonald
HP China
Sonny Rao
HP
HP
Matine Silberman HP
Sandy Harris
NEC Japan
John Schultz aol
Pavel E., Parallels
Denis L., Parallels
(?)
Benjamin
Daniel
Serge

On Phone:
Amy Griffith HP

(Later walk-ins)

Topics:

Why do various companies want containers?
ibm: workload management
EB: using containers as improved chroot
HP: wants similar to ibm, plus security
parallels: hosted providers

sysfs issues
EB gives status: should go into next merge window

mini-namespaces
NFS
clients should behave differently on diff. containers
currently uses single sunrpc transport for all containers
Dave: is there a list of all openvz mini-ns?
EB:
proposal:
create little filesystems
still store everything in nsproxy
currently:
some people want same process in different netns's
almost possible now, but can't open new sockets
namespace enter:
3 purposes
login
monitoring
configuring
may be worth prototyping the proposal
address mqns, or sunrpc, or fuse?
DH:
openvz addresses this using one big clone(), right?
(yes)

userid namespaces
EB summarizes his proposal
userid ns is unsharable without privilege
userids, capabilities, security labels become ns-local
hierarchical like pidns
openvz: just does chroot
DH:
observers that system vs. app containers have different requirements
EB:
so with userid namespaces, user has god-like powers over created namespaces
EB+SH will talk about hacking something this week during ols
Uses:
user unttrusted mounts
build systems

device namespaces
tty namespaces rejected
should be solved with generic device namespaces
virtualize the major:minor->device mapping
reserved device numbers (unnamed)
created with /proc?
get_unnamed_device()
tty ideas:
use selinux ptys
use user namespaces
use legacy ptys
leverage ptyfs
Suka is not on, so he gets volunteered to do pure /dev/pts fs approach

per-container LSMs:
SH: thinks LSMs should handle it
EB:
original purpose of chroot
set up policies from inside container
creating smack container inside selinux would be ideal

entering a container
netns: identified using pid of a ns
sh: can we solve this using EB's namespace filesystems proposal?
(EB goes to the board to demonstrate his proposal)
PM: Can we use control groups?
PE: Can we re-use /proc/pid/ ?
EB: could have a ns with no processes in it
Example of command using this:
ip set eth0 netns <pid>
becomes
ip set eth0 netns /proc/<pid>/
DL:
a real netns problem is knowing when a childns has died
the netnsfs mount could solve that
PE: EB, can you send POC patches for the namespace?
EB and EM will both send their own POC.

DL: people have complained about needing CAP_SYS_ADMIN to unshare ns
EB: example, setuid root sysvipc-using program could be fooled

PE: Entering a container:
reasons:
monitoring
enter an administrative command
DH: how do you do it now?
PE: numerical ID for each VE, use it to enter
EB:
one need for entering: /sbin/hotplug
(someone): does hijack suffice?
EB: two cases:
partial entering
full entering
sys_hijack does not address partial entering
DH:
why need partial entering?
fs stuff can be done without entering
PM: privileged process
PE:
will look at hijack patches
someone will re-send hijack to containers@
EB:
if we can do sys_hijack cleanly,
we can use it to solve kthread problem

Containers/Mini-summit 2008 notes

2008-07-22T14:37:09Z

Hallyn: New page: Intros (8:36am) Dave Hansen Eric Biederman Jason Byron redhat Joe Rusio - evergreen Joe McDonald HP China Sonny Rao HP ...

Containers/Mini-summit 2008

2008-07-22T14:34:50Z

Hallyn:

There will be a containers mini-summit at the [http://www.linuxsymposium.org/2008/ OLS'08]. This page is for organizing this mini-summit. Feel free to edit.

'''When''': 22nd of July 2008, 8:30-16:30<br/>
'''Where''': Ottawa, ON, Canada, Novotel Hotel (Albion A).

== Proposal ==

The mini-summit proposal sent to OLS organizers. '''See [[/Proposal|proposal]]'''.

== Topics to discuss ==

* Device accessibility cgroup (maybe with remap ability)
* TTYs
* Syslog
* Checkpoint/restart
* Memory controllers
* more?..

== List of attendees ==
Please fill in your name here if you are going to attend, or email kir at openvz dot org if you are too lazy. Surely the list is not final, so put your name even if you are not sure you can make it.

This list is in no particular order.


<div style="-moz-column-count:3; -webkit-column-count:3; column-count:3; text-align: left; background: #fefef0; border: 1px solid #ddddc0;">
# Pavel Emelyanov
# Denis Lunev
# Andrey Mirkin
# Serge Hallyn
# Dave Hansen
# Daniel Lezcano
# Srivatsa Vaddagiri
# Balbir Singh
# Sukadev Bhattiprolu
# Paul Menage
# Eric W. Biederman
# Oren Laadan
# Yamamoto Takashi
# Kamezawa Hiroyuki
# Benjamin Thery
# Herbert Pötzl
# Oleg Nesterov
# Dhaval Giani
# Bart Trojanowski
# Joseph Ruscio
# Constant Chan
# Linda Knippers
# Satoshi Uchida
# Masahiko Takahashi
# Martine Silbermann
# Benoit des Ligneris
# Patrick Naubert
# Daisuke Nishimura
# Sudhir Kumar
# Munehiro Ikeda
# Kamalesh Babulal
# John Schulz
# Poornima Nayak
# Gyuil Cha
# YoungHo Kim
# Rob Woolley
# Daniel Robbins
# Jason Baron
# Subrata Modak
# Veerendra C
# Joe MacDonald
# Andrew Theurer
# Myron Stowe
# Peter Teoh
</div>

== Agenda ==

* Namespaces/Containers (8:30am-11am)
** sysfs issues (and any /proc issues)
*** uevents/hotplug
** Network namespaces issues
*** multiple namespaces in one process
** Device namespace design?
** User namespace
** Additional needed namespaces
*** Small namespaces ''What to do with small subsystem that might need virtualization. E.g. in openvz we have FUSE, binfmt_misc and some other small stuff virtualized. But how to merge it in mainline? Create a separate namespace for each? Mere them into one? How to call this then?''
** Handling filesystem/namespace synchronization (not sure what the issue is)
** Container design
*** How to enter a container
*** Nature of a 'container' — kernel object or userspace fiction

* Cgroups+Resource management (11:30-2pm)
** Cgroup implementation
*** Locking (don't let cgroup_lock() become the BKL)
*** Transactional attachment
*** "procs" file
*** User-space notification API
**** Resource counter hit soft/hard limit
**** Task entered/left cgroup
**** OOM occurred
*** Binary statistics API
** Existing cgroups
*** Memory (Balbir's NOTE: I would prefer to take some of this discussion to my memory controller BoF on Wednesday. Lets discuss this at the end)
**** Supporting over-commit and guarantees
**** Soft-limits
**** Hierarchical borrowing - in kernel or userspace?
**** Per-cgroup refault information?
*** Kernel memory
*** Device
*** Memrlimit
**** Some push-back over this - can we give real use cases?
*** CPU scheduler
** Additional cgroups and their design
*** Swap (separate subsystem or merge with memory?)
*** Disk I/O (several proposed designs)
*** Network traffic classification
*** Freezer
*** Signaller
*** OOM Handler
** libcg - userspace explotation of control groups/resource management
*** Overview so far
*** Is kernel-based reclassification needed?
*** Real use-cases
*** Future directions

* Checkpoint/Restart (2:30pm-5pm)
** Documentation : Look at "See Also" section below
** Goals and expectations of this summit
*** identify, discuss and (if possible) agree on the general design
*** identify, discuss and (if possible) agree on the technical points
*** decide on priorities for different components (eg. high, medium, low) such that the final outcome is a practical road-map that would keep us busy for (at least) until the next OLS (though the "O" may change ;)
** What are the problems that the linux community can solve with the checkpoint/restart ?
** Preparing the kernel internals
*** How we implement it without affecting long term maintainability ?
*** What are the kernel subsystems, process resources and framework for CR ?
*** Which pieces to target first ?

The following technical points can be discussed during the mini-summit if we have time or later at the OLS.

** Checkpointing / Restarting
*** Reaching a quescient point - network, processes, aio, avoiding side effects of quiesce/revive
*** Checkpoint - signal handler ? syscall ? crfs ? process hierarchy, resource dependencies, system and process resources
*** Restarting - New binary format handler ? converting between formats (from older kernel to newer)
*** Notification to processes which explicitly wish to be notified about quiesce, checkpoint and restart - container state ? new signals ?
** Determining the userspace API - Posix 1003.1m ?
** Passing the kernel internal state to/from userspace - coredump like file ? swap per container ? netlinks, CR filesystem ? army of different call for the CR (proc, existing syscalls, ...)
** Hopefully we can continue to discuss in the next days and get a bit of a hackfest going during OLS :)

== Moderators ==

* Namespaces/containers: Serge Hallyn, Dave Hansen
* Cgroups and resource management: Paul Menage, Balbir Singh, Dhaval Giani
* Checkpoint/restart: Daniel Lezcano, Oren Laadan

== See also ==
* http://www.linuxsymposium.org/2008/cfp.php — OLS call for papers
* https://lists.linux-foundation.org/pipermail/containers/2008-January/009688.html
* http://openvz.org/pipermail/devel/2008-July/012891.html
* Checkpoint/Restart
** Zap : http://www.ncl.cs.columbia.edu/publications/usenix2007_fordist.pdf
** Metacluster : http://lxc.sourceforge.net/doc/ols2006/lxc-ols2006.pdf
** OpenVZ : [[Checkpointing and live migration]]
** Checkpoint/Restart technology : http://en.wikipedia.org/wiki/Application_checkpointing
** Virtual Servers and Checkpoint/Restart in Mainstream Linux : Sigops document
** Remote fork: http://www.cse.nd.edu/~dthain/courses/classconf/wowsys2004/talks/rfork.pdf
** Vmadump : http://bproc.sourceforge.net/c268.html
** Posix CR : http://techpubs.sgi.com/library/tpl/cgi-bin/getdoc.cgi/0650/bks/SGI_Admin/CPR_OG/sgi_html/ch03.html
** An OS services overview : http://sw-eng.falls-church.va.us/itsg/P08V31.htm

[[Containers/Mini-summit_2008_notes]]

[[Category: Containers]]
[[Category: Events]]

Containers/Mini-summit 2008

2008-07-22T14:33:51Z

Hallyn:

There will be a containers mini-summit at the [http://www.linuxsymposium.org/2008/ OLS'08]. This page is for organizing this mini-summit. Feel free to edit.

'''When''': 22nd of July 2008, 8:30-16:30<br/>
'''Where''': Ottawa, ON, Canada, Novotel Hotel (Albion A).

== Proposal ==

The mini-summit proposal sent to OLS organizers. '''See [[/Proposal|proposal]]'''.

== Topics to discuss ==

* Device accessibility cgroup (maybe with remap ability)
* TTYs
* Syslog
* Checkpoint/restart
* Memory controllers
* more?..

== List of attendees ==
Please fill in your name here if you are going to attend, or email kir at openvz dot org if you are too lazy. Surely the list is not final, so put your name even if you are not sure you can make it.

This list is in no particular order.


<div style="-moz-column-count:3; -webkit-column-count:3; column-count:3; text-align: left; background: #fefef0; border: 1px solid #ddddc0;">
# Pavel Emelyanov
# Denis Lunev
# Andrey Mirkin
# Serge Hallyn
# Dave Hansen
# Daniel Lezcano
# Srivatsa Vaddagiri
# Balbir Singh
# Sukadev Bhattiprolu
# Paul Menage
# Eric W. Biederman
# Oren Laadan
# Yamamoto Takashi
# Kamezawa Hiroyuki
# Benjamin Thery
# Herbert Pötzl
# Oleg Nesterov
# Dhaval Giani
# Bart Trojanowski
# Joseph Ruscio
# Constant Chan
# Linda Knippers
# Satoshi Uchida
# Masahiko Takahashi
# Martine Silbermann
# Benoit des Ligneris
# Patrick Naubert
# Daisuke Nishimura
# Sudhir Kumar
# Munehiro Ikeda
# Kamalesh Babulal
# John Schulz
# Poornima Nayak
# Gyuil Cha
# YoungHo Kim
# Rob Woolley
# Daniel Robbins
# Jason Baron
# Subrata Modak
# Veerendra C
# Joe MacDonald
# Andrew Theurer
# Myron Stowe
# Peter Teoh
</div>

== Agenda ==

* Namespaces/Containers (8:30am-11am)
** sysfs issues (and any /proc issues)
*** uevents/hotplug
** Network namespaces issues
*** multiple namespaces in one process
** Device namespace design?
** User namespace
** Additional needed namespaces
*** Small namespaces ''What to do with small subsystem that might need virtualization. E.g. in openvz we have FUSE, binfmt_misc and some other small stuff virtualized. But how to merge it in mainline? Create a separate namespace for each? Mere them into one? How to call this then?''
** Handling filesystem/namespace synchronization (not sure what the issue is)
** Container design
*** How to enter a container
*** Nature of a 'container' — kernel object or userspace fiction

* Cgroups+Resource management (11:30-2pm)
** Cgroup implementation
*** Locking (don't let cgroup_lock() become the BKL)
*** Transactional attachment
*** "procs" file
*** User-space notification API
**** Resource counter hit soft/hard limit
**** Task entered/left cgroup
**** OOM occurred
*** Binary statistics API
** Existing cgroups
*** Memory (Balbir's NOTE: I would prefer to take some of this discussion to my memory controller BoF on Wednesday. Lets discuss this at the end)
**** Supporting over-commit and guarantees
**** Soft-limits
**** Hierarchical borrowing - in kernel or userspace?
**** Per-cgroup refault information?
*** Kernel memory
*** Device
*** Memrlimit
**** Some push-back over this - can we give real use cases?
*** CPU scheduler
** Additional cgroups and their design
*** Swap (separate subsystem or merge with memory?)
*** Disk I/O (several proposed designs)
*** Network traffic classification
*** Freezer
*** Signaller
*** OOM Handler
** libcg - userspace explotation of control groups/resource management
*** Overview so far
*** Is kernel-based reclassification needed?
*** Real use-cases
*** Future directions

* Checkpoint/Restart (2:30pm-5pm)
** Documentation : Look at "See Also" section below
** Goals and expectations of this summit
*** identify, discuss and (if possible) agree on the general design
*** identify, discuss and (if possible) agree on the technical points
*** decide on priorities for different components (eg. high, medium, low) such that the final outcome is a practical road-map that would keep us busy for (at least) until the next OLS (though the "O" may change ;)
** What are the problems that the linux community can solve with the checkpoint/restart ?
** Preparing the kernel internals
*** How we implement it without affecting long term maintainability ?
*** What are the kernel subsystems, process resources and framework for CR ?
*** Which pieces to target first ?

The following technical points can be discussed during the mini-summit if we have time or later at the OLS.

** Checkpointing / Restarting
*** Reaching a quescient point - network, processes, aio, avoiding side effects of quiesce/revive
*** Checkpoint - signal handler ? syscall ? crfs ? process hierarchy, resource dependencies, system and process resources
*** Restarting - New binary format handler ? converting between formats (from older kernel to newer)
*** Notification to processes which explicitly wish to be notified about quiesce, checkpoint and restart - container state ? new signals ?
** Determining the userspace API - Posix 1003.1m ?
** Passing the kernel internal state to/from userspace - coredump like file ? swap per container ? netlinks, CR filesystem ? army of different call for the CR (proc, existing syscalls, ...)
** Hopefully we can continue to discuss in the next days and get a bit of a hackfest going during OLS :)

== Moderators ==

* Namespaces/containers: Serge Hallyn, Dave Hansen
* Cgroups and resource management: Paul Menage, Balbir Singh, Dhaval Giani
* Checkpoint/restart: Daniel Lezcano, Oren Laadan

== See also ==
* http://www.linuxsymposium.org/2008/cfp.php — OLS call for papers
* https://lists.linux-foundation.org/pipermail/containers/2008-January/009688.html
* http://openvz.org/pipermail/devel/2008-July/012891.html
* Checkpoint/Restart
** Zap : http://www.ncl.cs.columbia.edu/publications/usenix2007_fordist.pdf
** Metacluster : http://lxc.sourceforge.net/doc/ols2006/lxc-ols2006.pdf
** OpenVZ : [[Checkpointing and live migration]]
** Checkpoint/Restart technology : http://en.wikipedia.org/wiki/Application_checkpointing
** Virtual Servers and Checkpoint/Restart in Mainstream Linux : Sigops document
** Remote fork: http://www.cse.nd.edu/~dthain/courses/classconf/wowsys2004/talks/rfork.pdf
** Vmadump : http://bproc.sourceforge.net/c268.html
** Posix CR : http://techpubs.sgi.com/library/tpl/cgi-bin/getdoc.cgi/0650/bks/SGI_Admin/CPR_OG/sgi_html/ch03.html
** An OS services overview : http://sw-eng.falls-church.va.us/itsg/P08V31.htm

[Containers/Mini-summit_2008_notes]

[[Category: Containers]]
[[Category: Events]]

Containers/Mini-summit 2008

2008-07-16T19:16:09Z

Hallyn:

Containers/Mini-summit 2008

2008-07-07T21:41:58Z

Hallyn:

Containers/Mini-summit 2008

2008-04-14T20:58:43Z

Hallyn:

Containers/Mini-summit 2008

2008-04-14T19:08:38Z

Hallyn:

Containers/Mini-summit 2008

2008-04-01T15:49:56Z

Hallyn:

There will be a containers mini-summit at the [http://www.linuxsymposium.org/2008/ OLS'08]. This page is for organizing this mini-summit. Feel free to edit.

'''When''': 21st or 22nd of July 2008<br/>
'''Where''': Ottawa, ON, Canada.

== Proposal ==

The mini-summit proposal sent to OLS organizers. See [[/Proposal|proposal]].

== Topics to discuss ==

* Device accessibility cgroup (maybe with remap ability)
* TTYs
* Syslog
* Checkpoint/restart
* Memory controllers
* more?..

== List of attendees ==
Please fill in your name here if you are going to attend, or email kir at openvz dot org if you are too lazy. Surely the list is not final, so put your name even if you are not sure you can make it.

This list is in no particular order.


<div style="-moz-column-count:3; -webkit-column-count:3; column-count:3; text-align: left; background: #fefef0; border: 1px solid #ddddc0;">
# Kir Kolyshkin
# Pavel Emelyanov
# Denis Lunev
# Andrey Mirkin
# Serge Hallyn
# Dave Hansen
# Cedric Le Goater
# Daniel Lezcano
# Srivatsa Vaddagiri
# Balbir Singh
# Sukadev Bhattiprolu
# Paul Menage
# Eric W. Biederman
# Oren Laadan
# Yamamoto Takashi
# Kamezawa Hiroyuki
# Benjamin Thery
# Herbert Pötzl
# Oleg Nesterov
# Dhaval Giani
</div>

== Agenda ==

* Namespaces/Containers
** Additional needed namespaces
*** Small namespaces ''What to do with small subsystem that might need virtualization. E.g. in openvz we have FUSE, binfmt_misc and some other small stuff virtualized. But how to merge it in mainline? Create a separate namespace for each? Mere them into one? How to call this then?''
** Nature of a 'container' — kernel object or userspace fiction
** Handling of /proc and /sysfs within containers
** Handling filesystem/namespace synchronization (not sure what the issue is)
** How to enter a container
** User namespaces?
* Cgroups+Resource management
** Cgroup implementation
** Additional cgroups and their design
** libcg - userspace explotation of control groups/resource management
** Resource management
* Checkpoint/Restart
** Summary of existing c/r patchsets/designs
** How to initiate and synchronize checkpoint/restart
** (state of freezer subsystem?)
** Memory state dump
** How to dump/fetch data for resource (file, ipc) checkpoint
** How to do restart
** Hopefully we can make decisions here, and get a bit of a hackfest going during OLS

== Moderators ==

* Namespaces/containers: Serge Hallyn, Cedric Le Goater
* Cgroups and resource management: Paul Menage, Balbir Singh, Dhaval Giani
* Checkpoint/restart: Dave Hansen, Cedric Le Goater

== See also ==
* http://www.linuxsymposium.org/2008/cfp.php — OLS call for papers
* https://lists.linux-foundation.org/pipermail/containers/2008-January/009688.html

[[Category: Containers]]
[[Category: Events]]

Containers/Mini-summit 2008

2008-03-26T15:45:46Z

Hallyn:

There will be a containers mini-summit at the [http://www.linuxsymposium.org/2008/ OLS'08]. This page is for organizing this mini-summit. Feel free to edit.

'''When''': 21st or 22nd of July 2008<br/>
'''Where''': Ottawa, ON, Canada.

== Proposal ==

The mini-summit proposal sent to OLS organizers. See [[/Proposal|proposal]].

== Topics to discuss ==

* Device accessibility cgroup (maybe with remap ability)
* TTYs
* Syslog
* Checkpoint/restart
* Memory controllers
* more?..

== List of attendees ==
Please fill in your name here if you are going to attend, or email kir at openvz dot org if you are too lazy. Surely the list is not final, so put your name even if you are not sure you can make it.

This list is in no particular order.


<div style="-moz-column-count:3; -webkit-column-count:3; column-count:3; text-align: left; background: #fefef0; border: 1px solid #ddddc0;">
# Kir Kolyshkin
# Pavel Emelyanov
# Denis Lunev
# Andrey Mirkin
# Serge Hallyn
# Dave Hansen
# Cedric Le Goater
# Daniel Lezcano
# Srivatsa Vaddagiri
# Balbir Singh
# Sukadev Bhattiprolu
# Paul Menage
# Eric W. Biederman
# Oren Laadan
# Yamamoto Takashi
# Kamezawa Hiroyuki
# Benjamin Thery
# Herbert Pötzl
# Oleg Nesterov
# Dhaval Giani
</div>

== Agenda ==

* Namespaces/Containers
** Additional needed namespaces
*** Small namespaces ''What to do with small subsystem that might need virtualization. E.g. in openvz we have FUSE, binfmt_misc and some other small stuff virtualized. But how to merge it in mainline? Create a separate namespace for each? Mere them into one? How to call this then?''
** Nature of a 'container' — kernel object or userspace fiction
** Handling of /proc and /sysfs within containers
** Handling filesystem/namespace synchronization (not sure what the issue is)
** How to enter a container
** User namespaces?
* Cgroups+Resource management
** Cgroup implementation
** Additional cgroups and their design
** libcg - userspace explotation of control groups/resource management
** Resource management
* Checkpoint/Restart
** Summary of existing c/r patchsets/designs
** How to initiate and synchronize checkpoint/restart
** (state of freezer subsystem?)
** Memory state dump
** How to dump/fetch data for resource (file, ipc) checkpoint
** How to do restart

== See also ==
* http://www.linuxsymposium.org/2008/cfp.php — OLS call for papers
* https://lists.linux-foundation.org/pipermail/containers/2008-January/009688.html

[[Category: Containers]]
[[Category: Events]]

Containers/Mini-summit 2008

2008-03-17T18:21:03Z

Hallyn:

There will be a containers mini-summit at the OLS'08. This page is for organizing this mini-summit. Feel free to edit.

'''When''': 21st or 22nd of July 2008<br/>
'''Where''': Ottawa, ON, Canada.

== Proposal ==

The mini-summit proposal sent to OLS organizers. See [[{{PAGENAME}}/Proposal]].

== Topics to discuss ==

* Device accessibility cgroup (maybe with remap ability)
* TTYs
* Syslog
* Checkpoint/restart
* Memory controllers
* more?..

== List of attendees ==
Please fill in your name here if you are going to attend, or email kir at openvz dot org if you are too lazy. Surely the list is not final, so put your name even if you are not sure you can make it.

This list is in no particular order.


<div style="-moz-column-count:3; -webkit-column-count:3; column-count:3; text-align: left; background: #fefef0; border: 1px solid #ddddc0;">
# Kir Kolyshkin
# Pavel Emelyanov
# Denis Lunev
# Andrey Mirkin
# Serge Hallyn
# Dave Hansen
# Cedric Le Goater
# Daniel Lezcano
# Srivatsa Vaddagiri
# Balbir Singh
# Sukadev Bhattiprolu
# Paul Menage
# Eric W. Biederman
# Oren Laadan
# Yamamoto Takashi
# Kamezawa Hiroyuki
# Benjamin Thery
# Herbert Pötzl
# Oleg Nesterov
# Dhaval Giani
</div>

== Agenda ==

* Namespaces/Containers
* Additional needed namespaces
* Nature of a 'container' — kernel object or userspace fiction
* Handling of /proc and /sysfs within containers
* Handling filesystem/namespace synchronization (not sure what the issue is)
* How to enter a container
* User namespaces?
* Cgroups+Resource management
* Cgroup implementation
* Additional cgroups and their design
* Resource management
* Checkpoint/Restart
* Summary of existing c/r patchsets/designs
* How to initiate and synchronize checkpoint/restart
* (state of freezer subsystem?)
* Memory state dump
* How to dump/fetch data for resource (file, ipc) checkpoint
* How to do restart

== See also ==
* http://www.linuxsymposium.org/2008/cfp.php — OLS call for papers
* https://lists.linux-foundation.org/pipermail/containers/2008-January/009688.html

[[Category: Containers]]
[[Category: Events]]

Containers/Mini-summit 2008

2008-03-17T18:18:01Z

Hallyn:

There are plans to organize a containers mini-summit at the OLS'08. This page is for organizing this mini-summit. Feel free to edit.

'''When''': 21st or 22nd of July 2008<br/>
'''Where''': Ottawa, ON, Canada.

== Proposal ==

The mini-summit proposal sent to OLS organizers. See [[{{PAGENAME}}/Proposal]].

== Topics to discuss ==

* Device accessibility cgroup (maybe with remap ability)
* TTYs
* Syslog
* Checkpoint/restart
* Memory controllers
* more?..

== List of attendees ==
Please fill in your name here if you are going to attend, or email kir at openvz dot org if you are too lazy. Surely the list is not final, so put your name even if you are not sure you can make it.

This list is in no particular order.


<div style="-moz-column-count:3; -webkit-column-count:3; column-count:3; text-align: left; background: #fefef0; border: 1px solid #ddddc0;">
# Kir Kolyshkin
# Pavel Emelyanov
# Denis Lunev
# Andrey Mirkin
# Serge Hallyn
# Dave Hansen
# Cedric Le Goater
# Daniel Lezcano
# Srivatsa Vaddagiri
# Balbir Singh
# Sukadev Bhattiprolu
# Paul Menage
# Eric W. Biederman
# Oren Laadan
# Yamamoto Takashi
# Kamezawa Hiroyuki
# Benjamin Thery
# Herbert Pötzl
# Oleg Nesterov
# Dhaval Giani
</div>

== Agenda ==

* Namespaces/Containers
* Additional needed namespaces
* Nature of a 'container' — kernel object or userspace fiction
* Handling of /proc and /sysfs within containers
* Handling filesystem/namespace synchronization (not sure what the issue is)
* How to enter a container
* User namespaces?
* Cgroups+Resource management
* Cgroup implementation
* Additional cgroups and their design
* Resource management
* Checkpoint/Restart
* Summary of existing c/r patchsets/designs
* How to initiate and synchronize checkpoint/restart
* (state of freezer subsystem?)
* Memory state dump
* How to dump/fetch data for resource (file, ipc) checkpoint
* How to do restart

== See also ==
* http://www.linuxsymposium.org/2008/cfp.php — OLS call for papers
* https://lists.linux-foundation.org/pipermail/containers/2008-January/009688.html

[[Category: Containers]]
[[Category: Events]]

Containers/Mini-summit 2008/Proposal

2008-01-30T22:23:37Z

Hallyn:

Mini-summit proposal: '''Linux Kernel Containers Developer Summit'''
__NOTOC__
== Topic ==

Namespaces, containers, cgroups, and container checkpoint/restart.

== Description ==

Development for namespaces and cgroups is well underway in the
mainline kernel. To keep momentum going and keep the loosely
knit teams of developers well-coordinated, a physical meeting in
which to discuss future development plans is needed.
Additionally, we are at a point where crucial decisions about
the nature of a "container object" and about the checkpoint/restart
design need to be made.

A final set of topics will be decided upon through mailing lists
ahead of time, but potential topics include:
* Handling filesystem/namespace synchronization
* Handling of /proc and /sysfs within containers
* Additional needed namespaces (i.e. device namespace)
* Nature of a 'container' — kernel object or userspace fiction
* Cgroup implementation
* Additional cgroups and their design
* Resource management
* How to initiate and synchronize checkpoint/restart
* How to enter a 'container'

== Moderators ==

(Debating whether to: 1. switch to one moderator for each, 2. use
non-experts for moderators so the experts are more free to argue...)

* Namespaces/containers: Serge Hallyn, Cedric Le Goater
* Cgroups and resource management: Paul Menage, Balbir Singh
* Checkpoint/restart: Dave Hansen, Cedric Le Goater

== Expected Time Required ==

One day.

== Number of Attendees ==

Approximately 30.

== Technical Requirements ==

* Projector and screen
* Whiteboard
* Network access
* Power for laptops
* doughnuts and croissants for participants

Containers/Mini-summit 2008/Proposal

2008-01-30T20:33:38Z

Hallyn:

Mini-summit proposal: '''Linux Kernel Containers Developer Summit'''
__NOTOC__
== Topic ==

Namespaces, containers, cgroups, and container checkpoint/restart.

== Description ==

Development for namespaces and cgroups is well underway in the
mainline kernel. To keep momentum going and keep the loosely
knit teams of developers well-coordinated, a physical meeting in
which to discuss future development plans is needed.
Additionally, we are at a point where crucial decisions about
the nature of a "container object" and about the checkpoint/restart
design need to be made.

A final set of topics will be decided upon through mailing lists
ahead of time, but potential topics include:
* Handling filesystem/namespace synchronization
* Handling of /proc and /sysfs within containers
* Additional needed namespaces (i.e. device namespace)
* Nature of a 'container' — kernel object or userspace fiction
* Cgroup implementation
* Additional cgroups and their design
* Resource management
* How to initiate and synchronize checkpoint/restart
* How to enter a 'container'

== Moderators ==
{{Out|These are just suggestions, please edit here or let us know if you do or do not want to moderate.}}

* Namespaces/containers: Serge Hallyn, Cedric Le Goater
* Cgroups and resource management: Paul Menage, Balbir Singh
* Checkpoint/restart: Dave Hansen, Cedric Le Goater

== Expected Time Required ==

One day.

== Number of Attendees ==

Approximately 30.

== Technical Requirements ==

* Projector and screen
* Whiteboard
* Network access
* Power for laptops
* doughnuts and croissants for participants

Containers/Mini-summit 2008/Proposal

2008-01-30T18:09:19Z

Hallyn: updates reflecting mailing list discussions

Mini-summit proposal: '''Linux Kernel Containers Developer Summit'''
__NOTOC__
== Topic ==

Namespaces, containers, cgroups, and container checkpoint/restart.

== Description ==

Development for namespaces and cgroups is well underway in the
mainline kernel. To keep momentum going and keep the loosely
knit teams of developers well-coordinated, a physical meeting in
which to discuss future development plans is needed.
Additionally, we are at a point where crucial decisions about
the nature of a "container object" and about the checkpoint/restart
design need to be made.

A final set of topics will be decided upon through mailing lists
ahead of time, but potential topics include:
* Handling filesystem/namespace synchronization
* Handling of /proc and /sysfs within containers
* Additional needed namespaces (i.e. device namespace)
* Nature of a 'container' — kernel object or userspace fiction
* Cgroup implementation
* Additional cgroups and their design
* Resource management
* How to initiate and synchronize checkpoint/restart
* How to enter a 'container'

== Moderators ==
{{Out|These are just suggestions, please edit here or let us know if you do or do not want to moderate.}}

* Namespaces/containers: Serge Hallyn, Cedric Le Goater
* Cgroups and resource management: Balbir Singh, (Dhaval Giani or Paul Menage)
* Checkpoint/restart: Dave Hansen, Cedric Le Goater

== Expected Time Required ==

One day.

== Number of Attendees ==

Approximately 30.

== Technical Requirements ==

* Projector and screen
* Whiteboard
* Network access
* Power for laptops
* doughnuts and croissants for participants

Containers/Pidcache

2006-08-31T04:26:53Z

Hallyn: Reorganized by priority

'''List of kernel_thread() callers in 2.6.18-rc2. '''

{| class="wikitable" style="text-align;center"
|+ Pidcaching in drivers
|| Filename/line-num || Function || Priority || Module ? || PidCache? || Boottime ? || Comments
|-
|| linux-2.6.18-rc2/arch/mips/au1000/db1x00/mirage_ts.c:236 || ts_mirage_init() || || ? || ? || || This file is compiled under nonexistand flag. File should be removed from kernel tree?
|-
|| linux-2.6.18-rc2/drivers/s390/scsi/zfcp_erp.c:1031 || zfcp_erp_thread_setup() || || Y || ? || || Cedric working on it with the z team.
|-
|| linux-2.6.18-rc2/drivers/usb/atm/usbatm.c:1021 || usbatm_heavy_init() || || Y || ? || ||
|-
|| linux-2.6.18-rc2/drivers/usb/storage/libusual.c:135 || usu_probe() || || Y || ? || ||
|-
|| linux-2.6.18-rc2/fs/cifs/connect.c:1733 || cifs_mount() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/init/main.c:392 || __releases() || || ? || ? || || This is the init task.
|-
|| linux-2.6.18-rc2/fs/jffs/inode-v23.c:135 || jffs_fill_super() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/fs/jffs2/background.c:43 || jffs2_start_garbage_collect_thread() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/fs/nfs/delegation.c:361 || nfs_async_inode_return_delegation() || || ? || ? || || cedric working on it.
|-
|| linux-2.6.18-rc2/kernel/stop_machine.c:101 || stop_machine() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/bluetooth/bnep/core.c:578 || bnep_add_connection() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/bluetooth/cmtp/core.c:376 || cmtp_add_connection() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/bluetooth/hidp/core.c:632 || hidp_add_connection() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/bluetooth/rfcomm/core.c:2047 || rfcomm_init() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/core/pktgen.c:3260 || pktgen_create_thread() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/ipv4/ipvs/ip_vs_sync.c:826 || fork_sync_thread() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/ipv4/ipvs/ip_vs_sync.c:860 || start_sync_thread() || || ? || ? || ||
|-
|| linux-2.6.18-rc2/net/rxrpc/krxiod.c:159 || rxrpc_krxiod_init() || || ? || ? || || cedric working on it.
|-
|| linux-2.6.18-rc2/net/rxrpc/krxsecd.c:128 || rxrpc_krxsecd_init() || || ? || ? || || cedric working on it.
|-
|| linux-2.6.18-rc2/net/rxrpc/krxtimod.c:39 || rxrpc_krxtimod_start() || || ? || ? || || cedric working on it.
|-
|| linux-2.6.18-rc2/net/sunrpc/svc.c:176 || svc_create_thread() || || ? || ? || || cedric working on it. Difficult but issues were already spotted by akpm
|-
|| linux-2.6.18-rc2/drivers/macintosh/adb.c:272 || __adb_probe_task() || || Y || Y || ||
|-
|| linux-2.6.18-rc2/drivers/macintosh/therm_pm72.c:1771 || start_control_loops() || || Y || Y || || In progress, Suka
|-
|| linux-2.6.18-rc2/drivers/macintosh/therm_windtunnel.c:325 || do_attach() || || Y || Y || || (pid cached, but never referenced)
|-
|| linux-2.6.18-rc2/drivers/media/dvb/dvb-core/dvb_frontend.c:705 || dvb_frontend_start() || || Y || Y || ||
|-
|| linux-2.6.18-rc2/drivers/media/dvb/dvb-core/dvb_ca_en50221.c:1714 || dvb_ca_en50221_init() || || Y || Y || ||
|-
|| linux-2.6.18-rc2/drivers/media/video/saa7134/saa7134-tvaudio.c:1012 || saa7134_tvaudio_init2() || || Y || Y || || In progress, Suka
|-
|| linux-2.6.18-rc2/drivers/media/video/tvaudio.c:1547 || chip_attach() || || Y || Y || || In progress, Cedric
|-
|| linux-2.6.18-rc2/drivers/pci/hotplug/ibmphp_hpc.c:1086 || ibmphp_hpc_start_poll_thread() || || Y || Y || || (logged and stored in static var,
but
never used)
|-
|| linux-2.6.18-rc2/kernel/kmod.c:175 || wait_for_helper() || || N || Y || ||
|-
|| linux-2.6.18-rc2/kernel/kmod.c:205 || __call_usermodehelper() || || N || Y || ||
|-
|| linux-2.6.18-rc2/kernel/kmod.c:208 || __call_usermodehelper() || || N || Y || ||
|-
|| linux-2.6.18-rc2/arch/i386/mach-voyager/voyager_thread.c:47 || voyager_thread_start() || || Y || N || ||
|-
|| linux-2.6.18-rc2/arch/ia64/sn/kernel/xpc_main.c:584 || xpc_activate_partition() || || Y || N || ||
|-
|| linux-2.6.18-rc2/arch/ia64/sn/kernel/xpc_main.c:846 || xpc_create_kthreads() || || Y || N || ||
|-
|| linux-2.6.18-rc2/arch/ia64/sn/kernel/xpc_main.c:1345 || xpc_init() || || Y || N || ||
|-
|| linux-2.6.18-rc2/arch/ia64/sn/kernel/xpc_main.c:1374 || xpc_init() || || Y || N || ||
|-
|| linux-2.6.18-rc2/arch/s390/mm/cmm.c:164 || cmm_start_thread() || || Y || N || || Sent off - serge
|-
|| linux-2.6.18-rc2/drivers/macintosh/mediabay.c:702 || media_bay_attach() || || Y || N || ||

|-
|| linux-2.6.18-rc2/drivers/mtd/mtd_blkdevs.c:405 || register_mtd_blktrans() || || Y || N || ||
|-
|| linux-2.6.18-rc2/drivers/pci/hotplug/cpci_hotplug_core.c:603 || cpci_start_thread() || || Y || N || || (only printed in dbg())
|-
|| linux-2.6.18-rc2/drivers/pci/hotplug/cpci_hotplug_core.c:605 || cpci_start_thread() || || Y || N || || (pid only logged)
|-
|| linux-2.6.18-rc2/drivers/pci/hotplug/cpqphp_ctrl.c:1781 || cpqhp_event_start_thread() || || Y || N || || (pid only logged)
|-
|| linux-2.6.18-rc2/drivers/pci/hotplug/pciehp_ctrl.c:554 || pciehp_event_start_thread() || || Y || N || ||
|-
|| linux-2.6.18-rc2/drivers/pnp/pnpbios/core.c:582 || pnpbios_thread_init() || || Y || N || ||
|-
|| linux-2.6.18-rc2/drivers/s390/net/lcs.c:1732 || lcs_start_kernel_thread() || || Y || N || || Sent off - serge
|-
|| linux-2.6.18-rc2/drivers/s390/net/lcs.c:1735 || lcs_start_kernel_thread() || || Y || N || || Sent off - serge
|-
|| linux-2.6.18-rc2/drivers/s390/net/qeth_main.c:1051 || qeth_start_kernel_thread() || || Y || N || || Sent off - serge
|-
|| linux-2.6.18-rc2/drivers/s390/net/qeth_main.c:1053 || qeth_start_kernel_thread() || || Y || N || || Sent off - serge
|-
|| linux-2.6.18-rc2/drivers/s390/net/qeth_main.c:1055 || qeth_start_kernel_thread() || || Y || N || || Sent off - serge
|-
|| linux-2.6.18-rc2/drivers/media/dvb/ttpci/av7110.c:2621 || av7110_attach() || || Y || N || ||
|-
|| linux-2.6.18-rc2/drivers/mmc/mmc_queue.c:161 || mmc_init_queue() || || Y || N || ||
|-
|| linux-2.6.18-rc2/fs/afs/cmservice.c:300 || afscm_start() || || Y || N || ||
|-
|| linux-2.6.18-rc2/fs/afs/kafsasyncd.c:60 || afs_kafsasyncd_start() || || Y || N || ||
|-
|| linux-2.6.18-rc2/fs/afs/kafstimod.c:40 || afs_kafstimod_start() || || Y || N || ||
|-
|| linux-2.6.18-rc2/fs/lockd/clntlock.c:186 || nlmclnt_recovery() || || Y || N || || sent - cedric
|-
|| linux-2.6.18-rc2/arch/arm/kernel/ecard.c:1062 || ecard_init() || || N || N || || Not needed
|-
|| linux-2.6.18-rc2/arch/i386/kernel/io_apic.c:640 || balanced_irq_init() || || N || N || || Not needed
|-
|| linux-2.6.18-rc2/arch/parisc/kernel/process.c:168 || NA || || N || N || || This is the definition, not a use, of kernel_thread.
|-
|| linux-2.6.18-rc2/arch/powerpc/platforms/pseries/eeh_event.c:108 || eeh_thread_launcher() || || N || N || ||
|-
|| linux-2.6.18-rc2/arch/powerpc/platforms/pseries/rtasd.c:500 || rtas_init() || || N || N || ||
|-
|| linux-2.6.18-rc2/arch/sparc64/kernel/power.c:132 || power_probe() || || N || N || ||
|-
|| linux-2.6.18-rc2/init/do_mounts_initrd.c:59 || handle_initrd() || || N || N || || doesn't cache, but does a wait4 on the pid.
|-
|| linux-2.6.18-rc2/kernel/kthread.c:120 || keventd_create_kthread() || || N || N || || This is the definition of kthread.
|-
|| linux-2.6.18-rc2/drivers/base/firmware_class.c:569 || power_probe() || || Y || ? || || Done Suka, 2.6.18, http://lkml.org/lkml/2006/7/26/307
|-
|| linux-2.6.18-rc2/drivers/block/loop.c:840 || loop_set_fd() || || Y || ? || || Done, Serge 2.6.18
|-
|| linux-2.6.18-rc2/drivers/ieee1394/nodemgr.c:429 || fw_set_rescan() || || Y || ? || || Done, Stefan Ricter, 2.6.18, http://lkml.org/lkml/2006/7/
2/135
|-
|| linux-2.6.18-rc2/drivers/ieee1394/nodemgr.c:1779 || nodemgr_add_host() || || Y || ? || || Done, Stefan Ricter, 2.6.18, http://lkml.org/lkml/20
06/7/2/135
|-
|| linux-2.6.18-rc2/drivers/net/wireless/airo.c:2815 || _init_airo_card() || || Y || ? || || Done, Suka, 2.6.18, http://lkml.org/lkml/2006/7/24/16
3
|-
|| linux-2.6.18-rc2/arch/arm/kernel/apm.c:525 || apm_init() || || Y || Y || || In -mm.
|-
|| linux-2.6.18-rc2/arch/mips/kernel/apm.c:525 || apm_init() || || Y || Y || || In -mm.
|-
|| linux-2.6.18-rc2/arch/i386/kernel/apm.c:2339 || apm_init() || || Y || N || || In -mm.
|-
|}