Difference between revisions of "OpenZFS Developer Summit 2015"
(33 intermediate revisions by 5 users not shown) | |||
Line 1: | Line 1: | ||
[[Category:Events|201510]] | |||
{|cellpadding="20" | {|cellpadding="20" | ||
|- | |- | ||
|valign="top" |[[file:2015_ozds_event_page_v5.png|250px]] | |valign="top" |[[file:2015_ozds_event_page_v5.png|250px]] | ||
|valign="top" |The third annual OpenZFS Developer Summit | |valign="top" |The third annual OpenZFS Developer Summit was held in San Francisco, October 19 - 20, 2015. This was the 10th anniversary of the open sourcing of ZFS! All OpenZFS developers were invited to participate. | ||
<br> | <br> | ||
The goal of the event | The goal of the event was to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consisted of 1 day of presentation (Oct 19) and a 1 day hackathon (Oct 20). | ||
|} | |} | ||
The event was streamed live, and you can find all videos and presentations below. | |||
{| | == Event == | ||
|- | === Photos === | ||
|[[ | Photos of the event can be viewed on the [https://plus.google.com/photos/107465241361512478015/albums/6208527265028401729?sort=1 OpenZFS Google+ page]. | ||
|[[ | |||
|[[ | === Presentations === | ||
|[[ | You can view the videos individually using the links below or watch the sequential [https://www.youtube.com/playlist?list=PLaUVvul17xSedlXipesHxfzDm74lXj0ab presentation playlist]. | ||
{| class="wikitable" | |||
|- | |||
!Title!!Speaker!!Company!!Slides!!Video | |||
|- | |||
|Keynote||Matt Ahrens||[http://www.delphix.com/ Delphix]||[https://drive.google.com/file/d/0B4BF1vnv6p0-R0NQdE1EaFJLeVE/view?usp=sharing Slides]||[https://youtu.be/aV276yUfgK4 Video] | |||
|- | |||
|OpenZFS Success Stories||Tarkan Maner||[http://nexenta.com/ Nexenta]|| [https://drive.google.com/file/d/0B4BF1vnv6p0-MHpXTGkyZDBlamc/view?usp=sharing Slides]||[https://youtu.be/PWS1TR8X4Fo Video] | |||
|- | |||
|ZFS Internals Overview||Kirk McKusick||[http://www.mckusick.com Independent]|| [https://drive.google.com/file/d/0B4BF1vnv6p0-MmlYN2VIR2lEVXc/view?usp=sharing Slides]||[https://youtu.be/IQp_FglfzUQ Video] | |||
|- | |||
|ZFS Send and Receive||Paul Dagnelie||[http://www.delphix.com/ Delphix]||rowspan="2"|[https://drive.google.com/file/d/0B4BF1vnv6p0-cHZEeEJaZmNpZVE/view?usp=sharing Slides]||rowspan="2"|[https://youtu.be/LaNgoAZeTww Video] | |||
|- | |||
|Compressed Send and Receive||Dan Kimmel||[http://www.delphix.com/ Delphix] | |||
|- | |||
|Live Migration with Zmotion||Francois Lesage||[http://www.ovh.com/ OVH]||[https://drive.google.com/file/d/0B4BF1vnv6p0-MEpCRTAyTk1PUXc/view?usp=sharing Slides]||[https://youtu.be/mURQFCuvGtk Video] | |||
|- | |||
|The Birth of ZFS||Jeff Bonwick||[http://dssd.com/ DSSD], [http://www.emc.com/ EMC]||None||[https://youtu.be/dcV2PaMTAJ4 Video] | |||
|- | |||
|Parity Declustered RAID-Z/Mirror||Isaac Huang||[http://www.intel.com/content/www/us/en/homepage.html Intel]|| [https://drive.google.com/file/d/0B4BF1vnv6p0-bGVrQXg3dmY1Uzg/view?usp=sharing Slides]||[https://youtu.be/MxKohtFSB4M Video] | |||
|- | |||
|Improve Performance on AWS with Eager Zero||Joe Stein||[http://www.delphix.com/ Delphix]||[https://drive.google.com/file/d/0B4BF1vnv6p0-T21WN0N2N0pCY0E/view?usp=sharing Slides]||[https://youtu.be/oVh6l4BTntw Video] | |||
|- | |||
|Compressed ARC||George Wilson||[http://www.delphix.com/ Delphix]||[https://drive.google.com/file/d/0B5hUzsxe4cdmbEh2eEZDbjY3LXM/view?usp=sharing Slides]||[https://youtu.be/zWcgccpVRfA Video] | |||
|- | |||
|Discontiguous Caching with ABD||David Chen||[http://www.osnexus.com/ OSNexus]||[https://drive.google.com/file/d/0B4BF1vnv6p0-UHpOQ3lwQlhvUkk/view?usp=sharing Slides]||[https://youtu.be/jTZ3SL9XV0o Video] | |||
|- | |||
|Persistent L2ARC||Saso Kiselkov||[http://nexenta.com/ Nexenta]||rowspan="2"|[https://drive.google.com/file/d/0B4BF1vnv6p0-RnBoQXc3MVdLRGM/view?usp=sharing Slides]||rowspan="2"|[https://youtu.be/kt91t4sBWi8 Video] | |||
|- | |||
|Dedup Ceiling||Saso Kiselkov||[http://nexenta.com/ Nexenta] | |||
|- | |||
|[[Writeback Cache]]||Alex Aizman||[http://nexenta.com/ Nexenta]||[https://drive.google.com/file/d/0B4BF1vnv6p0-MjJCcmViY2trY1E/view?usp=sharing Slides]||[https://youtu.be/MkdrnG7GwdE Video] | |||
|- | |||
|Sandboxing OpenZFS on Linux||Albert Lee||[http://omniti.com/ OmniTI]||[https://drive.google.com/file/d/0B4BF1vnv6p0-SzBObm9EWkNRMG8/view?usp=sharing Slides]||[https://youtu.be/okF7D6lr2BI Video] | |||
|- | |||
|SPA Metadata Allocation Classes||Don Brady||[http://www.intel.com/content/www/us/en/homepage.html Intel]||[https://drive.google.com/file/d/0B4BF1vnv6p0-bkZ1YTJFamxnSmM/view?usp=sharing Slides]||rowspan="2"|[https://youtu.be/28fKiTWb2oM Video] | |||
|- | |||
|Ztour||Don Brady||[http://www.intel.com/content/www/us/en/homepage.html Intel]||[https://drive.google.com/file/d/0B4BF1vnv6p0-T3VESzBjRXdGSU0/view?usp=sharing Slides] | |||
|- | |- | ||
| | |Closing - Story time with Matt & Jeff||Matt Ahrens & Jeff Bonwick||-||None||[https://youtu.be/yNKZQBsTX08 Video] | ||
| | |||
| | |||
|- | |- | ||
|Day 2 Hackathon Presentations & Awards||Hackathon Participants||-||None||[https://youtu.be/vKiJzj-vRYM Video] | |||
|} | |} | ||
== Projects started at the hackathon == | |||
== | ==== Discussion / Design sessions ==== | ||
* vdev/metaslab classes / dedicated metadata devices (don brady) | |||
* upstream to openzfs (prakash) | |||
* make zfs recv (& ZPL & ZAP) less trusting -> no, just sign the stream (bryan, Alex Wilson) | |||
* | ==== Hacks ==== | ||
* | * vdev/metaslab classes / dedicated metadata devices (don brady) | ||
* | * ZFS Kernel APIs (platform independent) - worked on atomic.h (paul) | ||
* building illumos more easily on OmniOS (dan mcdonald) | |||
* python test suite on linux/illumos (john kennedy, Allen Petersen allen.petersen@osnexus.com ) | |||
* lz4hc (dan kimmel) | |||
* zfs api (alan jude) | |||
* upstream unmap/trim to illumos (saso) | |||
* pool-wide snapshot (george wilson) | |||
* channel programs (chris williamson) | |||
* (alexander K) | |||
* openzfs repo pull requests 9x (richard yao) | |||
* space map repair (making zdb write is hard -> zhack) (albert lee) | |||
* store vdev class info in per-vdev zaps (port per-vdev zap to illumos) (pavel & prashanth) | |||
* using kitchen to run illumos tests (eric) | |||
* mdb walkers (rob m) | |||
== | <!-- | ||
==== Medium-size hackathon projects ==== | |||
* zfs clone --nopromote (Dan K) | |||
* store total # blocks on disk (of each type, in each ds, etc) (George W) | |||
* use refcount_t for v_count (fileystem-ey but not ZFS) | |||
* embedded slog (George W) | |||
* on-disk map from dataset GUID -> set of object IDs | |||
* Simplify dbuf_free_range by removing dn_unlisted_l0_blkid (perf testing) | |||
* scrub specific dataset | |||
* channel programs! (Alvin) | |||
* add LZ4HC compression | |||
* allow receive of -L / -e / -c streams on systems with the required feature flags disabled | |||
* allow spacemap to represent larger range with one entry (increase entry size) | |||
== | ==== Simpler hackathon projects ==== | ||
= | * break zfs/zpool manpages into one page per subcommand | ||
* zfs send —current-format | |||
* “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr)) | |||
* expose send size estimation from bookmarks through sbin/zfs | |||
* we should not attempt to write to ZFS while panicking (illumos-specific) | |||
* more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t | |||
* ::spa -h should show free space histogram for whole pool | |||
* metaslab size can exceed offset addressable by spacemap | |||
==== Backlog ideas ==== | |||
* error counts in per-vdev object | |||
* scrub on readonly pool (on top of sorted scrub code?) | |||
* “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart | |||
* preferred allocation alignment (george) | |||
* promote prefetch reads to sync reads | |||
* runtime lock analyzer (like freebsd WITNESS) | |||
* test suite for system attributes | |||
* show clone-origin relationships with zfs list --graph | |||
* feature flags support for disabling inactive features | |||
* ZFS should prefer gethrtime() to ddi_get_lbolt() | |||
* create vdev in syncing context (with sync task) | |||
* Add interface for creating file with specific recordsize | |||
* does ::abuf_find still work? | |||
* make spa_load_impl() always use config from the MOS (except for finding devices) | |||
** also spa_unload() would have to be made more airtight | |||
* JSON command output | |||
* zfs help command | |||
* zfs set print usage message specific to property you're trying to set | |||
* make zfs recv less trusting | |||
* convert some AVL trees to b-trees or hash tables | |||
* cross platform xattr | |||
--> | |||
== A huge THANK YOU to the sponsors of the 2015 OpenZFS Developer Summit: == | |||
Read all about what our sponsors enabled us to bring to our audience this year on the [http://blog.delphix.com/anastasiya/2015/10/22/thanks-to-the-sponsors-of-the-2015-openzfs-developer-summit/ Delphix blog]! | |||
==== <u>Beer Bash</u> ==== | ==== <u>Beer Bash</u> ==== | ||
{|cellpadding="10" | {|cellpadding="10" | ||
Line 77: | Line 159: | ||
|[[File: RGB_iXsystems_Logo_2015_OnLight_M.png|150x150px|link=http://www.ixsystems.com/]] | |[[File: RGB_iXsystems_Logo_2015_OnLight_M.png|150x150px|link=http://www.ixsystems.com/]] | ||
|[[File: syneto-logo-Sept14.svg|150x150px|link=http://syneto.net/]] | |[[File: syneto-logo-Sept14.svg|150x150px|link=http://syneto.net/]] | ||
|- | |- | ||
|} | |} | ||
Line 93: | Line 174: | ||
==== <u>Bronze</u> ==== | ==== <u>Bronze</u> ==== | ||
{|cellpadding="10" | |||
|- | |||
|[[File: OVH-baseline-bichro-H256.png|200x200px|link=http://www.ovh.com]] | |||
|- | |||
|} | |||
<strong>Special thanks</strong>: | |||
* Hackathon prizes - Thank you [http://www.nexenta.com/ Nexenta]! | * Hackathon prizes - Thank you [http://www.nexenta.com/ Nexenta]! | ||
* Conference branding, t-shirt and banner design - Thank you Aaron Holding! | * Conference branding, t-shirt and banner design - Thank you Aaron Holding! | ||
* Design and | * Design and creation of conference badges - Thank you [http://syneto.eu/ Syneto]! | ||
== Harassment Policy == | == Harassment Policy == | ||
OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers. | OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers. | ||
''For information about last year's event, see the [[OpenZFS Developer Summit 2014]] page.'' | ''For information about last year's event, see the [[OpenZFS Developer Summit 2014]] page.'' |
Latest revision as of 07:46, 3 October 2018
The event was streamed live, and you can find all videos and presentations below.
Event
Photos
Photos of the event can be viewed on the OpenZFS Google+ page.
Presentations
You can view the videos individually using the links below or watch the sequential presentation playlist.
Title | Speaker | Company | Slides | Video |
---|---|---|---|---|
Keynote | Matt Ahrens | Delphix | Slides | Video |
OpenZFS Success Stories | Tarkan Maner | Nexenta | Slides | Video |
ZFS Internals Overview | Kirk McKusick | Independent | Slides | Video |
ZFS Send and Receive | Paul Dagnelie | Delphix | Slides | Video |
Compressed Send and Receive | Dan Kimmel | Delphix | ||
Live Migration with Zmotion | Francois Lesage | OVH | Slides | Video |
The Birth of ZFS | Jeff Bonwick | DSSD, EMC | None | Video |
Parity Declustered RAID-Z/Mirror | Isaac Huang | Intel | Slides | Video |
Improve Performance on AWS with Eager Zero | Joe Stein | Delphix | Slides | Video |
Compressed ARC | George Wilson | Delphix | Slides | Video |
Discontiguous Caching with ABD | David Chen | OSNexus | Slides | Video |
Persistent L2ARC | Saso Kiselkov | Nexenta | Slides | Video |
Dedup Ceiling | Saso Kiselkov | Nexenta | ||
Writeback Cache | Alex Aizman | Nexenta | Slides | Video |
Sandboxing OpenZFS on Linux | Albert Lee | OmniTI | Slides | Video |
SPA Metadata Allocation Classes | Don Brady | Intel | Slides | Video |
Ztour | Don Brady | Intel | Slides | |
Closing - Story time with Matt & Jeff | Matt Ahrens & Jeff Bonwick | - | None | Video |
Day 2 Hackathon Presentations & Awards | Hackathon Participants | - | None | Video |
Projects started at the hackathon
Discussion / Design sessions
- vdev/metaslab classes / dedicated metadata devices (don brady)
- upstream to openzfs (prakash)
- make zfs recv (& ZPL & ZAP) less trusting -> no, just sign the stream (bryan, Alex Wilson)
Hacks
- vdev/metaslab classes / dedicated metadata devices (don brady)
- ZFS Kernel APIs (platform independent) - worked on atomic.h (paul)
- building illumos more easily on OmniOS (dan mcdonald)
- python test suite on linux/illumos (john kennedy, Allen Petersen allen.petersen@osnexus.com )
- lz4hc (dan kimmel)
- zfs api (alan jude)
- upstream unmap/trim to illumos (saso)
- pool-wide snapshot (george wilson)
- channel programs (chris williamson)
- (alexander K)
- openzfs repo pull requests 9x (richard yao)
- space map repair (making zdb write is hard -> zhack) (albert lee)
- store vdev class info in per-vdev zaps (port per-vdev zap to illumos) (pavel & prashanth)
- using kitchen to run illumos tests (eric)
- mdb walkers (rob m)
A huge THANK YOU to the sponsors of the 2015 OpenZFS Developer Summit:
Read all about what our sponsors enabled us to bring to our audience this year on the Delphix blog!
Beer Bash
Platinum
Gold
Silver
Bronze
Special thanks:
- Hackathon prizes - Thank you Nexenta!
- Conference branding, t-shirt and banner design - Thank you Aaron Holding!
- Design and creation of conference badges - Thank you Syneto!
Harassment Policy
OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.
For information about last year's event, see the OpenZFS Developer Summit 2014 page.