Difference between revisions of "OpenZFS Developer Summit 2015"

From OpenZFS
Jump to navigation Jump to search
(→‎Event Logistics: Added CCM Info)
 
(48 intermediate revisions by 5 users not shown)
Line 1: Line 1:
[[Category:Events|201510]]
{|cellpadding="20"
{|cellpadding="20"
|-
|-
|valign="top" |[[file:2015_ozds_event_page_v5.png|250px]]
|valign="top" |[[file:2015_ozds_event_page_v5.png|250px]]
|valign="top" |The third annual OpenZFS Developer Summit will be held in San Francisco, October 19 - 20, 2015.  This will be the 10th anniversary of the open sourcing of ZFS!  All OpenZFS developers are invited to participate.
|valign="top" |The third annual OpenZFS Developer Summit was held in San Francisco, October 19 - 20, 2015.  This was the 10th anniversary of the open sourcing of ZFS!  All OpenZFS developers were invited to participate.
<br>
<br>
The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event will consist of 1 day of presentation (Oct 19) and a 1 day hackathon (Oct 20).
The goal of the event was to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consisted of 1 day of presentation (Oct 19) and a 1 day hackathon (Oct 20).
<br><br>
Details about registration, proposing presentations, deadlines, and sponsorship opportunities are provided on this page.
|}
|}


Thanks to the 2015 Beer Bash and Platinum sponsors for their support!
The event was streamed live, and you can find all videos and presentations below.


{|cellpadding="10"
== Event ==
|-  
=== Photos ===
|[[File: Delphix logo.png|150x150px|link=http://delphix.com]]
Photos of the event can be viewed on the [https://plus.google.com/photos/107465241361512478015/albums/6208527265028401729?sort=1 OpenZFS Google+ page].
|[[File: GitHub_Logo.png|150x150px|link=http://github.com]]
 
|[[File: ClusterHQ-logo 1A---FC-w-strap-black-1360x568.png|150x150px|link=https://clusterhq.com/]]
=== Presentations ===
|[[File: New_hac_logo.jpg|150x150px|link=http://www.high-availability.com/]]
You can view the videos individually using the links below or watch the sequential [https://www.youtube.com/playlist?list=PLaUVvul17xSedlXipesHxfzDm74lXj0ab presentation playlist].
{| class="wikitable"
|-
!Title!!Speaker!!Company!!Slides!!Video
|-
|Keynote||Matt Ahrens||[http://www.delphix.com/ Delphix]||[https://drive.google.com/file/d/0B4BF1vnv6p0-R0NQdE1EaFJLeVE/view?usp=sharing Slides]||[https://youtu.be/aV276yUfgK4 Video]
|-
|OpenZFS Success Stories||Tarkan Maner||[http://nexenta.com/ Nexenta]|| [https://drive.google.com/file/d/0B4BF1vnv6p0-MHpXTGkyZDBlamc/view?usp=sharing Slides]||[https://youtu.be/PWS1TR8X4Fo Video]
|-
|ZFS Internals Overview||Kirk McKusick||[http://www.mckusick.com Independent]|| [https://drive.google.com/file/d/0B4BF1vnv6p0-MmlYN2VIR2lEVXc/view?usp=sharing Slides]||[https://youtu.be/IQp_FglfzUQ Video]
|-
|ZFS Send and Receive||Paul Dagnelie||[http://www.delphix.com/ Delphix]||rowspan="2"|[https://drive.google.com/file/d/0B4BF1vnv6p0-cHZEeEJaZmNpZVE/view?usp=sharing Slides]||rowspan="2"|[https://youtu.be/LaNgoAZeTww Video]
|-
|Compressed Send and Receive||Dan Kimmel||[http://www.delphix.com/ Delphix]
|-
|Live Migration with Zmotion||Francois Lesage||[http://www.ovh.com/ OVH]||[https://drive.google.com/file/d/0B4BF1vnv6p0-MEpCRTAyTk1PUXc/view?usp=sharing Slides]||[https://youtu.be/mURQFCuvGtk Video]
|-
|The Birth of ZFS||Jeff Bonwick||[http://dssd.com/ DSSD], [http://www.emc.com/ EMC]||None||[https://youtu.be/dcV2PaMTAJ4 Video]
|-
|Parity Declustered RAID-Z/Mirror||Isaac Huang||[http://www.intel.com/content/www/us/en/homepage.html Intel]|| [https://drive.google.com/file/d/0B4BF1vnv6p0-bGVrQXg3dmY1Uzg/view?usp=sharing Slides]||[https://youtu.be/MxKohtFSB4M Video]
|-
|Improve Performance on AWS with Eager Zero||Joe Stein||[http://www.delphix.com/ Delphix]||[https://drive.google.com/file/d/0B4BF1vnv6p0-T21WN0N2N0pCY0E/view?usp=sharing Slides]||[https://youtu.be/oVh6l4BTntw Video]
|-
|Compressed ARC||George Wilson||[http://www.delphix.com/ Delphix]||[https://drive.google.com/file/d/0B5hUzsxe4cdmbEh2eEZDbjY3LXM/view?usp=sharing Slides]||[https://youtu.be/zWcgccpVRfA Video]
|-
|Discontiguous Caching with ABD||David Chen||[http://www.osnexus.com/ OSNexus]||[https://drive.google.com/file/d/0B4BF1vnv6p0-UHpOQ3lwQlhvUkk/view?usp=sharing Slides]||[https://youtu.be/jTZ3SL9XV0o Video]
|-
|Persistent L2ARC||Saso Kiselkov||[http://nexenta.com/ Nexenta]||rowspan="2"|[https://drive.google.com/file/d/0B4BF1vnv6p0-RnBoQXc3MVdLRGM/view?usp=sharing Slides]||rowspan="2"|[https://youtu.be/kt91t4sBWi8 Video]
|-
|Dedup Ceiling||Saso Kiselkov||[http://nexenta.com/ Nexenta]
|-
|[[Writeback Cache]]||Alex Aizman||[http://nexenta.com/ Nexenta]||[https://drive.google.com/file/d/0B4BF1vnv6p0-MjJCcmViY2trY1E/view?usp=sharing Slides]||[https://youtu.be/MkdrnG7GwdE Video]
|-
|Sandboxing OpenZFS on Linux||Albert Lee||[http://omniti.com/ OmniTI]||[https://drive.google.com/file/d/0B4BF1vnv6p0-SzBObm9EWkNRMG8/view?usp=sharing Slides]||[https://youtu.be/okF7D6lr2BI Video]
|-
|SPA Metadata Allocation Classes||Don Brady||[http://www.intel.com/content/www/us/en/homepage.html Intel]||[https://drive.google.com/file/d/0B4BF1vnv6p0-bkZ1YTJFamxnSmM/view?usp=sharing Slides]||rowspan="2"|[https://youtu.be/28fKiTWb2oM Video]
|-
|Ztour||Don Brady||[http://www.intel.com/content/www/us/en/homepage.html Intel]||[https://drive.google.com/file/d/0B4BF1vnv6p0-T3VESzBjRXdGSU0/view?usp=sharing Slides]
|-
|-
|[[File: Nexenta-GL-logo-tagline.jpg|150x150px|link=http://nexenta.com/]]
|Closing - Story time with Matt & Jeff||Matt Ahrens & Jeff Bonwick||-||None||[https://youtu.be/yNKZQBsTX08 Video]
|[[File: OsNexus.png|150x150px|link=http://www.osnexus.com/]]
|[[File: OmniTI-logo.jpeg|150x150px|link=http://omniti.com/]]
|-
|-
|Day 2 Hackathon Presentations & Awards||Hackathon Participants||-||None||[https://youtu.be/vKiJzj-vRYM Video]
|}
|}


== Projects started at the hackathon ==


== Registration ==
==== Discussion / Design sessions ====
Registration for the 2015 Summit is now open! Please register on [http://www.eventbrite.com/e/2015-openzfs-developer-summit-tickets-17450402624 Eventbrite].
* vdev/metaslab classes / dedicated metadata devices (don brady)
 
* upstream to openzfs (prakash)
* There will be no registration deadline - the registration will remain open until capacity is reached.
* make zfs recv (& ZPL & ZAP) less trusting -> no, just sign the stream (bryan, Alex Wilson)
* Please register by '''Sept 25, 2015''' to ensure you get a t-shirt in your size.
* Registration is $50 per attendee. If your company is a sponsor (as listed below), you may be eligible for a free registration. Please contact admin at open-zfs dot org if that is the case.  Speakers will also receive free registration.


All attendees are expected to contribute/participate. Your ideas and questions are what make the event exciting!
==== Hacks ====
* vdev/metaslab classes / dedicated metadata devices (don brady)
* ZFS Kernel APIs (platform independent) - worked on atomic.h (paul)
* building illumos more easily on OmniOS (dan mcdonald)
* python test suite on linux/illumos (john kennedy, Allen Petersen allen.petersen@osnexus.com )
* lz4hc (dan kimmel)
* zfs api (alan jude)
* upstream unmap/trim to illumos (saso)
* pool-wide snapshot (george wilson)
* channel programs (chris williamson)
* (alexander K)
* openzfs repo pull requests 9x (richard yao)
* space map repair (making zdb write is hard -> zhack) (albert lee)
* store vdev class info in per-vdev zaps (port per-vdev zap to illumos) (pavel & prashanth)
* using kitchen to run illumos tests (eric)
* mdb walkers (rob m)


== Conference presentations ==
The proposal submission deadline has passed.


Matt will review all of the submissions and select talks that will be most interesting for the audience. We will notify the submitters about the result, and the presentation details will be posted on the site.  The registration fee will be waived for speakers.
<!--
==== Medium-size hackathon projects ====
* zfs clone --nopromote (Dan K)
* store total # blocks on disk (of each type, in each ds, etc) (George W)
* use refcount_t for v_count (fileystem-ey but not ZFS)
* embedded slog (George W)
* on-disk map from dataset GUID -> set of object IDs
* Simplify dbuf_free_range by removing dn_unlisted_l0_blkid (perf testing)
* scrub specific dataset
* channel programs! (Alvin)
* add LZ4HC compression
* allow receive of -L / -e / -c streams on systems with the required feature flags disabled
* allow spacemap to represent larger range with one entry (increase entry size)


== Event deadlines ==
==== Simpler hackathon projects ====
{|border="0"  cellpadding="2"
* break zfs/zpool manpages into one page per subcommand
|-
* zfs send —current-format
|valign="top"|Aug 31, 2015
* “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr))
| All abstract/proposals submitted to admin at open-zfs dot org
* expose send size estimation from bookmarks through sbin/zfs
|-
* we should not attempt to write to ZFS while panicking (illumos-specific)
|valign="top"|Sept 14, 2015
* more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
| Matt will notify all submitters about the disposition of their proposal
* ::spa -h should show free space histogram for whole pool
|-
* metaslab size can exceed offset addressable by spacemap
|valign="top"|Sept 25, 2015
| Register by this date to ensure you get a t-shirt in your size
|-
|valign="top"|Oct 12, 2015
| Agenda finalized
|-
|valign="top"|Oct 19 - 20, 2015
| OpenZFS Developer Summit
|}


== Sponsorship ==
==== Backlog ideas ====
=== Committed sponsors ===
* error counts in per-vdev object
 
* scrub on readonly pool (on top of sorted scrub code?)
Thanks to our sponsors who have already committed to sponsoring the 2015 event:
* “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
* preferred allocation alignment (george)
* promote prefetch reads to sync reads
* runtime lock analyzer (like freebsd WITNESS)
* test suite for system attributes
* show clone-origin relationships with zfs list --graph
* feature flags support for disabling inactive features
* ZFS should prefer gethrtime() to ddi_get_lbolt()
* create vdev in syncing context (with sync task)
* Add interface for creating file with specific recordsize
* does ::abuf_find still work?
* make spa_load_impl() always use config from the MOS (except for finding devices)
** also spa_unload() would have to be made more airtight
* JSON command output
* zfs help command
* zfs set print usage message specific to property you're trying to set
* make zfs recv less trusting
* convert some AVL trees to b-trees or hash tables
* cross platform xattr
-->


== A huge THANK YOU to the sponsors of the 2015 OpenZFS Developer Summit: ==
Read all about what our sponsors enabled us to bring to our audience this year on the [http://blog.delphix.com/anastasiya/2015/10/22/thanks-to-the-sponsors-of-the-2015-openzfs-developer-summit/ Delphix blog]!
==== <u>Beer Bash</u> ====
==== <u>Beer Bash</u> ====
{|cellpadding="10"
{|cellpadding="10"
Line 88: Line 159:
|[[File: RGB_iXsystems_Logo_2015_OnLight_M.png|150x150px|link=http://www.ixsystems.com/]]
|[[File: RGB_iXsystems_Logo_2015_OnLight_M.png|150x150px|link=http://www.ixsystems.com/]]
|[[File: syneto-logo-Sept14.svg|150x150px|link=http://syneto.net/]]
|[[File: syneto-logo-Sept14.svg|150x150px|link=http://syneto.net/]]
|[[File: Intel.png|100x100px|link=http://www.intel.com/]]
|-
|-
|}
|}
Line 104: Line 174:
==== <u>Bronze</u> ====
==== <u>Bronze</u> ====


This can be you!
{|cellpadding="10"
|-
|[[File: OVH-baseline-bichro-H256.png|200x200px|link=http://www.ovh.com]]
|-
|}


=== Sponsorship opportunities and benefits ===
<strong>Special thanks</strong>:
 
The full details of the monetary sponsorship options and the associated rewards can be viewed [http://open-zfs.org/w/images/f/f5/Sponsorship_Options_-_OpenZFS_Dev_Summit_2015.pdf in the sponsorship plan].
 
All of our sponsors have an opportunity to be known as a OpenZFS supporter in a very talented and influential community.
 
Please send email to admin at open-zfs dot org if you would like to sponsor the event.
 
==== Other ways to sponsor ====
 
If you are interested in supporting the event through non-monetary means, we would be happy to match the sponsorship packages to the effort.
 
* Video record and stream the presentations
* Photograph the event
* Help with setup/administrative tasks related to the conference
 
Thanks to our generous sponsors for their help:


* Hackathon prizes - Thank you [http://www.nexenta.com/ Nexenta]!
* Hackathon prizes - Thank you [http://www.nexenta.com/ Nexenta]!
* Conference branding, t-shirt and banner design - Thank you Aaron Holding!
* Conference branding, t-shirt and banner design - Thank you Aaron Holding!
* Design and create conference badges - Thank you [http://syneto.eu/ Syneto]!
* Design and creation of conference badges - Thank you [http://syneto.eu/ Syneto]!
 
== Hackathon ==
The goals of the hackathon are:
* to get people working with ZFS engineers from outside their normal circles
* to start work on some of the [[projects]] we'd like to accomplish
Therefore, we should plan to work in small teams of 2-3 engineers.  The team members could be pair-programming, splitting up the work into discrete tasks for each person, or advising / implementing.
 
=== Hackathon ideas ===
''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''
 
== Event Logistics ==
=== Location ===
'''Note: Day 1 and Day 2 of the event will take place in different locations less than a 20 minute walk apart.'''
 
On Monday, October 19, 2015 the event will take place at the [http://creativity.org/ Children’s Creativity Museum] located at [https://www.google.com/maps/place/Children's+Creativity+Museum/@37.783326,-122.402066,15z/data=!4m2!3m1!1s0x80858087438c54b7:0x9229072a5964c7fb 221 Fourth Street, San Francisco, CA 94103], behind the Carousel at the corner of Fourth and Howard. This is the same location as Day 1 of the 2014 event, but we will be in the theater this time. 
 
On Tuesday, October 20, 2015 the event will consist of the hackathon and related activities. The location for the hackathon will be announced soon.
 
=== Schedule ===
We will finalize the schedule after the talks are selected, but the rough schedule will be:
 
{|border="1" cellpadding="2"
|-
|valign="top"|Sunday, October 18, 2015
| ~6:30pm
| Optional dinner (location: TBD)
|-
|valign="top"|Monday, October 19, 2015
| 8:30am - 9:00am
| Breakfast/Registration
|-
|
| 9:00am - noon
| Presentations
|-
|
| noon - 1pm
| Lunch
|-
|
| 1pm - 5:45pm
| Presentations
|-
|
| 5:45 - 6:00pm
| Closing remarks
|-
|valign="top"|
| 6:30
| Beer bash & casual dinner at conference venue
|-
|valign="top"|Tuesday, October 20, 2015
| 9:00am - 5:00pm
| Hackathon
|-
|
| 5:00 - 5:45pm
| Hackathon presentations
|-
|
| 6:00pm
| Optional dinner (location: TBD)
|}
 
Note that the optional, off-site dinners on Sunday and Tuesday are at your own expense.


== Harassment Policy ==
== Harassment Policy ==
OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.
OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.


''For information about last year's event, see the [[OpenZFS Developer Summit 2014]] page.''
''For information about last year's event, see the [[OpenZFS Developer Summit 2014]] page.''
==  ==
Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.

Latest revision as of 07:46, 3 October 2018

2015 ozds event page v5.png The third annual OpenZFS Developer Summit was held in San Francisco, October 19 - 20, 2015. This was the 10th anniversary of the open sourcing of ZFS! All OpenZFS developers were invited to participate.


The goal of the event was to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consisted of 1 day of presentation (Oct 19) and a 1 day hackathon (Oct 20).

The event was streamed live, and you can find all videos and presentations below.

Event

Photos

Photos of the event can be viewed on the OpenZFS Google+ page.

Presentations

You can view the videos individually using the links below or watch the sequential presentation playlist.

Title Speaker Company Slides Video
Keynote Matt Ahrens Delphix Slides Video
OpenZFS Success Stories Tarkan Maner Nexenta Slides Video
ZFS Internals Overview Kirk McKusick Independent Slides Video
ZFS Send and Receive Paul Dagnelie Delphix Slides Video
Compressed Send and Receive Dan Kimmel Delphix
Live Migration with Zmotion Francois Lesage OVH Slides Video
The Birth of ZFS Jeff Bonwick DSSD, EMC None Video
Parity Declustered RAID-Z/Mirror Isaac Huang Intel Slides Video
Improve Performance on AWS with Eager Zero Joe Stein Delphix Slides Video
Compressed ARC George Wilson Delphix Slides Video
Discontiguous Caching with ABD David Chen OSNexus Slides Video
Persistent L2ARC Saso Kiselkov Nexenta Slides Video
Dedup Ceiling Saso Kiselkov Nexenta
Writeback Cache Alex Aizman Nexenta Slides Video
Sandboxing OpenZFS on Linux Albert Lee OmniTI Slides Video
SPA Metadata Allocation Classes Don Brady Intel Slides Video
Ztour Don Brady Intel Slides
Closing - Story time with Matt & Jeff Matt Ahrens & Jeff Bonwick - None Video
Day 2 Hackathon Presentations & Awards Hackathon Participants - None Video

Projects started at the hackathon

Discussion / Design sessions

  • vdev/metaslab classes / dedicated metadata devices (don brady)
  • upstream to openzfs (prakash)
  • make zfs recv (& ZPL & ZAP) less trusting -> no, just sign the stream (bryan, Alex Wilson)

Hacks

  • vdev/metaslab classes / dedicated metadata devices (don brady)
  • ZFS Kernel APIs (platform independent) - worked on atomic.h (paul)
  • building illumos more easily on OmniOS (dan mcdonald)
  • python test suite on linux/illumos (john kennedy, Allen Petersen allen.petersen@osnexus.com )
  • lz4hc (dan kimmel)
  • zfs api (alan jude)
  • upstream unmap/trim to illumos (saso)
  • pool-wide snapshot (george wilson)
  • channel programs (chris williamson)
  • (alexander K)
  • openzfs repo pull requests 9x (richard yao)
  • space map repair (making zdb write is hard -> zhack) (albert lee)
  • store vdev class info in per-vdev zaps (port per-vdev zap to illumos) (pavel & prashanth)
  • using kitchen to run illumos tests (eric)
  • mdb walkers (rob m)


A huge THANK YOU to the sponsors of the 2015 OpenZFS Developer Summit:

Read all about what our sponsors enabled us to bring to our audience this year on the Delphix blog!

Beer Bash

ClusterHQ-logo 1A---FC-w-strap-black-1360x568.png

Platinum

Delphix logo.png GitHub Logo.png New hac logo.jpg
Nexenta-GL-logo-tagline.jpg OsNexus.png OmniTI-logo.jpeg

Gold

RGB iXsystems Logo 2015 OnLight M.png Syneto-logo-Sept14.svg

Silver

Storiant.png Datto logo 7692 cmyk.png Logo freebsdfoundation.png RackTop-Systems.jpg

Bronze

OVH-baseline-bichro-H256.png

Special thanks:

  • Hackathon prizes - Thank you Nexenta!
  • Conference branding, t-shirt and banner design - Thank you Aaron Holding!
  • Design and creation of conference badges - Thank you Syneto!

Harassment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2014 page.