Difference between revisions of "OpenZFS Developer Summit 2015"

From OpenZFS
Jump to navigation Jump to search
Line 241: Line 241:
''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''
''Add your idea and your name below.  Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.''


==== Medium-size hackathon projects ====
* zfs clone --nopromote (Dan K)
* store total # blocks on disk (of each type, in each ds, etc) (George W)
* use refcount_t for v_count (fileystem-ey but not ZFS)
* embedded slog (George W)
* on-disk map from dataset GUID -> set of object IDs
* Simplify dbuf_free_range by removing dn_unlisted_l0_blkid (perf testing)
* scrub specific dataset
* channel programs! (Alvin)
* add LZ4HC compression
* allow receive of -L / -e / -c streams on systems with the required feature flags disabled
* allow spacemap to represent larger range with one entry (increase entry size)
==== Simpler hackathon projects ====
* break zfs/zpool manpages into one page per subcommand
* zfs send —current-format
* “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed)
* expose send size estimation from bookmarks through sbin/zfs
* we should not attempt to write to ZFS while panicking (illumos-specific)
* more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
* ::spa -h should show free space histogram for whole pool
* metaslab size can exceed offset addressable by spacemap
==== Backlog ideas ====
* error counts in per-vdev object
* scrub on readonly pool (on top of sorted scrub code?)
* “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
* preferred allocation alignment (george)
* promote prefetch reads to sync reads
* runtime lock analyzer (like freebsd WITNESS)
* test suite for system attributes
* show clone-origin relationships with zfs list --graph
* feature flags support for disabling inactive features
* ZFS should prefer gethrtime() to ddi_get_lbolt()
* create vdev in syncing context (with sync task)
* Add interface for creating file with specific recordsize
* does ::abuf_find still work?
* make spa_load_impl() always use config from the MOS (except for finding devices)
** also spa_unload() would have to be made more airtight
* JSON command output
* zfs help command
* zfs set print usage message specific to property you're trying to set
* make zfs recv less trusting
* convert some AVL trees to b-trees or hash tables
* cross platform xattr


== Harassment Policy ==
== Harassment Policy ==

Revision as of 06:16, 16 October 2015

2015 ozds event page v5.png The third annual OpenZFS Developer Summit will be held in San Francisco, October 19 - 20, 2015. This will be the 10th anniversary of the open sourcing of ZFS! All OpenZFS developers are invited to participate.


The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event will consist of 1 day of presentation (Oct 19) and a 1 day hackathon (Oct 20).

Details about registration, proposing presentations, deadlines, and sponsorship opportunities are provided on this page.

Thanks to the 2015 Beer Bash and Platinum sponsors for their support!

Delphix logo.png GitHub Logo.png ClusterHQ-logo 1A---FC-w-strap-black-1360x568.png New hac logo.jpg
Nexenta-GL-logo-tagline.jpg OsNexus.png OmniTI-logo.jpeg

You can watch live using the player below!


Registration

Registration is full! If you would like to attend, please contact us at admin@open-zfs.org or add yourself to the waitlist on Eventbrite. Conversely, if you have registered but will not be able to attend, let us know so we can refund your fee and make the space available to someone else.

  • Registration is $50 per attendee. If your company is a sponsor (as listed below), you may be eligible for a free registration. Please contact admin at open-zfs dot org if that is the case. Speakers will also receive free registration.

All attendees are expected to contribute/participate. Your ideas and questions are what make the event exciting!

Event Logistics

Location

Note: Day 1 and Day 2 of the event will take place in different locations less than a 20 minute walk apart.

Day 1: Conference - Monday, October 19, 2015

Children’s Creativity Museum at 221 Fourth Street, San Francisco, CA 94103, behind the Carousel at the corner of Fourth and Howard. This is the same location as Day 1 of the 2014 event, but we will be in the theater this time.

Day 2: Hackathon - Tuesday, October 20, 2015

GitHub at 88 Colin P. Kelly Jr St, San Francisco, CA 94107, which is a street that runs between Brannan and Townsend St, between 2nd and King Streets. The entrance is very close to the corner with Brannan St. Once there, let the security guard know that you are there for the hackathon.

If biking to the hackathon, go into the employee entrance at 275 Brannan Street, San Francisco, CA 94107. Let them know you are there for the hackathon, and they will let you store your bicycle. They will then direct you to the appropriate entrance.

Schedule

Note that the optional, off-site dinner on Sunday is at your own expense.

Sunday, October 18, 2015
Time Title
6:30pm Optional dinner at Rosamunde Sausage Grill at 2832 Mission St, San Francisco, CA 94110.

Location is a 3 minute walk from the 24th Street BART station.

Monday, October 19, 2015
Time Title Speaker Company
9:00am – 9:30am Registration & Breakfast
9:30am – 9:45am Keynote Matt Ahrens Delphix
9:45am – 10:00am OpenZFS Success Stories Tarkan Maner Nexenta
10:00am – 10:45am ZFS Internals Overview Kirk McKusick Independent
10:45am – 11:00am Break
11:00am – 11:30am ZFS Send and Receive Paul Dagnelie Delphix
11:30am – 11:45am Compressed Send and Receive Dan Kimmel Delphix
11:45am – 12:00pm Live Migration with Zmotion Francois Lesage OVH
12:00pm – 12:45pm Lunch
12:45pm – 1:00pm The Birth of ZFS Jeff Bonwick DSSD, EMC
1:00pm – 1:30pm Parity Declustered RAID-Z/Mirror Isaac Huang Intel
1:30pm – 1:45pm Improve Performance on AWS with Eager Zero Joe Stein Delphix
1:45pm – 2:15pm Break
2:15pm – 2:45pm Compressed ARC George Wilson Delphix
2:45pm – 3:00pm Discontiguous Caching with ABD David Chen OSNexus
3:00pm – 3:15pm Persistent L2ARC Saso Kiselkov Nexenta
3:15pm – 3:30pm Dedup Ceiling Saso Kiselkov Nexenta
3:30pm – 4:00pm Break
4:00pm – 4:30pm Writeback Cache Alex Aizman Nexenta
4:30pm – 4:45pm Sandboxing OpenZFS on Linux Albert Lee OmniTI
4:45pm – 5:00pm Ztour Don Brady Intel
5:00pm – 5:15pm SPA Metadata Allocation Classes Don Brady Intel
5:15pm – 5:30pm Closing Matt Ahrens Delphix
5:30pm Beer Bash & Casual Dinner at Conference Venue
Tuesday, October 20, 2015
Time Title
9:00am – 9:30am Breakfast
9:30am –10:45am Hackathon
10:45am – 11:00am Break
11:00am – 12:00pm Hackathon
12:00pm – 12:45pm Lunch
12:45pm – 1:45pm Hackathon
1:45pm – 2:15pm Break
2:15pm – 3:30pm Hackathon
3:30pm – 4:00pm Break
4:00pm – 5:30pm Hackathon Presentations, Awards & Closing
5:30pm Dinner at Hackathon Location (GitHub)

Event deadlines

Sept 25, 2015 Register by this date to ensure you get a t-shirt in your size
Oct 12, 2015 Agenda finalized
Oct 19 - 20, 2015 OpenZFS Developer Summit

Sponsorship

Thanks to our sponsors who make the 2015 event possible:

Beer Bash

ClusterHQ-logo 1A---FC-w-strap-black-1360x568.png

Platinum

Delphix logo.png GitHub Logo.png New hac logo.jpg
Nexenta-GL-logo-tagline.jpg OsNexus.png OmniTI-logo.jpeg

Gold

RGB iXsystems Logo 2015 OnLight M.png Syneto-logo-Sept14.svg Intel.png

Silver

Storiant.png Datto logo 7692 cmyk.png Logo freebsdfoundation.png RackTop-Systems.jpg

Bronze

OVH-baseline-bichro-H256.png

Sponsorship opportunities and benefits

The full details of the monetary sponsorship options and the associated rewards can be viewed in the sponsorship plan.

All of our sponsors have an opportunity to be known as a OpenZFS supporter in a very talented and influential community.

Please send email to admin at open-zfs dot org if you would like to sponsor the event.

Other ways to sponsor

If you are interested in supporting the event through non-monetary means, we would be happy to match the sponsorship packages to the effort.

  • Video record and stream the presentations
  • Photograph the event
  • Help with setup/administrative tasks related to the conference

Thanks to our generous sponsors for their help:

  • Hackathon prizes - Thank you Nexenta!
  • Conference branding, t-shirt and banner design - Thank you Aaron Holding!
  • Design and create conference badges - Thank you Syneto!

Hackathon

The goals of the hackathon are:

  • to get people working with ZFS engineers from outside their normal circles
  • to start work on some of the projects we'd like to accomplish

Therefore, we should plan to work in small teams of 2-3 engineers. The team members could be pair-programming, splitting up the work into discrete tasks for each person, or advising / implementing.

Hackathon ideas

Add your idea and your name below. Be prepared to explain your idea at the beginning of the hackathon and enlist/entice others to help with it.

Medium-size hackathon projects

  • zfs clone --nopromote (Dan K)
  • store total # blocks on disk (of each type, in each ds, etc) (George W)
  • use refcount_t for v_count (fileystem-ey but not ZFS)
  • embedded slog (George W)
  • on-disk map from dataset GUID -> set of object IDs
  • Simplify dbuf_free_range by removing dn_unlisted_l0_blkid (perf testing)
  • scrub specific dataset
  • channel programs! (Alvin)
  • add LZ4HC compression
  • allow receive of -L / -e / -c streams on systems with the required feature flags disabled
  • allow spacemap to represent larger range with one entry (increase entry size)

Simpler hackathon projects

  • break zfs/zpool manpages into one page per subcommand
  • zfs send —current-format
  • “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed)
  • expose send size estimation from bookmarks through sbin/zfs
  • we should not attempt to write to ZFS while panicking (illumos-specific)
  • more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
  • ::spa -h should show free space histogram for whole pool
  • metaslab size can exceed offset addressable by spacemap

Backlog ideas

  • error counts in per-vdev object
  • scrub on readonly pool (on top of sorted scrub code?)
  • “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
  • preferred allocation alignment (george)
  • promote prefetch reads to sync reads
  • runtime lock analyzer (like freebsd WITNESS)
  • test suite for system attributes
  • show clone-origin relationships with zfs list --graph
  • feature flags support for disabling inactive features
  • ZFS should prefer gethrtime() to ddi_get_lbolt()
  • create vdev in syncing context (with sync task)
  • Add interface for creating file with specific recordsize
  • does ::abuf_find still work?
  • make spa_load_impl() always use config from the MOS (except for finding devices)
    • also spa_unload() would have to be made more airtight
  • JSON command output
  • zfs help command
  • zfs set print usage message specific to property you're trying to set
  • make zfs recv less trusting
  • convert some AVL trees to b-trees or hash tables
  • cross platform xattr

Harassment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

Disclaimers

Intel and the Intel logo are trademarks of Intel Corporation in the U.S. and/or other countries.

For information about last year's event, see the OpenZFS Developer Summit 2014 page.