OpenZFS Developer Summit 2015

From OpenZFS
Jump to navigation Jump to search
2015 ozds event page v5.png The third annual OpenZFS Developer Summit was held in San Francisco, October 19 - 20, 2015. This was the 10th anniversary of the open sourcing of ZFS! All OpenZFS developers were invited to participate.


The goal of the event was to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. This 2-day event consisted of 1 day of presentation (Oct 19) and a 1 day hackathon (Oct 20).

Details about registration, proposing presentations, deadlines, and sponsorship opportunities were provided on this page.

The event was streamed live, and you can find all videos and presentations below.

or use the #OpenZFS tag on twitter.

Thanks to the 2015 Beer Bash and Platinum sponsors for their support!

Delphix logo.png GitHub Logo.png ClusterHQ-logo 1A---FC-w-strap-black-1360x568.png New hac logo.jpg
Nexenta-GL-logo-tagline.jpg OsNexus.png OmniTI-logo.jpeg

Event

Photos

Photos of the event can be viewed on the OpenZFS Google+ page.

Presentations

Title Speaker Company Slides Video
Keynote Matt Ahrens Delphix Slides Video
OpenZFS Success Stories Tarkan Maner Nexenta Slides
ZFS Internals Overview Kirk McKusick Independent Slides Video
ZFS Send and Receive Paul Dagnelie Delphix Slides Video
Compressed Send and Receive Dan Kimmel Delphix
Live Migration with Zmotion Francois Lesage OVH Slides Video
The Birth of ZFS Jeff Bonwick DSSD, EMC None Video
Parity Declustered RAID-Z/Mirror Isaac Huang Intel Slides Video
Improve Performance on AWS with Eager Zero Joe Stein Delphix Slides Video
Compressed ARC George Wilson Delphix Slides Video
Discontiguous Caching with ABD David Chen OSNexus Slides Video
Persistent L2ARC Saso Kiselkov Nexenta Slides Video
Dedup Ceiling Saso Kiselkov Nexenta
Writeback Cache Alex Aizman Nexenta Slides Coming Soon
Sandboxing OpenZFS on Linux Albert Lee OmniTI Slides Coming Soon
SPA Metadata Allocation Classes Don Brady Intel Slides Coming Soon
Ztour Don Brady Intel Slides Coming Soon
Day 1 Closing Matt Ahrens Delphix None Coming Soon
Day 2 Hackathon Presentations & Awards Hackathon Participants - None Coming Soon

Projects started at the hackathon

Medium-size hackathon projects

  • zfs clone --nopromote (Dan K)
  • store total # blocks on disk (of each type, in each ds, etc) (George W)
  • use refcount_t for v_count (fileystem-ey but not ZFS)
  • embedded slog (George W)
  • on-disk map from dataset GUID -> set of object IDs
  • Simplify dbuf_free_range by removing dn_unlisted_l0_blkid (perf testing)
  • scrub specific dataset
  • channel programs! (Alvin)
  • add LZ4HC compression
  • allow receive of -L / -e / -c streams on systems with the required feature flags disabled
  • allow spacemap to represent larger range with one entry (increase entry size)

Simpler hackathon projects

  • break zfs/zpool manpages into one page per subcommand
  • zfs send —current-format
  • “zfs API” subcommand to enumerate software capabilities (e.g. what CLI flags are allowed, when things change (zfs send -nv now outputs to stdout instead of stderr))
  • expose send size estimation from bookmarks through sbin/zfs
  • we should not attempt to write to ZFS while panicking (illumos-specific)
  • more type safety in ZFS: typedef struct { uint64_t doi_id} dmu_object_id_t
  • ::spa -h should show free space histogram for whole pool
  • metaslab size can exceed offset addressable by spacemap

Backlog ideas

  • error counts in per-vdev object
  • scrub on readonly pool (on top of sorted scrub code?)
  • “resilver groups”/“vdev-directed resilver” where additional failure does not cause scrub to restart
  • preferred allocation alignment (george)
  • promote prefetch reads to sync reads
  • runtime lock analyzer (like freebsd WITNESS)
  • test suite for system attributes
  • show clone-origin relationships with zfs list --graph
  • feature flags support for disabling inactive features
  • ZFS should prefer gethrtime() to ddi_get_lbolt()
  • create vdev in syncing context (with sync task)
  • Add interface for creating file with specific recordsize
  • does ::abuf_find still work?
  • make spa_load_impl() always use config from the MOS (except for finding devices)
    • also spa_unload() would have to be made more airtight
  • JSON command output
  • zfs help command
  • zfs set print usage message specific to property you're trying to set
  • make zfs recv less trusting
  • convert some AVL trees to b-trees or hash tables
  • cross platform xattr

A huge THANK YOU to the sponsors of the 2015 OpenZFS Developer Summit:

Beer Bash

ClusterHQ-logo 1A---FC-w-strap-black-1360x568.png

Platinum

Delphix logo.png GitHub Logo.png New hac logo.jpg
Nexenta-GL-logo-tagline.jpg OsNexus.png OmniTI-logo.jpeg

Gold

RGB iXsystems Logo 2015 OnLight M.png Syneto-logo-Sept14.svg

Silver

Storiant.png Datto logo 7692 cmyk.png Logo freebsdfoundation.png RackTop-Systems.jpg

Bronze

OVH-baseline-bichro-H256.png

Special thanks:

  • Hackathon prizes - Thank you Nexenta!
  • Conference branding, t-shirt and banner design - Thank you Aaron Holding!
  • Design and creation of conference badges - Thank you Syneto!

Harassment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2014 page.