Difference between revisions of "OpenZFS Developer Summit"

From OpenZFS
Jump to navigation Jump to search
(4 intermediate revisions by 2 users not shown)
Line 1: Line 1:
The ''OpenZFS Developer Summit'' was held November 18-19, 2013.  The goals of the event were:
{{:OpenZFS Developer Summit 2017}}
* to foster cross-platform community discussions of OpenZFS work
* to make progress on some of the projects proposed for this community.
 
[https://www.youtube.com/playlist?list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q Video recordings of the presentations] are in the OpenZFS channel on YouTube.
 
[https://www.surveymonkey.com/s/SL98Z8H Participant Survey]: Please complete by December 6 end of day.
 
== Topics that were discussed ==
{| class="wikitable"
!Title!!Speaker!!Slides!!Video
|-
|Introduction||Matt Ahrens||[http://www.slideshare.net/MatthewAhrens/open-zfs-devsummit slides]||[https://www.youtube.com/watch?v=U3dMhpmQTrU&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Platform Panel||Brian Behlendorf, Jorgen Lundman, Chris Siden, Xin Li||-||[https://www.youtube.com/watch?v=U3dMhpmQTrU&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Platform-independent code repository||Matt Ahrens||[http://www.slideshare.net/MatthewAhrens/openzfs-code-repository slides]||[https://www.youtube.com/watch?v=U3dMhpmQTrU&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Storage Tiering||Boris Protopopov||[http://www.open-zfs.org/w/images/7/71/ZFS_tiering.pdf slides]||[https://www.youtube.com/watch?v=tm0NYEVS6qM&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Vendor Lightning Talks||Many||-||[https://www.youtube.com/watch?v=EGKek5sZ2Xw&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Community Planning||Karyn Ritter||[https://docs.google.com/presentation/d/1LCvQxcNSxUi-5-NUgVRKp68iMLOrepp1VRJxPrklBPY/pub?start=false&loop=false&delayms=3000 slides]||[https://www.youtube.com/watch?v=EGKek5sZ2Xw&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Channel Programs||Chris Siden, Max Grossman||[http://www.slideshare.net/MatthewAhrens/openzfs-channel-programs slides]||[https://www.youtube.com/watch?v=EGKek5sZ2Xw&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Test Coverage||John Kennedy||[http://www.slideshare.net/jwk404/open-zfs-111813-28528303 slides]||[https://www.youtube.com/watch?v=M5RnPZW0_Xk&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Performance Investigation||Adam Leventhal||[http://www.slideshare.net/ahl0003/openzfs-datadriven-performance slides]||[https://www.youtube.com/watch?v=w3-eppY7ICc&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Performance on full & fragmented pools||George Wilson||-||[https://www.youtube.com/watch?v=UuscV_fSncY&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Scalability|| Kirill Davydychev ||-||[https://www.youtube.com/watch?v=hvoL6z8YKgM&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Virtual Memory Interactions|| Brian Behlendorf ||-||[https://www.youtube.com/watch?v=hvoL6z8YKgM&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Multi Tenancy|| Rob Mustacchi ||-||[https://www.youtube.com/watch?v=MLTX1i7UEL4&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|-
|Examining On-disk Format|| Max Bruning ||-||[https://www.youtube.com/watch?v=MLTX1i7UEL4&list=PLaUVvul17xSdWMBt5tAC8Hu7bbeWskD_q video]
|}
 
== Hackathon projects ==
These projects were worked on at the hackathon:
 
* Testrunner suite running on other platforms: linux, freebsd (+ illumos libzpool)
* channel programs: pass instruction stream into kernel
* ZFS send progress reporting with "set proc title"
* dedicated kmem_cache for dedup table entries
* larger (1MB) blocksize
* compressed ARC
* upstreaming dbuf_user & dbuf state machine (spectra DMU changes)
* limit DDT size
* onexit for osx
 
== Event Planning Info ==
See [[OpenZFS Developer Summit 2013 planning]]

Revision as of 15:58, 12 June 2017


OpenZFS Dev Summit 2017

The fifth annual OpenZFS Developer Summit was held October 24-25, 2017 in San Francisco. As with previous years: The goal of the event is to foster cross-community discussions of OpenZFS work and to make progress on some of the projects we have proposed. The first day of the event is presentations, and the second day is combined presentations and a hackathon. New contributors are welcome at the hackathon!

Talks: Day 1

Main talks, typically 45 minutes each.

Title Speaker Company Video Slides
State of the Union Matt Ahrens Delphix Video Slides
Keynote: ZFS Past & Future Mark Maybee Oracle Video Slides
ZSTD Compression Allan Jude ScaleEngine Video Slides
Fast Clone Deletion Sara Hartse Delphix Video Slides
MMP: Safe "zpool import" for Clusters Olaf Faaland LLNL Video Slides
Porting With OSX Jorgen Lundman GMO Video Slides
Faster Allocation with the Log Spacemap Serapheim Dimitropoulos Delphix Video Slides
iFlash: Dynamic Adaptive L2ARC Caching Shailendra Tripathi Tegile Video Slides
DRAID Isaac Huang Intel Video Slides
ZIL Performance: How I Doubled Sync Write Speed Prakash Surya Delphix Video Slides

Talks: Day 2

Shorter talks, around 15 minutes each.

Title Speaker Company Video Slides
"Oh Shift!" changing the allocation size George Wilson Delphix Video Slides
A proposal for 1,000x better dedup performance Matt Ahrens Delphix Video Slides
New prefetcher for sequential scrub Tom Caputi Datto Video Slides
Storage Pool Checkpoint Serapheim Dimitropoulos Delphix Video Slides
Improving resilver: results & operational impacts Saso Kiselkov Nexenta Video Slides
RAID-Z Expansion Matt Ahrens Delphix + FreeBSD Foundation Video Slides

Hackathon Projects

Audience choice awards:

Prize Project Participants
1st place ZTOUR, which mixes ZDB with FUSE, allowing you to explore the internals of the ZFS on-disk format with a file browser Don Brady, Pavel Zakharov, Prashanth Sreenivasa
2nd place FIEMAP, which makes file segment info from ZFS available via the standard Linux API Brian Behlendorf
3rd place MDB on Linux: porting the illumos kernel debugger MDB to Linux Seb Roy, Serapheim Dimitropoulos, Prakash Surya, John Kennedy

Additional projects:

Uploading videos from this morning
FreeNAS Test Integration
ZFS Property Setting in Channel Programs
Compressed+deduped send stream bug fix
Metaslab allocation PR testing
Proposed deduplication improvements
Combined smart compression and backing off compression level
zfs send / receive for windows
Optimized Fletcher4 port to illumos
Man page updates for Linux (default values)
Benchmark to create large directory structures
ztest reproducibility
Tags for controlling the ZFS Test Suite

Thank You 2017 Sponsors!

Platinum Sponsors

  • datto
  • Delphix
  • GitHub
  • MPSTOR
  • Nexenta
  • OpenDrives
  • OSNEXUS
  • OVH

Gold Sponsors

  • Intel
  • iXSystems
  • Syneto

Silver Sponsors

  • FreeBSD Foundation
  • rsync.net

Bronze Sponsors

  • reevert

Coffee Sponsor

  • MyNAS

Harassment Policy

OpenZFS Developer Summit is dedicated to providing a harassment-free conference experience for everyone, regardless of gender, gender identity and expression, sexual orientation, disability, physical appearance, body size, race, age or religion. We do not tolerate harassment of conference participants in any form. Sexual language and imagery is not appropriate for any conference venue, including talks. Conference participants violating these rules may be sanctioned or expelled from the conference at the discretion of the conference organizers.

For information about last year's event, see the OpenZFS Developer Summit 2016 page.