Difference between revisions of "Main Page"

From OpenZFS
Jump to navigation Jump to search
(36 intermediate revisions by 3 users not shown)
Line 2: Line 2:
__NOTOC__
__NOTOC__


OpenZFS brings together developers and users from various open-source forks of the original ZFS on different platforms and we're always looking to grow our community. There are a multitude of ways to contribute to the project and contributors are happy to help newcomers. As we add diverse perspectives, our community becomes richer, and we're committed to creating an environment where all people feel welcome.  [[Newcomers | Information for new contributors is available here.]]


== Summary ==
== Summary ==
Line 25: Line 26:
|[https://openzfsonosx.org/ Webpage]
|[https://openzfsonosx.org/ Webpage]
|[https://github.com/openzfsonosx/ GitHub]
|[https://github.com/openzfsonosx/ GitHub]
|-
| '''OpenZFS on OS X'''
|
|[https://github.com/openzfsonwindows/ZFSin GitHub]
|}
|}


== News ==
Matt Ahrens and George Wilson gave a talk on [https://www.socallinuxexpo.org/scale/16x/presentations/openzfs-basics OpenZFS Basics] at SCALE16x, March 2018.  [https://docs.google.com/presentation/d/1P2Q_eAgJH_6YorgTHDVgTZQfrBgtGs6VwLBvX7W23FA/edit?usp=sharing Slides] and [https://www.youtube.com/watch?v=MsY-BafQgj4 Video]


== [[OpenZFS Developer Summit 2017]] <-- click for more info ==
The [http://zfs.datto.com/ ZFS User Conference] was held April 2018.  Videos now posted.


The fifth annual [[OpenZFS Developer Summit 2017|OpenZFS Developer Summit]] was held in San Francisco, '''October 24-25th, 2017'''.
Matt Ahrens gave a talk at BSDCAN: [https://www.bsdcan.org/2018/schedule/events/960.en.html Flexible Disk Use in OpenZFS?], June 2018


'''Talks: Day 1''' - Main talks, typically 45 minutes each.
Sara Hartse gave a talk at BSDCAN: [https://www.bsdcan.org/2018/schedule/events/937.en.html 100x Faster Clone Deletion for ZFS], June 2018
 
[[OpenZFS_Developer_Summit_2018 | OpenZFS Developer Summit]] was held September 10-11, 2018.
 
The first [https://docs.google.com/document/d/1w2jv2XVYFmBVvG1EGf-9A5HBVsjAYoLIFZAnWHhV-BM/edit?ts=5bb3b66c# OpenZFS Leadership Meeting] will be held October 9, 2018
 
== [[OpenZFS Developer Summit 2018]] <-- click for more info ==
 
The sixth annual [[OpenZFS Developer Summit 2018|OpenZFS Developer Summit]] was held '''September 10-11, 2018''' in San Francisco.
 
===Talks: Day 1===


{| class="wikitable"
{| class="wikitable"
|-
|-
!Title!!Speaker!!Company!!Video!!Slides
!Title!!Speaker!!Company!!Slides!!Video
|-
|-
|State of the Union||Matt Ahrens||Delphix || [https://www.youtube.com/watch?v=1LkHsofR_kc Video] || [https://drive.google.com/file/d/0B5fzqkw_-diCX0x5d2hIVDhYZ28/view?usp=sharing Slides]
|State of the Union||Matt Ahrens||Delphix||[https://docs.google.com/presentation/d/144mwRPMznHL3xUxYuohIc0IZrDJDMj3s3_36_L9DJh8/edit#slide=id.p slides]||[https://www.youtube.com/watch?v=DearbVpOTro&index=2&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|Keynote: ZFS Past & Future||Mark Maybee||Oracle || Not Available || N/A
|ZIO Pipeline Explained||George Wilson||Delphix||[https://docs.google.com/presentation/d/1ohdmjsp9mejuSRKwDeU83o9297KaiHrqC-tV__kjO6E/edit?usp=sharing slides]||[https://www.youtube.com/watch?v=qkA5HhfzsvM&index=3&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|ZSTD Compression||Allan Jude||ScaleEngine||[https://www.youtube.com/watch?v=hWnWEitDPlM Video]||[[Media:03-OpenZFS_2017_-_ZStandard_in_ZFS.pdf|Slides]]
|[[zrepl]], a one-stop ZFS replication solution||Christian Schwarz||Student||[https://docs.google.com/presentation/d/1HXJ_9Q0kiHffeoQ7PlFn1qAfUcWyzedRgFlvL3nUlMU/edit?usp=sharing slides]||[https://www.youtube.com/watch?v=U4TUPQzZzPk&index=4&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|Fast Clone Deletion||Sara Hartse||Delphix||[https://www.youtube.com/watch?v=GLABJRWwGMk Video]||[[Media:04-Fast_Clone_Deletion.pdf|Slides]]
|[[Observing and Monitoring ZFS Metrics Using Open Source Tools]]||Richard Elling||Newisys||[https://drive.google.com/open?id=1Q-I4xD6q_wWkmhCy5oJ0Gyt00EgvfCec slides]||[https://www.youtube.com/watch?v=b5awF6SVNwI&index=5&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|MMP: Safe "zpool import" for Clusters||Olaf Faaland||LLNL||[https://www.youtube.com/watch?v=zZTP3zEfKYM Video]||[https://drive.google.com/file/d/0B_J4mRfoVJQRd3Vvc2ludGpvX1N0Y0E3bVd6ZjFRMmR0SnRJ/view?usp=sharing Slides]
|[[Managing ZVOLs with vzvol]]||Rainbow||Moogsoft||[https://docs.google.com/presentation/d/1BFgMUoUu5NxotqVbbn-ci-gAF3ylpzNyy9Dj1iwY_F0/edit?usp=sharing slides]||[https://www.youtube.com/watch?v=PoHsYzzzp8Q&index=6&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|Porting With OSX||Jorgen Lundman||GMO ||[https://www.youtube.com/watch?v=6_8jQnJf418 Video]||[[Media:06-Porting_with_OSX.pdf|Slides]]
|Hackathon Info|| Serapheim Dimitropoulos & Sara Hartse ||||[https://drive.google.com/file/d/1gx_UmSWhUhdNMRCWFpw2L7Zd_GpwuvvT/view slides]||[https://www.youtube.com/watch?v=5xG5WjPazlk&index=7&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|Faster Allocation with the Log Spacemap||Serapheim Dimitropoulos||Delphix || [https://www.youtube.com/watch?v=jj2IxRkl5bQ Video]|| [https://drive.google.com/file/d/0B5fzqkw_-diCeDVZSzl0VnR6Tzg/view?usp=sharing Slides]
|[[ZFS Hardware Acceleration with QAT]]||Weigang Li||Intel||[https://drive.google.com/file/d/0B_J4mRfoVJQRV3ZOd1ZMWkphcV9OYXdWT0FBblVHbVZpSmZj/view?usp=sharing slides]||[https://www.youtube.com/watch?v=4zWTU_hnGp0&index=8&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|[[iFlash | iFlash: Dynamic Adaptive L2ARC Caching]]||Shailendra Tripathi||Tegile || [https://www.youtube.com/watch?v=oAjMr5IES2w Video]|| [[Media:08-iFlash.pdf|Slides]]
|ZoL Releases||Tony Hutter||LLNL||[https://drive.google.com/file/d/0B_J4mRfoVJQRMzNPb1hBZ3RYcGg4NzFBSHd1clk4enVob01r/view?usp=sharing slides]||[https://www.youtube.com/watch?v=TyA0EKhGRsE&index=9&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|DRAID||Isaac Huang||Intel||[https://www.youtube.com/watch?v=xPU3rIHyCTs Video]||[[Media:09-dRAID.pdf|Slides]]
|Device Removal||Matt Ahrens||Delphix||[https://docs.google.com/presentation/d/1u4gIGHJCbKAUxpFjU6VpUJaTX_pHAyT_HVpQJxUOFR8/edit?usp=sharing slides]||[https://www.youtube.com/watch?v=KGnFhmG8gT0&index=10&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|-
|-
|ZIL Performance: How I Doubled Sync Write Speed||Prakash Surya||Delphix||[https://www.youtube.com/watch?v=RUb8svObroE Video]||[[Media:10-ZIL_performance.pdf|Slides]]
|[[iRAID]]||Shailendra Tripathi||Tegile, a Western Digital Brand||[https://docs.google.com/presentation/d/1pO10vS_6xY1MqFDnO1Op-BkAeVI5N4quigZHGVgBvD0/edit?usp=sharing slides]||[https://www.youtube.com/watch?v=OaZmkq5jgfk&index=11&list=PLaUVvul17xSe0pC6sCirlZXYqICP09Y8z&t=0s video]
|}
|}


'''Talks: Day 2''' - Shorter talks, around 15 minutes each.
===Talks: Day 2===
 
The bulk of this day will be spent on the hackathon but in the morning we'll have a few shorter talks and discussions, around 10-20 minutes each:


{| class="wikitable"
{| class="wikitable"
|-
|-
!Title!!Speaker!!Company!!Video!!Slides
!Title!!Speaker!!Company!!Slides!!Video
|-
|[[Log Spacemap: Flushing algorithm and performance]]|| Serapheim Dimitropoulos ||Delphix||[https://docs.google.com/presentation/d/1qxsbZGt1jCwhz-eHmilZS0ZATxGvvk7VLYBd1JnCCtI/edit?usp=sharing slides]||[https://youtu.be/x6D2dHRjkxw video]
|-
|[[DRAID Rebuild Performance]]||Carles Mateo||Newisys||[https://docs.google.com/presentation/d/1GZXj0u13_FcgfnFCZNbKemlvC0NPZ7I56UVNQNHJwIc/edit?usp=sharing slides]||[https://youtu.be/CVST0t0X9YU video]
|-
|-
|"Oh Shift!" changing the allocation size||George Wilson||Delphix||[https://www.youtube.com/watch?v=_-QAnKtIbGc Video]|| [https://drive.google.com/file/d/0B5fzqkw_-diCZFVTZlpua3hjNWs/view?usp=sharing Slides]
|Send Dedup||Paul Dagnelie||Delphix||[https://docs.google.com/presentation/d/1Ecwg3L52FQ7B86QPleVqXDJe9g5Jv_S4TJsNyK5uJLI/edit?usp=sharing slides]||[https://youtu.be/yPObFI-QU0o video]
|-
|-
|A proposal for 1,000x better dedup performance||Matt Ahrens||Delphix||[https://www.youtube.com/watch?v=PYxFDBgxFS8 Video]||[[Media:ZFS_dedup.pdf | Slides]]
|Allocation Classes||Don Brady||Delphix||[https://docs.google.com/presentation/d/17nYRgs-TAIOPODOMaq-VwuJ0LqJHEXBfM9sUDxJUJ54/edit?usp=sharing slides]||[https://youtu.be/Wg0VRAgaARI video]
|-
|-
|New prefetcher for sequential scrub||Tom Caputi||Datto||[https://www.youtube.com/watch?v=upn9tYh917s Video]||[[Media:New_Scrub_Prefetcher.pdf | Slides]]
|[[Vdev Properties]]||Allan Jude||Klara Systems||[https://docs.google.com/presentation/d/14dr-s9ScAHvAwuDAZBNj8W0r5z77xLCGbdZFggtFT5U/edit?usp=sharing slides]||[https://youtu.be/hD0uJOOCDb0 video]
|}
 
===Hackathon===
 
Hackathon presentation [https://youtu.be/zN_tGxCpTBU video]
 
Audience Choice Awards:
 
{| class="wikitable"
!Prize!!Project!!Participants
|-
|-
|Storage Pool Checkpoint||Serapheim Dimitropoulos||Delphix||[https://www.youtube.com/watch?v=fPQA8K40jAM Video]||[[Media:Storage_Pool_Checkpoint.pdf | Slides]]
|1st place||zpool status in color / 🔥|| Tony Hutter
|-
|-
|Improving resilver: results & operational impacts||Saso Kiselkov||Nexenta||[https://www.youtube.com/watch?v=HnTYCjSo6ic Video]||[[Media:Saso_-_resilver_update.pdf | Slides]]
|2nd place||vdev properties||Pavel Zahkarov, Allan Jude, Brian Behlendorf, and others
|-
|-
|RAID-Z Expansion||Matt Ahrens||Delphix + FreeBSD Foundation||[https://www.youtube.com/watch?v=ZF8V7Tc9G28 Video]||[[Media:RAIDZ_Expansion_v2.pdf | Slides]]
|3rd place|| Newcomer track; how to ask for money; AND setting props from channel progs ||Sara Hartse
|}
|}


'''Thank you to the 2017 Platinum sponsors for their support!'''
===Diamond Sponsors===


<div><ul>  
<div><ul>  
<li style="display: inline-block; padding: 20px; padding-bottom: 70px;"> [[File: Datto_logo_2015.jpg|80x80px|link=http://www.datto.com/ | right | datto ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 28px;"> [[File: Datto_logo_2015.jpg|80x80px|link=http://www.datto.com/ | right | datto ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 70px;"> [[File: Delphix logo.png|170x150px|link=http://delphix.com | right | Delphix]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 28px;"> [[File: Delphix logo.png|170x150px|link=http://delphix.com | right | Delphix]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 60px;"> [[File: GitHub_Logo.png|120x120px|link=http://github.com | right | GitHub]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 15px;">[[File: OsNexus.png|180x180px|link=http://www.osnexus.com/ | right | OSNEXUS ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 15px;"> [[File: MPSTOR_Logo.jpeg|200x200px|link=http://mpstor.com | right | MPSTOR]] </li>
<br>
<li style="display: inline-block; padding: 20px; padding-bottom: 65px;"> [[file:Nexenta_logo.jpg |180x180px|link=http://www.nexenta.com/ | right | Nexenta]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 65px;">[[File: opendrives-logo.png|180x180px|link=https://opendrives.com/ | right | OpenDrives ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 65px;">[[File: OsNexus.png|180x180px|link= http://www.osnexus.com/ | right | OSNEXUS ]] </li>
<li style="display: inline-block; padding: 20px; padding-bottom: 65px;">[[File: OVH-logo.png|240x240px|link=http://www.ovh.com/ | right | OVH ]] </li>
</ul></div>
</ul></div>
===Platinum Sponsors===
<div><ul>
<li style="display: inline-block; padding: 20px; padding-bottom: 15px;"> [[File:Newisys_Logo.png|200x200px|link=http://www.newisys.com/ | right | Newisys]] </li>
</ul></div>
== Automated Testing ==
Pull requests submitted to our [https://github.com/openzfs/openzfs/pulls GitHub page] are automatically tested, by running ztest and the ZFS Test Suite.  We use illumos VM's running on AWS to perform the tests, and results are available publicly.
Thanks to infrastructure sponsor Nexenta for covering our AWS hosting costs!  [[File: Nexenta-global-leader.jpg|180x180px|link=http://www.nexenta.com/ | Nexenta ]]


== Goals ==
== Goals ==
Line 111: Line 143:
== Donate ==
== Donate ==


We perform automated testing on all [https://github.com/openzfs/openzfs/pulls OpenZFS Pull Requests], which run on public cloud infrastructure (Amazon AWS).  We accept donations to cover our AWS bills.
We accept donations to cover our ongoing costs.


OpenZFS is an associated project of SPI ([https://www.spi-inc.org/projects/openzfs/ Software in the Public Interest]).  SPI is a 501(c)3 nonprofit organization which handles our donations, finances, and legal holdings.  You can donate through paypal using the link below:
OpenZFS is an associated project of SPI ([https://www.spi-inc.org/projects/openzfs/ Software in the Public Interest]).  SPI is a 501(c)3 nonprofit organization which handles our donations, finances, and legal holdings.  You can donate through paypal using the link below:
Line 125: Line 157:
</form>
</form>
</html>
</html>
== ZFS User Conference ==
The ZFS User Conference will be held April 19-20th, 2018, in Norwalk CT.  Details to come!
The first ZFS User Conference was held March 16-17, 2017, in Norwalk CT. Videos and slides from the conference are available here: [http://zfs.datto.com/ zfs.datto.com]


== Site orientation ==
== Site orientation ==

Revision as of 20:08, 2 October 2018

Welcome to OpenZFS

OpenZFS brings together developers and users from various open-source forks of the original ZFS on different platforms and we're always looking to grow our community. There are a multitude of ways to contribute to the project and contributors are happy to help newcomers. As we add diverse perspectives, our community becomes richer, and we're committed to creating an environment where all people feel welcome. Information for new contributors is available here.

Summary

OpenZFS was announced in September 2013 as the truly open source successor to the ZFS project. Our community brings together developers from the illumos, FreeBSD, Linux, and OS X platforms, and a wide range of companies that build products on top of OpenZFS.

OpenZFS is an outstanding storage platform that encompasses the functionality of traditional filesystems, volume managers, and more, with consistent reliability, functionality and performance across all distributions:

illumos Webpage GitHub
FreeBSD Webpage GitHub
ZFS on Linux Webpage GitHub
OpenZFS on OS X Webpage GitHub

News

Matt Ahrens and George Wilson gave a talk on OpenZFS Basics at SCALE16x, March 2018. Slides and Video

The ZFS User Conference was held April 2018. Videos now posted.

Matt Ahrens gave a talk at BSDCAN: Flexible Disk Use in OpenZFS?, June 2018

Sara Hartse gave a talk at BSDCAN: 100x Faster Clone Deletion for ZFS, June 2018

OpenZFS Developer Summit was held September 10-11, 2018.

The first OpenZFS Leadership Meeting will be held October 9, 2018

OpenZFS Developer Summit 2018 <-- click for more info

The sixth annual OpenZFS Developer Summit was held September 10-11, 2018 in San Francisco.

Talks: Day 1

Title Speaker Company Slides Video
State of the Union Matt Ahrens Delphix slides video
ZIO Pipeline Explained George Wilson Delphix slides video
zrepl, a one-stop ZFS replication solution Christian Schwarz Student slides video
Observing and Monitoring ZFS Metrics Using Open Source Tools Richard Elling Newisys slides video
Managing ZVOLs with vzvol Rainbow Moogsoft slides video
Hackathon Info Serapheim Dimitropoulos & Sara Hartse slides video
ZFS Hardware Acceleration with QAT Weigang Li Intel slides video
ZoL Releases Tony Hutter LLNL slides video
Device Removal Matt Ahrens Delphix slides video
iRAID Shailendra Tripathi Tegile, a Western Digital Brand slides video

Talks: Day 2

The bulk of this day will be spent on the hackathon but in the morning we'll have a few shorter talks and discussions, around 10-20 minutes each:

Title Speaker Company Slides Video
Log Spacemap: Flushing algorithm and performance Serapheim Dimitropoulos Delphix slides video
DRAID Rebuild Performance Carles Mateo Newisys slides video
Send Dedup Paul Dagnelie Delphix slides video
Allocation Classes Don Brady Delphix slides video
Vdev Properties Allan Jude Klara Systems slides video

Hackathon

Hackathon presentation video

Audience Choice Awards:

Prize Project Participants
1st place zpool status in color / 🔥 Tony Hutter
2nd place vdev properties Pavel Zahkarov, Allan Jude, Brian Behlendorf, and others
3rd place Newcomer track; how to ask for money; AND setting props from channel progs Sara Hartse

Diamond Sponsors

  • datto
  • Delphix
  • OSNEXUS

Platinum Sponsors

  • Newisys

Automated Testing

Pull requests submitted to our GitHub page are automatically tested, by running ztest and the ZFS Test Suite. We use illumos VM's running on AWS to perform the tests, and results are available publicly.

Thanks to infrastructure sponsor Nexenta for covering our AWS hosting costs! Nexenta

Goals

The high-level goals of OpenZFS are:

  • to raise awareness of the quality, utility, and availability of open source implementations of ZFS
  • to encourage open communication about ongoing efforts to improve open source ZFS
  • to ensure consistent reliability, functionality, and performance of all distributions of ZFS.

The main technical goal of OpenZFS is easier sharing of code between platforms. Strategies include:

We accept donations to cover our ongoing costs.

OpenZFS is an associated project of SPI (Software in the Public Interest). SPI is a 501(c)3 nonprofit organization which handles our donations, finances, and legal holdings. You can donate through paypal using the link below:

Site orientation

All main pages (alphabetical order) …

Twitter