Difference between revisions of "Features"

From OpenZFS
Jump to navigation Jump to search
(Add ZFSOnLinux extensions to CLI Usability)
(Update ZFSOnLinux Performance Improvements)
Line 337: Line 337:
=== Developed in ZFSOnLinux ===
=== Developed in ZFSOnLinux ===


==== Don't ashift-align vdev read requests. ====
==== FASTWRITE Algorithm ====


Avoids memory allocation in heavily-used code path and reduces the amount of data that has to travel. Porting it to illumos will require a rewrite of its block device drivers.
Improves synchronous IO performance.


{| class="wikitable"
{| class="wikitable"
Line 350: Line 350:
|-
|-
|'''ZFS on Linux'''
|'''ZFS on Linux'''
|[https://github.com/zfsonlinux/zfs/commit/a5c20e2a0a9046c06d86615fbf51dc04f12bba14 Oct 2012]
|[https://github.com/zfsonlinux/zfs/commit/920dd524fb2997225d4b1ac180bcbc14b045fda6 Oct 2012]
|-
|-
|'''Mac ZFS'''
|'''Mac ZFS'''
Line 356: Line 356:
|}
|}


==== FASTWRITE Algorithm ====
==== Improve N-way mirror performance ====


Improves synchronous IO performance.
Queues read requests to least busy leaf vdev in mirrors.


{| class="wikitable"
{| class="wikitable"
Line 369: Line 369:
|-
|-
|'''ZFS on Linux'''
|'''ZFS on Linux'''
|[https://github.com/zfsonlinux/zfs/commit/920dd524fb2997225d4b1ac180bcbc14b045fda6 Jun 2012]
|[https://github.com/zfsonlinux/zfs/commit/556011dbec2d10579819078559a77630fc559112 Jul 2013]
|-
|-
|'''Mac ZFS'''
|'''Mac ZFS'''
Line 375: Line 375:
|}
|}


==== Improve N-way mirror performance ====
==== SA based xattrs ====


Queues read requests to least busy leaf vdev in mirrors.
Requires a disk format change and is off by default until ZFS Version Feature Flags (not to be  confused with Pool Version Feature Flags) are implemented.


{| class="wikitable"
{| class="wikitable"
Line 388: Line 388:
|-
|-
|'''ZFS on Linux'''
|'''ZFS on Linux'''
|[https://github.com/zfsonlinux/zfs/commit/556011dbec2d10579819078559a77630fc559112 Jul 2013]
|[https://github.com/zfsonlinux/zfs/commit/82a37189aac955c81a59a5ecc3400475adb56355 Oct 2011]
|-
|-
|'''Mac ZFS'''
|'''Mac ZFS'''
Line 394: Line 394:
|}
|}


==== SA based xattrs ====
==== Use the slog even with logbias=throughput ====


Requires a disk format change and is off by default until ZFS Version Feature Flags (not to be  confused with Pool Version Feature Flags) are implemented.
Requires a disk format change and is off by default until ZFS Version Feature Flags (not to be  confused with Pool Version Feature Flags) are implemented.
Line 407: Line 407:
|-
|-
|'''ZFS on Linux'''
|'''ZFS on Linux'''
|[https://github.com/zfsonlinux/zfs/commit/82a37189aac955c81a59a5ecc3400475adb56355 Oct 2011]
|[https://github.com/zfsonlinux/zfs/commit/5d7a86d114c2706a8d14d94b71f81ad5cdf066c5 Oct 2011]
|-
|-
|'''Mac ZFS'''
|'''Mac ZFS'''

Revision as of 14:54, 13 September 2013

Feature Flags Overview

libzfs_core

CLI Usability

These are improvements to the command line interface. While the end result is a generally more friendly user interface, getting the desired behavior often required modifications to the core of ZFS.

Developed in Illumos

Pool Comment

OpenZFS has a per-pool comment property which can be set with the zpool set command, but can be read even if the pool is not imported, so it is accessible even if the pool cannot be imported.

illumos Nov 2011
FreeBSD ??
ZFS on Linux Aug 2012
Mac ZFS ??

Size Estimates for zfs send and zfs destroy

This feature enhances OpenZFS's internal space accounting information. This new accounting information is used to provide a -n (dry-run) option for zfs send which can instantly calculate the amount of send stream data a specific zfs send command would generate. It is also used for a -n option for zfs destroy which can instantly calculate the amount of space that would be reclaimed by a specific zfs destroy command.

illumos Nov 2011
FreeBSD ??
ZFS on Linux Jul 2012
Mac ZFS ??

vdev Information in zpool list

OpenZFS adds a -v option to the zpool list command which shows detailed sizing information about the vdevs in the pool: 

$ zpool list -v
NAME          SIZE  ALLOC   FREE  EXPANDSZ    CAP  DEDUP  HEALTH  ALTROOT
dcenter      5.24T  3.85T  1.39T         -    73%  1.00x  ONLINE  -
  mirror      556G   469G  86.7G         -
    c2t1d0       -      -      -         -
    c2t0d0       -      -      -         -
  mirror      556G   493G  63.0G         -
    c2t3d0       -      -      -         -
    c2t2d0       -      -      -         -
  mirror      556G   493G  62.7G         -
    c2t5d0       -      -      -         -
    c2t4d0       -      -      -         -
  mirror      556G   494G  62.5G         -
    c2t8d0       -      -      -         -
    c2t6d0       -      -      -         -
  mirror      556G   494G  62.2G         -
    c2t10d0      -      -      -         -
    c2t9d0       -      -      -         -
  mirror      556G   494G  61.9G         -
    c2t12d0      -      -      -         -
    c2t11d0      -      -      -         -
  mirror     1016G   507G   509G         -
    c1t1d0       -      -      -         -
    c1t5d0       -      -      -         -
  mirror     1016G   496G   520G         -
    c1t3d0       -      -      -         -
    c1t4d0       -      -      -         -
illumos Jan 2012
FreeBSD ??
ZFS on Linux Sept 2012
Mac ZFS ??

zfs send Progress Reporting

OpenZFS introduces a -v option to zfs send which reports per-second information on how much data has been sent, how long it has taken, and how much data remains to be sent.

illumos May 2012
FreeBSD ??
ZFS on Linux Sept 2012
Mac ZFS ??

Arbitrary Snapshot Arguments to zfs snapshot

illumos Jun 2012
FreeBSD ??
ZFS on Linux August 2013
Mac ZFS ??

Developed in ZFSOnLinux

ZFS list snapshot property alias

Functionally identical to Solaris 11 extension [code]zfs list -t snap[/code].

illumos ??
FreeBSD ??
ZFS on Linux Apr 2012
Mac ZFS ??

ZFS snapshot alias

Functionally identical to Solaris 11 extension [code]zfs snap[/code].

illumos ??
FreeBSD ??
ZFS on Linux Apr 2012
Mac ZFS ??

Performance

Developed in Illumos

Asynchronous Filesystem and Volume Destruction

Destroying a filesystem requires traversing all of its data in order to return its used blocks to the pool's free list. Before this feature the filesystem was not fully removed until all blocks had been reclaimed. If the destroy operation was interrupted by a reboot or power outage the next attempt to import the pool (probably during boot) would need to complete the destroy operation synchronously, possibly delaying a boot for long periods of time.

With asynchronous destruction the filesystem's data is immediately moved to a "to be freed" list, allowing the destroy operation to complete without traversing any of the filesystem's data. A background process reclaims blocks from this "to be freed" list and is capable of resuming this process after reboots without slowing the pool import process.

The new freeing algorithm also has a significant performance improvement when destroying clones. The old algorithm took time proportional to the number of blocks referenced by the clone, even if most of those blocks could not be reclaimed because they were still referenced by the clone's origin. The new algorithm only takes time proportional to the number of blocks unique to the clone.

illumos May 2012
FreeBSD ??
ZFS on Linux Jan 2013
Mac ZFS ??

empty bpobjs?

illumos Aug 2012
FreeBSD ??
ZFS on Linux Dec 2012
Mac ZFS ??

single copy arc?

illumos Sep 2012
FreeBSD ??
ZFS on Linux Dec 2012
Mac ZFS ??

George's massive spacemap performance improvments (the set from 2012)?

also 16a4a8074274d2d7cc408589cf6359f4a378c861 and 9eb57f7f3fbb970d4b9b89dcd5ecf543fe2414d5

illumos Nov 2012
FreeBSD ??
ZFS on Linux May 2013
Mac ZFS ??

nop-write?

illumos Nov 2012
FreeBSD ??
ZFS on Linux Not yet (as of Sept. 13, 2013)
Mac ZFS ??

lz4 compression

illumos Jan 2013
FreeBSD ??
ZFS on Linux Jan 2013
Mac ZFS ??

synctask rewrite

illumos Feb 2013
FreeBSD ??
ZFS on Linux Sept 2013
Mac ZFS ??

l2arc compression

illumos Jun 2013
FreeBSD ??
ZFS on Linux Aug 2013
Mac ZFS ??

arc shouldn't cache freed blocks

illumos Jun 2013
FreeBSD ??
ZFS on Linux Jun 2013
Mac ZFS ??

Developed in ZFSOnLinux

FASTWRITE Algorithm

Improves synchronous IO performance.

illumos ??
FreeBSD ??
ZFS on Linux Oct 2012
Mac ZFS ??

Improve N-way mirror performance

Queues read requests to least busy leaf vdev in mirrors.

illumos ??
FreeBSD ??
ZFS on Linux Jul 2013
Mac ZFS ??

SA based xattrs

Requires a disk format change and is off by default until ZFS Version Feature Flags (not to be confused with Pool Version Feature Flags) are implemented.

illumos ??
FreeBSD ??
ZFS on Linux Oct 2011
Mac ZFS ??

Use the slog even with logbias=throughput

Requires a disk format change and is off by default until ZFS Version Feature Flags (not to be confused with Pool Version Feature Flags) are implemented.

illumos ??
FreeBSD ??
ZFS on Linux Oct 2011
Mac ZFS ??

Dataset Properties

These are new filesystem, volume, and snapshot properties which can be accessed with the zfs(1) command's get subcommand. See the zfs(1) manpage for your distribution for more details on each of these properties.

Property Description illumos FreeBSD ZFS on Linux Mac ZFS
refcompressratio The compression ratio acheived for all data referenced by (but not necessarily unique to) a snapshot, filesystem, or volume, expressed as a multiplier. Jun 2011 ?? Aug 2012 ??
clones For snapshots, this property is a comma-separated list of filesystems or volumes which are clones of this snapshot. Nov 2011 ?? Jul 2012 ??
written The amount of referenced space written to this dataset since the previous snapshot. Nov 2011 ?? Jul 2012 ??
written@<snap> The amount of referenced space written to this dataset since the specified snapshot. This is the space referenced by this dataset, but not referenced by the specified snapshot. Nov 2011 ?? Jul 2012 ??

more props lused lcompressed 77372cb0f35e8d3615ca2e16044f033397e88e21 Not yet ported to ZFSOnLinux (as of Sept. 13, 2013)

Retrieved from "https://openzfs.org/w/index.php?title=Features&oldid=465"