Implement Samba support for DUPLICATE_EXTENTS SMB3 fcntl
an idea by dmdiss
Updated almost 5 years ago. No love. Has no hacker: grab it! 
FSCTL_DUPLICATE_EXTENTS_TO_FILE is a new SMB3 ioctl introduced with
Windows Server 2016 (currently in technical preview), which allows for a client to
remotely request that the server perform a COW clone of a specified file:
https://msdn.microsoft.com/en-us/library/mt182620.aspx

The cifs.ko Linux kernel SMB client includes support for
FSCTL_DUPLICATE_EXTENTS_TO_FILE, which is invoked for cp --reflink
initiated COW clone operations. 

Samba has existing support for COW clones atop Btrfs via
FSCTL_SRV_COPYCHUNK:
https://wiki.samba.org/index.php/Server-Side_Copy

This functionality should be extended to support the new
FSCTL_DUPLICATE_EXTENTS_TO_FILE ioctl, to allow for remote COW clone
requests from new (Windows10+) clients, and the cifs.ko kernel client.

Time Plan:

  • Install Windows Server 2016 Technical Preview
  • Test cifs.ko fsctl support
  • Implement Samba client/smbtorture functionality
  • Implement Samba server support
  • Plumb functionality into Btrfs backend, for remote COW clones
  • Submit upstream

No Hackers yet

Join this project

Looking for hackers with the skills:

smb samba storage

This project is part of:

Hack Week 14

Activity

  • over 8 years ago: dmdiss added keyword "storage" to this project.
  • over 8 years ago: dmdiss added keyword "smb" to this project.
  • over 8 years ago: dmdiss added keyword "samba" to this project.
  • over 8 years ago: dmdiss originated this project.


    • Comments

    Be the first to comment!

    Similar Projects

    Modularization and Modernization of cifs.ko for Enhanced SMB Protocol Support by hcarvalho

    Creator:
    Enzo Matsumiya ematsumiya@suse.de @ SUSE Samba team
    Members:
    Henrique Carvalho henrique.carvalho@suse.com @ SUSE Samba team

    Description

    Split cifs.ko in 2 separate modules; one for SMB 1.0 and 2.0.x, and another for SMB 2.1, 3.0, and 3.1.1.

    Goals

    Primary

    Start phasing out/deprecation of older SMB versions

    Secondary

    • Clean up of the code (with focus on the newer versions)
    • Update cifs-utils
    • Update documentation
    • Improve backport workflow (see below)

    Technical details

    Ideas for the implementation.

    • fs/smb/client/{old,new}.c to generate the respective modules
      • Maybe don't create separate folders? (re-evaluate as things progresses!)
    • Remove server->{ops,vals} if possible
    • Clean up fs_context.* -- merge duplicate options into one, handle them in userspace utils
    • Reduce code in smb2pdu.c -- tons of functions with very similar init/setup -> send/recv -> handle/free flow
    • Restructure multichannel
      • Treat initial connection as "channel 0" regardless of multichannel enabled/negotiated status, proceed with extra channels accordingly
      • Extra channel just point to "channel 0" as the primary server, no need to allocate an extra TCPServerInfo for each one
    • Authentication mechanisms
      • Modernize algorithms (references: himmelblau, IAKERB/Local KDC, SCRAM, oauth2 (Azure), etc.

    Modularization and Modernization of cifs.ko for Enhanced SMB Protocol Support by hcarvalho

    Creator:
    Enzo Matsumiya ematsumiya@suse.de @ SUSE Samba team
    Members:
    Henrique Carvalho henrique.carvalho@suse.com @ SUSE Samba team

    Description

    Split cifs.ko in 2 separate modules; one for SMB 1.0 and 2.0.x, and another for SMB 2.1, 3.0, and 3.1.1.

    Goals

    Primary

    Start phasing out/deprecation of older SMB versions

    Secondary

    • Clean up of the code (with focus on the newer versions)
    • Update cifs-utils
    • Update documentation
    • Improve backport workflow (see below)

    Technical details

    Ideas for the implementation.

    • fs/smb/client/{old,new}.c to generate the respective modules
      • Maybe don't create separate folders? (re-evaluate as things progresses!)
    • Remove server->{ops,vals} if possible
    • Clean up fs_context.* -- merge duplicate options into one, handle them in userspace utils
    • Reduce code in smb2pdu.c -- tons of functions with very similar init/setup -> send/recv -> handle/free flow
    • Restructure multichannel
      • Treat initial connection as "channel 0" regardless of multichannel enabled/negotiated status, proceed with extra channels accordingly
      • Extra channel just point to "channel 0" as the primary server, no need to allocate an extra TCPServerInfo for each one
    • Authentication mechanisms
      • Modernize algorithms (references: himmelblau, IAKERB/Local KDC, SCRAM, oauth2 (Azure), etc.

    SMB3 Server written entirely in Rust by dmulder

    Description

    Given the number of bugs frequently discovered in the Samba code caused by memory issues, it makes sense to re-write the smbd service purely in Rust code. Meanwhile, it would be wise to abandon backwards compatibility here with insecure protocol versions, and simply implement the SMB3 spec.

    Goals

    Get a simple server up and running and get it merged into upstream Samba (which now has Rust build support).

    Resources

    Agama Expert Partitioner by joseivanlopez

    Description

    Agama is a new Linux installer that will be very likely used for SLES 16.

    It offers an UI for configuring the target system (language, patterns, network, etc). One of the more complex sections is the storage configuration, which is going to be revamped. This project consists on exploring the possibility of having something similar to the YaST Expert Partitioner for Agama.

    Goals

    • Explore different approaches for the storage UI in Agama.