dmdiss

Build and validate a scale-out Samba/CTDB cluster atop CephFS

an invention by dmdiss

Samba and CTDB rely heavily on POSIX fcntl locks for data and meta-data integrity. This functionality was recently fixed in CephFS, opening up the possibility to use CephFS as an underlying filesystem for a scale-out Samba/CTDB cluster. Such an architecture should perform and scale much better than the existing single Samba + VFS module gateway.

Updated over 5 years ago. 1 hackers ♥️.

Add support for Amazon S3 cloud backed block devices to istgt / Elasto

an idea by dmdiss

Elasto is a cloud library and client utility for managing and manipulating cloud storage objects via REST. Functionality was recently added to istgt so that it can expose an Azure storage blob for access via iSCSI, it does so using Elasto's file API.

Updated over 7 years ago. No love. Has no hacker: grab it!

Add snapshot support to cifs.ko

an idea by dmdiss

The File Server Remote VSS Protocol (FSRVP) was recently defined by Microsoft. It allows for SMB clients to remotely request the creation, exposure and destruction of share snapshots. Aside from support in Windows Server 2012, preliminary FSRVP server support has also been implemented for Samba.

Updated over 5 years ago. 1 hackers ♥️. Has no hacker: grab it!

Elastocloud back-end for Samba

an invention by dmdiss

1) Add support for the Microsoft Azure File Service REST protocol to Elastocloud, a cloud storage client library created in a previous Hackweek. 2) After completing (1), create an Elastocloud VFS module for Samba that intercepts filesystem IO and locking operations. This would allow for the creation of a globally accessible Samba share backed by cloud storage, which could also be accessed by VMs deployed in the Azure cloud.

Updated over 5 years ago. 1 hackers ♥️.

Elasto: Add Ceph RADOS Gateway support, extend file API and other improvements

a project by dmdiss

Elasto is a cloud storage client project that has been developed across a number of SUSE Hack Weeks.
It currently supports Amazon S3 and Microsoft Azure REST storage protocols, and includes a POSIX like file API.

Updated over 7 years ago. No love.

Ceph RBD backed USB mass storage gadget

a project by dmdiss

Create a USB device that, when configured and connected, exposes one or more Ceph RBD images for use as USB storage, allowing for: * Ceph storage consumption by almost any system with a USB port

Updated over 5 years ago. 1 hackers ♥️.

Implement Samba support for DUPLICATE_EXTENTS SMB3 fcntl

an idea by dmdiss

FSCTLDUPLICATEEXTENTSTOFILE is a new SMB3 ioctl introduced with

Updated over 4 years ago. No love. Has no hacker: grab it!

Implement an "openSUSE / SLES latest ISO" USB gadget in Rust

an idea by dmdiss

Create an internet-connected embedded USB gadget that locates the latest openSUSE / SLES ISOs and exposes them to the connected host as USB mass storage. The purpose of such a device is to improve installation time and reduce waste:

Updated over 7 years ago. No love. Has no hacker: grab it!

libcephfs and/or libsmb2/lib backend for fio

an idea by dmdiss

fio is a flexible load generator useful for benchmarking and performance profiling. It offers a pluggable back-end, that supports: - Ceph librbd

Updated over 7 years ago. No love. Has no hacker: grab it!

Boot system from Ceph RADOS Block Device

an idea by dmdiss

Write a new Dracut module which adds support for booting a system where the root filesystem resides on a remote RBD image. * Pack keyring and ceph.conf (monitor address) in the initramfs image

Updated over 5 years ago. 3 hacker ♥️. Has no hacker: grab it!

Add Ceph support for Azure RESTful protocols

an idea by dmdiss

Microsoft Azure offers a bunch of interesting RESTful protocols, providing access to objects (Block Blobs, similar to S3 Objects), disk images (Page Blobs) and file systems (Azure Files). The underlying services seem to map pretty closely to RADOS, RBD and CephFS respectively, so adding support for these protocols to Ceph, despite being a lot of work, should be relatively straightforward. I've already worked on implementing a C client for these protocols via Elasto, so it might be worth reusing the same code in implementing the server functionality atop the public librados / librbd / libcephfs libraries. The other option would be to use civetweb/rgw, which is already embedded within Ceph for S3/SWIFT gateway support.

Updated almost 7 years ago. No love. Has no hacker: grab it!

Use Ceph RADOS key-value store as a dbwrap backend for Samba

a project by dmdiss

Ceph offers a highly scalable and fault-tolerant storage system. Samba is already capable of sharing data located on the Ceph Filesystem, however scale-out sharing (the same data exposed by multiple Samba nodes) currently requires the use of CTDB for consistent and coherent state across Samba cluster nodes. In such a setup CTDB provides a clustered database with persistent key-value data storage and locking. Database usage is abstracted out via a generic dbwrap interface. Ceph's librados library provides an API for the storage and retrieval of arbitrary key-value data via the omap functions. A watch/notify protocol is also provided as a mechanism for synchronising client state (locking). Key-value data stored in the RADOS back-end inherits the same redundancy features as regular objects, making it a potentially good candidate as a replacement for CTDB in scale-out Samba clusters.

Updated about 5 years ago. No love.

Clustered Samba with Ceph omap as a replacement for CTDB key-value storage

a project by dmdiss

Updated about 5 years ago. No love. 2 followers.

Azure File Service compatible REST frontend for CephFS

an idea by dmdiss

The Azure File Service protocol offers a RESTful interface for files and directories which are simultaneously exported via SMB. Ceph already provides separate (S3 compatible) REST and SMB (Samba) gateways, but they expose storage object via different layers and as a result don't allow for cross protocol access to the same data.

Updated over 4 years ago. No love. 1 follower. Has no hacker: grab it!

CephFS client for Android using the Linux Kernel Library and Wireguard

a project by dmdiss

CephFS is awesome, but without a VPN it's not safe to be routed over the internet, and it lacks client support on many platforms. The Linux Kernel Library allows for the linux kernel to be built as a cross-platform user-space library and integrated into a regular Android, Windows, macOS, etc. application. This project combines CephFS, LKL and wireguard, and sprinkles some io-uring on top. My objectives are:

Updated over 4 years ago. 3 hacker ♥️. 1 follower.

Mount Btrfs USB disks on non-root Android using the Linux Kernel Library

an invention by dmdiss

Project Description

I plan on continuing on with my Linux Kernel Library efforts from Hackweek 19. This time I'd like to spice things up a bit by plumbing USB devices into LKL, allowing reuse of native Linux USB host and filesystem drivers on non-root Android.