dmdiss
Build and validate a scale-out Samba/CTDB cluster atop CephFS
an invention by dmdiss
Samba and CTDB rely heavily on POSIX fcntl locks for data and meta-data integrity. This functionality was recently fixed in CephFS, opening up the possibility to use CephFS as an underlying filesystem for a scale-out Samba/CTDB cluster. Such an architecture should perform and scale much better than the existing single Samba + VFS module gateway.
Add support for Amazon S3 cloud backed block devices to istgt / Elasto
an idea by dmdiss
Elasto is a cloud library and client utility for managing and manipulating cloud storage objects via REST. Functionality was recently added to istgt so that it can expose an Azure storage blob for access via iSCSI, it does so using Elasto's file API.
Add snapshot support to cifs.ko
an idea by dmdiss
The File Server Remote VSS Protocol (FSRVP) was recently defined by Microsoft. It allows for SMB clients to remotely request the creation, exposure and destruction of share snapshots. Aside from support in Windows Server 2012, preliminary FSRVP server support has also been implemented for Samba.
Elastocloud back-end for Samba
an invention by dmdiss
1) Add support for the Microsoft Azure File Service REST protocol to Elastocloud, a cloud storage client library created in a previous Hackweek. 2) After completing (1), create an Elastocloud VFS module for Samba that intercepts filesystem IO and locking operations. This would allow for the creation of a globally accessible Samba share backed by cloud storage, which could also be accessed by VMs deployed in the Azure cloud.
Elasto: Add Ceph RADOS Gateway support, extend file API and other improvements
a project by dmdiss
Elasto is a cloud storage client project that has been developed across a number of SUSE Hack Weeks.<br /> It currently supports Amazon S3 and Microsoft Azure REST storage protocols, and includes a POSIX like file API.<br />
Ceph RBD backed USB mass storage gadget
a project by dmdiss
Create a USB device that, when configured and connected, exposes one or more Ceph RBD images for use as USB storage, allowing for: * Ceph storage consumption by almost any system with a USB port
Implement Samba support for DUPLICATE_EXTENTS SMB3 fcntl
an idea by dmdiss
<pre> FSCTLDUPLICATEEXTENTSTOFILE is a new SMB3 ioctl introduced with
Implement an "openSUSE / SLES latest ISO" USB gadget in Rust
an idea by dmdiss
Create an internet-connected embedded USB gadget that locates the latest openSUSE / SLES ISOs and exposes them to the connected host as USB mass storage. The purpose of such a device is to improve installation time and reduce waste:
libcephfs and/or libsmb2/lib backend for fio
an idea by dmdiss
fio is a flexible load generator useful for benchmarking and performance profiling. It offers a pluggable back-end, that supports: - Ceph librbd
Boot system from Ceph RADOS Block Device
an idea by dmdiss
Write a new Dracut module which adds support for booting a system where the root filesystem resides on a remote RBD image. * Pack keyring and ceph.conf (monitor address) in the initramfs image
Add Ceph support for Azure RESTful protocols
an idea by dmdiss
Microsoft Azure offers a bunch of interesting RESTful protocols, providing access to objects (Block Blobs, similar to S3 Objects), disk images (Page Blobs) and file systems (Azure Files). The underlying services seem to map pretty closely to RADOS, RBD and CephFS respectively, so adding support for these protocols to Ceph, despite being a lot of work, should be relatively straightforward. I've already worked on implementing a C client for these protocols via Elasto, so it might be worth reusing the same code in implementing the server functionality atop the public librados / librbd / libcephfs libraries. The other option would be to use civetweb/rgw, which is already embedded within Ceph for S3/SWIFT gateway support.
Use Ceph RADOS key-value store as a dbwrap backend for Samba
a project by dmdiss
Ceph offers a highly scalable and fault-tolerant storage system. Samba is already capable of sharing data located on the Ceph Filesystem, however scale-out sharing (the same data exposed by multiple Samba nodes) currently requires the use of CTDB for consistent and coherent state across Samba cluster nodes. In such a setup CTDB provides a clustered database with persistent key-value data storage and locking. Database usage is abstracted out via a generic dbwrap interface. Ceph's librados library provides an API for the storage and retrieval of arbitrary key-value data via the omap functions. A watch/notify protocol is also provided as a mechanism for synchronising client state (locking). Key-value data stored in the RADOS back-end inherits the same redundancy features as regular objects, making it a potentially good candidate as a replacement for CTDB in scale-out Samba clusters.
Clustered Samba with Ceph omap as a replacement for CTDB key-value storage
a project by dmdiss
Ceph offers a highly scalable and fault-tolerant storage system. Samba is already capable of sharing data located on the Ceph Filesystem, however scale-out sharing (the same data exposed by multiple Samba nodes) currently requires the use of CTDB for consistent and coherent state across Samba cluster nodes. In such a setup CTDB provides a clustered database with persistent key-value data storage and locking. Database usage is abstracted out via a generic dbwrap interface. Ceph's librados library provides an API for the storage and retrieval of arbitrary key-value data via the omap functions. A watch/notify protocol is also provided as a mechanism for synchronising client state (locking). Key-value data stored in the RADOS back-end inherits the same redundancy features as regular objects, making it a potentially good candidate as a replacement for CTDB in scale-out Samba clusters.
Azure File Service compatible REST frontend for CephFS
an idea by dmdiss
The Azure File Service protocol offers a RESTful interface for files and directories which are simultaneously exported via SMB. Ceph already provides separate (S3 compatible) REST and SMB (Samba) gateways, but they expose storage object via different layers and as a result don't allow for cross protocol access to the same data.
CephFS client for Android using the Linux Kernel Library and Wireguard
a project by dmdiss
CephFS is awesome, but without a VPN it's not safe to be routed over the internet, and it lacks client support on many platforms. The Linux Kernel Library allows for the linux kernel to be built as a cross-platform user-space library and integrated into a regular Android, Windows, macOS, etc. application. This project combines CephFS, LKL and wireguard, and sprinkles some io-uring on top. My objectives are:
Mount Btrfs USB disks on non-root Android using the Linux Kernel Library
an invention by dmdiss
Project Description
I plan on continuing on with my Linux Kernel Library efforts from Hackweek 19. This time I'd like to spice things up a bit by plumbing USB devices into LKL, allowing reuse of native Linux USB host and filesystem drivers on non-root Android.
USB security key running embedded Linux
an invention by dmdiss
Project Description
Implement a proof-of-concept USB security key with support for encrypted data storage, U2F and FIDO2 (webauthn).
Looking for projects around:
Nothing at the moment
Activity