Elasto is a cloud library and client utility for managing and manipulating cloud storage objects via REST.

Functionality was recently added to istgt so that it can expose an Azure storage blob for access via iSCSI, it does so using Elasto's file API.

Elasto's file API should be extended, so that it supports Amazon S3 object IO. This task would be difficult, as the S3 REST API does not currently support length@offset writes to objects.

Once complete, istgt could be extended to pass through Amazon S3 credentials to Elasto, and thus expose an iSCSI target backed by an S3 object. This would allow for cloud redundancy / failover by layers above (RAID, etc.).

Looking for hackers with the skills:

iscsi scsi cloud rest amazon s3 azure

This project is part of:

Hack Week 10

Activity

  • about 12 years ago: dmdiss added keyword "iscsi" to this project.
  • about 12 years ago: dmdiss added keyword "scsi" to this project.
  • about 12 years ago: dmdiss added keyword "cloud" to this project.
  • about 12 years ago: dmdiss added keyword "rest" to this project.
  • about 12 years ago: dmdiss added keyword "amazon" to this project.
  • about 12 years ago: dmdiss added keyword "s3" to this project.
  • about 12 years ago: dmdiss added keyword "azure" to this project.
  • about 12 years ago: dmdiss originated this project.

  • Comments

    • bmwiedemann
      about 12 years ago by bmwiedemann | Reply

      I think, S3 is not designed for this. It is more like a filesystem, where keys are pathnames and values are file content. Is there an API for access to Amazon's Elastic Block Storage (EBS) ? What about owncloud?

    • bmwiedemann
      about 12 years ago by bmwiedemann | Reply

      ceph/rbd (used for volumes) and swift (S3 equivalent) from SUSE Cloud would also be a worthy target.

    • dmdiss
      about 12 years ago by dmdiss | Reply

      Indeed, S3's REST interface is not designed for this. Nevertheless, I'd still like to implement it, as this would allow for transparent encryption and compression on the client using existing tools such as dm-crypt and Btrfs. Failover and redundancy between Azure and Amazon S3 storage should also be possible. Amazon already offer a Storage Gateway with a similar purpose, but this promotes vendor lock-in.

    • dmdiss
      about 12 years ago by dmdiss | Reply

      Ceph's RADOS gateway purportedly offers the same REST protocol as Amazon S3. I agree that it and swift would both be worthy targets.

    Similar Projects

    Create a Cloud-Native policy engine with notifying capabilities to optimize resource usage by gbazzotti

    Description

    The goal of this project is to begin the initial phase of development of an all-in-one Cloud-Native Policy Engine that notifies resource owners when their resources infringe predetermined policies. This was inspired by a current issue in the CES-SRE Team where other solutions seemed to not exactly correspond to the needs of the specific workloads running on the Public Cloud Team space.

    The initial architecture can be checked out on the Repository listed under Resources.

    Among the features that will differ this project from other monitoring/notification systems:

    • Pre-defined sensible policies written at the software-level, avoiding a learning curve by requiring users to write their own policies
    • All-in-one functionality: logging, mailing and all other actions are not required to install any additional plugins/packages
    • Easy account management, being able to parse all required configuration by a single JSON file
    • Eliminate integrations by not requiring metrics to go through a data-agreggator

    Goals

    • Create a minimal working prototype following the workflow specified on the documentation
    • Provide instructions on installation/usage
    • Work on email notifying capabilities

    Resources


    Backfire TV - Take back control of your Firestick by andreabenini

    Take Back Control of Your Amazon Firestick.
    Tired of Ads, a cluttered launcher, and buttons you can't change? BackFireTV is a project to liberate your Firestick from Amazon's walled garden and make it truly yours. They call it the firestick. To fight fire with fire, you need a backfire.

    That's the soul of BackFireTV. To truly liberate it and return back to its core capabilities this project uses a linux script, one Android app and ADB access against Amazon's restrictive policies. We leverage these internal tools to create a "backfire" against the incessant ads and locked ecosystem, transforming your Firestick back into the useful, customizable device it was always meant to be.

    Goals

    I'm still defining it as a side project and something I'll surely do in the upcoming days with hw I already have. btw I'd like to register it in advance in order to work on it. I already have a somehow working concept I'll redefine later during the week


    Provide personal account sign-in for Himmelblau (Azure Entra Id) by dmulder

    Description

    Himmelblau currently does not support personal account sign-in, but only sign-in for business/school accounts. Adding personal account sign-in would broaden the userbase, and potentially attract more users to Linux from Windows (since they could easily migrate their existing Windows account, etc).

    Goals

    Implement personal account sign-in for libhimmelblau.

    Resources

    gitlab.com/samba-team/libhimmelblau