Summary

knots aims to be a multi-node S3 benchmark and load generator written in Rust and on top of WebAssembly, waPC, and waSCC.

Goal for this Hackweek

My goal for HackWeek is to have a prototype actor that can at least run a few GET/PUT requests against a single bucket and tells me how long that took.

Collaboration

Since this is a training wheels exercise for me on multiple fronts (Rust, and the entire WASM/waPC/waSCC world), I'm not actively looking for other contributors yet. I don't learn as much if someone else does the work, and I have precisely zero experience with any of the technologies involved except S3 ;-)

But if you have experience, I don't mind chatting!

Especially if your project maybe includes a krustlet/waSCC ops environment to try and deploy the actor on.

I just want an S3 benchmark, now

I recommend you take a look at these:

  • fio is an excellent C tool for benchmarking all sorts of data IO mechanisms, and is very useful for comparing protocols. I contributed a simple S3 module to it a while ago. If your primary interest is data throughput and latency, fio is your tool of choice.
  • MinIO warp is a versatile tool written in Go for benchmarking various aspects of S3 and probably the most mature choice.
  • cosbench is a very well-known tool for benchmarking S3 written in Java.

Looking for hackers with the skills:

s3 wasm wascc wasi ceph krustlet rust containerless

This project is part of:

Hack Week 20

Activity

  • 6 months ago: jluis liked this project.
  • 6 months ago: LarsMB liked this project.
  • 6 months ago: LarsMB added keyword "containerless" to this project.
  • 6 months ago: LarsMB started this project.
  • 6 months ago: LarsMB added keyword "ceph" to this project.
  • 6 months ago: LarsMB added keyword "krustlet" to this project.
  • 6 months ago: LarsMB added keyword "rust" to this project.
  • 6 months ago: LarsMB added keyword "s3" to this project.
  • 6 months ago: LarsMB added keyword "wasm" to this project.
  • 6 months ago: LarsMB added keyword "wascc" to this project.
  • All Activity

    Comments

    Be the first to comment!

    Similar Projects

    Sharing logic between desktop and web based applications through WASM by IGonzalezSosa

    Project Description

    A few months ago, the...


    WASM Serverless by davidko

    Project Description

    Support WASM serverle...


    WASM Serverless by davidko

    Project Description

    Support WASM serverle...


    k8s-rook-client by haass

    [comment]: # (Please use the project descriptio...


    Developing an opinionated storage appliance by asettle

    [comment]: # (Please use the project descriptio...


    Velcro demuxing software management by zbenjamin

    [comment]: # (Please use the project descriptio...


    Improve packaging of Rust in OBS by aplanas

    Project Description

    • Complete the pull r...


    Rust Bootcamp by SMorlan

    [comment]: # (Please use the project descriptio...


    Kanidm - A modern opensource IDM by firstyear

    Project Description

    Kanidm is a modern, fas...


    Sharing logic between desktop and web based applications through WASM by IGonzalezSosa

    Project Description

    A few months ago, the...