Summary

knots aims to be a multi-node S3 benchmark and load generator written in Rust and on top of WebAssembly, waPC, and waSCC.

Goal for this Hackweek

My goal for HackWeek is to have a prototype actor that can at least run a few GET/PUT requests against a single bucket and tells me how long that took.

Collaboration

Since this is a training wheels exercise for me on multiple fronts (Rust, and the entire WASM/waPC/waSCC world), I'm not actively looking for other contributors yet. I don't learn as much if someone else does the work, and I have precisely zero experience with any of the technologies involved except S3 ;-)

But if you have experience, I don't mind chatting!

Especially if your project maybe includes a krustlet/waSCC ops environment to try and deploy the actor on.

I just want an S3 benchmark, now

I recommend you take a look at these:

  • fio is an excellent C tool for benchmarking all sorts of data IO mechanisms, and is very useful for comparing protocols. I contributed a simple S3 module to it a while ago. If your primary interest is data throughput and latency, fio is your tool of choice.
  • MinIO warp is a versatile tool written in Go for benchmarking various aspects of S3 and probably the most mature choice.
  • cosbench is a very well-known tool for benchmarking S3 written in Java.

Looking for hackers with the skills:

s3 wasm wascc wasi ceph krustlet rust containerless

This project is part of:

Hack Week 20

Activity

  • about 3 years ago: jluis liked this project.
  • about 3 years ago: LarsMB liked this project.
  • about 3 years ago: LarsMB added keyword "containerless" to this project.
  • about 3 years ago: LarsMB started this project.
  • about 3 years ago: LarsMB added keyword "ceph" to this project.
  • about 3 years ago: LarsMB added keyword "krustlet" to this project.
  • about 3 years ago: LarsMB added keyword "rust" to this project.
  • about 3 years ago: LarsMB added keyword "s3" to this project.
  • about 3 years ago: LarsMB added keyword "wasm" to this project.
  • about 3 years ago: LarsMB added keyword "wascc" to this project.
  • about 3 years ago: LarsMB added keyword "wasi" to this project.
  • about 3 years ago: LarsMB originated this project.

  • Comments

    Be the first to comment!

    Similar Projects

    (Rust) Manage systems in NetBox using NetBox-Sync by chock

    [comment]: # (Please use the project descriptio...


    toniowm by fabriziosestito

    toniowm is yet another window manager written i...


    Relm4-based user interface for Agama by IGonzalezSosa

    Motivation

    Disclaimer: the idea of this pr...


    A set of utilities to produce a "from scratch" OCI/Docker container using Opensuse/SLE rpms by ldragon

    [comment]: # (Please use the project descriptio...


    Create a new markup language with parser in rust by nkrapp

    Project Description

    Write a parser for my...