knots aims to be a multi-node S3 benchmark and load generator written in Rust and on top of WebAssembly, waPC, and waSCC.
Goal for this Hackweek
My goal for HackWeek is to have a prototype actor that can at least run a few
PUT requests against a single bucket and tells me how long that took.
Since this is a training wheels exercise for me on multiple fronts (Rust, and the entire WASM/waPC/waSCC world), I'm not actively looking for other contributors yet. I don't learn as much if someone else does the work, and I have precisely zero experience with any of the technologies involved except S3 ;-)
But if you have experience, I don't mind chatting!
Especially if your project maybe includes a
waSCC ops environment to try and deploy the actor on.
I just want an S3 benchmark, now
I recommend you take a look at these:
- fio is an excellent C tool for benchmarking all sorts of data IO mechanisms, and is very useful for comparing protocols. I contributed a simple S3 module to it a while ago. If your primary interest is data throughput and latency, fio is your tool of choice.
- MinIO warp is a versatile tool written in Go for benchmarking various aspects of S3 and probably the most mature choice.
- cosbench is a very well-known tool for benchmarking S3 written in Java.
This project is part of:
Hack Week 20