Keeping a consolidated view of a project's progress is a non-trivial endeavor. There are far too many moving parts from its inception, such as planning, issue tracking, development, and testing. All the while one must keep track of some form of metrics to ensure that there's progress, and that the progress is happening in the right direction (or whatever is considered the right direction at the moment).
Traditionally we have enough tools to keep track of a project's progress in terms of planning, work planned, and work finished. Issue trackers are ubiquitous, and we're all used to using them and obtaining rough metrics out of them. However, just because work gets done doesn't mean the work being done is the right kind of work.
At its infancy, the s3gw project is going through a turmoil of development: we know where we want to go, we have a good idea how we'll get there, but we know a lot of things are going to be broken while we're on the road to get there.
While issue trackers help us keep track of work being done, these are not the right tools to keep track of how much of an API has been covered, for instance, or what kind of performance we can get out of the software at any given point in time. Even though one can keep track of these things in the form of issues, establishing baselines for different metrics and comparing against them then becomes a laborious, mind-numbing manual task that often has to involve spreadsheets.
Instead, we are proposing a dedicated web-based tracker, focused on running coverage and performance tests against the project at several points in time, keeping a history of results against known baselines, that we can then rely on when making decisions going forward and to evaluate where we are and how far we've come.
Goal for this Hackweek
The scope of this project is a bit far too broad for a one week development cycle. Being reasonable in goal setting, by the end of this hackweek we intend to have basic testing functionality and result reporting via a web interface.
Project's repository: github
This project is part of:
Hack Week 21
This project is one of its kind!