Description

In this Hack Week project, we're extending an existing Apache Airflow setup that processes Git repositories for test code. With a React frontend and an Express backend already in place for browsing and searching test cases, we're now adding a feature that lets users easily add new Git repositories right from the UI.

What’s more, as users add these repositories and tags to the whitelist, they'll get a preview of what Apache Airflow will actually do with those repos. In other words, the UI will not only let them add repositories, but also show them a kind of "sneak peek" of the Airflow workflow that will run. This way, users know exactly how their new repos will be handled, making the whole integration process transparent and user-friendly.

Apache Airflow already includes pipelines for machine learning-based tagging and AI-enhanced test descriptions. By allowing users to define new repository sources in the UI, only the initial processing pipelines are triggered first. After a newly added repository is processed and the resulting data is reviewed and approved, only then are the machine learning and AI-driven Airflow flows executed.

Goals

• Enable users to add new data sources through the UI seamlessly.
• Provide a clear preview of the Airflow processing steps for these newly added repositories so users know what to expect.
• Once the data from the new sources is reviewed and approved, trigger the machine learning and AI-driven Airflow workflows.

Remark: This project acts as the first building block in bringing Apache Airflow functionality directly into a user-friendly UI, effectively exposing Airflow through the interface and making it more accessible.

Resources

https://gitlab.suse.de/susetestcatalog/test-catalog-backend

https://gitlab.suse.de/susetestcatalog/test-catalog-frontend

https://gitlab.suse.de/susetestcatalog/test-catalog-airflow