Kubernetes API caching layer according to Stable Diffusion

Make it faster!

There are use cases that put the Kubernetes API under heavy load - using Rancher at scale can be one of them.

Also, there are use cases in which a connection to the Kubernetes API might not always be present, or with good bandwidth - using Rancher for edge use cases can be one of them.

This project aims to create a local cache serving data from the Kubernetes API - with good performance and displaying last-good-results on a flaky connection.

Goal for this Hackweek

Implement Proof-Of-Concept client-go components backed by SQLite.

https://github.com/moio/vai

Resources

Golang and ideally Kubernetes hackers are more than welcome!

Looking for hackers with the skills:

kubernetes k8s api golang go performance testautomation scalability

This project is part of:

Hack Week 22

Activity

  • about 2 months ago: lizhang liked this project.
  • about 2 months ago: moio added keyword "k8s" to this project.
  • about 2 months ago: moio added keyword "api" to this project.
  • about 2 months ago: moio added keyword "golang" to this project.
  • about 2 months ago: moio added keyword "go" to this project.
  • about 2 months ago: moio added keyword "performance" to this project.
  • about 2 months ago: moio added keyword "testautomation" to this project.
  • about 2 months ago: moio added keyword "scalability" to this project.
  • about 2 months ago: moio added keyword "kubernetes" to this project.
  • about 2 months ago: moio liked this project.
  • about 2 months ago: paulgonin liked this project.
  • about 2 months ago: moio started this project.
  • about 2 months ago: moio originated this project.

  • Comments

    • moio
      about 2 months ago by moio | Reply

      Day 1 question: is a separate daemon design better than creating an Informer backed by a SQL cache.Store?

    • moio
      about 2 months ago by moio | Reply

      Day 1 answer: no. Pivoting project to the creation of a SQL-based Indexer

    • moio
      about 2 months ago by moio | Reply

      Day 2 progress: SQL-backed Store works. https://github.com/moio/vai

    • moio
      about 2 months ago by moio | Reply

      Day 3 progress: SQL-backed Indexer works

    • moio
      about 2 months ago by moio | Reply

      Day 4 question: where would it fit best? Steve or Lasso, and where?

    • moio
      about 1 month ago by moio | Reply

      Day 4 answer: Steve, as an alternative to the current LRU cache of k8s API responses

    • moio
      about 1 month ago by moio | Reply

      Day 5 progress: SQL-backed ThreadSafeStore works. History-preserving VersionedStore also works

    Similar Projects

    Hack on project MONAI (Medical Open Network for Artificial Intelligence) by jordimassaguerpla

    Project Description

    MONAI is a set of o...


    Learn about kubernetes by creating a k3s HA setup by rsimai

    This is mostly a learning activity for myself, ...


    K3S Control Planes as a service by ademicev0

    [comment]: # (Please use the project descriptio...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    operator for s3gw by gbaccini

    Project Description

    Create a K8s CRD for ...


    operator for s3gw by gbaccini

    Project Description

    Create a K8s CRD for ...


    Improve Docker registry listing tool by rbranco

    Project Description

    [regview](https://git...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Elemental Operator: support hosts without TPM by fgiudici

    [comment]: # (Please use the project descriptio...


    Generic Wrangler Controllers by kjoiner

    [comment]: # (Please use the project descriptio...


    Real-time container runtime support by a_faerber

    [comment]: # (Please use the project descriptio...


    Rancher Token Revoker by mbolot

    [comment]: # (Please use the project descriptio...


    K3S Control Planes as a service by ademicev0

    [comment]: # (Please use the project descriptio...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Visualization of historical sar(1) archives by ggherdovich

    Project Description

    The sar(1) tool, fr...