Kubernetes API caching layer according to Stable Diffusion

Make it faster!

There are use cases that put the Kubernetes API under heavy load - using Rancher at scale can be one of them.

Also, there are use cases in which a connection to the Kubernetes API might not always be present, or with good bandwidth - using Rancher for edge use cases can be one of them.

This project aims to create a local cache serving data from the Kubernetes API - with good performance and displaying last-good-results on a flaky connection.

Goal for this Hackweek

Implement Proof-Of-Concept client-go components backed by SQLite.

https://github.com/moio/vai

Resources

Golang and ideally Kubernetes hackers are more than welcome!

Looking for hackers with the skills:

kubernetes k8s api golang go performance testautomation scalability

This project is part of:

Hack Week 22

Activity

  • over 1 year ago: lizhang liked this project.
  • over 1 year ago: moio added keyword "k8s" to this project.
  • over 1 year ago: moio added keyword "api" to this project.
  • over 1 year ago: moio added keyword "golang" to this project.
  • over 1 year ago: moio added keyword "go" to this project.
  • over 1 year ago: moio added keyword "performance" to this project.
  • over 1 year ago: moio added keyword "testautomation" to this project.
  • over 1 year ago: moio added keyword "scalability" to this project.
  • over 1 year ago: moio added keyword "kubernetes" to this project.
  • over 1 year ago: moio liked this project.
  • over 1 year ago: paulgonin liked this project.
  • over 1 year ago: moio started this project.
  • over 1 year ago: moio originated this project.

  • Comments

    • moio
      over 1 year ago by moio | Reply

      Day 1 question: is a separate daemon design better than creating an Informer backed by a SQL cache.Store?

    • moio
      over 1 year ago by moio | Reply

      Day 1 answer: no. Pivoting project to the creation of a SQL-based Indexer

    • moio
      over 1 year ago by moio | Reply

      Day 2 progress: SQL-backed Store works. https://github.com/moio/vai

    • moio
      over 1 year ago by moio | Reply

      Day 3 progress: SQL-backed Indexer works

    • moio
      over 1 year ago by moio | Reply

      Day 4 question: where would it fit best? Steve or Lasso, and where?

    • moio
      over 1 year ago by moio | Reply

      Day 4 answer: Steve, as an alternative to the current LRU cache of k8s API responses

    • moio
      over 1 year ago by moio | Reply

      Day 5 progress: SQL-backed ThreadSafeStore works. History-preserving VersionedStore also works

    Similar Projects

    mikrolite - a cli to create lighweight Kubernetes clusters using microvms by rcase

    [comment]: # (Please use the project descriptio...


    RKE2/K3S working on IBM Power by tkelly

    [comment]: # (Please use the project descriptio...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Predefined app security policy template for NeuVector by feih

    Project Description

    Idea is to predefin...


    Brainstorming: connecting physical stores with a portal for humans by tneau

    [comment]: # (Please use the project descriptio...


    Rancher Upgrader - Upgrades your rancher install via helm, and communicates critical changes from release A to B. by rweir

    [comment]: # (Please use the project descriptio...


    WebUI for your data by avicenzi

    [comment]: # (Please use the project descriptio...


    Learn Golang contribuing to opensource projects by mbussolotto

    Project Description

    Get practice in Golan...


    Go zip updater: Appending new files to zip archive without decompressing the whole file by StarryWang

    Project Description

    Currently, Golang's `...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Cluster API Provider for Harvester by rcase

    [comment]: # (Please use the project descriptio...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Rancher Upgrader - Upgrades your rancher install via helm, and communicates critical changes from release A to B. by rweir

    [comment]: # (Please use the project descriptio...


    WebUI for your data by avicenzi

    [comment]: # (Please use the project descriptio...


    Learn Golang contribuing to opensource projects by mbussolotto

    Project Description

    Get practice in Golan...


    Visualization of historical sar(1) archives by ggherdovich

    Project Description

    The sar(1) tool, fr...


    Investigate zypper/openSUSE repository refresh optimisations by dirkmueller

    [comment]: # (Please use the project descriptio...