Kubernetes API caching layer according to Stable Diffusion

Make it faster!

There are use cases that put the Kubernetes API under heavy load - using Rancher at scale can be one of them.

Also, there are use cases in which a connection to the Kubernetes API might not always be present, or with good bandwidth - using Rancher for edge use cases can be one of them.

This project aims to create a local cache serving data from the Kubernetes API - with good performance and displaying last-good-results on a flaky connection.

Goal for this Hackweek

Implement Proof-Of-Concept client-go components backed by SQLite.

https://github.com/moio/vai

Resources

Golang and ideally Kubernetes hackers are more than welcome!

Looking for hackers with the skills:

kubernetes k8s api golang go performance testautomation scalability

This project is part of:

Hack Week 22

Activity

  • over 1 year ago: lizhang liked this project.
  • over 1 year ago: moio added keyword "k8s" to this project.
  • over 1 year ago: moio added keyword "api" to this project.
  • over 1 year ago: moio added keyword "golang" to this project.
  • over 1 year ago: moio added keyword "go" to this project.
  • over 1 year ago: moio added keyword "performance" to this project.
  • over 1 year ago: moio added keyword "testautomation" to this project.
  • over 1 year ago: moio added keyword "scalability" to this project.
  • over 1 year ago: moio added keyword "kubernetes" to this project.
  • over 1 year ago: moio liked this project.
  • over 1 year ago: paulgonin liked this project.
  • over 1 year ago: moio started this project.
  • over 1 year ago: moio originated this project.

  • Comments

    • moio
      over 1 year ago by moio | Reply

      Day 1 question: is a separate daemon design better than creating an Informer backed by a SQL cache.Store?

    • moio
      over 1 year ago by moio | Reply

      Day 1 answer: no. Pivoting project to the creation of a SQL-based Indexer

    • moio
      over 1 year ago by moio | Reply

      Day 2 progress: SQL-backed Store works. https://github.com/moio/vai

    • moio
      over 1 year ago by moio | Reply

      Day 3 progress: SQL-backed Indexer works

    • moio
      over 1 year ago by moio | Reply

      Day 4 question: where would it fit best? Steve or Lasso, and where?

    • moio
      over 1 year ago by moio | Reply

      Day 4 answer: Steve, as an alternative to the current LRU cache of k8s API responses

    • moio
      over 1 year ago by moio | Reply

      Day 5 progress: SQL-backed ThreadSafeStore works. History-preserving VersionedStore also works

    Similar Projects

    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Predefined app security policy template for NeuVector by feih

    Project Description

    Idea is to predefin...


    mikrolite - a cli to create lighweight Kubernetes clusters using microvms by rcase

    [comment]: # (Please use the project descriptio...


    RKE2/K3S working on IBM Power by tkelly

    [comment]: # (Please use the project descriptio...


    Brainstorming: connecting physical stores with a portal for humans by tneau

    [comment]: # (Please use the project descriptio...


    Rancher Upgrader - Upgrades your rancher install via helm, and communicates critical changes from release A to B. by rweir

    [comment]: # (Please use the project descriptio...


    Gameboy emulator written in Go by mikeletux

    [comment]: # (Please use the project descriptio...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    WebUI for your data by avicenzi

    [comment]: # (Please use the project descriptio...


    Go zip updater: Appending new files to zip archive without decompressing the whole file by StarryWang

    Project Description

    Currently, Golang's `...


    A CLI for Harvester by mohamed.belgaied

    [comment]: # Harvester does not officially come...


    Learn Golang contribuing to opensource projects by mbussolotto

    Project Description

    Get practice in Golan...


    WebUI for your data by avicenzi

    [comment]: # (Please use the project descriptio...


    Cluster API Provider for Harvester by rcase

    [comment]: # (Please use the project descriptio...


    Rancher Upgrader - Upgrades your rancher install via helm, and communicates critical changes from release A to B. by rweir

    [comment]: # (Please use the project descriptio...


    Investigate zypper/openSUSE repository refresh optimisations by dirkmueller

    [comment]: # (Please use the project descriptio...


    Visualization of historical sar(1) archives by ggherdovich

    Project Description

    The sar(1) tool, fr...