jgouin
Building and Distilling a Custom LLM Using Rancher Data
a project by rcabello
Description
This project explores how to create a custom Large Language Model (LLM) trained specifically on Rancher related data. We will explore LLM distillation techniques to produce a smaller, more efficient model suitable for deployment in resource-constrained environments. We will also explore how Retrieval-Augmented Generation (RAG) can enhance model performance by combining the strengths of fine-tuning with dynamic knowledge retrieval.
0
1
0
0
Looking for projects around:
Nothing at the moment