Project Description

Generate a personalized avatar artwork images by fine-tuning stable diffusion on personal pictures

Goal for this Hackweek

Get a new fancy and unique avatar!

Resources

Looking for hackers with the skills:

ai stable-diffusion imaging

This project is part of:

Hack Week 23

Activity

  • 5 months ago: dfaggioli liked this project.
  • 5 months ago: mgrossu joined this project.
  • 5 months ago: jgoldschmidt liked this project.
  • 5 months ago: STorresi added keyword "ai" to this project.
  • 5 months ago: STorresi added keyword "stable-diffusion" to this project.
  • 5 months ago: STorresi added keyword "imaging" to this project.
  • 5 months ago: STorresi started this project.
  • 5 months ago: STorresi originated this project.

  • Comments

    • STorresi
      5 months ago by STorresi | Reply

      ...and here are the results!

      In paris

      In New York City

    • STorresi
      5 months ago by STorresi | Reply

      These are generated after a bespoke LoRA training using DreamBooth over the JuggernautXL model, which in turn is based on SDXL 1.0.

      As you can see, hands are still tricky (a known issue of diffusion models, apparently), but I didn't try inpainting and img2img fine-tuning, which are supposed to be the go-to way to solve small issues like that. I must say the overall experience was quite painful due to the hardware requirements of SDXL and the amount of memory leaks in pytorch. A high-end consumer grade GPU like an NVIDIA 4080 with 16GB of VRAM often wasn't enough and ran OOM.

    Similar Projects

    A quantum physics experiment puzzle (designed with Google's CP-SAT solver) by moio

    [![link to video player demoing the result](htt...


    Implement Generative AI for SUSE Asset management (using Amazon Bedrock) by mpiala

    [comment]: # (Please use the project descriptio...


    Package MONAI Machine Learning Models for Medical Applications by jordimassaguerpla

    Project Description

    MONAI Deploy aims to ...


    COOTWbot by ngetahun

    [comment]: # (Please use the project descriptio...


    AI frontend to Bugzilla by paolodepa

    Project Description

    Over the years, our b...