Cloud vs. Homelab: Which is Actually Better for LLMs?

I battled my homelab machine cerebro against cloud machines with identical or better GPUs to see if my local setup is worth it or not. The results are interesting to say the least, especially when it comes to multi-gpu tests. Checkout the video and watch me scratching my head given some odd results along the way.

Links from the video 🔥:

GitHub Project with performance data and scripts: https://github.com/tech-grandpa/llmperf (with sources of the video)
SGLang: https://github.com/sgl-project/sglang
vLLM: https://github.com/vllm-project/vllm
Ollama: https://ollama.com
Llama-3.1-8B - FP8: https://huggingface.co/neuralmagic/Meta-Llama-3.1-8B-Instruct-FP8
Llama-3.1-8B - BF16: https://huggingface.co/unsloth/Meta-Llama-3.1-8B-Instruct