Testing vLLM with Open-WebUI - Llama 3 70B Tulu - 4x AMD Instinct Mi60 Rig - 26 tok/s!