Prometheus와 Grafana로 LLM 추론 모니터링하기 (vLLM, TGI, Llama.cpp)

Monitoring LLM Inference with Prometheus and Grafana (vLLM, TGI, Llama.cpp)