From 51d2cb2c97f22d1fbb80677c4d32154e19cb1f9a Mon Sep 17 00:00:00 2001 From: Yuki Watanabe <31463517+B-Step62@users.noreply.github.com> Date: Fri, 14 Mar 2025 21:33:29 +0900 Subject: [PATCH] Add MLflow for LLM monitoring MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Hi! This is an awesome list, thank you for putting this many resources together🙌 This PR adds MLflow in the LLM monitoring section for completeness. It provides open-telemetry based tracing and evaluation solution: https://mlflow.org/docs/latest/tracing --- README.md | 1 + 1 file changed, 1 insertion(+) diff --git a/README.md b/README.md index 33a9093..a66d5a1 100644 --- a/README.md +++ b/README.md @@ -220,6 +220,7 @@ This repository contains a curated list of 120+ LLM libraries category wise. | Library | Description | Link | |----------------------|-------------------------------------------------------------------------------------------------|-------| +| MLflow | An open-source end-to-end MLOps/LLMOps Platform for tracking, evaluating, and monitoring LLM applications. | [Link](https://github.com/mlflow/mlflow) | | Opik | An open-source end-to-end LLM Development Platform which also includes LLM monitoring. | [Link](https://github.com/comet-ml/opik) | | LangSmith | Provides tools for logging, monitoring, and improving your LLM applications. | [Link](https://github.com/langchain-ai/langsmith-sdk) | | Weights & Biases (W&B) | W&B provides features for tracking LLM performance. | [Link](https://github.com/wandb) |