LLMOps Tools
- 01. Phoenix provides ML insights at lightning speed with zero-config observability for model drift, performance, and data quality.
- 02. Deep Lake - Store anything. Deploy anywhere. Fine-tune your own LLM models.
- 03. GPTCache : A Library for Creating Semantic Cache for LLM Queries
- 04. Haystack is an open source NLP framework to interact with your data using Transformer models and LLMs (GPT-4, ChatGPT and alike)
- 05. LangChain is a framework for developing applications powered by language models.
- 06. LangKit is an open-source text metrics toolkit for monitoring language models.
- 07. LlamaIndex (GPT Index) is a data framework for your LLM application.
- 08. Promptfoo - Test your prompts. Evaluate and compare LLM outputs, catch regressions, and improve prompt quality.
- 09. TrueFoundry takes care of the tricky details of production machine learning so you can focus on using ML to deliver value. Training jobs, inference services, LLMs, GPUs and more
- 10. ReliableGPT - Get 100% uptime, reliability from OpenAI. Handle Rate Limit, Timeout, API, Keys Errors
- 11. Weights & Biases (Prompts) is a suite of LLMOps tools built for the development of LLM-powered applications.
- 12. xTuring - Easily build, customize and control your own LLMs
- 13. ZenML - Open-source framework for orchestrating, experimenting and deploying production-grade ML solutions, with built-in langchain & llama_index integrations.
- 14. Dify - One API for plugins and datasets, one interface for prompt engineering and visual operation, all for creating powerful AI applications.
- 15. LangFlow is a UI for LangChain, designed with react-flow to provide an effortless way to experiment and prototype flows.