Skip to content

⚔️ Tools

🤖 Products

You can check LMSYS Chatbot Arena Leaderboard to choose the best chatbot for your needs.

⛏️ Development

  • Weights & Biases - Train and fine-tune models, manage models from experimentation to production, and track and evaluate LLM applications.

  • Pytorch - An open-source machine learning library based on the Torch library.

  • LLaMA-Factory - A WebUI for Efficient Fine-Tuning of 100+ LLMs (ACL 2024)

📍 Demo

  • Gradio - Build and share delightful machine learning apps, all in Python.

🏹 Inference

  • Ollama - Get up and running with large language models.

🗡️ Others

  • DeepSpeed - DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

  • vLLM - A high-throughput and memory-efficient inference and serving engine for LLMs.

  • UnSloth - Finetune Llama 3.1, Mistral, Phi & Gemma LLMs 2-5x faster with 80% less memory.

  • nvtop - GPU & Accelerator process monitoring for AMD, Apple, Huawei, Intel, NVIDIA and Qualcomm.