Explore Projects
Discover 41 open source projects
Showing 1-20 of 41 projects
huggingface/pytorch-image-models
A collection of PyTorch image encoders/backbones with training, evaluation, and inference scripts.
langfuse/langfuse
LLM engineering platform for observability, evaluation, and prompt management
mastra-ai/mastra
AI-powered app & agent framework for TypeScript
openai/evals
A framework for evaluating large language models (LLMs) and an open-source registry of benchmarks.
ConardLi/easy-dataset
A powerful JavaScript tool for creating datasets for fine-tuning large language models (LLMs) and retrieval-augmented generation (RAG).
promptfoo/promptfoo
A framework for testing and evaluating large language models, prompts, and AI agents for security and performance.
bobthecow/psysh
A REPL (Read-Eval-Print Loop) for PHP, providing a powerful interactive environment for developers.
Arize-ai/phoenix
AI observability and evaluation tooling for developers building with large language models and AI agents.
laravel/tinker
A powerful REPL (Read-Eval-Print Loop) for the Laravel PHP framework.
allenai/OLMo
Modeling, training, evaluation, and inference code for OLMo, a large language model.
prompt-toolkit/ptpython
A feature-rich, interactive Python REPL (Read-Eval-Print Loop) that improves the developer experience.
AgentOps-AI/agentops
Python SDK for AI agent monitoring, LLM cost tracking, benchmarking, and more for vibe coders.
Giskard-AI/giskard-oss
Open-source evaluation and testing library for LLM Agents
Kiln-AI/Kiln
Build, Evaluate, and Optimize AI Systems
openai/simple-evals
Simple-evals is a Python library for running OpenAI's model evaluation scripts.
pydantic/logfire
An AI observability platform for production LLM and agent systems, built with Python and Pydantic.
PrimeIntellect-ai/verifiers
A Python library for reinforcement learning environments and evaluations targeted at AI-focused developers.
EvolvingLMMs-Lab/lmms-eval
A multimodal evaluation toolkit for assessing AI models across text, image, video, and audio tasks.
openai/human-eval
A Python library for evaluating the capabilities of large language models trained on code.
kodjodevf/mangayomi
A free and open-source application for reading manga, novels, and watching animes across multiple platforms.
Stay in the loop
Get weekly updates on trending AI coding tools and projects.