AI Tools Directory

Model EvaluationClear filters

Langfuse

Models & Developer Platforms

Trace and evaluate AI app calls to improve agent quality using operational data.

ObservabilityModel Evaluation

Label Studio

Data Analytics

Annotate text, images, audio, and agent trajectories to prepare data for model training and evaluation.

Data annotationModel Evaluation

MLflow

Models & Developer Platforms

Track model experiments and evaluate AI applications to manage development workflows for models and agents.

Experiment TrackingModel Evaluation

Weights & Biases

Models & Developer Platforms

Track machine learning experiments to observe and evaluate AI model and agent performance.

Experiment TrackingModel Evaluation

Arize

Models & Developer Platforms

Observe and evaluate the performance of AI applications to diagnose issues in models and agents.

ObservabilityModel Evaluation

Respan

API Gateways & Proxies

Unify model gateway, evaluation, and call observability into a single workflow.

AI gatewayModel Evaluation

BenchGen

Agents & Automation

Used for intelligent task processing, supporting model evaluation, general-purpose agents, cloud infrastructure, and data management.

Cloud InfrastructureModel EvaluationGeneral-Purpose Agents

EverMind

Agents & Automation

Designed for intelligent task processing, supporting contextual memory, general-purpose agents, model evaluation, and team collaboration.

Contextual MemoryModel EvaluationGeneral-Purpose Agents

Fiddler AI

Agents & Automation

Designed for intelligent task processing, supporting general-purpose agents, permissions & policy management, and model evaluation.

Permission & Policy ManagementModel EvaluationGeneral-Purpose Agents

Oqoqo

Agents & Automation

Used for intelligent task processing, supporting general agents, model evaluation, agent building, and cloud infrastructure.

Agent BuildingModel EvaluationGeneral-Purpose Agents

Runsight

Agents & Automation

Used for intelligent task processing, supporting workflow orchestration, general-purpose agents, model evaluation, and content design.

Workflow OrchestrationModel EvaluationGeneral-Purpose Agents

Snorkel

Agents & Automation

Designed for intelligent task processing, supporting data management, model evaluation, model training & fine-tuning, and agent building.

Data ManagementModel Training & Fine-TuningModel Evaluation

UserTrace

Agents & Automation

Used for intelligent task processing, supporting model evaluation, model monitoring, and general-purpose agents.

Model MonitoringModel EvaluationGeneral-Purpose Agents

Vivgrid

Agents & Automation

Used for intelligent task processing, supporting general-purpose agents, model evaluation, model monitoring, and model inference.

Model MonitoringModel EvaluationGeneral-Purpose Agents

Acrux Core

General Assistant

Designed for daily Q&A and information processing, supporting prompt resources, model evaluation, and model monitoring.

Prompt ResourcesModel MonitoringModel Evaluation

Artificial Analysis

General Assistant

Designed for daily Q&A and information processing, supporting API calls, model evaluation, and model integration.

API IntegrationModel IntegrationModel Evaluation

Scale AI

General Assistant

Designed for everyday Q&A and information processing, supporting AI system development, model evaluation, and data management.

AI System DevelopmentData ManagementModel Evaluation

Sigma AI

General Assistant

Designed for everyday Q&A and information processing, supporting model evaluation, AI system development, and data management.

AI System DevelopmentData ManagementModel Evaluation

WhatLLM.org

General Assistant

Designed for daily Q&A and information processing, supporting model evaluation, business analysis, and model integration.

Business AnalysisModel IntegrationModel Evaluation

hume

Voice & Transcription

For voice and audio workflows, supporting Q&A chat, user feedback, model evaluation, and API calls.

Model EvaluationUser FeedbackQ&A & Dialogue

Arena AI

Coding & Development

Designed for software development, supporting model integration, model evaluation, and Q&A chat.

Model IntegrationModel EvaluationQ&A & Dialogue

Codeflash

Coding & Development

Designed for software development, supporting model evaluation and automated execution.

Model EvaluationAutomated Execution

Devin

Coding & Development

Designed for software development, supporting model evaluation and autonomous driving.

Model EvaluationAutonomous Driving

IdeaPulley

Coding & Development

Designed for software development, supporting model evaluation and investment research.

Investment ResearchModel Evaluation

Showing24 tools of33 total