ITBench-AA: Frontier Models Score Below 50% on the First Benchmark for Agentic Enterprise IT Tasks — by Artificial Analysis and IBM
• 7
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
View all activity
Papers
Beyond Final Answers: Auditing Trajectory-Level Hallucinations in Multi-Agent Industrial Workflows
Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
Articles
Organization Card
IBM ❤️ Open Source AI
IBM is building enterprise-focused foundation models to drive the future of business.
We strongly believe in the power of collaboration and community-driven development to propel AI forward. As such, we will be hosting our latest open innovations from IBM Research in this Hugging Face organization. We hope that the AI community will find our efforts useful and that our models help fuel their research.
If you have any questions, please visit our discussions page.
A collection of time series models trained by IBM
-
ibm-research/ttm-research-r2
Time Series Forecasting • 855k • Updated • 23.9k • 6 -
ibm-research/ttm-r3
Time Series Forecasting • 1.41M • Updated • 110k • 5 -
ibm-research/flowstate
Time Series Forecasting • 9.07M • Updated • 31.3k • 11 -
ibm-research/patchtst-fm-r1
Time Series Forecasting • 0.3B • Updated • 6.9k • 9
A collection of time series models trained by IBM
-
ibm-research/ttm-research-r2
Time Series Forecasting • 855k • Updated • 23.9k • 6 -
ibm-research/ttm-r3
Time Series Forecasting • 1.41M • Updated • 110k • 5 -
ibm-research/flowstate
Time Series Forecasting • 9.07M • Updated • 31.3k • 11 -
ibm-research/patchtst-fm-r1
Time Series Forecasting • 0.3B • Updated • 6.9k • 9
Enterprise agent ecosystem featuring AssetOpsBench (industrial) and ITBench (SRE, FinOps, CISO), CUGA to accelerate AI Automation
spaces 16
pinned
Running
Agents
7
BlueBench Leaderboard
🥇
An open-source benchmark for enterprise use cases.
Running
18
VAKRA Leaderboard
🏆
Explore AI agent benchmark and submit results
Running
1
ScarfBench
🐠
Java framework migration
Sleeping
2
BPO Benchmark Evaluation
📊
Run BPO recruiting benchmark with CUGA SDK
Sleeping
Agents
8
Ai Atlas Nexus Capabilities
📚
Intent to AI Capability with AI Atlas Nexus
Running
19
AssetOpsBench
🚀
Benchmark asset operation performance in the browser
models 330
ibm-research/demo-hf-model-test
Text Classification • Updated • 6 • 1
ibm-research/biomed.rna.llama.47m.wced.multitask.v1
Feature Extraction • Updated • 79 • 5
ibm-research/biomed.rna.llama.32m.mlm.multitask.v1
Updated • 19 • 4
ibm-research/patchtst-fm-r1
Time Series Forecasting • 0.3B • Updated • 6.9k • 9
ibm-research/ttm-r3
Time Series Forecasting • 1.41M • Updated • 110k • 5
ibm-research/flowstate
Time Series Forecasting • 9.07M • Updated • 31.3k • 11
ibm-research/test-tsfm
Updated
ibm-research/trajcast.models-arxiv2025
Graph Machine Learning • Updated • 91 • 2
ibm-research/test-ttm-r2
805k • Updated • 13
ibm-research/biomed.sm.mv-te-84m-MoleculeNet-ligand_scaffold-BACE-101
Updated • 1.54k • 3
datasets 96
ibm-research/ScarfBench
Updated • 298 • 6
ibm-research/WikiVQABench
Viewer • Updated • 344 • 215 • 6
ibm-research/LLM_Fine-Tuning_Performance
Preview • Updated • 93 • 1
ibm-research/AITQARetrieval
Viewer • Updated • 3.99k • 133
ibm-research/cif-dataset
Viewer • Updated • 301k • 5.21k • 3
ibm-research/hemolab-bench
Viewer • Updated • 49.7k • 581 • 2
ibm-research/MermaidSeqBench
Viewer • Updated • 132 • 80 • 5
ibm-research/STaD
Preview • Updated • 960 • 1
ibm-research/ITBench-Lite
Updated • 947 • 5
ibm-research/AssetOpsBench
Viewer • Updated • 467 • 1.2k • 29