ITBench-AA: Frontier Models Score Below 50% on the First Benchmark for Agentic Enterprise IT Tasks — by Artificial Analysis and IBM
• 10
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
View all activity
Papers
Beyond Final Answers: Auditing Trajectory-Level Hallucinations in Multi-Agent Industrial Workflows
Agentic CLEAR: Automating Multi-Level Evaluation of LLM Agents
Articles
ibm-research/demo-hf-model-test
Text Classification • Updated • 6 • 1
ibm-research/biomed.rna.llama.47m.wced.multitask.v1
Feature Extraction • Updated • 79 • 5
ibm-research/biomed.rna.llama.32m.mlm.multitask.v1
Updated • 19 • 4
ibm-research/patchtst-fm-r1
Time Series Forecasting • 0.3B • Updated • 8.71k • 9
ibm-research/ttm-r3
Time Series Forecasting • 1.41M • Updated • 107k • 5
ibm-research/flowstate
Time Series Forecasting • 9.07M • Updated • 31.5k • 11
ibm-research/test-tsfm
Updated
ibm-research/trajcast.models-arxiv2025
Graph Machine Learning • Updated • 99 • 2
ibm-research/test-ttm-r2
805k • Updated • 13
ibm-research/biomed.sm.mv-te-84m-MoleculeNet-ligand_scaffold-BACE-101
Updated • 1.66k • 3
ibm-research/biomed.sm.mv-te-84m
Updated • 12.1k • 19
ibm-research/materials.smilesdft-clip
Updated • 2
ibm-research/materials.str-bamba
Updated • 14 • 3
ibm-research/biomed.dna.snp.modernbert.113m.v1
Updated • 23 • 5
ibm-research/biomed.dna.ref.modernbert.113m.v1
Updated • 22 • 3
ibm-research/biomed.rna.bert.110m.mlm.rda.v1
Updated • 20 • 3
ibm-research/biomed.rna.bert.110m.mlm.multitask.v1
Updated • 20 • 3
ibm-research/biomed.rna.bert.110m.wced.v1
Updated • 15 • 4
ibm-research/biomed.rna.bert.110m.wced.multitask.v1
Updated • 30 • 5
ibm-research/materials.3dgrid_vqgan
Updated • 39
ibm-research/materials.geodite
Graph Machine Learning • Updated
ibm-research/materials.selfies-ted
Feature Extraction • 0.4B • Updated • 13.1k • • 11
ibm-research/materials.mhg-ged
Feature Extraction • Updated • 345 • 4
ibm-research/materials.pos-egnn
Graph Machine Learning • Updated • 86 • 8
ibm-research/materials.smi-ted
Feature Extraction • Updated • 124 • 34
ibm-research/biomed.sm.mv-te-84m-CYP-ligand_scaffold_balanced-CYP3A4-101
Updated • 11
ibm-research/biomed.sm.mv-te-84m-CYP-ligand_scaffold_balanced-CYP2D6-101
Updated • 10
ibm-research/biomed.sm.mv-te-84m-CYP-ligand_scaffold_balanced-CYP2C9-101
Updated • 10
ibm-research/biomed.sm.mv-te-84m-CYP-ligand_scaffold_balanced-CYP2C19-101
Updated • 10
ibm-research/biomed.sm.mv-te-84m-CYP-ligand_scaffold_balanced-CYP1A2-101
Updated • 11