IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST
•
18
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
Papers
View all Papers Articles
ibm-research/data-product-benchmark
Viewer • Updated • 33.2k • 463 • 3
ibm-research/900K-Judgements
Viewer • Updated • 939k • 56 • 1
ibm-research/VAREX
Viewer • Updated • 1.78k • 201
ibm-research/BPO-Bench
Preview • Updated • 41 • 1
ibm-research/watsonxDocsQA
Viewer • Updated • 1.22k • 87 • 4
ibm-research/AITQARetrieval
Viewer • Updated • 3.99k • 68
ibm-research/ITBench-Lite
Updated • 1.05k • 5
ibm-research/flow-bench
Viewer • Updated • 546 • 27 • 2
ibm-research/ScarfBench
Updated • 35 • 1
ibm-research/AssetOpsBench
Viewer • Updated • 467 • 671 • 15
ibm-research/FailureSensorIQ
Viewer • Updated • 8.3k • 174 • 6
ibm-research/WatsonxDocsQARetrieval
Viewer • Updated • 1.2k • 37
ibm-research/StatCanDialogueRetrieval
Viewer • Updated • 7.65k • 26
ibm-research/MultiHierttRetrieval
Viewer • Updated • 11.9k • 27
ibm-research/OTTQASmallRetrieval
Viewer • Updated • 31.1k • 21
ibm-research/NQTablesRetrieval
Viewer • Updated • 533k • 65 • 1
ibm-research/OpenWikiTablesRetrieval
Viewer • Updated • 178k • 44
ibm-research/FeTaQARetrieval
Viewer • Updated • 24.7k • 44
ibm-research/rag-hpo-bench
Preview • Updated • 3.62k • 2
ibm-research/acp_bench
Viewer • Updated • 3.72k • 1.79k • 13
ibm-research/dp-bench
Updated • 23 • 1
ibm-research/ITBench-Trajectories
Updated • 166 • 3
ibm-research/nc-bench
Viewer • Updated • 720 • 29 • 1
ibm-research/ReasonLab
Viewer • Updated • 4.35k • 139 • 1
ibm-research/Auto-BenchmarkCard
Viewer • Updated • 105 • 49 • 3
ibm-research/MermaidSeqBench
Viewer • Updated • 132 • 58 • 5
ibm-research/knowledge_consistency_of_LLMs
Preview • Updated • 41 • 3
ibm-research/ToolRM-train-data
Viewer • Updated • 459k • 100 • 7
ibm-research/BFCL-FC-robustness
Updated • 19
ibm-research/SQL-API-Bench
Viewer • Updated • 3.41k • 235 • 4