IBM and UC Berkeley Diagnose Why Enterprise Agents Fail Using IT-Bench and MAST
•
18
AI & ML interests
Enterprise AI and ML, Foundation Models, Responsible AI
Recent Activity
View all activity
Papers
View all Papers Articles
ibm-research/data-product-benchmark
Viewer • Updated • 33.2k • 547 • 3
ibm-research/900K-Judgements
Viewer • Updated • 939k • 49 • 1
ibm-research/VAREX
Viewer • Updated • 1.78k • 201
ibm-research/BPO-Bench
Preview • Updated • 32 • 1
ibm-research/watsonxDocsQA
Viewer • Updated • 1.22k • 92 • 4
ibm-research/AITQARetrieval
Viewer • Updated • 3.99k • 67
ibm-research/ITBench-Lite
Updated • 733 • 5
ibm-research/flow-bench
Viewer • Updated • 546 • 26 • 2
ibm-research/ScarfBench
Updated • 32 • 1
ibm-research/AssetOpsBench
Viewer • Updated • 467 • 695 • 14
ibm-research/FailureSensorIQ
Viewer • Updated • 8.3k • 186 • 6
ibm-research/WatsonxDocsQARetrieval
Viewer • Updated • 1.2k • 39
ibm-research/StatCanDialogueRetrieval
Viewer • Updated • 7.65k • 28
ibm-research/MultiHierttRetrieval
Viewer • Updated • 11.9k • 33
ibm-research/OTTQASmallRetrieval
Viewer • Updated • 31.1k • 25
ibm-research/NQTablesRetrieval
Viewer • Updated • 533k • 55 • 1
ibm-research/OpenWikiTablesRetrieval
Viewer • Updated • 178k • 51
ibm-research/FeTaQARetrieval
Viewer • Updated • 24.7k • 44
ibm-research/rag-hpo-bench
Preview • Updated • 3.59k • 2
ibm-research/acp_bench
Viewer • Updated • 3.72k • 1.84k • 13
ibm-research/dp-bench
Updated • 24 • 1
ibm-research/ITBench-Trajectories
Updated • 555 • 3
ibm-research/nc-bench
Viewer • Updated • 720 • 28 • 1
ibm-research/ReasonLab
Viewer • Updated • 4.35k • 144 • 1
ibm-research/Auto-BenchmarkCard
Viewer • Updated • 105 • 55 • 3
ibm-research/MermaidSeqBench
Viewer • Updated • 132 • 62 • 5
ibm-research/knowledge_consistency_of_LLMs
Preview • Updated • 55 • 3
ibm-research/ToolRM-train-data
Viewer • Updated • 459k • 133 • 7
ibm-research/BFCL-FC-robustness
Updated • 15
ibm-research/SQL-API-Bench
Viewer • Updated • 3.41k • 252 • 4