ToolQA

ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.

night-chen/ToolQA

View on GitHub ↗

ToolQA, a new dataset to evaluate the capabilities of LLMs in answering challenging questions with external tools. It offers two levels (easy/hard) across eight real-life scenarios.

ToolQA grew -0.3% in the last 30 days, ranks 35th of 67 in Dataset Collections, last commit 1,163 days ago.

Star trajectory

115 days tracked
2026-07-02287 stars today2026-10-25
Momentum

-0.3% in 30d, below the Dataset Collections median of +0.5%.

Maintenance

Last commit 1,163 days ago, staler than the median of 177d.

How it compares in Dataset Collections

ToolQA
287
stars
-0.3% 30d
commit 1,163 days ago
Dataset Collections median
293
stars
+0.5% 30d
commit ~177d ago
Leader · Awesome-Domain-LLM
2.6k
stars
+0.0% 30d
commit 1,033 days ago

Ranked 35th of 67 by stars.

Language
Jupyter Notebook
License
Apache License 2.0
Contributors
2
Forks
12
Watchers
4
Open issues
5
Releases
0
Created
2023-06-06
Stars this week
+0

You've seen where ToolQA stands today.

Get the moves before everyone else: the 5 Dataset Collections repos climbing fastest, every Tuesday.

Free weekly digest. Double opt-in, unsubscribe anytime.

Maintain ToolQA?

Claim this page to add your own call-to-action.

Claim this page