Awesome-LLM4Tool is a curated list of the papers, repositories, tutorials, and anythings related to the large language models for tools.

ToolQA: A Dataset for LLM Question Answering with External Tools
Yuchen Zhuang, Yue Yu, Kuan Wang, Haotian Sun, Chao Zhang
[arXiv] [Code]
June 23 2023

On the Tool Manipulation Capability of Open-source Large Language Models
Qiantong Xu, Fenglu Hong, Bo Li, Changran Hu, Zhengyu Chen, Jian Zhang
[arXiv] [Code]
May 25 2023

🦍 Gorilla: Large Language Model Connected with Massive APIs
Shishir G. Patil*, Tianjun Zhang*, Xin Wang, Joseph E. Gonzalez
[arXiv] [Project Page] [Code]
May 24 2023

ToolkenGPT: Augmenting Frozen Language Models with Massive Tools via Tool Embeddings
Shibo Hao, Tianyang Liu, Zhen Wang, Zhiting Hu
[arXiv] [Code]
May 19 2023

InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
Zhaoyang Liu, Yinan He, Wenhai Wang, Weiyun Wang, Yi Wang, Shoufa Chen, Qinglong Zhang, Zeqiang Lai, Yang Yang, Qingyun Li, Jiashuo Yu, Kunchang Li, Zhe Chen, Xue Yang, Xizhou Zhu, Yali Wang, Limin Wang, Ping Luo, Jifeng Dai, Yu Qiao
[arXiv] [Project Page] [Code]
May 9 2023

GPT4Tools: Teaching LLM to Use Tools via Self-instruction
Lin Song, Yanwei Li, Rui Yang, Sijie Zhao, Yixiao Ge, Ying Shan
[arXiv] [Huggingface] [Code]
April 24 2023

🌋 LLaVA: Large Language and Vision Assistant
Haotian Liu*, Chunyuan Li*, Qingyang Wu, Yong Jae Lee
[arXiv] [Project Page] [Code]
April 18 2023

API-Bank: A Benchmark for Tool-Augmented LLMs
Minghao Li, Feifan Song, Bowen Yu, Haiyang Yu, Zhoujun Li, Fei Huang, Yongbin Li
[arXiv]
April 14 2023

HuggingGPT: Solving AI Tasks with ChatGPT and its Friends in HuggingFace
Yongliang Shen, Kaitao Song, Xu Tan, Dongsheng Li, Weiming Lu and Yueting Zhuang
[arXiv] [Huggingface] [Code]
Mar 30 2023

Visual ChatGPT: Talking, Drawing and Editing with Visual Foundation Models
Chenfei Wu, Shengming Yin, Weizhen Qi, Xiaodong Wang, Zecheng Tang, Nan Duan
[arXiv] [Huggingface] [Code]
Mar 8 2023

Toolformer: Language Models Can Teach Themselves to Use Tools
Timo Schick, Jane Dwivedi-Yu, Roberto Dessì, Roberta Raileanu, Maria Lomeli, Luke Zettlemoyer, Nicola Cancedda, Thomas Scialom
[arXiv] [Code]
9 Feb 2023

Visual Programming: Compositional Visual Reasoning without Training
Tanmay Gupta, Aniruddha Kembhavi
[arXiv] [Code]
Nov 18 2022

TALM: Tool Augmented Language Models
Aaron Parisi, Yao Zhao, Noah Fiedel
[arXiv]
May 24 2022

MRKL Systems: A modular, neuro-symbolic architecture that combines large language models, external knowledge sources and discrete reasoning
Ehud Karpas, Omri Abend, Yonatan Belinkov, Barak Lenz, Opher Lieber, Nir Ratner, Yoav Shoham, Hofit Bata, Yoav Levine, Kevin Leyton-Brown, Dor Muhlgay, Noam Rozen, Erez Schwartz, Gal Shachaf, Shai Shalev-Shwartz, Amnon Shashua, Moshe Tenenholtz
[arXiv] [Code]
May 1 2022

• Auto-GPT
• semantic-kernel

• LLM Powered Autonomous Agents