Computer Environments Elicit General Agentic Intelligence in LLMs

Daixuan Chengαβ, Shaohan Huangβ, Yuxian Guγ, Huatong Songα, Guoxin Chenα

Li Dongβ, Wayne Xin Zhaoα, Ji-Rong Wenα, Furu Weiβ

αGSAI, Renmin University of China   βMicrosoft Research   γTsinghua University

📄 Paper 💻 Code 🤗 Hugging Face

Agentic intelligence in large language models (LLMs) requires not only model intrinsic capabilities but also interactions with external environments. Equipping LLMs with computers now represents a prevailing trend. However, the computer environment's intrinsic value has not been systematically investigated, particularly its potential to elicit general capabilities. Here we introduce LLM-in-Sandbox, which virtualizes the computer as a code sandbox with only basic functionalities, and demonstrate that this minimal setting elicits computer-based meta-capabilities for general task solving: external resource access, file management, and code execution. Without additional training, strong models achieve substantial gains (up to 15.5%) across mathematics, physics, chemistry, biomedicine, long-context understanding, and instruction following, while reducing token consumption by up to 8 times. Furthermore, we develop LLM-in-Sandbox-RL to train models exclusively on non-agentic data within the sandbox, empowering weaker models to harness the environment and internalize these interactions. Our results demonstrate that computer environments elicit general intelligence, yield efficiency gains, and can be harnessed through training, serving as a promising foundation for generalist agents.

Quick Start

# Install our package (requires Docker pre-installed)
pip install llm-in-sandbox
# Run your LLM in sandbox
llm-in-sandbox run \
--query "How many r's are in strawberry?" \
--llm_name your-model \
--llm_base_url http://your-api-server/v1
--api_key your-api-key

Demo Video

Watch LLM-in-Sandbox solve a chemistry problem: converting IUPAC names to SMILES notation

Task: Given a chemical compound's IUPAC name, identify the correct SMILES representation from multiple choices. The agent downloads PubChem package and uses it to convert the name to SMILES. Gold Answer: A

Results

Generalization across diverse LLMs and Domains

LLM-in-Sandbox Results

Citation

If you find our work helpful, please cite us:

@article{cheng2026llm,
  title={Llm-in-sandbox elicits general agentic intelligence},
  author={Cheng, Daixuan and Huang, Shaohan and Gu, Yuxian and Song, Huatong and Chen, Guoxin and Dong, Li and Zhao, Wayne Xin and Wen, Ji-Rong and Wei, Furu},
  journal={arXiv preprint arXiv:2601.16206},
  year={2026}
}