Abstract
ClawGym presents a scalable framework for developing Claw-style personal agents with synthetic training data, verified workspaces, and benchmark evaluation.
Claw-style environments support multi-step workflows over local files, tools, and persistent workspace states. However, scalable development around these environments remains constrained by the absence of a systematic framework, especially one for synthesizing verifiable training data and integrating it with agent training and diagnostic evaluation. To address this challenge, we present ClawGym, a scalable framework that supports the full lifecycle of Claw-style personal agent development. Concretely, we construct ClawGym-SynData, a diverse dataset of 13.5K filtered tasks synthesized from persona-driven intents and skill-grounded operations, paired with realistic mock workspaces and hybrid verification mechanisms. We then train a family of capable Claw-style models, termed ClawGym-Agents, through supervised fine-tuning on black-box rollout trajectories, and further explore reinforcement learning via a lightweight pipeline that parallelizes rollouts across per-task sandboxes.To support reliable evaluation, we further construct ClawGym-Bench, a benchmark of 200 instances calibrated through automated filtering and human-LLM review. Relevant resources will be soon released at https://github.com/ClawGym.
Community
ClawGym: full-lifecycle framework for Claw-style personal agents
1️⃣ Data: ClawGym-SynData — 13.5K filtered tasks, persona-driven intents × skill-grounded ops, with mock workspaces & hybrid verification
2️⃣ Training: ClawGym-Agents — SFT on black-box rollouts + lightweight RL pipeline parallelizing rollouts across per-task sandboxes
3️⃣ Eval: ClawGym-Bench — 200 instances, auto-filtered & human-LLM reviewed, calibrated for trust
Resources dropping soon https://github.com/ClawGym
Thank you for the suggestion! We recognize the value of this ablation and plan to conduct experiments in future work to evaluate how deterministic checks alone perform on complex tasks, which will further assess the necessity of hybrid verification.
This is an automated message from the Librarian Bot. I found the following papers similar to this paper.
The following papers were recommended by the Semantic Scholar API
- SWE-Shepherd: Advancing PRMs for Reinforcing Code Agents (2026)
- ClawEnvKit: Automatic Environment Generation for Claw-Like Agents (2026)
- ClawGUI: A Unified Framework for Training, Evaluating, and Deploying GUI Agents (2026)
- SWE-Next: Scalable Real-World Software Engineering Tasks for Agents (2026)
- Claw-Eval: Toward Trustworthy Evaluation of Autonomous Agents (2026)
- Toward Scalable Terminal Task Synthesis via Skill Graphs (2026)
- EnterpriseLab: A Full-Stack Platform for developing and deploying agents in Enterprises (2026)
Please give a thumbs up to this comment if you found it helpful!
If you want recommendations for any Paper on Hugging Face checkout this Space
You can directly ask Librarian Bot for paper recommendations by tagging it in a comment: @librarian-bot recommend
Get this paper in your agent:
hf papers read 2604.26904 Don't have the latest CLI?
curl -LsSf https://hf.co/cli/install.sh | bash Models citing this paper 0
No model linking this paper
Datasets citing this paper 3
RUC-AIBOX/ClawGym-Task
Spaces citing this paper 0
No Space linking this paper