Agent Research Aggregator
Scans AI agent caches (.claude, .cursor, and more) to turn scattered experiment logs into PaperOrchestra-ready idea.md and experimental_log.md.
What it does
This skill crawls AI coding-agent cache directories (.claude, .cursor, .antigravity, .openclaw) or any folder you point it at, finds experimentation logs, extracts hypotheses, methods and numeric results, and consolidates them into a single coherent research narrative. The output lands in workspace/inputs/idea.md and workspace/inputs/experimental_log.md, exactly the (I, E) pair the PaperOrchestra paper-writing pipeline expects.
It runs in five phases:
- Discovery —
discover_logs.pybuilds a manifest and prints the list of projects found. - Project selection — a paper must come from one project, so the skill always asks you to pick one before any LLM work.
- Extraction & synthesis — logs are processed in ~50 KB batches into structured JSON, then merged into one research question, contributions, and result tables.
- Formatting — deterministic script writes the two input files with GFM tables.
- Audit report — scan statistics, data-quality warnings, and the files still missing.
Safety rules are explicit: never write to cache directories, strip PII and credentials, never fabricate results (low-confidence numbers get an [UNVERIFIED] tag), and confirm with the user when more than 50 files are found.
Who it's for
- Researchers who ran many agent-driven experiments but kept no structured lab notebook.
- Grad students racing a conference deadline who need setup sections and result tables fast.
- Anyone wanting to run PaperOrchestra without existing
idea.md/experimental_log.md. - Teams whose work history is spread across several agent tools.
Examples
- "Aggregate my agent logs for paper writing" → the skill scans cwd and
~, shows a numbered project list, and generates both input files for the project you choose. - Use
--search-roots ~/projects/rl-exp --since 2025-01-01 --depth 3to limit the scan to one project's recent experiments. - If the audit report flags conflicting metrics, inspect the source logs, keep the verified numbers, and re-run the formatting phase.
· · · Install guide · · ·
Try it now, no install
Paste this into Claude to use the skill without installing anything.
Read the instructions in this file and follow them to help me: https://raw.githubusercontent.com/Ar9av/PaperOrchestra/HEAD/skills/agent-research-aggregator/SKILL.md What I want: (describe your task here)
If Claude can't open the link, open it yourself and paste the contents instead.
↓ If it works for you, download the ZIP below and install it. Then it runs on its own — no pasting each time.
Install in the Claude app (no terminal)
- Download the ZIP with the button below.
- In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
- Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Install in Claude Code
Let Claude do it — paste this into Claude Code
Install the skill I found on Claude Skill Mart. Copy the skills/agent-research-aggregator folder from the GitHub repo Ar9av/PaperOrchestra into my ~/.claude/skills/agent-research-aggregator/. When it's done, tell me in one line what this skill can do.
Install with a command instead
git clone https://github.com/Ar9av/PaperOrchestra.git && cp -r PaperOrchestra/skills/agent-research-aggregator ~/.claude/skills/⚠ This is a third-party skill. Check the source repository before installing.
- Open a terminal and move to the folder where you keep tools.
- Clone the repository:
git clone https://github.com/Ar9av/PaperOrchestra.git - Copy the skill into place:
mkdir -p ~/.claude/skills && cp -r PaperOrchestra/skills/agent-research-aggregator ~/.claude/skills/ - Verify the
scripts/folder (discover_logs.py,extract_experiments.py,format_po_inputs.py) andreferences/prompt files came along; also copy thepaper-orchestraskill if you plan to write the full paper. - Check Python 3 is available with
python --version. - Restart Claude Code, then ask something like: "Prepare PaperOrchestra inputs from the agent logs in ~/projects/my-experiment" — always name a folder to avoid scanning your whole home directory.
- Answer the project-selection question, then review the generated
workspace/inputs/idea.mdandexperimental_log.md. - To continue into paper generation, supply your conference
template.texandconference_guidelines.md.