Scholar Evaluation
Qualitative-first, evidence-traceable developmental review for papers, protocols and research ideas.
EducationAdvanced★ 33,030⑂ 3,248AI score 8/10Last updated: Aug 9, 2026
What it does
Delivers developmental feedback on a scholarly work — paper, draft, protocol, literature synthesis or research idea — leading with qualitative judgment; optional scores only map submitted evidence onto a predeclared bounded rubric.
- Forces you to define the construct before writing criteria.
- Ships offline Python 3.11 CLIs (no network, no credentials, no subprocesses) for rubric validation, bounded scoring, evidence traceability, inter-rater agreement, weight sensitivity and a fail-closed process checklist.
- Bans quality inference from impact factor, h-index, citation counts, venue or institutional prestige.
- Keeps
missingandnot_applicabledistinct from zero, and observation distinct from interpretation.
⚠️ Explicitly prohibited for hiring, promotion, admissions, funding, awards or discipline. It never ranks people.
Who it's for
- Journal/conference reviewers, thesis advisors and lab-internal review leads.
- Research groups that want a repeatable, documented critique workflow.
- Staff auditing whether a low-stakes assessment process documents provenance, uncertainty, fairness and appeals.
Examples
- Pre-submission self-check: break your draft down criterion by criterion, log strengths, limitations and non-prescriptive improvement options with evidence locators.
- Group review: have three reviewers rate independently, then run
summarize_agreement.pyon the CSV to surface disagreements before a calibration meeting. - Process audit: run
check_process.pyagainst a departmental seminar review to confirm appeal routes, accessibility accommodations and retention policy are documented.
· · · Install guide · · ·
Install in the Claude app (no terminal)
- Download the ZIP with the button below.
- In Claude, open Settings → Capabilities and turn on 'Code execution and file creation'. (one time)
- Go to Customize → Skills → + → 'Upload a skill' and upload the ZIP.
Install in Claude Code
Let Claude do it — paste this into Claude Code
Install the skill I found on Claude Skill Mart. Copy the skills/scholar-evaluation folder from the GitHub repo K-Dense-AI/scientific-agent-skills into my ~/.claude/skills/scholar-evaluation/. When it's done, tell me in one line what this skill can do.
Install with a command instead
git clone https://github.com/K-Dense-AI/scientific-agent-skills.git && cp -r scientific-agent-skills/skills/scholar-evaluation ~/.claude/skills/⚠ This is a third-party skill. Check the source repository before installing.
- Open a terminal.
- Clone the repository:
git clone https://github.com/K-Dense-AI/scientific-agent-skills.git - Create the skills folder if needed:
mkdir -p ~/.claude/skills - Copy the skill:
cp -r scientific-agent-skills/skills/scholar-evaluation ~/.claude/skills/ - Verify Python:
python3 --version(3.11+ required for the optional bundled CLIs). - Restart Claude Code and try: "Use scholar-evaluation to give developmental feedback on my draft."
- Read
references/responsible_assessment.mdbefore any organizational use.
View source on GitHub ↗License: MIT