Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
44 changes: 22 additions & 22 deletions .claude-plugin/marketplace.json
Original file line number Diff line number Diff line change
Expand Up @@ -2,20 +2,20 @@
"$schema": "https://www.schemastore.org/claude-code-marketplace.json",
"name": "alterlab-academic-skills",
"description": "241 Claude skills for academic research, organized by domain",
"version": "4.0.0",
"version": "4.1.0",
"owner": {
"name": "AlterLab @ Izmir University of Economics"
},
"metadata": {
"description": "241 Claude skills for academic research, organized by domain",
"version": "4.0.0"
"version": "4.1.0"
},
"plugins": [
{
"name": "alterlab-bioinformatics",
"source": "./skills/bioinformatics",
"description": "Genomics, proteomics, and single-cell analysis (Scanpy, BioPython, pysam, ESM) (38 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -76,7 +76,7 @@
"name": "alterlab-cheminformatics",
"source": "./skills/cheminformatics",
"description": "Chemistry and drug discovery (RDKit, docking, ADMET, mass spec) (12 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -111,7 +111,7 @@
"name": "alterlab-clinical-research",
"source": "./skills/clinical-research",
"description": "Clinical decision support, medical imaging, and regulatory workflows (7 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -140,7 +140,7 @@
"name": "alterlab-core",
"source": "./skills/core",
"description": "Core research-to-publication pipeline plus teaching and thesis tools (10 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -217,7 +217,7 @@
"name": "alterlab-data-science",
"source": "./skills/data-science",
"description": "Machine learning and statistics (scikit-learn, PyTorch, transformers, SHAP) (22 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -262,7 +262,7 @@
"name": "alterlab-databases",
"source": "./skills/databases",
"description": "Connectors to scientific databases (PubMed, ChEMBL, UniProt, GEO, and more) (38 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -325,7 +325,7 @@
"name": "alterlab-document-tools",
"source": "./skills/document-tools",
"description": "Document and Markdown conversion (MarkItDown, Open Notebook) (3 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand All @@ -349,7 +349,7 @@
"name": "alterlab-domain-specific",
"source": "./skills/domain-specific",
"description": "Quantum computing, geospatial, materials, astronomy, and digital humanities (18 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -390,7 +390,7 @@
"name": "alterlab-faculty-life",
"source": "./skills/faculty-life",
"description": "Faculty research-lifecycle and academic administration (syllabus AI-policy, IRB/consent, post-award grant admin, recommendation letters, accreditation AoL) (6 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -420,7 +420,7 @@
"name": "alterlab-finance-economics",
"source": "./skills/finance-economics",
"description": "Economic and financial data (FRED, Alpha Vantage, SEC EDGAR, market research) (7 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -450,7 +450,7 @@
"name": "alterlab-lab-integrations",
"source": "./skills/lab-integrations",
"description": "Laboratory platforms (Benchling, DNAnexus, Opentrons, Protocols.io) (9 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -481,7 +481,7 @@
"name": "alterlab-methodology",
"source": "./skills/methodology",
"description": "Research methodology and rigor scaffolds (Iron Laws, rationalization tables, decision flowcharts, systematic-reasoning checklists) (3 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand All @@ -507,7 +507,7 @@
"name": "alterlab-research-tools",
"source": "./skills/research-tools",
"description": "Search, discovery, Zotero, qualitative methods, ethics, and open science (14 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -544,7 +544,7 @@
"name": "alterlab-social-science-workflow",
"source": "./skills/social-science-workflow",
"description": "Stage-gated social-science methods spine — orchestrator + 5 validity gates (design/identifying-assumption, measurement, sampling/power, reflexivity, inference) and 11 analysis modules (causal inference, complex-survey analysis, SEM/psychometrics, multilevel models, QCA, SNA, ABM, text-as-data, qualitative analysis, meta-analysis, missing data) (17 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand All @@ -566,7 +566,7 @@
"name": "alterlab-turkish-academia",
"source": "./skills/turkish-academia",
"description": "Turkish academic system workflows (YÖK, ÜAK, DergiPark, YÖK-Tez, TÜBİTAK, doçentlik) (13 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -603,7 +603,7 @@
"name": "alterlab-visualization",
"source": "./skills/visualization",
"description": "Publication-quality plotting and schematics (Matplotlib, Seaborn, Plotly) (9 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -635,7 +635,7 @@
"name": "alterlab-workflows",
"source": "./skills/workflows",
"description": "Runnable multi-agent research workflows for Claude Code (systematic-review screening, citation audit, review panel, claim stress-test, rebuttal, grant mock panel, literature map) plus the portable playbook skill (1 skill)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand All @@ -657,7 +657,7 @@
"name": "alterlab-writing-tools",
"source": "./skills/writing-tools",
"description": "Scientific writing, citations, grants, posters, and academic career (14 skills)",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down Expand Up @@ -694,7 +694,7 @@
"name": "alterlab-complete",
"source": "./plugins/alterlab-complete",
"description": "The complete AlterLab Academic Skills suite — installs every domain plugin in one step",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand All @@ -713,7 +713,7 @@
"name": "alterlab-essentials",
"source": "./plugins/alterlab-essentials",
"description": "Faculty starter kit — installs the core research-to-publication pipeline, the multi-agent research workflows, research tools, writing tools, methodology gates, and scientific-database connectors in one step",
"version": "4.0.0",
"version": "4.1.0",
"author": {
"name": "AlterLab @ Izmir University of Economics",
"url": "https://github.com/AlterLab-IEU"
Expand Down
94 changes: 94 additions & 0 deletions CHANGELOG.md
Original file line number Diff line number Diff line change
Expand Up @@ -6,6 +6,100 @@ and the project adheres to [Semantic Versioning](https://semver.org/spec/v2.0.0.

## [Unreleased]

## [4.1.0] — 2026-11-05

A second reliability repair, prompted by an external review of 4.0.0 (commit `6fa2616`). Every
finding was reproduced on that commit before it was changed; the mapping of all 20 findings to
fixes, tests and remaining limits is in
[`docs/reliability-review-4.0.0.md`](docs/reliability-review-4.0.0.md). No skills were added
or removed. This release changes report schemas and status vocabulary (see *Compatibility*).

### Changed — citation verification (`alterlab-citation-verifier`, tool 2.0.0, report schema 2)

- **Existence and metadata are separate.** A DOI that resolves no longer clears the cited
metadata: an author the record does not list makes the entry `PAC` (flag
`UNSUPPORTED_AUTHOR`, names in `metadata.authors.unsupported`). "et al." and BibTeX "and
others" are honoured; missing record metadata is `unknown` / `not_checked`, never agreement.
- **Surnames are compared token-wise**, never by substring ("Li" no longer matches "Williams"),
with explicit variants: accents, LaTeX, German umlauts, particles, compound surnames,
organisations by name or acronym.
- **Absence from indexes is not fabrication.** It is `NOT_FOUND` (run verdict
`REVIEW_REQUIRED`); an unregistered DOI or nonexistent arXiv ID is `ID_INVALID`. The script
no longer emits `TF`, which is reserved for an analyst's conclusion after a documented manual
search. Malformed DOIs are reported.
- **One unreachable source no longer stops verification**: it is recorded as not checked, the
other sources are still asked, and the host is paused for 60 s.
- **Retraction status is three-state** (`flagged`, `not_flagged_in_checked_sources`,
`unknown`) with the sources that answered and the time; `retracted` is `null` when unknown.
- The citation-audit workflow reports `NOT_FOUND` and `ID_INVALID` instead of relabelling
absence as `TF`, and counts found works whose retraction status is unknown.

### Changed — scholarly retrieval (`alterlab-research-lookup`, output schema 2)

- Query terms keep every script (Turkish, Greek, CJK); nothing is transliterated.
- Explicit search syntax (`--terms`, quotes, AND / OR / NOT, parentheses) is parsed and
translated per index; where an index cannot express it the query is labelled approximate or
the index is skipped with a reason (`query_translation`).
- De-duplication never merges on an empty or truncated key; preprint and published versions
with different DOIs stay separate; every merged record keeps `merged_from` provenance.
- The default order is relevance; `--rank cited` orders by one declared index (`--cite-index`).
`--rank auto` was removed.
- New `--since` / `--until`, translated per index and re-checked client-side; "recent"
wording is disclosed, never turned into a hidden filter.

### Changed — presentation validation (`alterlab-scientific-slides`)

- `validate_presentation.py` reports `status` valid / invalid / blocked / partial with a
`checks` list and exits 0 / 1 / 2 / 3. A missing required parser, an unsupported format
(including `.ppt`) or a missing compiler is `blocked`, never a pass; `valid` is true only for
status valid. `--json` added.
- PPTX font sizes are resolved through the inheritance chain (paragraph, list styles, layout and
master placeholders, master text styles, presentation default, autofit); grouped shapes and
table cells are checked; unresolved sizes make the check incomplete.

### Changed — evaluation tooling

- `run_benchmark.py` (scoring schema 2): conflicting duplicate answers for one item are
`unresolved_conflict`, never correct; evidence text is kept; label accuracy is reported
separately from two deterministic evidence checks, other evidence is `needs_review`
(`--export-evidence-review`). Published benchmark numbers are schema 1 and not directly
comparable.
- `run_evals.py` (results schema 2): `--regrade` exit codes now reflect every requested file
(0 / 1 / 2 / 3, as `--behavioral`); `--judge` applies to `--behavioral` (default `substance`)
and is recorded with its prompt hash; both arms are graded on identical substantive criteria,
with routing and skill-vocabulary assertions as separate dimensions; `--audit-rubrics` lists
rubric text that requires internal names; declared output files are checked by
`scripts/artifact_checks.py` before the workspace is deleted and stored with hashes.
- New `scripts/aggregate_results.py`: reproducible summaries from versioned records with
explicit selection rules and denominators. The raw records behind the published 4.0.0 totals
are not in the repository, so those totals cannot be reconstructed from this checkout.
- New `scripts/activation_eval.py` with 40 hand-written activation cases (English and Turkish,
ambiguous, distractor and unavailable-skill cases over realistic install profiles).
- New `scripts/check_workflow_run.py` and minimal fixtures for the seven dynamic workflows.
- Dev dependencies gain `python-pptx`, `pypdf` and `pymupdf<2`, so the slide-validator tests run
instead of skipping.

### Live validation recorded (2026-11-05, Claude Code CLI login, no API key)

- Activation set, one vote per case: 39 / 40 counted successes; one false activation
(`docs/activation.md`, raw records in `benchmarks/activation/results/`).
- Judge calibration: literal 12 / 13, substance 13 / 13 (`docs/evals.md`).
- Dynamic workflows: see `docs/workflow-validation.md` for which workflows were run live and
which remain dry-run only.

### Compatibility

- Citation verifier: consumers that treated `TF` as "absent from the indexes" must read
`NOT_FOUND` / `ID_INVALID`; `summary.verdict` can now be `REVIEW_REQUIRED`; `retracted` can
be `null`. All v1 keys are still present.
- citation-audit workflow: `counts.TF` is gone; read `counts.NOT_FOUND` and `counts.ID_INVALID`.
- Research lookup: the default order changed from citation count to relevance; `--rank auto`
is an error.
- Slide validator: exit codes and the meaning of `valid` changed.
- Eval results: `run_evals.py` writes `schema_version` 2; the default rubric judge for
`--behavioral` is now `substance`, so new runs are not directly comparable with the 4.0.0
results (literal judge). Use `--judge literal` for comparison.

## [4.0.0] — 2026-11-04

**Why a major version.** These changes alter what existing users, scripts and installs get back:
Expand Down
4 changes: 2 additions & 2 deletions CITATION.cff
Original file line number Diff line number Diff line change
Expand Up @@ -7,8 +7,8 @@ abstract: >-
audits, and bilingual (English/Turkish) documentation. A content fork of K-Dense-AI's
scientific-agent-skills, re-aimed at the academic faculty and research-lifecycle audience.
type: software
version: 4.0.0
date-released: "2026-11-04"
version: 4.1.0
date-released: "2026-11-05"
license: MIT
repository-code: "https://github.com/AlterLab-IEU/AlterLab-Academic-Skills"
url: "https://github.com/AlterLab-IEU/AlterLab-Academic-Skills"
Expand Down
Loading
Loading