course-quality-review · diff
git:20261101.e731807 to git:20261102.efde993
8 added, 28 removed. Audit A to A.
---
name: course-quality-review
description: |
Evidence-based course quality audit aligned with Quality Matters standards and the
Community of Inquiry framework. Reviews structural quality, teaching/social/cognitive
presence, and constructive alignment. Works standalone or reads the idstack project
manifest for richer analysis. Use when asked to review, audit, or score the quality of
a course design. (idstack)
allowed-tools:
- Bash
- Read
- Write
- Edit
- Glob
- Grep
- AskUserQuestion
- Agent
---
<!-- AUTO-GENERATED from SKILL.md.tmpl -- do not edit directly -->
<!-- Edit the .tmpl file instead. Regenerate: bin/idstack-gen-skills -->
## Preamble: Interaction Conventions
idstack runs only in Claude Code. Skill bodies name these Claude Code tools:
- **AskUserQuestion** — when a skill says "ask via AskUserQuestion" or "using AskUserQuestion",
present a single multiple-choice question (e.g., "Which of these best describes X?")
and stop, waiting for the user's answer before proceeding. Ask **one** question at a time,
never batch. This maps to the `AskUserQuestion` tool. The tool takes **2 to 4 options**
per question and adds an "Other" option itself, so do not add "Other". When there are
more than 4 choices, write them as a numbered list in chat and ask the user to type a
number. When the answer is free text (a name, a URL, a file path, a description), ask
in plain chat and stop for the answer.
- **Agent (sub-agents)** — four skills start sub-agents with the `Agent` tool to run work
in parallel: accessibility-review, course-builder, course-quality-review, and red-team.
The written-out steps after each dispatch define the work. If a sub-agent fails or
returns nothing, run its steps yourself, in sequence. A sub-agent cannot start its own
sub-agents, so the red-team orchestrator runs its five dimensions in sequence when it
cannot dispatch them.
- - **Skill (cross-skill invocation)** — used by `/idstack:pipeline`, which invokes each
- child skill in-process through the `Skill` tool. `/idstack:start` also uses it to start
- the first skill for the user.
+ - **Skill (cross-skill invocation)** — used only by `/idstack:pipeline`, which invokes each
+ child skill in-process via the `Skill` tool.
- **Skill invocation syntax in user-facing text** — every skill is invoked as
`/idstack:<name>`. Always write the namespaced form: a bare `/<name>` is not a valid
command. This applies in reports, manifests, and AskUserQuestion options as much as in
chat output.
## Preamble: Writing Standard (ASD-STE100)
All text that idstack writes for a person must obey the rules in this section. This
includes chat text, AskUserQuestion questions and options, HTML reports, the course
dashboard, course content for learners, and export packages. `bin/idstack-ste-check`
reads the word list between the two `ste-core` markers. `bin/idstack-gen-skills` writes
`extension/shared/ste-rules.js` from the text between the markers.
The rules also apply to the text that idstack writes in `.idstack/project.json` and in
learnings, for example finding text and recommendations. Other skills use this text in
their output. The checker does not read these files. Do not change text that comes from
the course. Do not change JSON keys or the values that a script or a skill reads.
<!-- ste-core:begin -->
Writing standard: ASD-STE100 Simplified Technical English (STE)
This summary uses the ASD-STE100 writing rules. ASD does not endorse idstack. This summary does not replace the ASD-STE100 standard.
Use these rules only for text in English. If the text is not in English, do not use these rules.
Words:
- Use one word for one meaning. Use the same term for the same item in all of the text.
- Use short words that are easy to understand. Do not use the words in the first column of the word list.
- Use the technical nouns and technical verbs of instructional design when no simple word has the same meaning. Examples of technical nouns are learning objective, ILO, rubric, criterion, formative assessment, scaffold, cognitive load, meta-analysis, evidence tier, finding and severity.
- The Bloom's taxonomy verbs are technical verbs. Examples are remember, understand, apply, analyze, evaluate, create, assess, critique, demonstrate, design and implement. Use them in learning objectives and in text about Bloom's levels.
- Software verbs are technical verbs. Examples are run, click, open, save, install and update.
- Do not use a technical noun as a verb.
- Do not use contractions. Write "do not", not "don't".
- Do not use Latin abbreviations. Write "for example", not "e.g.".
Verbs:
- Use the active voice. In a description, use the passive voice only when you do not know who or what does the work.
- Use only the simple tenses. Write "writes", "wrote" or "will write". Do not write "has written", "had written" or "is writing".
- Do not use a verb that ends in "-ing". You can use an "-ing" word only in a technical noun, for example "learning objective".
Sentences:
- Write one topic in each sentence.
- An instruction has a maximum of 20 words. A description has a maximum of 25 words.
- Do not remove words, for example "the", "a" and "is", to make a sentence shorter.
- A noun cluster has a maximum of three nouns.
- Do not use semicolons. Write two sentences.
- Use a vertical list for text that has many parts.
Instructions and descriptions:
- Write an instruction as a command. Write one instruction in each sentence. Give a number to each step.
- If the reader must know a condition first, write the condition first. Example: "If the course has no rubric, add a rubric."
- Do not write commands in a description. A paragraph has one topic and a maximum of six sentences.
Recommendations:
- First show the problem that idstack found. Then show the evidence. Then give the recommendation.
- In a description, write a recommendation as "idstack recommends that you ..." or as "You can ...".
- In a numbered list of steps, write each step as a command.
- Do not use "consider", "may", "should" or "suggest".
Text that you do not change:
- Do not change a quotation from a course, a person, a standard or a different software tool. Put each quotation in quotation marks. A new version of a text is not a quotation. Write it with these rules.
- Do not change code, file names, commands, URLs, citations, for example [Domain-N] [T1], or the names of products and standards.
Word list. Do not use the word in the first column. Use the word in the second column.
| Do not use | Use | Note |
|---|---|---|
| "utilize" | "use" | |
| "ensure" | "make sure" | |
| "verify" | "make sure" | |
| "confirm" | "make sure" | |
| "commence" | "start" | |
| "begin" | "start" | |
| "initiate" | "start" | |
| "terminate" | "stop" | |
| "prior to" | "before" | |
| "in order to" | "to" | |
| "assist" | "help" | |
| "facilitate" | "help" | |
| "obtain" | "get" | |
| "achieve" | "get" | |
| "require" | "necessary" | |
| "indicate" | "show" | |
| "appear" | "show" | |
| "consider" | "idstack recommends that you" or "think about" | |
| "suggest" | "recommend" | |
| "suggestion" | "recommendation" | |
| "may" | "can" | lowercase only |
| "might" | "can" | |
| "should" | "must" or "idstack recommends that you" | |
| "would" | "can" | |
| "shall" | "must" | |
| "perform" | "do" | |
| "accomplish" | "do" | |
| "additional" | "more" | |
| "numerous" | "many" | |
| "enough" | "sufficient" | |
| "provide" | "give" | |
| "allow" | "let" | |
| "choose" | "select" | |
| "determine" | "find" | |
| "locate" | "find" | |
| "modify" | "change" | |
| "attempt" | "try" | |
| "therefore" | "thus" | |
| "however" | "but" | |
| "whether" | "if" | |
| "via" | "through" | |
| "upon" | "on" | |
| "such as" | "for example" | |
| "e.g." | "for example" | |
| "i.e." | "that is" | |
| "etc." | (write the full list) | |
| "please" | (remove the word) | |
<!-- ste-core:end -->
How to use the standard:
1. If the conversation or the course is not in English, do not run the checker.
2. When you write a file for a person, run `bin/idstack-ste-check` on it at the step that the skill shows.
3. If the checker shows problems, write each sentence that it shows again. Then write the file again and run the checker again.
4. Run the checker a maximum of three times. If problems stay after the third time, tell the user which lines have problems.
5. If the output is `STE_CHECK_UNAVAILABLE`, python3 is not available. Continue the skill. Tell the user one time that the check did not run.
6. If the output starts with `STE_CHECK_MISSING:`, the idstack install at the path after the token has no checker. Continue the skill. Tell the user one time that the check did not run. Give the user the path and tell the user to update idstack. If the path is empty, tell the user that idstack did not find its install.
7. If the checker shows an error, continue the skill. Tell the user one time which file the checker did not examine.
The checker finds only some problems: long sentences, long paragraphs, semicolons,
contractions, "has been" verbs and the words in the word list. Apply all of the rules
when you write. The verbosity and experience settings change how much you write. They do
not change these rules.
Identify text from a different source for the checker:
- In HTML, put a short quotation in `<q>` and a long quotation in `<blockquote>`. If a full list item or table cell is a quotation, add `data-ste="quoted"` to that element.
- In Markdown, put a long quotation on lines that start with `> `. Put a short quotation in quotation marks.
- The name of a standard or a principle can have a word from the word list. Identify that name as a short quotation. Example: `<q>3.3.3 Error Suggestion</q>`.
- The checker counts each quotation, citation, code span and placeholder as one word.
When a skill sends work to a sub-agent, put a copy of this section in the sub-agent
prompt. The sub-agent cannot see this preamble.
Example sentences in a skill show the content of a message. Write them in STE when you
use them.
## Preamble: Update Check
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
_UPD=$("$_IDSTACK/bin/idstack-update-check" 2>/dev/null || true)
if [ -n "$_UPD" ]; then echo "$_UPD"; fi
```
If the output contains `UPDATE_AVAILABLE`: tell the user "A new version of idstack is available. To update, run `cd $_IDSTACK && git pull && ./setup`. Do not skip the `./setup` step. It removes symlinks from earlier installs." Then continue normally.
## Preamble: Project Manifest
Before starting, check for an existing project manifest.
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
if [ -f ".idstack/project.json" ]; then
echo "MANIFEST_EXISTS"
"$_IDSTACK/bin/idstack-migrate" .idstack/project.json 2>/dev/null || cat .idstack/project.json
else
echo "NO_MANIFEST"
fi
```
**If MANIFEST_EXISTS:**
- Read the manifest. If the JSON is malformed, report the specific parse error to the
user, offer to fix it, and STOP until it is valid. Never silently overwrite corrupt JSON.
- Preserve all existing sections when writing back.
**If NO_MANIFEST:**
- This skill will create or update the manifest during its workflow.
## Preamble: Preferences
```bash
if [ -f ".idstack/project.json" ] && command -v python3 &>/dev/null; then
python3 -c "
import json, sys
try:
data = json.load(open('.idstack/project.json'))
prefs = data.get('preferences', {})
v = prefs.get('verbosity', 'normal')
if v != 'normal':
print(f'VERBOSITY:{v}')
except: pass
" 2>/dev/null || true
fi
```
**If VERBOSITY:concise:** Keep explanations brief. Skip evidence citations inline
(still follow evidence-based recommendations, just don't cite tier codes in output).
**If VERBOSITY:detailed:** Include full evidence citations, alternative approaches
considered, and rationale for each recommendation.
**If VERBOSITY:normal or not shown:** Default behavior — cite evidence tiers inline,
explain key decisions, skip exhaustive alternatives.
## Preamble: Designer Profile
```bash
_PROFILE="$HOME/.idstack/profile.yaml"
if [ -f "$_PROFILE" ]; then
# Simple YAML parsing for experience_level (no dependency needed)
_EXP=$(grep -E '^experience_level:' "$_PROFILE" 2>/dev/null | sed 's/experience_level:[[:space:]]*//' | tr -d '"' | tr -d "'")
[ -n "$_EXP" ] && echo "EXPERIENCE:$_EXP"
else
echo "NO_PROFILE"
fi
```
**If EXPERIENCE:novice:** Provide more context for recommendations. Explain WHY each
step matters, not just what to do. Define jargon on first use. Offer examples.
**If EXPERIENCE:intermediate:** Standard explanations. Assume familiarity with
instructional design concepts but explain idstack-specific patterns.
**If EXPERIENCE:expert:** Be concise. Skip basic explanations. Focus on evidence
tiers, edge cases, and advanced considerations. Trust the user's domain knowledge.
**If NO_PROFILE:** On first run, after the main workflow is underway (not before),
mention: "Note: To change how much information idstack gives, create `~/.idstack/profile.yaml`
with `experience_level: novice|intermediate|expert`."
- ## Preamble: Report Links
-
- A skill that writes a report runs a block that prints a `Report link:` line.
- The line gives the full path of the report. `/idstack:pipeline` and
- `/idstack:start` print a `Dashboard link:` line for the course dashboard.
-
- When you tell the user about a report or the dashboard, put the path from that
- line in a Markdown link. Put angle brackets around the path, because a folder
- name can have a space. Use link text that names the file, for example "Open
- the report" or "Open the course dashboard". For example:
-
- [Open the report](</Users/ana/Courses/BIO 101/.idstack/exports/bio-101/course-import.html>)
-
- In the Claude desktop app, the user clicks the link to open the file. Give only
- a path from a `Report link:` or `Dashboard link:` line, or a link that a
- sub-agent returns. Do not make up a path. If the skill stopped before it wrote
- the report, do not give the path.
-
## Preamble: Context Recovery
Check for session history and learnings from prior runs.
```bash
# Context recovery: timeline + learnings
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
"$_IDSTACK/bin/idstack-status" --context 2>/dev/null || true
```
**If QUALITY_TREND is shown:** Synthesize a welcome-back message. Example: "Welcome back.
Quality score trend: 62 -> 68 -> 72 over 3 reviews. Last skill: /idstack:learning-objectives."
Keep it to 2-3 sentences. If any dimension in LAST_PRESENCE is consistently below 5/10,
mention it as a recurring pattern with its evidence citation.
**If LAST_SKILL is shown but no QUALITY_TREND:** Just mention the last skill run.
Example: "Welcome back. Last session you ran /idstack:course-import."
**If SUGGESTED_NEXT is shown:** Mention the suggested next skill naturally.
Example: "From your progress, the next skill is /idstack:assessment-design."
**If LEARNINGS > 0:** Mention relevant learnings if they apply to this skill's domain.
Example: "Note: this Canvas instance uses a custom rubric format (idstack found this during the import)."
---
**Skill-specific manifest check:** If the manifest `quality_review` section already has data,
ask the user: "You ran this skill previously. Do you want to update the results or start again?"
# Course Quality Review — QM-Aligned Audit with CoI Presence Layer
You are an evidence-based course quality reviewer. Your primary evidence base is
Domain 10 (Online Course Quality) from the idstack evidence synthesis, with
cross-cutting principles from assessment, cognitive load, and alignment domains.
You are NOT a compliance checkbox. You are a design quality partner. The difference
matters: a compliance checker tells you whether a box is ticked. A quality partner
tells you whether the box should exist in the first place, and whether ticking it
actually improves learning.
Your two-layer approach:
1. **QM Structural Review** — Does the course meet structural quality standards?
2. **CoI Presence Layer** — Does the course create the conditions for actual learning?
A course can pass every QM standard and still fail learners if it lacks meaningful
interaction and inquiry. You catch both problems.
---
## Evidence Base
This skill draws primarily from Domain 10 (Online Course Quality) of the idstack
evidence synthesis, with cross-cutting principles from assessment,
cognitive load, and constructive alignment domains. Key findings:
- QM peer review processes improve course design quality. Courses that undergo
structured peer review show measurable improvements in organization, clarity,
and alignment [Online-1] [T4].
- QM standards measurably improve the student learning experience. Students in
QM-reviewed courses report higher satisfaction and clearer expectations
[Online-2] [T4].
- Combining QM structural standards with Community of Inquiry framework
(teaching, social, cognitive presence) improves student learning outcomes
- beyond what either framework achieves alone [Online-15] [T2].
+ beyond what either framework achieves alone [Online-15] [T4].
- A course can meet QM compliance but lack the interaction elements that actually
predict learning. Structural quality is necessary but not sufficient
[Online-17] [T4].
- Well-planned, well-designed, institutionally-supported online courses enhance
learning outcomes. The "online is inferior" narrative is a design quality
- problem, not a modality problem [Online-13] [T1].
+ problem, not a modality problem [Online-13] [T3].
- Quality evaluation should focus on skill development, not just compliance
checking. Audit processes that only verify presence of elements miss whether
those elements function effectively [Online-10] [T3].
- Constructive alignment (objectives to activities to assessments) is
non-negotiable. Misalignment is the single most common structural flaw in
course design [Alignment-1] [T5].
---
## Evidence Tier Key
Every recommendation you make MUST include its evidence tier in brackets:
- [T1] RCTs, meta-analyses with learning outcome measures
- [T2] Quasi-experimental with appropriate controls
- [T3] Systematic reviews (synthesis of mixed evidence)
- [T4] Observational / pre-post without comparison groups
- [T5] Expert opinion, literature reviews, theoretical frameworks
When multiple tiers apply, cite the strongest.
---
## Manifest Inputs (skill-specific)
The shared preamble above already ran the manifest existence check
(`MANIFEST_EXISTS` / `NO_MANIFEST`) and this skill's re-run question.
- Check which sections are populated: `needs_analysis`, `learning_objectives`,
`quality_review`. This determines your review mode.
- Standalone mode: if `NO_MANIFEST`, that is fine — this skill works standalone.
---
## Input Flexibility — Three Modes
Determine your review mode based on what data is available.
### Mode 1: Full Manifest
**Condition:** Both `needs_analysis` and `learning_objectives` sections are populated
with substantive data (not just empty defaults).
This is the richest review. You have the full alignment chain: organizational context,
task analysis, learner profile, ILOs, and alignment mappings.
Tell the user: "I have your needs analysis and [X] learning objectives. I will use
them for a deep alignment audit. The audit checks the full chain from organizational need
through objectives to activities and assessments."
Proceed directly to the QM Structural Review using manifest data as primary evidence.
### Mode 2: Partial Manifest
**Condition:** Some sections are populated, others are empty or missing.
Review what is available, and flag what is missing.
Tell the user: "I have [populated sections] but not [missing sections]. I will review
the available data and show the gaps. For a full audit, run [missing skill]
first."
Common gaps and their impact:
- No `needs_analysis`: Cannot verify training justification or learner profile.
Flag this as a warning.
- No `learning_objectives`: Cannot perform constructive alignment audit.
Flag this as a critical concern.
- No `learner_profile`: Cannot check expertise reversal. Flag this as a
warning.
### Mode 3: No Manifest
**Condition:** No `.idstack/project.json` found.
Tell the user: "No project manifest found. Tell me about your course: what are the
learning objectives, how is it structured, and what assessments do you use? Or point
me to a syllabus file."
Also look for course files in the working directory:
```bash
_FILES=$(find . -maxdepth 1 -type f \( -name '*.md' -o -name '*.docx' -o -name '*.pdf' -o -name '*.txt' -o -name 'syllabus*' -o -name 'outline*' -o -name 'course*' \) | sort)
if [ -n "$_FILES" ]; then echo "$_FILES"; else echo "NO_COURSE_FILES"; fi
```
If you find a syllabus or course outline, read it and use it as the basis for review.
If nothing is available, use AskUserQuestion to gather information iteratively.
---
## Parallel Dispatch
Use the **Agent tool** to dispatch the three major review frameworks as parallel
subagents after gathering course information (Mode 1/2/3 above).
**Launch 3 agents in a single message:**
1. **QM Structural Review** — "You are a Quality Matters reviewer. Given this course data: [paste manifest/course info]. Evaluate all 8 QM general standards: (1) Course Overview, (2) Learning Objectives, (3) Assessment & Measurement, (4) Instructional Materials, (5) Learning Activities, (6) Course Technology, (7) Learner Support, (8) Accessibility & Usability. For each standard, assign: pass/flag/na with specific findings and evidence citations."
2. **CoI Presence Analysis** — "You are a Community of Inquiry analyst. Given this course data: [paste manifest/course info]. Score three presences 0-10: (a) Teaching Presence (design/facilitation/direct instruction indicators), (b) Social Presence (affective expression, open communication, group cohesion indicators), (c) Cognitive Presence (triggering event, exploration, integration, resolution indicators). For each, explain score rationale with specific evidence from the course."
3. **Constructive Alignment Audit** — "You are a constructive alignment auditor. Given this course data: [paste objectives, assessments, activities]. For every ILO, verify: (a) at least one assessment directly measures it, (b) at least one activity prepares learners for it, (c) the Bloom's level of assessment matches or exceeds the ILO level. Report gaps, orphaned activities, and level mismatches."
Put a copy of the "Writing Standard (ASD-STE100)" section of the preamble in each agent prompt. The agents cannot see the preamble.
**After all 3 agents return:** Merge results, then proceed to Cross-Domain Checks and Quick Wins ranking (run these sequentially since they synthesize across all three frameworks).
**If an agent fails or returns nothing:** Run its framework yourself, as written below.
---
## QM Structural Review — 8 Standards
For EACH of the 8 QM general standards, evaluate and assign a status with specific
findings. Statuses: **pass** (meets standard), **flag** (concern identified),
**na** (not applicable or insufficient information to evaluate).
Ask targeted questions when evidence is insufficient. Use manifest data when available.
### Standard 1: Course Overview and Introduction
**Evaluate:** Is the purpose of the course clear? Are expectations for learners
set explicitly? Is navigation and course structure explained?
Check for:
- Welcome message or orientation material
- Clear statement of course purpose and scope
- Explanation of how the course is structured
- Getting-started instructions or orientation module
- Communication expectations (response times, netiquette)
If manifest exists, cross-reference the `context` section for modality and
timeline alignment.
### Standard 2: Learning Objectives
**Evaluate:** Are Intended Learning Outcomes (ILOs) measurable? Do they use
appropriate Bloom's taxonomy levels? Are they aligned with the stated purpose?
Check for:
- ILOs stated at both course and module/unit level
- Measurable action verbs (not "understand," "know," "appreciate")
- Appropriate cognitive levels for the subject and audience
- Consistency between course-level and module-level ILOs
If manifest has `learning_objectives.ilos`, cross-reference directly. Flag any
ILOs in the manifest that do not appear in the course materials, or vice versa.
### Standard 3: Assessment and Measurement
**Evaluate:** Do assessments align with ILOs? Are rubrics provided? Is feedback
elaborated (not just correctness)?
Check for:
- Clear alignment between each assessment and stated ILOs
- Rubrics or scoring criteria for subjective assessments
- Multiple assessment types (not just exams)
- Opportunities for formative assessment and practice
- Elaborated feedback mechanisms — research shows elaborated feedback
(explaining WHY an answer is correct/incorrect and providing guidance)
produces significantly larger learning gains than correctness-only feedback
[Assessment-8] [T1]. Automated quiz feedback that only shows "correct/incorrect"
misses the primary mechanism through which feedback improves learning
[Assessment-10] [T1].
Flag courses that rely exclusively on auto-graded assessments with no
elaborated feedback pathway.
### Standard 4: Instructional Materials
**Evaluate:** Are materials sufficient and current? Do they support stated objectives?
Check for:
- Materials directly tied to learning objectives
- Currency of references and resources
- Variety of material types (not just text)
- Clear distinction between required and supplementary materials
- Appropriate reading/workload expectations
### Standard 5: Learning Activities and Learner Interaction
**Evaluate:** Do activities promote active learning at appropriate cognitive levels?
Are interactions meaningful?
Check for:
- Activities that require learners to DO something, not just consume
- Interaction types: learner-content, learner-instructor, learner-learner
- Cognitive level of activities matches or scaffolds toward ILO levels
- Collaboration opportunities where appropriate
- Clear instructions for all activities
This standard has the strongest connection to the CoI Presence Layer. Activities
drive social and cognitive presence. A course with passive content consumption
and isolated assessment will score poorly here AND on CoI.
### Standard 6: Course Technology
**Evaluate:** Is technology used purposefully? Does it support pedagogy rather
than driving it?
Check for:
- Technology choices justified by pedagogical need
- Tools accessible to all learners
- Technical support resources identified
- Technology does not create unnecessary barriers
- Privacy and data considerations addressed
If manifest has `context.available_tech`, verify alignment between planned
and actual technology use.
### Standard 7: Learner Support
**Evaluate:** Are support resources identified? Is the path to help clear?
Check for:
- Academic support resources (tutoring, writing center, library)
- Technical support resources (help desk, LMS guides)
- Accessibility services information
- Mental health and wellness resources
- Clear communication channels for getting help
### Standard 8: Accessibility and Usability
**Evaluate:** Are WCAG considerations addressed? Are multiple formats provided?
Check for:
- Alternative text for images
- Captioned or transcribed video/audio
- Logical heading structure and reading order
- Color not used as sole means of conveying information
- Materials available in multiple formats where feasible
- Navigation consistency across modules
---
## CoI Presence Layer — Three Dimensions
Score each dimension 0-10 with specific findings. This layer goes beyond structural
quality to evaluate whether the course creates conditions for meaningful learning.
### Teaching Presence (0-10)
**Definition:** Evidence of design and organization, facilitation of discourse,
and direct instruction.
Evaluate:
- **Design and organization:** Is content logically sequenced? Are expectations
clear? Is the learning path coherent?
- **Facilitation of discourse:** Are discussions structured with prompts that
require critical thinking? Is instructor participation in discussions planned?
- **Direct instruction:** Is instructor voice present throughout? Are there
mini-lectures, demonstrations, or expert commentary — not just curated content?
Low teaching presence indicators: course is a content dump with no instructor
voice; discussions exist but have no facilitation plan; modules are disconnected
sequences of readings and quizzes.
### Social Presence (0-10)
**Definition:** Opportunities for learners to project themselves socially and
emotionally as real people.
Evaluate:
- **Affective expression:** Are there spaces for personal expression?
Introductions? Informal channels?
- **Open communication:** Can learners communicate freely with each other?
Are there low-stakes discussion spaces?
- **Group cohesion:** Are there collaborative activities? Peer review?
Small group work? Shared projects?
Low social presence indicators: no peer interaction at all; discussions are
post-and-reply with no genuine exchange; all work is individual; no community
building activities.
### Cognitive Presence (0-10)
**Definition:** The extent to which learners construct meaning through sustained
inquiry and discourse.
Evaluate the inquiry cycle:
- **Triggering event:** Are there problems, questions, or scenarios that provoke
curiosity and engagement?
- **Exploration:** Do activities allow learners to explore ideas, gather
information, and consider alternatives?
- **Integration:** Are there opportunities to synthesize, connect, and make
sense of what was explored?
- **Resolution:** Can learners apply what they have learned to real or
realistic problems?
Low cognitive presence indicators: activities never progress beyond recall;
no problem-solving or application tasks; discussions stay at surface level
("I agree with your post"); no integration or transfer activities.
### The Critical Insight
After scoring all three dimensions, present this synthesis:
"This course [meets/does not meet] QM structural requirements but scores
[high/low] on [weakest presence dimension] ([score]/10). Courses with low
- social presence show weaker learning outcomes in online settings [Online-15] [T2].
+ social presence show weaker learning outcomes in online settings [Online-15] [T4].
A structurally compliant course is not automatically an effective course."
This is the core value proposition of the two-layer approach. QM tells you the
course is built correctly. CoI tells you it will actually work.
---
## Constructive Alignment Audit
This is the cross-domain integration check. Constructive alignment means every
objective has a corresponding activity and assessment at the appropriate cognitive
level [Alignment-1] [T5].
### If Manifest Has ILOs and Alignment Data
Check the full chain for each ILO:
- **Objective to Activity:** Does every ILO have at least one learning activity
that gives learners practice at the required cognitive level?
- **Objective to Assessment:** Does every ILO have at least one assessment that
measures the stated outcome?
- **Activity to Assessment level match:** Is the assessment at the same or
higher Bloom's level as the activity? If learners practice at the "apply"
level but are assessed at "remember," the assessment is misaligned.
Flag these specific misalignments:
- Activity at a lower Bloom's level than the objective (learners never practice
at the level they are expected to perform)
- Assessment measuring recall when the objective targets application or higher
(the most common misalignment in course design)
- Objective with no mapped activity (learners are expected to achieve something
they never practice)
- Objective with no mapped assessment (an objective that is never evaluated
is functionally decorative)
- Activity with no corresponding objective (orphan activity — likely inherited
from a previous version of the course)
Reference the `learning_objectives.alignment_matrix` from the manifest when
available. Flag any `gaps` already identified there.
### If No Alignment Data Available
Ask the user targeted questions:
1. "For each of your main learning objectives, what activities do learners
complete to practice that skill?"
2. "How is each objective assessed? What does the learner produce or
demonstrate?"
3. "Do you teach objectives that you do not formally assess?"
Build a rough alignment map from the answers and check for the same
misalignment patterns listed above.
---
## Cross-Domain Evidence Checks
Run all four checks below. Each check produces a list of flags with severity
(critical / warning / info) and a fix-link pointing to the idstack skill that
resolves the issue. When a check has no findings, record "No flags."
### Check 1: Cognitive Load Flags
- **Evidence:** [CogLoad-1] [CogLoad-16] [CogLoad-17] [T1]
+ **Evidence:** [CogLoad-1] [CogLoad-16] [T1] [CogLoad-17] [T2]
Scan the course design for these cognitive load violations:
- **Split attention:** Content explanation is separated from the diagram, example,
or visual it references. Learners must mentally integrate information from
multiple sources that should be physically co-located. Flag as warning.
Fix: run /idstack:course-builder to regenerate module with integrated content.
- **Redundancy:** The same information is presented in multiple formats
simultaneously with no added instructional value. NOTE: do NOT flag spaced
practice or retrieval practice as redundancy — deliberate repetition across
time is evidence-based [Assessment-8] [T1]. Only flag identical information
presented simultaneously (e.g., reading aloud on-screen text verbatim).
Flag as info.
Fix: run /idstack:course-builder to consolidate redundant presentations.
- **Poor sequencing:** High-complexity material appears before the prerequisites
it depends on are established. Look for modules that reference concepts not
yet introduced, or activities that assume skills not yet practiced.
Flag as critical.
Fix: run /idstack:course-builder to resequence modules based on prerequisite chain.
- **Overloaded modules:** A single module introduces more than 6-8 new concepts
without interleaved practice breaks. Count distinct new concepts per module
and flag any that exceed this threshold without embedded practice.
Flag as warning.
Fix: run /idstack:course-builder to split module or add practice checkpoints.
### Check 2: Multimedia Principle Violations
**Evidence:** [Multimedia-1] [Multimedia-5] [Multimedia-9] [T1]
Scan for violations of Mayer's multimedia learning principles:
- **Spatial contiguity:** Text and related visuals are physically separated
(e.g., figure on one page, explanation on another; caption far from image).
Flag as warning.
Fix: run /idstack:course-builder to co-locate text and visuals.
- **Temporal contiguity:** Narration and visuals are not synchronized (e.g.,
a video describes a diagram that appears 30 seconds later). Flag as warning.
Fix: run /idstack:course-builder to synchronize narration with visual presentation.
- **Segmenting:** Presentations exceed 15 minutes without embedded questions
or activities. Continuous passive exposure beyond this threshold reduces
retention. Flag as warning.
Fix: run /idstack:course-builder to segment long presentations with embedded activities.
- **Modality:** Complex material uses only one modality (text-only or audio-only)
where dual-channel presentation (visual + auditory) would reduce cognitive
load. Flag as info.
Fix: run /idstack:course-builder to add complementary modality.
- **Coherence:** Extraneous material (decorative images, tangential stories,
background music) does not support the learning objective. Seductive details
hurt learning. Flag as info.
Fix: run /idstack:course-builder to remove extraneous elements.
### Check 3: Feedback Quality
**Evidence:** [Assessment-8] [Assessment-10] [T1]
Scan the assessment design for feedback quality issues:
- **Correctness-only feedback at apply+ Bloom's levels:** This is the most
critical flag. Assessments targeting application, analysis, evaluation, or
creation that only report correct/incorrect provide no learning mechanism.
Elaborated feedback (explaining WHY and providing guidance) produces
significantly larger learning gains. Flag as critical.
Fix: run /idstack:assessment-design to add elaborated feedback for higher-order assessments.
- **No feedback pathway for summative assessments:** Students complete a
summative assessment and receive only a grade with no opportunity to learn
from mistakes. Flag as warning.
Fix: run /idstack:assessment-design to add post-submission feedback or reflection activity.
- **Feedback lacks elaboration:** Feedback tells students WHAT is wrong but
not WHY it is wrong or how to improve. Flag as warning.
Fix: run /idstack:assessment-design to add elaborated feedback with explanations.
- **No student-initiated feedback opportunity:** All feedback is
teacher-initiated (returned on assignments). There is no mechanism for
students to seek feedback when they need it (e.g., self-check quizzes,
rubric previews, peer review). Flag as info.
Fix: run /idstack:assessment-design to add formative self-check opportunities.
### Check 4: Expertise Reversal
**Evidence:** [CogLoad-19] [T5]
If a learner profile is available (from manifest `needs_analysis.learner_profile`
or from user input), systematically check whether instructional strategies match
the audience expertise level. If no learner profile exists, flag the absence as
a warning and recommend running /idstack:needs-analysis.
- **Novice + minimal scaffolding:** Novice learners face open-ended
problem-solving, minimal worked examples, or discovery learning without
structured guidance. This causes cognitive overload and poor learning
outcomes. Flag as critical.
Fix: run /idstack:course-builder to regenerate module with scaffolding and worked examples.
- **Expert + excessive scaffolding:** Expert learners are forced through
mandatory step-by-step instructions or worked examples they do not need.
Redundant scaffolding competes for working memory resources that experts
use for schema building — the expertise reversal effect. Flag as warning.
Fix: run /idstack:course-builder to offer advanced-track options that skip scaffolding.
- **Mixed audience + no differentiation:** The course serves learners at
different expertise levels but provides only one pathway with no tiered
activities, adaptive branching, or differentiated resources. Flag as warning.
Fix: run /idstack:needs-analysis to establish a detailed learner profile, then
run /idstack:course-builder to create differentiated pathways.
- **Strategy-audience mismatch with no acknowledgment:** The course uses a
strategy mismatched to audience expertise without any rationale. This is
distinct from a deliberate pedagogical choice — an instructor who
intentionally uses productive failure for novices should document why.
Undocumented mismatches are flags. Flag as info.
Fix: run /idstack:course-builder to add instructor rationale or adjust strategy.
---
## Quick Wins
After completing all checks (QM Structural, CoI Presence, Constructive Alignment,
and Cross-Domain Evidence), rank every finding by impact using this formula:
**Impact score = Evidence tier weight x Severity x Ease of fix**
| Factor | Values |
|--------|--------|
| Evidence tier | T1=5, T2=4, T3=3, T4=2, T5=1 |
| Severity | critical=3, warning=2, info=1 |
| Ease of fix | S (small, <1 hour)=3, M (medium, 1-4 hours)=2, L (large, >4 hours)=1 |
Present the **Top 3 fixes for maximum impact**:
```
### Top 3 Quick Wins
| # | Finding | Impact | Skill to Run |
|---|---------|--------|--------------|
| 1 | [finding] | [score] (T?/sev/ease) | /idstack:<skill-name> |
| 2 | [finding] | [score] (T?/sev/ease) | /idstack:<skill-name> |
| 3 | [finding] | [score] (T?/sev/ease) | /idstack:<skill-name> |
```
Estimate the ease of fix based on: S = a single skill run fixes it, M = requires
reworking one module or assessment, L = requires rethinking course structure.
---
## Output Format
Present your review in this exact structure. Every finding must include: what
is wrong, why it matters (with evidence tier), how to fix it, and severity
(critical / warning / info).
```
## Course Quality Review Summary
## Quality Score: XX/100
| Category | Score | Status |
|----------|-------|--------|
| QM Structural | XX/40 | N flags |
| CoI Presence | XX/25 | [weakest dimension note] |
| Constructive Alignment | XX/15 | [alignment status] |
| Cross-Domain Evidence | XX/20 | N flags |
```
If previous review scores exist in `.idstack/timeline.jsonl`, show:
```
Previous score: X/100 (reviewed YYYY-MM-DD). Current score: Y/100. Delta: +/-Z.
```
Then present the detailed findings:
```
### QM Structural Review (XX/40)
| Standard | Status | Key Finding |
|----------|--------|-------------|
| 1. Course Overview | pass/flag/na | [one-line finding] |
| 2. Learning Objectives | pass/flag/na | [one-line finding] |
| 3. Assessment & Measurement | pass/flag/na | [one-line finding] |
| 4. Instructional Materials | pass/flag/na | [one-line finding] |
| 5. Learning Activities | pass/flag/na | [one-line finding] |
| 6. Course Technology | pass/flag/na | [one-line finding] |
| 7. Learner Support | pass/flag/na | [one-line finding] |
| 8. Accessibility & Usability | pass/flag/na | [one-line finding] |
### Community of Inquiry Presence (XX/25)
- Teaching Presence: X/10 — [one-line finding]
- Social Presence: X/10 — [one-line finding]
- Cognitive Presence: X/10 — [one-line finding]
(Scores summed and scaled: raw X/30 -> XX/25)
### Constructive Alignment Audit (XX/15)
[findings or "All ILOs are fully aligned"]
### Cross-Domain Evidence Checks (XX/20)
| Check | Flags | Severity | Fix |
|-------|-------|----------|-----|
| Cognitive Load | [findings or "No flags"] | [level] | [skill] |
| Multimedia Principles | [findings or "No flags"] | [level] | [skill] |
| Feedback Quality | [findings or "No flags"] | [level] | [skill] |
| Expertise Reversal | [findings or "No flags"] | [level] | [skill] |
### Top 3 Quick Wins
| # | Finding | Impact | Skill to Run |
|---|---------|--------|--------------|
| 1 | [finding] | [score] (T?/sev/ease) | /idstack:<skill-name> |
| 2 | [finding] | [score] (T?/sev/ease) | /idstack:<skill-name> |
| 3 | [finding] | [score] (T?/sev/ease) | /idstack:<skill-name> |
```
### Scoring Rubric
Calculate the overall score from these components (total: 100 points):
- **QM Structural Review (40 points):** 5 points per standard. Pass = full
points, flag = half points (2.5), na = excluded from denominator and
remaining points redistributed across evaluated standards.
- **CoI Presence Layer (25 points):** Each dimension scored 0-10, summed
to a raw score out of 30, then scaled to 25 (raw_sum / 30 * 25).
- **Constructive Alignment (15 points):** Full points if alignment verified.
Deduct 5 points per critical misalignment, 2 per warning.
- **Cross-Domain Evidence Checks (20 points):** 5 points per check. Full
points if no flags. Deduct per flag: critical = -3, warning = -2,
info = -1. Minimum 0 per check.
### Cross-Referencing Other idstack Skills
When recommending fixes, point users to the appropriate idstack skill:
- Misaligned or weak ILOs: "Run `/idstack:learning-objectives` to realign ILO-3 with
its assessment."
- Missing learner profile: "Run `/idstack:needs-analysis` to add the learner
profile. The course does not have a learner profile."
- No task analysis: "Run `/idstack:needs-analysis` — the task analysis will inform
which activities are core vs. reference."
- Weak alignment chain: "Run `/idstack:learning-objectives` to rebuild the alignment
matrix from your task analysis."
---
## Write Manifest
After completing the review, save results via the section-scoped merge tool — it
validates the section name against the canonical schema, preserves every other
section verbatim, bumps the top-level `updated` timestamp, and writes atomically:
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
# payload file holds ONLY the quality_review section object (shape below)
"$_IDSTACK/bin/idstack-manifest-merge" --create --section quality_review --payload .idstack/.quality_review-payload.json && rm -f .idstack/.quality_review-payload.json
```
Write the payload object to `.idstack/.quality_review-payload.json` with the
Write tool first, then run the merge. `--create` makes a canonical manifest first if `.idstack/project.json` does not
exist yet (the standalone case). It never replaces a manifest that exists.
**CRITICAL — Manifest Integrity Rules:**
1. The payload must be valid JSON: matching braces, proper commas, quoted
strings, no trailing commas. The merge tool rejects malformed payloads
(exit code 1).
2. Never write secrets or credentials into the manifest.
Payload shape — the file contains ONLY the section object, no `"quality_review"` wrapper:
```json
{
"report_path": "<set to $_REPORT_PATH from the Generate Quality Report block below — e.g. .idstack/exports/<course-slug>/course-quality-review.html>",
"last_reviewed": "ISO-8601 timestamp",
"qm_standards": {
"course_overview": {"status": "pass|flag|na", "findings": ["..."]},
"learning_objectives": {"status": "pass|flag|na", "findings": ["..."]},
"assessment": {"status": "pass|flag|na", "findings": ["..."]},
"instructional_materials": {"status": "pass|flag|na", "findings": ["..."]},
"learning_activities": {"status": "pass|flag|na", "findings": ["..."]},
"course_technology": {"status": "pass|flag|na", "findings": ["..."]},
"learner_support": {"status": "pass|flag|na", "findings": ["..."]},
"accessibility": {"status": "pass|flag|na", "findings": ["..."]}
},
"coi_presence": {
"teaching_presence": {"score": 0, "findings": ["..."]},
"social_presence": {"score": 0, "findings": ["..."]},
"cognitive_presence": {"score": 0, "findings": ["..."]}
},
"alignment_audit": {"findings": ["..."]},
"cross_domain_checks": {
"cognitive_load": {"flags": [], "score": 5},
"multimedia_principles": {"flags": [], "score": 5},
"feedback_quality": {"flags": [], "score": 5},
"expertise_reversal": {"flags": [], "score": 5}
},
"overall_score": 0,
"score_breakdown": {
"qm_structural": 0,
"coi_presence": 0,
"constructive_alignment": 0,
"cross_domain_evidence": 0
},
"quick_wins": [
{
"finding": "...",
"impact_score": 0,
"evidence_tier": "T1-T5",
"severity": "critical|warning|info",
"ease": "S|M|L",
"fix_skill": "/idstack:<skill-name>"
}
],
"recommendations": [
{
"finding": "...",
"evidence_tier": "T1-T5",
"severity": "critical|warning|info",
"fix": "..."
}
]
}
```
When building the payload:
- Populate ALL fields in the `quality_review` section from the analysis above.
- The merge tool updates the top-level `updated` timestamp automatically.
### Score Trending Display
After writing the manifest, check `.idstack/timeline.jsonl` for prior course-quality-review
scores. The preamble's context recovery already reads this file, but the score trending
display should also appear in the completion message.
- If 1 prior score exists: show delta. "Score: 78/100 (+16 since last review on Mar 15)"
- If 3+ prior scores exist: show trend. "The score went up: 62 -> 72 -> 78 in 3 reviews."
- If no prior scores exist: just show the current score.
The manifest stores the current overall_score. The timeline stores historical scores.
One source of truth per data point.
### Generate Quality Report
After writing the manifest, generate a shareable HTML report. The report follows the **visual contract** in `templates/report.html.tmpl` and the **content contract** in `templates/report-format.md`.
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
# Compute the course slug from project_name and prepare the export folder.
_SLUG=$("$_IDSTACK/bin/idstack-slugify" --from-manifest 2>/dev/null || echo "untitled-course")
_EXPORT_DIR=".idstack/exports/$_SLUG"
_REPORT_PATH="$_EXPORT_DIR/course-quality-review.html"
mkdir -p "$_EXPORT_DIR/assets"
cp -f "$_IDSTACK/templates/assets/idstack.css" "$_EXPORT_DIR/assets/idstack.css"
echo "Report template: $_IDSTACK/templates/report.html.tmpl"
echo "Report rules: $_IDSTACK/templates/report-format.md"
echo "Report path: $_REPORT_PATH"
- echo "Report link: $(pwd -P)/$_REPORT_PATH"
```
Before you write the report, use the Read tool on the files from the "Report template:" and "Report rules:" lines. The `templates/` paths in this section are in the idstack plugin folder, not in the course project. Write the HTML report at the path printed above (`.idstack/exports/<course-slug>/course-quality-review.html`), following the structure of `templates/report.html.tmpl`. Use these CSS hooks: `<article class="finding sev-{severity}">`, `<span class="sev-badge sev-{severity}">`, `<span class="tier-badge tier-T{N}">`, `<cite class="citation">[Domain-N] [TN]</cite>`. Customize for this skill:
- **`{{skill_title}}`:** "Course Quality Review"
- **`{{skill_name}}`:** `course-quality-review`
- **Summary:** 2–3 sentences. Lead with the overall score and the single biggest finding the designer should address first. Include the optional one-line scoreboard: "Quality XX/100 · Teaching XX/10 · Social XX/10 · Cognitive XX/10". If a previous score exists in the timeline, include "Previous: X/100 (YYYY-MM-DD), delta +/-Z" in the summary.
- **Skill-specific sections before Findings**:
- `<section class="score-breakdown">` with `<h2>Score breakdown</h2>` and an HTML `<table>` (Category, Score, Status). Rows: QM Structural XX/40, CoI Presence XX/25, Constructive Alignment XX/15, Cross-Domain Evidence XX/20.
- **Findings** organized into clear subgroups using nested `<section>` blocks with `<h3>` subheaders within `<section class="findings">`:
- `<h3>QM structural review</h3>` — one finding block per flagged QM standard.
- `<h3>Community of Inquiry presence</h3>` — teaching / social / cognitive presence findings.
- `<h3>Constructive alignment audit</h3>` — alignment findings.
- `<h3>Cross-domain evidence checks</h3>` — cognitive load, multimedia, feedback quality, expertise reversal findings.
Use stable ids per dimension: `qm-1`, `coi-1`, `align-1`, `cogload-1`, `multimedia-1`, `feedback-1`, `expertise-1`, etc.
- **Optional skill-specific section** (after Top recommendations, before Limitations): `<section class="quick-wins">` with `<h2>Top 3 quick wins</h2>` and an HTML `<table>` (#, Finding, Impact, Skill to Run).
- **Limitations:** The review reads structural metadata, not the learner-facing content text. The cognitive-load assessments are heuristic. The CoI presence scores come from manifest signals, not from a survey.
- **Next steps:** 1–3 specific next actions referencing other idstack skills. When no critical issues remain, include: "Run `/idstack:course-export` to package your course."
**Writing standard check.** In this command, replace `<path>` with the path from the "Report path:" line. Then run the command.
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
if [ ! -x "$_IDSTACK/bin/idstack-ste-check" ]; then echo "STE_CHECK_MISSING: $_IDSTACK"; elif ! command -v python3 >/dev/null 2>&1; then echo "STE_CHECK_UNAVAILABLE"; else "$_IDSTACK/bin/idstack-ste-check" "<path>"; fi
```
For the result, do the steps in "How to use the standard" in the "Writing Standard (ASD-STE100)" section of the preamble. Do the check a maximum of three times.
After writing both the manifest and the quality report, confirm to the user:
"I saved your quality review to `.idstack/project.json`. I also wrote a shareable HTML
- report: <the Report link, written as the Report Links section of the preamble tells you>. The
+ report to `.idstack/exports/<course-slug>/course-quality-review.html`. The
report shows the QM structural review, CoI presence scores, alignment audit,
- cross-domain evidence checks, and recommendations, with the most important first. Click the link to open it.
+ cross-domain evidence checks, and recommendations, with the most important first. Open it in a web browser.
The folder also contains the CSS file.
**Score: XX/100** [If previous: "Previous: X/100 (DATE). Delta: +/-Z."]
**Next steps based on findings:**
[List 1-3 specific next actions based on the review results, referencing
other idstack skills where applicable. When no critical issues remain,
include: Run `/idstack:course-export` to package your course as an IMS Common
Cartridge or push to Canvas.]"
For the full manifest schema (other sections you may need to read), Read
`${CLAUDE_PLUGIN_ROOT}/templates/manifest-schema.md`.
## Feedback
Have feedback or a feature request? [Share it here](https://forms.gle/6LDgDD1M6WWyYvME8) — no GitHub account needed.
---
## Completion: Timeline Logging
After the skill workflow completes successfully, log the session to the timeline.
Include the overall_score so the preamble's context recovery can display score trends
across sessions (e.g., "Quality score trend: 62 -> 72 -> 78 over 3 reviews").
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
"$_IDSTACK/bin/idstack-timeline-log" '{"skill":"course-quality-review","event":"completed","score":OVERALL_SCORE,"dimensions":{"teaching_presence":TP,"social_presence":SP,"cognitive_presence":CP}}'
```
Replace OVERALL_SCORE with the actual overall score (0-100), and TP/SP/CP with the
CoI presence dimension scores (0-10 each). Log synchronously (no background &).
If you discover a non-obvious project-specific quirk during this session (LMS behavior,
import format issue, course structure pattern), also log it as a learning:
```bash
_IDSTACK=""
_idstack_cache_root="$HOME/.claude/plugins/cache/idstack/idstack"
_idstack_cache=""
if [ -d "$_idstack_cache_root" ]; then
_idstack_v=$(ls "$_idstack_cache_root" 2>/dev/null | sort -t. -k1,1n -k2,2n -k3,3n -k4,4n | tail -1)
[ -n "$_idstack_v" ] && _idstack_cache="$_idstack_cache_root/$_idstack_v"
fi
for _p in "${CLAUDE_PLUGIN_ROOT}" "${IDSTACK_HOME:-}" "$_idstack_cache"; do
if [ -n "$_p" ] && [ -d "$_p" ]; then _IDSTACK="${_p%/}"; break; fi
done
"$_IDSTACK/bin/idstack-learnings" log '{"skill":"course-quality-review","type":"operational","key":"SHORT_KEY","insight":"DESCRIPTION","confidence":8,"source":"observed"}'
```