admin-valentin/agent-skill-creator
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions
agent-skill-creator/scenarios/SC-067-validation-result-structure.scenario.md
francylisboacharuto bac2b27bb8 feat: v4.0 Cross-Platform Modernization — Agent Skills Open Standard compliance 
BREAKING CHANGES:
- Remove -cskill suffix from all skill names (use standard kebab-case)
- Simplify marketplace.json to only official fields (fixes Issue #5)
- SKILL.md body must be <500 lines (progressive disclosure via references/)

New features:
- Cross-platform support for 8+ platforms (Claude Code, Copilot, Cursor, Windsurf, Cline, Codex CLI, Gemini CLI)
- scripts/install-template.sh: Auto-detect platform installer with --dry-run
- scripts/validate.py: Spec compliance checker for generated skills
- scripts/security_scan.py: Security scanner for hardcoded keys and dangerous patterns
- MIGRATION.md: v3.x to v4.0 migration guide
- 6 new reference files for progressive disclosure from lean SKILL.md

Key changes:
- SKILL.md: 4,116 → 272 lines with spec-compliant YAML frontmatter
- marketplace.json: Stripped to {name, plugins} only
- article-to-prototype-cskill/ → article-to-prototype/
- stock-analyzer-cskill/ → stock-analyzer/
- Export system integrates validation + security scanning
- README.md rewritten for all supported platforms
- Phase 5 pipeline outputs SKILL.md-first, spec-compliant skills

Co-Authored-By: Claude Opus 4.6 <noreply@anthropic.com>
2026-02-26 14:52:09 -03:00

1.2 KiB
Raw Blame History

SC-067: Validation Returns Correct ValidationResult Structure

Covers: FR-011, Section 5.3 — Validation interface returns ValidationResult with valid, errors, warnings, security Type: Happy Path

Given

  • The validate_skill function is available in scripts/validate.py
  • A valid skill directory test-skill/ exists

When

  • result = validate_skill("test-skill/") is called

Then

  • The result is a ValidationResult object (or dict) with the following fields:
    • valid: bool
    • errors: list of strings (spec violations)
    • warnings: list of strings (recommendations)
    • security: list of strings (security issues)
  • All four fields are present regardless of pass/fail status

Verification Method

Method: Automated test

Steps:

  1. Call validate_skill("test-skill/")
  2. Assert hasattr(result, 'valid') and isinstance(result.valid, bool)
  3. Assert hasattr(result, 'errors') and isinstance(result.errors, list)
  4. Assert hasattr(result, 'warnings') and isinstance(result.warnings, list)
  5. Assert hasattr(result, 'security') and isinstance(result.security, list)

Expected evidence: Result object has all four fields: valid (bool), errors (list), warnings (list), security (list).