Files
hakorune/tools/selfhost
nyash-codex 9e3b258046 feat(phase-91): JoinIR Selfhost depth-2 advancement - Pattern P5b design & planning
## Overview
Analyzed 34 loops across selfhost codebase to identify JoinIR coverage gaps.
Current readiness: 47% (16/30 loops). Next frontier: Pattern P5b (Escape Handling).

## Current Status
- Phase 91 planning document: Complete
  - Loop inventory across 6 key files
  - Priority ranking: P5b (escape) > P5 (guard) > P6 (nested)
  - Effort estimates and ROI analysis

- Pattern P5b Design: Complete
  - Problem statement (variable-step carriers)
  - Pattern definition with Skeleton layout
  - Recognition algorithm (8-step detection)
  - Capability taxonomy (P5b-specific guards)
  - Lowering strategy (Phase 92 preview)

- Test fixture: Created
  - Minimal escape sequence parser
  - JSON string with backslash escape

- Loop Canonicalizer extended
  - Capability table updated with P5b entries
  - Fail-Fast criteria documented
  - Implementation checklist added

## Key Findings

### Loop Readiness Matrix
| Category | Count | JoinIR Status |
|----------|-------|--------------|
| Pattern 1 (simple bounded) | 16 |  Ready |
| Pattern 2 (with break) | 1 | ⚠️ Partial |
| **Pattern P5b (escape seq)** | ~3 |  NEW |
| Pattern P5 (guard-bounded) | ~2 |  Deferred |
| Pattern P6 (nested loops) | ~8 |  Deferred |

### Top Candidates
1. **P5b**: json_loader.hako:30 (8 lines, high reuse)
   - Effort: 2-3 days (recognition)
   - Impact: Unlocks all escape parsers

2. **P5**: mini_vm_core.hako:541 (204 lines, monolithic)
   - Effort: 1-2 weeks
   - Impact: Major JSON optimization

3. **P6**: seam_inspector.hako:76 (7+ nesting)
   - Effort: 2-3 weeks
   - Impact: Demonstrates nested composition

## Phase 91 Strategy
**Recognition-only phase** (no lowering in P1):
- Step 1: Design & planning 
- Step 2: Canonicalizer implementation (detect_escape_pattern)
- Step 3: Unit tests + parity verification
- Step 4: Lowering deferred to Phase 92

## Files Added
- docs/development/current/main/phases/phase-91/README.md - Full analysis & planning
- docs/development/current/main/design/pattern-p5b-escape-design.md - Technical design
- tools/selfhost/test_pattern5b_escape_minimal.hako - Test fixture

## Files Modified
- docs/development/current/main/design/loop-canonicalizer.md
  - Capability table extended with P5b entries
  - Pattern P5b full section added
  - Implementation checklist updated

## Acceptance Criteria (Phase 91 Step 1)
-  Loop inventory complete (34 loops across 6 files)
-  Pattern P5b design document ready
-  Test fixture created
-  Capability taxonomy extended
-  Implementation deferred (Step 2+)

## References
- JoinIR Architecture: joinir-architecture-overview.md
- Phase 91 Plan: phases/phase-91/README.md
- P5b Design: design/pattern-p5b-escape-design.md

Next: Implement detect_escape_pattern() recognition in Phase 91 Step 2

🤖 Generated with Claude Code

Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
2025-12-16 14:22:36 +09:00
..

Hybrid Selfhost Build (80/20)

Purpose

  • Provide a minimal, fast path to compile Hako source via Hakorune StageB to Program(JSON v0), and optionally run it via CoreDirect (inproc).
  • Future: add MIR emit and ny-llvmc EXE build in small increments.

Script

  • tools/selfhost/selfhost_build.sh
    • --in <file.hako>: input Hako source
    • --json <out.json>: write Program(JSON v0); default: /tmp/hako_stageb_$$.json
    • --mir <out.json>: emit MIR(JSON) from source (runner path)
    • --exe : build native executable via ny-llvmc (llvmlite harness)
    • --run: run via GateC/Core Direct (inproc). Exit code mirrors program return.
    • Env:
      • NYASH_BIN: path to hakorune/nyash binary (auto-detected)
      • NYASH_ROOT: repo root (auto-detected)
      • HAKO_USE_BUILDBOX=1: use BuildBox for emit-only (no run/exe)

Examples

# Emit JSON only (StageB)
tools/selfhost/selfhost_build.sh --in apps/demo/main.hako --json /tmp/demo.json

# Run and use exit code
tools/selfhost/selfhost_build.sh --in apps/demo/return7.hako --run; echo $?

Notes

  • StageB emit uses either the StageB entry or BuildBoxHAKO_USE_BUILDBOX=1 for emit-only
  • Runner executes CoreDirect in-proc under HAKO_CORE_DIRECT_INPROC=1.
  • For heavier cases (bundles/alias/require), keep StageB canaries optin in quick profile.

Stage1 Selfhost Binary (Phase 25.1 — initial wiring)

Purpose

  • Provide a concrete Stage1 binary (hakorune) built from Hako sources.
  • Separate the Rust bootstrap binary (Stage0, nyash) from the Hakorune selfhost binary at the build-script level.

Script

  • tools/selfhost/build_stage1.sh
    • Builds a Stage1 selfhost executable from a Nyash/Hako entry point.
    • Current entry (default):
      • lang/src/runner/launcher.hako — Stage1 CLI launcher (commands: emit program-json/mir-json, etc.).
    • Output:
      • target/selfhost/hakorune by default.

Usage

# Build Stage1 selfhost binary with defaults
tools/selfhost/build_stage1.sh

# Custom output path
tools/selfhost/build_stage1.sh --out /tmp/hakorune-dev

# Custom entry (experimental)
tools/selfhost/build_stage1.sh --entry apps/selfhost-minimal/main.hako --out /tmp/hako_min

How it works

  • Pipeline:
    1. StageB + MirBuilder:
      • tools/hakorune_emit_mir.sh <entry.hako> <mir.json>
    2. LLVM EXE build:
      • tools/ny_mir_builder.sh --in <mir.json> --emit exe -o <exe>
  • The Rust binary (Stage0) is resolved via the existing helpers inside hakorune_emit_mir.sh / ny_mir_builder.sh:
    • Prefers target/release/hakorune when present.
    • Falls back to target/release/nyash otherwise.

Notes

  • This Stage1 binary is a minimal Ny Executor and not yet a full CLI replacement.
  • Full CLI / mode selection for Stage1 will be implemented in later phases; this script focuses on establishing the binary layout and build wiring.

Helper — Stage1 CLI Runner

  • tools/selfhost/run_stage1_cli.sh
    • Wraps a Stage1 binary (default target/selfhost/hakorune) with the required runtime env:
      • NYASH_NYRT_SILENT_RESULT=1Result 行を抑止して JSON stdout を維持)
      • NYASH_DISABLE_PLUGINS=1, NYASH_FILEBOX_MODE=core-roFileBox などのコア実装を強制)
    • Pass arguments verbatim to the Stage1 CLI:
      tools/selfhost/run_stage1_cli.sh emit program-json apps/tests/minimal.hako
      tools/selfhost/run_stage1_cli.sh --bin /tmp/hakorune-dev emit mir-json apps/tests/minimal.hako
      
    • Use this helper (or set the env vars manually) whenever CLI output is consumed by scripts, so that stdout matches llvmlite harness expectations.