Files

nyash-codex df9068a555 feat(stage-b): Add FLOW keyword support + fix Stage-3 keyword conflicts

## ✅ Fixed Issues

### 1. `local` keyword tokenization (commit 9aab64f7)
- Added Stage-3 gate for LOCAL/TRY/CATCH/THROW keywords
- LOCAL now only active when NYASH_PARSER_STAGE3=1

### 2. `env.local.get` keyword conflict
- File: `lang/src/compiler/entry/compiler_stageb.hako:21-23`
- Problem: `.local` in member access tokenized as `.LOCAL` keyword
- Fix: Commented out `env.local.get("HAKO_SOURCE")` line
- Fallback: Use `--source` argument (still functional)

### 3. `flow` keyword missing
- Added FLOW to TokenType enum (`src/tokenizer/kinds.rs`)
- Added "flow" → TokenType::FLOW mapping (`src/tokenizer/lex_ident.rs`)
- Added FLOW to Stage-3 gate (requires NYASH_PARSER_STAGE3=1)
- Added FLOW to parser statement dispatch (`src/parser/statements/mod.rs`)
- Added FLOW to declaration handler (`src/parser/statements/declarations.rs`)
- Updated box_declaration parser to accept BOX or FLOW (`src/parser/declarations/box_definition.rs`)
- Treat `flow FooBox {}` as syntactic sugar for `box FooBox {}`

### 4. Module namespace conversion
- Renamed `lang.compiler.builder.ssa.local` → `localvar` (avoid keyword)
- Renamed file `local.hako` → `local_ssa.hako`
- Converted 152 path-based using statements to namespace format
- Added 26+ entries to `nyash.toml` [modules] section

## ⚠️ Remaining Issues

### Stage-B selfhost compiler performance
- Stage-B compiler not producing output (hangs/times out after 10+ seconds)
- Excessive PHI debug output suggests compilation loop issue
- Needs investigation: infinite loop or N² algorithm in hako compiler

### Fallback JSON version mismatch
- Rust fallback (`--emit-mir-json`) emits MIR v1 JSON (schema_version: "1.0")
- Smoke tests expect MIR v0 JSON (`"version":0, "kind":"Program"`)
- stageb_helpers.sh fallback needs adjustment

## Test Status
- Parse errors: FIXED ✅
- Keyword conflicts: FIXED ✅
- Stage-B smoke tests: STILL FAILING ❌ (performance issue)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>

2025-11-02 04:13:17 +09:00

README.md

Nyash Smoke Tests v2 — Guide

Overview

Entry: tools/smokes/v2/run.sh — unified runner for quick/integration/full.
Profiles:
- quick — fast developer checks.
- integration — VM↔LLVM parity, basic stability.
- full — comprehensive matrix.

🎯 Two Baselines (Runbook)

これから開発の基準となる2つのベースライン：

📦 VM ライン（Rust VM - 既定）

用途: 開発・デバッグ・検証用（高速・型安全）

# ビルド
cargo build --release

# 一括スモークテスト
tools/smokes/v2/run.sh --profile quick

# 個別スモークテスト
tools/smokes/v2/run.sh --profile quick --filter "<glob>"
# 例: --filter "core/json_query_min_vm.sh"

# 単発実行（参考）
./target/release/nyash --backend vm apps/APP/main.nyash

⚡ llvmlite ライン（LLVMハーネス）

用途: 本番・最適化・配布用（実証済み安定性）

前提: Python3 + llvmlite

pip install llvmlite  # 未導入の場合

実行手順:

# ビルド（LLVM_SYS_180_PREFIX不要！）
cargo build --release --features llvm

# 一括スモークテスト
tools/smokes/v2/run.sh --profile integration

# 個別スモークテスト
tools/smokes/v2/run.sh --profile integration --filter "<glob>"

# 単発実行
NYASH_LLVM_USE_HARNESS=1 ./target/release/nyash --backend llvm apps/tests/peek_expr_block.nyash

# 有効化確認
./target/release/nyash --version | rg -i 'features.*llvm'

💡 重要: 両方のラインのテストが通ることで、MIR14統一アーキテクチャの品質を保証！

🔁 QuickでAST/LLVM系も実行したいとき

通常、quick は LLVM未ビルド時に AST/LLVM系テストを自動で SKIP します。 Quickでも実行したい場合は、先に LLVM 有効でビルドしてください：

LLVM_SYS_180_PREFIX=$(llvm-config-18 --prefix) cargo build --release --features llvm
tools/smokes/v2/run.sh --profile quick

テストランナーは LLVM 非対応時にヒントを出力します（buildコマンドの案内）。

Notes

Using resolution: prefer nyash.toml aliases (SSOT). Some tests may enable NYASH_ALLOW_USING_FILE=1 internally for convenience.
Plugin warnings are informational; smokes are designed to pass without dynamic plugins.
Harness single-run may take longer due to link+exec; integration profile includes generous timeouts.

Dev Mode (defaults)

In v2 smokes, the quick profile exports NYASH_DEV=1 by default.
- This enables CLI --dev-equivalent defaults inside Nyash:
  - AST using ON (SSOT + AST prelude merge)
  - Operator Boxes in observe mode (no adoption)
  - Minimal diagnostics; output parity is preserved
You can also run manually with nyash --dev script.nyash.

Common commands

Quick suite (auto NYASH_DEV=1):
- tools/smokes/v2/run.sh --profile quick
Focus JSON smokes:
- tools/opbox-json.sh (Roundtrip/Nested, plugins disabled, generous timeout)
One-off program (VM):
- target/release/nyash --backend vm --dev apps/APP/main.nyash

Key env knobs

NYASH_DEV=1 — enable dev defaults (same effect as --dev).
SMOKES_DEFAULT_TIMEOUT — per test timeout seconds (default 15 for quick).
SMOKES_PLUGIN_MODE=dynamic|static — plugin mode for preflight (auto by default).
SMOKES_FORCE_CONFIG=rust_vm_dynamic|llvm_static — force backend config.
SMOKES_NOTIFY_TAIL — lines to show on failure tail (default 80).