Selfhosting Dev 2720884a20 bridge/json_v0: split expr lowering; add Ternary/Peek lowering + AST; selfhost Peek JSON emit; add selfhost Peek smoke; warning cleanup in lowering/optimizer/verification
- Split expr lowering into ; route calls from stmt lowering
- Implement ternary/peek lowering (MIR13 PHI-off=Copy, PHI-on=Phi)
- Extend JSON v0 AST (ExprV0::{Ternary,Peek}, PeekArmV0)
- Selfhost parser_box: emit Peek JSON; add Stage-2 'Peek basic' smoke
- Reduce warnings: remove unused imports/vars in several modules
- current_task: update plan for legacy VM/Interpreter offboarding
2025-09-17 11:45:57 +09:00

🐱 Nyash Programming Language

A Seriously-Crafted Hobby Language
From Zero to Native Binary in 20 Days - The AI-Powered Language Revolution

🇯🇵 日本語版はこちら / Japanese Version

Selfhost Minimal Core Smoke Everything is Box Performance JIT Ready Try in Browser MIT License


Developer quickstart: see docs/DEV_QUICKSTART.md. Changelog highlights: CHANGELOG.md. MIR mode note: default is MIR13 (PHI-off). See docs/development/mir/MIR13_MODE.md. Selfhosting onepager: docs/how-to/self-hosting.md.

Table of Contents

🧪 SelfHosting (Dev Focus)

  • Guide: docs/how-to/self-hosting.md
  • Minimal E2E: NYASH_DISABLE_PLUGINS=1 ./target/release/nyash --backend vm apps/selfhost-minimal/main.nyash
  • Smokes: bash tools/jit_smoke.sh / bash tools/selfhost_vm_smoke.sh
  • Makefile: make run-minimal, make smoke-selfhost

MIR note: Core13 minimal kernel is enforced by default (NYASH_MIR_CORE13=1). Legacy ops are normalized (Array/Ref→BoxCall; TypeCheck/Cast/Barrier/WeakRef unified).

Pure mode: set NYASH_MIR_CORE13_PURE=1 to enable strict Core13. The optimizer rewrites a few ops (Load/Store/NewBox/Unary) to Core13 forms, and the compiler rejects any remaining nonCore13 ops. This may break execution temporarily by design to surface MIR violations early.

Note: JIT runtime execution is currently disabled to reduce debugging overhead. Use Interpreter/VM for running and AOT (Cranelift/LLVM) for distribution.

🎮 Try Nyash in Your Browser Right Now!

👉 Launch Browser Playground 👈

No installation needed - experience Nyash instantly in your web browser!


🚀 Breaking News: Self-Hosting Revolution!

September 2, 2025 - 🔥 ABI as a Box! Nyash ABI itself implemented as TypeBox (C language) - path to self-hosting clear! September 1, 2025 - Revolutionary TypeBox ABI unification achieved! C ABI + Nyash ABI seamlessly integrated. August 29, 2025 - Just 20 days after inception, Nyash can now compile to native executables!

# From Nyash source to native binary (Cranelift required)
cargo build --release --features cranelift-jit
./tools/build_aot.sh program.nyash -o app         # Native EXE
./app                                             # Standalone execution!

What we achieved in 24 days:

  • Full programming language with interpreter
  • VM with 13.5x performance boost
  • JIT compiler (Cranelift integration)
  • WebAssembly support
  • Plugin system (C ABI + Nyash ABI unified)
  • Native binary generation
  • Python integration via plugins
  • TypeBox ABI bridge (revolutionary plugin unification)
  • Self-hosting path clear (Nyash ABI in C, no Rust dependency!)

Why Nyash?

🎯 Everything is Box Philosophy

// Traditional languages have complex type systems
// Nyash: One concept rules them all - Box

static box Main {
    main() {
        // Every value is a Box - unified, safe, simple
        local name = new StringBox("Nyash")
        local count = new IntegerBox(42)
        local data = new MapBox()
        
        // Even Python objects are Boxes!
        local py = new PyRuntimeBox()
        local math = py.import("math")
        print("sqrt(9) = " + math.getattr("sqrt").call(9).str())
        
        return 0
    }
}

Unprecedented Development Speed

  • Day 1: Basic interpreter working
  • Day 4: Already planning JIT
  • Day 13: VM achieving 13.5x speedup
  • Day 20: Native executable generation!

🔌 Plugin-First Architecture

// Any functionality can be a plugin Box
local file = new FileBox()          // File I/O plugin
local http = new HttpClientBox()    // Network plugin  
local py = new PyRuntimeBox()       // Python plugin

// Plugins compile to native code too!

🏗️ Multiple Execution Modes

Important: JIT runtime execution is sealed for now. Use Interpreter/VM for running, and Cranelift AOT/LLVM AOT for native executables.

1. Interpreter Mode (Development)

./target/release/nyash program.nyash
  • Instant execution
  • Full debug information
  • Perfect for development

2. VM Mode (Production)

./target/release/nyash --backend vm program.nyash
  • 13.5x faster than interpreter
  • Optimized bytecode execution
  • Production-ready performance

3. Native Binary (Cranelift AOT) (Distribution)

# Build once (Cranelift)
cargo build --release --features cranelift-jit

./tools/build_aot.sh program.nyash -o myapp
./myapp  # Standalone executable!
  • Zero dependencies
  • Maximum performance
  • Easy distribution

4. Native Binary (LLVM AOT)

LLVM_SYS_180_PREFIX=$(llvm-config-18 --prefix) \
  cargo build --release --features llvm
NYASH_LLVM_OBJ_OUT=$PWD/nyash_llvm_temp.o \
  ./target/release/nyash --backend llvm program.nyash
# Link and run
cc nyash_llvm_temp.o -L crates/nyrt/target/release -Wl,--whole-archive -lnyrt -Wl,--no-whole-archive -lpthread -ldl -lm -o myapp
./myapp

Quick smoke test (VM vs EXE):

tools/smoke_aot_vs_vm.sh examples/aot_min_string_len.nyash

LLVM Backend Notes

  • NYASH_LLVM_OBJ_OUT: Path to emit .o when running --backend llvm.
    • Example: NYASH_LLVM_OBJ_OUT=$PWD/nyash_llvm_temp.o ./target/release/nyash --backend llvm apps/ny-llvm-smoke/main.nyash
  • Previously available NYASH_LLVM_ALLOW_BY_NAME=1: Removed - all plugin calls now use method_id by default.
    • The LLVM backend only supports method_id-based plugin calls for better performance and type safety.

5. WebAssembly (Browser)

cargo build --release --features wasm-backend
./target/release/nyash --compile-wasm program.nyash
  • Run in browsers
  • Cross-platform by default
  • Web-first development

🧰 OneCommand Build (MVP): nyash --build

Reads nyash.toml, builds plugins → core → emits AOT object → links an executable in one shot.

Basic (Cranelift AOT)

./target/release/nyash --build nyash.toml \
  --app apps/egui-hello-plugin/main.nyash \
  --out app_egui

Key options (minimal)

  • --build <path>: path to nyash.toml
  • --app <file>: entry .nyash
  • --out <name>: output executable (default: app/app.exe)
  • --build-aot cranelift|llvm (default: cranelift)
  • --profile release|debug (default: release)
  • --target <triple> (only when needed)

Notes

  • LLVM AOT requires LLVM 18 (LLVM_SYS_180_PREFIX).
  • Apps that open a GUI may show a window during AOT emission; close it to continue.
  • On WSL if the window doesnt show, see docs/guides/cranelift_aot_egui_hello.md (Wayland→X11).

📊 Performance Benchmarks

Real-world benchmark results (ny_bench.nyash):

Mode           | Time      | Relative Speed
---------------|-----------|---------------
Interpreter    | 110.10ms  | 1.0x (baseline)
VM             | 8.14ms    | 13.5x faster
Cranelift AOT  | ~46ms    | ~2027x faster  
Native (LLVM)  | ~4ms      | ~27x faster

🎮 Language Features

Clean Syntax

box GameCharacter {
    private { name, health, skills }
    
    // Birth constructor - giving life to Boxes!
    birth(characterName) {
        me.name = characterName
        me.health = 100
        me.skills = new ArrayBox()
        print("🌟 " + characterName + " has been born!")
    }
    
    learnSkill(skill) {
        me.skills.push(skill)
        return me  // Method chaining
    }
}

// Usage
local hero = new GameCharacter("Neko")
hero.learnSkill("Fire Magic").learnSkill("Healing")

Modern Async/Await

// Concurrent operations made simple
nowait task1 = fetchDataFromAPI()
nowait task2 = processLocalFiles()

// Do other work while waiting
updateUI()

// Collect results
local apiData = await task1
local files = await task2

Delegation Pattern

// Composition over inheritance
box EnhancedArray from ArrayBox {
    private { logger }
    
    override push(item) {
        me.logger.log("Adding: " + item)
        from ArrayBox.push(item)  // Delegate to parent
    }
}

🔌 Revolutionary Plugin System (TypeBox Architecture)

TypeBox: The Universal Plugin Bridge (September 2025)

"Everything is Box" Philosophy - Even ABI is a Box!

// TypeBox - Type information as a Box (enables cross-plugin creation)
typedef struct {
    uint32_t abi_tag;           // 'TYBX'
    const char* name;           // "ArrayBox"
    void* (*create)(void);      // Box creation function
} NyrtTypeBox;

// NEW: Nyash ABI itself as a TypeBox! (C implementation, no Rust)
typedef struct {
    uint32_t abi_tag;           // 'NABI'
    const char* name;           // "NyashABIProvider"
    void* (*create)(void);      // ABI provider creation
    // ... Nyash operations (call, retain, release)
} NyashABITypeBox;

Revolutionary Achievement: ABI implementation in pure C enables self-hosting!

Plugin Configuration

# nyash.toml v3.0 - Unified plugin support
[plugins.map]
path = "plugins/map.so"
abi = "c"              # Traditional C ABI

[plugins.advanced_map]
path = "plugins/adv_map.so"
abi = "nyash"          # Type-safe Nyash ABI

[plugins.hybrid]
path = "plugins/hybrid.so"
abi = "unified"        # Both ABIs supported!

Key Innovation: TypeBox enables cross-plugin Box creation without circular dependencies. MapBox can now return ArrayBox seamlessly!

📚 Full TypeBox Documentation


🛠️ Getting Started

Quick Install (Linux/Mac/WSL)

# Clone and build
git clone https://github.com/moe-charm/nyash.git
cd nyash
cargo build --release --features cranelift-jit

# Run your first program
echo 'print("Hello Nyash!")' > hello.nyash
./target/release/nyash hello.nyash

Windows

# Cross-compile for Windows
cargo install cargo-xwin
cargo xwin build --target x86_64-pc-windows-msvc --release
# Use target/x86_64-pc-windows-msvc/release/nyash.exe

# Native EXE (AOT) on Windows (requires Cranelift and MSYS2/WSL toolchain for linking)
cargo build --release --features cranelift-jit
powershell -ExecutionPolicy Bypass -File tools\build_aot.ps1 -Input examples\aot_min_string_len.nyash -Out app.exe
./app.exe

🌟 Unique Innovations

1. AI-Driven Development

  • Developed with Claude, ChatGPT, and Codex collaboration
  • 20-day journey from concept to native compilation
  • Proves AI can accelerate language development by 30x

2. Box-First Architecture

  • Every optimization preserves the Box abstraction
  • Plugins are Boxes, JIT preserves Boxes, even native code respects Boxes
  • TypeBox: Even type information is a Box!
  • Unprecedented consistency across all execution modes

3. Observable by Design

  • Built-in debugging and profiling
  • JSON event streams for JIT compilation
  • DOT graph visualization of optimizations

📚 Examples

Python Integration

// Use Python libraries from Nyash!
local py = new PyRuntimeBox()
local np = py.import("numpy")
local array = np.getattr("array").call([1, 2, 3])
print("NumPy array: " + array.str())

Web Server

local server = new HttpServerBox()
server.start(8080)

loop(true) {
    local request = server.accept()
    local response = new HttpResponseBox()
    response.setStatus(200)
    response.write("Hello from Nyash!")
    request.respond(response)
}

Game Development

box GameObject {
    public { x, y, sprite }
    
    update(deltaTime) {
        // Physics simulation
        me.y = me.y + gravity * deltaTime
    }
    
    render(canvas) {
        canvas.drawImage(me.sprite, me.x, me.y)
    }
}

🤝 Contributing

Join the revolution! We welcome:

  • 🐛 Bug reports and fixes
  • New Box types via plugins
  • 📚 Documentation improvements
  • 🎮 Cool example programs

See also: Contributor guide in AGENTS.md (Repository Guidelines) for project layout, build/test commands, and PR expectations.

📄 License

MIT License - Use freely in your projects!


👨‍💻 Creator

charmpic - Hobby Language Developer

  • 🐱 GitHub: @moe-charm
  • 🌟 Created with: Claude, ChatGPT, Codex collaboration

🎉 Historical Timeline

  • August 9, 2025: First commit - "Hello Nyash!"
  • August 13: JIT planning begins (day 4!)
  • August 20: VM achieves 13.5x performance
  • August 29: Native EXE compilation achieved!
  • September 1: TypeBox ABI unification - C ABI + Nyash ABI seamless integration
  • September 2: 🔥 Self-hosting path clear - Nyash ABI in C (no Rust dependency!)
  • September 4: 🪟 Windows GUI displayed via JIT/native EXE (OS-native window)

24 days from zero to self-hosting capability - a new record in language development!


🚀 Nyash - Where Everything is a Box, and Boxes Compile to Native Code!

Built with ❤️, 🤖 AI collaboration, and the belief that programming languages can be created at the speed of thought

Description
No description provided
Readme 1.2 GiB
Languages
Rust 73.6%
Shell 13.5%
C 6.5%
Python 4%
HTML 1%
Other 1.4%