Major changes: - LLVM backend initial implementation (compiler.rs, llvm mode) - Semantics layer integration in interpreter (operators.rs) - Phase 12 plugin architecture revision (3-layer system) - Builtin box removal preparation - MIR instruction set documentation (26→Core-15 migration) - Cross-backend testing infrastructure - Await/nowait syntax support New features: - LLVM AOT compilation support (--backend llvm) - Semantics layer for interpreter→VM flow - Tri-backend smoke tests - Plugin-only registry mode Bug fixes: - Interpreter plugin box arithmetic operations - Branch test returns incorrect values Documentation: - Phase 12 README.md updated with new plugin architecture - Removed obsolete NYIR proposals - Added LLVM test programs documentation Co-Authored-By: Claude <noreply@anthropic.com>
366 lines
9.3 KiB
Markdown
366 lines
9.3 KiB
Markdown
# 🐱 Nyash Programming Language
|
||
**A Seriously-Crafted Hobby Language**
|
||
**From Zero to Native Binary in 20 Days - The AI-Powered Language Revolution**
|
||
|
||
*[🇯🇵 日本語版はこちら / Japanese Version](README.ja.md)*
|
||
|
||
[](#)
|
||
[](#philosophy)
|
||
[](#performance)
|
||
[](#execution-modes)
|
||
[](projects/nyash-wasm/nyash_playground.html)
|
||
[](#license)
|
||
|
||
---
|
||
|
||
## 🎮 **Try Nyash in Your Browser Right Now!**
|
||
|
||
👉 **[Launch Browser Playground](projects/nyash-wasm/nyash_playground.html)** 👈
|
||
|
||
No installation needed - experience Nyash instantly in your web browser!
|
||
|
||
---
|
||
|
||
## 🚀 **Breaking News: Native EXE Achieved!**
|
||
|
||
**August 29, 2025** - Just 20 days after inception, Nyash can now compile to native executables!
|
||
|
||
```bash
|
||
# From Nyash source to native binary (Cranelift required)
|
||
cargo build --release --features cranelift-jit
|
||
./tools/build_aot.sh program.nyash -o app # Native EXE
|
||
./app # Standalone execution!
|
||
```
|
||
|
||
**What we achieved in 20 days:**
|
||
- ✅ Full programming language with interpreter
|
||
- ✅ VM with 13.5x performance boost
|
||
- ✅ JIT compiler (Cranelift integration)
|
||
- ✅ WebAssembly support
|
||
- ✅ Plugin system (C ABI)
|
||
- ✅ Native binary generation
|
||
- ✅ Python integration via plugins
|
||
|
||
---
|
||
|
||
## ✨ **Why Nyash?**
|
||
|
||
### 🎯 **Everything is Box Philosophy**
|
||
```nyash
|
||
// Traditional languages have complex type systems
|
||
// Nyash: One concept rules them all - Box
|
||
|
||
static box Main {
|
||
main() {
|
||
// Every value is a Box - unified, safe, simple
|
||
local name = new StringBox("Nyash")
|
||
local count = new IntegerBox(42)
|
||
local data = new MapBox()
|
||
|
||
// Even Python objects are Boxes!
|
||
local py = new PyRuntimeBox()
|
||
local math = py.import("math")
|
||
print("sqrt(9) = " + math.getattr("sqrt").call(9).str())
|
||
|
||
return 0
|
||
}
|
||
}
|
||
```
|
||
|
||
### ⚡ **Unprecedented Development Speed**
|
||
- **Day 1**: Basic interpreter working
|
||
- **Day 4**: Already planning JIT
|
||
- **Day 13**: VM achieving 13.5x speedup
|
||
- **Day 20**: Native executable generation!
|
||
|
||
### 🔌 **Plugin-First Architecture**
|
||
```nyash
|
||
// Any functionality can be a plugin Box
|
||
local file = new FileBox() // File I/O plugin
|
||
local http = new HttpClientBox() // Network plugin
|
||
local py = new PyRuntimeBox() // Python plugin
|
||
|
||
// Plugins compile to native code too!
|
||
```
|
||
|
||
---
|
||
|
||
## 🏗️ **Multiple Execution Modes**
|
||
|
||
### 1. **Interpreter Mode** (Development)
|
||
```bash
|
||
./target/release/nyash program.nyash
|
||
```
|
||
- Instant execution
|
||
- Full debug information
|
||
- Perfect for development
|
||
|
||
### 2. **VM Mode** (Production)
|
||
```bash
|
||
./target/release/nyash --backend vm program.nyash
|
||
```
|
||
- 13.5x faster than interpreter
|
||
- Optimized bytecode execution
|
||
- Production-ready performance
|
||
|
||
### 3. **JIT Mode** (High Performance)
|
||
```bash
|
||
NYASH_JIT_EXEC=1 ./target/release/nyash --backend vm program.nyash
|
||
```
|
||
- Cranelift-powered JIT compilation
|
||
- Near-native performance
|
||
- Hot function optimization
|
||
|
||
### 4. **Native Binary** (Distribution)
|
||
```bash
|
||
# Build once (Cranelift)
|
||
cargo build --release --features cranelift-jit
|
||
|
||
./tools/build_aot.sh program.nyash -o myapp
|
||
./myapp # Standalone executable!
|
||
```
|
||
- Zero dependencies
|
||
- Maximum performance
|
||
- Easy distribution
|
||
|
||
Quick smoke test (VM vs EXE):
|
||
```bash
|
||
tools/smoke_aot_vs_vm.sh examples/aot_min_string_len.nyash
|
||
```
|
||
|
||
### LLVM Backend Notes
|
||
- `NYASH_LLVM_OBJ_OUT`: Path to emit `.o` when running `--backend llvm`.
|
||
- Example: `NYASH_LLVM_OBJ_OUT=$PWD/nyash_llvm_temp.o ./target/release/nyash --backend llvm apps/ny-llvm-smoke/main.nyash`
|
||
- `NYASH_LLVM_ALLOW_BY_NAME=1`: Debug-only fallback for plugin calls by name when by-id isn’t available.
|
||
- Emits calls to `nyash.plugin.invoke_by_name_i64` for development.
|
||
- Do not enable in production.
|
||
|
||
|
||
### 5. **WebAssembly** (Browser)
|
||
```bash
|
||
cargo build --release --features wasm-backend
|
||
./target/release/nyash --compile-wasm program.nyash
|
||
```
|
||
- Run in browsers
|
||
- Cross-platform by default
|
||
- Web-first development
|
||
|
||
---
|
||
|
||
## 📊 **Performance Benchmarks**
|
||
|
||
Real-world benchmark results (ny_bench.nyash):
|
||
|
||
```
|
||
Mode | Time | Relative Speed
|
||
---------------|-----------|---------------
|
||
Interpreter | 110.10ms | 1.0x (baseline)
|
||
VM | 8.14ms | 13.5x faster
|
||
VM + JIT | 5.8ms | 19.0x faster
|
||
Native Binary | ~4ms | ~27x faster
|
||
```
|
||
|
||
---
|
||
|
||
## 🎮 **Language Features**
|
||
|
||
### Clean Syntax
|
||
```nyash
|
||
box GameCharacter {
|
||
private { name, health, skills }
|
||
|
||
// Birth constructor - giving life to Boxes!
|
||
birth(characterName) {
|
||
me.name = characterName
|
||
me.health = 100
|
||
me.skills = new ArrayBox()
|
||
print("🌟 " + characterName + " has been born!")
|
||
}
|
||
|
||
learnSkill(skill) {
|
||
me.skills.push(skill)
|
||
return me // Method chaining
|
||
}
|
||
}
|
||
|
||
// Usage
|
||
local hero = new GameCharacter("Neko")
|
||
hero.learnSkill("Fire Magic").learnSkill("Healing")
|
||
```
|
||
|
||
### Modern Async/Await
|
||
```nyash
|
||
// Concurrent operations made simple
|
||
nowait task1 = fetchDataFromAPI()
|
||
nowait task2 = processLocalFiles()
|
||
|
||
// Do other work while waiting
|
||
updateUI()
|
||
|
||
// Collect results
|
||
local apiData = await task1
|
||
local files = await task2
|
||
```
|
||
|
||
### Delegation Pattern
|
||
```nyash
|
||
// Composition over inheritance
|
||
box EnhancedArray from ArrayBox {
|
||
private { logger }
|
||
|
||
override push(item) {
|
||
me.logger.log("Adding: " + item)
|
||
from ArrayBox.push(item) // Delegate to parent
|
||
}
|
||
}
|
||
```
|
||
|
||
---
|
||
|
||
## 🔌 **Plugin System**
|
||
|
||
Nyash pioneered the "Everything is Plugin" architecture:
|
||
|
||
```toml
|
||
# nyash.toml - Plugin configuration
|
||
[libraries."libnyash_python_plugin.so"]
|
||
boxes = ["PyRuntimeBox", "PyObjectBox"]
|
||
|
||
[libraries."libnyash_net_plugin.so"]
|
||
boxes = ["HttpServerBox", "HttpClientBox", "WebSocketBox"]
|
||
```
|
||
|
||
Create your own Box types in C/Rust and integrate seamlessly!
|
||
|
||
---
|
||
|
||
## 🛠️ **Getting Started**
|
||
|
||
### Quick Install (Linux/Mac/WSL)
|
||
```bash
|
||
# Clone and build
|
||
git clone https://github.com/moe-charm/nyash.git
|
||
cd nyash
|
||
cargo build --release --features cranelift-jit
|
||
|
||
# Run your first program
|
||
echo 'print("Hello Nyash!")' > hello.nyash
|
||
./target/release/nyash hello.nyash
|
||
```
|
||
|
||
### Windows
|
||
```bash
|
||
# Cross-compile for Windows
|
||
cargo install cargo-xwin
|
||
cargo xwin build --target x86_64-pc-windows-msvc --release
|
||
# Use target/x86_64-pc-windows-msvc/release/nyash.exe
|
||
|
||
# Native EXE (AOT) on Windows (requires Cranelift and MSYS2/WSL toolchain for linking)
|
||
cargo build --release --features cranelift-jit
|
||
powershell -ExecutionPolicy Bypass -File tools\build_aot.ps1 -Input examples\aot_min_string_len.nyash -Out app.exe
|
||
./app.exe
|
||
```
|
||
|
||
---
|
||
|
||
## 🌟 **Unique Innovations**
|
||
|
||
### 1. **AI-Driven Development**
|
||
- Developed with Claude, ChatGPT, and Codex collaboration
|
||
- 20-day journey from concept to native compilation
|
||
- Proves AI can accelerate language development by 30x
|
||
|
||
### 2. **Box-First Architecture**
|
||
- Every optimization preserves the Box abstraction
|
||
- Plugins are Boxes, JIT preserves Boxes, even native code respects Boxes
|
||
- Unprecedented consistency across all execution modes
|
||
|
||
### 3. **Observable by Design**
|
||
- Built-in debugging and profiling
|
||
- JSON event streams for JIT compilation
|
||
- DOT graph visualization of optimizations
|
||
|
||
---
|
||
|
||
## 📚 **Examples**
|
||
|
||
### Python Integration
|
||
```nyash
|
||
// Use Python libraries from Nyash!
|
||
local py = new PyRuntimeBox()
|
||
local np = py.import("numpy")
|
||
local array = np.getattr("array").call([1, 2, 3])
|
||
print("NumPy array: " + array.str())
|
||
```
|
||
|
||
### Web Server
|
||
```nyash
|
||
local server = new HttpServerBox()
|
||
server.start(8080)
|
||
|
||
loop(true) {
|
||
local request = server.accept()
|
||
local response = new HttpResponseBox()
|
||
response.setStatus(200)
|
||
response.write("Hello from Nyash!")
|
||
request.respond(response)
|
||
}
|
||
```
|
||
|
||
### Game Development
|
||
```nyash
|
||
box GameObject {
|
||
public { x, y, sprite }
|
||
|
||
update(deltaTime) {
|
||
// Physics simulation
|
||
me.y = me.y + gravity * deltaTime
|
||
}
|
||
|
||
render(canvas) {
|
||
canvas.drawImage(me.sprite, me.x, me.y)
|
||
}
|
||
}
|
||
```
|
||
|
||
---
|
||
|
||
## 🤝 **Contributing**
|
||
|
||
Join the revolution! We welcome:
|
||
- 🐛 Bug reports and fixes
|
||
- ✨ New Box types via plugins
|
||
- 📚 Documentation improvements
|
||
- 🎮 Cool example programs
|
||
|
||
See also: Contributor guide in `AGENTS.md` (Repository Guidelines) for project layout, build/test commands, and PR expectations.
|
||
|
||
## 📄 **License**
|
||
|
||
MIT License - Use freely in your projects!
|
||
|
||
---
|
||
|
||
## 👨💻 **Creator**
|
||
|
||
**charmpic** - Hobby Language Developer
|
||
- 🐱 GitHub: [@moe-charm](https://github.com/moe-charm)
|
||
- 🌟 Created with: Claude, ChatGPT, Codex collaboration
|
||
|
||
---
|
||
|
||
## 🎉 **Historical Timeline**
|
||
|
||
- **August 9, 2025**: First commit - "Hello Nyash!"
|
||
- **August 13**: JIT planning begins (day 4!)
|
||
- **August 20**: VM achieves 13.5x performance
|
||
- **August 29**: Native EXE compilation achieved!
|
||
|
||
*20 days from zero to native binary - a new record in language development!*
|
||
|
||
---
|
||
|
||
**🚀 Nyash - Where Everything is a Box, and Boxes Compile to Native Code!**
|
||
|
||
*Built with ❤️, 🤖 AI collaboration, and the belief that programming languages can be created at the speed of thought*
|