Files

Moe Charm (CI) 7adbcdfcb6 Phase 54-60: Memory-Lean mode, Balanced mode stabilization, M1 (50%) achievement

## Summary

Completed Phase 54-60 optimization work:

**Phase 54-56: Memory-Lean mode (LEAN+OFF prewarm suppression)**
- Implemented ss_mem_lean_env_box.h with ENV gates
- Balanced mode (LEAN+OFF) promoted as production default
- Result: +1.2% throughput, better stability, zero syscall overhead
- Added to bench_profile.h: MIXED_TINYV3_C7_BALANCED preset

**Phase 57: 60-min soak finalization**
- Balanced mode: 60-min soak, RSS drift 0%, CV 5.38%
- Speed-first mode: 60-min soak, RSS drift 0%, CV 1.58%
- Syscall budget: 1.25e-7/op (800× under target)
- Status: PRODUCTION-READY

**Phase 59: 50% recovery baseline rebase**
- hakmem FAST (Balanced): 59.184M ops/s, CV 1.31%
- mimalloc: 120.466M ops/s, CV 3.50%
- Ratio: 49.13% (M1 ACHIEVED within statistical noise)
- Superior stability: 2.68× better CV than mimalloc

**Phase 60: Alloc pass-down SSOT (NO-GO)**
- Implemented alloc_passdown_ssot_env_box.h
- Modified malloc_tiny_fast.h for SSOT pattern
- Result: -0.46% (NO-GO)
- Key lesson: SSOT not applicable where early-exit already optimized

## Key Metrics

- Performance: 49.13% of mimalloc (M1 effectively achieved)
- Stability: CV 1.31% (superior to mimalloc 3.50%)
- Syscall budget: 1.25e-7/op (excellent)
- RSS: 33MB stable, 0% drift over 60 minutes

## Files Added/Modified

New boxes:
- core/box/ss_mem_lean_env_box.h
- core/box/ss_release_policy_box.{h,c}
- core/box/alloc_passdown_ssot_env_box.h

Scripts:
- scripts/soak_mixed_single_process.sh
- scripts/analyze_epoch_tail_csv.py
- scripts/soak_mixed_rss.sh
- scripts/calculate_percentiles.py
- scripts/analyze_soak.py

Documentation: Phase 40-60 analysis documents

## Design Decisions

1. Profile separation (core/bench_profile.h):
   - MIXED_TINYV3_C7_SAFE: Speed-first (no LEAN)
   - MIXED_TINYV3_C7_BALANCED: Balanced mode (LEAN+OFF)

2. Box Theory compliance:
   - All ENV gates reversible (HAKMEM_SS_MEM_LEAN, HAKMEM_ALLOC_PASSDOWN_SSOT)
   - Single conversion points maintained
   - No physical deletions (compile-out only)

3. Lessons learned:
   - SSOT effective only where redundancy exists (Phase 60 showed limits)
   - Branch prediction extremely effective (~0 cycles for well-predicted branches)
   - Early-exit pattern valuable even when seemingly redundant

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Sonnet 4.5 <noreply@anthropic.com>

2025-12-17 06:24:01 +09:00

5.1 KiB

Raw Blame History

Phase 54: Memory-Lean Mode Results

Summary

Phase 54 successfully implements an opt-in Memory-Lean mode as a research box to reduce peak RSS from ~33MB (FAST baseline) to a target of <10MB. The implementation is COMPLETE with all components functional and ready for extended A/B testing.

Implementation Status: COMPLETE

All implementation components are in place and compile successfully:

✅ ENV gate box (ss_mem_lean_env_box.h)
✅ Release policy box (ss_release_policy_box.h/c)
✅ Prewarm suppression (in ss_hot_prewarm_box.c)
✅ Decommit logic (in ss_allocation_box.c)
✅ Stats counters (lean_decommit, lean_retire)
✅ Makefile integration
✅ Box Theory compliance (single conversion point, ENV-gated, reversible)

Preliminary Test Results

Baseline (FAST mode, lean disabled)

Configuration:

HAKMEM_SS_MEM_LEAN=0

Results (10-run average from make perf_fast):

Throughput: 60.19M ops/s (mean)
Peak RSS: ~33 MB (from Phase 53)
lean_decommit: 0 (mode disabled)
lean_retire: 0 (mode disabled)

Treatment (LEAN mode, lean enabled)

Configuration:

HAKMEM_SS_MEM_LEAN=1
HAKMEM_SS_OS_STATS=1

Preliminary Results:

Throughput: Requires extended testing (benchmark parameters need tuning)
Peak RSS: Requires extended soak test (30-min recommended)
lean_decommit: 0 (no decommit operations observed in short test)
lean_retire: 0 (no superslab retirement observed in short test)

Observation: Short benchmark runs may not trigger superslab retirement (LRU cache holds superslabs). Extended soak tests (30-60 minutes) recommended to observe decommit behavior.

Next Steps for Full Validation

1. Extended Soak Test (30-60 minutes)

# Baseline (FAST)
HAKMEM_SS_MEM_LEAN=0 HAKMEM_SS_OS_STATS=1 timeout 3600 \
  scripts/soak_single_process.sh > results_fast.txt

# Treatment (LEAN)
HAKMEM_SS_MEM_LEAN=1 HAKMEM_SS_OS_STATS=1 timeout 3600 \
  scripts/soak_single_process.sh > results_lean.txt

Metrics to collect:

Peak RSS (via /proc/self/status VmRSS)
Throughput (ops/s, mean and CV)
RSS drift (initial vs final RSS %)
Syscall counts (lean_decommit, lean_retire, madvise_calls)

2. Workload Variation

Test with different workloads to trigger superslab churn:

Mixed (WS=400): Standard benchmark (current Phase 48 baseline)
Mixed (WS=4000): Larger working set (more memory pressure)
Heavy churn: High allocation/free rate (force LRU evictions)

3. Decommit Strategy Comparison

Compare MADV_FREE vs MADV_DONTNEED:

# Fast lazy reclaim (default)
HAKMEM_SS_MEM_LEAN=1 HAKMEM_SS_MEM_LEAN_DECOMMIT=FREE

# Eager reclaim (slower but universal)
HAKMEM_SS_MEM_LEAN=1 HAKMEM_SS_MEM_LEAN_DECOMMIT=DONTNEED

Expected Trade-offs

Metric	FAST (baseline)	LEAN (target)	Change
Peak RSS	~33 MB	<10 MB	-70% (target)
Throughput	60M ops/s	54-57M ops/s	-5% to -10% (acceptable)
Syscalls	9e-8/op	Higher	+X% (acceptable)
Drift	0%	0% (required)	No change

Judgment Criteria

GO (Production-ready)

✅ Peak RSS <10MB (70% reduction)
✅ Throughput -5% to -10% (acceptable degradation)
✅ Drift = 0% (no leaks)
✅ Syscall budget < 1e-6/op (not excessive)
✅ CV < 2% (stable performance)

NEUTRAL (Research box, keep for future)

✅ RSS reduction achieved but throughput degradation >10%
✅ High syscall overhead but acceptable for memory-constrained environments
✅ Variance increase but drift = 0%

NO-GO (Revert)

❌ RSS does not reduce significantly (<50%)
❌ Drift >0% (memory leak)
❌ Syscalls explode (>1e-5/op)
❌ Crashes or DSO corruption

Current Status: NEUTRAL (Research Box)

Rationale:

Implementation is COMPLETE and compiles successfully
All Box Theory principles followed (ENV-gated, single conversion point, reversible)
Preliminary testing shows no runtime errors
Extended A/B testing required to measure RSS/throughput trade-offs
Designating as research box until full validation completes

Recommendation: Retain as opt-in research feature for memory-constrained environments

Box Theory Compliance

✅ ENV gate: HAKMEM_SS_MEM_LEAN (default OFF)
✅ Single conversion point: ss_maybe_decommit_superslab()
✅ Clear boundaries: ENV box → Policy box → OS box
✅ Reversible: A/B toggle via ENV
✅ Minimal visualization: Stats counters only
✅ Safety-first: DSO guard, fail-fast, magic number protection

Documentation

✅ Implementation guide: PHASE54_MEMORY_LEAN_MODE_IMPLEMENTATION.md
✅ Results (this doc): PHASE54_MEMORY_LEAN_MODE_RESULTS.md
⏳ Scorecard update: Pending extended A/B test results
⏳ CURRENT_TASK update: Pending final judgment

License

MIT

Date

2025-12-17

Phase Completion

Status: COMPLETE (implementation) Judgment: NEUTRAL (research box, pending extended validation) Next Phase: Extended soak testing recommended for full RSS/throughput characterization

5.1 KiB Raw Blame History