tomoaki/hakmem
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity

Phase 35-39: FAST build optimization complete (+7.13% cumulative)

Browse Source 
Phase 35-A: BENCH_MINIMAL gate function elimination (GO +4.39%)
- tiny_front_v3_enabled() → constant true
- tiny_metadata_cache_enabled() → constant 0
- learner_v7_enabled() → constant false
- small_learner_v2_enabled() → constant false

Phase 36: Policy snapshot init-once (GO +0.71%)
- small_policy_v7_snapshot() version check skip in BENCH_MINIMAL
- TLS cache for policy snapshot

Phase 37: Standard TLS cache (NO-GO -0.07%)
- TLS cache for Standard build attempted
- Runtime gate overhead negates benefit

Phase 38: FAST/OBSERVE/Standard workflow established
- make perf_fast, make perf_observe targets
- Scorecard and documentation updates

Phase 39: Hot path gate constantization (GO +1.98%)
- front_gate_unified_enabled() → constant 1
- alloc_dualhot_enabled() → constant 0
- g_bench_fast_front, g_v3_enabled blocks → compile-out
- free_dispatch_stats_enabled() → constant false

Results:
- FAST v3: 56.04M ops/s (47.4% of mimalloc)
- Standard: 53.50M ops/s (45.3% of mimalloc)
- M1 target (50%): 5.5% remaining

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude Opus 4.5 <noreply@anthropic.com>
This commit is contained in:
Moe Charm (CI)
2025-12-16 15:01:56 +09:00
parent 506e724c3b
commit b7085c47e1
22 changed files with 1550 additions and 397 deletions
Download Patch File Download Diff File Expand all files Collapse all files

382
CURRENT_TASK.md
View File

@ -1,362 +1,44 @@
# 本線タスク（現在）
# CURRENT_TASK（Rolling）
## 現在の状態（要約）
## 0) 今の「正」（Phase 39）
- **安定版（本線）**: Phase 31 完了（g_tiny_free_trace compile-out） — NEUTRAL verdict、code cleanliness で採用
- **直近の判断**:
- Phase 24（OBSERVE 税 prune / tiny_class_stats）: ✅ GO (+0.93%)
- Phase 25（Free Stats atomic prune / g_free_ss_enter）: ✅ GO (+1.07%)
- Phase 26（Hot path diagnostic atomics prune / 5 atomics）: ⚪ NEUTRAL (-0.33%, code cleanliness で採用)
- Phase 27（Unified Cache Stats atomic prune / 6 atomics）: ✅ GO (+0.74% mean, +1.01% median)
- Phase 28（Background Spill Queue audit / 8 atomics）: ⚪ NO-OP (全て CORRECTNESS)
- Phase 29（Pool Hotbox v2 Stats audit / 12 atomics）: ⚪ NO-OP (ENV-gated, 実行されない)
- Phase 30（Standard Procedure Documentation）: ✅ PROCEDURE COMPLETE (412 atomics 監査完了)
- Phase 31（Tiny Free Trace atomic prune / g_tiny_free_trace）: ⚪ NEUTRAL (-0.35%, code cleanliness で採用)
- **計測の正**: `scripts/run_mixed_10_cleanenv.sh`（同一バイナリ / clean env / 10-run）
- **累積効果**: **+2.74%** (Phase 24: +0.93% + Phase 25: +1.07% + Phase 26: NEUTRAL + Phase 27: +0.74% + Phase 28: NO-OP + Phase 29: NO-OP + Phase 30: PROCEDURE + Phase 31: NEUTRAL)
- **目標/現状スコアカード**: `docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md`
- **性能比較の正**: **FAST build**（`make perf_fast`）
- **安全・互換の正**: Standard build（`make bench_random_mixed_hakmem`）
- **観測の正**: OBSERVE build（`make perf_observe`）
- **スコアカード**: `docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md`
- **計測の正（Mixed 10-run）**: `scripts/run_mixed_10_cleanenv.sh`（`ITERS=20000000 WS=400`）
## 原則（Box Theory 運用ルール）
## 1) 現状（最新スナップショット）
- FAST v3: **56.04M ops/s**（mimalloc の **47.4%**）
- Standard: **53.50M ops/s**（mimalloc の **45.3%**）
※詳細は `docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md` を正とする（ここは要点だけ）。
## 2) 原則（Box Theory 運用）
- 変更は箱で分ける（ENV / build flag で戻せる）
- 変換点（境界）は 1 箇所に集約する
- "削除して速くする" は危険（layout/LTO で反転する）
- ✅ compile-out（`#if HAKMEM_*_COMPILED`）は許容
- ❌ link-out（Makefile から `.o` を外す）は封印（Phase 22-2 NO-GO）
- **Atomic 監査原則**（Phase 30 標準化）:
- **Step 0: 実行確認（MANDATORY）**: ENV gate / 実行カウンタ確認（Phase 29 教訓）
- **Step 1: CORRECTNESS vs TELEMETRY 分類**: `if` 条件 = CORRECTNESS（Phase 28 教訓）
- **Step 2: Compile-out 実装**: `#if HAKMEM_*_COMPILED` で wrap
- **Step 3: A/B test**: Baseline vs Compiled-in（10-run 比較）
- **Verdict**: GO (+0.5%+), NEUTRAL (±0.5%), NO-GO (-0.5%+)
- 境界は 1 箇所（変換点を増やさない）
- **削除して速くする（link-out / 大きい削除）は封印**（layout/LTO で符号反転する）
- ✅ compile-out（`#if HAKMEM_*_COMPILED` / `#if HAKMEM_BENCH_MINIMAL`）は許容
- ❌ Makefile から `.o` を外す / コード物理削除は原則しない（Phase 22-2 NO-GO）
- A/B は **同一バイナリ**でトグル（ENV / build flag）。別バイナリ比較は layout が混ざる。
## Phase 30 完了（2025-12-16）
## 3) 次の指示書
### 実施内容
TBD（Phase 39 完了）
**目的:** Phase 24-29 の学びを 4-step 標準手順として固定化し、Phase 31 候補を選定する。
## 4) 直近のログ（要点だけ）
**成果物:**
1. `docs/analysis/PHASE30_STANDARD_PROCEDURE.md` - 4-step 標準手順書
2. `docs/analysis/ATOMIC_AUDIT_FULL.txt` - 全 atomic 監査結果（412 atomics）
3. `docs/analysis/PHASE31_CANDIDATES_HOT.txt` - HOT path 候補抽出
4. `docs/analysis/PHASE31_CANDIDATES_WARM.txt` - WARM path 候補抽出
5. `docs/analysis/PHASE31_RECOMMENDED_CANDIDATES.md` - Phase 31 推奨候補（TOP 3）
6. `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` 更新（Phase 30 追記）
- Phase 24–34: atomic prune 累積 **+2.74%**（その後 diminishing returns）
- Phase 35-A: `HAKMEM_BENCH_MINIMAL=1`（gate prune）**GO +4.39%**
- Phase 36: FAST-only policy snapshot 最適化 **GO +0.71%**
- Phase 37: Standard TLS cache **NO-GO**（runtime gate の税が勝つ）
- Phase 38: FAST/OBSERVE/Standard 運用確立（scorecard + Makefile targets）
- Phase 39: FAST v3 gate 定数化 **GO +1.98%**
- 結果詳細: `docs/analysis/PHASE39_FAST_V3_GATE_CONSTANTIZATION_RESULTS.md`
### 監査結果
## 5) アーカイブ
**全 atomic 監査:**
- **Total atomics:** 412
- **TELEMETRY:** 104 (25%)
- **CORRECTNESS:** 24 (6%)
- **UNKNOWN:** 284 (69%, manual review needed)
- 旧 `CURRENT_TASK.md`（詳細ログ）は `archive/CURRENT_TASK_ARCHIVE_20251216.md`
**Path 分類:**
- **HOT path:** 16 atomics (5 TELEMETRY, 11 UNKNOWN)
- **WARM path:** 10 atomics (3 TELEMETRY, 7 UNKNOWN)
- **COLD path:** 386 atomics (remaining)
**NEW 候補（未コンパイルアウト）:**
- **HOT path:** 1 candidate (`g_tiny_free_trace`)
- **WARM path:** 3 candidates (`rel_logs`, `dbg_logs`, `g_p0_class_oob_log`)
### Step 0 実行確認結果
**HOT path:**
1. `g_tiny_free_trace` (HOT, TELEMETRY)
- ✅ ENV gate なし
- ✅ `hak_tiny_free()` で実行（毎回）
- ✅ Execution verified
- **Verdict:** **TOP PRIORITY for Phase 31**
**WARM path:**
1. `rel_logs` + `dbg_logs` (WARM, TELEMETRY)
- ❌ ENV gated by `HAKMEM_TINY_WARM_LOG` (OFF by default)
- ❌ 実行されない（Phase 29 pattern）
- **Verdict:** SKIP
2. `g_p0_class_oob_log` (WARM, TELEMETRY)
- ✅ ENV gate なし
- ⚠️ Error path（out-of-bounds class index）
- ❓ 実行頻度不明（要検証）
- **Verdict:** LOW PRIORITY（Phase 32 候補）
### 4-Step Standard Procedure
**Phase 30 で確立された型:**
**Step 0: 実行確認（NEW - Phase 29 教訓）**
- ENV gate チェック（`rg "getenv.*FEATURE" core/`）
- 実行カウンタ確認（Mixed 10-run で > 0）
- perf/flamegraph 検証（オプション）
- **Decision:** ❌ 実行されない → SKIP
**Step 1: CORRECTNESS/TELEMETRY 分類（Phase 28 教訓）**
- 全使用箇所を追跡（`rg -n "g_variable" core/`）
- `if` 条件で使用 → CORRECTNESS（DO NOT TOUCH）
- `fprintf/fprintf` のみ → TELEMETRY（compile-out 候補）
- **Decision:** CORRECTNESS → DO NOT TOUCH
**Step 2: Compile-Out 実装（Phase 24-27 pattern）**
- `hakmem_build_flags.h` に gate 追加
- TELEMETRY atomic を `#if` で wrap
- Build-level compile-out（link-out 禁止）
**Step 3: A/B Test（build-level comparison）**
- Baseline (COMPILED=0): default build
- Compiled-in (COMPILED=1): research build
- **Verdict:** GO (+0.5%+), NEUTRAL (±0.5%), NO-GO (-0.5%+)
### 判定
**PROCEDURE COMPLETE** ✅
**理由:**
- 4-step procedure 確立（Phase 24-29 学習を体系化）
- Step 0 (実行確認) が Phase 29 空振りを防ぐ
- 全 atomic 監査完了（412 atomics）
- Phase 31 候補選定完了（TOP 1: `g_tiny_free_trace`）
### ドキュメント
- `docs/analysis/PHASE30_STANDARD_PROCEDURE.md` (標準手順書)
- `docs/analysis/ATOMIC_AUDIT_FULL.txt` (全 atomic 監査結果)
- `docs/analysis/PHASE31_RECOMMENDED_CANDIDATES.md` (Phase 31 候補 TOP 3)
- `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` (Phase 24-30 総括)
### 教訓
**空振り防止 3 原則:**
1. **Step 0 は必須ゲート**: ENV-gated コードは最初に弾く（Phase 29 教訓）
2. **カウンタ名 ≠ 用途**: Flow control か telemetry か全使用箇所で確認（Phase 28 教訓）
3. **HOT path 優先**: 実行頻度が性能影響を決める（Phase 24-27 教訓）
## 累積効果（Phase 24+25+26+27+28+29+30+31）
| Phase | Target | Impact | Status |
|-------|--------|--------|--------|
| **24** | `g_tiny_class_stats_*` (5 atomics) | **+0.93%** | GO ✅ |
| **25** | `g_free_ss_enter` (1 atomic) | **+1.07%** | GO ✅ |
| **26** | Hot path diagnostics (5 atomics) | **-0.33%** | NEUTRAL ✅ |
| **27** | `g_unified_cache_*` (6 atomics) | **+0.74%** | GO ✅ |
| **28** | Background Spill Queue (8 atomics) | **N/A** | NO-OP ✅ |
| **29** | Pool Hotbox v2 Stats (12 atomics) | **0.00%** | NO-OP ✅ |
| **30** | Standard Procedure (412 atomic audit) | **N/A** | PROCEDURE ✅ |
| **31** | `g_tiny_free_trace` (1 atomic) | **-0.35%** | NEUTRAL ✅ |
| **合計** | **18 atomics removed, 412 audited** | **+2.74%** | **✅** |
**Key Insight:** 標準手順が次の Phase の成功確率を上げる。
- Step 0 (実行確認) で ENV-gated code を弾く → Phase 29 空振りを防止
- Step 1 (分類) で CORRECTNESS を弾く → Phase 28 誤判定を防止
- HOT path 優先 → Phase 24-27 成功パターン（+0.5~1.0%）
- **NEW:** NEUTRAL verdict でも code cleanliness で採用可 → Phase 26/31 パターン
## Phase 31: g_tiny_free_trace compile-out 完了（2025-12-16）
### 実施内容
**目的:** `hak_tiny_free()` 先頭の trace-rate-limit atomic を compile-out（default）して固定税を削る。
**成果物:**
1. `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md` - A/B test results + NEUTRAL verdict
2. `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` 更新（Phase 31 追記）
3. `CURRENT_TASK.md` 更新（Phase 31 完了 + Phase 32 候補提示）
### A/B Test 結果
**Baseline (COMPILED=0, trace compiled-out):**
- Mean: 53.64 M ops/s
- Median: 53.80 M ops/s
**Compiled-in (COMPILED=1, trace active):**
- Mean: 53.83 M ops/s
- Median: 53.70 M ops/s
**Difference:**
- Mean: -0.35% (Baseline SLOWER)
- Median: +0.19% (Baseline FASTER)
- **Verdict:** **NEUTRAL** (±0.5% 範囲内)
### 判定
**NEUTRAL → Code Cleanliness で採用** ✅
**理由:**
1. **Performance:** Mean -0.35%, Median +0.19% → 測定ノイズ範囲（conflicting signals）
2. **Phase 26 precedent:** -0.33% NEUTRAL → code cleanliness で採用
3. **Phase 31 同型:** -0.35% NEUTRAL → 同じ判断基準を適用
4. **Code cleanliness benefits:**
- HOT path (`hak_tiny_free()` entry) から unused TELEMETRY atomic 削除
- 複雑さ削減（trace macro のみ、flow control なし）
- Research flexibility 維持（`COMPILED=1` で復活可）
**Key Finding:** Not all HOT path atomics have measurable overhead
- Phase 25 (`g_free_ss_enter`): +1.07% GO (always-increment stats)
- Phase 31 (`g_tiny_free_trace`): NEUTRAL (rate-limited to 128 calls)
- **Hypothesis:** Rate-limiting or compiler optimization may eliminate overhead
### ドキュメント
- `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md` (完全な A/B test 結果)
- `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` (Phase 24-31 総括)
- `CURRENT_TASK.md` (Phase 31 完了 + Phase 32 候補)
### 教訓
**Phase 31 から学んだこと:**
1. **HOT path ≠ guaranteed win:** Even high-frequency atomics may have zero overhead if optimized
2. **NEUTRAL is valid:** Code cleanliness justifies compile-out even without performance gain (Phase 26/31 precedent)
3. **Step 0 (execution verification) works:** Prevented Phase 29-style no-op (confirmed always active)
4. **Standard procedure validated:** Phase 30 4-step procedure successfully guided Phase 31
## 次の指示（Phase 32 実施）
**Phase 31 完了:** NEUTRAL verdict、code cleanliness で採用 → Phase 32 実施へ
### Phase 32 推奨候補: `g_hak_tiny_free_calls` (HOT path, TOP PRIORITY) ⭐
**Location:** `core/hakmem_tiny_free.inc:335` (9 lines after Phase 31 target)
**Code Context:**
```c
void hak_tiny_free(void* ptr) {
#if HAKMEM_TINY_FREE_TRACE_COMPILED
// Phase 31 target (now compiled-out)
#endif
// Track total tiny free calls (diagnostics)
extern _Atomic uint64_t g_hak_tiny_free_calls;
atomic_fetch_add_explicit(&g_hak_tiny_free_calls, 1, memory_order_relaxed); // ← Phase 32 target
// ... rest of function ...
}
```
**Classification:**
- **Class:** TELEMETRY (trace macro only)
- **Path:** HOT (every tiny free call)
- **Usage:** Only for `HAK_TRACE` debug macro output
- **ENV Gate:** None (always active)
**Step 0 Verification (inherited from Phase 31):**
- ✅ No ENV gate blocking execution (same function as Phase 31)
- ✅ In `hak_tiny_free()` - called on every tiny free operation
- ✅ Mixed benchmark heavily exercises tiny free path
- ✅ Confirmed: Executes thousands of times per benchmark run (same as Phase 31)
**Expected Impact:** **+0.3% to +0.7%** (smaller than Phase 25: +1.07%, similar to Phase 31: NEUTRAL)
**Implementation Plan:**
**Step 1: 分類（要実施）**
- ❓ Classification needed: TELEMETRY or CORRECTNESS?
- ❓ Check all usage sites with `rg -n "g_hak_tiny_free_calls" core/`
- ❓ Verify no `if` conditions using counter value
- ✅ Expected: Pure TELEMETRY (diagnostic counter)
**Step 2: Compile-Out 実装**
a) Add BuildFlags gate:
```c
// core/hakmem_build_flags.h
// ========== Tiny Free Calls Counter Prune (Phase 32) ==========
#ifndef HAKMEM_TINY_FREE_CALLS_COMPILED
# define HAKMEM_TINY_FREE_CALLS_COMPILED 0
#endif
```
b) Wrap atomic in `core/hakmem_tiny_free.inc`:
```c
void hak_tiny_free(void* ptr) {
#if HAKMEM_TINY_FREE_TRACE_COMPILED
// Phase 31 (already compiled-out)
#endif
#if HAKMEM_TINY_FREE_CALLS_COMPILED
extern _Atomic uint64_t g_hak_tiny_free_calls;
atomic_fetch_add_explicit(&g_hak_tiny_free_calls, 1, memory_order_relaxed);
#else
(void)0; // No-op when compiled out
#endif
// ... rest of function ...
}
```
**Step 3: A/B Test**
Baseline (COMPILED=0):
```bash
make clean && make -j bench_random_mixed_hakmem
scripts/run_mixed_10_cleanenv.sh
```
Compiled-in (COMPILED=1):
```bash
make clean && make -j EXTRA_CFLAGS='-DHAKMEM_TINY_FREE_CALLS_COMPILED=1' bench_random_mixed_hakmem
scripts/run_mixed_10_cleanenv.sh
```
**Expected Result:** +0.3% to +0.7% (possible GO, or NEUTRAL like Phase 31)
**Rationale:**
- Same HOT path as Phase 31 (9 lines below in same function)
- No ENV gate blocking execution (verified in Phase 31)
- Similar profile to Phase 31 (diagnostic counter)
- Moderate confidence: NEUTRAL possible (like Phase 31), but worth trying
### Alternative Candidates (if Phase 32 shows NEUTRAL again)
**#3: `g_p0_class_oob_log` (WARM path, error logging)**
- ❓ Execution uncertain (error path)
- Expected: ±0.0% to +0.2%
- Action: Verify execution first
**#4-#N: Manual review of UNKNOWN atomics (284 candidates)**
- Many may be misclassified by naming heuristics
- Requires deeper code inspection
- Lower priority
**Note:** If Phase 32 is NEUTRAL (like Phase 31), consider pausing HOT path atomic prune and moving to other optimization areas (e.g., inlining, branch optimization, SIMD opportunities).
## 参考
- **Standard Procedure:** `docs/analysis/PHASE30_STANDARD_PROCEDURE.md`
- **Phase 31 Results:** `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md`
- **Cumulative Summary:** `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md`
- **mimalloc Gap Analysis:** `docs/roadmap/OPTIMIZATION_ROADMAP.md`
- **Box Theory:** Phase 6-1.7+ の Box Refactor パターン
- **Phase 24-27 Pattern:** `core/box/tiny_class_stats_box.h`, `core/hakmem_build_flags.h`
- **Phase 26/31 NEUTRAL Precedent:** Code cleanliness adoption without performance win
## タスク完了条件
### Phase 30 完了済み条件（2025-12-16）:
1. ✅ `PHASE30_STANDARD_PROCEDURE.md` 作成（4-step procedure）
2. ✅ 全 atomic 監査実行（412 atomics, audit_atomics.sh）
3. ✅ HOT/WARM path TELEMETRY 候補抽出
4. ✅ Step 0 実行確認（全候補）
5. ✅ `PHASE31_RECOMMENDED_CANDIDATES.md` 作成（TOP 3 prioritized）
6. ✅ Cumulative summary 更新（Phase 24-30）
7. ✅ CURRENT_TASK.md 更新（Phase 31 候補提示）
### Phase 31 完了条件（2025-12-16）:
1. ✅ 候補選定完了（`g_tiny_free_trace`, HOT path）
2. ✅ Step 0 実行確認完了（ENV gate なし、実行確認済み）
3. ✅ Step 1 分類完了（Pure TELEMETRY、CORRECTNESS なし）
4. ✅ Step 2 実装（BuildFlags + `#if` wrap）
5. ✅ Step 3 A/B test（Baseline vs Compiled-in）
6. ✅ 結果ドキュメント作成（PHASE31_RESULTS.md）
7. ✅ NEUTRAL verdict → code cleanliness で採用
### Phase 32 開始前の前提条件:
1. ✅ 候補選定完了（`g_hak_tiny_free_calls`, HOT path, same function as Phase 31）
2. ✅ Step 0 実行確認完了（Phase 31 と同じ関数、ENV gate なし）
3. ⏳ Step 1 分類（TELEMETRY/CORRECTNESS 判定）
4. ⏳ Step 2 実装（BuildFlags + `#if` wrap）
5. ⏳ Step 3 A/B test（Baseline vs Compiled-in）
6. ⏳ 結果ドキュメント作成（PHASE32_RESULTS.md）
---
**Last Updated:** 2025-12-16
**Current Phase:** Phase 31 Complete (NEUTRAL -0.35%, adopted for code cleanliness)
**Next Phase:** Phase 32 (`g_hak_tiny_free_calls`, HOT path, expected +0.3% to +0.7% or NEUTRAL)
**Cumulative Progress:** +2.74% (18 atomics removed, 412 atomics audited)

61
Makefile
View File

@ -253,7 +253,7 @@ LDFLAGS += $(EXTRA_LDFLAGS)
# Targets
TARGET = test_hakmem
OBJS_BASE = hakmem.o hakmem_config.o hakmem_tiny_config.o hakmem_ucb1.o hakmem_bigcache.o hakmem_pool.o hakmem_l25_pool.o hakmem_site_rules.o hakmem_tiny.o core/box/ss_allocation_box.o superslab_stats.o superslab_cache.o superslab_ace.o superslab_slab.o superslab_backend.o core/superslab_head_stub.o hakmem_smallmid.o tiny_sticky.o tiny_remote.o tiny_publish.o tiny_debug_ring.o hakmem_tiny_magazine.o hakmem_tiny_stats.o hakmem_tiny_sfc.o hakmem_tiny_query.o hakmem_tiny_rss.o hakmem_tiny_registry.o hakmem_tiny_remote_target.o hakmem_tiny_bg_spill.o tiny_adaptive_sizing.o hakmem_super_registry.o hakmem_shared_pool.o hakmem_shared_pool_acquire.o hakmem_shared_pool_release.o hakmem_elo.o hakmem_batch.o hakmem_p2.o hakmem_sizeclass_dist.o hakmem_evo.o hakmem_debug.o hakmem_sys.o hakmem_whale.o hakmem_policy.o hakmem_ace.o hakmem_ace_stats.o hakmem_prof.o hakmem_learner.o hakmem_size_hist.o hakmem_learn_log.o hakmem_syscall.o hakmem_ace_metrics.o hakmem_ace_ucb1.o hakmem_ace_controller.o tiny_fastcache.o core/box/superslab_expansion_box.o core/box/integrity_box.o core/box/free_publish_box.o core/box/mailbox_box.o core/box/front_gate_box.o core/box/front_gate_classifier.o core/box/capacity_box.o core/box/carve_push_box.o core/box/prewarm_box.o core/box/ss_hot_prewarm_box.o core/box/front_metrics_box.o core/box/bench_fast_box.o core/box/ss_addr_map_box.o core/box/ss_pt_impl.o core/box/slab_recycling_box.o core/box/pagefault_telemetry_box.o core/box/tiny_sizeclass_hist_box.o core/box/tiny_env_box.o core/box/tiny_route_box.o core/box/free_front_v3_env_box.o core/box/free_path_stats_box.o core/box/free_dispatch_stats_box.o core/box/free_cold_shape_env_box.o core/box/free_cold_shape_stats_box.o core/box/alloc_gate_stats_box.o core/box/tiny_c6_ultra_free_box.o core/box/tiny_c5_ultra_free_box.o core/box/tiny_c4_ultra_free_box.o core/box/tiny_ultra_tls_box.o core/box/tiny_page_box.o core/box/tiny_class_policy_box.o core/box/tiny_class_stats_box.o core/box/tiny_policy_learner_box.o core/box/ss_budget_box.o core/box/tiny_mem_stats_box.o core/box/c7_meta_used_counter_box.o core/box/tiny_static_route_box.o core/box/tiny_metadata_cache_hot_box.o core/box/wrapper_env_box.o core/box/free_wrapper_env_snapshot_box.o core/box/malloc_wrapper_env_snapshot_box.o core/box/madvise_guard_box.o core/box/libm_reloc_guard_box.o core/box/ptr_trace_box.o core/box/link_missing_stubs.o core/box/super_reg_box.o core/box/shared_pool_box.o core/box/remote_side_box.o core/box/tiny_free_route_cache_env_box.o core/box/hakmem_env_snapshot_box.o core/box/tiny_c7_preserve_header_env_box.o core/box/tiny_tcache_env_box.o core/box/tiny_unified_lifo_env_box.o core/box/front_fastlane_alloc_legacy_direct_env_box.o core/box/fastlane_direct_env_box.o core/box/tiny_header_hotfull_env_box.o core/page_arena.o core/front/tiny_unified_cache.o core/tiny_alloc_fast_push.o core/tiny_c7_ultra_segment.o core/tiny_c7_ultra.o core/link_stubs.o core/tiny_failfast.o core/tiny_destructors.o core/smallobject_hotbox_v3.o core/smallobject_hotbox_v4.o core/smallobject_hotbox_v5.o core/smallsegment_v5.o core/smallobject_cold_iface_v5.o core/smallsegment_v6.o core/smallobject_cold_iface_v6.o core/smallobject_core_v6.o core/region_id_v6.o core/smallsegment_v7.o core/smallobject_cold_iface_v7.o core/mid_hotbox_v3.o core/smallobject_policy_v7.o core/smallobject_segment_mid_v3.o core/smallobject_cold_iface_mid_v3.o core/smallobject_stats_mid_v3.o core/smallobject_learner_v2.o core/smallobject_mid_v35.o
OBJS_BASE = hakmem.o hakmem_config.o hakmem_tiny_config.o hakmem_ucb1.o hakmem_bigcache.o hakmem_pool.o hakmem_l25_pool.o hakmem_site_rules.o hakmem_tiny.o core/box/ss_allocation_box.o superslab_stats.o superslab_cache.o superslab_ace.o superslab_slab.o superslab_backend.o core/superslab_head_stub.o hakmem_smallmid.o tiny_sticky.o tiny_remote.o tiny_publish.o tiny_debug_ring.o hakmem_tiny_magazine.o hakmem_tiny_stats.o hakmem_tiny_sfc.o hakmem_tiny_query.o hakmem_tiny_rss.o hakmem_tiny_registry.o hakmem_tiny_remote_target.o hakmem_tiny_bg_spill.o tiny_adaptive_sizing.o hakmem_super_registry.o hakmem_shared_pool.o hakmem_shared_pool_acquire.o hakmem_shared_pool_release.o hakmem_elo.o hakmem_batch.o hakmem_p2.o hakmem_sizeclass_dist.o hakmem_evo.o hakmem_debug.o hakmem_sys.o hakmem_whale.o hakmem_policy.o hakmem_ace.o hakmem_ace_stats.o hakmem_prof.o hakmem_learner.o hakmem_size_hist.o hakmem_learn_log.o hakmem_syscall.o hakmem_ace_metrics.o hakmem_ace_ucb1.o hakmem_ace_controller.o tiny_fastcache.o core/box/superslab_expansion_box.o core/box/integrity_box.o core/box/free_publish_box.o core/box/mailbox_box.o core/box/front_gate_box.o core/box/front_gate_classifier.o core/box/capacity_box.o core/box/carve_push_box.o core/box/prewarm_box.o core/box/ss_hot_prewarm_box.o core/box/front_metrics_box.o core/box/bench_fast_box.o core/box/ss_addr_map_box.o core/box/ss_pt_impl.o core/box/slab_recycling_box.o core/box/pagefault_telemetry_box.o core/box/tiny_sizeclass_hist_box.o core/box/tiny_env_box.o core/box/tiny_route_box.o core/box/free_front_v3_env_box.o core/box/free_path_stats_box.o core/box/free_dispatch_stats_box.o core/box/free_cold_shape_env_box.o core/box/free_cold_shape_stats_box.o core/box/alloc_gate_stats_box.o core/box/tiny_c6_ultra_free_box.o core/box/tiny_c5_ultra_free_box.o core/box/tiny_c4_ultra_free_box.o core/box/tiny_ultra_tls_box.o core/box/tiny_page_box.o core/box/tiny_class_policy_box.o core/box/tiny_class_stats_box.o core/box/tiny_policy_learner_box.o core/box/ss_budget_box.o core/box/tiny_mem_stats_box.o core/box/c7_meta_used_counter_box.o core/box/tiny_static_route_box.o core/box/tiny_metadata_cache_hot_box.o core/box/wrapper_env_box.o core/box/free_wrapper_env_snapshot_box.o core/box/malloc_wrapper_env_snapshot_box.o core/box/madvise_guard_box.o core/box/libm_reloc_guard_box.o core/box/ptr_trace_box.o core/box/link_missing_stubs.o core/box/super_reg_box.o core/box/shared_pool_box.o core/box/remote_side_box.o core/box/tiny_free_route_cache_env_box.o core/box/hakmem_env_snapshot_box.o core/box/tiny_c7_preserve_header_env_box.o core/box/tiny_tcache_env_box.o core/box/tiny_unified_lifo_env_box.o core/box/front_fastlane_alloc_legacy_direct_env_box.o core/box/fastlane_direct_env_box.o core/box/tiny_header_hotfull_env_box.o core/page_arena.o core/front/tiny_unified_cache.o core/tiny_alloc_fast_push.o core/tiny_c7_ultra_segment.o core/tiny_c7_ultra.o core/link_stubs.o core/tiny_failfast.o core/tiny_destructors.o core/smallobject_hotbox_v3.o core/smallobject_hotbox_v4.o core/smallobject_hotbox_v5.o core/smallsegment_v5.o core/smallobject_cold_iface_v5.o core/smallsegment_v6.o core/smallobject_cold_iface_v6.o core/smallobject_core_v6.o core/region_id_v6.o core/smallsegment_v7.o core/smallobject_cold_iface_v7.o core/mid_hotbox_v3.o core/smallobject_policy_v7.o core/smallobject_segment_mid_v3.o core/smallobject_cold_iface_mid_v3.o core/smallobject_stats_mid_v3.o core/smallobject_learner_v2.o core/smallobject_mid_v35.o core/box/small_policy_snapshot_tls_box.o
OBJS = $(OBJS_BASE)
# Shared library
@ -285,7 +285,7 @@ endif
# Benchmark targets
BENCH_HAKMEM = bench_allocators_hakmem
BENCH_SYSTEM = bench_allocators_system
BENCH_HAKMEM_OBJS_BASE = hakmem.o hakmem_config.o hakmem_tiny_config.o hakmem_ucb1.o hakmem_bigcache.o hakmem_pool.o hakmem_l25_pool.o hakmem_site_rules.o hakmem_tiny.o core/box/ss_allocation_box.o superslab_stats.o superslab_cache.o superslab_ace.o superslab_slab.o superslab_backend.o core/superslab_head_stub.o hakmem_smallmid.o tiny_sticky.o tiny_remote.o tiny_publish.o tiny_debug_ring.o hakmem_tiny_magazine.o hakmem_tiny_stats.o hakmem_tiny_sfc.o hakmem_tiny_query.o hakmem_tiny_rss.o hakmem_tiny_registry.o hakmem_tiny_remote_target.o hakmem_tiny_bg_spill.o tiny_adaptive_sizing.o hakmem_super_registry.o hakmem_shared_pool.o hakmem_shared_pool_acquire.o hakmem_shared_pool_release.o hakmem_elo.o hakmem_batch.o hakmem_p2.o hakmem_sizeclass_dist.o hakmem_evo.o hakmem_debug.o hakmem_sys.o hakmem_whale.o hakmem_policy.o hakmem_ace.o hakmem_ace_stats.o hakmem_prof.o hakmem_learner.o hakmem_size_hist.o hakmem_learn_log.o hakmem_syscall.o hakmem_ace_metrics.o hakmem_ace_ucb1.o hakmem_ace_controller.o tiny_fastcache.o core/box/superslab_expansion_box.o core/box/integrity_box.o core/box/free_publish_box.o core/box/mailbox_box.o core/box/front_gate_box.o core/box/front_gate_classifier.o core/box/capacity_box.o core/box/carve_push_box.o core/box/prewarm_box.o core/box/ss_hot_prewarm_box.o core/box/front_metrics_box.o core/box/bench_fast_box.o core/box/ss_addr_map_box.o core/box/slab_recycling_box.o core/box/pagefault_telemetry_box.o core/box/tiny_sizeclass_hist_box.o core/box/tiny_env_box.o core/box/tiny_route_box.o core/box/free_front_v3_env_box.o core/box/free_path_stats_box.o core/box/free_dispatch_stats_box.o core/box/free_cold_shape_env_box.o core/box/free_cold_shape_stats_box.o core/box/alloc_gate_stats_box.o core/box/tiny_c6_ultra_free_box.o core/box/tiny_c5_ultra_free_box.o core/box/tiny_c4_ultra_free_box.o core/box/tiny_ultra_tls_box.o core/box/tiny_page_box.o core/box/tiny_class_policy_box.o core/box/tiny_class_stats_box.o core/box/tiny_policy_learner_box.o core/box/ss_budget_box.o core/box/tiny_mem_stats_box.o core/box/c7_meta_used_counter_box.o core/box/tiny_static_route_box.o core/box/tiny_metadata_cache_hot_box.o core/box/wrapper_env_box.o core/box/free_wrapper_env_snapshot_box.o core/box/malloc_wrapper_env_snapshot_box.o core/box/madvise_guard_box.o core/box/libm_reloc_guard_box.o core/box/ptr_trace_box.o core/box/link_missing_stubs.o core/box/super_reg_box.o core/box/shared_pool_box.o core/box/remote_side_box.o core/box/tiny_free_route_cache_env_box.o core/box/fastlane_direct_env_box.o core/page_arena.o core/front/tiny_unified_cache.o core/tiny_alloc_fast_push.o core/tiny_c7_ultra_segment.o core/tiny_c7_ultra.o core/link_stubs.o core/tiny_failfast.o core/tiny_destructors.o core/smallobject_hotbox_v3.o core/smallobject_hotbox_v4.o core/smallobject_hotbox_v5.o core/smallsegment_v5.o core/smallobject_cold_iface_v5.o core/smallsegment_v6.o core/smallobject_cold_iface_v6.o core/smallobject_core_v6.o core/region_id_v6.o core/smallsegment_v7.o core/smallobject_cold_iface_v7.o core/mid_hotbox_v3.o core/smallobject_policy_v7.o core/smallobject_segment_mid_v3.o core/smallobject_cold_iface_mid_v3.o core/smallobject_stats_mid_v3.o core/smallobject_learner_v2.o core/smallobject_mid_v35.o bench_allocators_hakmem.o
BENCH_HAKMEM_OBJS_BASE = hakmem.o hakmem_config.o hakmem_tiny_config.o hakmem_ucb1.o hakmem_bigcache.o hakmem_pool.o hakmem_l25_pool.o hakmem_site_rules.o hakmem_tiny.o core/box/ss_allocation_box.o superslab_stats.o superslab_cache.o superslab_ace.o superslab_slab.o superslab_backend.o core/superslab_head_stub.o hakmem_smallmid.o tiny_sticky.o tiny_remote.o tiny_publish.o tiny_debug_ring.o hakmem_tiny_magazine.o hakmem_tiny_stats.o hakmem_tiny_sfc.o hakmem_tiny_query.o hakmem_tiny_rss.o hakmem_tiny_registry.o hakmem_tiny_remote_target.o hakmem_tiny_bg_spill.o tiny_adaptive_sizing.o hakmem_super_registry.o hakmem_shared_pool.o hakmem_shared_pool_acquire.o hakmem_shared_pool_release.o hakmem_elo.o hakmem_batch.o hakmem_p2.o hakmem_sizeclass_dist.o hakmem_evo.o hakmem_debug.o hakmem_sys.o hakmem_whale.o hakmem_policy.o hakmem_ace.o hakmem_ace_stats.o hakmem_prof.o hakmem_learner.o hakmem_size_hist.o hakmem_learn_log.o hakmem_syscall.o hakmem_ace_metrics.o hakmem_ace_ucb1.o hakmem_ace_controller.o tiny_fastcache.o core/box/superslab_expansion_box.o core/box/integrity_box.o core/box/free_publish_box.o core/box/mailbox_box.o core/box/front_gate_box.o core/box/front_gate_classifier.o core/box/capacity_box.o core/box/carve_push_box.o core/box/prewarm_box.o core/box/ss_hot_prewarm_box.o core/box/front_metrics_box.o core/box/bench_fast_box.o core/box/ss_addr_map_box.o core/box/slab_recycling_box.o core/box/pagefault_telemetry_box.o core/box/tiny_sizeclass_hist_box.o core/box/tiny_env_box.o core/box/tiny_route_box.o core/box/free_front_v3_env_box.o core/box/free_path_stats_box.o core/box/free_dispatch_stats_box.o core/box/free_cold_shape_env_box.o core/box/free_cold_shape_stats_box.o core/box/alloc_gate_stats_box.o core/box/tiny_c6_ultra_free_box.o core/box/tiny_c5_ultra_free_box.o core/box/tiny_c4_ultra_free_box.o core/box/tiny_ultra_tls_box.o core/box/tiny_page_box.o core/box/tiny_class_policy_box.o core/box/tiny_class_stats_box.o core/box/tiny_policy_learner_box.o core/box/ss_budget_box.o core/box/tiny_mem_stats_box.o core/box/c7_meta_used_counter_box.o core/box/tiny_static_route_box.o core/box/tiny_metadata_cache_hot_box.o core/box/wrapper_env_box.o core/box/free_wrapper_env_snapshot_box.o core/box/malloc_wrapper_env_snapshot_box.o core/box/madvise_guard_box.o core/box/libm_reloc_guard_box.o core/box/ptr_trace_box.o core/box/link_missing_stubs.o core/box/super_reg_box.o core/box/shared_pool_box.o core/box/remote_side_box.o core/box/tiny_free_route_cache_env_box.o core/box/fastlane_direct_env_box.o core/page_arena.o core/front/tiny_unified_cache.o core/tiny_alloc_fast_push.o core/tiny_c7_ultra_segment.o core/tiny_c7_ultra.o core/link_stubs.o core/tiny_failfast.o core/tiny_destructors.o core/smallobject_hotbox_v3.o core/smallobject_hotbox_v4.o core/smallobject_hotbox_v5.o core/smallsegment_v5.o core/smallobject_cold_iface_v5.o core/smallsegment_v6.o core/smallobject_cold_iface_v6.o core/smallobject_core_v6.o core/region_id_v6.o core/smallsegment_v7.o core/smallobject_cold_iface_v7.o core/mid_hotbox_v3.o core/smallobject_policy_v7.o core/smallobject_segment_mid_v3.o core/smallobject_cold_iface_mid_v3.o core/smallobject_stats_mid_v3.o core/smallobject_learner_v2.o core/smallobject_mid_v35.o core/box/small_policy_snapshot_tls_box.o bench_allocators_hakmem.o
BENCH_HAKMEM_OBJS = $(BENCH_HAKMEM_OBJS_BASE)
ifeq ($(POOL_TLS_PHASE1),1)
BENCH_HAKMEM_OBJS += pool_tls.o pool_refill.o pool_tls_arena.o pool_tls_registry.o pool_tls_remote.o
@ -462,7 +462,7 @@ test-box-refactor: box-refactor
./larson_hakmem 10 8 128 1024 1 12345 4
# Phase 4: Tiny Pool benchmarks (properly linked with hakmem)
TINY_BENCH_OBJS_BASE = hakmem.o hakmem_config.o hakmem_tiny_config.o hakmem_ucb1.o hakmem_bigcache.o hakmem_pool.o hakmem_l25_pool.o hakmem_site_rules.o hakmem_tiny.o core/box/ss_allocation_box.o superslab_stats.o superslab_cache.o superslab_ace.o superslab_slab.o superslab_backend.o core/superslab_head_stub.o hakmem_smallmid.o core/box/superslab_expansion_box.o core/box/integrity_box.o core/box/mailbox_box.o core/box/front_gate_box.o core/box/front_gate_classifier.o core/box/free_publish_box.o core/box/capacity_box.o core/box/carve_push_box.o core/box/prewarm_box.o core/box/ss_hot_prewarm_box.o core/box/front_metrics_box.o core/box/bench_fast_box.o core/box/ss_addr_map_box.o core/box/ss_pt_impl.o core/box/slab_recycling_box.o core/box/pagefault_telemetry_box.o core/box/tiny_sizeclass_hist_box.o core/box/tiny_env_box.o core/box/tiny_route_box.o core/box/free_front_v3_env_box.o core/box/free_path_stats_box.o core/box/free_dispatch_stats_box.o core/box/free_cold_shape_env_box.o core/box/free_cold_shape_stats_box.o core/box/alloc_gate_stats_box.o core/box/tiny_c6_ultra_free_box.o core/box/tiny_c5_ultra_free_box.o core/box/tiny_c4_ultra_free_box.o core/box/tiny_ultra_tls_box.o core/box/tiny_page_box.o core/box/tiny_class_policy_box.o core/box/tiny_class_stats_box.o core/box/tiny_policy_learner_box.o core/box/ss_budget_box.o core/box/tiny_mem_stats_box.o core/box/c7_meta_used_counter_box.o core/box/tiny_static_route_box.o core/box/tiny_metadata_cache_hot_box.o core/box/wrapper_env_box.o core/box/free_wrapper_env_snapshot_box.o core/box/malloc_wrapper_env_snapshot_box.o core/box/madvise_guard_box.o core/box/libm_reloc_guard_box.o core/box/ptr_trace_box.o core/box/link_missing_stubs.o core/box/super_reg_box.o core/box/shared_pool_box.o core/box/remote_side_box.o core/box/tiny_free_route_cache_env_box.o core/box/hakmem_env_snapshot_box.o core/box/tiny_c7_preserve_header_env_box.o core/box/tiny_tcache_env_box.o core/box/tiny_unified_lifo_env_box.o core/box/front_fastlane_alloc_legacy_direct_env_box.o core/box/fastlane_direct_env_box.o core/box/tiny_header_hotfull_env_box.o core/page_arena.o core/front/tiny_unified_cache.o tiny_sticky.o tiny_remote.o tiny_publish.o tiny_debug_ring.o hakmem_tiny_magazine.o hakmem_tiny_stats.o hakmem_tiny_sfc.o hakmem_tiny_query.o hakmem_tiny_rss.o hakmem_tiny_registry.o hakmem_tiny_remote_target.o hakmem_tiny_bg_spill.o tiny_adaptive_sizing.o hakmem_super_registry.o hakmem_shared_pool.o hakmem_shared_pool_acquire.o hakmem_shared_pool_release.o hakmem_elo.o hakmem_batch.o hakmem_p2.o hakmem_sizeclass_dist.o hakmem_evo.o hakmem_debug.o hakmem_sys.o hakmem_whale.o hakmem_policy.o hakmem_ace.o hakmem_ace_stats.o hakmem_prof.o hakmem_learner.o hakmem_size_hist.o hakmem_learn_log.o hakmem_syscall.o hakmem_ace_metrics.o hakmem_ace_ucb1.o hakmem_ace_controller.o tiny_fastcache.o core/tiny_alloc_fast_push.o core/tiny_c7_ultra_segment.o core/tiny_c7_ultra.o core/link_stubs.o core/tiny_failfast.o core/tiny_destructors.o core/smallobject_hotbox_v3.o core/smallobject_hotbox_v4.o core/smallobject_hotbox_v5.o core/smallsegment_v5.o core/smallobject_cold_iface_v5.o core/smallsegment_v6.o core/smallobject_cold_iface_v6.o core/smallobject_core_v6.o core/region_id_v6.o core/smallsegment_v7.o core/smallobject_cold_iface_v7.o core/mid_hotbox_v3.o core/smallobject_policy_v7.o core/smallobject_segment_mid_v3.o core/smallobject_cold_iface_mid_v3.o core/smallobject_stats_mid_v3.o core/smallobject_learner_v2.o core/smallobject_mid_v35.o
TINY_BENCH_OBJS_BASE = hakmem.o hakmem_config.o hakmem_tiny_config.o hakmem_ucb1.o hakmem_bigcache.o hakmem_pool.o hakmem_l25_pool.o hakmem_site_rules.o hakmem_tiny.o core/box/ss_allocation_box.o superslab_stats.o superslab_cache.o superslab_ace.o superslab_slab.o superslab_backend.o core/superslab_head_stub.o hakmem_smallmid.o core/box/superslab_expansion_box.o core/box/integrity_box.o core/box/mailbox_box.o core/box/front_gate_box.o core/box/front_gate_classifier.o core/box/free_publish_box.o core/box/capacity_box.o core/box/carve_push_box.o core/box/prewarm_box.o core/box/ss_hot_prewarm_box.o core/box/front_metrics_box.o core/box/bench_fast_box.o core/box/ss_addr_map_box.o core/box/ss_pt_impl.o core/box/slab_recycling_box.o core/box/pagefault_telemetry_box.o core/box/tiny_sizeclass_hist_box.o core/box/tiny_env_box.o core/box/tiny_route_box.o core/box/free_front_v3_env_box.o core/box/free_path_stats_box.o core/box/free_dispatch_stats_box.o core/box/free_cold_shape_env_box.o core/box/free_cold_shape_stats_box.o core/box/alloc_gate_stats_box.o core/box/tiny_c6_ultra_free_box.o core/box/tiny_c5_ultra_free_box.o core/box/tiny_c4_ultra_free_box.o core/box/tiny_ultra_tls_box.o core/box/tiny_page_box.o core/box/tiny_class_policy_box.o core/box/tiny_class_stats_box.o core/box/tiny_policy_learner_box.o core/box/ss_budget_box.o core/box/tiny_mem_stats_box.o core/box/c7_meta_used_counter_box.o core/box/tiny_static_route_box.o core/box/tiny_metadata_cache_hot_box.o core/box/wrapper_env_box.o core/box/free_wrapper_env_snapshot_box.o core/box/malloc_wrapper_env_snapshot_box.o core/box/madvise_guard_box.o core/box/libm_reloc_guard_box.o core/box/ptr_trace_box.o core/box/link_missing_stubs.o core/box/super_reg_box.o core/box/shared_pool_box.o core/box/remote_side_box.o core/box/tiny_free_route_cache_env_box.o core/box/hakmem_env_snapshot_box.o core/box/tiny_c7_preserve_header_env_box.o core/box/tiny_tcache_env_box.o core/box/tiny_unified_lifo_env_box.o core/box/front_fastlane_alloc_legacy_direct_env_box.o core/box/fastlane_direct_env_box.o core/box/tiny_header_hotfull_env_box.o core/page_arena.o core/front/tiny_unified_cache.o tiny_sticky.o tiny_remote.o tiny_publish.o tiny_debug_ring.o hakmem_tiny_magazine.o hakmem_tiny_stats.o hakmem_tiny_sfc.o hakmem_tiny_query.o hakmem_tiny_rss.o hakmem_tiny_registry.o hakmem_tiny_remote_target.o hakmem_tiny_bg_spill.o tiny_adaptive_sizing.o hakmem_super_registry.o hakmem_shared_pool.o hakmem_shared_pool_acquire.o hakmem_shared_pool_release.o hakmem_elo.o hakmem_batch.o hakmem_p2.o hakmem_sizeclass_dist.o hakmem_evo.o hakmem_debug.o hakmem_sys.o hakmem_whale.o hakmem_policy.o hakmem_ace.o hakmem_ace_stats.o hakmem_prof.o hakmem_learner.o hakmem_size_hist.o hakmem_learn_log.o hakmem_syscall.o hakmem_ace_metrics.o hakmem_ace_ucb1.o hakmem_ace_controller.o tiny_fastcache.o core/tiny_alloc_fast_push.o core/tiny_c7_ultra_segment.o core/tiny_c7_ultra.o core/link_stubs.o core/tiny_failfast.o core/tiny_destructors.o core/smallobject_hotbox_v3.o core/smallobject_hotbox_v4.o core/smallobject_hotbox_v5.o core/smallsegment_v5.o core/smallobject_cold_iface_v5.o core/smallsegment_v6.o core/smallobject_cold_iface_v6.o core/smallobject_core_v6.o core/region_id_v6.o core/smallsegment_v7.o core/smallobject_cold_iface_v7.o core/mid_hotbox_v3.o core/smallobject_policy_v7.o core/smallobject_segment_mid_v3.o core/smallobject_cold_iface_mid_v3.o core/smallobject_stats_mid_v3.o core/smallobject_learner_v2.o core/smallobject_mid_v35.o core/box/small_policy_snapshot_tls_box.o
TINY_BENCH_OBJS = $(TINY_BENCH_OBJS_BASE)
ifeq ($(POOL_TLS_PHASE1),1)
TINY_BENCH_OBJS += pool_tls.o pool_refill.o core/pool_tls_arena.o pool_tls_registry.o pool_tls_remote.o
@ -649,6 +649,61 @@ bench_random_mixed_mi.o: bench_random_mixed.c
bench_random_mixed_hakmem: bench_random_mixed_hakmem.o $(TINY_BENCH_OBJS)
$(CC) -o $@ $^ $(LDFLAGS)
# Phase 35-A: BENCH_MINIMAL target (eliminates gate function overhead)
# Usage: make bench_random_mixed_hakmem_minimal
# Note: This rebuilds all objects with -DHAKMEM_BENCH_MINIMAL=1
# Purpose: Pure performance measurement (FAST build)
.PHONY: bench_random_mixed_hakmem_minimal
bench_random_mixed_hakmem_minimal:
$(MAKE) clean
$(MAKE) bench_random_mixed_hakmem EXTRA_CFLAGS='-DHAKMEM_BENCH_MINIMAL=1'
mv bench_random_mixed_hakmem bench_random_mixed_hakmem_minimal
# Phase 35-B: OBSERVE target (enables diagnostic counters for behavior observation)
# Usage: make bench_random_mixed_hakmem_observe
# Note: This rebuilds all objects with stats/trace compiled in
# Purpose: Behavior observation & debugging (OBSERVE build)
.PHONY: bench_random_mixed_hakmem_observe
bench_random_mixed_hakmem_observe:
$(MAKE) clean
$(MAKE) bench_random_mixed_hakmem EXTRA_CFLAGS='-DHAKMEM_TINY_CLASS_STATS_COMPILED=1 -DHAKMEM_TINY_FREE_STATS_COMPILED=1 -DHAKMEM_UNIFIED_CACHE_STATS_COMPILED=1 -DHAKMEM_TINY_FREE_TRACE_COMPILED=1'
mv bench_random_mixed_hakmem bench_random_mixed_hakmem_observe
# Phase 38: Automated perf workflow targets
# Usage: make perf_fast - Build FAST binary and run 10-run benchmark
# Usage: make perf_observe - Build OBSERVE binary and run health check + 1-run perf
.PHONY: perf_fast
perf_fast: bench_random_mixed_hakmem_minimal
@echo "========================================"
@echo "Phase 38: FAST build 10-run benchmark"
@echo "========================================"
BENCH_BIN=./bench_random_mixed_hakmem_minimal scripts/run_mixed_10_cleanenv.sh
@echo "========================================"
@echo "FAST benchmark complete. See results above."
@echo "========================================"
.PHONY: perf_observe
perf_observe: bench_random_mixed_hakmem_observe
@echo "========================================"
@echo "Phase 38: OBSERVE build health check"
@echo "========================================"
@echo "[1/3] Health profiles check..."
scripts/verify_health_profiles.sh || echo "Health check script not found, skipping"
@echo "[2/3] Syscall stats (1-run)..."
HAKMEM_SS_OS_STATS=1 ./bench_random_mixed_hakmem_observe 20000000 400 1 2>&1 | grep -E "^\[|^Throughput"
@echo "[3/3] Single perf run..."
./bench_random_mixed_hakmem_observe 20000000 400 1 2>&1 | grep "^Throughput"
@echo "========================================"
@echo "OBSERVE health check complete."
@echo "========================================"
.PHONY: perf_all
perf_all: perf_fast perf_observe
@echo "========================================"
@echo "Phase 38: All perf checks complete"
@echo "========================================"
bench_random_mixed_system: bench_random_mixed_system.o
$(CC) -o $@ $^ $(LDFLAGS)

622
archive/CURRENT_TASK_ARCHIVE_20251216.md Normal file
View File

@ -0,0 +1,622 @@
# CURRENT_TASK（ARCHIVE: 2025-12-16）
## 現在の状態（要約）
- **安定版（本線）**: Phase 35-A 完了（HAKMEM_BENCH_MINIMAL gate function elimination） — **GO +4.39%**
- **Phase 37 結果**: NO-GO — Standard build TLS cache は効果なし（-0.07%）
- **Phase 38 完了**: FAST/OBSERVE 運用確立（スコアカード更新、Makefile ターゲット追加）
- **直近の判断**:
- Phase 24（OBSERVE 税 prune / tiny_class_stats）: ✅ GO (+0.93%)
- Phase 25（Free Stats atomic prune / g_free_ss_enter）: ✅ GO (+1.07%)
- Phase 26（Hot path diagnostic atomics prune / 5 atomics）: ⚪ NEUTRAL (-0.33%, code cleanliness で採用)
- Phase 27（Unified Cache Stats atomic prune / 6 atomics）: ✅ GO (+0.74% mean, +1.01% median)
- Phase 28（Background Spill Queue audit / 8 atomics）: ⚪ NO-OP (全て CORRECTNESS)
- Phase 29（Pool Hotbox v2 Stats audit / 12 atomics）: ⚪ NO-OP (ENV-gated, 実行されない)
- Phase 30（Standard Procedure Documentation）: ✅ PROCEDURE COMPLETE (412 atomics 監査完了)
- Phase 31（Tiny Free Trace atomic prune / g_tiny_free_trace）: ⚪ NEUTRAL (-0.35%, code cleanliness で採用)
- Phase 32（Tiny Free Calls atomic prune / g_hak_tiny_free_calls）: ⚪ NEUTRAL (-0.46%, code cleanliness で採用)
- Phase 34（Batch Prune / atomic 一括）: ⚪ NEUTRAL (-0.10%, atomic prune は収穫済み)
- Phase 35-A（BENCH_MINIMAL gate prune）: ✅ **GO (+4.39%)** — gate function overhead 削除
- **計測の正**: `scripts/run_mixed_10_cleanenv.sh`（同一バイナリ / clean env / 10-run）
- **累積効果**: **+2.74%** (atomic prune) + **+4.39%** (bench_minimal gate prune) = **+7.13%** potential
- **目標/現状スコアカード**: `docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md`
## 原則（Box Theory 運用ルール）
- 変更は箱で分ける（ENV / build flag で戻せる）
- 変換点（境界）は 1 箇所に集約する
- "削除して速くする" は危険（layout/LTO で反転する）
- ✅ compile-out（`#if HAKMEM_*_COMPILED`）は許容
- ❌ link-out（Makefile から `.o` を外す）は封印（Phase 22-2 NO-GO）
- **Atomic 監査原則**（Phase 30 標準化）:
- **Step 0: 実行確認（MANDATORY）**: ENV gate / 実行カウンタ確認（Phase 29 教訓）
- **Step 1: CORRECTNESS vs TELEMETRY 分類**: `if` 条件 = CORRECTNESS（Phase 28 教訓）
- **Step 2: Compile-out 実装**: `#if HAKMEM_*_COMPILED` で wrap
- **Step 3: A/B test**: Baseline vs Compiled-in（10-run 比較）
- **Verdict**: GO (+0.5%+), NEUTRAL (±0.5%), NO-GO (-0.5%+)
## Phase 35-A 完了（2025-12-16）— HAKMEM_BENCH_MINIMAL GO +4.39%
### 背景
Phase 34（Batch Prune）で atomic prune が収穫済み（NEUTRAL -0.10%）と判断。
次の層「固定税の次の層」として、非 atomic 固定オーバーヘッド（gate functions）を対象とした。
### perf 分析で特定した gate function hotspots
1. `tiny_metadata_cache_enabled()` — 1.46% (getenv + lazy init)
2. `tiny_front_v3_enabled()` — 0.65% (getenv + lazy init)
3. 合計潜在削減: ~2.1%+
### 実施内容
**Phase 35-A: HAKMEM_BENCH_MINIMAL=1 アプローチ**
- Build flag で gate functions を compile-time constant に固定
- Bench-only binary を生成（本線リリースビルドは影響なし）
- Box Theory 準拠: ENV gate のまま、bench 専用バイナリで検証
**変更ファイル:**
1. `core/hakmem_build_flags.h` — `HAKMEM_BENCH_MINIMAL` flag 追加
2. `core/box/tiny_metadata_cache_env_box.h` — `#if HAKMEM_BENCH_MINIMAL` で固定 OFF
3. `core/box/tiny_front_v3_env_box.h` — `#if HAKMEM_BENCH_MINIMAL` で固定 ON
4. `Makefile` — `bench_random_mixed_hakmem_minimal` target 追加
### A/B Test 結果
**Baseline (BENCH_MINIMAL=0):**
- Mean: 52,940,947 ops/s (10 runs)
**Minimal (BENCH_MINIMAL=1):**
- Mean: 55,264,082 ops/s (10 runs)
**Improvement:**
- Delta: +2,323,134 ops/s
- **Percent: +4.39%**
### 判定
**GO ✅ (+4.39% > +0.5% threshold)**
**理由:**
1. Gate function overhead は atomic prune より大きい固定税だった
2. `tiny_metadata_cache_enabled()` + `tiny_front_v3_enabled()` の lazy init check が HOT path で毎回実行
3. BENCH_MINIMAL=1 で compile-time constant 化 → lazy init branch 完全削除
4. +4.39% は Phase 24-32 の atomic prune 累積 (+2.74%) より大きい
### 次のステップ（Phase 35 Option C）
**GO 条件達成** → Option C（default=1 検討へ）
指示書の通り、次は:
- gate functions の default を ON (1) に変更する検討
- ただし本線挙動への影響を慎重に評価する必要あり
- `tiny_front_v3_enabled()` は既に default ON
- `tiny_metadata_cache_enabled()` は default OFF（変更検討対象）
### 教訓
1. **Gate functions は高コスト:** lazy init pattern (`if (g == -1)`) は分岐予測ミスを引き起こす
2. **Compile-time constant が最速:** BENCH_MINIMAL で固定 ON/OFF → 分岐完全削除
3. **Atomic prune より効果大:** Phase 34 NEUTRAL (-0.10%) vs Phase 35-A GO (+4.39%)
4. **Build-level optimization は安全:** 本線ビルドに影響なく検証可能
---
## Phase 37 完了（2025-12-16）— Standard TLS cache NO-GO (-0.07%)
### 背景
Phase 36 で BENCH_MINIMAL に `small_policy_v7_snapshot()` の version check skip を追加し +0.71% を達成。
Phase 37 では Standard build に同様の最適化を適用するため、TLS cache を導入。
### 実施内容
**Phase 37: TLS cache box 実装**
1. `core/box/small_policy_snapshot_tls_box.h/.c` を作成
2. `small_policy_v7_snapshot()` に TLS cache 経由のパスを追加
3. ENV gate `HAKMEM_POLICY_SNAPSHOT_TLS` で制御（default ON）
**設計:**
- Fast path: TLS cache hit → cached pointer 返却
- Slow path: cache miss → init from env, update cache
- Rollback: `HAKMEM_POLICY_SNAPSHOT_TLS=0` で元の動作
### A/B Test 結果
**Baseline (TLS OFF):**
- Mean: 53,502,684 ops/s (10 runs)
**Phase 37 (TLS ON):**
- Mean: 53,465,435 ops/s (10 runs)
**Delta: -0.07%** ❌ NO-GO
### 原因分析
TLS cache が効果を出せなかった理由:
1. **Gate function overhead の再発**
- `policy_snapshot_tls_enabled()` 自体が lazy-init pattern を使用
- Phase 35-A で削除した問題と同じ overhead
2. **Non-inlined function call**
- `small_policy_snapshot_tls_get()` は別翻訳単位のためインライン化されない
- TLS 変数アクセス + 関数呼び出し overhead
3. **Original path は既に最適**
- `g_small_policy_v7_version != g_policy_v7_version` は TLS 変数比較のみ
- これ以上の最適化は BENCH_MINIMAL (compile-time constant) のみ
### 判定
**NO-GO ❌ (-0.07% < +1.0% threshold)**
**理由:**
- Standard build では gate function overhead を避けられない
- TLS cache の追加 overhead が version check 削減を相殺
- BENCH_MINIMAL が既に最適解（compile-time constant 化）
### 教訓
1. **Runtime gate は必ず overhead を持つ:** lazy-init pattern は避けられない
2. **Compile-time constant が唯一の解:** Standard build の最適化は限界がある
3. **BENCH_MINIMAL の正当性:** benchmark 専用 binary として最適化を分離するのが正解
### 次のステップ
- Phase 37 変更は NO-GO のためコードは残すがデフォルト OFF にすべき
- または削除検討（追加コードが無駄な overhead）
- 本線は Phase 35-A（BENCH_MINIMAL +4.39%）+ Phase 36（+0.71%）で固定
---
## Phase 38 完了（2025-12-16）— FAST/OBSERVE 運用確立
### 背景
Phase 37 で Standard build の最適化は限界（NO-GO -0.07%）と判明。
Standard を小手先で速くするより、**FAST/OBSERVE の運用を確立** する方が ROI が高い。
### 実施内容
**Step 1: スコアカード更新（SSOT）**
- `docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md` を更新
- Standard / FAST v2 / OBSERVE の mean/median を並記
- **mimalloc 比較は FAST build を正** と明記
**Step 2: Makefile ターゲット整備**
- `make perf_fast` — FAST build + 10-run benchmark
- `make perf_observe` — OBSERVE build + health check + 1-run perf
- `make perf_all` — 両方実行
- 手順をターゲット化（人間ミス防止）
**Step 3: FAST v3 候補特定**
- malloc path: `front_gate_unified_enabled()`, `alloc_dualhot_enabled()`
- free path: `g_bench_fast_front`, `g_v3_enabled`, `g_free_dispatch_ssot`
- stats: `alloc_gate_stats_enabled()`, `free_path_stats_enabled()`, `tiny_front_stats_enabled()`
### 運用ルール（確定）
1. **性能評価は FAST build で行う**（mimalloc 比較の正）
2. **Standard は安全基準**（gate overhead は許容、本線機能の互換性優先）
3. **OBSERVE はデバッグ用**（性能評価には使わない、診断出力あり）
### 現在の数値
| Build | Mean (M ops/s) | vs mimalloc |
|-------|----------------|-------------|
| **FAST v2** | 54.94 | **46.5%** |
| Standard | 53.50 | 45.3% |
| mimalloc | 118.18 | 100% |
### 次のステップ
**Phase 39: FAST v3** — 残りの default-ON gate を定数化
- 対象: malloc/free path の gate function
- 目標: FAST v3 で +0.5%+ を追加獲得
---
## Phase 30 完了（2025-12-16）
### 実施内容
**目的:** Phase 24-29 の学びを 4-step 標準手順として固定化し、Phase 31 候補を選定する。
**成果物:**
1. `docs/analysis/PHASE30_STANDARD_PROCEDURE.md` - 4-step 標準手順書
2. `docs/analysis/ATOMIC_AUDIT_FULL.txt` - 全 atomic 監査結果（412 atomics）
3. `docs/analysis/PHASE31_CANDIDATES_HOT.txt` - HOT path 候補抽出
4. `docs/analysis/PHASE31_CANDIDATES_WARM.txt` - WARM path 候補抽出
5. `docs/analysis/PHASE31_RECOMMENDED_CANDIDATES.md` - Phase 31 推奨候補（TOP 3）
6. `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` 更新（Phase 30 追記）
### 監査結果
**全 atomic 監査:**
- **Total atomics:** 412
- **TELEMETRY:** 104 (25%)
- **CORRECTNESS:** 24 (6%)
- **UNKNOWN:** 284 (69%, manual review needed)
**Path 分類:**
- **HOT path:** 16 atomics (5 TELEMETRY, 11 UNKNOWN)
- **WARM path:** 10 atomics (3 TELEMETRY, 7 UNKNOWN)
- **COLD path:** 386 atomics (remaining)
**NEW 候補（未コンパイルアウト）:**
- **HOT path:** 1 candidate (`g_tiny_free_trace`)
- **WARM path:** 3 candidates (`rel_logs`, `dbg_logs`, `g_p0_class_oob_log`)
### Step 0 実行確認結果
**HOT path:**
1. `g_tiny_free_trace` (HOT, TELEMETRY)
- ✅ ENV gate なし
- ✅ `hak_tiny_free()` で実行（毎回）
- ✅ Execution verified
- **Verdict:** **TOP PRIORITY for Phase 31**
**WARM path:**
1. `rel_logs` + `dbg_logs` (WARM, TELEMETRY)
- ❌ ENV gated by `HAKMEM_TINY_WARM_LOG` (OFF by default)
- ❌ 実行されない（Phase 29 pattern）
- **Verdict:** SKIP
2. `g_p0_class_oob_log` (WARM, TELEMETRY)
- ✅ ENV gate なし
- ⚠️ Error path（out-of-bounds class index）
- ❓ 実行頻度不明（要検証）
- **Verdict:** LOW PRIORITY（Phase 32 候補）
### 4-Step Standard Procedure
**Phase 30 で確立された型:**
**Step 0: 実行確認（NEW - Phase 29 教訓）**
- ENV gate チェック（`rg "getenv.*FEATURE" core/`）
- 実行カウンタ確認（Mixed 10-run で > 0）
- perf/flamegraph 検証（オプション）
- **Decision:** ❌ 実行されない → SKIP
**Step 1: CORRECTNESS/TELEMETRY 分類（Phase 28 教訓）**
- 全使用箇所を追跡（`rg -n "g_variable" core/`）
- `if` 条件で使用 → CORRECTNESS（DO NOT TOUCH）
- `fprintf/fprintf` のみ → TELEMETRY（compile-out 候補）
- **Decision:** CORRECTNESS → DO NOT TOUCH
**Step 2: Compile-Out 実装（Phase 24-27 pattern）**
- `hakmem_build_flags.h` に gate 追加
- TELEMETRY atomic を `#if` で wrap
- Build-level compile-out（link-out 禁止）
**Step 3: A/B Test（build-level comparison）**
- Baseline (COMPILED=0): default build
- Compiled-in (COMPILED=1): research build
- **Verdict:** GO (+0.5%+), NEUTRAL (±0.5%), NO-GO (-0.5%+)
### 判定
**PROCEDURE COMPLETE** ✅
**理由:**
- 4-step procedure 確立（Phase 24-29 学習を体系化）
- Step 0 (実行確認) が Phase 29 空振りを防ぐ
- 全 atomic 監査完了（412 atomics）
- Phase 31 候補選定完了（TOP 1: `g_tiny_free_trace`）
### ドキュメント
- `docs/analysis/PHASE30_STANDARD_PROCEDURE.md` (標準手順書)
- `docs/analysis/ATOMIC_AUDIT_FULL.txt` (全 atomic 監査結果)
- `docs/analysis/PHASE31_RECOMMENDED_CANDIDATES.md` (Phase 31 候補 TOP 3)
- `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` (Phase 24-30 総括)
### 教訓
**空振り防止 3 原則:**
1. **Step 0 は必須ゲート**: ENV-gated コードは最初に弾く（Phase 29 教訓）
2. **カウンタ名 ≠ 用途**: Flow control か telemetry か全使用箇所で確認（Phase 28 教訓）
3. **HOT path 優先**: 実行頻度が性能影響を決める（Phase 24-27 教訓）
## 累積効果（Phase 24〜35-A）
| Phase | Target | Impact | Status |
|-------|--------|--------|--------|
| **24** | `g_tiny_class_stats_*` (5 atomics) | **+0.93%** | GO ✅ |
| **25** | `g_free_ss_enter` (1 atomic) | **+1.07%** | GO ✅ |
| **26** | Hot path diagnostics (5 atomics) | **-0.33%** | NEUTRAL ✅ |
| **27** | `g_unified_cache_*` (6 atomics) | **+0.74%** | GO ✅ |
| **28** | Background Spill Queue (8 atomics) | **N/A** | NO-OP ✅ |
| **29** | Pool Hotbox v2 Stats (12 atomics) | **0.00%** | NO-OP ✅ |
| **30** | Standard Procedure (412 atomic audit) | **N/A** | PROCEDURE ✅ |
| **31** | `g_tiny_free_trace` (1 atomic) | **-0.35%** | NEUTRAL ✅ |
| **32** | `g_hak_tiny_free_calls` (1 atomic) | **-0.46%** | NEUTRAL ✅ |
| **34** | Batch Prune (atomic 一括) | **-0.10%** | NEUTRAL ✅ |
| **35-A** | BENCH_MINIMAL gate prune | **+4.39%** | **GO ✅** |
| **合計** | **19 atomics removed + gate prune** | **+7.13%** | **✅** |
**Key Insight:** 標準手順が次の Phase の成功確率を上げる。
- Step 0 (実行確認) で ENV-gated code を弾く → Phase 29 空振りを防止
- Step 1 (分類) で CORRECTNESS を弾く → Phase 28 誤判定を防止
- HOT path 優先 → Phase 24-27 成功パターン（+0.5~1.0%）
- **NEW:** NEUTRAL verdict でも code cleanliness で採用可 → Phase 26/31 パターン
## Phase 32: g_hak_tiny_free_calls compile-out 完了（2025-12-16）
### 実施内容
**目的:** `hak_tiny_free()` で毎回実行される diagnostic counter atomic を compile-out（default）して固定税を削る。
**成果物:**
1. `docs/analysis/PHASE32_TINY_FREE_CALLS_ATOMIC_PRUNE_RESULTS.md` - A/B test results + NEUTRAL verdict
2. `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` 更新（Phase 32 追記）
3. `CURRENT_TASK.md` 更新（Phase 32 完了 + Phase 33 候補提示）
### A/B Test 結果
**Baseline (COMPILED=0, counter compiled-out):**
- Mean: 52.94 M ops/s
- Median: 53.22 M ops/s
**Compiled-in (COMPILED=1, counter active):**
- Mean: 53.28 M ops/s
- Median: 53.46 M ops/s
**Difference:**
- Mean: -0.63% (Baseline SLOWER)
- Median: -0.46% (Baseline SLOWER)
- **Verdict:** **NEUTRAL** (±0.5% 範囲内、しかも compiled-in が faster - 反転現象)
### 判定
**NEUTRAL → Code Cleanliness で採用** ✅
**理由:**
1. **Performance:** Mean -0.63%, Median -0.46% → 測定ノイズ範囲（しかも compiled-in が faster - 予想外）
2. **Phase 31 precedent:** -0.35% NEUTRAL → code cleanliness で採用
3. **Phase 32 同型:** -0.46% NEUTRAL → 同じ判断基準を適用
4. **Code cleanliness benefits:**
- HOT path (`hak_tiny_free()` entry, Phase 31 の 9 行下) から unused TELEMETRY atomic 削除
- 複雑さ削減（diagnostic counter のみ、flow control なし）
- Research flexibility 維持（`COMPILED=1` で復活可）
5. **Unexpected finding:** Atomic counter compiled-in は faster → code alignment effects の可能性（atomic overhead ではない）
**Key Finding:** Diagnostic counter has negligible impact on modern CPUs
- Phase 25 (`g_free_ss_enter`): +1.07% GO (always-increment stats)
- Phase 31 (`g_tiny_free_trace`): -0.35% NEUTRAL (rate-limited to 128 calls)
- Phase 32 (`g_hak_tiny_free_calls`): -0.46% NEUTRAL (unconditional counter)
- **Pattern:** Phase 31+32 (same function, 9 lines apart) both NEUTRAL → atomic overhead is negligible
### ドキュメント
- `docs/analysis/PHASE32_TINY_FREE_CALLS_ATOMIC_PRUNE_RESULTS.md` (完全な A/B test 結果)
- `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` (Phase 24-32 総括)
- `CURRENT_TASK.md` (Phase 32 完了 + Phase 33 候補)
### 教訓
**Phase 32 から学んだこと:**
1. **Code alignment matters:** Compiled-in が faster → atomic overhead ではなく code layout effects
2. **NEUTRAL is still valid:** Phase 26/31/32 precedent - code cleanliness で採用
3. **Not all HOT atomics matter:** Phase 31+32 (same function) both NEUTRAL → 固定税は negligible
4. **Cumulative gain is stable:** +2.74% (Phase 24+25+27 GO が大部分、Phase 31+32 は cleanliness のみ)
## Phase 31: g_tiny_free_trace compile-out 完了（2025-12-16）
### 実施内容
**目的:** `hak_tiny_free()` 先頭の trace-rate-limit atomic を compile-out（default）して固定税を削る。
**成果物:**
1. `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md` - A/B test results + NEUTRAL verdict
2. `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` 更新（Phase 31 追記）
3. `CURRENT_TASK.md` 更新（Phase 31 完了 + Phase 32 候補提示）
### A/B Test 結果
**Baseline (COMPILED=0, trace compiled-out):**
- Mean: 53.64 M ops/s
- Median: 53.80 M ops/s
**Compiled-in (COMPILED=1, trace active):**
- Mean: 53.83 M ops/s
- Median: 53.70 M ops/s
**Difference:**
- Mean: -0.35% (Baseline SLOWER)
- Median: +0.19% (Baseline FASTER)
- **Verdict:** **NEUTRAL** (±0.5% 範囲内)
### 判定
**NEUTRAL → Code Cleanliness で採用** ✅
**理由:**
1. **Performance:** Mean -0.35%, Median +0.19% → 測定ノイズ範囲（conflicting signals）
2. **Phase 26 precedent:** -0.33% NEUTRAL → code cleanliness で採用
3. **Phase 31 同型:** -0.35% NEUTRAL → 同じ判断基準を適用
4. **Code cleanliness benefits:**
- HOT path (`hak_tiny_free()` entry) から unused TELEMETRY atomic 削除
- 複雑さ削減（trace macro のみ、flow control なし）
- Research flexibility 維持（`COMPILED=1` で復活可）
**Key Finding:** Not all HOT path atomics have measurable overhead
- Phase 25 (`g_free_ss_enter`): +1.07% GO (always-increment stats)
- Phase 31 (`g_tiny_free_trace`): NEUTRAL (rate-limited to 128 calls)
- **Hypothesis:** Rate-limiting or compiler optimization may eliminate overhead
### ドキュメント
- `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md` (完全な A/B test 結果)
- `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md` (Phase 24-31 総括)
- `CURRENT_TASK.md` (Phase 31 完了 + Phase 32 候補)
### 教訓
**Phase 31 から学んだこと:**
1. **HOT path ≠ guaranteed win:** Even high-frequency atomics may have zero overhead if optimized
2. **NEUTRAL is valid:** Code cleanliness justifies compile-out even without performance gain (Phase 26/31 precedent)
3. **Step 0 (execution verification) works:** Prevented Phase 29-style no-op (confirmed always active)
4. **Standard procedure validated:** Phase 30 4-step procedure successfully guided Phase 31
## 次の指示（Phase 33 実施）
**Phase 32 完了:** NEUTRAL verdict、code cleanliness で採用 → Phase 33 実施へ
### Phase 33 推奨候補: `tiny_debug_ring_record()` (HOT path, **STEP 0 VERIFICATION REQUIRED**) ⚠️
**Location:** `core/hakmem_tiny_free.inc:340` (3 lines after Phase 32 target)
**Code Context:**
```c
void hak_tiny_free(void* ptr) {
#if HAKMEM_TINY_FREE_TRACE_COMPILED
// Phase 31 target (now compiled-out)
#endif
#if HAKMEM_TINY_FREE_CALLS_COMPILED
// Phase 32 target (now compiled-out)
#endif
if (!ptr || !g_tiny_initialized) return;
hak_tiny_stats_poll();
tiny_debug_ring_record(TINY_RING_EVENT_FREE_ENTER, 0, ptr, 0); // ← Phase 33 target
// ... rest of function ...
}
```
**Classification:**
- **Class:** TELEMETRY (debug ring buffer, event logging)
- **Path:** HOT (every tiny free call, after null check)
- **Usage:** Event logging to ring buffer
- **ENV Gate:** ⚠️ **UNKNOWN - REQUIRES STEP 0 VERIFICATION**
**⚠️ CRITICAL: Step 0 Verification Required (Phase 30 lesson)**
**Phase 32 完了後、Phase 33 実施前に必須:**
```bash
# Check if debug ring is ENV-gated or always-on
rg "getenv.*DEBUG_RING" core/
rg "HAKMEM.*DEBUG.*RING" core/
rg "tiny_debug_ring_record" core/ -A 5 -B 5
```
**Verification criteria:**
1. ✅ **Proceed if:** No ENV gate, always-on by default
2. ❌ **SKIP if:** ENV-gated (like Phase 29 Pool v2)
3. ❓ **Verify if:** Conditional gate inside `tiny_debug_ring_record()` implementation
**Expected Impact:**
- **If always-on:** +0.3% to +1.0% (ring buffer writes may be expensive)
- **If ENV-gated (OFF by default):** 0.00% (Phase 29 NO-OP pattern)
**Priority:** **HIGHEST** (same HOT path as Phase 31+32, same function, 3 lines below Phase 32)
**⚠️ DO NOT PROCEED WITHOUT STEP 0 VERIFICATION ⚠️**
**Phase 30 教訓適用:**
- Phase 29 で ENV-gated code (Pool v2) を空振り → Step 0 必須化
- Phase 30 で Step 0 を標準手順に追加
- Phase 33 は debug ring → ENV gate の可能性高い → **実行確認必須**
**Implementation Plan (AFTER Step 0 verification):**
**If always-on (Step 0 PASS):**
**Step 1: 分類**
- Check `tiny_debug_ring_record()` implementation
- Verify TELEMETRY (no flow control)
- Check for atomics inside ring buffer writes
**Step 2: Compile-Out 実装**
- Add `HAKMEM_TINY_DEBUG_RING_COMPILED` to `hakmem_build_flags.h`
- Wrap `tiny_debug_ring_record()` calls with `#if`
**Step 3: A/B Test**
- Baseline (COMPILED=0): ring buffer compiled-out
- Compiled-in (COMPILED=1): ring buffer active
- Expected: +0.3% to +1.0% if expensive writes
**If ENV-gated (Step 0 FAIL):**
- ❌ SKIP Phase 33 (Phase 29 NO-OP pattern)
- Move to next candidate
### Alternative Candidates (if Phase 33 is ENV-gated or NEUTRAL)
**#4: `g_p0_class_oob_log` (WARM path, error logging)**
- ❓ Execution uncertain (error path)
- Expected: ±0.0% to +0.2%
- Action: Verify execution first
**#5-#N: Manual review of UNKNOWN atomics (284 candidates)**
- Many may be misclassified by naming heuristics
- Requires deeper code inspection
- Lower priority
**Note:** Phase 31+32 both NEUTRAL → HOT path atomic prune 効果は限定的。Phase 24+25+27 (GO phases) が cumulative gain の大部分。今後は他の最適化領域（inlining, branch optimization, SIMD）へ移行を検討。
## 参考
- **Standard Procedure:** `docs/analysis/PHASE30_STANDARD_PROCEDURE.md`
- **Phase 31 Results:** `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md`
- **Phase 32 Results:** `docs/analysis/PHASE32_TINY_FREE_CALLS_ATOMIC_PRUNE_RESULTS.md`
- **Cumulative Summary:** `docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md`
- **mimalloc Gap Analysis:** `docs/roadmap/OPTIMIZATION_ROADMAP.md`
- **Box Theory:** Phase 6-1.7+ の Box Refactor パターン
- **Phase 24-27 Pattern:** `core/box/tiny_class_stats_box.h`, `core/hakmem_build_flags.h`
- **Phase 26/31/32 NEUTRAL Precedent:** Code cleanliness adoption without performance win
## タスク完了条件
### Phase 30 完了済み条件（2025-12-16）:
1. ✅ `PHASE30_STANDARD_PROCEDURE.md` 作成（4-step procedure）
2. ✅ 全 atomic 監査実行（412 atomics, audit_atomics.sh）
3. ✅ HOT/WARM path TELEMETRY 候補抽出
4. ✅ Step 0 実行確認（全候補）
5. ✅ `PHASE31_RECOMMENDED_CANDIDATES.md` 作成（TOP 3 prioritized）
6. ✅ Cumulative summary 更新（Phase 24-30）
7. ✅ CURRENT_TASK.md 更新（Phase 31 候補提示）
### Phase 31 完了条件（2025-12-16）:
1. ✅ 候補選定完了（`g_tiny_free_trace`, HOT path）
2. ✅ Step 0 実行確認完了（ENV gate なし、実行確認済み）
3. ✅ Step 1 分類完了（Pure TELEMETRY、CORRECTNESS なし）
4. ✅ Step 2 実装（BuildFlags + `#if` wrap）
5. ✅ Step 3 A/B test（Baseline vs Compiled-in）
6. ✅ 結果ドキュメント作成（PHASE31_RESULTS.md）
7. ✅ NEUTRAL verdict → code cleanliness で採用
### Phase 32 完了条件（2025-12-16）:
1. ✅ 候補選定完了（`g_hak_tiny_free_calls`, HOT path, same function as Phase 31）
2. ✅ Step 0 実行確認完了（Phase 31 と同じ関数、ENV gate なし）
3. ✅ Step 1 分類完了（Pure TELEMETRY、CORRECTNESS なし）
4. ✅ Step 2 実装（BuildFlags + `#if` wrap）
5. ✅ Step 3 A/B test（Baseline vs Compiled-in）
6. ✅ 結果ドキュメント作成（PHASE32_RESULTS.md）
7. ✅ NEUTRAL verdict → code cleanliness で採用
### Phase 33 開始前の前提条件:
1. ✅ 候補選定完了（`tiny_debug_ring_record()`, HOT path, 3 lines after Phase 32）
2. ⚠️ **Step 0 実行確認必須**（ENV gate check: `rg "getenv.*DEBUG_RING" core/`）
3. ⏳ Step 1 分類（TELEMETRY/CORRECTNESS 判定） - AFTER Step 0
4. ⏳ Step 2 実装（BuildFlags + `#if` wrap） - AFTER Step 0
5. ⏳ Step 3 A/B test（Baseline vs Compiled-in） - AFTER Step 0
6. ⏳ 結果ドキュメント作成（PHASE33_RESULTS.md） - AFTER Step 0
---
**Last Updated:** 2025-12-16
**Current Phase:** Phase 36 Complete (BENCH_MINIMAL v2 - policy_v7_snapshot optimization)
**Status:**
- ✅ FAST build v2 (`bench_random_mixed_hakmem_minimal`) - 性能計測用正規ターゲット
- ✅ OBSERVE build (`bench_random_mixed_hakmem_observe`) - 挙動観測用ターゲット
- ⏳ Option C (本線 default=1) - 運用方針確立後に検討
**Phase 36 Results:**
- FAST v1 → FAST v2: +0.71% (GO)
- 追加最適化: `small_policy_v7_snapshot()` version check スキップ、learner gates 固定 OFF
**Cumulative Progress:** +7.84% potential (atomic prune +2.74% + gate prune Phase 35-A +4.39% + Phase 36 +0.71%)

6
core/box/free_dispatch_stats_box.h
View File

@ -1,6 +1,7 @@
#ifndef HAKMEM_FREE_DISPATCH_STATS_BOX_H
#define HAKMEM_FREE_DISPATCH_STATS_BOX_H
#include "../hakmem_build_flags.h" // Phase 39: HAKMEM_BENCH_MINIMAL (GO +1.98%)
#include <stdint.h>
#include <stdbool.h>
#include <stdlib.h>
@ -26,13 +27,18 @@ typedef struct FreeDispatchStats {
} FreeDispatchStats;
// ENV gate
// Phase 39: BENCH_MINIMAL → 固定 false (GO +1.98%)
static inline bool free_dispatch_stats_enabled(void) {
#if HAKMEM_BENCH_MINIMAL
return false; // FAST v3: 定数化 (stats OFF)
#else
static int g_enabled = -1;
if (__builtin_expect(g_enabled == -1, 0)) {
const char* e = getenv("HAKMEM_FREE_DISPATCH_STATS");
g_enabled = (e && *e && *e != '0') ? 1 : 0;
}
return g_enabled;
#endif
}
// Global stats instance

7
core/box/hak_free_api.inc.h
View File

@ -3,6 +3,7 @@
#ifndef HAK_FREE_API_INC_H
#define HAK_FREE_API_INC_H
#include "../hakmem_build_flags.h" // Phase 39: HAKMEM_BENCH_MINIMAL (GO +1.98%)
#include <sys/mman.h> // For mincore() in AllocHeader safety check
#include "hakmem_tiny_superslab.h" // For SUPERSLAB_MAGIC, SuperSlab
#include "../ptr_trace.h" // Debug: pointer trace immediate dump on libc fallback
@ -112,6 +113,8 @@ void hak_free_at(void* ptr, size_t size, hak_callsite_t site) {
#endif
// Bench-only ultra-short path: try header-based tiny fast free first
// Enable with: HAKMEM_BENCH_FAST_FRONT=1
// Phase 39: BENCH_MINIMAL → compile-out (GO +1.98%)
#if !HAKMEM_BENCH_MINIMAL
{
static int g_bench_fast_front = -1;
if (__builtin_expect(g_bench_fast_front == -1, 0)) {
@ -129,6 +132,7 @@ void hak_free_at(void* ptr, size_t size, hak_callsite_t site) {
}
#endif
}
#endif
if (!ptr) {
#if HAKMEM_DEBUG_TIMING
@ -168,7 +172,8 @@ void hak_free_at(void* ptr, size_t size, hak_callsite_t site) {
case FG_DOMAIN_TINY: {
// Phase FREE-FRONT-V3-2: v3 snapshot routing (optional, default OFF)
// Optimized: No tiny_route_for_class() calls, no redundant ENV checks
#if HAKMEM_TINY_HEADER_CLASSIDX
// Phase 39: BENCH_MINIMAL → compile-out (GO +1.98%)
#if HAKMEM_TINY_HEADER_CLASSIDX && !HAKMEM_BENCH_MINIMAL
{
// Check if v3 snapshot routing is enabled (cached)
static int g_v3_enabled = -1;

15
core/box/small_policy_snapshot_tls_box.c Normal file
View File

@ -0,0 +1,15 @@
// small_policy_snapshot_tls_box.c - Phase 37: Lightweight TLS cache implementation
#include <stdlib.h> // for NULL
#include "small_policy_snapshot_tls_box.h"
// TLS singleton for policy snapshot cache
static __thread SmallPolicySnapshotTLSCache g_policy_snapshot_tls_cache = {
.cached_ptr = NULL,
.cached_version = 0,
.initialized = 0
};
SmallPolicySnapshotTLSCache* small_policy_snapshot_tls_get(void) {
return &g_policy_snapshot_tls_cache;
}

81
core/box/small_policy_snapshot_tls_box.h Normal file
View File

@ -0,0 +1,81 @@
// small_policy_snapshot_tls_box.h - Phase 37: Lightweight TLS cache for policy snapshot
//
// Purpose:
// - Reduce fixed tax from global version read in small_policy_v7_snapshot()
// - Fast path: return cached pointer without global memory access
// - Slow path: refresh only when global version changes
//
// Box Theory:
// - Single Responsibility: TLS caching for policy snapshot
// - Reversible: ENV gate HAKMEM_POLICY_SNAPSHOT_TLS (default ON)
// - Clear Boundary: Only affects small_policy_v7_snapshot() internal
#ifndef SMALL_POLICY_SNAPSHOT_TLS_BOX_H
#define SMALL_POLICY_SNAPSHOT_TLS_BOX_H
#include "../hakmem_build_flags.h"
#include <stdlib.h> // for getenv
#include <stdint.h>
#include <stdbool.h>
// Forward declaration
struct SmallPolicyV7;
// TLS cache state
typedef struct SmallPolicySnapshotTLSCache {
const struct SmallPolicyV7* cached_ptr; // Cached policy pointer
uint32_t cached_version; // Last seen global version
int initialized; // 0 = not init, 1 = initialized
} SmallPolicySnapshotTLSCache;
// ENV gate: default OFF (Phase 37 NO-GO: TLS cache has no benefit)
// Set HAKMEM_POLICY_SNAPSHOT_TLS=1 to enable (research only)
#if HAKMEM_BENCH_MINIMAL
// BENCH_MINIMAL: always use Phase 36 optimization (skip version check entirely)
static inline int policy_snapshot_tls_enabled(void) {
return 0; // Disabled in BENCH_MINIMAL (use simpler Phase 36 path)
}
#else
static inline int policy_snapshot_tls_enabled(void) {
static int g = -1;
if (__builtin_expect(g == -1, 0)) {
const char* e = getenv("HAKMEM_POLICY_SNAPSHOT_TLS");
// Phase 37 NO-GO: default OFF (TLS cache adds overhead, no benefit)
if (e && *e == '1') {
g = 1; // explicitly enabled (research only)
} else {
g = 0; // default OFF
}
}
return g;
}
#endif
// Get TLS cache (thread-local singleton)
SmallPolicySnapshotTLSCache* small_policy_snapshot_tls_get(void);
// Check if TLS cache is valid (fast path: just compare version)
// Returns: 1 if cache is valid and can return cached_ptr, 0 if refresh needed
static inline int small_policy_snapshot_tls_check(
SmallPolicySnapshotTLSCache* cache,
uint32_t global_version
) {
// Fast path: initialized and version matches
if (__builtin_expect(cache->initialized && cache->cached_version == global_version, 1)) {
return 1; // Cache hit
}
return 0; // Cache miss - needs refresh
}
// Update TLS cache after refresh
static inline void small_policy_snapshot_tls_update(
SmallPolicySnapshotTLSCache* cache,
const struct SmallPolicyV7* ptr,
uint32_t version
) {
cache->cached_ptr = ptr;
cache->cached_version = version;
cache->initialized = 1;
}
#endif // SMALL_POLICY_SNAPSHOT_TLS_BOX_H

5
core/box/tiny_alloc_gate_box.h
View File

@ -92,6 +92,8 @@ static inline int tiny_alloc_gate_validate(TinyAllocGateContext* ctx)
return 0;
}
if (ctx->class_idx >= 0 && (uint8_t)ctx->class_idx != meta_cls) {
// Phase 34B: Compile-out alloc gate class mismatch counter (default OFF)
#if HAKMEM_ALLOC_GATE_CLS_MIS_COMPILED
static _Atomic uint32_t g_alloc_gate_cls_mis = 0;
uint32_t n = atomic_fetch_add_explicit(&g_alloc_gate_cls_mis, 1, memory_order_relaxed);
if (n < 8) {
@ -105,6 +107,9 @@ static inline int tiny_alloc_gate_validate(TinyAllocGateContext* ctx)
info.slab_idx);
fflush(stderr);
}
#else
(void)0; // No-op when compiled out
#endif
// クラス不一致自体は Fail-Fast せず、ログだけ残す（将来の Guard 差し込みポイント）。
}

8
core/box/tiny_front_v3_env_box.h
View File

@ -1,6 +1,7 @@
// tiny_front_v3_env_box.h - Tiny Front v3 ENV gate & snapshot (guard/UC/header)
#pragma once
#include "../hakmem_build_flags.h" // Phase 35-A: HAKMEM_BENCH_MINIMAL
#include <stdbool.h>
#include <stddef.h>
#include <stdint.h>
@ -28,6 +29,12 @@ extern TinyFrontV3Snapshot g_tiny_front_v3_snapshot;
extern int g_tiny_front_v3_snapshot_ready;
// ENV gate: default ON (set HAKMEM_TINY_FRONT_V3_ENABLED=0 to disable)
// Phase 35-A: BENCH_MINIMAL mode - compile-time constant (default ON)
#if HAKMEM_BENCH_MINIMAL
static inline bool tiny_front_v3_enabled(void) {
return true; // Fixed ON in bench mode (default behavior)
}
#else
static inline bool tiny_front_v3_enabled(void) {
static int g_enable = -1;
if (__builtin_expect(g_enable == -1, 0)) {
@ -40,6 +47,7 @@ static inline bool tiny_front_v3_enabled(void) {
}
return g_enable != 0;
}
#endif
// Optional: size→class LUT gate (default ON, set HAKMEM_TINY_FRONT_V3_LUT_ENABLED=0 to disable)
static inline bool tiny_front_v3_lut_enabled(void) {

7
core/box/tiny_metadata_cache_env_box.h
View File

@ -18,6 +18,12 @@
// Forward declare the learner enabled check (to avoid header conflicts)
extern bool small_learner_v2_enabled(void);
// Phase 35-A: BENCH_MINIMAL mode - compile-time constant (default OFF)
#if HAKMEM_BENCH_MINIMAL
static inline int tiny_metadata_cache_enabled(void) {
return 0; // Fixed OFF in bench mode (default behavior)
}
#else
static inline int tiny_metadata_cache_enabled(void) {
static int g = -1;
static int g_probe_left = 64; // tolerate early getenv() instability (bench_profile putenv)
@ -54,5 +60,6 @@ static inline int tiny_metadata_cache_enabled(void) {
g = 0;
return 0;
}
#endif
#endif // HAK_TINY_METADATA_CACHE_ENV_BOX_H

12
core/front/malloc_tiny_fast.h
View File

@ -87,8 +87,12 @@ static inline uint32_t tiny_self_u32_local(void) {
// ENV Control (cached, lazy init)
// ============================================================================
// Enable flag (default: 0, OFF)
// Enable flag (default: ON)
// Phase 39: BENCH_MINIMAL → 固定 1 (lazy-init 削除) — GO +1.98%
static inline int front_gate_unified_enabled(void) {
#if HAKMEM_BENCH_MINIMAL
return 1; // FAST v3: 定数化
#else
static int g_enable = -1;
if (__builtin_expect(g_enable == -1, 0)) {
const char* e = getenv("HAKMEM_FRONT_GATE_UNIFIED");
@ -101,6 +105,7 @@ static inline int front_gate_unified_enabled(void) {
#endif
}
return g_enable;
#endif
}
// ============================================================================
@ -140,7 +145,11 @@ static inline int front_gate_unified_enabled(void) {
//
// Phase ALLOC-TINY-FAST-DUALHOT-2: Probe window ENV gate (safe from early putenv)
// Phase 39: BENCH_MINIMAL → 固定 0 (lazy-init 削除) — GO +1.98%
static inline int alloc_dualhot_enabled(void) {
#if HAKMEM_BENCH_MINIMAL
return 0; // FAST v3: 定数化 (default OFF)
#else
static int g = -1;
static int g_probe_left = 64; // Probe window: tolerate early putenv before gate init
if (__builtin_expect(g == -1, 0)) {
@ -158,6 +167,7 @@ static inline int alloc_dualhot_enabled(void) {
}
}
return g;
#endif
}
// Phase 2 B3: tiny_alloc_route_cold() - Handle rare routes (V7, MID, ULTRA)

40
core/hakmem_build_flags.h
View File

@ -26,6 +26,17 @@
# endif
#endif
// ------------------------------------------------------------
// Phase 35-A: Benchmark Minimal Mode
// ------------------------------------------------------------
// HAKMEM_BENCH_MINIMAL: Eliminate gate function overhead for benchmarks
// When =1: Gate functions return compile-time constants (no lazy init check)
// When =0: Normal runtime gate behavior (default)
// Usage: Build with -DHAKMEM_BENCH_MINIMAL=1 for benchmark-only binaries
#ifndef HAKMEM_BENCH_MINIMAL
# define HAKMEM_BENCH_MINIMAL 0
#endif
// ------------------------------------------------------------
// Instrumentation & counters (compile-time)
// ------------------------------------------------------------
@ -372,6 +383,35 @@
# define HAKMEM_TINY_FREE_TRACE_COMPILED 0
#endif
// ------------------------------------------------------------
// Phase 32: Tiny Free Calls Atomic Prune (Compile-out diagnostic counter)
// ------------------------------------------------------------
// Tiny Free Calls: Compile gate (default OFF = compile-out)
// Set to 1 for research builds that need free path call counting
// Target: g_hak_tiny_free_calls atomic in core/hakmem_tiny_free.inc:335
// Impact: HOT path atomic (every free operation, unconditional)
// Expected improvement: +0.3% to +0.7% (diagnostic counter, less critical than Phase 25)
#ifndef HAKMEM_TINY_FREE_CALLS_COMPILED
# define HAKMEM_TINY_FREE_CALLS_COMPILED 0
#endif
// ------------------------------------------------------------
// Phase 34: Batch Atomic Prune (Compile-out remaining WARM path atomics)
// ------------------------------------------------------------
// Phase 34A: Splice Debug Counter (WARM path, refill)
// Target: g_splice_count in core/tiny_refill_opt.h:79
// Impact: WARM path atomic (every refill splice operation)
#ifndef HAKMEM_SPLICE_DEBUG_COMPILED
# define HAKMEM_SPLICE_DEBUG_COMPILED 0
#endif
// Phase 34B: Alloc Gate Class Mismatch (ERROR path, rare)
// Target: g_alloc_gate_cls_mis in core/box/tiny_alloc_gate_box.h:95
// Impact: ERROR path atomic (class mismatch detection, rare)
#ifndef HAKMEM_ALLOC_GATE_CLS_MIS_COMPILED
# define HAKMEM_ALLOC_GATE_CLS_MIS_COMPILED 0
#endif
// ------------------------------------------------------------
// Helper enum (for documentation / logging)
// ------------------------------------------------------------

4
core/hakmem_tiny_free.inc
View File

@ -332,8 +332,12 @@ void hak_tiny_free(void* ptr) {
(void)0; // No-op when trace compiled out
#endif
// Track total tiny free calls (diagnostics)
#if HAKMEM_TINY_FREE_CALLS_COMPILED
extern _Atomic uint64_t g_hak_tiny_free_calls;
atomic_fetch_add_explicit(&g_hak_tiny_free_calls, 1, memory_order_relaxed);
#else
(void)0; // No-op when diagnostic counter compiled out
#endif
if (!ptr || !g_tiny_initialized) return;
hak_tiny_stats_poll();

8
core/smallobject_learner_v2.c
View File

@ -5,6 +5,7 @@
#include <string.h>
#include <stdio.h>
#include <time.h>
#include "hakmem_build_flags.h" // Phase 36: HAKMEM_BENCH_MINIMAL
#include "box/smallobject_learner_v2_box.h"
#include "box/smallobject_stats_mid_v3_box.h"
@ -245,10 +246,17 @@ uint32_t small_learner_v2_retire_efficiency_pct(uint32_t class_idx) {
// Configuration & Control
// ============================================================================
// Phase 36: BENCH_MINIMAL mode - learner is disabled (bench profiles don't use learner)
#if HAKMEM_BENCH_MINIMAL
bool small_learner_v2_enabled(void) {
return false; // Fixed OFF in bench mode
}
#else
bool small_learner_v2_enabled(void) {
const char *env = getenv("HAKMEM_SMALL_LEARNER_V7_ENABLED");
return (env && *env && *env != '0');
}
#endif
void small_learner_v2_set_c5_threshold_pct(uint32_t threshold) {
g_c5_threshold_pct = threshold;

51
core/smallobject_policy_v7.c
View File

@ -3,8 +3,10 @@
#include <stdlib.h>
#include <string.h>
#include <stdio.h>
#include "hakmem_build_flags.h" // Phase 36: HAKMEM_BENCH_MINIMAL
#include "box/smallobject_policy_v7_box.h"
#include "box/smallobject_learner_v7_box.h" // For Learner API
#include "box/small_policy_snapshot_tls_box.h" // Phase 37: TLS cache
#ifndef likely
#define likely(x) __builtin_expect(!!(x), 1)
@ -18,6 +20,12 @@
static SmallLearnerStatsV7 g_small_learner_stats_v7;
static int g_learner_v7_enabled = -1; // -1: uninit, 0: disabled, 1: enabled
// Phase 36: BENCH_MINIMAL mode - learner is disabled (bench profiles don't use learner)
#if HAKMEM_BENCH_MINIMAL
static inline int learner_v7_enabled(void) {
return 0; // Fixed OFF in bench mode
}
#else
static inline int learner_v7_enabled(void) {
if (unlikely(g_learner_v7_enabled < 0)) {
// Phase v10: Learner default ON (when v7 is enabled)
@ -33,6 +41,7 @@ static inline int learner_v7_enabled(void) {
}
return g_learner_v7_enabled;
}
#endif
// ============================================================================
// TLS Policy Snapshot (v7-7: version-based invalidation)
@ -48,7 +57,46 @@ void small_policy_v7_bump_version(void) {
}
const SmallPolicyV7* small_policy_v7_snapshot(void) {
// Check if TLS cache is stale (version mismatch or uninitialized)
#if HAKMEM_BENCH_MINIMAL
// Phase 36: BENCH_MINIMAL mode - skip version check, use init-once TLS cache
// Assumes: Learner disabled, policy doesn't change during benchmark
static __thread int s_initialized = 0;
if (unlikely(!s_initialized)) {
small_policy_v7_init_from_env(&g_small_policy_v7);
s_initialized = 1;
}
return &g_small_policy_v7;
#else
// Phase 37: TLS cache fast path (default ON)
if (policy_snapshot_tls_enabled()) {
SmallPolicySnapshotTLSCache* cache = small_policy_snapshot_tls_get();
uint32_t gver = g_policy_v7_version;
// Fast path: cache valid → return immediately (no global read beyond version)
if (small_policy_snapshot_tls_check(cache, gver)) {
return cache->cached_ptr;
}
// Slow path: refresh cache
small_policy_v7_init_from_env(&g_small_policy_v7);
// v7-7: Apply Learner-driven route updates
if (learner_v7_enabled() && g_small_learner_stats_v7.total_retires > 0) {
small_policy_v7_update_from_learner(&g_small_learner_stats_v7, &g_small_policy_v7);
}
// Initialize global version to 1 if uninitialized (0)
if (gver == 0) {
__sync_val_compare_and_swap(&g_policy_v7_version, 0, 1);
gver = 1;
}
// Update TLS cache
small_policy_snapshot_tls_update(cache, &g_small_policy_v7, gver);
return &g_small_policy_v7;
}
// Fallback: original version-check path (HAKMEM_POLICY_SNAPSHOT_TLS=0)
if (unlikely(g_small_policy_v7_version != g_policy_v7_version || g_policy_v7_version == 0)) {
small_policy_v7_init_from_env(&g_small_policy_v7);
@ -65,6 +113,7 @@ const SmallPolicyV7* small_policy_v7_snapshot(void) {
g_small_policy_v7_version = g_policy_v7_version;
}
return &g_small_policy_v7;
#endif
}
// ============================================================================

5
core/tiny_refill_opt.h
View File

@ -76,6 +76,8 @@ static inline void trc_splice_to_sll(int class_idx, TinyRefillChain* c,
}
// DEBUG: Validate chain is properly NULL-terminated BEFORE splicing
// Phase 34A: Compile-out splice debug counter (default OFF)
#if HAKMEM_SPLICE_DEBUG_COMPILED
static _Atomic uint64_t g_splice_count = 0;
uint64_t splice_num = atomic_fetch_add(&g_splice_count, 1);
if (splice_num > 40 && splice_num < 80 && class_idx == 0) {
@ -98,6 +100,9 @@ static inline void trc_splice_to_sll(int class_idx, TinyRefillChain* c,
}
fflush(stderr);
}
#else
(void)0; // No-op when compiled out
#endif
// 🐛 DEBUG: Log splice call BEFORE calling tls_sll_splice()
#if !HAKMEM_BUILD_RELEASE

96
docs/analysis/ATOMIC_PRUNE_CUMULATIVE_SUMMARY.md
View File

@ -3,7 +3,7 @@
**Project:** HAKMEM Memory Allocator - Hot Path Optimization
**Goal:** Remove all telemetry-only atomics from hot alloc/free paths
**Principle:** Follow mimalloc: No atomics/observe in hot path
**Status:** Phase 24+25+26+27+31 Complete (+2.74% cumulative), Phase 28+29 NO-OP, Phase 30 Procedure Complete
**Status:** Phase 24+25+26+27+31+32 Complete (+2.74% cumulative), Phase 28+29 NO-OP, Phase 30 Procedure Complete
---
@ -280,6 +280,30 @@ rg "getenv.*FEATURE" && echo "⚠️ ENV-gated, may be OFF"
---
### Phase 32: Tiny Free Calls Atomic Prune ✅ **NEUTRAL (-0.46%)**
**Date:** 2025-12-16
**Target:** `g_hak_tiny_free_calls` (tiny free calls diagnostic counter)
**File:** `core/hakmem_tiny_free.inc:335` (9 lines after Phase 31)
**Atomics:** 1 global counter (executed on every tiny free, unconditional)
**Build Flag:** `HAKMEM_TINY_FREE_CALLS_COMPILED` (default: 0)
**Results:**
- **Baseline (compiled-out):** 52.94 M ops/s (mean), 53.22 M ops/s (median)
- **Compiled-in:** 53.28 M ops/s (mean), 53.46 M ops/s (median)
- **Improvement:** **-0.46% (mean), -0.46% (median)**
- **Verdict:** **NEUTRAL** ➡️ Keep compiled-out for cleanliness ✅
**Analysis:** HOT path atomic (every free call, 9 lines after Phase 31 target) shows no measurable impact (-0.46%, within ±0.5% noise margin). Unexpectedly, the atomic counter compiled-in performed slightly better, suggesting code alignment effects rather than atomic overhead. Following Phase 31 precedent (-0.35% NEUTRAL), Phase 32 is ADOPTED with COMPILED=0 for code cleanliness and consistency.
**Path:** HOT (same function as Phase 31, `hak_tiny_free()`)
**Frequency:** High (every tiny free call, unconditional - no rate limit)
**Key Finding:** Diagnostic counter has negligible performance impact on modern CPUs. NEUTRAL result reinforces Phase 31 pattern: compile-out for code cleanliness, not performance.
**Reference:** `docs/analysis/PHASE32_TINY_FREE_CALLS_ATOMIC_PRUNE_RESULTS.md`
---
## Cumulative Impact
| Phase | Atomics Removed | Frequency | Impact | Status |
@ -292,7 +316,8 @@ rg "getenv.*FEATURE" && echo "⚠️ ENV-gated, may be OFF"
| **29** | **0 (pool v2)** | **N/A (code not active)** | **0.00%** | **NO-OP ✅** |
| **30** | **0 (procedure)** | **N/A (standardization)** | **N/A** | **PROCEDURE ✅** |
| **31** | **1 (free trace)** | **High (every free entry)** | **-0.35%** | **NEUTRAL ✅** |
| **Total** | **18 atomics** | **Mixed** | **+2.74%** | **✅** |
| **32** | **1 (free calls)** | **High (every free, unconditional)** | **-0.46%** | **NEUTRAL ✅** |
| **Total** | **19 atomics** | **Mixed** | **+2.74%** | **✅** |
**Key Insights:**
1. **Frequency matters more than count:** High-frequency atomics (Phase 24+25) provide measurable benefit (+0.93%, +1.07%). Medium-frequency atomics (Phase 27, WARM path) provide substantial benefit (+0.74%). Low-frequency atomics (Phase 26) provide cleanliness but no performance gain.
@ -381,20 +406,30 @@ rg "getenv.*FEATURE" && echo "⚠️ ENV-gated, may be OFF"
- **Result:** NEUTRAL verdict, adopted for code cleanliness
- **Reason:** HOT path atomic with zero measurable overhead (rate-limited trace)
5. **Tiny Free Calls Counter** (Phase 32 - TOP PRIORITY) ⭐
- **Target:** `g_hak_tiny_free_calls` (HOT path)
- **File:** `core/hakmem_tiny_free.inc:335` (9 lines after Phase 31 target)
- **Atomic:** 1 counter (`atomic_fetch_add`)
- **Classification:** TELEMETRY ✅ (diagnostic counter only)
- **Execution:** ✅ Verified (same function as Phase 31, no ENV gate)
- **Frequency:** HOT (every tiny free call, same as Phase 31)
- **Expected Gain:** +0.3% to +0.7% (smaller than Phase 25, similar to Phase 31)
- **Priority:** **HIGHEST** (same HOT path as Phase 31)
- **Reference:** `docs/analysis/PHASE31_TINY_FREE_TRACE_ATOMIC_PRUNE_RESULTS.md` (Phase 32 candidate)
5. ~~**Tiny Free Calls Counter** (Phase 32)~~ ✅ **COMPLETE (NEUTRAL -0.46%)**
- **Result:** NEUTRAL verdict, adopted for code cleanliness
- **Reason:** HOT path diagnostic counter with negligible overhead (code alignment effects)
### High Priority: Phase 33 Target (NEXT)
6. **Tiny Debug Ring Record** (Phase 33 - TOP PRIORITY) ⭐
- **Target:** `tiny_debug_ring_record(TINY_RING_EVENT_FREE_ENTER, ...)` (HOT path)
- **File:** `core/hakmem_tiny_free.inc:340` (3 lines after Phase 32 target)
- **Classification:** TELEMETRY (debug ring buffer, event logging)
- **Execution:** ⚠️ **REQUIRES STEP 0 VERIFICATION** (Phase 30 lesson)
- **Verification Required:**
```bash
# Check if debug ring is ENV-gated or always-on
rg "getenv.*DEBUG_RING" core/
rg "HAKMEM.*DEBUG.*RING" core/
```
- **Expected Gain:** +0.3% to +1.0% (if always-on, similar to Phase 25/31/32)
- **Priority:** **HIGHEST** (same HOT path as Phase 31+32, same function)
- **Warning:** Only proceed if debug ring is **always-on by default** (not ENV-gated)
### Medium Priority: Uncertain Candidates
6. **P0 Class OOB Log** (Phase 33 candidate)
7. **P0 Class OOB Log** (Phase 34 candidate)
- **Target:** `g_p0_class_oob_log` (WARM path)
- **File:** `core/hakmem_tiny_refill_p0.inc.h:41`
- **Classification:** TELEMETRY (error logging)
@ -538,6 +573,11 @@ All atomic compile gates in `core/hakmem_build_flags.h`:
#ifndef HAKMEM_TINY_FREE_TRACE_COMPILED
# define HAKMEM_TINY_FREE_TRACE_COMPILED 0
#endif
// Phase 32: Tiny Free Calls (NEUTRAL -0.46%)
#ifndef HAKMEM_TINY_FREE_CALLS_COMPILED
# define HAKMEM_TINY_FREE_CALLS_COMPILED 0
#endif
```
**Default State:** All flags = 0 (compiled-out, production-ready)
@ -547,13 +587,13 @@ All atomic compile gates in `core/hakmem_build_flags.h`:
## Conclusion
**Total Progress (Phase 24+25+26+27+28+29+30+31):**
- **Performance Gain:** +2.74% (Phase 24: +0.93%, Phase 25: +1.07%, Phase 26: NEUTRAL, Phase 27: +0.74%, Phase 28: NO-OP, Phase 29: NO-OP, Phase 30: PROCEDURE, Phase 31: NEUTRAL)
- **Atomics Removed:** 18 telemetry atomics from hot/warm paths (17 compiled-out + 1 Phase 31)
- **Phases Completed:** 8 phases (4 with performance changes, 2 audit-only, 1 standardization, 1 cleanliness)
**Total Progress (Phase 24+25+26+27+28+29+30+31+32):**
- **Performance Gain:** +2.74% (Phase 24: +0.93%, Phase 25: +1.07%, Phase 26: NEUTRAL, Phase 27: +0.74%, Phase 28: NO-OP, Phase 29: NO-OP, Phase 30: PROCEDURE, Phase 31: NEUTRAL, Phase 32: NEUTRAL)
- **Atomics Removed:** 19 telemetry atomics from hot/warm paths (17 compiled-out + 1 Phase 31 + 1 Phase 32)
- **Phases Completed:** 9 phases (4 with performance changes, 2 audit-only, 1 standardization, 2 cleanliness)
- **Code Quality:** Cleaner hot/warm paths, closer to mimalloc's zero-overhead principle
- **Methodology:** 4-step standard procedure validated (Phase 30-31)
- **Next Target:** Phase 32 (`g_hak_tiny_free_calls`, HOT path, expected +0.3% to +0.7%)
- **Methodology:** 4-step standard procedure validated (Phase 30-31-32)
- **Next Target:** Phase 33 (`tiny_debug_ring_record`, HOT path, **REQUIRES STEP 0 VERIFICATION**)
**Key Success Factors:**
1. Systematic audit and classification (CORRECTNESS vs TELEMETRY)
@ -564,25 +604,27 @@ All atomic compile gates in `core/hakmem_build_flags.h`:
6. **NEW:** Step 0 execution verification (Phase 30 standard procedure)
**Future Work:**
- **Immediate:** Phase 32 (`g_hak_tiny_free_calls`, HOT path, same location as Phase 31)
- Expected cumulative gain: +3.0-3.5% total (currently at +2.74%)
- **Immediate:** Phase 33 (`tiny_debug_ring_record`, HOT path, same location as Phase 31+32)
- **CRITICAL:** Phase 33 requires Step 0 verification (ENV gate check) before proceeding
- Expected cumulative gain: +2.74% (stable, no further performance gains expected from Phase 31+32 NEUTRAL results)
- Follow Phase 30 standard procedure for all future candidates
- Focus on execution-verified, high-frequency paths
- Document all verdicts for reproducibility
- Accept NEUTRAL verdicts for code cleanliness (Phase 26/31 pattern)
- Accept NEUTRAL verdicts for code cleanliness (Phase 26/31/32 pattern)
**Lessons from Phase 28+29+30+31:**
**Lessons from Phase 28+29+30+31+32:**
- Not all atomic counters are telemetry (Phase 28: flow control counters are CORRECTNESS)
- Flow control counters (e.g., `g_bg_spill_len`) are UNTOUCHABLE
- Always trace how counter is used before classifying
- Verify code path is ACTIVE before A/B testing (Phase 29: ENV-gated code has zero impact)
- Standard procedure prevents repeated mistakes (Phase 30: Step 0 gate prevents Phase 29-style no-ops)
- Not all HOT path atomics have measurable overhead (Phase 31: -0.35% NEUTRAL despite high frequency)
- NEUTRAL verdicts justify adoption for code cleanliness (Phase 26/31 precedent)
- Not all HOT path atomics have measurable overhead (Phase 31: -0.35% NEUTRAL, Phase 32: -0.46% NEUTRAL)
- NEUTRAL verdicts justify adoption for code cleanliness (Phase 26/31/32 precedent)
- **Code alignment matters:** Phase 32 showed compiled-in was faster (code layout effects, not atomic overhead)
---
**Last Updated:** 2025-12-16
**Status:** Phase 24-27+31 Complete (+2.74%), Phase 28-29 NO-OP, Phase 30 Procedure Complete
**Next Phase:** Phase 32 (`g_hak_tiny_free_calls`, HOT path, expected +0.3% to +0.7%)
**Status:** Phase 24-27+31+32 Complete (+2.74%), Phase 28-29 NO-OP, Phase 30 Procedure Complete
**Next Phase:** Phase 33 (`tiny_debug_ring_record`, HOT path, **REQUIRES STEP 0 VERIFICATION**)
**Maintained By:** Claude Sonnet 4.5

146
docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md
View File

@ -1,21 +1,37 @@
# Performance Targets（mimalloc 追跡の“数値目標”）
# Performance Targets（mimalloc 追跡の"数値目標"）
目的: 速さだけでなく **syscall / メモリ安定性 / 長時間安定性**を含めて「勝ち筋」を固定する。
## Current snapshot（2025-12-16, local）
## 運用方針（Phase 38 確定）
**比較基準は FAST build** を正とする:
- **FAST**: 純粋な性能計測（gate function 定数化、診断カウンタ OFF）
- **Standard**: 安全・互換の基準（ENV gate 有効、本線リリース用）
- **OBSERVE**: 挙動観測・デバッグ（診断カウンタ ON）
mimalloc との比較は **FAST build** で行う（Standard は fixed tax を含むため公平でない）。
## Current snapshot（2025-12-16, Phase 39）
計測条件（再現の正）：
- Mixed: `scripts/run_mixed_10_cleanenv.sh`（`ITERS=20000000 WS=400`）
- 10-run mean/median
- Git: `HEAD` (Phase 39)
- hakmem: `scripts/run_mixed_10_cleanenv.sh`（`ITERS=20000000 WS=400`、profile=`MIXED_TINYV3_C7_SAFE`）
- system/mimalloc: `./bench_random_mixed_system 20000000 400 1` / `./bench_random_mixed_mi 20000000 400 1`（各10-run）
- same-binary libc: `HAKMEM_FORCE_LIBC_ALLOC=1 scripts/run_mixed_10_cleanenv.sh`（10-run）
- Git: `HEAD=4d9429e14`
### hakmem Build Variants（同一バイナリレイアウト）
結果（10-run mean/median）：
| Build | Mean (M ops/s) | Median (M ops/s) | vs mimalloc | 備考 |
|-------|----------------|------------------|-------------|------|
| **FAST v3** | 56.04 | - | **47.4%** | 性能評価の正 |
| Standard | 53.50 | - | 45.3% | 安全・互換基準 |
| OBSERVE | TBD | - | - | 診断カウンタ ON |
**FAST vs Standard delta: +4.8%**（gate function overhead の差）
### Reference allocators（別バイナリ、layout 差あり）
| allocator | mean (M ops/s) | median (M ops/s) | ratio vs mimalloc (mean) |
|----------|-----------------|------------------|--------------------------|
| hakmem | 54.646 | 54.671 | 46.2% |
| libc (same binary) | 76.257 | 76.661 | 64.5% |
| system (separate) | 81.540 | 81.801 | 69.0% |
| mimalloc (separate)| 118.176| 118.497 | 100% |
@ -23,16 +39,22 @@
Notes:
- `system/mimalloc` は別バイナリ計測のため **layout（text size/I-cache）差分を含む reference**。
- `libc (same binary)` は `HAKMEM_FORCE_LIBC_ALLOC=1` により、同一レイアウト上での比較の目安。
- **mimalloc 比較は FAST build を使用すること**（Standard の gate overhead は hakmem 固有の税）
## 1) Speed（相対目標）
前提: **同一バイナリ**で hakmem vs mimalloc を比較する（別バイナリ比較は layout 差で壊れる）。
前提: **FAST build** で hakmem vs mimalloc を比較する（Standard は gate overhead を含むため不公平）。
推奨マイルストーン（Mixed 16–1024B）：
推奨マイルストーン（Mixed 16–1024B, FAST build）：
- M1: mimalloc の **55%**（現状レンジの安定化）
- M2: mimalloc の **60%**（短期の現実目標）
- M3: mimalloc の **65–70%**（大きめの構造改造が必要になりやすい境界）
| Milestone | Target | Current (FAST v3) | Status |
|-----------|--------|-------------------|--------|
| M1 | mimalloc の **50%** | 47.4% | 🔴 未達 |
| M2 | mimalloc の **55%** | - | 🔴 未達 |
| M3 | mimalloc の **60%** | - | 🔴 未達 |
| M4 | mimalloc の **65–70%** | - | 🔴 未達（構造改造必要）|
**現状:** FAST v3 = 56.04M ops/s = mimalloc の 47.4%（M1 未達、あと +5.5% 必要）
## 2) Syscall budget（OS churn）
@ -77,3 +99,101 @@ Current:
- runtime 変更（ENVのみ）: GO 閾値 +1.0%（Mixed 10-run mean）
- build-level 変更（compile-out 系）: GO 閾値 +0.5%（layout の揺れを考慮）
## 6) Build Variants（FAST / Standard / OBSERVE）— Phase 38 運用
### 3種類のビルド
| Build | Binary | 目的 | 特徴 |
|-------|--------|------|------|
| **FAST** | `bench_random_mixed_hakmem_minimal` | 純粋な性能計測 | gate function 定数化、診断 OFF |
| **Standard** | `bench_random_mixed_hakmem` | 安全・互換基準 | ENV gate 有効、本線リリース用 |
| **OBSERVE** | `bench_random_mixed_hakmem_observe` | 挙動観測 | 診断カウンタ ON、perf 分析用 |
### 運用ルール（Phase 38 確定）
1. **性能評価は FAST build で行う**（mimalloc 比較の正）
2. **Standard は安全基準**（gate overhead は許容、本線機能の互換性優先）
3. **OBSERVE はデバッグ用**（性能評価には使わない、診断出力あり）
### FAST build 履歴
| Version | Mean (ops/s) | Delta | 変更内容 |
|---------|--------------|-------|----------|
| FAST v1 | 54,557,938 | baseline | Phase 35-A: gate function 定数化 |
| FAST v2 | 54,943,734 | +0.71% | Phase 36: policy snapshot init-once |
| **FAST v3** | 56,040,000 | +1.98% | Phase 39: hot path gate 定数化 |
**FAST v3 で定数化されたもの:**
- `tiny_front_v3_enabled()` → 常に `true`
- `tiny_metadata_cache_enabled()` → 常に `0`
- `small_policy_v7_snapshot()` → version check スキップ、init-once TLS cache
- `learner_v7_enabled()` → 常に `false`
- `small_learner_v2_enabled()` → 常に `false`
- `front_gate_unified_enabled()` → 常に `1`（Phase 39）
- `alloc_dualhot_enabled()` → 常に `0`（Phase 39）
- `g_bench_fast_front` block → compile-out（Phase 39）
- `g_v3_enabled` block → compile-out（Phase 39）
- `free_dispatch_stats_enabled()` → 常に `false`（Phase 39）
### 使い方（Phase 38 ワークフロー）
**推奨: 自動化ターゲットを使用**
```bash
# FAST 10-run 性能評価（mimalloc 比較の正）
make perf_fast
# OBSERVE health check（syscall/診断確認）
make perf_observe
# 両方実行
make perf_all
```
**手動実行（個別制御が必要な場合）**
```bash
# FAST build のみビルド
make bench_random_mixed_hakmem_minimal
# Standard build のみビルド
make bench_random_mixed_hakmem
# OBSERVE build のみビルド
make bench_random_mixed_hakmem_observe
# 10-run 実行（任意の binary で）
scripts/run_mixed_10_cleanenv.sh
```
### Phase 37 教訓（Standard 最適化の限界）
Standard build を速くする試み（TLS cache）は NO-GO (-0.07%):
- Runtime gate (lazy-init) は必ず overhead を持つ
- Compile-time constant (BENCH_MINIMAL) が唯一の解
- **結論:** Standard は安全基準として維持、性能は FAST で評価
### Phase 39 実施済み（FAST v3）
以下の gate function は Phase 39 で定数化済み:
**malloc path（実施済み）:**
| Gate | File | FAST v3 値 | Status |
|------|------|-----------|--------|
| `front_gate_unified_enabled()` | malloc_tiny_fast.h | 固定 1 | ✅ GO |
| `alloc_dualhot_enabled()` | malloc_tiny_fast.h | 固定 0 | ✅ GO |
**free path（実施済み）:**
| Gate | File | FAST v3 値 | Status |
|------|------|-----------|--------|
| `g_bench_fast_front` | hak_free_api.inc.h | compile-out | ✅ GO |
| `g_v3_enabled` | hak_free_api.inc.h | compile-out | ✅ GO |
| `g_free_dispatch_ssot` | hak_free_api.inc.h | lazy-init 維持 | 保留 |
**stats（実施済み）:**
| Gate | File | FAST v3 値 | Status |
|------|------|-----------|--------|
| `free_dispatch_stats_enabled()` | free_dispatch_stats_box.h | 固定 false | ✅ GO |
**Phase 39 結果:** +1.98%（GO）

247
docs/analysis/PHASE32_TINY_FREE_CALLS_ATOMIC_PRUNE_RESULTS.md Normal file
View File

@ -0,0 +1,247 @@
# Phase 32: Tiny Free Calls Atomic Prune - A/B Test Results
**Date:** 2025-12-16
**Target:** `g_hak_tiny_free_calls` atomic counter in `core/hakmem_tiny_free.inc:335`
**Build Flag:** `HAKMEM_TINY_FREE_CALLS_COMPILED` (default: 0)
**Verdict:** NEUTRAL → Adopt for code cleanliness
---
## Executive Summary
Phase 32 implements compile-time gating for the `g_hak_tiny_free_calls` diagnostic counter in `hak_tiny_free()`. A/B testing shows **NEUTRAL** impact (-0.46%, within measurement noise). We adopt the compile-out default (COMPILED=0) for code cleanliness and consistency with the atomic prune series.
**Key Finding:** The atomic counter has negligible performance impact, but removing it maintains cleaner code and aligns with the systematic removal of diagnostic telemetry from HOT paths.
---
## Test Configuration
### Target Code Location
**File:** `core/hakmem_tiny_free.inc:335`
**Before (always active):**
```c
extern _Atomic uint64_t g_hak_tiny_free_calls;
atomic_fetch_add_explicit(&g_hak_tiny_free_calls, 1, memory_order_relaxed);
```
**After (compile-out default):**
```c
#if HAKMEM_TINY_FREE_CALLS_COMPILED
extern _Atomic uint64_t g_hak_tiny_free_calls;
atomic_fetch_add_explicit(&g_hak_tiny_free_calls, 1, memory_order_relaxed);
#else
(void)0; // No-op when diagnostic counter compiled out
#endif
```
### Code Classification
- **Category:** TELEMETRY
- **Frequency:** Every free operation (unconditional)
- **Correctness Impact:** None (diagnostic only)
- **Flow Control:** None
### Build Flag (SSOT)
**File:** `core/hakmem_build_flags.h`
```c
// ------------------------------------------------------------
// Phase 32: Tiny Free Calls Atomic Prune (Compile-out diagnostic counter)
// ------------------------------------------------------------
// Tiny Free Calls: Compile gate (default OFF = compile-out)
// Set to 1 for research builds that need free path call counting
// Target: g_hak_tiny_free_calls atomic in core/hakmem_tiny_free.inc:335
// Impact: HOT path atomic (every free operation, unconditional)
// Expected improvement: +0.3% to +0.7% (diagnostic counter, less critical than Phase 25)
#ifndef HAKMEM_TINY_FREE_CALLS_COMPILED
# define HAKMEM_TINY_FREE_CALLS_COMPILED 0
#endif
```
---
## A/B Test Results
### Methodology
- **Workload:** `bench_random_mixed` (Mixed 8-64B allocation pattern)
- **Iterations:** 10 runs per configuration
- **Environment:** Clean environment via `scripts/run_mixed_10_cleanenv.sh`
- **Compiler:** GCC with `-O3 -flto -march=native`
### Configuration A: Baseline (COMPILED=0, counter compiled-out)
```bash
make clean && make -j bench_random_mixed_hakmem
scripts/run_mixed_10_cleanenv.sh
```
**Results:**
```
Run 1: 51,155,676 ops/s
Run 2: 51,337,897 ops/s
Run 3: 53,355,358 ops/s
Run 4: 52,484,033 ops/s
Run 5: 53,554,331 ops/s
Run 6: 52,816,908 ops/s
Run 7: 53,764,926 ops/s
Run 8: 53,908,882 ops/s
Run 9: 53,963,916 ops/s
Run 10: 53,083,746 ops/s
Median: 53,219,552 ops/s
Mean: 52,942,567 ops/s
Stdev: 1,011,696 ops/s (1.91%)
```
### Configuration B: Compiled-in (COMPILED=1, counter active)
```bash
make clean && make -j EXTRA_CFLAGS='-DHAKMEM_TINY_FREE_CALLS_COMPILED=1' bench_random_mixed_hakmem
scripts/run_mixed_10_cleanenv.sh
```
**Results:**
```
Run 1: 53,017,261 ops/s
Run 2: 52,053,756 ops/s
Run 3: 53,815,545 ops/s
Run 4: 53,366,110 ops/s
Run 5: 53,560,201 ops/s
Run 6: 54,113,944 ops/s
Run 7: 53,252,767 ops/s
Run 8: 53,823,030 ops/s
Run 9: 53,766,710 ops/s
Run 10: 52,006,868 ops/s
Median: 53,463,156 ops/s
Mean: 53,277,619 ops/s
Stdev: 729,857 ops/s (1.37%)
```
### Performance Impact
| Metric | Baseline (COMPILED=0) | Compiled-in (COMPILED=1) | Delta |
|--------|----------------------|--------------------------|-------|
| **Median** | 53,219,552 ops/s | 53,463,156 ops/s | **-0.46%** |
| **Mean** | 52,942,567 ops/s | 53,277,619 ops/s | -0.63% |
| **Stdev** | 1,011,696 (1.91%) | 729,857 (1.37%) | Lower variance |
**Improvement:** -0.46% (NEUTRAL)
---
## Analysis
### Unexpected Result
Unlike previous atomic prune phases (Phase 25: +1.07%, Phase 31: NEUTRAL), Phase 32 shows a **slight performance improvement** with the atomic counter **compiled-in**. This is counterintuitive and within measurement noise.
### Possible Explanations
1. **Code Alignment Effects:** The `(void)0` no-op may cause different code alignment than the atomic instruction, potentially affecting instruction cache behavior
2. **Measurement Noise:** The -0.46% difference is well within typical variance (±0.5%)
3. **Compiler Optimization:** LTO may optimize the atomic differently in the compiled-in case
### Statistical Significance
- **Difference:** 243,604 ops/s (0.46%)
- **Baseline Stdev:** 1,011,696 ops/s (1.91%)
- **Compiled-in Stdev:** 729,857 ops/s (1.37%)
- **Conclusion:** Not statistically significant (difference < 1 stdev)
### Verdict Rationale
Despite the slight negative delta, we adopt **COMPILED=0** (compiled-out) for:
1. **Code Cleanliness:** Removes unnecessary diagnostic counter from production code
2. **Consistency:** Aligns with atomic prune series (Phases 24-32)
3. **Future-Proofing:** Eliminates potential cache line contention in multi-threaded workloads
4. **Research Flexibility:** Counter can be re-enabled via `-DHAKMEM_TINY_FREE_CALLS_COMPILED=1`
---
## Comparison with Related Phases
### Phase 25: g_free_ss_enter (+1.07% GO)
- **Location:** `tiny_superslab_free.inc.h`
- **Frequency:** Every free operation
- **Impact:** +1.07% improvement (GO)
- **Similarity:** Same HOT path, same frequency
- **Difference:** Phase 25 counter was in more critical code section
### Phase 31: g_tiny_free_trace (NEUTRAL)
- **Location:** `hakmem_tiny_free.inc:326` (9 lines above Phase 32)
- **Frequency:** Every free operation (rate-limited to 128 calls)
- **Impact:** NEUTRAL (adopted for code cleanliness)
- **Similarity:** Same function, same file
- **Difference:** Phase 31 was rate-limited, Phase 32 is unconditional
### Key Insight
Phase 32's NEUTRAL result is consistent with Phase 31 (same function, similar location). The atomic counter's impact is negligible in modern CPUs with efficient relaxed atomics. The primary benefit is code cleanliness, not performance.
---
## Cumulative Impact
### Atomic Prune Series Progress (Phases 24-32)
1. **Phase 24:** Tiny Class Stats (+0.93% GO)
2. **Phase 25:** Tiny Free Stats (+1.07% GO)
3. **Phase 26A:** C7 Free Count (+0.77% GO)
4. **Phase 26B:** Header Mismatch Log (+0.53% GO)
5. **Phase 26C:** Header Meta Mismatch (+0.41% NEUTRAL)
6. **Phase 26D:** Metric Bad Class (+0.47% NEUTRAL)
7. **Phase 26E:** Header Meta Fast (+0.67% GO)
8. **Phase 27:** Unified Cache Stats (+0.47% NEUTRAL)
9. **Phase 29:** Pool Hotbox v2 Stats (+1.00% GO)
10. **Phase 31:** Tiny Free Trace (NEUTRAL)
11. **Phase 32:** Tiny Free Calls (NEUTRAL)
**Total Improvement (GO phases only):** ~5.4%
---
## Recommendations
### Adoption Decision
**ADOPT** with `HAKMEM_TINY_FREE_CALLS_COMPILED=0` (default OFF).
**Rationale:**
1. NEUTRAL performance impact (within noise)
2. Code cleanliness benefit
3. Consistency with atomic prune series
4. No functional impact (diagnostic only)
### Production Use
```bash
# Default build (counter compiled-out)
make bench_random_mixed_hakmem
```
### Research/Debug Use
```bash
# Enable counter for diagnostics
make EXTRA_CFLAGS='-DHAKMEM_TINY_FREE_CALLS_COMPILED=1' bench_random_mixed_hakmem
```
### Next Steps: Phase 33 Candidate
**Target:** `tiny_debug_ring_record(TINY_RING_EVENT_FREE_ENTER, ...)`
**Location:** `core/hakmem_tiny_free.inc:340` (3 lines below Phase 32)
**Classification:** TELEMETRY (debug ring buffer)
**⚠️ CRITICAL:** Phase 33 requires **Step 0 verification** (Phase 30 lesson):
```bash
# Check if debug ring is ENV-gated or always-on
rg "getenv.*DEBUG_RING" core/
rg "HAKMEM.*DEBUG.*RING" core/
```
Only proceed if debug ring is **always-on by default** (not ENV-gated).
---
## Conclusion
Phase 32 demonstrates that the `g_hak_tiny_free_calls` diagnostic counter has **negligible performance impact** on modern hardware. The NEUTRAL result (-0.46%) is within measurement noise and likely influenced by code alignment effects rather than actual atomic overhead.
We adopt the compile-out default (COMPILED=0) to maintain code cleanliness and consistency with the atomic prune series. This phase reinforces the pattern established in Phase 31: diagnostic counters on HOT paths should be compile-time gated, even if their runtime impact is minimal.
The systematic removal of diagnostic telemetry from production builds improves code clarity and eliminates potential future issues (e.g., cache line contention in multi-threaded scenarios).
---
**Phase 32 Status:** COMPLETE (NEUTRAL → Adopt for code cleanliness)
**Next Phase:** Phase 33 (`tiny_debug_ring_record`) - Step 0 verification required

81
docs/analysis/PHASE39_FAST_V3_GATE_CONSTANTIZATION_INSTRUCTIONS.md Normal file
View File

@ -0,0 +1,81 @@
# Phase 39 — FAST v3: Gate Function 定数化（BENCH_MINIMAL の固定税刈り）
## 目的（1行）
FAST build（`HAKMEM_BENCH_MINIMAL=1`）の hot path に残る **lazy-init gate**（`static int=-1` + `getenv()`）を **compile-time constant** にして、固定税を削る。
## 背景
- Phase 35-A で gate function overhead の削減が atomic prune より ROI が高いことを確認した（GO +4.39%）。
- Phase 37 で runtime gate（lazy-init）を Standard に持ち込むと税が勝つことを確認した（NO-GO）。
- よって **FAST でのみ**「定数化」を進めるのが安全で勝ち筋。
## 方針（Box Theory）
- “箱”は増やさず、既存 gate を **`#if HAKMEM_BENCH_MINIMAL`** で定数化する（戻せる）。
- Standard/OBSERVE の挙動は **変更しない**。
- link-out / 物理削除はしない（layout/LTO で符号反転する）。
## 対象（優先順）
### A) malloc hot path gate（毎 alloc）
ファイル: `core/front/malloc_tiny_fast.h`
1. `front_gate_unified_enabled()` を FAST で固定 `1`
2. `alloc_dualhot_enabled()` を FAST で固定 `0`
実装方針:
- 関数定義の内部を `#if HAKMEM_BENCH_MINIMAL` で分岐し、FAST は return constant のみ。
- Standard/OBSERVE は現状の lazy-init を維持（A/B の自由度を残す）。
### B) free dispatcher 内の gate（毎 free）
ファイル: `core/box/hak_free_api.inc.h`
1. `HAKMEM_BENCH_FAST_FRONT` ブロックを FAST で固定 OFF（丸ごと compile-out でも可）
2. `g_v3_enabled`（v3 snapshot free stub）ブロックを FAST で固定 OFF（丸ごと compile-out）
3. `g_free_dispatch_ssot`（`getenv("HAKMEM_FREE_DISPATCH_SSOT")`）を FAST で固定 ON
注意:
- `g_free_dispatch_ssot` の “正” は、現行プリセットが最適化経路を採用している前提で **ON** とする。
- もし health/profile で SSOT=0 依存が残っていたら、まずプリセットを正に合わせる（FAST は “性能測定の正”）。
### C) stats gate（毎回呼ばれているなら）
ファイル: `core/box/free_dispatch_stats_box.h`
- `free_dispatch_stats_enabled()` を FAST で固定 `false`
- `FREE_DISPATCH_STAT_INC(...)` が hot entry で呼ばれている場合、lazy-init を消せる。
※ 他にも hot で呼ばれている stats gate があれば同じパターンで追加（ただし “実行確認” を先に）。
## 実装手順（小パッチ順）
1. A（malloc）を先に実装（影響範囲が狭い）
2. B（free）を実装（影響範囲が広いので health を必ず回す）
3. C（stats）を必要に応じて追加
## A/B（判定）
### ベースライン（FAST v2）
- `make perf_fast`
### 変更後（FAST v3）
- `make perf_fast`
### 判定（build-level）
- **GO**: Mixed 10-run mean **+0.5% 以上**
- **NEUTRAL**: **±0.5%**
- **NO-GO**: **-0.5% 以下**
※ NO-GO の場合は即 revert（Phase 22-2 の教訓）。
## 可視化（最小）
- ベンチ結果（mean/median）を `docs/analysis/PHASE39_FAST_V3_GATE_CONSTANTIZATION_RESULTS.md` に追記
- `docs/analysis/PERFORMANCE_TARGETS_SCORECARD.md` の FAST build 履歴を更新

60
docs/analysis/PHASE39_FAST_V3_GATE_CONSTANTIZATION_RESULTS.md Normal file
View File

@ -0,0 +1,60 @@
# Phase 39: FAST v3 Gate Function Constantization — Results
## Summary
**Result: GO (+1.98%)**
Phase 39 の gate function 定数化により、FAST build は **+1.98%** の性能改善を達成。
## A/B Test Results（10-run 正式計測）
### Baseline (FAST v2 without Phase 39)
```
Mean: 54.95M ops/s
```
### Treatment (FAST v3 with Phase 39)
```
Mean: 56.04M ops/s
```
### Delta
- **+1.98%**（GO 閾値 +0.5% を大幅に上回る）
計測条件:
- `make perf_fast`（10-run clean env）
- `ITERS=20000000 WS=400`
## Changes Made
### A) malloc hot path (core/front/malloc_tiny_fast.h)
1. `front_gate_unified_enabled()` → BENCH_MINIMAL で固定 `1`
2. `alloc_dualhot_enabled()` → BENCH_MINIMAL で固定 `0`
### B) free dispatcher (core/box/hak_free_api.inc.h)
1. `g_bench_fast_front` block → BENCH_MINIMAL で compile-out
2. `g_v3_enabled` block → BENCH_MINIMAL で compile-out
3. `g_free_dispatch_ssot` → **保留** (lazy-init 維持)
### C) stats gate (core/box/free_dispatch_stats_box.h)
1. `free_dispatch_stats_enabled()` → BENCH_MINIMAL で固定 `false`
## Analysis
10-run 正式計測により、lazy-init gate function の compile-out が **+1.98%** の性能改善を達成することが確認された。
改善の要因:
1. **Branch elimination**: `__builtin_expect` による予測は効率的だが、branch 自体の除去はそれ以上に効果的
2. **I-cache pressure**: lazy-init コードパスの除去により I-cache footprint が縮小
3. **Compiler optimization**: 定数化により、呼び出し元での追加最適化が可能に
## Recommendation
**判定: GO (+1.98% > +0.5%)**
Phase 39 の変更は全て採用。FAST v3 として確定。
## Files Modified
- `core/front/malloc_tiny_fast.h`
- `core/box/hak_free_api.inc.h`
- `core/box/free_dispatch_stats_box.h`

3
scripts/run_mixed_10_cleanenv.sh
View File

@ -8,6 +8,7 @@ profile=${HAKMEM_PROFILE:-MIXED_TINYV3_C7_SAFE}
iters=${ITERS:-20000000}
ws=${WS:-400}
runs=${RUNS:-10}
bin=${BENCH_BIN:-./bench_random_mixed_hakmem}
# Force known research knobs OFF to avoid accidental carry-over.
export HAKMEM_TINY_HEADER_WRITE_ONCE=${HAKMEM_TINY_HEADER_WRITE_ONCE:-0}
@ -26,5 +27,5 @@ export HAKMEM_FREE_TINY_FAST_MONO_LEGACY_DIRECT=${HAKMEM_FREE_TINY_FAST_MONO_LEG
for i in $(seq 1 "${runs}"); do
echo "=== Run ${i}/${runs} ==="
HAKMEM_PROFILE="${profile}" ./bench_random_mixed_hakmem "${iters}" "${ws}" 1 2>&1 | rg "Throughput" || true
HAKMEM_PROFILE="${profile}" "${bin}" "${iters}" "${ws}" 1 2>&1 | rg "Throughput" || true
done