tomoaki/hakmem
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
14e781cf602666a5cb1657f7117d5fea03f85819
hakmem/core/box
History
Moe Charm (CI) 04186341c1 Phase 4-Step2: Add Hot/Cold Path Box (+7.3% performance) 
Implemented Hot/Cold Path separation using Box pattern for Tiny allocations:

Performance Improvement (without PGO):
- Baseline (Phase 26-A):     53.3 M ops/s
- Hot/Cold Box (Phase 4-Step2): 57.2 M ops/s
- Gain: +7.3% (+3.9 M ops/s)

Implementation:
1. core/box/tiny_front_hot_box.h - Ultra-fast hot path (1 branch)
   - Removed range check (caller guarantees valid class_idx)
   - Inline cache hit path with branch prediction hints
   - Debug metrics with zero overhead in Release builds

2. core/box/tiny_front_cold_box.h - Slow cold path (noinline, cold)
   - Refill logic (batch allocation from SuperSlab)
   - Drain logic (batch free to SuperSlab)
   - Error reporting and diagnostics

3. core/front/malloc_tiny_fast.h - Updated to use Hot/Cold Boxes
   - Hot path: tiny_hot_alloc_fast() (1 branch: cache empty check)
   - Cold path: tiny_cold_refill_and_alloc() (noinline, cold attribute)
   - Clear separation improves i-cache locality

Branch Analysis:
- Baseline: 4-5 branches in hot path (range check + cache check + refill logic mixed)
- Hot/Cold Box: 1 branch in hot path (cache empty check only)
- Reduction: 3-4 branches eliminated from hot path

Design Principles (Box Pattern):
✅ Single Responsibility: Hot path = cache hit only, Cold path = refill/errors
✅ Clear Contract: Hot returns NULL on miss, Cold handles miss
✅ Observable: Debug metrics (TINY_HOT_METRICS_*) gated by NDEBUG
✅ Safe: Branch prediction hints (TINY_HOT_LIKELY/UNLIKELY)
✅ Testable: Isolated hot/cold paths, easy A/B testing

PGO Status:
- Temporarily disabled (build issues with __gcov_merge_time_profile)
- Will re-enable PGO in future commit after resolving gcc/lto issues
- Current benchmarks are without PGO (fair A/B comparison)

Other Changes:
- .gitignore: Added *.d files (dependency files, auto-generated)
- Makefile: PGO targets temporarily disabled (show informational message)
- build_pgo.sh: Temporarily disabled (show "PGO paused" message)

Next: Phase 4-Step3 (Front Config Box, target +5-8%)

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-29 11:58:37 +09:00
..
ace_pool_connector.c
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
ace_pool_connector.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
adopt_gate_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
bench_fast_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
bench_fast_box.h
Phase 20-2: BenchFast mode - Structural bottleneck analysis (+4.5% ceiling)
2025-11-16 06:36:02 +09:00
capacity_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
capacity_box.d
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
capacity_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
carve_push_box.c
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
carve_push_box.d
Cleanup: Consolidate debug ENV vars to HAKMEM_DEBUG_LEVEL
2025-11-29 06:57:03 +09:00
carve_push_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
external_guard_box.h
Phase 3: Remove mincore() syscall completely
2025-11-29 09:04:32 +09:00
free_local_box.c
ENV Cleanup Step 7: Gate debug ENV vars in core/box/free_local_box.c
2025-11-28 01:10:26 +09:00
free_local_box.d
Cleanup: Add tiny_debug_api.h to eliminate guard/failfast implicit warnings
2025-11-29 06:47:13 +09:00
free_local_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_publish_box.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_publish_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
free_publish_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_remote_box.c
Code Cleanup: Remove false positives, redundant validations, and reduce verbose logging
2025-11-21 23:00:24 +09:00
free_remote_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
free_remote_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
front_gate_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
front_gate_box.d
Cleanup: Consolidate debug ENV vars to HAKMEM_DEBUG_LEVEL
2025-11-29 06:57:03 +09:00
front_gate_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
front_gate_classifier.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
front_gate_classifier.d
Cleanup: Add tiny_debug_api.h to eliminate guard/failfast implicit warnings
2025-11-29 06:47:13 +09:00
front_gate_classifier.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
front_gate_v2.h
Phase 15: Box Separation (partial) - Box headers completed, routing deferred
2025-11-15 22:08:51 +09:00
front_metrics_box.c
ENV cleanup: Add RELEASE guards to DEBUG ENV variables (14 vars)
2025-11-27 03:41:07 +09:00
front_metrics_box.d
Phase 21-1-B: Ring cache Alloc/Free 統合 - C2/C3 hot path integration
2025-11-16 07:51:37 +09:00
front_metrics_box.h
ENV cleanup: Remove obsolete ULTRAHOT variable + organize docs
2025-11-26 17:12:41 +09:00
hak_alloc_api.inc.h
Perf optimization: Add __builtin_expect hints to hot paths
2025-11-28 18:04:32 +09:00
hak_core_init.inc.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
hak_exit_debug.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hak_free_api.inc.h
Phase 3: Remove mincore() syscall completely
2025-11-29 09:04:32 +09:00
hak_kpi_util.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hak_wrappers.inc.h
ENV cleanup: Consolidate SFC_DEBUG getenv() calls (86% reduction)
2025-11-27 03:18:33 +09:00
integrity_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
integrity_box.d
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
integrity_box.h
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
mailbox_box.c
Phase 4c: Add master trace control (HAKMEM_TRACE)
2025-11-28 16:08:44 +09:00
mailbox_box.d
Cleanup: Reformat super-long line in pool_api.inc.h for readability
2025-11-28 17:10:32 +09:00
mailbox_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pagefault_telemetry_box.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pagefault_telemetry_box.d
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pagefault_telemetry_box.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pool_api.inc.h
Cleanup: Reformat super-long line in pool_api.inc.h for readability
2025-11-28 17:10:32 +09:00
pool_init_api.inc.h
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
pool_mf2_adoption.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mf2_helpers.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mf2_types.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mid_desc.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_mid_tc.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_refill.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_stats.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_tls_core.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_tls_types.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
prewarm_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
prewarm_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
prewarm_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
ptr_conversion_box.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
ptr_trace_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
slab_freelist_atomic.h
Adaptive CAS: Single-threaded fast path optimization
2025-11-22 03:30:47 +09:00
ss_ace_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_ace_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_allocation_box.c
P2: TLS SLL Redesign - class_map default, tls_cached tracking, conditional header restore
2025-11-28 14:11:37 +09:00
ss_allocation_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_cache_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_cache_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_hot_cold_box.h
P2: TLS SLL Redesign - class_map default, tls_cached tracking, conditional header restore
2025-11-28 14:11:37 +09:00
ss_hot_prewarm_box.c
Phase 26: Front Gate Unification - Tiny allocator fast path (+12.9%)
2025-11-17 05:29:08 +09:00
ss_hot_prewarm_box.d
Phase 21-1-B: Ring cache Alloc/Free 統合 - C2/C3 hot path integration
2025-11-16 07:51:37 +09:00
ss_hot_prewarm_box.h
Phase 19 & 20-1: Frontend optimization + TLS cache prewarm (+16.2% total)
2025-11-16 05:48:59 +09:00
ss_os_acquire_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_os_acquire_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_management_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_management_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_meta_box.h
Phase 1: Atomic Freelist Implementation - MT Safety Foundation
2025-11-22 02:46:57 +09:00
ss_stats_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_stats_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
superslab_expansion_box.c
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
superslab_expansion_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
superslab_expansion_box.h
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
superslab_lookup_box.h
Refactor: Phase 2 Box化 - SuperSlab Lookup Box with multiple contract levels
2025-11-29 08:44:29 +09:00
tiny_front_cold_box.h
Phase 4-Step2: Add Hot/Cold Path Box (+7.3% performance)
2025-11-29 11:58:37 +09:00
tiny_front_hot_box.h
Phase 4-Step2: Add Hot/Cold Path Box (+7.3% performance)
2025-11-29 11:58:37 +09:00
tiny_header_box.h
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
tiny_near_empty_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_near_empty_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_next_ptr_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
tiny_sizeclass_hist_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_sizeclass_hist_box.d
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_sizeclass_hist_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tls_slab_reuse_guard_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
tls_sll_box.h
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
tls_sll_drain_box.h
Refactor: Phase 2 Box化 - SuperSlab Lookup Box with multiple contract levels
2025-11-29 08:44:29 +09:00
ultra_slim_alloc_box.h
Phase 19-2: Ultra SLIM debug logging and root cause analysis
2025-11-22 06:50:38 +09:00
unified_batch_box.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
unified_batch_box.d
Cleanup: Consolidate debug ENV vars to HAKMEM_DEBUG_LEVEL
2025-11-29 06:57:03 +09:00
unified_batch_box.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00