tomoaki/hakmem
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
cfa587c61d305dec5c13735be1ef30fbc23e53fb
hakmem/core/box
History
Moe Charm (CI) cfa587c61d Phase 8-Step1-3: Unified Cache hot path optimization (config macro + prewarm + PGO init removal) 
Goal: Reduce branches in Unified Cache hot paths (-2 branches per op)
Expected improvement: +2-3% in PGO mode

Changes:
1. Config Macro (Step 1):
   - Added TINY_FRONT_UNIFIED_CACHE_ENABLED macro to tiny_front_config_box.h
   - PGO mode: compile-time constant (1)
   - Normal mode: runtime function call unified_cache_enabled()
   - Replaced unified_cache_enabled() calls in 3 locations:
     * unified_cache_pop() line 142
     * unified_cache_push() line 182
     * unified_cache_pop_or_refill() line 228

2. Function Declaration Fix:
   - Moved unified_cache_enabled() from static inline to non-static
   - Implementation in tiny_unified_cache.c (was in .h as static inline)
   - Forward declaration in tiny_front_config_box.h
   - Resolves declaration conflict between config box and header

3. Prewarm (Step 2):
   - Added unified_cache_init() call to bench_fast_init()
   - Ensures cache is initialized before benchmark starts
   - Enables PGO builds to remove lazy init checks

4. Conditional Init Removal (Step 3):
   - Wrapped lazy init checks in #if !HAKMEM_TINY_FRONT_PGO
   - PGO builds assume prewarm → no init check needed (-1 branch)
   - Normal builds keep lazy init for safety
   - Applied to 3 functions: unified_cache_pop(), unified_cache_push(), unified_cache_pop_or_refill()

Performance Impact:
  PGO mode: -2 branches per operation (enabled check + init check)
  Normal mode: Same as before (runtime checks)

Branch Elimination (PGO):
  Before: if (!unified_cache_enabled()) + if (slots == NULL)
  After:  if (!1) [eliminated] + [init check removed]
  Result: -2 branches in alloc/free hot paths

Files Modified:
  core/box/tiny_front_config_box.h        - Config macro + forward declaration
  core/front/tiny_unified_cache.h         - Config macro usage + PGO conditionals
  core/front/tiny_unified_cache.c         - unified_cache_enabled() implementation
  core/box/bench_fast_box.c               - Prewarm call in bench_fast_init()

Note: BenchFast mode has pre-existing crash (not caused by these changes)

🤖 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-29 17:58:42 +09:00
..
ace_pool_connector.c
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
ace_pool_connector.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
adopt_gate_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
bench_fast_box.c
Phase 8-Step1-3: Unified Cache hot path optimization (config macro + prewarm + PGO init removal)
2025-11-29 17:58:42 +09:00
bench_fast_box.h
Phase 20-2: BenchFast mode - Structural bottleneck analysis (+4.5% ceiling)
2025-11-16 06:36:02 +09:00
capacity_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
capacity_box.d
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
capacity_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
carve_push_box.c
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
carve_push_box.d
Cleanup: Consolidate debug ENV vars to HAKMEM_DEBUG_LEVEL
2025-11-29 06:57:03 +09:00
carve_push_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
external_guard_box.h
Phase 3: Remove mincore() syscall completely
2025-11-29 09:04:32 +09:00
free_local_box.c
ENV Cleanup Step 7: Gate debug ENV vars in core/box/free_local_box.c
2025-11-28 01:10:26 +09:00
free_local_box.d
Cleanup: Add tiny_debug_api.h to eliminate guard/failfast implicit warnings
2025-11-29 06:47:13 +09:00
free_local_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_publish_box.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_publish_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
free_publish_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_remote_box.c
Code Cleanup: Remove false positives, redundant validations, and reduce verbose logging
2025-11-21 23:00:24 +09:00
free_remote_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
free_remote_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
front_gate_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
front_gate_box.d
Cleanup: Consolidate debug ENV vars to HAKMEM_DEBUG_LEVEL
2025-11-29 06:57:03 +09:00
front_gate_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
front_gate_classifier.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
front_gate_classifier.d
Cleanup: Add tiny_debug_api.h to eliminate guard/failfast implicit warnings
2025-11-29 06:47:13 +09:00
front_gate_classifier.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
front_gate_v2.h
Phase 15: Box Separation (partial) - Box headers completed, routing deferred
2025-11-15 22:08:51 +09:00
front_metrics_box.c
ENV cleanup: Add RELEASE guards to DEBUG ENV variables (14 vars)
2025-11-27 03:41:07 +09:00
front_metrics_box.d
Phase 21-1-B: Ring cache Alloc/Free 統合 - C2/C3 hot path integration
2025-11-16 07:51:37 +09:00
front_metrics_box.h
ENV cleanup: Remove obsolete ULTRAHOT variable + organize docs
2025-11-26 17:12:41 +09:00
hak_alloc_api.inc.h
Phase 5-Step3: Mid/Large Config Box (future workload optimization)
2025-11-29 14:39:07 +09:00
hak_core_init.inc.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
hak_exit_debug.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hak_free_api.inc.h
Phase 5-Step3: Mid/Large Config Box (future workload optimization)
2025-11-29 14:39:07 +09:00
hak_kpi_util.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hak_wrappers.inc.h
Phase 7-Step1: Unified front path branch hint reversal (+54.2% improvement!)
2025-11-29 16:17:34 +09:00
integrity_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
integrity_box.d
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
integrity_box.h
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
mailbox_box.c
Phase 4c: Add master trace control (HAKMEM_TRACE)
2025-11-28 16:08:44 +09:00
mailbox_box.d
Cleanup: Reformat super-long line in pool_api.inc.h for readability
2025-11-28 17:10:32 +09:00
mailbox_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
mid_free_route_box.h
Phase 6-B: Header-based Mid MT free (lock-free, +2.65% improvement)
2025-11-29 15:45:29 +09:00
mid_large_config_box.h
Phase 5-Step3: Mid/Large Config Box (future workload optimization)
2025-11-29 14:39:07 +09:00
pagefault_telemetry_box.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pagefault_telemetry_box.d
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pagefault_telemetry_box.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pool_api.inc.h
Cleanup: Reformat super-long line in pool_api.inc.h for readability
2025-11-28 17:10:32 +09:00
pool_init_api.inc.h
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
pool_mf2_adoption.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mf2_helpers.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mf2_types.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mid_desc.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_mid_tc.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_refill.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_stats.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_tls_core.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_tls_types.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
prewarm_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
prewarm_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
prewarm_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
ptr_conversion_box.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
ptr_trace_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
slab_freelist_atomic.h
Adaptive CAS: Single-threaded fast path optimization
2025-11-22 03:30:47 +09:00
ss_ace_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_ace_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_allocation_box.c
P2: TLS SLL Redesign - class_map default, tls_cached tracking, conditional header restore
2025-11-28 14:11:37 +09:00
ss_allocation_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_cache_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_cache_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_hot_cold_box.h
P2: TLS SLL Redesign - class_map default, tls_cached tracking, conditional header restore
2025-11-28 14:11:37 +09:00
ss_hot_prewarm_box.c
Phase 26: Front Gate Unification - Tiny allocator fast path (+12.9%)
2025-11-17 05:29:08 +09:00
ss_hot_prewarm_box.d
Phase 21-1-B: Ring cache Alloc/Free 統合 - C2/C3 hot path integration
2025-11-16 07:51:37 +09:00
ss_hot_prewarm_box.h
Phase 19 & 20-1: Frontend optimization + TLS cache prewarm (+16.2% total)
2025-11-16 05:48:59 +09:00
ss_os_acquire_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_os_acquire_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_management_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_management_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_meta_box.h
Phase 1: Atomic Freelist Implementation - MT Safety Foundation
2025-11-22 02:46:57 +09:00
ss_stats_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_stats_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
superslab_expansion_box.c
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
superslab_expansion_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
superslab_expansion_box.h
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
superslab_lookup_box.h
Refactor: Phase 2 Box化 - SuperSlab Lookup Box with multiple contract levels
2025-11-29 08:44:29 +09:00
tiny_front_cold_box.h
Phase 4-Step2: Add Hot/Cold Path Box (+7.3% performance)
2025-11-29 11:58:37 +09:00
tiny_front_config_box.h
Phase 8-Step1-3: Unified Cache hot path optimization (config macro + prewarm + PGO init removal)
2025-11-29 17:58:42 +09:00
tiny_front_hot_box.h
Phase 4-Step2: Add Hot/Cold Path Box (+7.3% performance)
2025-11-29 11:58:37 +09:00
tiny_header_box.h
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
tiny_near_empty_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_near_empty_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_next_ptr_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
tiny_sizeclass_hist_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_sizeclass_hist_box.d
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_sizeclass_hist_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tls_slab_reuse_guard_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
tls_sll_box.h
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
tls_sll_drain_box.h
Refactor: Phase 2 Box化 - SuperSlab Lookup Box with multiple contract levels
2025-11-29 08:44:29 +09:00
ultra_slim_alloc_box.h
Phase 19-2: Ultra SLIM debug logging and root cause analysis
2025-11-22 06:50:38 +09:00
unified_batch_box.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
unified_batch_box.d
Cleanup: Consolidate debug ENV vars to HAKMEM_DEBUG_LEVEL
2025-11-29 06:57:03 +09:00
unified_batch_box.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00