tomoaki/hakmem
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
cd3280eee71475211c1b718bcaa9dcc7dd71b48e
hakmem/core/box
History
Moe Charm (CI) cd3280eee7 Implement MADV_POPULATE_WRITE fix for SuperSlab allocation 
Add support for MADV_POPULATE_WRITE (Linux 5.14+) to force page population
AFTER munmap trimming in SuperSlab fallback path.

Changes:
1. core/box/ss_os_acquire_box.c (lines 171-201):
   - Apply MADV_POPULATE_WRITE after munmap prefix/suffix trim
   - Fallback to explicit page touch for kernels < 5.14
   - Always cleanup suffix region (remove MADV_DONTNEED path)

2. core/superslab_cache.c (lines 111-121):
   - Use MADV_POPULATE_WRITE instead of memset for efficiency
   - Fallback to memset if madvise fails

Testing Results:
- Page faults: Unchanged (~145K per 1M ops)
- Throughput: -2% (4.18M → 4.10M ops/s with HAKMEM_SS_PREFAULT=1)
- Root cause: 97.6% of page faults are from libc memset in initialization,
  not from SuperSlab memory access

Conclusion: MADV_POPULATE_WRITE is effective for SuperSlab memory,
but overall page fault bottleneck comes from TLS/shared pool initialization.
Startup warmup remains the most effective solution (already implemented
in bench_random_mixed.c with +9.5% improvement).

🤖 Generated with Claude Code

Co-Authored-By: Claude <noreply@anthropic.com>
2025-12-05 10:42:47 +09:00
..
ace_pool_connector.c
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
ace_pool_connector.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
adopt_gate_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
bench_fast_box.c
Implement Phase 2: Headerless Allocator Support (Partial)
2025-12-03 12:11:27 +09:00
bench_fast_box.h
Phase 8-TLS-Fix: BenchFast crash root cause fixes
2025-11-30 05:12:32 +09:00
capacity_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
capacity_box.d
Save current state before investigating TLS_SLL_HDR_RESET
2025-12-03 10:34:39 +09:00
capacity_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
carve_push_box.c
Bugfix: Add Header Box and fix Class 0/7 header handling (crash rate -50%)
2025-11-29 07:57:49 +09:00
carve_push_box.d
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
carve_push_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
external_guard_box.h
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
fg_tiny_gate_box.h
fix: guard Tiny FG misclass and add fg_tiny_gate box
2025-12-01 16:05:55 +09:00
free_local_box.c
Phase 9-2: Remove Legacy Backend & Unify to Shared Pool (50M ops/s)
2025-12-01 13:47:23 +09:00
free_local_box.d
Refactor: Clean up SuperSlab shared pool code
2025-11-30 15:27:53 +09:00
free_local_box.h
feat: Add ACE allocation failure tracing and debug hooks
2025-12-01 16:37:59 +09:00
free_publish_box.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_publish_box.d
Save current state before investigating TLS_SLL_HDR_RESET
2025-12-03 10:34:39 +09:00
free_publish_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
free_remote_box.c
Code Cleanup: Remove false positives, redundant validations, and reduce verbose logging
2025-11-21 23:00:24 +09:00
free_remote_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
free_remote_box.h
feat: Add ACE allocation failure tracing and debug hooks
2025-12-01 16:37:59 +09:00
front_gate_box.c
Fix critical type safety bug: enforce hak_base_ptr_t in tiny_alloc_fast_push
2025-12-04 04:58:22 +09:00
front_gate_box.d
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
front_gate_box.h
Fix critical type safety bug: enforce hak_base_ptr_t in tiny_alloc_fast_push
2025-12-04 04:58:22 +09:00
front_gate_classifier.c
Implement Phase 2: Headerless Allocator Support (Partial)
2025-12-03 12:11:27 +09:00
front_gate_classifier.d
Comprehensive legacy cleanup and architecture consolidation
2025-12-04 14:22:48 +09:00
front_gate_classifier.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
front_gate_v2.h
Phase 15: Box Separation (partial) - Box headers completed, routing deferred
2025-11-15 22:08:51 +09:00
front_metrics_box.c
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
front_metrics_box.d
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
front_metrics_box.h
ENV cleanup: Remove obsolete ULTRAHOT variable + organize docs
2025-11-26 17:12:41 +09:00
hak_alloc_api.inc.h
Comprehensive legacy cleanup and architecture consolidation
2025-12-04 14:22:48 +09:00
hak_core_init.inc.h
WIP: Add TLS SLL validation and SuperSlab registry fallback
2025-12-03 20:42:28 +09:00
hak_exit_debug.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hak_free_api.inc.h
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
hak_kpi_util.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hak_lane_classify.inc.h
Comprehensive legacy cleanup and architecture consolidation
2025-12-04 14:22:48 +09:00
hak_wrappers.inc.h
Two-Speed Optimization Part 2: Remove atomic trace counters from hot path
2025-12-04 19:20:44 +09:00
integrity_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
integrity_box.d
Save current state before investigating TLS_SLL_HDR_RESET
2025-12-03 10:34:39 +09:00
integrity_box.h
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
learner_env_box.h
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
mailbox_box.c
Phase 4c: Add master trace control (HAKMEM_TRACE)
2025-11-28 16:08:44 +09:00
mailbox_box.d
Save current state before investigating TLS_SLL_HDR_RESET
2025-12-03 10:34:39 +09:00
mailbox_box.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
mid_large_config_box.h
Phase 5-Step3: Mid/Large Config Box (future workload optimization)
2025-11-29 14:39:07 +09:00
pagefault_telemetry_box.c
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
pagefault_telemetry_box.d
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
pagefault_telemetry_box.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
pool_api.inc.h
Fix mid free routing and relax mid W_MAX
2025-12-01 22:06:10 +09:00
pool_init_api.inc.h
Fix mid free routing and relax mid W_MAX
2025-12-01 22:06:10 +09:00
pool_mf2_adoption.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mf2_helpers.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mf2_types.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
pool_mid_desc.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_mid_tc.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_refill.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_stats.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_tls_core.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
pool_tls_types.inc.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
prewarm_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
prewarm_box.d
Save current state before investigating TLS_SLL_HDR_RESET
2025-12-03 10:34:39 +09:00
prewarm_box.h
Box API Phase 1-3: Capacity Manager, Carve-Push, Prewarm 実装
2025-11-13 01:45:30 +09:00
ptr_conversion_box.h
Complete Phase 1.2: Centralize layout definitions in tiny_layout_box.h
2025-12-03 17:18:31 +09:00
ptr_trace_box.h
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
ptr_type_box.h
feat: Add ACE allocation failure tracing and debug hooks
2025-12-01 16:37:59 +09:00
slab_carve_box.h
Modularize Warm Pool with 3 Box Refactorings - Phase B-3a Complete
2025-12-04 23:39:02 +09:00
slab_freelist_atomic.h
Adaptive CAS: Single-threaded fast path optimization
2025-11-22 03:30:47 +09:00
slab_recycling_box.c
Phase 9: SuperSlab optimization & EMPTY slab recycling (WIP)
2025-11-30 07:16:50 +09:00
slab_recycling_box.h
Add SuperSlab Release Guard Box for centralized slab lifecycle decisions
2025-12-04 06:22:09 +09:00
sp_rebind_slot_box.h
Phase 9-3: Box Theory refactoring (TLS_SLL_DUP root fix)
2025-11-30 10:48:50 +09:00
ss_ace_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_ace_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_addr_map_box.c
Phase 9: SuperSlab optimization & EMPTY slab recycling (WIP)
2025-11-30 07:16:50 +09:00
ss_addr_map_box.h
Phase 9: SuperSlab optimization & EMPTY slab recycling (WIP)
2025-11-30 07:16:50 +09:00
ss_allocation_box.c
Implement and Test Lazy Zeroing Optimization: Phase 2 Complete
2025-12-04 20:49:21 +09:00
ss_allocation_box.h
Comprehensive legacy cleanup and architecture consolidation
2025-12-04 14:22:48 +09:00
ss_cache_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_cache_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_cold_start_box.inc.h
fix(Phase 11+): Cold Start lazy init for unified_cache_refill
2025-12-02 19:43:23 +09:00
ss_hot_cold_box.h
P2: TLS SLL Redesign - class_map default, tls_cached tracking, conditional header restore
2025-11-28 14:11:37 +09:00
ss_hot_prewarm_box.c
Phase 26: Front Gate Unification - Tiny allocator fast path (+12.9%)
2025-11-17 05:29:08 +09:00
ss_hot_prewarm_box.d
Save current state before investigating TLS_SLL_HDR_RESET
2025-12-03 10:34:39 +09:00
ss_hot_prewarm_box.h
Phase 19 & 20-1: Frontend optimization + TLS cache prewarm (+16.2% total)
2025-11-16 05:48:59 +09:00
ss_os_acquire_box.c
Implement MADV_POPULATE_WRITE fix for SuperSlab allocation
2025-12-05 10:42:47 +09:00
ss_os_acquire_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_prefault_box.h
Add SuperSlab Prefault Box with 4MB MAP_POPULATE bug fix
2025-12-04 20:11:24 +09:00
ss_release_guard_box.h
Add SuperSlab Release Guard Box for centralized slab lifecycle decisions
2025-12-04 06:22:09 +09:00
ss_slab_management_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_management_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_slab_meta_box.h
Phase 1: Atomic Freelist Implementation - MT Safety Foundation
2025-11-22 02:46:57 +09:00
ss_stats_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_stats_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
ss_tier_box.h
P-Tier + Tiny Route Policy: Aggressive Superslab Management + Safe Routing
2025-12-04 18:01:25 +09:00
ss_tls_hint_box.c.old
WIP: Add TLS SLL validation and SuperSlab registry fallback
2025-12-03 20:42:28 +09:00
ss_tls_hint_box.h.old
WIP: Add TLS SLL validation and SuperSlab registry fallback
2025-12-03 20:42:28 +09:00
superslab_expansion_box.c
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
superslab_expansion_box.d
Remove dead code: UltraHot, RingCache, FrontC23, Class5 Hotpath
2025-11-26 12:33:49 +09:00
superslab_expansion_box.h
Add Box I (Integrity), Box E (Expansion), and comprehensive P0 debugging infrastructure
2025-11-12 02:45:00 +09:00
superslab_lookup_box.h
Refactor: Phase 2 Box化 - SuperSlab Lookup Box with multiple contract levels
2025-11-29 08:44:29 +09:00
tiny_adopt_refill_box.h
Extract adopt/refill boundary into tiny_adopt_refill_box
2025-11-30 11:06:44 +09:00
tiny_alloc_gate_box.h
Implement Warm Pool Secondary Prefill Optimization (Phase B-2c Complete)
2025-12-04 23:31:54 +09:00
tiny_env_box.c
feat(Phase 1-1): Complete getenv elimination from malloc/free hot paths (+39-42% perf)
2025-12-02 16:16:51 +09:00
tiny_env_box.h
feat(Phase 1-1): Complete getenv elimination from malloc/free hot paths (+39-42% perf)
2025-12-02 16:16:51 +09:00
tiny_free_gate_box.h
Implement Warm Pool Secondary Prefill Optimization (Phase B-2c Complete)
2025-12-04 23:31:54 +09:00
tiny_front_cold_box.h
Unify Unified Cache API to BASE-only pointer type with Phantom typing
2025-12-04 12:20:21 +09:00
tiny_front_config_box.h
Fix potential freelist corruption in unified_cache_refill (Class 0) and improve TLS SLL logging/safety
2025-12-03 12:43:02 +09:00
tiny_front_hot_box.h
Complete Phase 1.2: Centralize layout definitions in tiny_layout_box.h
2025-12-03 17:18:31 +09:00
tiny_geometry_box.h
Phase 9-3: Box Theory refactoring (TLS_SLL_DUP root fix)
2025-11-30 10:48:50 +09:00
tiny_guard_box.h
Phase 9-3: Box Theory refactoring (TLS_SLL_DUP root fix)
2025-11-30 10:48:50 +09:00
tiny_header_box.h
Phase 1 Refactoring Complete: Box-based Logic Consolidation ✅
2025-12-03 11:38:11 +09:00
tiny_layout_box.h
Implement Phase 2: Headerless Allocator Support (Partial)
2025-12-03 12:11:27 +09:00
tiny_near_empty_box.c
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
tiny_near_empty_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_next_ptr_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
tiny_ptr_bridge_box.h
Add tiny_ptr_bridge_box for centralized pointer classification
2025-12-04 05:54:54 +09:00
tiny_route_box.c
P-Tier + Tiny Route Policy: Aggressive Superslab Management + Safe Routing
2025-12-04 18:01:25 +09:00
tiny_route_box.h
P-Tier + Tiny Route Policy: Aggressive Superslab Management + Safe Routing
2025-12-04 18:01:25 +09:00
tiny_sizeclass_hist_box.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_sizeclass_hist_box.d
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_sizeclass_hist_box.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tls_slab_reuse_guard_box.h
Tiny Pool redesign: P0.1, P0.3, P1.1, P1.2 - Out-of-band class_idx lookup
2025-11-28 13:42:39 +09:00
tls_sll_box.h
Two-Speed HOT PATH: Guard hak_super_lookup calls with HAKMEM_BUILD_RELEASE
2025-12-04 18:53:04 +09:00
tls_sll_drain_box.h
hak_init_wait_for_ready: タイムアウト削除 + デバッグ出力抑制
2025-12-02 23:29:07 +09:00
tls_ss_hint_box.h
Implement Phase 1: TLS SuperSlab Hint Box for Headerless performance
2025-12-03 18:06:24 +09:00
ultra_slim_alloc_box.h
P0 Optimization: Shared Pool fast path with O(1) metadata lookup
2025-12-04 16:21:54 +09:00
unified_batch_box.d
Remove legacy redundant code after Gatekeeper Box consolidation
2025-12-04 12:55:53 +09:00
warm_pool_prefill_box.h
Performance Optimization: Release Build Hygiene (Priority 1-4)
2025-12-05 06:16:12 +09:00
warm_pool_stats_box.h
Performance Optimization: Release Build Hygiene (Priority 1-4)
2025-12-05 06:16:12 +09:00
wrapper_env_box.c
feat(Phase 2-1): Lane Classification + Fallback Reduction
2025-12-02 19:13:28 +09:00
wrapper_env_box.h
feat(Phase 2-1): Lane Classification + Fallback Reduction
2025-12-02 19:13:28 +09:00