tomoaki/hakmem
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
9472ee90c95f5b74fd2debd654e1a619c8d69d3e
hakmem/core
History
Moe Charm (CI) 9472ee90c9 Fix: Larson multi-threaded crash - 3 critical race conditions in SharedSuperSlabPool 
Root Cause Analysis (via Task agent investigation):
Larson benchmark crashed with SEGV due to 3 separate race conditions between
lock-free Stage 2 readers and mutex-protected writers in shared_pool_acquire_slab().

Race Condition 1: Non-Atomic Counter
- **Problem**: `ss_meta_count` was `uint32_t` (non-atomic) but read atomically via cast
- **Impact**: Thread A reads partially-updated count, accesses uninitialized metadata[N]
- **Fix**: Changed to `_Atomic uint32_t`, use memory_order_release/acquire

Race Condition 2: Non-Atomic Pointer
- **Problem**: `meta->ss` was plain pointer, read lock-free but freed under mutex
- **Impact**: Thread A loads `meta->ss` after Thread B frees SuperSlab → use-after-free
- **Fix**: Changed to `_Atomic(SuperSlab*)`, set NULL before free, check for NULL

Race Condition 3: realloc() vs Lock-Free Readers (CRITICAL)
- **Problem**: `sp_meta_ensure_capacity()` used `realloc()` which MOVES the array
- **Impact**: Thread B reallocs `ss_metadata`, Thread A accesses OLD (freed) array
- **Fix**: **Removed realloc entirely** - use fixed-size array `ss_metadata[2048]`

Fixes Applied:

1. **core/hakmem_shared_pool.h** (Line 53, 125-126):
   - `SuperSlab* ss` → `_Atomic(SuperSlab*) ss`
   - `uint32_t ss_meta_count` → `_Atomic uint32_t ss_meta_count`
   - `SharedSSMeta* ss_metadata` → `SharedSSMeta ss_metadata[MAX_SS_METADATA_ENTRIES]`
   - Removed `ss_meta_capacity` (no longer needed)

2. **core/hakmem_shared_pool.c** (Lines 223-233, 248-287, 577, 631-635, 812-815, 872):
   - **sp_meta_ensure_capacity()**: Replaced realloc with capacity check
   - **sp_meta_find_or_create()**: atomic_load/store for count and ss pointer
   - **Stage 1 (line 577)**: atomic_load for meta->ss
   - **Stage 2 (line 631-635)**: atomic_load with NULL check + skip
   - **shared_pool_release_slab()**: atomic_store(NULL) BEFORE superslab_free()
   - All metadata searches: atomic_load for consistency

Memory Ordering:
- **Release** (line 285): `atomic_fetch_add(&ss_meta_count, 1, memory_order_release)`
  → Publishes all metadata[N] writes before count increment is visible
- **Acquire** (line 620, 631): `atomic_load(..., memory_order_acquire)`
  → Synchronizes-with release, ensures initialized metadata is seen
- **Release** (line 872): `atomic_store(&meta->ss, NULL, memory_order_release)`
  → Prevents Stage 2 from seeing dangling pointer

Test Results:
- **Before**: SEGV crash (1 thread, 2 threads, any iteration count)
- **After**: No crashes, stable execution
  - 1 thread: 266K ops/sec (stable, no SEGV)
  - 2 threads: 193K ops/sec (stable, no SEGV)
- Warning: `[SP_META_CAPACITY_ERROR] Exceeded MAX_SS_METADATA_ENTRIES=2048`
  → Non-fatal, indicates metadata recycling needed (future optimization)

Known Limitation:
- Fixed array size (2048) may be insufficient for extreme workloads
- Workaround: Increase MAX_SS_METADATA_ENTRIES if needed
- Proper solution: Implement metadata recycling when SuperSlabs are freed

Performance Note:
- Larson still slow (~200K ops/sec vs System 20M ops/sec, 100x slower)
- This is due to lock contention (separate issue, not race condition)
- Crash bug is FIXED, performance optimization is next step

Related Issues:
- Original report: Commit 93cc23450 claimed to fix 500K SEGV but crashes persisted
- This fix addresses the ROOT CAUSE, not just symptoms

🤖 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
2025-11-14 23:16:54 +09:00
..
box
Tiny: classify_ptr optimization via header-based fast path
2025-11-14 18:20:35 +09:00
front
Phase B: Set refill=64 as default (A/B optimized)
2025-11-14 19:35:56 +09:00
refill
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
superslab
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_ace_controller.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_ace_controller.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_metrics.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_metrics.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_stats.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_stats.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_ucb1.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_ucb1.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_ace.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_batch.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_batch.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_bigcache.c
feat: Phase 7 + Phase 2 - Massive performance & stability improvements
2025-11-08 17:08:00 +09:00
hakmem_bigcache.h
feat: Phase 7 + Phase 2 - Massive performance & stability improvements
2025-11-08 17:08:00 +09:00
hakmem_build_flags.h
Larson Fix: Increase batch refill from 64 to 128 blocks to reduce lock contention
2025-11-14 22:09:14 +09:00
hakmem_config.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_config.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_debug.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_debug.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_elo.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_elo.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_evo.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_evo.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_features.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_internal.h
Phase 9: SuperSlab Lazy Deallocation + mincore removal
2025-11-13 14:05:39 +09:00
hakmem_l25_pool.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_l25_pool.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learn_log.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learn_log.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learner.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learner.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_libc.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_mid_mt.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_mid_mt.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_p2.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_p2.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_phase7_config.h
Phase 7 Task 3: Pre-warm TLS cache (+180-280% improvement!)
2025-11-08 12:54:52 +09:00
hakmem_policy.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_policy.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_pool.c
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
hakmem_pool.c.refactored
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_pool.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_prof.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_prof.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_shared_pool.c
Fix: Larson multi-threaded crash - 3 critical race conditions in SharedSuperSlabPool
2025-11-14 23:16:54 +09:00
hakmem_shared_pool.h
Fix: Larson multi-threaded crash - 3 critical race conditions in SharedSuperSlabPool
2025-11-14 23:16:54 +09:00
hakmem_site_rules.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_site_rules.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_size_hist.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_size_hist.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_sizeclass_dist.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_sizeclass_dist.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_super_registry.c
CRITICAL DISCOVERY: Phase 9 LRU architecturally unreachable due to TLS SLL
2025-11-14 06:49:32 +09:00
hakmem_super_registry.h
Phase 11: SuperSlab Prewarm implementation (startup pre-allocation)
2025-11-13 14:45:43 +09:00
hakmem_sys.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_sys.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_syscall.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_syscall.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_alloc_new.inc
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_alloc_v3.inc
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_alloc.inc
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_assist.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_background.inc
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_batch_refill.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_bg_bin.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_bg_spill.c
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
hakmem_tiny_bg_spill.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_bump.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_tiny_config.c
Phase 10: TLS/SFC aggressive cache tuning (syscall reduction failed)
2025-11-13 14:25:54 +09:00
hakmem_tiny_config.h
Phase 10: TLS/SFC aggressive cache tuning (syscall reduction failed)
2025-11-13 14:25:54 +09:00
hakmem_tiny_drain_ema.inc.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_fastcache.inc.h
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_free.inc
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_hot_pop_v4.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_hot_pop.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_hotmag.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_init.inc
TLS SLL triage: add class mask gating (HAKMEM_TINY_SLL_C03_ONLY / HAKMEM_TINY_SLL_MASK), honor mask in inline POP/PUSH and tls_sll_box; SLL-off path stable. This gates SLL to C0..C3 for now to unblock shared SS triage.
2025-11-14 01:05:30 +09:00
hakmem_tiny_integrity.h
Phase 1-3: Performance optimization - 12.7x improvement (mimalloc strategy)
2025-11-12 13:57:46 +09:00
hakmem_tiny_intel.inc
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_lifecycle.inc
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
hakmem_tiny_magazine.c
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
hakmem_tiny_magazine.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_metadata.inc
Box TLS-SLL + free boundary hardening: normalize C0–C6 to base (ptr-1) at free boundary; route all caches/freelists via base; replace remaining g_tls_sll_head direct writes with Box API (tls_sll_push/splice) in refill/magazine/ultra; keep C7 excluded. Fixes rbp=0xa0 free crash by preventing header overwrite and centralizing TLS-SLL invariants.
2025-11-10 16:48:20 +09:00
hakmem_tiny_mini_mag.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_query_api.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_query.c
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_refill_p0_stub.c
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_refill_p0.inc.h
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_refill.inc.h
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_registry_api.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_registry.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_remote_target.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_remote_target.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_remote.inc
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_rss_api.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_rss.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_sfc.c
Remove debug overhead from release builds (19 hotspots)
2025-11-13 13:32:58 +09:00
hakmem_tiny_simple.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_simple.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_slab_mgmt.inc
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_slow.inc
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_smallmag.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_tiny_ss_target.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_ss_target.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_stats_api.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_tiny_stats.c
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_stats.h
Box TLS-SLL: fix splice head normalization and remove false misalignment guard; add header-aware linear link instrumentation; log splice details in debug.\n\n- Normalize head before publishing to TLS SLL (avoid user-ptr head)\n- Remove size-mod alignment guard (stride!=size); keep small-ptr fail-fast only\n- Drop heuristic base normalization to avoid corrupting base\n- Add [LINEAR_LINK]/[SPLICE_LINK]/[SPLICE_SET_HEAD] debug logs (debug-only)\n- Verified debug build on bench_fixed_size_hakmem with visible carve/splice traces
2025-11-11 00:02:24 +09:00
hakmem_tiny_superslab_constants.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_superslab.c
CRITICAL DISCOVERY: Phase 9 LRU architecturally unreachable due to TLS SLL
2025-11-14 06:49:32 +09:00
hakmem_tiny_superslab.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_tls_list.h
Add sentinel detection guards (defense-in-depth)
2025-11-13 05:43:31 +09:00
hakmem_tiny_tls_ops.h
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
hakmem_tiny_ultra_front.inc.h
Box TLS-SLL + free boundary hardening: normalize C0–C6 to base (ptr-1) at free boundary; route all caches/freelists via base; replace remaining g_tls_sll_head direct writes with Box API (tls_sll_push/splice) in refill/magazine/ultra; keep C7 excluded. Fixes rbp=0xa0 free crash by preventing header overwrite and centralizing TLS-SLL invariants.
2025-11-10 16:48:20 +09:00
hakmem_tiny_ultra_simple.inc
Phase E1-CORRECT: Fix USER/BASE pointer conversion bugs in slab_index_for calls
2025-11-13 05:21:36 +09:00
hakmem_tiny.c
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny.d
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_trace.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ucb1.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_whale.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_whale.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
link_stubs.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
link_stubs.d
Phase 7: header-aware TLS front caches and FG gating
2025-11-10 18:04:08 +09:00
mid_tcache.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
pool_refill.c
Tiny: fix remote sentinel leak → SEGV; add defense-in-depth; PoolTLS: refill-boundary remote drain; build UX help; quickstart docs
2025-11-09 16:49:34 +09:00
pool_refill.h
feat: Pool TLS Phase 1 - Lock-free TLS freelist (173x improvement, 2.3x vs System)
2025-11-08 23:53:25 +09:00
pool_tls_arena.c
Phase 12 SP-SLOT + Mid-Large P0 fix: Pool TLS debug logging & analysis
2025-11-14 14:18:56 +09:00
pool_tls_arena.d
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls_arena.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls_bind.c
Pool TLS: BIND_BOX simplification - TID cache only (SEGV fixed)
2025-11-14 15:00:13 +09:00
pool_tls_bind.h
Pool TLS: BIND_BOX simplification - TID cache only (SEGV fixed)
2025-11-14 15:00:13 +09:00
pool_tls_registry.c
Pool TLS: Lock-free MPSC remote queue implementation
2025-11-14 14:29:05 +09:00
pool_tls_registry.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls_remote.c
Pool TLS: Lock-free MPSC remote queue implementation
2025-11-14 14:29:05 +09:00
pool_tls_remote.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls.c
P0 Lock Contention Analysis: Instrumentation + comprehensive report
2025-11-14 15:32:07 +09:00
pool_tls.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
ptr_trace.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
ptr_track.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
slab_handle.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_adaptive_sizing.c
Phase 10: TLS/SFC aggressive cache tuning (syscall reduction failed)
2025-11-13 14:25:54 +09:00
tiny_adaptive_sizing.h
Phase 10: TLS/SFC aggressive cache tuning (syscall reduction failed)
2025-11-13 14:25:54 +09:00
tiny_alloc_fast_inline.h
TLS SLL triage: add class mask gating (HAKMEM_TINY_SLL_C03_ONLY / HAKMEM_TINY_SLL_MASK), honor mask in inline POP/PUSH and tls_sll_box; SLL-off path stable. This gates SLL to C0..C3 for now to unblock shared SS triage.
2025-11-14 01:05:30 +09:00
tiny_alloc_fast_sfc.inc.h
Remove debug overhead from release builds (19 hotspots)
2025-11-13 13:32:58 +09:00
tiny_alloc_fast.inc.h
Phase B: TinyFrontC23Box - Ultra-simple front path for C2/C3
2025-11-14 19:27:45 +09:00
tiny_api.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
tiny_atomic.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_box_geometry.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_debug_ring.c
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
tiny_debug_ring.h
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
tiny_debug.h
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
tiny_failfast.c
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_failfast.d
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_fastcache.c
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_fastcache.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_fc_api.h
Tiny: Enable P0→FC direct path for class7 (1KB) by default + docs
2025-11-09 23:15:02 +09:00
tiny_free_fast_v2.inc.h
Option B: Periodic TLS SLL Drain - Fix Phase 9 LRU Architecture Issue
2025-11-14 07:09:18 +09:00
tiny_free_fast.inc.h
Docs: update CURRENT_TASK with SLL triage status (C5 hotpath root-cause scope), shared SS A/B status, and next steps.
2025-11-14 01:34:59 +09:00
tiny_free_magazine.inc.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_mmap_gate.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_nextptr.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_publish.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_publish.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_ready_bg.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_ready.h
Phase 6-2.4: Fix SuperSlab free SEGV: remove guess loop and add memory readability check; add registry atomic consistency (base as _Atomic uintptr_t with acq/rel); add debug toggles (SUPER_REG_DEBUG/REQTRACE); update CURRENT_TASK with results and next steps; capture suite results.
2025-11-07 18:07:48 +09:00
tiny_refill_opt.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_refill.h
Phase 6-2.4: Fix SuperSlab free SEGV: remove guess loop and add memory readability check; add registry atomic consistency (base as _Atomic uintptr_t with acq/rel); add debug toggles (SUPER_REG_DEBUG/REQTRACE); update CURRENT_TASK with results and next steps; capture suite results.
2025-11-07 18:07:48 +09:00
tiny_region_id.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_remote_bg.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_remote.c
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
tiny_remote.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_route.h
Infrastructure and build updates
2025-11-11 21:49:05 +09:00
tiny_sticky.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_sticky.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_superslab_alloc.inc.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_superslab_free.inc.h
CRITICAL DISCOVERY: Phase 9 LRU architecturally unreachable due to TLS SLL
2025-11-14 06:49:32 +09:00
tiny_system.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
tiny_tls_guard.h
Phase 6-2.6: Fix slab_data_start() consistency in refill/validation paths
2025-11-07 22:34:24 +09:00
tiny_tls.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00