tomoaki/hakmem
1
0
Fork 0
Code Issues Pull Requests Actions Packages Projects Releases Wiki Activity
Files
6baf63a1fbe99a4e050ca64b2e53b67ff6909398
hakmem/core
History
Moe Charm (CI) 6afaa5703a Phase 12-1.1: EMPTY Slab Detection + Immediate Reuse (+13% improvement, 10.2M→11.5M ops/s) 
Implementation of Task-sensei Priority 1 recommendation: Add empty_mask to SuperSlab
for immediate EMPTY slab detection and reuse, reducing Stage 3 (mmap) overhead.

## Changes

### 1. SuperSlab Structure (core/superslab/superslab_types.h)
- Added `empty_mask` (uint32_t): Bitmap for EMPTY slabs (used==0)
- Added `empty_count` (uint8_t): Quick check for EMPTY slab availability

### 2. EMPTY Detection API (core/box/ss_hot_cold_box.h)
- Added `ss_is_slab_empty()`: Returns true if slab is completely EMPTY
- Added `ss_mark_slab_empty()`: Marks slab as EMPTY (highest reuse priority)
- Added `ss_clear_slab_empty()`: Removes EMPTY state when reactivated
- Updated `ss_update_hot_cold_indices()`: Classify EMPTY/Hot/Cold slabs
- Updated `ss_init_hot_cold()`: Initialize empty_mask/empty_count

### 3. Free Path Integration (core/box/free_local_box.c)
- After `meta->used--`, check if `meta->used == 0`
- If true, call `ss_mark_slab_empty()` to update empty_mask
- Enables immediate EMPTY detection on every free operation

### 4. Shared Pool Stage 0.5 (core/hakmem_shared_pool.c)
- New Stage 0.5 before Stage 1: Scan existing SuperSlabs for EMPTY slabs
- Iterate over `g_super_reg_by_class[class_idx][]` (first 16 entries)
- Check `ss->empty_count > 0` → scan `empty_mask` with `__builtin_ctz()`
- Reuse EMPTY slab directly, avoiding Stage 3 (mmap/lock overhead)
- ENV control: `HAKMEM_SS_EMPTY_REUSE=1` (default OFF for A/B testing)
- ENV tunable: `HAKMEM_SS_EMPTY_SCAN_LIMIT=N` (default 16 SuperSlabs)

## Performance Results

```
Benchmark: Random Mixed 256B (100K iterations)

OFF (default):  10.2M ops/s (baseline)
ON  (ENV=1):    11.5M ops/s (+13.0% improvement) ✅
```

## Expected Impact (from Task-sensei analysis)

**Current bottleneck**:
- Stage 1: 2-5% hit rate (free list broken)
- Stage 2: 3-8% hit rate (rare UNUSED)
- Stage 3: 87-95% hit rate (lock + mmap overhead) ← bottleneck

**Expected with Phase 12-1.1**:
- Stage 0.5: 20-40% hit rate (EMPTY scan)
- Stage 1-2: 20-30% hit rate (combined)
- Stage 3: 30-50% hit rate (significantly reduced)

**Theoretical max**: 25M → 55-70M ops/s (+120-180%)

## Current Gap Analysis

**Observed**: 11.5M ops/s (+13%)
**Expected**: 55-70M ops/s (+120-180%)
**Gap**: Performance regression or missing complementary optimizations

Possible causes:
1. Phase 3d-C (25.1M→10.2M) regression - unrelated to this change
2. EMPTY scan overhead (16 SuperSlabs × empty_count check)
3. Missing Priority 2-5 optimizations (Lazy SS deallocation, etc.)
4. Stage 0.5 too conservative (scan_limit=16, should be higher?)

## Usage

```bash
# Enable EMPTY reuse optimization
export HAKMEM_SS_EMPTY_REUSE=1

# Optional: increase scan limit (trade-off: throughput vs latency)
export HAKMEM_SS_EMPTY_SCAN_LIMIT=32

./bench_random_mixed_hakmem 100000 256 42
```

## Next Steps

**Priority 1-A**: Investigate Phase 3d-C→12-1.1 regression (25.1M→10.2M)
**Priority 1-B**: Implement Phase 12-1.2 (Lazy SS deallocation) for complementary effect
**Priority 1-C**: Profile Stage 0.5 overhead (scan_limit tuning)

## Files Modified

Core implementation:
- `core/superslab/superslab_types.h` - empty_mask/empty_count fields
- `core/box/ss_hot_cold_box.h` - EMPTY detection/marking API
- `core/box/free_local_box.c` - Free path EMPTY detection
- `core/hakmem_shared_pool.c` - Stage 0.5 EMPTY scan

Documentation:
- `CURRENT_TASK.md` - Task-sensei investigation report

---

🎯 Generated with [Claude Code](https://claude.com/claude-code)

Co-Authored-By: Claude <noreply@anthropic.com>
Co-Authored-By: Task-sensei (investigation & design analysis)
2025-11-21 04:56:48 +09:00
..
box
Phase 12-1.1: EMPTY Slab Detection + Immediate Reuse (+13% improvement, 10.2M→11.5M ops/s)
2025-11-21 04:56:48 +09:00
front
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
refill
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
superslab
Phase 12-1.1: EMPTY Slab Detection + Immediate Reuse (+13% improvement, 10.2M→11.5M ops/s)
2025-11-21 04:56:48 +09:00
ultra
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_ace_controller.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_ace_controller.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_metrics.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_metrics.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_stats.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_stats.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_ucb1.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace_ucb1.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ace.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_ace.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_batch.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_batch.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_bigcache.c
feat: Phase 7 + Phase 2 - Massive performance & stability improvements
2025-11-08 17:08:00 +09:00
hakmem_bigcache.h
feat: Phase 7 + Phase 2 - Massive performance & stability improvements
2025-11-08 17:08:00 +09:00
hakmem_build_flags.h
Larson Fix: Increase batch refill from 64 to 128 blocks to reduce lock contention
2025-11-14 22:09:14 +09:00
hakmem_config.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_config.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_debug.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_debug.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_elo.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_elo.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_evo.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_evo.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_features.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_internal.h
Phase 9: SuperSlab Lazy Deallocation + mincore removal
2025-11-13 14:05:39 +09:00
hakmem_l25_pool.c
Phase 24 PageArena/HotSpanBox: Mid/VM page reuse cache (structural limit identified)
2025-11-17 03:22:27 +09:00
hakmem_l25_pool.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learn_log.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learn_log.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learner.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_learner.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_libc.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_mid_mt.c
Phase 16: Dynamic Tiny/Mid Boundary with A/B Testing (ENV-controlled)
2025-11-16 01:26:48 +09:00
hakmem_mid_mt.h
Phase 16: Dynamic Tiny/Mid Boundary with A/B Testing (ENV-controlled)
2025-11-16 01:26:48 +09:00
hakmem_p2.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_p2.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_phase7_config.h
Phase 7 Task 3: Pre-warm TLS cache (+180-280% improvement!)
2025-11-08 12:54:52 +09:00
hakmem_policy.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_policy.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_pool.c
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
hakmem_pool.c.refactored
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_pool.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_prof.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_prof.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_shared_pool.c
Phase 12-1.1: EMPTY Slab Detection + Immediate Reuse (+13% improvement, 10.2M→11.5M ops/s)
2025-11-21 04:56:48 +09:00
hakmem_shared_pool.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_site_rules.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
hakmem_site_rules.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_size_hist.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_size_hist.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_sizeclass_dist.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_sizeclass_dist.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_smallmid_superslab.c
Phase 17-2: Small-Mid Dedicated SuperSlab Backend (実験結果: 70% page fault, 性能改善なし)
2025-11-16 03:21:13 +09:00
hakmem_smallmid_superslab.h
Phase 17-2: Small-Mid Dedicated SuperSlab Backend (実験結果: 70% page fault, 性能改善なし)
2025-11-16 03:21:13 +09:00
hakmem_smallmid.c
Phase 17-2: Small-Mid Dedicated SuperSlab Backend (実験結果: 70% page fault, 性能改善なし)
2025-11-16 03:21:13 +09:00
hakmem_smallmid.h
Phase 17-1 Revision: Small-Mid Front Box Only (ChatGPT Strategy)
2025-11-16 01:51:43 +09:00
hakmem_super_registry.c
Phase 15 Box Separation: Fix wrapper domain check to prevent BenchMeta→CoreAlloc violation
2025-11-16 00:38:29 +09:00
hakmem_super_registry.h
Phase 15 Box Separation: Fix wrapper domain check to prevent BenchMeta→CoreAlloc violation
2025-11-16 00:38:29 +09:00
hakmem_sys.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_sys.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_syscall.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_syscall.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_ace_guard_box.inc
Refactor: Extract 5 Box modules from hakmem_tiny.c (-52% size reduction)
2025-11-21 01:16:45 +09:00
hakmem_tiny_alloc_new.inc
Phase 13-A Step 1: TinyHeapV2 NO-REFILL L0 cache implementation
2025-11-15 01:42:57 +09:00
hakmem_tiny_alloc_v3.inc
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_alloc.inc
Phase 13-A Step 1: TinyHeapV2 NO-REFILL L0 cache implementation
2025-11-15 01:42:57 +09:00
hakmem_tiny_assist.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_background.inc
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_batch_refill.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_bg_bin.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_bg_spill.c
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
hakmem_tiny_bg_spill.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_bump.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_tiny_config_box.inc
Refactor: Extract 5 Box modules from hakmem_tiny.c (-52% size reduction)
2025-11-21 01:16:45 +09:00
hakmem_tiny_config.c
Phase 10: TLS/SFC aggressive cache tuning (syscall reduction failed)
2025-11-13 14:25:54 +09:00
hakmem_tiny_config.h
Phase 10: TLS/SFC aggressive cache tuning (syscall reduction failed)
2025-11-13 14:25:54 +09:00
hakmem_tiny_drain_ema.inc.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_eventq_box.inc
Refactor: Extract 4 safe Box modules from hakmem_tiny.c (-73% total reduction)
2025-11-21 03:20:42 +09:00
hakmem_tiny_fastcache.inc.h
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_free.inc
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_globals_box.inc
Refactor: Extract 5 Box modules from hakmem_tiny.c (-52% size reduction)
2025-11-21 01:16:45 +09:00
hakmem_tiny_hot_pop_v4.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_hot_pop.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_hotmag.inc.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
hakmem_tiny_init.inc
TLS SLL triage: add class mask gating (HAKMEM_TINY_SLL_C03_ONLY / HAKMEM_TINY_SLL_MASK), honor mask in inline POP/PUSH and tls_sll_box; SLL-off path stable. This gates SLL to C0..C3 for now to unblock shared SS triage.
2025-11-14 01:05:30 +09:00
hakmem_tiny_integrity.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_intel.inc
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_lazy_init.inc.h
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
hakmem_tiny_legacy_slow_box.inc
Refactor: Extract 3 more Box modules from hakmem_tiny.c (-70% total reduction)
2025-11-21 01:23:59 +09:00
hakmem_tiny_lifecycle.d
Phase 12-1.1: EMPTY Slab Detection + Immediate Reuse (+13% improvement, 10.2M→11.5M ops/s)
2025-11-21 04:56:48 +09:00
hakmem_tiny_lifecycle.inc
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_magazine.c
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
hakmem_tiny_magazine.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_metadata.inc
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_mini_mag.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_phase6_wrappers_box.inc
Refactor: Extract 5 Box modules from hakmem_tiny.c (-52% size reduction)
2025-11-21 01:16:45 +09:00
hakmem_tiny_publish_box.inc
Refactor: Extract 5 Box modules from hakmem_tiny.c (-52% size reduction)
2025-11-21 01:16:45 +09:00
hakmem_tiny_query_api.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_query.c
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_refill_p0_stub.c
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
hakmem_tiny_refill_p0.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_refill.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_registry_api.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_registry.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_remote_target.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_remote_target.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_remote.inc
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_rss_api.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_rss.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_sfc.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_simple.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_simple.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_slab_lookup_box.inc
Refactor: Extract 3 more Box modules from hakmem_tiny.c (-70% total reduction)
2025-11-21 01:23:59 +09:00
hakmem_tiny_slab_mgmt.inc
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_sll_cap_box.inc
Refactor: Extract 4 safe Box modules from hakmem_tiny.c (-73% total reduction)
2025-11-21 03:20:42 +09:00
hakmem_tiny_slow.inc
Fix workset=128 infinite recursion bug (Shared Pool realloc → mmap)
2025-11-15 14:35:44 +09:00
hakmem_tiny_smallmag.inc.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_tiny_ss_active_box.inc
Refactor: Extract 4 safe Box modules from hakmem_tiny.c (-73% total reduction)
2025-11-21 03:20:42 +09:00
hakmem_tiny_ss_target.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_ss_target.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_tiny_stats_api.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
hakmem_tiny_stats.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_stats.h
Box TLS-SLL: fix splice head normalization and remove false misalignment guard; add header-aware linear link instrumentation; log splice details in debug.\n\n- Normalize head before publishing to TLS SLL (avoid user-ptr head)\n- Remove size-mod alignment guard (stride!=size); keep small-ptr fail-fast only\n- Drop heuristic base normalization to avoid corrupting base\n- Add [LINEAR_LINK]/[SPLICE_LINK]/[SPLICE_SET_HEAD] debug logs (debug-only)\n- Verified debug build on bench_fixed_size_hakmem with visible carve/splice traces
2025-11-11 00:02:24 +09:00
hakmem_tiny_superslab_constants.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_superslab.c
Phase 3d-C: Hot/Cold Slab Split - SuperSlab cache locality optimization (baseline established)
2025-11-20 07:44:07 +09:00
hakmem_tiny_superslab.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
hakmem_tiny_tls_list.h
Add sentinel detection guards (defense-in-depth)
2025-11-13 05:43:31 +09:00
hakmem_tiny_tls_ops.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_tls_state_box.inc
Refactor: Extract 3 more Box modules from hakmem_tiny.c (-70% total reduction)
2025-11-21 01:23:59 +09:00
hakmem_tiny_ultra_batch_box.inc
Refactor: Extract 4 safe Box modules from hakmem_tiny.c (-73% total reduction)
2025-11-21 03:20:42 +09:00
hakmem_tiny_ultra_front.inc.h
Box TLS-SLL + free boundary hardening: normalize C0–C6 to base (ptr-1) at free boundary; route all caches/freelists via base; replace remaining g_tls_sll_head direct writes with Box API (tls_sll_push/splice) in refill/magazine/ultra; keep C7 excluded. Fixes rbp=0xa0 free crash by preventing header overwrite and centralizing TLS-SLL invariants.
2025-11-10 16:48:20 +09:00
hakmem_tiny_ultra_simple.inc
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_unified_stats.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_unified_stats.d
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny_unified_stats.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_tiny.c
Refactor: Extract 4 safe Box modules from hakmem_tiny.c (-73% total reduction)
2025-11-21 03:20:42 +09:00
hakmem_tiny.d
Phase 12-1.1: EMPTY Slab Detection + Immediate Reuse (+13% improvement, 10.2M→11.5M ops/s)
2025-11-21 04:56:48 +09:00
hakmem_tiny.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
hakmem_trace.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_ucb1.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_whale.c
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem_whale.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
hakmem.c
Phase 21-1-B: Ring cache Alloc/Free 統合 - C2/C3 hot path integration
2025-11-16 07:51:37 +09:00
hakmem.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
link_stubs.c
release: silence runtime logs and stabilize benches
2025-11-11 01:47:06 +09:00
link_stubs.d
Phase 7: header-aware TLS front caches and FG gating
2025-11-10 18:04:08 +09:00
mid_tcache.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
page_arena.c
Phase 24 PageArena/HotSpanBox: Mid/VM page reuse cache (structural limit identified)
2025-11-17 03:22:27 +09:00
page_arena.d
Phase 24 PageArena/HotSpanBox: Mid/VM page reuse cache (structural limit identified)
2025-11-17 03:22:27 +09:00
page_arena.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
pool_refill.c
Tiny: fix remote sentinel leak → SEGV; add defense-in-depth; PoolTLS: refill-boundary remote drain; build UX help; quickstart docs
2025-11-09 16:49:34 +09:00
pool_refill.h
feat: Pool TLS Phase 1 - Lock-free TLS freelist (173x improvement, 2.3x vs System)
2025-11-08 23:53:25 +09:00
pool_tls_arena.c
Phase 24 PageArena/HotSpanBox: Mid/VM page reuse cache (structural limit identified)
2025-11-17 03:22:27 +09:00
pool_tls_arena.d
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls_arena.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls_bind.c
Pool TLS: BIND_BOX simplification - TID cache only (SEGV fixed)
2025-11-14 15:00:13 +09:00
pool_tls_bind.h
Pool TLS: BIND_BOX simplification - TID cache only (SEGV fixed)
2025-11-14 15:00:13 +09:00
pool_tls_registry.c
Pool TLS: Lock-free MPSC remote queue implementation
2025-11-14 14:29:05 +09:00
pool_tls_registry.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls_remote.c
Pool TLS: Lock-free MPSC remote queue implementation
2025-11-14 14:29:05 +09:00
pool_tls_remote.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
pool_tls.c
P0 Lock Contention Analysis: Instrumentation + comprehensive report
2025-11-14 15:32:07 +09:00
pool_tls.h
Tiny: fix header/stride mismatch and harden refill paths
2025-11-09 18:55:50 +09:00
ptr_trace.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
ptr_track.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
slab_handle.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_adaptive_sizing.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_adaptive_sizing.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_alloc_fast_inline.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_alloc_fast_push.c
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
tiny_alloc_fast_push.d
Phase 23 Unified Cache + PageFaultTelemetry generalization: Mid/VM page-fault bottleneck identified
2025-11-17 02:47:58 +09:00
tiny_alloc_fast_sfc.inc.h
Remove debug overhead from release builds (19 hotspots)
2025-11-13 13:32:58 +09:00
tiny_alloc_fast.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_api.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
tiny_atomic.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_box_geometry.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_debug_ring.c
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
tiny_debug_ring.h
Front-Direct implementation: SS→FC direct refill + SLL complete bypass
2025-11-14 05:41:49 +09:00
tiny_debug.h
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
tiny_failfast.c
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_failfast.d
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_fastcache.c
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_fastcache.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_fc_api.h
Tiny: Enable P0→FC direct path for class7 (1KB) by default + docs
2025-11-09 23:15:02 +09:00
tiny_free_fast_v2.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_free_fast.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_free_magazine.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_mmap_gate.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_nextptr.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_publish.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_publish.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_ready_bg.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_ready.h
Phase 6-2.4: Fix SuperSlab free SEGV: remove guess loop and add memory readability check; add registry atomic consistency (base as _Atomic uintptr_t with acq/rel); add debug toggles (SUPER_REG_DEBUG/REQTRACE); update CURRENT_TASK with results and next steps; capture suite results.
2025-11-07 18:07:48 +09:00
tiny_refill_opt.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00
tiny_refill.h
Phase 6-2.4: Fix SuperSlab free SEGV: remove guess loop and add memory readability check; add registry atomic consistency (base as _Atomic uintptr_t with acq/rel); add debug toggles (SUPER_REG_DEBUG/REQTRACE); update CURRENT_TASK with results and next steps; capture suite results.
2025-11-07 18:07:48 +09:00
tiny_region_id.h
Phase E3-FINAL: Fix Box API offset bugs - ALL classes now use correct offsets
2025-11-13 06:50:20 +09:00
tiny_remote_bg.h
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_remote.c
Phase 12: Shared SuperSlab Pool implementation (WIP - runtime crash)
2025-11-13 16:33:03 +09:00
tiny_remote.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_route.h
Infrastructure and build updates
2025-11-11 21:49:05 +09:00
tiny_sticky.c
CRITICAL FIX: TLS 未初期化による 4T SEGV を完全解消
2025-11-07 01:27:04 +09:00
tiny_sticky.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_superslab_alloc.inc.h
Phase12 debug: restore SUPERSLAB constants/APIs, implement Box2 drain boundary, fix tiny_fast_pop to return BASE, honor TLS SLL toggle in alloc/free fast paths, add fail-fast stubs, and quiet capacity sentinel. Update CURRENT_TASK with A/B results (SLL-off stable; SLL-on crash).
2025-11-14 01:02:00 +09:00
tiny_superslab_free.inc.h
CRITICAL DISCOVERY: Phase 9 LRU architecturally unreachable due to TLS SLL
2025-11-14 06:49:32 +09:00
tiny_system.h
Phase 1: Box Theory refactoring + include reduction
2025-11-06 21:54:12 +09:00
tiny_tls_guard.h
Phase 6-2.6: Fix slab_data_start() consistency in refill/validation paths
2025-11-07 22:34:24 +09:00
tiny_tls.h
Debug Counters Implementation - Clean History
2025-11-05 12:31:14 +09:00
tiny_ultra_fast.inc.h
Phase 3d-B: TLS Cache Merge - Unified g_tls_sll[] structure (+12-18% expected)
2025-11-20 07:32:30 +09:00