ef8e2ab9b5
Phase 59b: Speed-first Mode Baseline Rebase - Rebase on MIXED_TINYV3_C7_SAFE profile (Speed-first, no prewarm suppression) - hakmem: 58.478 M ops/s (CV 2.52%) - mimalloc: 120.979 M ops/s (CV 0.90%) - Ratio: 48.34% of mimalloc (down from 49.13% Balanced mode in Phase 59) - Reason for difference: Profile selection (Speed-first vs Balanced) and mimalloc environment variance - Status: COMPLETE (measurement-only, zero code changes) Phase 61: C7 ULTRA Header-Light Optimization Attempt - Objective: Skip header write on C7 ULTRA alloc hit (write only on refill) - Implementation: ENV gate HAKMEM_TINY_C7_ULTRA_HEADER_LIGHT (default OFF) - Result: +0.31% (NEUTRAL, below +1.0% GO threshold) - Baseline: 59.543 M ops/s (CV 1.53%) - Treatment: 59.729 M ops/s (CV 2.66%) - Root cause analysis: - tiny_region_id_write_header only 2.32% of time (lower than Phase 42 estimate 4.56%) - Header-light mode adds branch to hot path, negating write savings - Mixed workload dilutes C7-specific optimization effectiveness - Variance increased due to branch prediction variability - Decision: Kept as research box with ENV gate (default OFF) - Lesson: Workload-specific optimizations need careful verification with full workloads Updated Documentation: - PHASE59B_SPEED_FIRST_REBASE_RESULTS.md: Full measurement results and analysis - PHASE61_C7_ULTRA_HEADER_LIGHT_RESULTS.md: A/B test results and root cause analysis - PHASE61_C7_ULTRA_HEADER_LIGHT_IMPLEMENTATION.md: Implementation details and design - CURRENT_TASK.md: Updated status and next phase planning (Phase 62) - PERFORMANCE_TARGETS_SCORECARD.md: Updated baseline and M1 milestone status M1 (50%) Milestone Status: - Current: 48.34% (Speed-first profile) - Gap: -1.66% (within measurement noise) - Profile recommendation: Speed-first as canonical default for throughput focus 🤖 Generated with Claude Code Co-Authored-By: Claude Haiku 4.5 <noreply@anthropic.com>
47 lines
1.9 KiB
Bash
Executable File
47 lines
1.9 KiB
Bash
Executable File
#!/usr/bin/env bash
|
|
set -euo pipefail
|
|
|
|
# 10-run Mixed benchmark with explicit clean ENV for frozen/research knobs.
|
|
# Purpose: avoid "bench_setenv_default() does not override exported ENV" drift.
|
|
|
|
profile=${HAKMEM_PROFILE:-MIXED_TINYV3_C7_SAFE}
|
|
iters=${ITERS:-20000000}
|
|
ws=${WS:-400}
|
|
runs=${RUNS:-10}
|
|
bin=${BENCH_BIN:-./bench_random_mixed_hakmem}
|
|
|
|
# Keep profiles reproducible even if user exported env vars.
|
|
case "${profile}" in
|
|
MIXED_TINYV3_C7_BALANCED)
|
|
export HAKMEM_SS_MEM_LEAN=1
|
|
export HAKMEM_SS_MEM_LEAN_DECOMMIT=OFF
|
|
export HAKMEM_SS_MEM_LEAN_TARGET_MB=10
|
|
;;
|
|
*)
|
|
export HAKMEM_SS_MEM_LEAN=0
|
|
export HAKMEM_SS_MEM_LEAN_DECOMMIT=OFF
|
|
export HAKMEM_SS_MEM_LEAN_TARGET_MB=10
|
|
;;
|
|
esac
|
|
|
|
# Force known research knobs OFF to avoid accidental carry-over.
|
|
export HAKMEM_TINY_HEADER_WRITE_ONCE=${HAKMEM_TINY_HEADER_WRITE_ONCE:-0}
|
|
export HAKMEM_TINY_C7_PRESERVE_HEADER=${HAKMEM_TINY_C7_PRESERVE_HEADER:-0}
|
|
export HAKMEM_TINY_TCACHE=${HAKMEM_TINY_TCACHE:-0}
|
|
export HAKMEM_TINY_TCACHE_CAP=${HAKMEM_TINY_TCACHE_CAP:-64}
|
|
export HAKMEM_MALLOC_TINY_DIRECT=${HAKMEM_MALLOC_TINY_DIRECT:-0}
|
|
export HAKMEM_FRONT_FASTLANE_ALLOC_LEGACY_DIRECT=${HAKMEM_FRONT_FASTLANE_ALLOC_LEGACY_DIRECT:-0}
|
|
export HAKMEM_FORCE_LIBC_ALLOC=${HAKMEM_FORCE_LIBC_ALLOC:-0}
|
|
export HAKMEM_ENV_SNAPSHOT_SHAPE=${HAKMEM_ENV_SNAPSHOT_SHAPE:-0}
|
|
export HAKMEM_TINY_C7_ULTRA_HEADER_LIGHT=${HAKMEM_TINY_C7_ULTRA_HEADER_LIGHT:-0}
|
|
# NOTE: Phase 19-1b is promoted in presets. Keep cleanenv aligned by default.
|
|
export HAKMEM_FASTLANE_DIRECT=${HAKMEM_FASTLANE_DIRECT:-1}
|
|
# NOTE: Phase 9/10 are promoted (bench_profile defaults to 1). Keep cleanenv aligned by default.
|
|
export HAKMEM_FREE_TINY_FAST_MONO_DUALHOT=${HAKMEM_FREE_TINY_FAST_MONO_DUALHOT:-1}
|
|
export HAKMEM_FREE_TINY_FAST_MONO_LEGACY_DIRECT=${HAKMEM_FREE_TINY_FAST_MONO_LEGACY_DIRECT:-1}
|
|
|
|
for i in $(seq 1 "${runs}"); do
|
|
echo "=== Run ${i}/${runs} ==="
|
|
HAKMEM_PROFILE="${profile}" "${bin}" "${iters}" "${ws}" 1 2>&1 | rg "Throughput" || true
|
|
done
|