Files
hakmem/core/box/tiny_env_box.h

59 lines
3.1 KiB
C
Raw Normal View History

feat(Phase 1-1): Complete getenv elimination from malloc/free hot paths (+39-42% perf) ## Summary Eliminated all getenv() calls from malloc/free wrappers and allocator hot paths by implementing constructor-based environment variable caching. This achieves 39-42% performance improvement (36s → 22s on sh8bench single-thread). ## Performance Impact - sh8bench 1 thread: 35-36s → 21-22s (+39-42% improvement) 🚀 - sh8bench 8 threads: ~15s (maintained) - getenv overhead: 36.32% → 0% (completely eliminated) ## Changes ### New Files - **core/box/tiny_env_box.{c,h}**: Centralized environment variable cache for Tiny allocator - Caches 43 environment variables (HAKMEM_TINY_*, HAKMEM_SLL_*, HAKMEM_SS_*, etc.) - Constructor-based initialization with atomic CAS for thread safety - Inline accessor tiny_env_cfg() for hot path access - **core/box/wrapper_env_box.{c,h}**: Environment cache for malloc/free wrappers - Caches 3 wrapper variables (HAKMEM_STEP_TRACE, HAKMEM_LD_SAFE, HAKMEM_FREE_WRAP_TRACE) - Constructor priority 101 ensures early initialization - Replaces all lazy-init patterns in wrapper code ### Modified Files - **Makefile**: Added tiny_env_box.o and wrapper_env_box.o to OBJS_BASE and SHARED_OBJS - **core/box/hak_wrappers.inc.h**: - Removed static lazy-init variables (g_step_trace, ld_safe_mode cache) - Replaced with wrapper_env_cfg() lookups (wcfg->step_trace, wcfg->ld_safe_mode) - All getenv() calls eliminated from malloc/free hot paths - **core/hakmem.c**: - Added hak_ld_env_init() with constructor for LD_PRELOAD caching - Added hak_force_libc_ctor() for HAKMEM_FORCE_LIBC_ALLOC* caching - Simplified hak_ld_env_mode() to return cached value only - Simplified hak_force_libc_alloc() to use cached values - Eliminated all getenv/atoi calls from hot paths ## Technical Details ### Constructor Initialization Pattern All environment variables are now read once at library load time using __attribute__((constructor)): ```c __attribute__((constructor(101))) static void wrapper_env_ctor(void) { wrapper_env_init_once(); // Atomic CAS ensures exactly-once init } ``` ### Thread Safety - Atomic compare-and-swap (CAS) ensures single initialization - Spin-wait for initialization completion in multi-threaded scenarios - Memory barriers (memory_order_acq_rel) ensure visibility ### Hot Path Impact Before: Every malloc/free → getenv("LD_PRELOAD") + getenv("HAKMEM_STEP_TRACE") + ... After: Every malloc/free → Single pointer dereference (wcfg->field) ## Next Optimization Target (Phase 1-2) Perf analysis reveals libc fallback accounts for ~51% of cycles: - _int_malloc: 15.04% - malloc: 9.81% - _int_free: 10.07% - malloc_consolidate: 9.27% - unlink_chunk: 6.82% Reducing libc fallback from 51% → 10% could yield additional +25-30% improvement. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> Co-Authored-By: ChatGPT <chatgpt@openai.com>
2025-12-02 16:16:51 +09:00
// tiny_env_box.h - Centralized Tiny env cache (hot-path safe)
#pragma once
#include <stdatomic.h>
typedef struct {
int inited;
int tiny_tls_sll; // HAKMEM_TINY_TLS_SLL (default: 1)
int sll_multiplier; // HAKMEM_SLL_MULTIPLIER (default: 2)
int tiny_no_front_cache; // HAKMEM_TINY_NO_FRONT_CACHE (default: 0)
int tiny_no_quick; // HAKMEM_TINY_NO_QUICK (default: 0)
int tiny_prefetch; // HAKMEM_TINY_PREFETCH (default: 0)
int front_direct; // HAKMEM_TINY_FRONT_DIRECT (default: 0)
int use_class_map; // !HAKMEM_TINY_NO_CLASS_MAP (default: 1)
int route_enable; // HAKMEM_ROUTE (default: 0)
int route_sample_lg; // HAKMEM_ROUTE_SAMPLE_LG (default: 10 -> 1/1024)
int larson_fix; // HAKMEM_TINY_LARSON_FIX (default: 0)
int active_track; // HAKMEM_TINY_ACTIVE_TRACK (default: 0)
int drain_to_sll; // HAKMEM_TINY_DRAIN_TO_SLL (default: 0)
int free_to_ss; // HAKMEM_TINY_FREE_TO_SS (default: 0)
int route_free; // HAKMEM_TINY_ROUTE_FREE (default: 0)
int sll_diag; // HAKMEM_TINY_SLL_DIAG (default: 0)
int sll_safeheader; // HAKMEM_TINY_SLL_SAFEHEADER (default: 0)
int sll_ring; // HAKMEM_TINY_SLL_RING (default: 0)
int free_fast; // HAKMEM_TINY_FREE_FAST (default: 1)
int sll_canary_fast; // HAKMEM_TINY_SLL_CANARY_FAST (default: 0)
int ss_free_debug; // HAKMEM_SS_FREE_DEBUG (default: 0)
int ss_adopt; // HAKMEM_TINY_SS_ADOPT (default: 1)
int disable_remote; // HAKMEM_TINY_DISABLE_REMOTE (default: 0)
int freelist_mask; // HAKMEM_TINY_FREELIST_MASK (default: 0)
int alloc_1024_metric; // HAKMEM_TINY_ALLOC_1024_METRIC (default: 0)
int tiny_profile; // HAKMEM_TINY_PROFILE (default: 0)
int tiny_fast_stats; // HAKMEM_TINY_FAST_STATS (default: 0)
int heap_v2_stats; // HAKMEM_TINY_HEAP_V2_STATS (default: 0)
int front_slim; // HAKMEM_TINY_FRONT_SLIM (default: 0)
int sfc_cascade_pct; // HAKMEM_SFC_CASCADE_PCT (default: 50)
int sfc_cascade; // HAKMEM_TINY_SFC_CASCADE (default: 0)
int alloc_remote_relax; // HAKMEM_TINY_ALLOC_REMOTE_RELAX (default: 0)
int ss_empty_reuse; // HAKMEM_SS_EMPTY_REUSE (default: 1)
int ss_empty_scan_limit; // HAKMEM_SS_EMPTY_SCAN_LIMIT (default: 32)
int ss_acquire_debug; // HAKMEM_SS_ACQUIRE_DEBUG (default: 0)
int tension_drain_enable; // HAKMEM_TINY_TENSION_DRAIN_ENABLE (default: 1)
int tension_drain_threshold; // HAKMEM_TINY_TENSION_DRAIN_THRESHOLD (default: 1024)
int alloc_route_shape; // HAKMEM_TINY_ALLOC_ROUTE_SHAPE (default: 0)
2025-12-13 19:19:42 +09:00
int tiny_metadata_cache; // HAKMEM_TINY_METADATA_CACHE (default: 0)
feat(Phase 1-1): Complete getenv elimination from malloc/free hot paths (+39-42% perf) ## Summary Eliminated all getenv() calls from malloc/free wrappers and allocator hot paths by implementing constructor-based environment variable caching. This achieves 39-42% performance improvement (36s → 22s on sh8bench single-thread). ## Performance Impact - sh8bench 1 thread: 35-36s → 21-22s (+39-42% improvement) 🚀 - sh8bench 8 threads: ~15s (maintained) - getenv overhead: 36.32% → 0% (completely eliminated) ## Changes ### New Files - **core/box/tiny_env_box.{c,h}**: Centralized environment variable cache for Tiny allocator - Caches 43 environment variables (HAKMEM_TINY_*, HAKMEM_SLL_*, HAKMEM_SS_*, etc.) - Constructor-based initialization with atomic CAS for thread safety - Inline accessor tiny_env_cfg() for hot path access - **core/box/wrapper_env_box.{c,h}**: Environment cache for malloc/free wrappers - Caches 3 wrapper variables (HAKMEM_STEP_TRACE, HAKMEM_LD_SAFE, HAKMEM_FREE_WRAP_TRACE) - Constructor priority 101 ensures early initialization - Replaces all lazy-init patterns in wrapper code ### Modified Files - **Makefile**: Added tiny_env_box.o and wrapper_env_box.o to OBJS_BASE and SHARED_OBJS - **core/box/hak_wrappers.inc.h**: - Removed static lazy-init variables (g_step_trace, ld_safe_mode cache) - Replaced with wrapper_env_cfg() lookups (wcfg->step_trace, wcfg->ld_safe_mode) - All getenv() calls eliminated from malloc/free hot paths - **core/hakmem.c**: - Added hak_ld_env_init() with constructor for LD_PRELOAD caching - Added hak_force_libc_ctor() for HAKMEM_FORCE_LIBC_ALLOC* caching - Simplified hak_ld_env_mode() to return cached value only - Simplified hak_force_libc_alloc() to use cached values - Eliminated all getenv/atoi calls from hot paths ## Technical Details ### Constructor Initialization Pattern All environment variables are now read once at library load time using __attribute__((constructor)): ```c __attribute__((constructor(101))) static void wrapper_env_ctor(void) { wrapper_env_init_once(); // Atomic CAS ensures exactly-once init } ``` ### Thread Safety - Atomic compare-and-swap (CAS) ensures single initialization - Spin-wait for initialization completion in multi-threaded scenarios - Memory barriers (memory_order_acq_rel) ensure visibility ### Hot Path Impact Before: Every malloc/free → getenv("LD_PRELOAD") + getenv("HAKMEM_STEP_TRACE") + ... After: Every malloc/free → Single pointer dereference (wcfg->field) ## Next Optimization Target (Phase 1-2) Perf analysis reveals libc fallback accounts for ~51% of cycles: - _int_malloc: 15.04% - malloc: 9.81% - _int_free: 10.07% - malloc_consolidate: 9.27% - unlink_chunk: 6.82% Reducing libc fallback from 51% → 10% could yield additional +25-30% improvement. 🤖 Generated with [Claude Code](https://claude.com/claude-code) Co-Authored-By: Claude <noreply@anthropic.com> Co-Authored-By: ChatGPT <chatgpt@openai.com>
2025-12-02 16:16:51 +09:00
} tiny_env_cfg_t;
extern tiny_env_cfg_t g_tiny_env;
void tiny_env_init_once(void);
static inline const tiny_env_cfg_t* tiny_env_cfg(void) {
if (__builtin_expect(!g_tiny_env.inited, 0)) {
tiny_env_init_once();
}
return &g_tiny_env;
}