Description:
------------
- Versions:

APC 3.1.9
Php 5.3.3-27

Centos 6.5

apache => 2.2.15-30

Every around two days , unexpectedly, and without any external factor, apache processes get stuck and arrive to its max clients and Stops responding.

APC config:


apc.shm_segments=1
apc.shm_size=512M
apc.ttl=600
apc.cache_by_default=1
apc.mmap_file_mask=/tmp/apc.XXXXXX
apc.stat=1
apc.stat_ctime=0
apc.canonicalize=0
apc.write_lock=1
apc.report_autofilter=0
apc.include_once_override=0
apc.lazy_classes=0
apc.lazy_functions=0
apc.coredump_unmap=0
apc.file_md5=0
apc.preload_path
apc.slam_defense = Off
apc.serializer = igbinary


GDB:


(gdb) bt
#0  __lll_lock_wait () at ../nptl/sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:136
#1  0x00007f8ae5d09508 in _L_lock_854 () from /lib64/libpthread.so.0
#2  0x00007f8ae5d093d7 in __pthread_mutex_lock (mutex=0x7f8ab6f20960) at pthread_mutex_lock.c:61
#3  0x00007f8adea53389 in apc_pthreadmutex_lock (lock=<value optimized out>) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_pthreadmutex.c:72
#4  0x00007f8adea4d5a7 in apc_cache_expunge (cache=0x7f8ae9c96440, size=66640) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_cache.c:399
#5  0x00007f8adea538a1 in apc_sma_malloc_ex (n=66592, fragment=48, allocated=0x7fff0c274778) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_sma.c:458
#6  0x00007f8adea53ac3 in apc_sma_malloc (n=<value optimized out>) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_sma.c:517
#7  0x00007f8adea555cd in create_pool_block (pool=0x7f8abefdd5b0, size=<value optimized out>) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_pool.c:217
#8  apc_realpool_alloc (pool=0x7f8abefdd5b0, size=<value optimized out>) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_pool.c:274
#9  0x00007f8adea55766 in apc_pmemcpy (p=0x7f8aea929f68, n=66135, pool=<value optimized out>) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_pool.c:492
#10 0x00007f8adea512b5 in apc_string_pmemcpy (dst=0x7f8abefdd700, src=0x7f8aea93e588, ctxt=0x7fff0c2748f0) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_compile.c:288
#11 my_copy_zval (dst=0x7f8abefdd700, src=0x7f8aea93e588, ctxt=0x7fff0c2748f0) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_compile.c:337
#12 0x00007f8adea4bd7d in apc_cache_make_user_entry (
    info=0x7f8aea89dae0 "xxx.xxx.xxx/var/www/xxx.xxxx.xxx/www/instances/xxx.xxx/config/inherited/templates_inheritance.config.php@1399542473", info_len=125, 
    val=0x7f8aea93e588, ctxt=0x7fff0c2748f0, ttl=0) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/apc_cache.c:1158
#13 0x00007f8adea4a3e3 in _apc_store (
    strkey=0x7f8aea89dae0 "xxx.xxx.xxx/var/www/xxx.xxx.xxx/www/instances/xxx.xxx/config/inherited/templates_inheritance.config.php@1399542473", strkey_len=125, 
    val=0x7f8aea93e588, ttl=0, exclusive=0) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/php_apc.c:610
#14 0x00007f8adea4a63f in apc_store_helper (ht=<value optimized out>, return_value=0x7f8aea93e4d8, return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, 
    return_value_used=<value optimized out>, exclusive=0) at /usr/src/debug/php-pecl-apc-3.1.9/APC-3.1.9/php_apc.c:669
#15 0x00007f8ae213f498 in ?? () from /etc/httpd/modules/libphp5.so
#16 0x00007f8ae21165e0 in execute () from /etc/httpd/modules/libphp5.so
#17 0x00007f8ae20f07ed in zend_execute_scripts () from /etc/httpd/modules/libphp5.so
#18 0x00007f8ae209e878 in php_execute_script () from /etc/httpd/modules/libphp5.so
#19 0x00007f8ae2179e55 in ?? () from /etc/httpd/modules/libphp5.so
#20 0x00007f8ae745cbb0 in ap_run_handler (r=0x7f8aea15d688) at /usr/src/debug/httpd-2.2.15/server/config.c:158
#21 0x00007f8ae746046e in ap_invoke_handler (r=0x7f8aea15d688) at /usr/src/debug/httpd-2.2.15/server/config.c:376
#22 0x00007f8ae746bb30 in ap_process_request (r=0x7f8aea15d688) at /usr/src/debug/httpd-2.2.15/modules/http/http_request.c:282
#23 0x00007f8ae74689a8 in ap_process_http_connection (c=0x7f8ae9d2ff48) at /usr/src/debug/httpd-2.2.15/modules/http/http_core.c:190
#24 0x00007f8ae74646b8 in ap_run_process_connection (c=0x7f8ae9d2ff48) at /usr/src/debug/httpd-2.2.15/server/connection.c:43
#25 0x00007f8ae7470977 in child_main (child_num_arg=<value optimized out>) at /usr/src/debug/httpd-2.2.15/server/mpm/prefork/prefork.c:667
#26 0x00007f8ae7470c8a in make_child (s=0x7f8ae951b860, slot=154) at /usr/src/debug/httpd-2.2.15/server/mpm/prefork/prefork.c:763
#27 0x00007f8ae747190c in perform_idle_server_maintenance (_pconf=<value optimized out>, plog=<value optimized out>, s=<value optimized out>)
    at /usr/src/debug/httpd-2.2.15/server/mpm/prefork/prefork.c:898
#28 ap_mpm_run (_pconf=<value optimized out>, plog=<value optimized out>, s=<value optimized out>) at /usr/src/debug/httpd-2.2.15/server/mpm/prefork/prefork.c:1102
#29 0x00007f8ae7448900 in main (argc=1, argv=0x7fff0c277518) at /usr/src/debug/httpd-2.2.15/server/main.c:760
(gdb)