PHP :: Bug #58869 :: All apache processes stuck in __lll_lock

Bug #58869	All apache processes stuck in __lll_lock_wait
Submitted:	2009-09-30 14:01 UTC	Modified:	2016-08-31 15:19 UTC
From:	marcin at onetime dot com	Assigned:	cmb (profile)
Status:	Wont fix	Package:	APC (PECL)
PHP Version:	5.2.4	OS:	Ubuntu 8.04 LTS
Private report:	No	CVE-ID:	None

View Developer Edit

Welcome! If you don't have a Git account, you can't do anything here.
If you reported this bug, you can edit this bug over here.

php.net Username: php.net Password:

	Block user comment
Status:		Assign to:
Package:
Bug Type:
Summary:
From:	marcin at onetime dot com
New email:
PHP Version:		OS:

New/Additional Comment:

[2009-09-30 14:01 UTC] marcin at onetime dot com

Description:
------------
All 180 processes are stuck in __ll_lock_wait. [3 processes are from previous apache run and stuck in apache_cache_release (2940X numbered processes at bottom of btacktrace)]. Processes  with pids in the 30000 range are locked on various cache reads. This started happening when we moved from single core to a quad core servers. Problems seen on multiple servers.

GDB Backtrace:
_______________ 32753 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32753)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x99f060 "VERSION_SEED", keylen=1, t=1254281716)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b9a60, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32752 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32752)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x1128378 "CampaignRowMapper-\t\t\tselect\n\t\t\t\tc.id as campaignid, c.name as campaignname, cd.id as id, cd.reach, cd.weight as weight, cd.campaign, t.id as target,\n\t\t\t\tt.name as targetname, cd.optin as optin, cd.sub"..., 
    keylen=1, t=1254281715) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x10ffbd0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#14 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045f86d0)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#16 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f647670d in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fccd0)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#19 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#22 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#23 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#24 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#25 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#26 0x0000000000437daa in ap_run_handler ()
#27 0x000000000043b1cc in ap_invoke_handler ()
#28 0x00000000004478de in ap_process_request ()
#29 0x0000000000444cd8 in ?? ()
#30 0x000000000043ef02 in ap_run_process_connection ()
#31 0x000000000044b6d5 in ?? ()
#32 0x000000000044b985 in ?? ()
#33 0x000000000044c218 in ap_mpm_run ()
#34 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32723 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32723)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x99ead8 "VERSION_SEED", keylen=1, t=1254281541)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b9ac0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32722 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32722)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9b81d0 "VERSION_SEED", keylen=1, t=1254281541)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b8e18, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32721 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32721)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0xa3d2c8 "AirportAutoCompleterDao_findFlightAirports_mia_10", keylen=1, t=1254281541)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x1025fe8, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#14 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x0000000000437daa in ap_run_handler ()
#19 0x000000000043b1cc in ap_invoke_handler ()
#20 0x00000000004478de in ap_process_request ()
#21 0x0000000000444cd8 in ?? ()
#22 0x000000000043ef02 in ap_run_process_connection ()
#23 0x000000000044b6d5 in ?? ()
#24 0x000000000044b985 in ?? ()
#25 0x000000000044c218 in ap_mpm_run ()
#26 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32718 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32718)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0xc49730 "VERSION_SEED", keylen=1, t=1254281540)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0xc62bd8, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32717 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32717)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9a0700 "VERSION_SEED", keylen=1, t=1254281540)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x999688, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32716 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32716)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9a0110 "VERSION_SEED", keylen=1, t=1254281539)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x999348, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32715 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32715)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9b8978 "VERSION_SEED", keylen=1, t=1254281539)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b91c0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32704 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32704)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x1291200 "DefaultRowMapper-\t\t\tselect count(*) as count\n\t\t\tfrom\n\t\t\t\tsemcategory\n\t\t\twhere\n\t\t\t\tsyndicationpartner=343 and\n\t\t\t\tsempartner=1", keylen=1, t=1254281538) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x1291118, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f647670d in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045f9770)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#14 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#19 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#22 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#23 0x0000000000437daa in ap_run_handler ()
#24 0x000000000043b1cc in ap_invoke_handler ()
#25 0x00000000004478de in ap_process_request ()
#26 0x0000000000444cd8 in ?? ()
#27 0x000000000043ef02 in ap_run_process_connection ()
#28 0x000000000044b6d5 in ?? ()
#29 0x000000000044b985 in ?? ()
#30 0x000000000044c218 in ap_mpm_run ()
#31 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32675 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32675)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x99e8b0 "VERSION_SEED", keylen=1, t=1254281535)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9990f0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32674 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32674)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x12b0908 "DefaultRowMapper-\t\t\tselect count(*) as count\n\t\t\tfrom\n\t\t\t\tsemcategory\n\t\t\twhere\n\t\t\t\tsyndicationpartner=9079 and\n\t\t\t\tsempartner=1", keylen=1, t=1254281535) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x12b0820, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f647670d in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045f9770)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#14 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#19 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#22 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#23 0x0000000000437daa in ap_run_handler ()
#24 0x000000000043b1cc in ap_invoke_handler ()
#25 0x00000000004478de in ap_process_request ()
#26 0x0000000000444cd8 in ?? ()
#27 0x000000000043ef02 in ap_run_process_connection ()
#28 0x000000000044b6d5 in ?? ()
#29 0x000000000044b985 in ?? ()
#30 0x000000000044c218 in ap_mpm_run ()
#31 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32673 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32673)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0xce5850 "DefaultRowMapper-\t\t\t\tselect\n\t\t\t\t\tl.id, if(ln.location is not null, ln.name, l.name) as name, l.parentnames, l.hotels, l.longitude, l.state as stateid,\n\t\t\t\t\tl.country as countryid, l.latitude, if(sn.lo"..., 
    keylen=1, t=1254281535) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0xce53e0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#14 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#18 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#19 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#22 0x0000000000437daa in ap_run_handler ()
#23 0x000000000043b1cc in ap_invoke_handler ()
#24 0x00000000004478de in ap_process_request ()
#25 0x0000000000444cd8 in ?? ()
#26 0x000000000043ef02 in ap_run_process_connection ()
#27 0x000000000044b6d5 in ?? ()
#28 0x000000000044b985 in ?? ()
#29 0x000000000044c218 in ap_mpm_run ()
#30 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32660 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32660)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0xad0090 "VERSION_SEED", keylen=1, t=1254281535)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0xac9040, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32659 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32659)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x99e330 "VERSION_SEED", keylen=1, t=1254281534)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b9300, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32649 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32649)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9a0558 "VERSION_SEED", keylen=1, t=1254281533)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9995b0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32383 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32383)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0xba86c0 "DefaultRowMapper-\t\t\t\tselect\n\t\t\t\t\tl.id, if(ln.location is not null, ln.name, l.name) as name, l.parentnames, l.hotels, l.longitude, l.state as stateid,\n\t\t\t\t\tl.country as countryid, l.latitude, if(sn.lo"..., 
    keylen=1, t=1254280293) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0xba8250, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#14 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#18 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#19 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#22 0x0000000000437daa in ap_run_handler ()
#23 0x000000000043b1cc in ap_invoke_handler ()
#24 0x00000000004478de in ap_process_request ()
#25 0x0000000000444cd8 in ?? ()
#26 0x000000000043ef02 in ap_run_process_connection ()
#27 0x000000000044b6d5 in ?? ()
#28 0x000000000044b985 in ?? ()
#29 0x000000000044c218 in ap_mpm_run ()
#30 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32382 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32382)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x12b4928 "DefaultRowMapper-\t\t\tselect count(*) as count\n\t\t\tfrom\n\t\t\t\tsemcategory\n\t\t\twhere\n\t\t\t\tsyndicationpartner=9080 and\n\t\t\t\tsempartner=1", keylen=1, t=1254280284) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x12b4840, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f647670d in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045f9770)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#14 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#19 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#22 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#23 0x0000000000437daa in ap_run_handler ()
#24 0x000000000043b1cc in ap_invoke_handler ()
#25 0x00000000004478de in ap_process_request ()
#26 0x0000000000444cd8 in ?? ()
#27 0x000000000043ef02 in ap_run_process_connection ()
#28 0x000000000044b6d5 in ?? ()
#29 0x000000000044b985 in ?? ()
#30 0x000000000044c218 in ap_mpm_run ()
#31 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32381 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32381)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0xa98500 "AirportAutoCompleterDao_findFlightAirports_j_10", keylen=1, t=1254280295)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0xa9c7e8, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#14 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x0000000000437daa in ap_run_handler ()
#19 0x000000000043b1cc in ap_invoke_handler ()
#20 0x00000000004478de in ap_process_request ()
#21 0x0000000000444cd8 in ?? ()
#22 0x000000000043ef02 in ap_run_process_connection ()
#23 0x000000000044b6d5 in ?? ()
#24 0x000000000044b985 in ?? ()
#25 0x000000000044c218 in ap_mpm_run ()
#26 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32380 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32380)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x99ed98 "VERSION_SEED", keylen=1, t=1254280274)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b9820, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32379 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32379)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9a0800 "VERSION_SEED", keylen=1, t=1254280274)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x999790, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32378 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32378)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x1259500 "DefaultRowMapper-\t\t\t\tselect\n\t\t\t\t\tl.id, if(ln.location is not null, ln.name, l.name) as name, l.parentnames, l.hotels, l.longitude, l.state as stateid,\n\t\t\t\t\tl.country as countryid, l.latitude, if(sn.lo"..., 
    keylen=1, t=1254280273) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x1259090, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#14 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#19 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#20 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#22 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#23 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#24 0x0000000000437daa in ap_run_handler ()
#25 0x000000000043b1cc in ap_invoke_handler ()
#26 0x00000000004478de in ap_process_request ()
#27 0x0000000000444cd8 in ?? ()
#28 0x000000000043ef02 in ap_run_process_connection ()
#29 0x000000000044b6d5 in ?? ()
#30 0x000000000044b985 in ?? ()
#31 0x000000000044c218 in ap_mpm_run ()
#32 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32377 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32377)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x99e748 "VERSION_SEED", keylen=1, t=1254280277)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b9898, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32376 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32376)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x1288bc0 "CampaignRowMapper-\t\t\tselect\n\t\t\t\tc.id as campaignid, c.name as campaignname, cd.id as id, cd.reach, cd.weight as weight, cd.campaign, t.id as target,\n\t\t\t\tt.name as targetname, cd.optin as optin, cd.sub"..., 
    keylen=1, t=1254280286) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x1288880, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#14 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#19 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#22 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#23 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#24 0x00007f71f64a938d in ?? () from /usr/lib/apache2/modules/libphp5.so
#25 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045f86d0)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#26 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#27 0x00007f71f647670d in ?? () from /usr/lib/apache2/modules/libphp5.so
#28 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fccd0)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#29 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#30 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#31 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#32 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#33 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#34 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#35 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#36 0x0000000000437daa in ap_run_handler ()
#37 0x000000000043b1cc in ap_invoke_handler ()
#38 0x00000000004478de in ap_process_request ()
#39 0x0000000000444cd8 in ?? ()
#40 0x000000000043ef02 in ap_run_process_connection ()
#41 0x000000000044b6d5 in ?? ()
#42 0x000000000044b985 in ?? ()
#43 0x000000000044c218 in ap_mpm_run ()
#44 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32375 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32375)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0x1214dc0 "DefaultRowMapper-\t\t\tselect count(*) as count\n\t\t\tfrom\n\t\t\t\tsemcategory\n\t\t\twhere\n\t\t\t\tsyndicationpartner=1644 and\n\t\t\t\tsempartner=1", keylen=1, t=1254280273) at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x1214cd8, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f647670d in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045f9770)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#14 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#15 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#16 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#17 0x00007f71f6477f90 in ?? () from /usr/lib/apache2/modules/libphp5.so
#18 0x00007f71f4758f9a in apc_op_ZEND_INCLUDE_OR_EVAL (execute_data=0x7fff045fe900)
    at /tmp/pear/cache/APC-3.0.19/apc_zend.c:216
#19 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#20 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#21 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#22 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#23 0x0000000000437daa in ap_run_handler ()
#24 0x000000000043b1cc in ap_invoke_handler ()
#25 0x00000000004478de in ap_process_request ()
#26 0x0000000000444cd8 in ?? ()
#27 0x000000000043ef02 in ap_run_process_connection ()
#28 0x000000000044b6d5 in ?? ()
#29 0x000000000044b985 in ?? ()
#30 0x000000000044c218 in ap_mpm_run ()
#31 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32374 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32374)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, strkey=0x9b89e0 "VERSION_SEED", keylen=1, t=1254280283)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0x9b91f0, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6453773 in zend_execute_scripts () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f640f9fa in php_execute_script () from /usr/lib/apache2/modules/libphp5.so
#12 0x00007f71f64d3d02 in ?? () from /usr/lib/apache2/modules/libphp5.so
#13 0x0000000000437daa in ap_run_handler ()
#14 0x000000000043b1cc in ap_invoke_handler ()
#15 0x00000000004478de in ap_process_request ()
#16 0x0000000000444cd8 in ?? ()
#17 0x000000000043ef02 in ap_run_process_connection ()
#18 0x000000000044b6d5 in ?? ()
#19 0x000000000044b985 in ?? ()
#20 0x000000000044c218 in ap_mpm_run ()
#21 0x0000000000425a44 in main ()
The program is running.  Quit anyway (and detach it)? (y or n) [answered Y; input not from terminal]
_______________ 32373 _______________
[Thread debugging using libthread_db enabled]
[New Thread 0x7f71fc5ee760 (LWP 32373)]
0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#0  0x00007f71fbb6a174 in __lll_lock_wait () from /lib/libpthread.so.0
#1  0x00007f71fbb65b74 in _L_lock_1007 () from /lib/libpthread.so.0
#2  0x00007f71fbb6599e in pthread_mutex_lock () from /lib/libpthread.so.0
#3  0x00007f71f4758269 in apc_pthreadmutex_lock (lock=0x7f71e047f210) at /tmp/pear/cache/APC-3.0.19/apc_pthreadmutex.c:72
#4  0x00007f71f47529b0 in apc_cache_user_find (cache=0x9103d0, 
    strkey=0xa98b58 "AirportAutoCompleterDao_findFlightAirports_b_10", keylen=1, t=1254280274)
    at /tmp/pear/cache/APC-3.0.19/apc_cache.c:579
#5  0x00007f71f4750977 in zif_apc_fetch (ht=<value optimized out>, return_value=0xa9ce40, 
    return_value_ptr=<value optimized out>, this_ptr=<value optimized out>, return_value_used=<value optimized out>)
    at /tmp/pear/cache/APC-3.0.19/php_apc.c:706
#6  0x00007f71f6481fb2 in ?? () from /usr/lib/apache2/modules/libphp5.so
#7  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#8  0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#9  0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#10 0x00007f71f6481a44 in ?? () from /usr/lib/apache2/modules/libphp5.so
#11 0x00007f71f6472ee3 in execute () from /usr/lib/apache2/modules/libphp5.so
#

Patches

Pull Requests

History

AllCommentsChangesGit/SVN commitsRelated reports

[2009-09-30 17:25 UTC] shire@php.net

Thanks for the detailed backtraces.  There's probably one segfault or timeout that triggers these.  Can you check your logs and see if there's an initial segmentation fault or timeout right before you see everything locking up?  If it's a segfault a backtrace of that one would be specifically helpful.

[2009-09-30 17:49 UTC] marcin at onetime dot com

Thanks for the prompt feedback. I have apache set to debug LogLevel but I don't see any segfaults. There are a few of these though:(32)Broken pipe: core_output_filter: writing data to the network. I kept the server in it's failure state so I still have the processes running. Let me know what I can do to get you more info. Would using anonymous mmaped memory have anything to do with it? Here is our apc.ini:
extension=apc.so
; see http://www.php.net/manual/en/apc.configuration.php
apc.cache_by_default = 1
apc.enable_cli = 0
apc.enabled = 1
apc.file_update_protection = 5
;apc.filters = no value
apc.gc_ttl = 3600
apc.include_once_override = 1
apc.max_file_size = 2M
apc.num_files_hint = 10000
apc.report_autofilter = 0
apc.shm_segments = 1
apc.shm_size = 256
;apc.slam_defense = 0
apc.stat = 0
apc.stat_ctime = 0
apc.ttl = 120
apc.user_entries_hint = 100000
apc.user_ttl = 120
apc.write_lock = On

[2009-10-01 11:23 UTC] andy dot rigby at cybertill dot co dot uk

Hi, we are also seeing this problem on a dual core server.

Attaching to program: /usr/sbin/httpd, process 21263
(no debugging symbols found)
...
(gdb) s
Single stepping until exit from function __kernel_vsyscall, 
which has no line number information.
0x001390b9 in __lll_lock_wait () from /lib/libpthread.so.0
(gdb) s
Single stepping until exit from function __lll_lock_wait, 
which has no line number information.


We did have a timeout at the time things started to lock up:

[Thu Oct 01 16:00:38 2009] [error] [client XXX.XXX.XXX.XXX] PHP Fatal error:  Maximum execution time of 30 seconds exceeded in /home/XX/projects/trunk/lib/vendor/symfony/lib/autoload/sfAutoload.class.php on line 175, referer: http://XXX/trunk/backoffice_dev.php/menu/admin

[2009-10-01 11:43 UTC] andy dot rigby at cybertill dot co dot uk

I have just read http://pecl.php.net/bugs/bug.php?id=15179 - this looks related to that ticket which is marked as resolved. Trying 3.1.3p1 now.

[2016-08-31 15:19 UTC] cmb@php.net

-Status: Open +Status: Wont fix -Assigned To: +Assigned To: cmb

[2016-08-31 15:19 UTC] cmb@php.net

According to <https://bugs.php.net/69618>, APC support has been
discontinued in favor of OPcache, APCu, the session upload
progress API and WinCache. Therefore this issue won't get fixed.

	php.net \| support \| documentation \| report a bug \| advanced search \| search howto \| statistics \| random bug \| login
go to bug id or search bugs for


Copyright © 2001-2024 The PHP Group All rights reserved.	Last updated: Sat Dec 21 17:01:58 2024 UTC