php.net |  support |  documentation |  report a bug |  advanced search |  search howto |  statistics |  random bug |  login
Bug #45239 Hang (99.9%CPU) when encoding_translation is on
Submitted: 2008-06-11 15:02 UTC Modified: 2009-02-06 07:39 UTC
From: pumuckel at metropolis dot de Assigned: moriyoshi (profile)
Status: Closed Package: mbstring related
PHP Version: 5.*-CVS-2009-02-04 OS: *
Private report: No CVE-ID: None
 [2008-06-11 15:02 UTC] pumuckel at metropolis dot de
Description:
------------
When mbstring.encoding_translation is set to on, and passing a variable like x=%FC (ISO '?' character) the mb lib is hanging in itself.

Following settings are applyied (internal encoding is ISO):

Multibyte Support 	enabled
Multibyte string engine 	libmbfl
HTTP input encoding translation 	enabled
Multibyte (japanese) regex support 	enabled
Multibyte regex (oniguruma) version 	4.4.4
Multibyte regex (oniguruma) backtrack check 	On

mbstring extension makes use of "streamable kanji code filter and converter", which is distributed under the GNU Lesser General Public License version 2.1.

Directive	Local Value	Master Value
mbstring.detect_order	auto	no value
mbstring.encoding_translation	On	Off
mbstring.func_overload	0	0
mbstring.http_input	UTF-8,ISO-8859-15	pass
mbstring.http_output	ISO-8859-15	pass
mbstring.internal_encoding	ISO-8859-15	no value
mbstring.language	neutral	neutral
mbstring.strict_detection	On	Off
mbstring.substitute_character	no value	no value


Also not working with these settings (internal UTF8)
mbstring.detect_order	auto	auto
mbstring.encoding_translation	On	On
mbstring.func_overload	0	7
mbstring.http_input	UTF-8,ISO-8859-15	auto
mbstring.http_output	UTF-8	UTF-8
mbstring.internal_encoding	UTF-8	UTF-8
mbstring.language	neutral	neutral
mbstring.strict_detection	On	Off
mbstring.substitute_character	no value	no value

Reproduce code:
---------------
Pass a ?x=%FC as a parameter. When followed by other parameters, it is working again.

Expected result:
----------------
No hang.

Actual result:
--------------
Hang (99.9% CPU usage). As a result the script will be aborted later on with "Max execution time exceeded". The first line of PHP Code itself is never called.

GDB Info:
(gdb) where
#0  0xb752e9d5 in mbfl_encoding_detector_judge () from /usr/lib/apache2/modules/libphp5.so
#1  0xb753c93e in _php_mb_encoding_handler_ex () from /usr/lib/apache2/modules/libphp5.so
#2  0xbffd34ec in ?? ()

Patches

Add a Patch

Pull Requests

Add a Pull Request

History

AllCommentsChangesGit/SVN commitsRelated reports
 [2008-08-01 23:41 UTC] moriyoshi@php.net
Please provide the short and self-contained example to reproduce the problem. I could never reproduce the problem with the following way.

$ env REQUEST_METHOD=get QUERY_STRING=x=%fc SCRIPT_FILENAME=/tmp/test.php php-cgi -c /tmp/test.ini

test.php:
<?php var_dump($_REQUEST); ?>

test.ini:
mbstring.encoding_translation=on
mbstring.http_input=auto
mbstring.internal_encoding=UTF-8

 [2009-01-27 14:04 UTC] pumuckel at metropolis dot de
With following ini settings it is reproducable:

test.ini:
mbstring.strict_detection = 1
mbstring.encoding_translation=on
mbstring.http_input=auto
mbstring.internal_encoding=UTF-8

Just tried with current 5.3 CVS Version and php-cgi. The result is the same: It's hanging around with 99.9% cpu usage.

Please switch strict_detection and encoding_translation on. strit_detection is recommended to be used for correct iso-8859-* detection as described in 

Bug #35711  	[PATCH] ISO-8859 charset not correctly detected
 [2009-02-04 22:26 UTC] jani@php.net
Moriyoshi, see the feedback..
 [2009-02-06 07:39 UTC] moriyoshi@php.net
This bug has been fixed in CVS.

Snapshots of the sources are packaged every three hours; this change
will be in the next snapshot. You can grab the snapshot at
http://snaps.php.net/.
 
Thank you for the report, and for helping us make PHP better.

Hmm... I'm just wondering why it took this long for this to be found...

 
PHP Copyright © 2001-2018 The PHP Group
All rights reserved.
Last updated: Sat Sep 22 06:01:26 2018 UTC