|
|
php.net | support | documentation | report a bug | advanced search | search howto | statistics | random bug | login |
[2005-04-26 02:07 UTC] fransson at fransson dot de
Description:
------------
PHP runs out of memory when iterating large loops. It seems that it does not free unused memory. The Windows Task Manager indicates that it tries to allocate more than 2 Gigabytes of memory (on my P4 with 1 Gigabyte) before crashing with an access violation.
In my opinion this is a performance problem in the first place. The crash does help in this case because the machine becomes usable again.
Although I guess it is not, this problem might be related to the MySQL interface because the loops which are causing my troubles are of the following structure:
while ($row = mysql_fetch_array($set, MYSQL_ASSOC)) {
...
}
I guess that the data being stored in the variable $row with each iteration is never being freed up by php, although it can never be referenced again after the next iteration has overwritten the old reference.
To be more explicit:
1. Before the execution of the while-loop, $row does not even exist and therefore does not consume any memory.
2. During the execution of the first iteration of the while-loop, $row consumes only enough memory to hold a single row of the result set (which might be around 20 KB in my case).
3. During the execution of the second iteration, $row is being overwritten with a new row of the result set. Its previous value is not accessible any more, but nevertheless consumes memory. Therefore, assuming a memory consumption of about 20 KB per row, the total memory consumption during the second iteration is 40 KB. 20 KB of these are completely wasted since they remain inaccessible to the application.
4. The larger the result set, the larger the memory wasted. If it is large enough, it will slow down and crash any machine. In my case, the result set holds about 50,000 records.
PatchesPull RequestsHistoryAllCommentsChangesGit/SVN commits
|
|||||||||||||||||||||||||||||||||||||
Copyright © 2001-2024 The PHP GroupAll rights reserved. |
Last updated: Thu Dec 26 15:01:32 2024 UTC |
The following script will kill almost any machine as it consumes enormous amounts of memory (more than 1 Gigabyte). If your machine still survives, just append one or more zeros to the $mobySize value ;-) Memory consumption should not occur since this script does not allocate memory. It seems there is a memory leak associated with PHP's MySQL interface. <?php set_time_limit(3600); $lnk = mysql_connect("localhost", "root", ""); if ($lnk <= 0) { die("Cannot connect to database!"); } $ok = mysql_select_db("test", $lnk); if (!$ok) { die("Cannot select database!"); } $ok = mysql_query("DROP TABLE IF EXISTS moby"); $ok = mysql_query("CREATE TABLE moby (" . "MobyID int(11) unsigned NOT NULL auto_increment," . "MobyNumber int(11) unsigned NOT NULL default '0'," . "MobyText mediumtext," . "PRIMARY KEY (MobyID)" . ") ENGINE=MyISAM DEFAULT CHARSET=latin1"); if (!$ok) { die("Cannot create table!"); } $mobySize = 1000000; for ($i = 0; $i < $mobySize; $i++) { $text = ""; for ($j = 0; $j < 100; $j++) { $text .= "Moby" . rand(); } $ok = mysql_query("INSERT INTO moby (MobyNumber, MobyText) VALUES (" . rand() . ", '" . $text . "')"); if (!$ok) { die("Cannot insert record!"); } } $set = mysql_query("SELECT * FROM moby"); $i = 0; while ($row = mysql_fetch_array($set, MYSQL_ASSOC)) { $value = $row["MobyNumber"]; $i++; if (($i % 100000) == 0) { // print("Memory usage: " . number_format(memory_get_usage(), 0, ",", ".") . " Bytes<br>"); print("Memory usage: memory_get_usage() is not defined on windows!<br>"); print("MobyNumber: " . $value . "<br>"); print("MobyText: " . $text . "<br>"); } if ($value == $row) { print("Never."); } } ?>