|
|
php.net | support | documentation | report a bug | advanced search | search howto | statistics | random bug | login |
[2011-09-09 21:26 UTC] rewilliams at crystaltech dot com
Description: ------------ I created a script that uses SplFileObject to iterate over a CSV file. As it goes, it creates a new object with each line's data and adds the object to an array. Running it with 10k or more lines crashes with a "Segmentation fault: 11" error message, while anything up to 9,999 lines works well. Adjusting PHP's memory limit had no effect. I've attached a partial reduction to this bug. It seems like I really need the elements of the SplFileObject and the class for each line, as skipping either one of those (even when the resulting array is much larger than 10k items) causes the failure to disappear. I'm not sure exactly what the trigger is, however. My reduction includes a sample CSV file of just over 10k lines, and though it still uses SplFileObject and a per-line object, the class for the latter is just an stdClass, and the data from the file is essentially ignored. The script has two lines near the bottom that are method calls to ImportData(). Comment out one or the other to see the script run successfully or to see it fail. Option 1 works; option 2 fails. Note that I tested this under 5.3.6, not the 5.3.8 that's indicated on the bug. I do not have access to the latter. Expected result: ---------------- I'd expect the script to run to completion in all cases, assuming there is sufficient memory. Actual result: -------------- The script fails in the case of >= 10000 items in the array being converted. PatchesPull RequestsHistoryAllCommentsChangesGit/SVN commits
|
|||||||||||||||||||||||||||
Copyright © 2001-2024 The PHP GroupAll rights reserved. |
Last updated: Sat Dec 21 16:01:28 2024 UTC |
Hmm, I don't see how to upload reproduction scripts. The script is below; I'll leave the data file to the tester. I created a simple CSV file that had 10,005 lines of 13 columns each, where the value of every column is the alphabet. It included one trailing blank line and used CRLF line endings. Here's the script: <?php ini_set('display_errors', 1); ini_set('error_reporting', E_ALL | E_STRICT); class NmsObj { static public function ImportData($whichOption) { $fileObj = new SplFileObject('TestData.csv'); $fileObj->setFlags(SplFileObject::SKIP_EMPTY | SplFileObject::DROP_NEW_LINE | SplFileObject::READ_CSV); $return = array(); foreach ($fileObj as $oneLine) { $return[] = new stdClass(); } //foreach switch ($whichOption) { case 1: $return = array_slice($return, 0, 9999); $result = SplFixedArray::fromArray($return); //we get here return $result; break; case 2: $return = array_slice($return, 0, 10000); $result = SplFixedArray::fromArray($return); //we won't get here - get "Segmentation fault: 11" return $result; break; } //switch } //ImportData } //NmsObj //$dataSet1 = NmsObj::ImportData(1); $dataSet1 = NmsObj::ImportData(2); echo "Done!\n"; ?>