php.net |  support |  documentation |  report a bug |  advanced search |  search howto |  statistics |  random bug |  login
Bug #71176 Updating records within a limit/offset loop misses records
Submitted: 2015-12-20 23:27 UTC Modified: 2015-12-21 01:45 UTC
From: espadav8 at gmail dot com Assigned:
Status: Not a bug Package: PDO PgSQL
PHP Version: 7.0.1 OS: OS X and Linux
Private report: No CVE-ID: None
View Developer Edit
Welcome! If you don't have a Git account, you can't do anything here.
If you reported this bug, you can edit this bug over here.
(description)
Block user comment
Status: Assign to:
Package:
Bug Type:
Summary:
From: espadav8 at gmail dot com
New email:
PHP Version: OS:

 

 [2015-12-20 23:27 UTC] espadav8 at gmail dot com
Description:
------------
When looping over all records in the database using 'limit X offset Y' to update a column, the postgres PDO driver will start to return the same records again for different offset values. It gets worse the smaller the limit size compared to the dataset size.

Test script:
---------------
https://github.com/EspadaV8/laravel-chunking-non-persistance/blob/develop/public/pg-pdo-test.php

Script assumes that there is a database with a table called `example` with columns `id` (serial), `name` (text) and `name-new` (text).

Expected result:
----------------
ID: 72 - Name: 5677360fde707 - Name new: 5677360fde707-qwe
ID: 69 - Name: 5677360fdde80 - Name new: 5677360fdde80-qwe
ID: 70 - Name: 5677360fde241 - Name new: 5677360fde241-qwe
ID: 71 - Name: 5677360fde4c3 - Name new: 5677360fde4c3-qwe

Actual result:
--------------
Depending on the limit to dataset size (limit 1, 4 records)

ID: 62 - Name: 567735dbccacd - Name new: 567735dbccacd
ID: 64 - Name: 567735dbccffc - Name new: 567735dbccffc
ID: 63 - Name: 567735dbccd4c - Name new: 567735dbccd4c-qwe
ID: 61 - Name: 567735dbcc64b - Name new: 567735dbcc64b-qwe-qwe-qwe

or (limit 3, 4 records)

ID: 72 - Name: 5677360fde707 - Name new: 5677360fde707
ID: 69 - Name: 5677360fdde80 - Name new: 5677360fdde80-qwe
ID: 70 - Name: 5677360fde241 - Name new: 5677360fde241-qwe
ID: 71 - Name: 5677360fde4c3 - Name new: 5677360fde4c3-qwe-qwe

Patches

Pull Requests

History

AllCommentsChangesGit/SVN commitsRelated reports
 [2015-12-21 01:45 UTC] requinix@php.net
-Status: Open +Status: Not a bug
 [2015-12-21 01:45 UTC] requinix@php.net
http://www.postgresql.org/docs/current/static/queries-limit.html
> When using LIMIT, it is important to use an ORDER BY clause that constrains the
> result rows into a unique order. Otherwise you will get an unpredictable subset
> of the query's rows. You might be asking for the tenth through twentieth rows,
> but tenth through twentieth in what ordering? The ordering is unknown, unless
> you specified ORDER BY.
 
PHP Copyright © 2001-2024 The PHP Group
All rights reserved.
Last updated: Fri Dec 06 14:01:27 2024 UTC