bucket.list_blobs(max_results=n) has no effect #1467

Activity

1. dhermes

   added

   api: storageIssues related to the Cloud Storage API.Issues related to the Cloud Storage API.

   type: bugError or flaw in code with unintended results or allowing sub-optimal usage patterns.Error or flaw in code with unintended results or allowing sub-optimal usage patterns.

   on Feb 15, 2016
2. dhermes commented on Feb 15, 2016

   

   dhermes

   on Feb 15, 2016

   Contributor

   More actions

   Trying to reproduce right now.
3. dhermes commented on Feb 15, 2016

   

   dhermes

   on Feb 15, 2016

   Contributor

   More actions

   Confirmed:

   >>> list(b.list_blobs(max_results=5))
   [<Blob: new1455562849552, a>,
    <Blob: new1455562849552, b>,
    <Blob: new1455562849552, c>,
    <Blob: new1455562849552, d>,
    <Blob: new1455562849552, e>,
    <Blob: new1455562849552, f>]

   I'm hoping it's just a query string bug. Digging deeper to ascertain.
4. jlowin commented on Feb 15, 2016

   

   jlowin

   on Feb 15, 2016

   Author

   More actions

   @dhermes thanks!
5. dhermes commented on Feb 15, 2016

   

   dhermes

   on Feb 15, 2016

   Contributor

   More actions

   Luckily, it's our fault (not the storage backend API). We iterate past the maxResults even when we don't mean to.

   A short term fix would be for you to use the iterator manually:

   response = blob_iter.get_next_page_response()
   results = list(blob_iter.get_items_from_response(response))

   Thanks a lot for bringing it to our attention!
6. dhermes commented on Oct 3, 2016

   

   dhermes

   on Oct 3, 2016

   Contributor

   More actions

   #1787 should be a reference point for a fix here
7. dhermes commented on Oct 3, 2016

   

   dhermes

   on Oct 3, 2016

   Contributor

   More actions

   Another example of unexpected failure:

   bucket = Bucket(client, 'my-bucket-name')
   blobs = bucket.list_blob(
       max_results=10, page_token=None, fields="items/name,nextPageToken")
   
   for b in blobs:
      print(b.name)

   This prints many more than 10 blobs when the iterator is exhausted.
8. dhermes

   added 2 commits that reference this issue on Oct 4, 2016

   Making max_results part of the base Iterator class.

   ...

   This issue will close once commit 4992b10 is merged into the 'master' branch.

   4992b10

   Making max_results part of the base Iterator class.

   ...

   This issue will close once commit 78b09c5 is merged into the 'master' branch.

   78b09c5
9. tseaver commented on Oct 4, 2016

   

   tseaver

   on Oct 4, 2016

   Contributor

   More actions

   FTR, #2490 is the first pass at fixing this issue: the solution there may eventually be obsoleted by the general approach sketched recently in #895.
10. dhermes

    closed this as completedin #2490on Oct 4, 2016
11. daspecster

    added a commit that references this issue on Oct 6, 2016

    Making max_results part of the base Iterator class.

    ...

    This issue will close once commit e74d75c is merged into the 'master' branch.

    e74d75c
12. JustinBeckwith

    assigned

    dhermes

    on Feb 1, 2021
13. parthea

    added a commit that references this issue on Jun 4, 2023

    Making max_results part of the base Iterator class.

    ...

    This issue will close once commit 81f1c28 is merged into the 'main' branch.

    81f1c28
14. parthea

    added 2 commits that reference this issue on Nov 24, 2025

    chore(deps): update dependency google-api-core to v2.10.2 (#1467)

    acb0caa

    Making max_results part of the base Iterator class.

    ...

    75f9e5c
15. parthea

    added 4 commits that reference this issue on Mar 6, 2026

    docs: revised relax column mode sample (#1467)

    ...

    dc16cb3

    Making max_results part of the base Iterator class.

    ...

    8bd0177

    feat(gapic): support mTLS certificates when available (#1467)

    ...

    e1a7310

    chore: librarian release pull request: 20251216T134400Z (#1468)

    ...

    3375d00
16. parthea

    added a commit that references this issue on Apr 1, 2026

    chore: fix Multimodal Gemini modifies input DF (#1467)

    ...

    dd58c79
17. parthea

    added a commit that references this issue on Sep 8, 2026

    docs: migrate code from googleapis/python-bigquery (#18303)

    ...

    23f9a74