Skip to content

Parquet import meets error when loading from azure #65261

Closed
#65262
Closed
Parquet import meets error when loading from azure#65261
#65262
Labels
affects-8.5This bug affects the 8.5.x(LTS) versions.affects-9.0This bug affects the 9.0.x versions.component/importseverity/moderatetype/bugThe issue is confirmed as a bug.type/regression

Description

@joechenrh
joechenrh
opened on Dec 25, 2025

Bug Report

Please answer these questions before submitting your issue. Thanks!

The error is as follow, where 1046 is actually the size of this file.

 [Lightning:Storage:ErrStorageUnknown]list file failed: parquet: could not retrieve footer offset: Failed to read data from azure blob, data info: pos='1046'

1. Minimal reproduce step (Required)

2. What did you expect to see? (Required)

3. What did you see instead (Required)

4. What is your TiDB version? (Required)

Activity

  1. joechenrh
    added
    type/bugThe issue is confirmed as a bug.
    affects-8.5This bug affects the 8.5.x(LTS) versions.
    affects-9.0This bug affects the 9.0.x versions.
    severity/major
    on Dec 25, 2025
  2. ti-chi-bot
    added
    may-affects-6.5
    may-affects-7.1
    may-affects-7.5
    may-affects-8.1
    on Dec 25, 2025
  3. joechenrh
    added
    severity/moderate
    and removed
    severity/major
    may-affects-6.5
    may-affects-7.1
    may-affects-7.5
    may-affects-8.1
    on Dec 25, 2025

  4. joechenrh commented on Dec 25, 2025

    @joechenrh
    joechenrh
    on Dec 25, 2025
    ContributorAuthor

    Only using arrow-go with azure can meet such problem, so the affected versions are 8.5 and 9.0.

  5. jebter
    added
    component/DXFDistributed eXecute Framework of tidb
    type/regression
    on Dec 25, 2025

  6. joechenrh commented on Dec 25, 2025

    @joechenrh
    joechenrh
    on Dec 25, 2025
    ContributorAuthor

    Not related to DXF, remove this flag.

  7. joechenrh
    added
    component/import
    and removed
    component/DXFDistributed eXecute Framework of tidb
    on Dec 25, 2025
  8. ti-chi-bot
    closed this as completedin #65262on Dec 27, 2025
  9. ti-chi-bot
    added a commit that references this issue on Dec 27, 2025

    storage: fix reader error when seeking to end (#65262)

    310e154
  10. seagel
    added a commit that references this issue on Dec 27, 2025

    storage: fix reader error when seeking to end (pingcap#65262)

    03a554a
  11. ti-chi-bot
    added a commit that references this issue on Dec 29, 2025

    storage: fix reader error when seeking to end (#65262) (#65300)

    7c1dc40
  12. Reminiscent
    added a commit that references this issue on Jan 14, 2026

    storage: fix reader error when seeking to end (pingcap#65262)

    4ec03b2
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

No one assigned

    Labels

    affects-8.5This bug affects the 8.5.x(LTS) versions.affects-9.0This bug affects the 9.0.x versions.component/importseverity/moderatetype/bugThe issue is confirmed as a bug.type/regression

    Type

    No type

    Projects

    No projects

      Milestone

      No milestone

      Relationships

      None yet

      Development

      No branches or pull requests

      Issue actions