Skip to content

[format] Fix positional schema evolution for ORC reads - #9464

Open
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/fix-pos-orc
Open

[format] Fix positional schema evolution for ORC reads#9464
ArnavBalyan wants to merge 1 commit into
apache:masterfrom
ArnavBalyan:arnavb/fix-pos-orc

Conversation

@ArnavBalyan

Copy link
Copy Markdown
Member

Purpose

  • Legacy ORC files use generated column names such as _col0 but table declares actual names.
  • Paimon ignores the positional schema and returns null since the lookup logic is using the real column names.
  • Forward the positional schema settings to the orc reader so columns can be matched by position.

Tests

  • UT

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant