Repository navigation
[Python] Fix execution boundary regressions and restore Native CI - #10782
Merged
JingsongLi merged 2 commits intoOct 24, 2026
Merged
JingsongLi merged 2 commits into
JingsongLi merged 2 commits into
Conversation
QuakeWang
added a commit
to QuakeWang/paimon
that referenced
this pull request
Oct 24, 2026
Keep the reader and Native test identical to upstream after apache#10782. Retain real-SDK sparse-filter and Python deletion-vector regression coverage. Signed-off-by: QuakeWang <wangfuzheng0814@foxmail.com>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Purpose
Restore Python and Native regression coverage after separating public APIs from execution backends:
Align backend guards, public updater wrapper checks and lazy-import mocks with the current execution classes, retaining data, cleanup, file-layout and no-fallback assertions. Correct the stale-bucket injection target and late write-type error expectation. Set
DAFT_RUNNER=nativein Native CI to avoid retaining an inferred Ray runner across test cluster shutdowns; explicit Ray-runner tests remain covered.For the malformed Lance descriptor fixture, use only the Python writer to seed invalid legacy bytes. Native planning/reading, export rejection and create/overwrite atomicity assertions remain enabled and independently verified.
Dependencies: Native CI builds paimon-rust main and needs apache/paimon-rust#1211 for three indexed partition-filter cases. Rust's advisory gate independently needs apache/paimon-rust#1212. Final local Native validation uses the wheel built from vector-fix commit
188a754573f90d113a560345edea126e999cb5f1.Tests
git diff --checkand independent review passed.Local full-suite runs used macOS ARM, Python 3.10 without Rust and Python 3.13 with Rust. Lance/LeRobot supplemental runs used PyArrow 22. Skips include unavailable cloud credentials/native libraries and version-specific checks; Lance and timezone cases were exercised separately.