Skip to content

JP: four editions, and a date per parcel - #273

Closed
ivorbosloper wants to merge 1 commit into
split/duckdbfrom
split/jp
Closed

ivorbosloper wants to merge 1 commit into
split/duckdbfrom
split/jp

Conversation

@ivorbosloper

@ivorbosloper ivorbosloper commented Sep 12, 2026

Copy link
Copy Markdown
Collaborator

Third in a stack: #266 (per-file) → #272 (DuckDB) → this.

The Fude polygons are published per year and the converter knew one of them. All four (2021-2024) are variants now, newest first, with the test fixture last so it is never chosen by accident — a converter whose default is a fixture silently converts 100 rows in production.

The determination date used to be a constant; each parcel carries its own issue year, which becomes its determination:datetime in the SQL migration. That is why this one is converted in SQL: 33 GB of Parquet, ~30M fields per edition.

If vecorel/cli#29 lands first, #272 goes away and this needs one import line changed.

🤖 Generated with Claude Code

https://claude.ai/code/session_01DVx9uQV2QPM8ecPAY3ZjXG

The Fude polygons are published per year and the converter knew one of them.
All four are variants now, newest first, with the test fixture last so it is
not chosen by accident.

The determination date used to be a constant for the whole file. Each parcel
carries its own issue year, which becomes its determination:datetime in the SQL
migration — the point of converting this dataset with SQL rather than in memory:
33 GB of Parquet across the four editions.

Co-Authored-By: Claude Opus 5 (1M context) <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_01DVx9uQV2QPM8ecPAY3ZjXG
@ivorbosloper

Copy link
Copy Markdown
Collaborator Author

Superseded by #280, which carries the same jp converter with the import pointed at vecorel-cli 0.2.18 instead of the copy in this repository. Closing.

@m-mohr
m-mohr deleted the split/jp branch September 13, 2026 20:01
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant