Skip to content

gh-153569: consolidate tokenizer input, layout, and diagnostics - #157055

Draft
pablogsal wants to merge 5 commits into
python:mainfrom
pablogsal:gh-153569-tokenizer-input-diagnostics
Draft

gh-153569: consolidate tokenizer input, layout, and diagnostics#157055
pablogsal wants to merge 5 commits into
python:mainfrom
pablogsal:gh-153569-tokenizer-input-diagnostics

Conversation

@pablogsal

@pablogsal pablogsal commented Sep 7, 2026

Copy link
Copy Markdown
Member

Put decoded input ownership and interactive-input control in the reader, and group indentation and logical-line handling in the layout state.

Record diagnostic locations and source spans separately from the scanning cursor. Remove the unused cursor and source lookup APIs.

Part of gh-153569.

Previous: #156654. Last PR in the stack.

Please do not review until #156654 lands.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant