gh-153569: hide tokenizer state behind token and source operations - #156654

gh-153569: hide tokenizer state behind token and source operations#156654

pablogsal wants to merge 4 commits into

python:mainpython/cpython:mainfrom

pablogsal:gh-153569-tokenizer-source-ftstring-cleanpablogsal/cpython:gh-153569-tokenizer-source-ftstring-cleanCopy head branch name to clipboard