gh-153569: return tokenizer tokens as source spans - #156482

gh-153569: return tokenizer tokens as source spans#156482

pablogsal wants to merge 4 commits into

python:mainpython/cpython:mainfrom

pablogsal:gh-153569-tokenizer-offset-statepablogsal/cpython:gh-153569-tokenizer-offset-stateCopy head branch name to clipboard