| Commit message (Expand) | Author | Age | Files | Lines |
* | bpo-44667: Treat correctly lines ending with comments and no newlines in the ... | ![](//www.gravatar.com/avatar/74bcc7166aa70e4da97bd8a40dff5c31?s=13&d=retro) Miss Islington (bot) | 2021-08-02 | 1 | -1/+1 |
* | bpo-43014: Improve performance of tokenize.tokenize by 20-30% | ![](//www.gravatar.com/avatar/553ecc3bebe61a420629be87ef332963?s=13&d=retro) Anthony Sottile | 2021-01-24 | 1 | -0/+2 |
* | bpo-5028: Fix up rest of documentation for tokenize documenting line (GH-13686) | ![](//www.gravatar.com/avatar/553ecc3bebe61a420629be87ef332963?s=13&d=retro) Anthony Sottile | 2019-05-30 | 1 | -1/+1 |
* | bpo-5028: fix doc bug for tokenize (GH-11683) | ![](//www.gravatar.com/avatar/a76d6d6cbf223ea4ca993de15690751e?s=13&d=retro) Andrew Carr | 2019-05-30 | 1 | -1/+1 |
* | bpo-36766: Typos in docs and code comments (GH-13116) | ![](//www.gravatar.com/avatar/b03f626df57a183b5e69b323726f8a7a?s=13&d=retro) penguindustin | 2019-05-06 | 1 | -1/+1 |
* | bpo-30455: Generate all token related code and docs from Grammar/Tokens. (GH-... | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2018-12-22 | 1 | -60/+6 |
* | bpo-33899: Make tokenize module mirror end-of-file is end-of-line behavior (G... | ![](//www.gravatar.com/avatar/9fdd32c8051eaa1dc4f2cc06186cb85d?s=13&d=retro) Ammar Askar | 2018-07-06 | 1 | -0/+10 |
* | bpo-12486: Document tokenize.generate_tokens() as public API (#6957) | ![](//www.gravatar.com/avatar/7f1ae3f14fd5b87c2c3f7b36014e185c?s=13&d=retro) Thomas Kluyver | 2018-06-05 | 1 | -3/+6 |
* | bpo-33338: [tokenize] Minor code cleanup (#6573) | ![](//www.gravatar.com/avatar/dbae42afc5ab53e05f3c61d36b9ee7d4?s=13&d=retro) Łukasz Langa | 2018-04-23 | 1 | -11/+8 |
* | bpo-33260: Regenerate token.py after removing ASYNC and AWAIT. (GH-6447) | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2018-04-11 | 1 | -1/+1 |
* | bpo-30406: Make async and await proper keywords (#1669) | ![](//www.gravatar.com/avatar/57da4d2e2a527026baaaab35e6872fa5?s=13&d=retro) Jelle Zijlstra | 2017-10-05 | 1 | -61/+1 |
* | bpo-25324: copy tok_name before changing it (#1608) | ![](//www.gravatar.com/avatar/0a4a3d9b09139058bfe3cae8c5708d8e?s=13&d=retro) Albert-Jan Nijburg | 2017-05-31 | 1 | -9/+2 |
* | bpo-30377: Simplify handling of COMMENT and NL in tokenize.py (#1607) | ![](//www.gravatar.com/avatar/0a4a3d9b09139058bfe3cae8c5708d8e?s=13&d=retro) Albert-Jan Nijburg | 2017-05-24 | 1 | -5/+3 |
* | bpo-30296 Remove unnecessary tuples, lists, sets, and dicts (#1489) | ![](//www.gravatar.com/avatar/5cea2f3b7f4f6e34fc4d4fdaed37763e?s=13&d=retro) Jon Dufresne | 2017-05-18 | 1 | -1/+1 |
* | Add ELLIPSIS and RARROW. Add tests (#666) | ![](//www.gravatar.com/avatar/920c4b024e9f4d9de2b04bf05f142e78?s=13&d=retro) Jim Fasarakis-Hilliard | 2017-03-14 | 1 | -1/+3 |
* | Issue #26331: Implement the parsing part of PEP 515. | ![](//www.gravatar.com/avatar/e8600d16ba667cc8d7f00ddc9f254340?s=13&d=retro) Brett Cannon | 2016-09-09 | 1 | -8/+9 |
* | Issue #26581: Use the first coding cookie on a line, not the last one. | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2016-03-20 | 1 | -1/+1 |
|\ |
|
| * | Issue #26581: Use the first coding cookie on a line, not the last one. | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2016-03-20 | 1 | -1/+1 |
* | | Issue #25977: Fix typos in Lib/tokenize.py | ![](//www.gravatar.com/avatar/df8e51d7618d5ed7ccbbc8dea9a9afee?s=13&d=retro) Berker Peksag | 2015-12-30 | 1 | -5/+5 |
|\| |
|
| * | Issue #25977: Fix typos in Lib/tokenize.py | ![](//www.gravatar.com/avatar/df8e51d7618d5ed7ccbbc8dea9a9afee?s=13&d=retro) Berker Peksag | 2015-12-30 | 1 | -4/+4 |
* | | Issue 25311: Add support for f-strings to tokenize.py. Also added some commen... | ![](//www.gravatar.com/avatar/2828041405aa313004b6549acf918228?s=13&d=retro) Eric V. Smith | 2015-10-26 | 1 | -51/+67 |
|/ |
|
* | Issue #24619: Simplify async/await tokenization. | ![](//www.gravatar.com/avatar/b7dcc9823f4be3d8f26cdad7a433b670?s=13&d=retro) Yury Selivanov | 2015-07-23 | 1 | -16/+23 |
* | Issue #24619: New approach for tokenizing async/await. | ![](//www.gravatar.com/avatar/b7dcc9823f4be3d8f26cdad7a433b670?s=13&d=retro) Yury Selivanov | 2015-07-22 | 1 | -1/+6 |
* | Issue #20387: Merge test and patch from 3.4.4 | ![](//www.gravatar.com/avatar/163acaf31cfd01645493404a2d379df6?s=13&d=retro) Jason R. Coombs | 2015-06-28 | 1 | -0/+17 |
|\ |
|
| * | Issue #20387: Restore retention of indentation during untokenize. | ![](//www.gravatar.com/avatar/375576ffa391a35beda18fe9f9581d72?s=13&d=retro) Dingyuan Wang | 2015-06-22 | 1 | -0/+17 |
* | | (Merge 3.5) Issue #23840: tokenize.open() now closes the temporary binary file | ![](//www.gravatar.com/avatar/daa45563a98419bb1b6b63904ce71f95?s=13&d=retro) Victor Stinner | 2015-05-26 | 1 | -5/+9 |
|\| |
|
| * | Issue #23840: tokenize.open() now closes the temporary binary file on error to | ![](//www.gravatar.com/avatar/daa45563a98419bb1b6b63904ce71f95?s=13&d=retro) Victor Stinner | 2015-05-26 | 1 | -5/+9 |
* | | PEP 0492 -- Coroutines with async and await syntax. Issue #24017. | ![](//www.gravatar.com/avatar/b7dcc9823f4be3d8f26cdad7a433b670?s=13&d=retro) Yury Selivanov | 2015-05-11 | 1 | -2/+54 |
* | | Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2015-03-11 | 1 | -2/+1 |
|\| |
|
| * | Issue #23615: Modules bz2, tarfile and tokenize now can be reloaded with | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2015-03-11 | 1 | -2/+1 |
* | | Removed duplicated dict entries. | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2015-01-11 | 1 | -1/+0 |
* | | (Merge 3.4) Issue #22599: Enhance tokenize.open() to be able to call it during | ![](//www.gravatar.com/avatar/daa45563a98419bb1b6b63904ce71f95?s=13&d=retro) Victor Stinner | 2014-12-05 | 1 | -3/+4 |
|\| |
|
| * | Issue #22599: Enhance tokenize.open() to be able to call it during Python | ![](//www.gravatar.com/avatar/daa45563a98419bb1b6b63904ce71f95?s=13&d=retro) Victor Stinner | 2014-12-05 | 1 | -3/+4 |
* | | PEP 465: a dedicated infix operator for matrix multiplication (closes #21176) | ![](//www.gravatar.com/avatar/cd2e442c42c95ed534e4197df4300222?s=13&d=retro) Benjamin Peterson | 2014-04-09 | 1 | -2/+3 |
|/ |
|
* | Merge with 3.3 | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-23 | 1 | -1/+1 |
|\ |
|
| * | whitespace | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-23 | 1 | -1/+1 |
* | | Merge with 3.3 | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-23 | 1 | -0/+6 |
|\| |
|
| * | Issue #9974: When untokenizing, use row info to insert backslash+newline. | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-23 | 1 | -0/+6 |
* | | Merge with 3.3 | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-17 | 1 | -13/+11 |
|\| |
|
| * | Issue #8478: Untokenizer.compat now processes first token from iterator input. | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-17 | 1 | -13/+11 |
* | | Untokenize, bad assert: Merge with 3.3 | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-17 | 1 | -1/+3 |
|\| |
|
| * | Untokenize: An logically incorrect assert tested user input validity. | ![](//www.gravatar.com/avatar/d6b9415353e04ffa6de5a8f3aaea0553?s=13&d=retro) Terry Jan Reedy | 2014-02-17 | 1 | -1/+3 |
* | | Issue #18960: Fix bugs with Python source code encoding in the second line. | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2014-01-09 | 1 | -0/+3 |
|\| |
|
| * | Issue #18960: Fix bugs with Python source code encoding in the second line. | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2014-01-09 | 1 | -0/+3 |
* | | #19620: merge with 3.3. | ![](//www.gravatar.com/avatar/003518259e6453b071aeaa7f6e6ed37b?s=13&d=retro) Ezio Melotti | 2013-11-25 | 1 | -1/+1 |
|\| |
|
| * | #19620: Fix typo in docstring (noticed by Christopher Welborn). | ![](//www.gravatar.com/avatar/003518259e6453b071aeaa7f6e6ed37b?s=13&d=retro) Ezio Melotti | 2013-11-25 | 1 | -1/+1 |
* | | Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2013-09-16 | 1 | -4/+4 |
|\| |
|
| * | Issue #18873: The tokenize module, IDLE, 2to3, and the findnocoding.py script | ![](//www.gravatar.com/avatar/4c01705256aa2160c1354790e8c154db?s=13&d=retro) Serhiy Storchaka | 2013-09-16 | 1 | -4/+4 |
* | | Replace IOError with OSError (#16715) | ![](//www.gravatar.com/avatar/7775d42d960a69e98fecf270bdeb6f57?s=13&d=retro) Andrew Svetlov | 2012-12-25 | 1 | -1/+1 |
|/ |
|
* | #16152: merge with 3.2. | ![](//www.gravatar.com/avatar/003518259e6453b071aeaa7f6e6ed37b?s=13&d=retro) Ezio Melotti | 2012-11-03 | 1 | -1/+3 |
|\ |
|