CodeTokenizer

Description

Source code and identifier name tokenizer for Pharo

Details

Source

GitHub

Dialect

pharo (25% confidence)

License

MIT

Created

Jan. 10, 2019

Updated

Sept. 10, 2019

README excerpt

# CodeTokenizer
Source code and identifier name tokenizer for Pharo

## Installation
To install `CodeTokenizer`, go to the Playground (`Ctrl+OW`) in your fresh Pharo image and execute the following Metacello script (select it and press Do-it button or `Ctrl+D`):

```smalltalk
Metacello new
  baseline: 'CodeTokenizer';
  repository: 'github://olekscode/CodeTokenizer/src';
  load.
```