| Safe Haskell | None |
|---|---|
| Language | Haskell2010 |
Token
Description
Common token representation used.
Documentation
Token just classifies to blank, operator, and the style class
Constructors
| TBlank | Whitespace or comments |
| TOperator | Operators |
| TKeyword | Language-specific keywords |
| TCons | Constructors |
| TVar | Variables, function names |
| TNum | Numbers |
| TOther | Other tokens |
| TString | String constants |
| TTikz Text | TikZmark in a comment |
Location is just line and column (not a slice.)
Constructors
| MyLoc | |
type Tokenized = (MyTok, MyLoc, Text) Source #
Records tokenized and converted to common token format.
Given opening text, and closing text,
check that input is "braced" by these, and strip them.
Return Nothing if input text does not match.