diff options
| author | Josh Rahm <joshuarahm@gmail.com> | 2023-01-08 22:44:44 -0700 |
|---|---|---|
| committer | Josh Rahm <joshuarahm@gmail.com> | 2023-01-08 22:47:50 -0700 |
| commit | def481d234ce5e1671d9faaa539477de8cd14640 (patch) | |
| tree | 76bcd95f030571c506a73ddb021eeed7a6f6aec1 /src/Language/Fiddle/Tokenizer.hs | |
| parent | 0c45ef8884ec82d26c47e952132d54d4bb8a9238 (diff) | |
| download | fiddle-def481d234ce5e1671d9faaa539477de8cd14640.tar.gz fiddle-def481d234ce5e1671d9faaa539477de8cd14640.tar.bz2 fiddle-def481d234ce5e1671d9faaa539477de8cd14640.zip | |
Parser is able to parse the goal file.
Diffstat (limited to 'src/Language/Fiddle/Tokenizer.hs')
| -rw-r--r-- | src/Language/Fiddle/Tokenizer.hs | 3 |
1 files changed, 3 insertions, 0 deletions
diff --git a/src/Language/Fiddle/Tokenizer.hs b/src/Language/Fiddle/Tokenizer.hs index ec41042..4e06b92 100644 --- a/src/Language/Fiddle/Tokenizer.hs +++ b/src/Language/Fiddle/Tokenizer.hs @@ -108,3 +108,6 @@ parseToken = spaces *> tok parseToken' <* spaces tokenize :: String -> Text -> Either ParseError [Token SourceSpan] tokenize = Text.Parsec.runParser (many parseToken <* eof) () + +tokenType :: Token SourceSpan -> T +tokenType (Token t _) = t |