Mercury library 1.0 Translation of CFG grammars into an object model (Bachelor's thesis).

- Main Page
- Packages
- Classes
- Files

- Class List
- Class Index
- Class Hierarchy
- Class Members

All Classes Namespaces Files Functions Variables Enumerations Enumerator Properties
Public Member Functions | List of all members
Mercury.Scanning.ITokenizer Interface Reference

The tokenizer interface. More...

Inheritance diagram for Mercury.Scanning.ITokenizer:

## Public Member Functions
IList< Token > | Tokenize (string input)
| Splits source string into tokens. More...

## Detailed Description

The tokenizer interface.

Definition at line 14 of file Tokenizer.cs.

## Member Function Documentation

IList<Token> Mercury.Scanning.ITokenizer.Tokenize | ( | string | input | ) |

Splits source string into tokens.

Parameters

  input | Source string.

Returns
  List of tokens.

Implemented in Mercury.Scanning.Tokenizer.

The documentation for this interface was generated from the following file:

- Mercury/Mercury/Scanning/Tokenizer.cs