Tokenizer.cs File Reference

Go to the source code of this file.

Classes
interface	Mercury.Scanning.ITokenizer
	The tokenizer interface. More...
class	Mercury.Scanning.Tokenizer
	A default implementation of ITokenizer interface using Microsoft Regular Expressions. Splits tokens in the following fashion: More...

Namespaces
package	Mercury.Scanning

Enumerations
enum	Mercury.Scanning.TokenizerOptions {   Mercury.Scanning.TokenizerOptions.None = 0, Mercury.Scanning.TokenizerOptions.CompiledMatch = 1, Mercury.Scanning.TokenizerOptions.IgnoreNumbers = 2, Mercury.Scanning.TokenizerOptions.IgnoreCase = 4,   Mercury.Scanning.TokenizerOptions.IgnoreQuotes = 8, Mercury.Scanning.TokenizerOptions.IgnoreSigns = 16, Mercury.Scanning.TokenizerOptions.StrictNumbers = 32 }
	Options for the tokenizer More...