[Overview][Types][Classes][Index] |
Tokenizers constructor
Source position: tiTokenLibrary.pas line 39
public constructor TTokens.Create( |
const OriginalString: string; |
const Separators: string; |
const LeftMark: Char; |
const RightMark: Char; |
const Escape: Char; |
const SeparatorBetweenTokens: TTokenSeparator = tsMultipleSeparatorsBetweenTokens |
); overload; |
OriginalString |
|
The original string containing tokens and to be tokenized. |
Separators |
|
Defines one or more separators to look for. |
LeftMark |
|
The left most marker to define a single token. It does not need to be the same as the Right Marker. |
RightMark |
|
The right most marker to define a single token. It does not need to be the same as the Left Marker. |
Escape |
|
Escape string to be removed from the OriginalString. |
SeparatorBetweenTokens |
|
How to handle separators between tokens. |
Tokenizers constructor. This is where it all begins.