Module net.luis.utils
Package net.luis.utils.io.token
package net.luis.utils.io.token
-
ClassDescriptionClass which represents the position of a token in a file.
The line, character in line and character numbers are 0-based.A class that reads tokens from a string input based on defined token definitions.
It processes the input string, identifies tokens, and returns a list of tokens.
It handles escape sequences and allows for custom token definitions and separators.A class that tracks the position of the current character in the input string.
It keeps track of the line number, character position, and character index in the line.