Updated lexer to have a state with read_token to shift read the next token, alsoi added a reset_offset to reset offset
Updated lexer to have a state with read_token to shift read the next token, alsoi added a reset_offset to reset offset

pankajdoharey/Esha