fixed tokens larger than buffer + cases when eof reached.
fixed tokens larger than buffer + cases when eof reached.


DanielUranga/neko,danteinforno/neko,pperidont/neko,DanielUranga/neko,pperidont/neko,danteinforno/neko,danteinforno/neko,DanielUranga/neko