Fix several tokenizer bugs.
Fix several tokenizer bugs.

Real-Currents/brackets,ricciozhang/brackets,CapeSepias/brackets,Mosoc/brackets,abhishekbhalani/brackets,Live4Code/brackets,falcon1812/brackets,pratts/brackets,L0g1k/brackets,NGHGithub/brackets,michaeljayt/brackets,riselabs-ufba/RiPLE-HC-ExperimentalData,shiyamkumar/brackets,massimiliano76/brackets,ropik/brackets,zhukaixy/brackets,malinkie/brackets,weebygames/brackets,Andrey-Pavlov/brackets,stowball/brackets,fabricadeaplicativos/brackets,sedge/nimble,cdot-brackets-extensions/nimble-htmlLint,jacobnash/brackets,mozilla/brackets,jacobnash/brackets,hanmichael/brackets,karevn/brackets,robertkarlsson/brackets,bidle/brackets,flukeout/brackets,shiyamkumar/brackets,ChaofengZhou/brackets,jacobnash/brackets,Jonavin/brackets,ScalaInc/brackets,jacobnash/brackets,NGHGithub/brackets,rlugojr/brackets,StephanieMak/brackets,massimiliano76/brackets,zcbenz/brackets,raygervais/brackets,Real-Currents/brackets,raygervais/brackets,y12uc231/brackets,lunode/brackets,thehogfather/brackets,richmondgozarin/brackets,L0g1k/brackets,cosmosgenius/brackets,albertinad/brackets,ChaofengZhou/brackets,dangkhue27/brackets,udhayam/brackets,gupta-tarun/brackets,Rajat-dhyani/brackets,wangjun/brackets,fashionsun/brackets,andrewnc/brackets,kolipka/brackets,alicoding/nimble,jiimaho/brackets,udhayam/brackets,lunode/brackets,dtcom/MyPSDBracket,y12uc231/brackets,amrelnaggar/brackets,goldcase/brackets,lovewitty/brackets,Mosoc/brackets,xantage/brackets,xantage/brackets,zLeonjo/brackets,m66n/brackets,show0017/brackets,malinkie/brackets,nucliweb/brackets,ls2uper/brackets,MahadevanSrinivasan/brackets,Wikunia/brackets,NickersF/brackets,rafaelstz/brackets,No9/brackets,chambej/brackets,riselabs-ufba/RiPLE-HC-ExperimentalData,baig/brackets,ls2uper/brackets,fastrde/brackets,L0g1k/quickfire-old,youprofit/brackets,pomadgw/brackets,treejames/brackets,mjurczyk/brackets,chrismoulton/brackets,Free-Technology-Guild/brackets,Free-Technology-Guild/brackets,keir-rex/brackets,ForkedRepos/brackets,massimiliano76/brackets,SidBala/brackets,zLeonjo/brackets,Rynaro/brackets,nucliweb/brackets,2youyouo2/cocoslite,jmarkina/brackets,richmondgozarin/brackets,fabricadeaplicativos/brackets,agreco/brackets,sgupta7857/brackets,MantisWare/brackets,ScalaInc/brackets,mcanthony/brackets,adobe/brackets,abhisekp/brackets,thehogfather/brackets,pratts/brackets,JordanTheriault/brackets,RobertJGabriel/brackets,sprintr/brackets,m66n/brackets,falcon1812/brackets,fvntr/brackets,ralic/brackets,fashionsun/brackets,resir014/brackets,shiyamkumar/brackets,mcanthony/brackets,gcommetti/brackets,Cartman0/brackets,y12uc231/brackets,fashionsun/brackets,NGHGithub/brackets,revi/brackets,zaggino/brackets-electron,IAmAnubhavSaini/brackets,jiawenbo/brackets,resir014/brackets,cdot-brackets-extensions/nimble-htmlLint,m66n/brackets,srinivashappy/brackets,GHackAnonymous/brackets,simon66/brackets,ficristo/brackets,Rynaro/brackets,lovewitty/brackets,L0g1k/quickfire-old,NGHGithub/brackets,busykai/brackets,youprofit/brackets,kolipka/brackets,bidle/brackets,pkdevbox/brackets,quasto/ArduinoStudio,tan9/brackets,Fcmam5/brackets,pomadgw/brackets,Jonavin/brackets,xantage/brackets,nucliweb/brackets,Rynaro/brackets,chambej/brackets,CapeSepias/brackets,mjurczyk/brackets,sgupta7857/brackets,JordanTheriault/brackets,mcanthony/brackets,wangjun/brackets,FTG-003/brackets,karevn/brackets,gcommetti/brackets,revi/brackets,2youyouo2/cocoslite,pkdevbox/brackets,zaggino/brackets-electron,pratts/brackets,ryanackley/tailor,emanziano/brackets,NKcentinel/brackets,ls2uper/brackets,jiawenbo/brackets,lovewitty/brackets,raygervais/brackets,jiimaho/brackets,ForkedRepos/brackets,ashleygwilliams/brackets,iamchathu/brackets,fronzec/brackets,eric-stanley/brackets,ralic/brackets,rafaelstz/brackets,sophiacaspar/brackets,raygervais/brackets,srhbinion/brackets,Fcmam5/brackets,quasto/ArduinoStudio,ggusman/present,arduino-org/ArduinoStudio,michaeljayt/brackets,82488059/brackets,CoherentLabs/brackets,thr0w/brackets,srhbinion/brackets,youprofit/brackets,baig/brackets,wakermahmud/brackets,abhisekp/brackets,arduino-org/ArduinoStudio,falcon1812/brackets,Denisov21/brackets,petetnt/brackets,CoherentLabs/brackets,veveykocute/brackets,TylerL-uxai/brackets,simon66/brackets,fronzec/brackets,L0g1k/brackets,karevn/brackets,keir-rex/brackets,gwynndesign/brackets,tan9/brackets,ScalaInc/brackets,sprintr/brackets,pomadgw/brackets,uwsd/brackets,gupta-tarun/brackets,jiawenbo/brackets,wesleifreitas/brackets,gupta-tarun/brackets,treejames/brackets,jiawenbo/brackets,brianjking/brackets,Denisov21/brackets,ForkedRepos/brackets,sprintr/brackets,siddharta1337/brackets,ecwebservices/brackets,mozilla/brackets,wakermahmud/brackets,Lojsan123/brackets,humphd/brackets,marcominetti/brackets,shal1y/brackets,Denisov21/brackets,SebastianBoyd/sebastianboyd.github.io-OLD,richmondgozarin/brackets,StephanieMak/brackets,Rajat-dhyani/brackets,revi/brackets,show0017/brackets,hanmichael/brackets,zcbenz/brackets,Lojsan123/brackets,zaggino/brackets-electron,L0g1k/quickfire-old,udhayam/brackets,ricciozhang/brackets,jmarkina/brackets,gcommetti/brackets,mjurczyk/brackets,alicoding/nimble,pratts/brackets,arduino-org/ArduinoStudio,RobertJGabriel/brackets,NKcentinel/brackets,fvntr/brackets,netlams/brackets,alexkid64/brackets,agreco/brackets,chinnyannieb/brackets,ecwebservices/brackets,Wikunia/brackets,lunode/brackets,Andrey-Pavlov/brackets,ForkedRepos/brackets,jiimaho/brackets,amrelnaggar/brackets,busykai/brackets,chambej/brackets,macdg/brackets,No9/brackets,Th30/brackets,ricciozhang/brackets,Andrey-Pavlov/brackets,resir014/brackets,MahadevanSrinivasan/brackets,thehogfather/brackets,rlugojr/brackets,CapeSepias/brackets,MantisWare/brackets,wakermahmud/brackets,pkdevbox/brackets,ChaofengZhou/brackets,eric-stanley/brackets,agreco/brackets,zcbenz/brackets,SidBala/brackets,dangkhue27/brackets,siddharta1337/brackets,fastrde/brackets,L0g1k/quickfire-old,treejames/brackets,sgupta7857/brackets,rlugojr/brackets,chrismoulton/brackets,pkdevbox/brackets,tan9/brackets,raygervais/brackets,ficristo/brackets,chrismoulton/brackets,mat-mcloughlin/brackets,ryanackley/tailor,alexkid64/brackets,petetnt/brackets,wesleifreitas/brackets,cdot-brackets-extensions/nimble-htmlLint,CoherentLabs/brackets,kilroy23/brackets,Th30/brackets,chrisle/brackets,MarcelGerber/brackets,fvntr/brackets,hanmichael/brackets,udhayam/brackets,ashleygwilliams/brackets,kolipka/brackets,gwynndesign/brackets,sprintr/brackets,sophiacaspar/brackets,andrewnc/brackets,thr0w/brackets,weebygames/brackets,dtcom/MyPSDBracket,StephanieMak/brackets,bidle/brackets,brianjking/brackets,humphd/brackets,RobertJGabriel/brackets,flukeout/brackets,2youyouo2/cocoslite,veveykocute/brackets,marcominetti/brackets,amrelnaggar/brackets,No9/brackets,bidle/brackets,SebastianBoyd/sebastianboyd.github.io-OLD,eric-stanley/brackets,stowball/brackets,MahadevanSrinivasan/brackets,82488059/brackets,Rajat-dhyani/brackets,chrisle/brackets,Mosoc/brackets,fashionsun/brackets,albertinad/brackets,Free-Technology-Guild/brackets,ralic/brackets,sophiacaspar/brackets,youprofit/brackets,Denisov21/brackets,Th30/brackets,uwsd/brackets,iamchathu/brackets,malinkie/brackets,Pomax/brackets,wesleifreitas/brackets,shal1y/brackets,wesleifreitas/brackets,mat-mcloughlin/brackets,fastrde/brackets,Live4Code/brackets,ecwebservices/brackets,xantage/brackets,ralic/brackets,cosmosgenius/brackets,adrianhartanto0/brackets,TylerL-uxai/brackets,y12uc231/brackets,FTG-003/brackets,treejames/brackets,ropik/brackets,srhbinion/brackets,mjurczyk/brackets,hanmichael/brackets,Th30/brackets,No9/brackets,riselabs-ufba/RiPLE-HC-ExperimentalData,sprintr/brackets,MarcelGerber/brackets,pkdevbox/brackets,NGHGithub/brackets,gcommetti/brackets,NKcentinel/brackets,Lojsan123/brackets,agreco/brackets,albertinad/brackets,MarcelGerber/brackets,stowball/brackets,keir-rex/brackets,michaeljayt/brackets,shal1y/brackets,kolipka/brackets,MarcelGerber/brackets,RamirezWillow/brackets,dtcom/MyPSDBracket,pomadgw/brackets,sedge/nimble,m66n/brackets,simon66/brackets,Andrey-Pavlov/brackets,sedge/nimble,zcbenz/brackets,robertkarlsson/brackets,ryanackley/tailor,2youyouo2/cocoslite,RamirezWillow/brackets,fastrde/brackets,stowball/brackets,ChaofengZhou/brackets,cosmosgenius/brackets,ggusman/present,quasto/ArduinoStudio,Real-Currents/brackets,michaeljayt/brackets,sgupta7857/brackets,mozilla/brackets,RamirezWillow/brackets,gwynndesign/brackets,gideonthomas/brackets,resir014/brackets,emanziano/brackets,wangjun/brackets,fcjailybo/brackets,IAmAnubhavSaini/brackets,shal1y/brackets,IAmAnubhavSaini/brackets,show0017/brackets,jmarkina/brackets,humphd/brackets,ficristo/brackets,bidle/brackets,ashleygwilliams/brackets,weebygames/brackets,srinivashappy/brackets,FTG-003/brackets,netlams/brackets,lovewitty/brackets,iamchathu/brackets,chrismoulton/brackets,thehogfather/brackets,cdot-brackets-extensions/nimble-htmlLint,falcon1812/brackets,andrewnc/brackets,veveykocute/brackets,FTG-003/brackets,falcon1812/brackets,shiyamkumar/brackets,emanziano/brackets,eric-stanley/brackets,weebygames/brackets,GHackAnonymous/brackets,chinnyannieb/brackets,netlams/brackets,abhishekbhalani/brackets,robertkarlsson/brackets,Jonavin/brackets,chinnyannieb/brackets,alicoding/nimble,keir-rex/brackets,ForkedRepos/brackets,riselabs-ufba/RiPLE-HC-ExperimentalData,zhukaixy/brackets,StephanieMak/brackets,massimiliano76/brackets,uwsd/brackets,Fcmam5/brackets,Jonavin/brackets,xantage/brackets,JordanTheriault/brackets,revi/brackets,zhukaixy/brackets,chrisle/brackets,RobertJGabriel/brackets,siddharta1337/brackets,ralic/brackets,MarcelGerber/brackets,gideonthomas/brackets,chambej/brackets,TylerL-uxai/brackets,Wikunia/brackets,NickersF/brackets,quasto/ArduinoStudio,fvntr/brackets,Real-Currents/brackets,alexkid64/brackets,Wikunia/brackets,fronzec/brackets,MantisWare/brackets,zaggino/brackets-electron,gwynndesign/brackets,veveykocute/brackets,Cartman0/brackets,wangjun/brackets,srinivashappy/brackets,TylerL-uxai/brackets,malinkie/brackets,iamchathu/brackets,GHackAnonymous/brackets,mozilla/brackets,MantisWare/brackets,gcommetti/brackets,goldcase/brackets,rafaelstz/brackets,Pomax/brackets,netlams/brackets,simon66/brackets,alexkid64/brackets,chinnyannieb/brackets,Fcmam5/brackets,adrianhartanto0/brackets,ricciozhang/brackets,JordanTheriault/brackets,kilroy23/brackets,rlugojr/brackets,adrianhartanto0/brackets,andrewnc/brackets,macdg/brackets,pratts/brackets,pomadgw/brackets,goldcase/brackets,petetnt/brackets,chinnyannieb/brackets,cosmosgenius/brackets,srinivashappy/brackets,dangkhue27/brackets,kilroy23/brackets,mcanthony/brackets,ashleygwilliams/brackets,Cartman0/brackets,rafaelstz/brackets,zLeonjo/brackets,goldcase/brackets,busykai/brackets,nucliweb/brackets,NKcentinel/brackets,phillipalexander/brackets,gideonthomas/brackets,siddharta1337/brackets,tan9/brackets,quasto/ArduinoStudio,srhbinion/brackets,chrisle/brackets,ScalaInc/brackets,gupta-tarun/brackets,chrisle/brackets,CapeSepias/brackets,shal1y/brackets,dangkhue27/brackets,amrelnaggar/brackets,Real-Currents/brackets,alicoding/nimble,baig/brackets,weebygames/brackets,mat-mcloughlin/brackets,hanmichael/brackets,Rynaro/brackets,NickersF/brackets,fcjailybo/brackets,ggusman/present,busykai/brackets,sedge/nimble,Live4Code/brackets,flukeout/brackets,SebastianBoyd/sebastianboyd.github.io-OLD,Live4Code/brackets,GHackAnonymous/brackets,arduino-org/ArduinoStudio,thehogfather/brackets,uwsd/brackets,macdg/brackets,Live4Code/brackets,GHackAnonymous/brackets,wangjun/brackets,Th30/brackets,RamirezWillow/brackets,82488059/brackets,m66n/brackets,jiimaho/brackets,netlams/brackets,emanziano/brackets,Pomax/brackets,FTG-003/brackets,fcjailybo/brackets,Real-Currents/brackets,ls2uper/brackets,amrelnaggar/brackets,ropik/brackets,jmarkina/brackets,SebastianBoyd/sebastianboyd.github.io-OLD,lunode/brackets,mat-mcloughlin/brackets,ChaofengZhou/brackets,chrismoulton/brackets,lunode/brackets,shiyamkumar/brackets,srinivashappy/brackets,fabricadeaplicativos/brackets,RamirezWillow/brackets,veveykocute/brackets,treejames/brackets,SebastianBoyd/sebastianboyd.github.io-OLD,fronzec/brackets,petetnt/brackets,adrianhartanto0/brackets,NKcentinel/brackets,chambej/brackets,mcanthony/brackets,michaeljayt/brackets,thr0w/brackets,Free-Technology-Guild/brackets,humphd/brackets,lovewitty/brackets,richmondgozarin/brackets,2youyouo2/cocoslite,show0017/brackets,abhishekbhalani/brackets,zaggino/brackets-electron,karevn/brackets,revi/brackets,sedge/nimble,gideonthomas/brackets,ryanackley/tailor,Lojsan123/brackets,phillipalexander/brackets,Andrey-Pavlov/brackets,arduino-org/ArduinoStudio,riselabs-ufba/RiPLE-HC-ExperimentalData,kilroy23/brackets,adobe/brackets,fabricadeaplicativos/brackets,adobe/brackets,adrianhartanto0/brackets,Cartman0/brackets,Fcmam5/brackets,NickersF/brackets,richmondgozarin/brackets,jacobnash/brackets,tan9/brackets,nucliweb/brackets,Lojsan123/brackets,mjurczyk/brackets,udhayam/brackets,busykai/brackets,stowball/brackets,thr0w/brackets,phillipalexander/brackets,Pomax/brackets,karevn/brackets,zhukaixy/brackets,eric-stanley/brackets,Pomax/brackets,brianjking/brackets,simon66/brackets,goldcase/brackets,rlugojr/brackets,StephanieMak/brackets,RobertJGabriel/brackets,y12uc231/brackets,emanziano/brackets,82488059/brackets,Jonavin/brackets,zLeonjo/brackets,ashleygwilliams/brackets,humphd/brackets,NickersF/brackets,sophiacaspar/brackets,jiawenbo/brackets,JordanTheriault/brackets,mozilla/brackets,Free-Technology-Guild/brackets,MahadevanSrinivasan/brackets,Cartman0/brackets,TylerL-uxai/brackets,L0g1k/quickfire-old,fabricadeaplicativos/brackets,adobe/brackets,phillipalexander/brackets,fvntr/brackets,ecwebservices/brackets,resir014/brackets,wakermahmud/brackets,macdg/brackets,ScalaInc/brackets,jmarkina/brackets,albertinad/brackets,IAmAnubhavSaini/brackets,zaggino/brackets-electron,uwsd/brackets,fastrde/brackets,alexkid64/brackets,Rajat-dhyani/brackets,ricciozhang/brackets,flukeout/brackets,massimiliano76/brackets,baig/brackets,brianjking/brackets,thr0w/brackets,ls2uper/brackets,flukeout/brackets,ropik/brackets,dtcom/MyPSDBracket,siddharta1337/brackets,kolipka/brackets,IAmAnubhavSaini/brackets,petetnt/brackets,keir-rex/brackets,Mosoc/brackets,MantisWare/brackets,gupta-tarun/brackets,abhisekp/brackets,No9/brackets,Mosoc/brackets,kilroy23/brackets,wesleifreitas/brackets,MahadevanSrinivasan/brackets,Rynaro/brackets,Denisov21/brackets,Wikunia/brackets,andrewnc/brackets,srhbinion/brackets,baig/brackets,ggusman/present,sophiacaspar/brackets,macdg/brackets,phillipalexander/brackets,SidBala/brackets,Rajat-dhyani/brackets,malinkie/brackets,fronzec/brackets,ficristo/brackets,SidBala/brackets,robertkarlsson/brackets,fcjailybo/brackets,82488059/brackets,youprofit/brackets,robertkarlsson/brackets,rafaelstz/brackets,albertinad/brackets,dangkhue27/brackets,fcjailybo/brackets,SidBala/brackets,sgupta7857/brackets,abhisekp/brackets,abhisekp/brackets,L0g1k/brackets,adobe/brackets,CoherentLabs/brackets,zLeonjo/brackets,iamchathu/brackets,zhukaixy/brackets,wakermahmud/brackets,riselabs-ufba/RiPLE-HC-ExperimentalData,ecwebservices/brackets,gideonthomas/brackets,CapeSepias/brackets,brianjking/brackets,jiimaho/brackets,fashionsun/brackets,ficristo/brackets