set utf8 mode on the input and output files, instead of on stdin and stdout, which are not used.  This allows case variants of non-ASCII characters to be recognized correctly
set utf8 mode on the input and output files, instead of on stdin and stdout, which are not used.  This allows case variants of non-ASCII characters to be recognized correctly

git-svn-id: f5d636078e73450abf2183305c5e43efec2a5605@2987 1f5c12ca-751b-0410-a591-d2e778427230

hychyc07/mosesdecoder,emjotde/mosesdecoder_nmt,moses-smt/mosesdecoder,alvations/mosesdecoder,hychyc07/mosesdecoder,tofula/mosesdecoder,emjotde/mosesdecoder_nmt,alvations/mosesdecoder,tofula/mosesdecoder,hychyc07/mosesdecoder,hychyc07/mosesdecoder,emjotde/mosesdecoder_nmt,tofula/mosesdecoder,hychyc07/mosesdecoder,KonceptGeek/mosesdecoder,KonceptGeek/mosesdecoder,tofula/mosesdecoder,hychyc07/mosesdecoder,pjwilliams/mosesdecoder,alvations/mosesdecoder,moses-smt/mosesdecoder,alvations/mosesdecoder,pjwilliams/mosesdecoder,alvations/mosesdecoder,alvations/mosesdecoder,pjwilliams/mosesdecoder,emjotde/mosesdecoder_nmt,KonceptGeek/mosesdecoder,pjwilliams/mosesdecoder,tofula/mosesdecoder,alvations/mosesdecoder,hychyc07/mosesdecoder,KonceptGeek/mosesdecoder,hychyc07/mosesdecoder,KonceptGeek/mosesdecoder,pjwilliams/mosesdecoder,KonceptGeek/mosesdecoder,emjotde/mosesdecoder_nmt,KonceptGeek/mosesdecoder,moses-smt/mosesdecoder,alvations/mosesdecoder,KonceptGeek/mosesdecoder,moses-smt/mosesdecoder,alvations/mosesdecoder,tofula/mosesdecoder,emjotde/mosesdecoder_nmt,emjotde/mosesdecoder_nmt,KonceptGeek/mosesdecoder,tofula/mosesdecoder,tofula/mosesdecoder,moses-smt/mosesdecoder,pjwilliams/mosesdecoder,hychyc07/mosesdecoder,hychyc07/mosesdecoder,moses-smt/mosesdecoder,moses-smt/mosesdecoder,alvations/mosesdecoder,pjwilliams/mosesdecoder,moses-smt/mosesdecoder,tofula/mosesdecoder,pjwilliams/mosesdecoder,pjwilliams/mosesdecoder,alvations/mosesdecoder,tofula/mosesdecoder,moses-smt/mosesdecoder,moses-smt/mosesdecoder,emjotde/mosesdecoder_nmt,emjotde/mosesdecoder_nmt,tofula/mosesdecoder,KonceptGeek/mosesdecoder,pjwilliams/mosesdecoder,moses-smt/mosesdecoder,emjotde/mosesdecoder_nmt