don't assume default device in towercontext (#295)
don't assume default device in towercontext (#295)

ppwwyyxx/tensorpack,eyaler/tensorpack,haamoon/tensorpack,eyaler/tensorpack,ppwwyyxx/tensorpack,haamoon/tensorpack,haamoon/tensorpack