SPARK-1115: Catch depickling errors
SPARK-1115: Catch depickling errors

This surroungs the complete worker code in a try/except block so we catch any error that arrives. An example would be the depickling failing for some reason

@JoshRosen

Author: Bouke van der Bijl <boukevanderbijl@gmail.com>

Closes #644 from bouk/catch-depickling-errors and squashes the following commits:

f0f67cc [Bouke van der Bijl] Lol indentation
0e4d504 [Bouke van der Bijl] Surround the complete python worker with the try block

huang1900/spark,alunarbeach/spark,vinodkc/spark,tengpeng/spark,patrick-nicholson/spark,JoshRosen/spark,mahak/spark,tejasapatil/spark,UndeadBaneGitHub/spark,sahilTakiar/spark,jiangxb1987/spark,witgo/spark,narahari92/spark,mike0sv/spark,markhamstra/spark,lvdongr/spark,nlalevee/spark,maropu/spark,srowen/spark,jiangxb1987/spark,facaiy/spark,loneknightpy/spark,zuotingbing/spark,ajaysaini725/spark,caneGuy/spark,kissmetrics/spark,holdenk/spark,akopich/spark,aray/spark,darionyaphet/spark,minixalpha/spark,kimoonkim/spark,poffuomo/spark,xuanyuanking/spark,yanboliang/spark,icexelloss/spark,WindCanDie/spark,icexelloss/spark,wangyum/spark,cloud-fan/spark,zhouyejoe/spark,mahak/spark,UndeadBaneGitHub/spark,xflin/spark,eyalfa/spark,ioana-delaney/spark,HyukjinKwon/spark,caneGuy/spark,jrshust/spark,esi-mineset/spark,darionyaphet/spark,setjet/spark,eyalfa/spark,szhem/spark,ahnqirage/spark,haowu80s/spark,michalsenkyr/spark,jlopezmalla/spark,nlalevee/spark,mdespriee/spark,liutang123/spark,huang1900/spark,cloud-fan/spark,kimoonkim/spark,srowen/spark,shaneknapp/spark,patrick-nicholson/spark,joseph-torres/spark,goldmedal/spark,loneknightpy/spark,SHASHANKB/spark,tejasapatil/spark,debugger87/spark,JerryLead/spark,publicRoman/spark,rednaxelafx/apache-spark,pronix/spark,MLnick/spark,kiszk/spark,ueshin/apache-spark,wangmiao1981/spark,lvdongr/spark,minixalpha/spark,Aegeaner/spark,ConeyLiu/spark,ptkool/spark,kevinyu98/spark,Panos-Bletsos/spark-cost-model-optimizer,Panos-Bletsos/spark-cost-model-optimizer,kiszk/spark,janewangfb/spark,panfengfeng/spark,ConeyLiu/spark,mahak/spark,gengliangwang/spark,bOOm-X/spark,map222/spark,icexelloss/spark,sachintyagi22/spark,mzl9039/spark,chuckchen/spark,alunarbeach/spark,nchammas/spark,sryza/spark,1haodian/spark,mzl9039/spark,xflin/spark,saturday-shi/spark,ahnqirage/spark,big-pegasus/spark,adrian-ionescu/apache-spark,SHASHANKB/spark,holdenk/spark,aokolnychyi/spark,taroplus/spark,ericvandenbergfb/spark,SnappyDataInc/spark,michalsenkyr/spark,someorz/spark,spark-test/spark,debugger87/spark,zzcclp/spark,shuangshuangwang/spark,bravo-zhang/spark,metamx/spark,saturday-shi/spark,guoxiaolongzte/spark,hvanhovell/spark,markhamstra/spark,ahnqirage/spark,dongjoon-hyun/spark,zhouyejoe/spark,mahak/spark,actuaryzhang/spark,caneGuy/spark,michalsenkyr/spark,gengliangwang/spark,liyichao/spark,wangyum/spark,dbtsai/spark,big-pegasus/spark,pgandhi999/spark,milliman/spark,lvdongr/spark,metamx/spark,jianran/spark,map222/spark,ibm-research-ireland/sparkoscope,wzhfy/spark,gengliangwang/spark,shaneknapp/spark,map222/spark,witgo/spark,markhamstra/spark,rednaxelafx/apache-spark,mzl9039/spark,WeichenXu123/spark,nilsgrabbert/spark,andrewor14/spark,sryza/spark,shuangshuangwang/spark,setjet/spark,aray/spark,BryanCutler/spark,andrewor14/iolap,tejasapatil/spark,sahilTakiar/spark,xuanyuanking/spark,techaddict/spark,stanzhai/spark,hvanhovell/spark,caneGuy/spark,guoxiaolongzte/spark,andrewor14/iolap,mike0sv/spark,dongjoon-hyun/spark,bOOm-X/spark,wangmiao1981/spark,zzcclp/spark,HyukjinKwon/spark,saltstar/spark,kiszk/spark,skonto/spark,saturday-shi/spark,SHASHANKB/spark,Panos-Bletsos/spark-cost-model-optimizer,someorz/spark,byakuinss/spark,liyichao/spark,highfei2011/spark,zzcclp/spark,sureshthalamati/spark,xflin/spark,byakuinss/spark,esi-mineset/spark,apache-spark-on-k8s/spark,andrewor14/iolap,akopich/spark,liutang123/spark,someorz/spark,loneknightpy/spark,facaiy/spark,techaddict/spark,gengliangwang/spark,aosagie/spark,gioenn/xSpark,markhamstra/spark,aray/spark,bravo-zhang/spark,jianran/spark,holdenk/spark,sureshthalamati/spark,kiszk/spark,kissmetrics/spark,haowu80s/spark,andrewor14/spark,icexelloss/spark,tengpeng/spark,vinodkc/spark,sahilTakiar/spark,joseph-torres/spark,witgo/spark,patrick-nicholson/spark,apache/spark,mdespriee/spark,narahari92/spark,chuckchen/spark,jianran/spark,ioana-delaney/spark,kiszk/spark,debugger87/spark,zero323/spark,ueshin/apache-spark,setjet/spark,stanzhai/spark,holdenk/spark,holdenk/spark,wzhfy/spark,xflin/spark,hhbyyh/spark,icexelloss/spark,SnappyDataInc/spark,someorz/spark,byakuinss/spark,alunarbeach/spark,ron8hu/spark,sachintyagi22/spark,goldmedal/spark,xuanyuanking/spark,zhouyejoe/spark,guoxiaolongzte/spark,panfengfeng/spark,apache/spark,nlalevee/spark,ueshin/apache-spark,narahari92/spark,liutang123/spark,actuaryzhang/spark,dbtsai/spark,wzhfy/spark,nilsgrabbert/spark,BryanCutler/spark,cin/spark,big-pegasus/spark,maropu/spark,dongjoon-hyun/spark,ericvandenbergfb/spark,bdrillard/spark,milliman/spark,SnappyDataInc/spark,jiangxb1987/spark,actuaryzhang/spark,tengpeng/spark,pgandhi999/spark,map222/spark,byakuinss/spark,srowen/spark,JerryLead/spark,shaneknapp/spark,WeichenXu123/spark,mike0sv/spark,darionyaphet/spark,zero323/spark,big-pegasus/spark,ahnqirage/spark,zuotingbing/spark,goldmedal/spark,dhruve/spark,apache/spark,zhouyejoe/spark,wzhfy/spark,nchammas/spark,lxsmnv/spark,dongjoon-hyun/spark,lxsmnv/spark,bdrillard/spark,ptkool/spark,skonto/spark,ibm-research-ireland/sparkoscope,pronix/spark,esi-mineset/spark,techaddict/spark,rednaxelafx/apache-spark,metamx/spark,tengpeng/spark,jkbradley/spark,ueshin/apache-spark,apache-spark-on-k8s/spark,nchammas/spark,shaneknapp/spark,loneknightpy/spark,nlalevee/spark,zero323/spark,map222/spark,highfei2011/spark,JerryLead/spark,bravo-zhang/spark,hvanhovell/spark,techaddict/spark,tejasapatil/spark,hhbyyh/spark,adrian-ionescu/apache-spark,narahari92/spark,dbtsai/spark,techaddict/spark,cin/spark,janewangfb/spark,ajaysaini725/spark,ericvandenbergfb/spark,SHASHANKB/spark,minixalpha/spark,saturday-shi/spark,SHASHANKB/spark,byakuinss/spark,wangyum/spark,actuaryzhang/spark,ioana-delaney/spark,WeichenXu123/spark,wangmiao1981/spark,kevinyu98/spark,milliman/spark,shaneknapp/spark,mahak/spark,haowu80s/spark,haowu80s/spark,adrian-ionescu/apache-spark,aokolnychyi/spark,highfei2011/spark,ConeyLiu/spark,sahilTakiar/spark,kevinyu98/spark,witgo/spark,lvdongr/spark,HyukjinKwon/spark,aosagie/spark,highfei2011/spark,aray/spark,witgo/spark,nilsgrabbert/spark,WindCanDie/spark,metamx/spark,andrewor14/spark,highfei2011/spark,ahnqirage/spark,Aegeaner/spark,szhem/spark,sureshthalamati/spark,janewangfb/spark,jlopezmalla/spark,dhruve/spark,ron8hu/spark,WindCanDie/spark,MLnick/spark,icexelloss/spark,UndeadBaneGitHub/spark,maropu/spark,cloud-fan/spark,aray/spark,MLnick/spark,SnappyDataInc/spark,darionyaphet/spark,ron8hu/spark,cin/spark,SnappyDataInc/spark,Aegeaner/spark,shubhamchopra/spark,kevinyu98/spark,zuotingbing/spark,JerryLead/spark,bOOm-X/spark,pronix/spark,patrick-nicholson/spark,mdespriee/spark,kissmetrics/spark,nilsgrabbert/spark,bdrillard/spark,ibm-research-ireland/sparkoscope,ron8hu/spark,JerryLead/spark,MLnick/spark,JoshRosen/spark,apache-spark-on-k8s/spark,minixalpha/spark,liutang123/spark,apache-spark-on-k8s/spark,nilsgrabbert/spark,someorz/spark,saltstar/spark,goldmedal/spark,gengliangwang/spark,chuckchen/spark,kevinyu98/spark,bdrillard/spark,big-pegasus/spark,ueshin/apache-spark,milliman/spark,wzhfy/spark,publicRoman/spark,sachintyagi22/spark,WeichenXu123/spark,someorz/spark,gioenn/xSpark,MLnick/spark,Panos-Bletsos/spark-cost-model-optimizer,aokolnychyi/spark,esi-mineset/spark,wzhfy/spark,ahnqirage/spark,tengpeng/spark,rekhajoshm/spark,mdespriee/spark,BryanCutler/spark,aosagie/spark,rednaxelafx/apache-spark,hhbyyh/spark,kimoonkim/spark,publicRoman/spark,apache/spark,vinodkc/spark,caneGuy/spark,kiszk/spark,mahak/spark,ddna1021/spark,rekhajoshm/spark,shubhamchopra/spark,sachintyagi22/spark,szhem/spark,aokolnychyi/spark,taroplus/spark,cloud-fan/spark,zuotingbing/spark,nlalevee/spark,bOOm-X/spark,szhem/spark,tengpeng/spark,ajaysaini725/spark,guoxiaolongzte/spark,rednaxelafx/apache-spark,vinodkc/spark,apache/spark,taroplus/spark,hvanhovell/spark,eyalfa/spark,ConeyLiu/spark,publicRoman/spark,mike0sv/spark,andrewor14/spark,someorz/spark,andrewor14/spark,MLnick/spark,brad-kaiser/spark,ioana-delaney/spark,sachintyagi22/spark,liutang123/spark,janewangfb/spark,witgo/spark,techaddict/spark,minixalpha/spark,LantaoJin/spark,aosagie/spark,stanzhai/spark,Panos-Bletsos/spark-cost-model-optimizer,jrshust/spark,milliman/spark,BryanCutler/spark,nchammas/spark,wangmiao1981/spark,pgandhi999/spark,rikima/spark,pgandhi999/spark,UndeadBaneGitHub/spark,zuotingbing/spark,ioana-delaney/spark,bravo-zhang/spark,lvdongr/spark,liyichao/spark,HyukjinKwon/spark,ddna1021/spark,rikima/spark,icexelloss/spark,xflin/spark,eyalfa/spark,gengliangwang/spark,cin/spark,caneGuy/spark,stanzhai/spark,rezasafi/spark,shuangshuangwang/spark,jianran/spark,ibm-research-ireland/sparkoscope,sachintyagi22/spark,poffuomo/spark,jrshust/spark,darionyaphet/spark,lxsmnv/spark,wangyum/spark,esi-mineset/spark,jlopezmalla/spark,ddna1021/spark,ddna1021/spark,saltstar/spark,dbtsai/spark,apache-spark-on-k8s/spark,jkbradley/spark,vinodkc/spark,panfengfeng/spark,guoxiaolongzte/spark,mahak/spark,aokolnychyi/spark,HyukjinKwon/spark,skonto/spark,WindCanDie/spark,cin/spark,shaneknapp/spark,SHASHANKB/spark,guoxiaolongzte/spark,nlalevee/spark,shubhamchopra/spark,LantaoJin/spark,andrewor14/iolap,kevinyu98/spark,andrewor14/spark,metamx/spark,BryanCutler/spark,dongjoon-hyun/spark,vinodkc/spark,brad-kaiser/spark,jkbradley/spark,shubhamchopra/spark,adrian-ionescu/apache-spark,bdrillard/spark,brad-kaiser/spark,ConeyLiu/spark,shuangshuangwang/spark,yanboliang/spark,eyalfa/spark,ptkool/spark,kimoonkim/spark,jrshust/spark,rezasafi/spark,alunarbeach/spark,andrewor14/spark,ajaysaini725/spark,dongjoon-hyun/spark,michalsenkyr/spark,mike0sv/spark,yanboliang/spark,sureshthalamati/spark,szhem/spark,facaiy/spark,rekhajoshm/spark,zzcclp/spark,WeichenXu123/spark,shuangshuangwang/spark,rekhajoshm/spark,jkbradley/spark,sryza/spark,debugger87/spark,jianran/spark,srowen/spark,wangmiao1981/spark,dongjoon-hyun/spark,tengpeng/spark,byakuinss/spark,aray/spark,Aegeaner/spark,WeichenXu123/spark,1haodian/spark,1haodian/spark,zhouyejoe/spark,poffuomo/spark,ptkool/spark,dhruve/spark,joseph-torres/spark,xuanyuanking/spark,michalsenkyr/spark,rezasafi/spark,chuckchen/spark,BryanCutler/spark,debugger87/spark,saturday-shi/spark,hvanhovell/spark,kimoonkim/spark,chuckchen/spark,shuangshuangwang/spark,ericvandenbergfb/spark,brad-kaiser/spark,pronix/spark,michalsenkyr/spark,JoshRosen/spark,Aegeaner/spark,jlopezmalla/spark,SnappyDataInc/spark,ibm-research-ireland/sparkoscope,kissmetrics/spark,rikima/spark,BryanCutler/spark,poffuomo/spark,markhamstra/spark,rekhajoshm/spark,bravo-zhang/spark,cloud-fan/spark,kiszk/spark,zero323/spark,ddna1021/spark,sahilTakiar/spark,HyukjinKwon/spark,kissmetrics/spark,saturday-shi/spark,maropu/spark,markhamstra/spark,caneGuy/spark,WindCanDie/spark,liyichao/spark,yanboliang/spark,ioana-delaney/spark,stanzhai/spark,rezasafi/spark,highfei2011/spark,zzcclp/spark,big-pegasus/spark,saturday-shi/spark,mzl9039/spark,szhem/spark,publicRoman/spark,srowen/spark,yanboliang/spark,haowu80s/spark,rikima/spark,facaiy/spark,janewangfb/spark,adrian-ionescu/apache-spark,alunarbeach/spark,ddna1021/spark,dhruve/spark,alunarbeach/spark,aokolnychyi/spark,liyichao/spark,ajaysaini725/spark,metamx/spark,huang1900/spark,map222/spark,spark-test/spark,setjet/spark,facaiy/spark,gioenn/xSpark,holdenk/spark,yanboliang/spark,liyichao/spark,kimoonkim/spark,publicRoman/spark,wangmiao1981/spark,adrian-ionescu/apache-spark,adrian-ionescu/apache-spark,mzl9039/spark,maropu/spark,spark-test/spark,setjet/spark,taroplus/spark,andrewor14/iolap,Panos-Bletsos/spark-cost-model-optimizer,ibm-research-ireland/sparkoscope,metamx/spark,cloud-fan/spark,actuaryzhang/spark,hvanhovell/spark,panfengfeng/spark,zero323/spark,lxsmnv/spark,liutang123/spark,patrick-nicholson/spark,pronix/spark,LantaoJin/spark,Aegeaner/spark,1haodian/spark,aosagie/spark,akopich/spark,sahilTakiar/spark,rikima/spark,eyalfa/spark,JoshRosen/spark,gioenn/xSpark,poffuomo/spark,gengliangwang/spark,ueshin/apache-spark,pronix/spark,mdespriee/spark,nilsgrabbert/spark,rednaxelafx/apache-spark,LantaoJin/spark,rikima/spark,HyukjinKwon/spark,zero323/spark,milliman/spark,rezasafi/spark,kimoonkim/spark,markhamstra/spark,bOOm-X/spark,UndeadBaneGitHub/spark,xuanyuanking/spark,nchammas/spark,bravo-zhang/spark,patrick-nicholson/spark,mdespriee/spark,narahari92/spark,bdrillard/spark,chuckchen/spark,jlopezmalla/spark,sachintyagi22/spark,akopich/spark,shuangshuangwang/spark,dhruve/spark,panfengfeng/spark,shubhamchopra/spark,setjet/spark,ibm-research-ireland/sparkoscope,apache-spark-on-k8s/spark,goldmedal/spark,jiangxb1987/spark,skonto/spark,poffuomo/spark,srowen/spark,ptkool/spark,zuotingbing/spark,shaneknapp/spark,spark-test/spark,saltstar/spark,xflin/spark,ron8hu/spark,zuotingbing/spark,publicRoman/spark,spark-test/spark,zhouyejoe/spark,spark-test/spark,andrewor14/iolap,saltstar/spark,rednaxelafx/apache-spark,sahilTakiar/spark,huang1900/spark,ConeyLiu/spark,michalsenkyr/spark,MLnick/spark,lvdongr/spark,skonto/spark,narahari92/spark,mzl9039/spark,mdespriee/spark,sureshthalamati/spark,witgo/spark,gioenn/xSpark,eyalfa/spark,jiangxb1987/spark,xflin/spark,JoshRosen/spark,minixalpha/spark,tejasapatil/spark,WindCanDie/spark,holdenk/spark,esi-mineset/spark,dhruve/spark,1haodian/spark,hhbyyh/spark,minixalpha/spark,brad-kaiser/spark,jkbradley/spark,yanboliang/spark,sureshthalamati/spark,dbtsai/spark,aray/spark,vinodkc/spark,WeichenXu123/spark,zhouyejoe/spark,1haodian/spark,nlalevee/spark,liutang123/spark,SHASHANKB/spark,loneknightpy/spark,patrick-nicholson/spark,lxsmnv/spark,sureshthalamati/spark,loneknightpy/spark,taroplus/spark,bOOm-X/spark,maropu/spark,gioenn/xSpark,wzhfy/spark,ahnqirage/spark,bOOm-X/spark,nchammas/spark,cloud-fan/spark,pgandhi999/spark,UndeadBaneGitHub/spark,stanzhai/spark,darionyaphet/spark,haowu80s/spark,szhem/spark,JerryLead/spark,wangyum/spark,debugger87/spark,ptkool/spark,akopich/spark,kevinyu98/spark,aosagie/spark,ron8hu/spark,janewangfb/spark,jrshust/spark,hvanhovell/spark,pgandhi999/spark,pgandhi999/spark,ConeyLiu/spark,taroplus/spark,ueshin/apache-spark,jiangxb1987/spark,hhbyyh/spark,highfei2011/spark,goldmedal/spark,spark-test/spark,akopich/spark,saltstar/spark,skonto/spark,joseph-torres/spark,liyichao/spark,JoshRosen/spark,ptkool/spark,aosagie/spark,dhruve/spark,jkbradley/spark,jlopezmalla/spark,goldmedal/spark,lxsmnv/spark,byakuinss/spark,gioenn/xSpark,apache-spark-on-k8s/spark,tejasapatil/spark,janewangfb/spark,nchammas/spark,rezasafi/spark,dbtsai/spark,apache/spark,debugger87/spark,lvdongr/spark,bdrillard/spark,kissmetrics/spark,jianran/spark,zero323/spark,narahari92/spark,huang1900/spark,xuanyuanking/spark,cin/spark,andrewor14/iolap,LantaoJin/spark,ajaysaini725/spark,mike0sv/spark,alunarbeach/spark,apache/spark,shubhamchopra/spark,JerryLead/spark,WindCanDie/spark,LantaoJin/spark,JoshRosen/spark,panfengfeng/spark,map222/spark,ajaysaini725/spark,ericvandenbergfb/spark,milliman/spark,sryza/spark,poffuomo/spark,tejasapatil/spark,cin/spark,actuaryzhang/spark,chuckchen/spark,guoxiaolongzte/spark,joseph-torres/spark,dbtsai/spark,hhbyyh/spark,taroplus/spark,huang1900/spark,rekhajoshm/spark,wangyum/spark,ron8hu/spark,zzcclp/spark,joseph-torres/spark,ioana-delaney/spark,jianran/spark,joseph-torres/spark,bravo-zhang/spark,UndeadBaneGitHub/spark,aokolnychyi/spark,matthewfranglen/spark,facaiy/spark,mike0sv/spark,esi-mineset/spark,setjet/spark,xuanyuanking/spark,Aegeaner/spark,wangyum/spark,techaddict/spark,jiangxb1987/spark,rezasafi/spark,jrshust/spark,SnappyDataInc/spark,lxsmnv/spark,big-pegasus/spark,wangmiao1981/spark,kissmetrics/spark,loneknightpy/spark,akopich/spark,actuaryzhang/spark,rikima/spark,darionyaphet/spark,jlopezmalla/spark,ericvandenbergfb/spark,1haodian/spark,shubhamchopra/spark,ddna1021/spark,zzcclp/spark,jkbradley/spark,stanzhai/spark,ericvandenbergfb/spark,sryza/spark,Panos-Bletsos/spark-cost-model-optimizer,LantaoJin/spark,rekhajoshm/spark,skonto/spark,srowen/spark,mzl9039/spark,saltstar/spark,huang1900/spark,maropu/spark,nilsgrabbert/spark,hhbyyh/spark,panfengfeng/spark,brad-kaiser/spark,brad-kaiser/spark,facaiy/spark,jrshust/spark