[SPARK-36370][PYTHON][FOLLOWUP] Use LooseVersion instead of pkg_resources.parse_version
[SPARK-36370][PYTHON][FOLLOWUP] Use LooseVersion instead of pkg_resources.parse_version

### What changes were proposed in this pull request?

This is a follow-up of #33687.

Use `LooseVersion` instead of `pkg_resources.parse_version`.

### Why are the changes needed?

In the previous PR, `pkg_resources.parse_version` was used, but we should use `LooseVersion` instead to be consistent in the code base.

### Does this PR introduce _any_ user-facing change?

No.

### How was this patch tested?

Existing tests.

Closes #33768 from ueshin/issues/SPARK-36370/LooseVersion.

Authored-by: Takuya UESHIN <f070f8f0c50caeda5841963fc7b57e73e59dad56@databricks.com>
Signed-off-by: Hyukjin Kwon <2680965ad5aae29275c8fb10150cb10f5554e78b@apache.org>

HyukjinKwon/spark,hvanhovell/spark,xuanyuanking/spark,ueshin/apache-spark,vinodkc/spark,dongjoon-hyun/spark,ueshin/apache-spark,holdenk/spark,vinodkc/spark,mahak/spark,nchammas/spark,chuckchen/spark,WeichenXu123/spark,srowen/spark,mahak/spark,gengliangwang/spark,zero323/spark,nchammas/spark,taroplus/spark,srowen/spark,vinodkc/spark,HyukjinKwon/spark,apache/spark,apache/spark,rednaxelafx/apache-spark,dongjoon-hyun/spark,nchammas/spark,xuanyuanking/spark,dongjoon-hyun/spark,zzcclp/spark,hvanhovell/spark,shaneknapp/spark,JoshRosen/spark,srowen/spark,vinodkc/spark,witgo/spark,HyukjinKwon/spark,srowen/spark,JoshRosen/spark,JoshRosen/spark,cloud-fan/spark,holdenk/spark,witgo/spark,ueshin/apache-spark,gengliangwang/spark,HyukjinKwon/spark,chuckchen/spark,apache/spark,WeichenXu123/spark,HyukjinKwon/spark,taroplus/spark,zero323/spark,wangyum/spark,hvanhovell/spark,rednaxelafx/apache-spark,chuckchen/spark,dongjoon-hyun/spark,shaneknapp/spark,nchammas/spark,gengliangwang/spark,WeichenXu123/spark,zzcclp/spark,holdenk/spark,zzcclp/spark,mahak/spark,xuanyuanking/spark,apache/spark,gengliangwang/spark,zero323/spark,shaneknapp/spark,dongjoon-hyun/spark,ueshin/apache-spark,witgo/spark,zzcclp/spark,hvanhovell/spark,cloud-fan/spark,ueshin/apache-spark,rednaxelafx/apache-spark,srowen/spark,rednaxelafx/apache-spark,taroplus/spark,HyukjinKwon/spark,JoshRosen/spark,zzcclp/spark,vinodkc/spark,rednaxelafx/apache-spark,gengliangwang/spark,mahak/spark,mahak/spark,holdenk/spark,cloud-fan/spark,gengliangwang/spark,dongjoon-hyun/spark,wangyum/spark,mahak/spark,holdenk/spark,holdenk/spark,chuckchen/spark,hvanhovell/spark,cloud-fan/spark,WeichenXu123/spark,taroplus/spark,cloud-fan/spark,HyukjinKwon/spark,hvanhovell/spark,apache/spark,xuanyuanking/spark,witgo/spark,JoshRosen/spark,witgo/spark,cloud-fan/spark,zzcclp/spark,xuanyuanking/spark,vinodkc/spark,chuckchen/spark,shaneknapp/spark,wangyum/spark,rednaxelafx/apache-spark,ueshin/apache-spark,srowen/spark,zzcclp/spark,nchammas/spark,mahak/spark,vinodkc/spark,JoshRosen/spark,wangyum/spark,zero323/spark,hvanhovell/spark,zero323/spark,apache/spark,chuckchen/spark,JoshRosen/spark,srowen/spark,witgo/spark,taroplus/spark,dongjoon-hyun/spark,nchammas/spark,apache/spark,wangyum/spark,shaneknapp/spark,WeichenXu123/spark,taroplus/spark,witgo/spark,WeichenXu123/spark,wangyum/spark,wangyum/spark,taroplus/spark,xuanyuanking/spark,nchammas/spark,chuckchen/spark,gengliangwang/spark,zero323/spark,xuanyuanking/spark,cloud-fan/spark,shaneknapp/spark,shaneknapp/spark,rednaxelafx/apache-spark,holdenk/spark,WeichenXu123/spark,ueshin/apache-spark,zero323/spark