[SPARK-29613][BUILD][SS] Upgrade to Kafka 2.3.1
[SPARK-29613][BUILD][SS] Upgrade to Kafka 2.3.1

### What changes were proposed in this pull request?

This PR aims to upgrade to Kafka 2.3.1 client library for client fixes like KAFKA-8950, KAFKA-8570, and KAFKA-8635. The following is the full release note.
- https://archive.apache.org/dist/kafka/2.3.1/RELEASE_NOTES.html

### Why are the changes needed?

- [KAFKA-8950 KafkaConsumer stops fetching](https://issues.apache.org/jira/browse/KAFKA-8950)
- [KAFKA-8570 Downconversion could fail when log contains out of order message formats](https://issues.apache.org/jira/browse/KAFKA-8570)
- [KAFKA-8635 Unnecessary wait when looking up coordinator before transactional request](https://issues.apache.org/jira/browse/KAFKA-8635)

### Does this PR introduce any user-facing change?

No.

### How was this patch tested?

Pass the Jenkins with the existing tests.

Closes #26271 from dongjoon-hyun/SPARK-29613.

Authored-by: Dongjoon Hyun <9b02cb7e37158797a8e22c559f7c5f5ecd28ea57@apple.com>
Signed-off-by: Dongjoon Hyun <9b02cb7e37158797a8e22c559f7c5f5ecd28ea57@apple.com>

kevinyu98/spark,ptkool/spark,wangyum/spark,vinodkc/spark,milliman/spark,kevinyu98/spark,skonto/spark,mahak/spark,skonto/spark,xuanyuanking/spark,wzhfy/spark,taroplus/spark,zero323/spark,ConeyLiu/spark,skonto/spark,maropu/spark,xuanyuanking/spark,cloud-fan/spark,xuanyuanking/spark,taroplus/spark,gengliangwang/spark,jkbradley/spark,hvanhovell/spark,ConeyLiu/spark,spark-test/spark,ptkool/spark,milliman/spark,wangyum/spark,chuckchen/spark,caneGuy/spark,ueshin/apache-spark,maropu/spark,wangyum/spark,goldmedal/spark,HyukjinKwon/spark,vinodkc/spark,nchammas/spark,apache/spark,zuotingbing/spark,BryanCutler/spark,witgo/spark,shuangshuangwang/spark,maropu/spark,mahak/spark,wangmiao1981/spark,HyukjinKwon/spark,wangmiao1981/spark,dbtsai/spark,dbtsai/spark,zzcclp/spark,kevinyu98/spark,holdenk/spark,goldmedal/spark,BryanCutler/spark,WeichenXu123/spark,mahak/spark,chuckchen/spark,holdenk/spark,kevinyu98/spark,cloud-fan/spark,wangmiao1981/spark,darionyaphet/spark,chuckchen/spark,zuotingbing/spark,hvanhovell/spark,zero323/spark,ConeyLiu/spark,ueshin/apache-spark,taroplus/spark,zzcclp/spark,mahak/spark,witgo/spark,gengliangwang/spark,shaneknapp/spark,shaneknapp/spark,wangyum/spark,wangmiao1981/spark,ConeyLiu/spark,jkbradley/spark,maropu/spark,zzcclp/spark,goldmedal/spark,witgo/spark,HyukjinKwon/spark,jkbradley/spark,gengliangwang/spark,wangyum/spark,hvanhovell/spark,nchammas/spark,darionyaphet/spark,spark-test/spark,rednaxelafx/apache-spark,nchammas/spark,chuckchen/spark,jkbradley/spark,zero323/spark,kevinyu98/spark,mahak/spark,wangmiao1981/spark,ptkool/spark,nchammas/spark,jiangxb1987/spark,xuanyuanking/spark,hvanhovell/spark,kevinyu98/spark,rednaxelafx/apache-spark,apache/spark,JoshRosen/spark,taroplus/spark,cloud-fan/spark,dbtsai/spark,WeichenXu123/spark,shuangshuangwang/spark,spark-test/spark,jiangxb1987/spark,zuotingbing/spark,wangyum/spark,zzcclp/spark,jkbradley/spark,milliman/spark,WeichenXu123/spark,dbtsai/spark,vinodkc/spark,wangmiao1981/spark,wzhfy/spark,dongjoon-hyun/spark,zuotingbing/spark,zzcclp/spark,rednaxelafx/apache-spark,taroplus/spark,ptkool/spark,cloud-fan/spark,apache/spark,skonto/spark,WeichenXu123/spark,goldmedal/spark,apache/spark,goldmedal/spark,gengliangwang/spark,shaneknapp/spark,cloud-fan/spark,milliman/spark,JoshRosen/spark,zero323/spark,zuotingbing/spark,mahak/spark,dbtsai/spark,witgo/spark,darionyaphet/spark,shuangshuangwang/spark,spark-test/spark,nchammas/spark,zero323/spark,HyukjinKwon/spark,milliman/spark,spark-test/spark,wzhfy/spark,shaneknapp/spark,skonto/spark,maropu/spark,srowen/spark,JoshRosen/spark,zero323/spark,darionyaphet/spark,dongjoon-hyun/spark,dongjoon-hyun/spark,maropu/spark,ConeyLiu/spark,holdenk/spark,holdenk/spark,HyukjinKwon/spark,BryanCutler/spark,gengliangwang/spark,ueshin/apache-spark,xuanyuanking/spark,gengliangwang/spark,gengliangwang/spark,wzhfy/spark,WeichenXu123/spark,wangyum/spark,cloud-fan/spark,ptkool/spark,caneGuy/spark,chuckchen/spark,ConeyLiu/spark,jiangxb1987/spark,wzhfy/spark,ConeyLiu/spark,srowen/spark,nchammas/spark,wangmiao1981/spark,kevinyu98/spark,apache/spark,dongjoon-hyun/spark,srowen/spark,WeichenXu123/spark,milliman/spark,spark-test/spark,skonto/spark,darionyaphet/spark,rednaxelafx/apache-spark,witgo/spark,jiangxb1987/spark,JoshRosen/spark,vinodkc/spark,srowen/spark,milliman/spark,zzcclp/spark,vinodkc/spark,HyukjinKwon/spark,ueshin/apache-spark,rednaxelafx/apache-spark,jiangxb1987/spark,shaneknapp/spark,ueshin/apache-spark,hvanhovell/spark,chuckchen/spark,BryanCutler/spark,maropu/spark,srowen/spark,ueshin/apache-spark,caneGuy/spark,rednaxelafx/apache-spark,ptkool/spark,ueshin/apache-spark,JoshRosen/spark,wzhfy/spark,shaneknapp/spark,spark-test/spark,ptkool/spark,hvanhovell/spark,apache/spark,BryanCutler/spark,caneGuy/spark,cloud-fan/spark,wzhfy/spark,shuangshuangwang/spark,xuanyuanking/spark,taroplus/spark,HyukjinKwon/spark,holdenk/spark,vinodkc/spark,zero323/spark,caneGuy/spark,taroplus/spark,shaneknapp/spark,mahak/spark,BryanCutler/spark,holdenk/spark,xuanyuanking/spark,dongjoon-hyun/spark,vinodkc/spark,zuotingbing/spark,caneGuy/spark,dongjoon-hyun/spark,dbtsai/spark,apache/spark,jkbradley/spark,JoshRosen/spark,goldmedal/spark,caneGuy/spark,shuangshuangwang/spark,srowen/spark,dongjoon-hyun/spark,shuangshuangwang/spark,witgo/spark,zuotingbing/spark,BryanCutler/spark,shuangshuangwang/spark,hvanhovell/spark,skonto/spark,witgo/spark,zzcclp/spark,WeichenXu123/spark,jiangxb1987/spark,jkbradley/spark,matthewfranglen/spark,srowen/spark,darionyaphet/spark,rednaxelafx/apache-spark,goldmedal/spark,darionyaphet/spark,JoshRosen/spark,holdenk/spark,chuckchen/spark,nchammas/spark,jiangxb1987/spark,dbtsai/spark