Spark Yarn Cluster lost executor when running with Annovar

How to fix it.

1. Annovar only supports with spark via “local[*]” mode. The example command for running is like:

spark-submit --master local[*]  spark.jar ...

2. We need to also use jdk 8 instead of jdk 11 because annovar does not support later java version.

~~PEACE~~