Commit f90c3fa
Igor Pisarev
downgrade jackson-databind to match version used in spark and aws-sdk
spark uses 2.6.7.1, and aws-java-sdk-s3 uses 2.6.7.3. There are no conflicts between the two, so we can explicitly use the latter.
When running spark with the newer version of jackson-databind (2.10.2), it produces the following runtime error:
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.apache.spark.SparkContext.withScope(SparkContext.scala:693)
at org.apache.spark.SparkContext.parallelize(SparkContext.scala:710)
at org.apache.spark.api.java.JavaSparkContext.parallelize(JavaSparkContext.scala:134)
at org.janelia.stitching.PipelineFusionStepExecutor.fuse(PipelineFusionStepExecutor.java:276)
at org.janelia.stitching.PipelineFusionStepExecutor.runImpl(PipelineFusionStepExecutor.java:179)
at org.janelia.stitching.PipelineFusionStepExecutor.run(PipelineFusionStepExecutor.java:69)
at org.janelia.stitching.StitchingSpark.run(StitchingSpark.java:87)
at org.janelia.stitching.StitchingSpark.main(StitchingSpark.java:34)
Caused by: com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.10.2
at com.fasterxml.jackson.module.scala.JacksonModule$class.setupModule(JacksonModule.scala:64)
at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:19)
at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:808)
at org.apache.spark.rdd.RDDOperationScope$.<init>(RDDOperationScope.scala:82)
at org.apache.spark.rdd.RDDOperationScope$.<clinit>(RDDOperationScope.scala)
... 8 more1 parent 940b5fe commit f90c3fa
1 file changed
Lines changed: 1 addition & 1 deletion
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
872 | 872 | | |
873 | 873 | | |
874 | 874 | | |
875 | | - | |
| 875 | + | |
876 | 876 | | |
877 | 877 | | |
878 | 878 | | |
| |||
0 commit comments