Skip to content

Commit f90c3fa

Browse files
author
Igor Pisarev
committed
downgrade jackson-databind to match version used in spark and aws-sdk
spark uses 2.6.7.1, and aws-java-sdk-s3 uses 2.6.7.3. There are no conflicts between the two, so we can explicitly use the latter. When running spark with the newer version of jackson-databind (2.10.2), it produces the following runtime error: Exception in thread "main" java.lang.ExceptionInInitializerError at org.apache.spark.SparkContext.withScope(SparkContext.scala:693) at org.apache.spark.SparkContext.parallelize(SparkContext.scala:710) at org.apache.spark.api.java.JavaSparkContext.parallelize(JavaSparkContext.scala:134) at org.janelia.stitching.PipelineFusionStepExecutor.fuse(PipelineFusionStepExecutor.java:276) at org.janelia.stitching.PipelineFusionStepExecutor.runImpl(PipelineFusionStepExecutor.java:179) at org.janelia.stitching.PipelineFusionStepExecutor.run(PipelineFusionStepExecutor.java:69) at org.janelia.stitching.StitchingSpark.run(StitchingSpark.java:87) at org.janelia.stitching.StitchingSpark.main(StitchingSpark.java:34) Caused by: com.fasterxml.jackson.databind.JsonMappingException: Incompatible Jackson version: 2.10.2 at com.fasterxml.jackson.module.scala.JacksonModule$class.setupModule(JacksonModule.scala:64) at com.fasterxml.jackson.module.scala.DefaultScalaModule.setupModule(DefaultScalaModule.scala:19) at com.fasterxml.jackson.databind.ObjectMapper.registerModule(ObjectMapper.java:808) at org.apache.spark.rdd.RDDOperationScope$.<init>(RDDOperationScope.scala:82) at org.apache.spark.rdd.RDDOperationScope$.<clinit>(RDDOperationScope.scala) ... 8 more
1 parent 940b5fe commit f90c3fa

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

pom.xml

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -872,7 +872,7 @@
872872
<jackrabbit-webdav.version>2.21.0</jackrabbit-webdav.version>
873873

874874
<!-- Jackson - https://github.com/FasterXML/jackson -->
875-
<jackson-databind.version>2.10.2</jackson-databind.version>
875+
<jackson-databind.version>2.6.7.3</jackson-databind.version>
876876

877877
<!-- Java Advanced Imaging - https://java.net/projects/jai-core -->
878878
<jai.version>1.1.3</jai.version>

0 commit comments

Comments
 (0)