Storm pulling in stale dependencies -
we trying upgrade storm 0.10.0 1.0.2 , our project uses kafka-spout
between versions, backtype.storm
package-names changed org.apache.storm
package-names storm-community.
as part of our own upgrade, had change storm-kafka
's version 1.0.2
but when run topology on storm, error missing classes older version:
apache-storm-1.0.2/bin/storm \ jar \ $jarfile \ org.apache.storm.flux.flux \ $yamlfile \ --remote +- apache storm -+ +- data flow user experience -+ version: 1.0.2 parsing file: topology-config.yaml 333 [main] info o.a.s.f.p.fluxparser - loading yaml input stream... 335 [main] info o.a.s.f.p.fluxparser - not performing property substitution. 335 [main] info o.a.s.f.p.fluxparser - not performing environment variable substitution. exception in thread "main" java.lang.noclassdeffounderror: backtype/storm/spout/multischeme @ java.lang.class.forname0(native method) @ java.lang.class.forname(class.java:264) @ org.apache.storm.flux.fluxbuilder.buildobject(fluxbuilder.java:291) @ org.apache.storm.flux.fluxbuilder.buildcomponents(fluxbuilder.java:350) @ org.apache.storm.flux.fluxbuilder.buildtopology(fluxbuilder.java:75) @ org.apache.storm.flux.flux.runcli(flux.java:153) @ org.apache.storm.flux.flux.main(flux.java:98) caused by: java.lang.classnotfoundexception: backtype.storm.spout.multischeme @ java.net.urlclassloader.findclass(urlclassloader.java:381) @ java.lang.classloader.loadclass(classloader.java:424) @ sun.misc.launcher$appclassloader.loadclass(launcher.java:331) @ java.lang.classloader.loadclass(classloader.java:357) ... 7 more
i not sure backtype.storm
creeping code-base.
i have looked on code-base (and mvn dependency:tree
) 0.10.0
, backtype.storm
things older-version no place found.
i excluded storm-kafka
versions child-dependencies , added explicit dependency on storm-kafka
did not change thing.
maven not seem @ fault because not see 0.10*
versions in ~/.m2/repository
:
ls ~/.m2/repository/org/apache/storm/* ~/.m2/repository/org/apache/storm/flux: 1.0.2 ~/.m2/repository/org/apache/storm/flux-core: 1.0.2 ~/.m2/repository/org/apache/storm/storm: 1.0.2 ~/.m2/repository/org/apache/storm/storm-kafka: 1.0.2
clearly storm doing wrong here.
check topology-config.yaml
, class loaded dynamically loaded after picking class name yaml file.
Comments
Post a Comment