solr + Mahout 클러스터링 위한 벡터 생성중 org.apache.lucene.index.CorruptIndexException: checksum passed

Question

* Solr 의 인덱스에서 TermVector 만들어서 Mahout 이용하여 클러스터링 하는 예제 테스트 중입니다.([자연어 텍스트 처리를 통한 검색 시스템 구축]에 있는 예제) mahout lucene.vector ... 실행시 CorruptIndexException: checksum passed ... 라며 오류가 발생합니다. 인덱스를 지웠다가 다시 생성해도, 코어를 새로 만들어도 계속 동일한 오류가 납니다. 구글에서도 원인을 찾을 수 없어 오키 여러분들께 도움을 요청합니다. [환경]Solr 6.3.0Mahout 0.13.0Mahout/lib 의 Lucene-XXX.jar 6.2.1 [ 실행 명령 ] $MAHOUT_HOME/bin/mahout lucene.vector \--dir /home/jsh/solr-6.3.0/server/solr/core3/data/index --output /home/jsh/part-out180226.vec \--field description \ --idField id \--dictOut /home/jsh/dict180226.txt \--norm 2 [ 오류 로그 ] hadoop binary is not in PATH,HADOOP_HOME/bin,HADOOP_PREFIX/bin, running locallySLF4J: Class path contains multiple SLF4J bindings.SLF4J: Found binding in [jar:file:/home/jsh/mahout/apache-mahout-distribution-0.13.0/mahout-examples-0.13.0-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/home/jsh/mahout/apache-mahout-distribution-0.13.0/mahout-mr-0.13.0-job.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: Found binding in [jar:file:/home/jsh/mahout/apache-mahout-distribution-0.13.0/lib/slf4j-log4j12-1.7.22.jar!/org/slf4j/impl/StaticLoggerBinder.class]SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]Exception in thread &#34;main&#34; java.lang.NoSuchMethodError: org.apache.lucene.index.SegmentInfo.<init>(Lorg/apache/lucene/store/Directory;Lorg/apache/lucene/util/Version;Ljava/lang/String;IZLorg/apache/lucene/codecs/Codec;Ljava/util/Map;[BLjava/util/Map;Lorg/apache/lucene/search/Sort;)V at org.apache.lucene.codecs.lucene62.Lucene62SegmentInfoFormat.read(Lucene62SegmentInfoFormat.java:198) at org.apache.lucene.index.SegmentInfos.readCommit(SegmentInfos.java:362) at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:53) at org.apache.lucene.index.StandardDirectoryReader$1.doBody(StandardDirectoryReader.java:50) at org.apache.lucene.index.SegmentInfos$FindSegmentsFile.run(SegmentInfos.java:731) at org.apache.lucene.index.StandardDirectoryReader.open(StandardDirectoryReader.java:50) at org.apache.lucene.index.DirectoryReader.open(DirectoryReader.java:63) at org.apache.mahout.utils.vectors.lucene.Driver.dumpVectors(Driver.java:90) at org.apache.mahout.utils.vectors.lucene.Driver.main(Driver.java:278) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.util.ProgramDriver$ProgramDescription.invoke(ProgramDriver.java:72) at org.apache.hadoop.util.ProgramDriver.run(ProgramDriver.java:145) at org.apache.hadoop.util.ProgramDriver.driver(ProgramDriver.java:153) at org.apache.mahout.driver.MahoutDriver.main(MahoutDriver.java:195) Suppressed: org.apache.lucene.index.CorruptIndexException: checksum passed (c446aa89). possibly transient resource issue, or a Lucene or JVM bug (resource&#61;BufferedChecksumIndexInput(MMapIndexInput(path&#61;&#34;/home/jsh/solr-6.3.0/server/solr/core3/data/index/_1.si&#34;))) at org.apache.lucene.codecs.CodecUtil.checkFooter(CodecUtil.java:379) at org.apache.lucene.codecs.lucene62.Lucene62SegmentInfoFormat.read(Lucene62SegmentInfoFormat.java:203) ... 16 more

solr + Mahout 클러스터링 위한 벡터 생성중 org.apache.lucene.index.CorruptIndexException: checksum passed

0개의 답변

#mahout 목록