Class not found Kryo exception in hive 0.13 - Hadoop -
i have genericudf (see code below) running fine on hadoop-1 , hive-0.12. when testing same genericudf using hive-0.13 + hadoop-2, getting below error.
vertex failed, vertexname=map 12, vertexid=vertex_1409698731658_42202_1_00, diagnostics=[vertex input: ccv initializer failed., org.apache.hive.com.esotericsoftware.kry o.kryoexception: unable find class: com.xxx.xxx.id1
here code udf.
package com.xxx.xxx; import org.apache.hadoop.hive.*; public class id1 extends genericudf { private mapredcontext context; private long sequencenum = 0; private static final int padlength = 10; stringbuilder sb = null; public objectinspector initialize(objectinspector[] arguments) throws udfargumentexception { sequencenum = 0; sb = new stringbuilder(); homecoming primitiveobjectinspectorfactory.javastringobjectinspector; } public object evaluate(deferredobject[] arguments) throws hiveexception { int sblength = sb.tostring().length(); if (sblength > 0) sb.replace(0, sblength, ""); string taskid = null; if (context.getjobconf() != null) taskid = context.getjobconf().get("mapred.taskid"); sequencenum++; if (taskid != null) { sb.append(taskid.replace("attempt_", "")); } int = 0; string seqstr = string.valueof(sequencenum); sb.append(seqstr); homecoming sb.tostring(); } public string getdisplaystring(string[] children) { homecoming "id1()"; } @override public void configure(mapredcontext context) { this.context = context; } }
i has hive-0.13, not able see post related error.
hadoop hive kryo
No comments:
Post a Comment