Saturday 15 March 2014

Class not found Kryo exception in hive 0.13 - Hadoop -



Class not found Kryo exception in hive 0.13 - Hadoop -

i have genericudf (see code below) running fine on hadoop-1 , hive-0.12. when testing same genericudf using hive-0.13 + hadoop-2, getting below error.

vertex failed, vertexname=map 12, vertexid=vertex_1409698731658_42202_1_00, diagnostics=[vertex input: ccv initializer failed., org.apache.hive.com.esotericsoftware.kry o.kryoexception: unable find class: com.xxx.xxx.id1

here code udf.

package com.xxx.xxx; import org.apache.hadoop.hive.*; public class id1 extends genericudf { private mapredcontext context; private long sequencenum = 0; private static final int padlength = 10; stringbuilder sb = null; public objectinspector initialize(objectinspector[] arguments) throws udfargumentexception { sequencenum = 0; sb = new stringbuilder(); homecoming primitiveobjectinspectorfactory.javastringobjectinspector; } public object evaluate(deferredobject[] arguments) throws hiveexception { int sblength = sb.tostring().length(); if (sblength > 0) sb.replace(0, sblength, ""); string taskid = null; if (context.getjobconf() != null) taskid = context.getjobconf().get("mapred.taskid"); sequencenum++; if (taskid != null) { sb.append(taskid.replace("attempt_", "")); } int = 0; string seqstr = string.valueof(sequencenum); sb.append(seqstr); homecoming sb.tostring(); } public string getdisplaystring(string[] children) { homecoming "id1()"; } @override public void configure(mapredcontext context) { this.context = context; } }

i has hive-0.13, not able see post related error.

hadoop hive kryo

No comments:

Post a Comment