Monday 15 March 2010

amazon web services - EMR: Master instance failed attempting to download bootstrap action -



amazon web services - EMR: Master instance failed attempting to download bootstrap action -

i trying install: 1) cluster spark. 2) cluster hbase.

first effort install add together cluster bootstrapping spark succeeded but, used ssh wrong key, have redo install new key. since (from sec attempt) getting same error on every effort while installing 1 , 2 above.

i next instructions from: https://aws.amazon.com/articles/elasticmapreduce/4926593393724923

my command aws cli: aws emr create-cluster --name gcspark --ami-version 3.2 --instance-type m3.xlarge --instance-count 3 --ec2-attributes keyname=keypair--applications name=hive --bootstrap-actions path=s3://support.elasticmapreduce/spark/install-spark

output stderr.txt: + python install-spark-script ba 14/10/31 22:00:45 info guice.emrfsbasemodule: consistency disabled, using com.amazon.ws.emr.hadoop.fs.s3n.s3nativefilesystem filesystem implementation. 14/10/31 22:00:46 info fs.emrfilesystem: using com.amazon.ws.emr.hadoop.fs.s3n.s3nativefilesystem filesystem implementation 14/10/31 22:00:47 info s3n.s3nativefilesystem: opening 's3://support.elasticmapreduce/spark/1.1.0/scala-2.10.3.tgz' reading 14/10/31 22:01:06 info guice.emrfsbasemodule: consistency disabled, using com.amazon.ws.emr.hadoop.fs.s3n.s3nativefilesystem filesystem implementation. 14/10/31 22:01:07 info fs.emrfilesystem: using com.amazon.ws.emr.hadoop.fs.s3n.s3nativefilesystem filesystem implementation 14/10/31 22:01:08 info s3n.s3nativefilesystem: opening 's3://support.elasticmapreduce/spark/1.1.0/spark-1.1.0.e.tgz' reading /bin/cp: cannot stat /usr/share/aws/emr/emr-fs/lib/: no such file or directory traceback (most recent phone call last): file "install-spark-script", line 120, in prepare_classpath() file "install-spark-script", line 52, in prepare_classpath subprocess.check_call() file "/usr/lib64/python2.6/subprocess.py", line 505, in check_call raise calledprocesserror(retcode, cmd) subprocess.calledprocesserror: command '' returned non-zero exit status 1*

any help appreciated.

thanks!

the install error temporary issue @ time , fixed later version (1.1.0.f).

a readme of changes , notes @ https://github.com/awslabs/emr-bootstrap-actions/tree/master/spark.

amazon-web-services apache-spark hbase bootstrapping emr

No comments:

Post a Comment