{"id":268,"date":"2012-04-18T13:22:23","date_gmt":"2012-04-18T12:22:23","guid":{"rendered":"http:\/\/www.nax.cz\/?p=268"},"modified":"2012-04-18T13:22:23","modified_gmt":"2012-04-18T12:22:23","slug":"pig-query-using-datastax-connection-error","status":"publish","type":"post","link":"https:\/\/nax.cz\/?p=268","title":{"rendered":"Pig query using DataStax – connection error"},"content":{"rendered":"

When I used following setup:
\n
\nexport DSE_HOME=\/opt\/brisk
\nexport CASSANDRA_HOME=$DSE_HOME\/resources\/cassandra
\nexport PATH=\"$PATH:$DSE_HOME\/bin:$CASSANDRA_HOME\/bin\"
\nexport USE64BITJVM=1
\nexport CASSANDRA_CONF=\/etc\/cassandra\/
\ncd \/opt\/brisk\/resources\/pig\/bin
\ndse pig -l \/var\/tmp\/josefh\/
\n<\/code><\/p>\n

I ended up with following error:<\/p>\n


\ngrunt> resources = LOAD 'cassandra:\/\/mynamespace\/resource' USING CassandraStorage() AS (KEY, columns:bag{T:tuple(name:chararray,description:chararray)});<\/p>\n

2012-04-18 07:54:23,049 [main] ERROR org.apache.cassandra.hadoop.ConfigHelper - failed to connect to any initial addresses
\n2012-04-18 07:54:23,050 [main] ERROR org.apache.cassandra.hadoop.ConfigHelper -
\njava.io.IOException: unable to connect to server
\n at org.apache.cassandra.hadoop.ConfigHelper.createConnection(ConfigHelper.java:390)
\n at org.apache.cassandra.hadoop.ConfigHelper.getClientFromAddressList(ConfigHelper.java:359)
\n at com.datastax.bdp.hadoop.pig.CassandraStorage.initSchema(CassandraStorage.java:581)
\n at com.datastax.bdp.hadoop.pig.CassandraStorage.setLocation(CassandraStorage.java:320)
\n at com.datastax.bdp.hadoop.pig.CassandraStorage.getSchema(CassandraStorage.java:325)
\n at org.apache.pig.impl.logicalLayer.LOLoad.determineSchema(LOLoad.java:186)
\n at org.apache.pig.impl.logicalLayer.LOLoad.getSchema(LOLoad.java:151)
\n at org.apache.pig.impl.logicalLayer.parser.QueryParser.Parse(QueryParser.java:851)
\n at org.apache.pig.impl.logicalLayer.LogicalPlanBuilder.parse(LogicalPlanBuilder.java:63)
\n at org.apache.pig.PigServer$Graph.parseQuery(PigServer.java:1612)
\n at org.apache.pig.PigServer$Graph.registerQuery(PigServer.java:1562)
\n at org.apache.pig.PigServer.registerQuery(PigServer.java:534)
\n at org.apache.pig.tools.grunt.GruntParser.processPig(GruntParser.java:871)
\n at org.apache.pig.tools.pigscript.parser.PigScriptParser.parse(PigScriptParser.java:388)
\n at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:168)
\n at org.apache.pig.tools.grunt.GruntParser.parseStopOnError(GruntParser.java:144)
\n at org.apache.pig.tools.grunt.Grunt.run(Grunt.java:76)
\n at org.apache.pig.Main.run(Main.java:455)
\n at org.apache.pig.Main.main(Main.java:107)
\nCaused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection refused
\n at org.apache.thrift.transport.TSocket.open(TSocket.java:183)
\n at org.apache.thrift.transport.TFramedTransport.open(TFramedTransport.java:81)
\n at org.apache.cassandra.hadoop.ConfigHelper.createConnection(ConfigHelper.java:386)
\n ... 18 more
\nCaused by: java.net.ConnectException: Connection refused
\n at java.net.PlainSocketImpl.socketConnect(Native Method)
\n at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351)
\n at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213)
\n at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200)
\n at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366)
\n at java.net.Socket.connect(Socket.java:529)
\n at org.apache.thrift.transport.TSocket.open(TSocket.java:178)
\n ... 20 more
\n2012-04-18 07:54:23,054 [main] ERROR org.apache.pig.tools.grunt.Grunt - ERROR 2999: Unexpected internal error. java.io.IOException: unable to connect to server
\nDetails at logfile: \/var\/tmp\/josefh\/pig_1334735618872.log
\n<\/code><\/p>\n

As I googled around I found following solution<\/a>:<\/p>\n

export PIG_RPC_PORT=112233 <\/p>\n

(you need to change port to your specific port where Cassandra RPC is running).<\/p>\n","protected":false},"excerpt":{"rendered":"

When I used following setup: export DSE_HOME=\/opt\/brisk export CASSANDRA_HOME=$DSE_HOME\/resources\/cassandra export PATH=“$PATH:$DSE_HOME\/bin:$CASSANDRA_HOME\/bin“ export USE64BITJVM=1 export CASSANDRA_CONF=\/etc\/cassandra\/ cd \/opt\/brisk\/resources\/pig\/bin dse pig -l \/var\/tmp\/josefh\/ I ended up with following error: grunt> resources = LOAD ‚cassandra:\/\/mynamespace\/resource‘ USING CassandraStorage() AS (KEY, columns:bag{T:tuple(name:chararray,description:chararray)}); 2012-04-18 07:54:23,049 [main] ERROR org.apache.cassandra.hadoop.ConfigHelper – failed to connect to any initial addresses 2012-04-18 07:54:23,050 [main] ERROR org.apache.cassandra.hadoop.ConfigHelper […]<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[1],"tags":[],"class_list":["post-268","post","type-post","status-publish","format-standard","hentry","category-uncategorized"],"_links":{"self":[{"href":"https:\/\/nax.cz\/index.php?rest_route=\/wp\/v2\/posts\/268","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/nax.cz\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/nax.cz\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/nax.cz\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/nax.cz\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=268"}],"version-history":[{"count":0,"href":"https:\/\/nax.cz\/index.php?rest_route=\/wp\/v2\/posts\/268\/revisions"}],"wp:attachment":[{"href":"https:\/\/nax.cz\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=268"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/nax.cz\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=268"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/nax.cz\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=268"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}