hadoop - Sqoop Free-Form Query Causing Unrecognized Arguments in Hue/Oozie -

-

i attempting run sqoop command free-form query, because need perform aggregation. it's being submitted via hue interface, oozie workflow. following scaled-down version of command , query. when command processed, "--query" statement (enclosed in quotes) results in each portion of query interpreted unrecognized arguments, shown in error following command. in addition, target directory being misinterpreted. preventing running, , can done resolve it? ${env} , ${shard} variables being parsed, reflected in last error message.

thank you!

===========

import --connect jdbc:mysql://irbasedw-${shard}.db.xxxx.net:3417/irbasedw_${shard}?donttrackopenresources=true&defaultfetchsize=10000&usecursorfetch=true --username iretl --password-file /irdw/${env}/lib/.passwordbasedw --table agg_daily_activity_performance_stage -m 1 --query "select sum(click_count) agg_daily_activity_performance_stage \$conditions group 1" --target-dir /irdw/${env}/legacy/agg/activity_performance/text/shard_${shard}

==========

 3881 [main] error org.apache.sqoop.tool.basesqooptool  - error parsing arguments import: 3881 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: sum(click_count) 3881 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: agg_daily_activity_performance_stage 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: \$conditions 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: group 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: 1" 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: --target-dir 3882 [main] error org.apache.sqoop.tool.basesqooptool  - unrecognized argument: /irdw/test/legacy/agg/activity_performance/text/shard_0

i able working. solution submit of query elements separate arguments. nothing should in "command" window. instead, starting "import" first argument, enter each part of query separate argument. properties , values each element entered separate arguments. example:

 arg:  import arg:  --connect arg:  jdbc:mysql.... arg:  --username arg:  [username] arg:  --password-file arg:  [password file] arg:  --query arg:  select ..... arg:  --target-dir arg:  [target]

the workflow performs expected.


Comments

Post a Comment

Popular posts from this blog

javascript - how to protect a flash video from refresh？ -

-
<!doctype html> <html> <head> <meta http-equiv="content-type" content="text/html; charset=utf-8"> <title>flash video refresh</title> </head> <body> <div id="playerzone"><embed height="496" width="580" flashvars="flvid=19742822&amp;createtime=2012-4-19 13:46:33" wmode="opaque" allowscriptaccess="always" allowfullscreen="true" quality="high" bgcolor="#000000" name="player" id="player" src="swf/mine.swf" type="application/x-shockwave-flash"></div> <a onclick="return test();" id="test">click me popup div,and hide scrollbar</a> </body> the code upon： for example,when click a#test button,popup div,it's no problem,but want hide scrollbar while div popup. i used $('html').css('overflow','hidden') in...
Read more

visual studio 2010 - Connect to informix database windows form application -

-
i trying figure out how connect ibm informix database. have been doing research , have found threads 5 years ago examples not working. i have installed latest sdk ibm informix. i have included ibm.data.informix.dll references in project. i have included using ibm.data.informix; i adding button , on click testing conenction. debug error "sql0035n file "c:\users\adam\documents\visual studio 2010\projects\test\test\msg\en_us\db2nmp.xml" cannot opened." this file not exist , dont see anywhere in program files (x86)\ibm informix client sdk directory. my on click code is private void button1_click(object sender, eventargs e) { const string host = "192.168.obfuscated"; const string servicenum = "1525"; //port? const string server = "serverobfuscated"; const string database = "dbobfuscatedy"; const string user = "myusername"; const string password = ...
Read more

android - Associate same looper with different threads -

-
Image
in application, want create multiple threads working on single queue. create queue know need call looper.prepare() . i want other threads create should associated looper created first thread, how can achieve this? use 1 of java thread safe queue class java.util.concurrent package instead of looper achieve goal. it's more common practice. share queue between threads , post task queue entry 1 thread can entry thread. blockingqueue can - in 1 thread call take() , block thread until thread put() entry queue. that's all. producer consumer pattern example blockingqueue or concurrentlinkedqueue about blockingqueue
Read more