Posted
by sagie
on Stack Overflow
See other posts from Stack Overflow
or by sagie
Published on 2010-01-28T12:19:48Z
Indexed on
2010/03/30
14:03 UTC
Read the original article
Hit count: 618
Hi I am using Pig to cross join two data sets, both with format. This will result as . In my case, if I have both tuples and , it is a duplication. Can I filter those duplications (or not joining them at all)?
thanks, Sagie
© Stack Overflow or respective owner
as seen on Stack Overflow
- Search for 'Stack Overflow'
Apache Pig can load data from Hadoop sequence files using the PiggyBank SequenceFileLoader:
REGISTER /home/hadoop/pig/contrib/piggybank/java/piggybank.jar;
DEFINE SequenceFileLoader org.apache.pig.piggybank.storage.SequenceFileLoader();
log = LOAD '/data/logs' USING SequenceFileLoader AS (...)
Is…
>>> More
as seen on Server Fault
- Search for 'Server Fault'
I'm following basic Pig, Cassandra, Hadoop installation. Everything works just fine as a stand alone. No error. However when I tried to run the example file provided by Pig_cassandra example, I got this error.
[root@localhost pig]# /opt/cassandra/apache-cassandra-1.1.6/examples/pig/bin/pig_cassandra
-x…
>>> More
as seen on SQL Authority
- Search for 'SQL Authority'
In yesterday’s blog post we learned the importance of the HIVE in Big Data Story. In this article we will understand what is PIG and PIG Latin in Big Data Story.
Yahoo started working on Pig for their application deployment on Hadoop. The goal of Yahoo to manage their unstructured data.
What…
>>> More
as seen on Stack Overflow
- Search for 'Stack Overflow'
Hi
I am using Pig to cross join two data sets, both with format.
This will result as .
In my case, if I have both tuples and , it is a duplication.
Can I filter those duplications (or not joining them at all)?
thanks,
Sagie
>>> More
as seen on Stack Overflow
- Search for 'Stack Overflow'
I have this following pig script, which works perfectly using grunt shell (stored the results to HDFS without any issues); however, the last job (ORDER BY) failed if I ran the same script using Java EmbeddedPig. If I replace the ORDER BY job by others, such as GROUP or FOREACH GENERATE, the whole…
>>> More
as seen on Programmers
- Search for 'Programmers'
i am willing to learn hadoop as a Developer , but i am confused over the prerequisite of learning it.? is having a good experience in java programming very essential to learn hadoop? I have 4 years of experience in application development in LAMP.
But i am not in touch with java programming as a part…
>>> More
as seen on Server Fault
- Search for 'Server Fault'
Full list of error:
hb@localhost:/etc/hadoop/conf$ sudo service hadoop-hdfs-namenode start
* Starting Hadoop namenode:
starting namenode, logging to /var/log/hadoop-hdfs/hadoop-hdfs-namenode-localhost.out
12/09/10 14:41:09 INFO namenode.NameNode: STARTUP_MSG:
/************************************************************
STARTUP_MSG:…
>>> More
as seen on Server Fault
- Search for 'Server Fault'
Introduction
An attempt to combine HBase and HDFS results in the following:
2014-06-09 00:15:14,777 WARN org.apache.hadoop.hbase.HBaseFileSystem: Create Dir
ectory, retries exhausted
2014-06-09 00:15:14,780 FATAL org.apache.hadoop.hbase.master.HMaster: Unhandled
exception. Starting shutdown.
java…
>>> More
as seen on Stack Overflow
- Search for 'Stack Overflow'
I compiling with Solaris 10 SPARC, jdk 1.6 from Sun, Ant 1.7.1 from OpenCSW.
I have no problem running hadoop 0.17.2.1
However, I have problem compiling/integrating hive with the error 'cannot find symbol', although I followed the tutorial.
I have the hive source code from SVN exactly from tutorial…
>>> More
as seen on Stack Overflow
- Search for 'Stack Overflow'
I'm new to hadoop and is in learning phase.
As per Hadoop Definitve guide, i have set up my hadoop in pseudo distributed mode and everything was working fine. I was even able to execute all the examples from chapter 3 yesterday. Today, when i rebooted my unix and tried to run start-dfs.sh and then…
>>> More
