Support Forums

Hadoop, Hive, Pig etc

Batch, ASP, JScript, Kixtart, etc.
Forum rules
Do not post any licensing information in this forum.
User avatar
rowlandg
Posts: 3
Joined: Mon Dec 03, 2012 5:50 am

Hadoop, Hive, Pig etc

Postby rowlandg » Mon Dec 03, 2012 5:50 am

I've recently started working with Hadoop, Hive and Pig. Do you have any plans to support the Big Data technologies and languages?

Hive is somewhat like ANSI 92 SQL so there's an initial area I know you can cover. But Pig has a different approach. The most popular editor I think is the PigPen plugin for Eclipse.

TIA
Rowland
User avatar
Alexander Riedel
Posts: 5857
Joined: Tue May 29, 2007 4:43 pm

Hadoop, Hive, Pig etc

Postby Alexander Riedel » Tue Dec 04, 2012 4:31 am

I must admit I have never heard of these before today, so no, we had no plans.
We are never opposed to adding new languages, but at first glance there is little documentation on syntax rules. We will check it out though.
Alexander Riedel
SAPIEN Technologies, Inc.
User avatar
rowlandg
Posts: 3
Joined: Mon Dec 03, 2012 5:50 am

Re: Hadoop, Hive, Pig etc

Postby rowlandg » Fri Jul 19, 2013 8:51 am

I would urge you to move faster on this. I've been a Sapien customer for a number of years. There is no UI tool for Pig -- which is becoming the defacto standard for big data -- not only Hadoop but appliances like Teradata.

You guys are the natural fit for this.
User avatar
Alexander Riedel
Posts: 5857
Joined: Tue May 29, 2007 4:43 pm

Re: Hadoop, Hive, Pig etc

Postby Alexander Riedel » Fri Jul 19, 2013 9:02 am

Anyone else here using this?
Alexander Riedel
SAPIEN Technologies, Inc.
User avatar
jvierra
Posts: 10016
Joined: Tue May 22, 2007 9:57 am
Contact:

Re: Hadoop, Hive, Pig etc

Postby jvierra » Fri Jul 19, 2013 10:06 am

It apparently only works with Teradata and TerraData is a very small player in the game.

BIG data has gone by the wayside in favor of datamart-ing and leveraging of MD data. In many shops the raw extracts are stored as text compressed and high speed loaded when a new item is needed. Most SQL designers handle MD syntaxes well. Other companies have excellent tools for Teradata semantics.

It shuold be relatively easy to create a parser for 'Pig' if the syntax is publish as Backus Naur.
User avatar
rowlandg
Posts: 3
Joined: Mon Dec 03, 2012 5:50 am

Re: Hadoop, Hive, Pig etc

Postby rowlandg » Fri Jul 19, 2013 11:48 am

I'm not sure what you're talking about. Pig is one of several Big Data technologies invented at Yahoo!, Google and other places. It has found favor at IBM and many other large companies. Because it's open source it's finding favor even in smaller businesses.

For Example:

http://www.ibm.com/developerworks/libra ... dataquery/
User avatar
jvierra
Posts: 10016
Joined: Tue May 22, 2007 9:57 am
Contact:

Re: Hadoop, Hive, Pig etc

Postby jvierra » Fri Jul 19, 2013 12:17 pm

Yeah yeah. I know. I was working on 'big data' before the term was coined. I built a 6 Terabyte database in 1997. It was the second largest in the world at the time.

Pig is OK and I said it could be easily turned into a tool if you can find the B-N for it.
User avatar
Alexander Riedel
Posts: 5857
Joined: Tue May 29, 2007 4:43 pm

Re: Hadoop, Hive, Pig etc

Postby Alexander Riedel » Fri Jul 19, 2013 3:19 pm

Rowland, that was a general question to the folks following the forums here.
Alexander Riedel
SAPIEN Technologies, Inc.

Return to “Other Scripting Languages”

Who is online

Users browsing this forum: No registered users and 1 guest