What Is Hadoop?


Hadoop is a term you will hear over and over again when discussing the processing of big data information.

You might have also seen the yellow elephant image, which is the copyrighted icon depicting Hadoop (Hadoop was the name of the founder’s (Doug Cutting’s) son’s toy elephant).
In the other post, I broke down the idea of MapReduce into the most easily digestible way possible; here is the same with Hadoop.
A little history… Hadoop was born out of a need to process big data, as the amount of generated data continued to rapidly increase. As the Web generated more and more information, it was becoming quite challenging to index the content, so Google created MapReduce in 2004, then Yahoo! created Hadoop as a way to implement the MapReduce function. Hadoop is now an open-source Apache implementation project.
Overall, Hadoop enables applications to work with huge amounts of data stored on various servers. Hadoop’s functions allow the existing data to be pulled from various places (since now, data is not centralized, but distributed in places using cloud technology) and use the MapReduce technology to push the query code and run a proper analysis, therefore returning the desired results.

As for the more specific functions, Hadoop has a large-scale file system (Hadoop Distributed File System or HDFS), it can write programs, it manages the distribution of programs, then accepts the results, and generates a data result set.

Comments

Post a Comment

Popular posts from this blog

Image
Capricornian Lucky Connections Colour: brown, green, black, gray, indigo Plants: yew, ash, hemp, weeping willow Perfume: musk Starstone: black onyx Metal: lead Tarot Card: the devil Animals: goat, donkey Ruling Planet: Saturn Lucky Numbers: 6, 8 and 9 black onyx Emerald ~ Panna Blue Sapphire ~ Neelam Pearl ~ Moti Blue Lapiz Lazuli
Read more

Now, send free SMS through Gmail chat

Now, send free SMS through Gmail chat It is finally here. The free SMS service right from your Gmail chat window.  Almost a year after the service was introduced in the United States and many other countries, the service has now been made available to Indian users. You could now send a text message to most mobile operators across the country from the comfort of your computer, although there is a prominent exception, at least for users in Bangalore. The Gmail Free SMS service is available for connection to mobile phones with SIMs of many operators, including BSNL, Aircel, Idea, Loop Mobile, MTS, Reliance, Tata DoCoMo, Tata Indicom and Vodafone. However, repeated test messages to Airtel mobiles failed to get the SMSes delivered. Once you send an SMS from the chat window to a mobile phone other than Airtel’s, you wait for a response. The replies will appear as regular chat replies  and conversations will also be stored in your chat history. The new feature was rolled out t...
Read more

CPA Gateway Company Leadbolt Why You Should Use Them

When searching for a CPA company often times you will have a hard time figuring out who to use as many companies sound promising but usually come short on what they promise. Many CPA companies fail to meet payments on schedule, cheat you out of legitimate conversions, or ban your account before you receive payments. Leadbolt isn’t one of those companies that you hear about from other Internet marketers as they are real company founded in the United States with a strong track record among the industry. Leadbolt is defined as a CPA Gateway company like CPA lead. When you visit a website with Leadbolt’s code installed into the website, a blocker will pop up and before they can enter the website they must fill out a survey from a number of advertisers. Once the survey has been filled out you will be paid a commission and the person will be able to enter the website. To incentivize people to fill out surveys to enter the website you can offer downloads, coupons, or adult content etc. Ra...
Read more