Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

The reduce stage explanation is rather poor. Reduce aggregates based on key and does not just mash everything together like the proverbial grinder.


Like all good lessons, this one starts with a little lie and tells you the truth later on...

"Supriya : But how I will create different types of Chutneys?

Shekhar : Now you will see the missing phase of MapReduce — Shuffle phase. MapReduce will group all the outputs written by every Map based on the key. This will be automatically done for you. You can assume key as just a name of ingredient like Onion. So all the onion keys will be grouped together and will be transferred to a grinder which will just process onions. So, you will get onion Chutney. Similarly all the tomatoes will be transferred to the grinder marked for tomato and will produce tomato Chutney."




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: