pferrel's Stuff

Home » pferrel (5 trails)
pferrel's Stats (public trails only):
Trails created: 105
Marks created: 303
Views received: 47,197
Positive ratings: 1
Negative ratings:
Comments received: 17
Comments left: 70
pferrel

The only good marmot is a dead marmot.

pferrel's Trails: input    (view all)
These four novel components of human thought are the ability to combine and recombine different types of information and knowledge in order to gain new understanding; to apply the same “rule” or solution to one problem to a different and new situation; to create and easily understand symbolic representations of computation and sensory input; and to detach modes of thought from raw sensory and perceptual input.
Tags: cognition, thought, “rule”, postulates, recombine, ...
A trail of 1 page
A simple mapreduce program in php running on hadoop
Tags: hadoop, mapreduce, slashdot, news, nerds, ...
A trail of 2 pages

Uses

MapReduce is useful in a wide range of applications, including: "distributed grep, distributed sort, web link-graph reversal, term-vector per host, web access log stats, inverted index construction, document clustering, machine learning, statistical machine translation..." Most significantly, when MapReduce was finished, it was used to completely regenerate Google's index of the Internet, and replaced the old ad hoc programs that updated the index and ran the various analyses. [2]

MapReduce's stable inputs and outputs are usually stored in a distributed file system, such as Google File System. The transient data is usually stored on local disk and fetched remotely by the reduces.

[edit]

Tags: mapreduce, hadoop, hadooppresentations, prsentationtemplate, uneprsentationtemplate, ...
A trail of 5 pages
Tags: rails, tidbits, ruby, references, rake, ...
A trail of 1 page
Example ruby starfish app.
Tags: starfish, ruby, "distributed processing", software, technoblog, ...
A trail of 2 pages