Title: Understanding Hadoop through matrix multiplication using R
Tags: r;hadoop;matrix
Question: This is just an attempt to understand Hadoop, R and the best practice for doing certain things that really leverages the best of both Hadoop and R.

If the goal is to multiply two matrices A*B when these two matrices are stored in Hadoop then traditional methods of multiplying two matrices A &amp; B in R is against the logic of big data. The reason we are having this discussion in the first place is because r chokes on big data and it is impossible to multiple two large matrices in R ? If I am correct so far, matrix multiplication should be performed using shell scripts/ unix scripts, is this correct ? we just use R to display the results of this operation (matrix multiplication) that occurred behind the scene via shell script, am I correct ? 

Interested to know your thoughts on this topic.

Comment: Check out [mining massive dataset](http://infolab.stanford.edu/~ullman/mmds/book.pdf), maybe page 30.

Comment: Do you think you can answer your own question so it will be helpful for the coming readers or you want me to do it?

Comment: @B.Mr.W. that pdf is exactly what the doctor prescribed :) awesome.



{'source': 'StackExchangeDataset', 'subset': 'stackoverflow.com', 'metadata': {'AnswerCount': 0, 'CommentCount': 3, 'ContentLicense': 'CC BY-SA 3.0', 'CreationDate': '2014:00:11/17/14', 'FavoriteCount': None, 'PostTypeId': 1, 'Tags': '<r><hadoop><matrix>', 'Title': 'Understanding Hadoop through matrix multiplication using R', 'ViewCount': 260, 'id': 26984113, 'user_AboutMe': None, 'user_AccountId': 4899940.0, 'user_DisplayName': 'Tyrone Williams', 'user_Reputation': 77.0, 'user_Views': 37.0, 'user_id': 3948603.0}}