I've been reading on distributed systems for processing on large graphs. The most prominent examples include Pregel (developed by Google) and Apache Giraph. Most of these systems argue their existence that they are for "big data" processing, i.e., they can handle graphs that are too big to fit into a single machine.

While I'm aware that there are (a few) real world examples of graphs that are HUGE, for example, the Facebook graph (billion of nodes, trillion of edges), or the web graph, it seems to me that these are outliers and most people will rarely ever have to deal with such data sets.

Are there examples of graphs that frequently occur in the real world (i.e. either created by humans or occurring in nature) that are so huge that they cannot be handled by a single (commodity-type) machine?

  • $\begingroup$ I have worked with graphs that have billions of edges, like the 2009 Twitter graph. I have a feel the question is too subjective. What makes you say the FB graph is an outlier? People are interested in social network analysis. From what I've understood from people working in the domain, they really need to handle huge graphs like you describe. $\endgroup$
    – Juho
    Jan 23 '15 at 7:33
  • $\begingroup$ there are many in bioinformatics eg DNA/ gene interactions etc... $\endgroup$
    – vzn
    Jan 24 '15 at 0:04

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Browse other questions tagged or ask your own question.