MARVIN: Distributed reasoning over large-scale Semantic Web data. Oren, E., Kotoulas, S., Anadiotis, G., Siebes, R., ten Teije , A., & van Harmelen , F. Journal of Web Semantics, Elsevier, 2009.
doi  abstract   bibtex   
Many Semantic Web problems are difficult to solve through common divide-and-conquer strategies, since they are hard to partition. We present Marvin, a parallel and distributed platform for processing large amounts of RDF data, on a network of loosely coupled peers. We present our divide-conquer-swap strategy and show that this model converges towards completeness. Within this strategy, we address the problem of making distributed reasoning scalable and load-balanced. We present SpeedDate, a routing strategy that combines data clustering with random exchanges. The random exchanges ensure load balancing, while the data clustering attempts to maximise efficiency. SpeedDate is compared against random and deterministic (DHT-like) approaches, on performance and load-balancing. We simulate parameters such as system size, data distribution, churn rate, and network topology. The results indicate that SpeedDate is near-optimally balanced, performs in the same order of magnitude as a DHT-like approach, and has an average throughput per node that scales with sqrt(i) for i items in the system. We evaluate our overall Marvin system for performance, scalability, load balancing and efficiency. © 2009 Elsevier B.V. All rights reserved.
@article{dcf9139489264b0793a7e4646dea2a19,
  title     = "MARVIN: Distributed reasoning over large-scale Semantic Web data",
  abstract  = "Many Semantic Web problems are difficult to solve through common divide-and-conquer strategies, since they are hard to partition. We present Marvin, a parallel and distributed platform for processing large amounts of RDF data, on a network of loosely coupled peers. We present our divide-conquer-swap strategy and show that this model converges towards completeness. Within this strategy, we address the problem of making distributed reasoning scalable and load-balanced. We present SpeedDate, a routing strategy that combines data clustering with random exchanges. The random exchanges ensure load balancing, while the data clustering attempts to maximise efficiency. SpeedDate is compared against random and deterministic (DHT-like) approaches, on performance and load-balancing. We simulate parameters such as system size, data distribution, churn rate, and network topology. The results indicate that SpeedDate is near-optimally balanced, performs in the same order of magnitude as a DHT-like approach, and has an average throughput per node that scales with sqrt(i) for i items in the system. We evaluate our overall Marvin system for performance, scalability, load balancing and efficiency. © 2009 Elsevier B.V. All rights reserved.",
  author    = "E. Oren and S. Kotoulas and G. Anadiotis and R.M. Siebes and {ten Teije}, A.C.M. and {van Harmelen}, F.A.H.",
  year      = "2009",
  doi       = "10.1016/j.websem.2009.09.002",
  volume    = "7",
  journal   = "Journal of Web Semantics",
  issn      = "1570-8268",
  publisher = "Elsevier",
  number    = "4",
}

Downloads: 0