Do You See Me Now? Sparsity in Passive Observations of Address Liveness (extended). Mirkovic, J., Bartlett, G., Heidemann, J., Shi, H., & Deng, X. Technical Report ISI-TR-2016-710, USC/Information Sciences Institute, July, 2016. ![Do You See Me Now? Sparsity in Passive Observations of Address Liveness (extended) [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper abstract bibtex Full allocation of IPv4 addresses has prompted interest in measuring address \emphliveness, first with active probing, and recently with the addition of passive observation. While prior work has shown dramatic increases in coverage, this paper explores \emphwhat factors affect contributions of passive observers to visibility. While all passive monitors are \emphsparse, seeing only a part of the Internet, we seek to understand how different types of sparsity impact observation quality: the \emphinterests of external hosts and the hosts within the observed network, the \emphtemporal limitations on the observation duration, and \emphcoverage challenges to observe all traffic for a given target or a given vantage point. We study sparsity with \emphinverted analysis, a new approach where we use passive monitors at four sites to infer what monitors would see at \emphall sites exchanging traffic with those four. We show that visibility provided by monitors is heavy-tailed—interest sparsity means popular monitors see a great deal, while 99% see very little. We find that traffic is bipartite, with visibility much stronger between client-networks and server-networks than within each group. Finally, we find that popular monitors are robust to temporal and coverage sparsity, but they greatly reduce power of monitors that start with low visibility.
@TechReport{Mirkovic16a,
author = "Jelena Mirkovic and Genevieve Bartlett and
John Heidemann and Hao Shi and Xiyue Deng",
title = "Do You See Me Now? Sparsity in Passive
Observations of Address Liveness (extended)",
institution = "USC/Information Sciences Institute",
year = 2016,
sortdate = "2016-07-27",
number = "ISI-TR-2016-710",
project = "ant, lacrend, lander, retrofuture",
jsubject = "topology_modeling",
month = jul,
jlocation = "johnh: pafile",
keywords = "passive observation, internet census",
url = "https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.html",
pdfurl = "https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.pdf",
myorganization = "USC/Information Sciences Institute",
copyrightholder = "authors",
abstract = "
Full allocation of IPv4 addresses has prompted interest in measuring
address \emph{liveness}, first with active probing, and recently with
the addition of passive observation. While prior work has shown
dramatic increases in coverage, this paper explores \emph{what factors
affect contributions of passive observers to visibility}. While all
passive monitors are \emph{sparse}, seeing only a part of the
Internet, we seek to understand how different types of sparsity impact
observation quality: the \emph{interests} of external hosts and the
hosts within the observed network, the \emph{temporal} limitations on
the observation duration, and \emph{coverage} challenges to observe
all traffic for a given target or a given vantage point. We study
sparsity with \emph{inverted analysis}, a new approach where we use
passive monitors at four sites to infer what monitors would see at
\emph{all} sites exchanging traffic with those four. We show that
visibility provided by monitors is heavy-tailed---interest sparsity
means popular monitors see a great deal, while 99\% see very little.
We find that traffic is bipartite, with visibility much stronger
between client-networks and server-networks than within each group.
Finally, we find that popular monitors are robust to temporal and
coverage sparsity, but they greatly reduce power of monitors that
start with low visibility.
",
}
Downloads: 0
{"_id":"jSBFGcnSC6nNWeKDD","bibbaseid":"mirkovic-bartlett-heidemann-shi-deng-doyouseemenowsparsityinpassiveobservationsofaddresslivenessextended-2016","author_short":["Mirkovic, J.","Bartlett, G.","Heidemann, J.","Shi, H.","Deng, X."],"bibdata":{"bibtype":"techreport","type":"techreport","author":[{"firstnames":["Jelena"],"propositions":[],"lastnames":["Mirkovic"],"suffixes":[]},{"firstnames":["Genevieve"],"propositions":[],"lastnames":["Bartlett"],"suffixes":[]},{"firstnames":["John"],"propositions":[],"lastnames":["Heidemann"],"suffixes":[]},{"firstnames":["Hao"],"propositions":[],"lastnames":["Shi"],"suffixes":[]},{"firstnames":["Xiyue"],"propositions":[],"lastnames":["Deng"],"suffixes":[]}],"title":"Do You See Me Now? Sparsity in Passive Observations of Address Liveness (extended)","institution":"USC/Information Sciences Institute","year":"2016","sortdate":"2016-07-27","number":"ISI-TR-2016-710","project":"ant, lacrend, lander, retrofuture","jsubject":"topology_modeling","month":"July","jlocation":"johnh: pafile","keywords":"passive observation, internet census","url":"https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.html","pdfurl":"https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.pdf","myorganization":"USC/Information Sciences Institute","copyrightholder":"authors","abstract":"Full allocation of IPv4 addresses has prompted interest in measuring address \\emphliveness, first with active probing, and recently with the addition of passive observation. While prior work has shown dramatic increases in coverage, this paper explores \\emphwhat factors affect contributions of passive observers to visibility. While all passive monitors are \\emphsparse, seeing only a part of the Internet, we seek to understand how different types of sparsity impact observation quality: the \\emphinterests of external hosts and the hosts within the observed network, the \\emphtemporal limitations on the observation duration, and \\emphcoverage challenges to observe all traffic for a given target or a given vantage point. We study sparsity with \\emphinverted analysis, a new approach where we use passive monitors at four sites to infer what monitors would see at \\emphall sites exchanging traffic with those four. We show that visibility provided by monitors is heavy-tailed—interest sparsity means popular monitors see a great deal, while 99% see very little. We find that traffic is bipartite, with visibility much stronger between client-networks and server-networks than within each group. Finally, we find that popular monitors are robust to temporal and coverage sparsity, but they greatly reduce power of monitors that start with low visibility. ","bibtex":"@TechReport{Mirkovic16a,\n\tauthor = \t\"Jelena Mirkovic and Genevieve Bartlett and\n John Heidemann and Hao Shi and Xiyue Deng\",\n\ttitle = \t\"Do You See Me Now? Sparsity in Passive\n Observations of Address Liveness (extended)\",\n\tinstitution = \t\"USC/Information Sciences Institute\",\n\tyear = \t\t2016,\n\tsortdate = \"2016-07-27\",\n\tnumber = \t\"ISI-TR-2016-710\",\n\tproject = \"ant, lacrend, lander, retrofuture\",\n\tjsubject = \"topology_modeling\",\n\tmonth = \tjul,\n\tjlocation = \t\"johnh: pafile\",\n\tkeywords = \t\"passive observation, internet census\",\n\turl =\t\t\"https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.html\",\n\tpdfurl =\t\"https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.pdf\",\n\tmyorganization =\t\"USC/Information Sciences Institute\",\n\tcopyrightholder = \"authors\",\n\tabstract = \"\nFull allocation of IPv4 addresses has prompted interest in measuring\naddress \\emph{liveness}, first with active probing, and recently with\nthe addition of passive observation. While prior work has shown\ndramatic increases in coverage, this paper explores \\emph{what factors\n affect contributions of passive observers to visibility}. While all\npassive monitors are \\emph{sparse}, seeing only a part of the\nInternet, we seek to understand how different types of sparsity impact\nobservation quality: the \\emph{interests} of external hosts and the\nhosts within the observed network, the \\emph{temporal} limitations on\nthe observation duration, and \\emph{coverage} challenges to observe\nall traffic for a given target or a given vantage point. We study\nsparsity with \\emph{inverted analysis}, a new approach where we use\npassive monitors at four sites to infer what monitors would see at\n\\emph{all} sites exchanging traffic with those four. We show that\nvisibility provided by monitors is heavy-tailed---interest sparsity\nmeans popular monitors see a great deal, while 99\\% see very little.\nWe find that traffic is bipartite, with visibility much stronger\nbetween client-networks and server-networks than within each group.\nFinally, we find that popular monitors are robust to temporal and\ncoverage sparsity, but they greatly reduce power of monitors that\nstart with low visibility.\n\",\n}\n\n","author_short":["Mirkovic, J.","Bartlett, G.","Heidemann, J.","Shi, H.","Deng, X."],"bibbaseid":"mirkovic-bartlett-heidemann-shi-deng-doyouseemenowsparsityinpassiveobservationsofaddresslivenessextended-2016","role":"author","urls":{"Paper":"https://ant.isi.edu/%7ejohnh/PAPERS/Mirkovic16a.html"},"keyword":["passive observation","internet census"],"metadata":{"authorlinks":{}}},"bibtype":"techreport","biburl":"https://bibbase.org/f/dHevizJoWEhWowz8q/johnh-2023-2.bib","dataSources":["YLyu3mj3xsBeoqiHK","fLZcDgNSoSuatv6aX","fxEParwu2ZfurScPY","7nuQvtHTqKrLmgu99"],"keywords":["passive observation","internet census"],"search_terms":["see","now","sparsity","passive","observations","address","liveness","extended","mirkovic","bartlett","heidemann","shi","deng"],"title":"Do You See Me Now? Sparsity in Passive Observations of Address Liveness (extended)","year":2016}