A Novel Change-Point Detection Approach for Monitoring High-Dimensional Traffics in Distributed Systems

A Novel Change-Point Detection Approach for Monitoring High-Dimensional Traffics in Distributed Systems. Zhao, L., Liu, Q., Du, P., Fu, G., & Cao, W. 2014. Conference Name: Advances in Mechatronics, Robotics and Automation II ISBN: 9783038350781 ISSN: 1662-7482 Pages: 499-511 Publisher: Trans Tech Publications Ltd Volume: 536-537

Paper doi abstract bibtex

Change-point detection is the problem of finding abrupt changes in time-series. However, the meaningful changes are usually difficult to identify from the original massive traffics, due to high dimension and strong periodicity. In this paper, we propose a novel change-point detection approach, which simultaneously detects change points from all dimensions of the traffics with three steps. We first reduce the dimensions by the classical Principal Component Analysis (PCA), then we apply an extended time-series segmentation method to detect the nontrivial change times, finally we identify the responsible applications for the changes by F-test. We demonstrate through experiments on datasets collected from four distributed systems with 44 applications that the proposed approach can effectively detect the nontrivial change points from the multivariate and periodical traffics. Our approach is more appropriate for mining the nontrivial changes in traffic data comparing with other clustering methods, such as center-based Kmeans and density-based DBSCAN.

@misc{zhao_novel_2014,
	title = {A {Novel} {Change}-{Point} {Detection} {Approach} for {Monitoring} {High}-{Dimensional} {Traffics} in {Distributed} {Systems}},
	url = {https://www.scientific.net/AMM.536-537.499},
	abstract = {Change-point detection is the problem of finding abrupt changes in time-series. However, the meaningful changes are usually difficult to identify from the original massive traffics, due to high dimension and strong periodicity. In this paper, we propose a novel change-point detection approach, which simultaneously detects change points from all dimensions of the traffics with three steps. We first reduce the dimensions by the classical Principal Component Analysis (PCA), then we apply an extended time-series segmentation method to detect the nontrivial change times, finally we identify the responsible applications for the changes by F-test. We demonstrate through experiments on datasets collected from four distributed systems with 44 applications that the proposed approach can effectively detect the nontrivial change points from the multivariate and periodical traffics. Our approach is more appropriate for mining the nontrivial changes in traffic data comparing with other clustering methods, such as center-based Kmeans and density-based DBSCAN.},
	language = {en},
	urldate = {2020-10-01},
	journal = {Applied Mechanics and Materials},
	author = {Zhao, Li and Liu, Qian and Du, Peng and Fu, Ge and Cao, Wei},
	year = {2014},
	doi = {10.4028/www.scientific.net/AMM.536-537.499},
	note = {Conference Name: Advances in Mechatronics, Robotics and Automation II
ISBN: 9783038350781
ISSN: 1662-7482
Pages: 499-511
Publisher: Trans Tech Publications Ltd
Volume: 536-537},
}

Downloads: 0

{"_id":"t7cw2KDPNXGWSxA4n","bibbaseid":"zhao-liu-du-fu-cao-anovelchangepointdetectionapproachformonitoringhighdimensionaltrafficsindistributedsystems-2014","author_short":["Zhao, L.","Liu, Q.","Du, P.","Fu, G.","Cao, W."],"bibdata":{"bibtype":"misc","type":"misc","title":"A Novel Change-Point Detection Approach for Monitoring High-Dimensional Traffics in Distributed Systems","url":"https://www.scientific.net/AMM.536-537.499","abstract":"Change-point detection is the problem of finding abrupt changes in time-series. However, the meaningful changes are usually difficult to identify from the original massive traffics, due to high dimension and strong periodicity. In this paper, we propose a novel change-point detection approach, which simultaneously detects change points from all dimensions of the traffics with three steps. We first reduce the dimensions by the classical Principal Component Analysis (PCA), then we apply an extended time-series segmentation method to detect the nontrivial change times, finally we identify the responsible applications for the changes by F-test. We demonstrate through experiments on datasets collected from four distributed systems with 44 applications that the proposed approach can effectively detect the nontrivial change points from the multivariate and periodical traffics. Our approach is more appropriate for mining the nontrivial changes in traffic data comparing with other clustering methods, such as center-based Kmeans and density-based DBSCAN.","language":"en","urldate":"2020-10-01","journal":"Applied Mechanics and Materials","author":[{"propositions":[],"lastnames":["Zhao"],"firstnames":["Li"],"suffixes":[]},{"propositions":[],"lastnames":["Liu"],"firstnames":["Qian"],"suffixes":[]},{"propositions":[],"lastnames":["Du"],"firstnames":["Peng"],"suffixes":[]},{"propositions":[],"lastnames":["Fu"],"firstnames":["Ge"],"suffixes":[]},{"propositions":[],"lastnames":["Cao"],"firstnames":["Wei"],"suffixes":[]}],"year":"2014","doi":"10.4028/www.scientific.net/AMM.536-537.499","note":"Conference Name: Advances in Mechatronics, Robotics and Automation II ISBN: 9783038350781 ISSN: 1662-7482 Pages: 499-511 Publisher: Trans Tech Publications Ltd Volume: 536-537","bibtex":"@misc{zhao_novel_2014,\n\ttitle = {A {Novel} {Change}-{Point} {Detection} {Approach} for {Monitoring} {High}-{Dimensional} {Traffics} in {Distributed} {Systems}},\n\turl = {https://www.scientific.net/AMM.536-537.499},\n\tabstract = {Change-point detection is the problem of finding abrupt changes in time-series. However, the meaningful changes are usually difficult to identify from the original massive traffics, due to high dimension and strong periodicity. In this paper, we propose a novel change-point detection approach, which simultaneously detects change points from all dimensions of the traffics with three steps. We first reduce the dimensions by the classical Principal Component Analysis (PCA), then we apply an extended time-series segmentation method to detect the nontrivial change times, finally we identify the responsible applications for the changes by F-test. We demonstrate through experiments on datasets collected from four distributed systems with 44 applications that the proposed approach can effectively detect the nontrivial change points from the multivariate and periodical traffics. Our approach is more appropriate for mining the nontrivial changes in traffic data comparing with other clustering methods, such as center-based Kmeans and density-based DBSCAN.},\n\tlanguage = {en},\n\turldate = {2020-10-01},\n\tjournal = {Applied Mechanics and Materials},\n\tauthor = {Zhao, Li and Liu, Qian and Du, Peng and Fu, Ge and Cao, Wei},\n\tyear = {2014},\n\tdoi = {10.4028/www.scientific.net/AMM.536-537.499},\n\tnote = {Conference Name: Advances in Mechatronics, Robotics and Automation II\nISBN: 9783038350781\nISSN: 1662-7482\nPages: 499-511\nPublisher: Trans Tech Publications Ltd\nVolume: 536-537},\n}\n\n","author_short":["Zhao, L.","Liu, Q.","Du, P.","Fu, G.","Cao, W."],"key":"zhao_novel_2014","id":"zhao_novel_2014","bibbaseid":"zhao-liu-du-fu-cao-anovelchangepointdetectionapproachformonitoringhighdimensionaltrafficsindistributedsystems-2014","role":"author","urls":{"Paper":"https://www.scientific.net/AMM.536-537.499"},"metadata":{"authorlinks":{}}},"bibtype":"misc","biburl":"https://bibbase.org/zotero/mh_lenguyen","dataSources":["iwKepCrWBps7ojhDx"],"keywords":[],"search_terms":["novel","change","point","detection","approach","monitoring","high","dimensional","traffics","distributed","systems","zhao","liu","du","fu","cao"],"title":"A Novel Change-Point Detection Approach for Monitoring High-Dimensional Traffics in Distributed Systems","year":2014}