Transfer learning for cross-company software defect prediction. Ma, Y., Luo, G., Zeng, X., & Chen, A. Information and Software Technology, 54(3):248--256, 2012. ![Transfer learning for cross-company software defect prediction [link]](https://bibbase.org/img/filetypes/link.svg "link")
Paper doi abstract bibtex Context Software defect prediction studies usually built models using within-company data, but very few focused on the prediction models trained with cross-company data. It is difficult to employ these models which are built on the within-company data in practice, because of the lack of these local data repositories. Recently, transfer learning has attracted more and more attention for building classifier in target domain using the data from related source domain. It is very useful in cases when distributions of training and test instances differ, but is it appropriate for cross-company software defect prediction? Objective In this paper, we consider the cross-company defect prediction scenario where source and target data are drawn from different companies. In order to harness cross company data, we try to exploit the transfer learning method to build faster and highly effective prediction model. Method Unlike the prior works selecting training data which are similar from the test data, we proposed a novel algorithm called Transfer Naive Bayes (TNB), by using the information of all the proper features in training data. Our solution estimates the distribution of the test data, and transfers cross-company data information into the weights of the training data. On these weighted data, the defect prediction model is built. Results This article presents a theoretical analysis for the comparative methods, and shows the experiment results on the data sets from different organizations. It indicates that TNB is more accurate in terms of AUC (The area under the receiver operating characteristic curve), within less runtime than the state of the art methods. Conclusion It is concluded that when there are too few local training data to train good classifiers, the useful knowledge from different-distribution training data on feature level may help. We are optimistic that our transfer learning method can guide optimal resource allocation strategies, which may reduce software testing cost and increase effectiveness of software testing process.
@article{ ma_transfer_2012,
title = {Transfer learning for cross-company software defect prediction},
volume = {54},
issn = {0950-5849},
url = {http://www.sciencedirect.com/science/article/pii/S0950584911001996},
doi = {10.1016/j.infsof.2011.09.007},
abstract = {Context
Software defect prediction studies usually built models using within-company data, but very few focused on the prediction models trained with cross-company data. It is difficult to employ these models which are built on the within-company data in practice, because of the lack of these local data repositories. Recently, transfer learning has attracted more and more attention for building classifier in target domain using the data from related source domain. It is very useful in cases when distributions of training and test instances differ, but is it appropriate for cross-company software defect prediction?
Objective
In this paper, we consider the cross-company defect prediction scenario where source and target data are drawn from different companies. In order to harness cross company data, we try to exploit the transfer learning method to build faster and highly effective prediction model.
Method
Unlike the prior works selecting training data which are similar from the test data, we proposed a novel algorithm called Transfer Naive Bayes (TNB), by using the information of all the proper features in training data. Our solution estimates the distribution of the test data, and transfers cross-company data information into the weights of the training data. On these weighted data, the defect prediction model is built.
Results
This article presents a theoretical analysis for the comparative methods, and shows the experiment results on the data sets from different organizations. It indicates that TNB is more accurate in terms of AUC (The area under the receiver operating characteristic curve), within less runtime than the state of the art methods.
Conclusion
It is concluded that when there are too few local training data to train good classifiers, the useful knowledge from different-distribution training data on feature level may help. We are optimistic that our transfer learning method can guide optimal resource allocation strategies, which may reduce software testing cost and increase effectiveness of software testing process.},
number = {3},
urldate = {2014-07-21TZ},
journal = {Information and Software Technology},
author = {Ma, Ying and Luo, Guangchun and Zeng, Xue and Chen, Aiguo},
year = {2012},
keywords = {Different distribution, Machine learning, Naive Bayes, Software defect prediction, Transfer learning, _done},
pages = {248--256}
}
Downloads: 0
{"_id":"3EEaZ4HuJvuQhTkFH","bibbaseid":"ma-luo-zeng-chen-transferlearningforcrosscompanysoftwaredefectprediction-2012","downloads":0,"creationDate":"2015-04-15T11:01:18.197Z","title":"Transfer learning for cross-company software defect prediction","author_short":["Ma, Y.","Luo, G.","Zeng, X.","Chen, A."],"year":2012,"bibtype":"article","biburl":"http://bibbase.org/zotero/troeger","bibdata":{"abstract":"Context Software defect prediction studies usually built models using within-company data, but very few focused on the prediction models trained with cross-company data. It is difficult to employ these models which are built on the within-company data in practice, because of the lack of these local data repositories. Recently, transfer learning has attracted more and more attention for building classifier in target domain using the data from related source domain. It is very useful in cases when distributions of training and test instances differ, but is it appropriate for cross-company software defect prediction? Objective In this paper, we consider the cross-company defect prediction scenario where source and target data are drawn from different companies. In order to harness cross company data, we try to exploit the transfer learning method to build faster and highly effective prediction model. Method Unlike the prior works selecting training data which are similar from the test data, we proposed a novel algorithm called Transfer Naive Bayes (TNB), by using the information of all the proper features in training data. Our solution estimates the distribution of the test data, and transfers cross-company data information into the weights of the training data. On these weighted data, the defect prediction model is built. Results This article presents a theoretical analysis for the comparative methods, and shows the experiment results on the data sets from different organizations. It indicates that TNB is more accurate in terms of AUC (The area under the receiver operating characteristic curve), within less runtime than the state of the art methods. Conclusion It is concluded that when there are too few local training data to train good classifiers, the useful knowledge from different-distribution training data on feature level may help. We are optimistic that our transfer learning method can guide optimal resource allocation strategies, which may reduce software testing cost and increase effectiveness of software testing process.","author":["Ma, Ying","Luo, Guangchun","Zeng, Xue","Chen, Aiguo"],"author_short":["Ma, Y.","Luo, G.","Zeng, X.","Chen, A."],"bibtex":"@article{ ma_transfer_2012,\n title = {Transfer learning for cross-company software defect prediction},\n volume = {54},\n issn = {0950-5849},\n url = {http://www.sciencedirect.com/science/article/pii/S0950584911001996},\n doi = {10.1016/j.infsof.2011.09.007},\n abstract = {Context\nSoftware defect prediction studies usually built models using within-company data, but very few focused on the prediction models trained with cross-company data. It is difficult to employ these models which are built on the within-company data in practice, because of the lack of these local data repositories. Recently, transfer learning has attracted more and more attention for building classifier in target domain using the data from related source domain. It is very useful in cases when distributions of training and test instances differ, but is it appropriate for cross-company software defect prediction?\nObjective\nIn this paper, we consider the cross-company defect prediction scenario where source and target data are drawn from different companies. In order to harness cross company data, we try to exploit the transfer learning method to build faster and highly effective prediction model.\nMethod\nUnlike the prior works selecting training data which are similar from the test data, we proposed a novel algorithm called Transfer Naive Bayes (TNB), by using the information of all the proper features in training data. Our solution estimates the distribution of the test data, and transfers cross-company data information into the weights of the training data. On these weighted data, the defect prediction model is built.\nResults\nThis article presents a theoretical analysis for the comparative methods, and shows the experiment results on the data sets from different organizations. It indicates that TNB is more accurate in terms of AUC (The area under the receiver operating characteristic curve), within less runtime than the state of the art methods.\nConclusion\nIt is concluded that when there are too few local training data to train good classifiers, the useful knowledge from different-distribution training data on feature level may help. We are optimistic that our transfer learning method can guide optimal resource allocation strategies, which may reduce software testing cost and increase effectiveness of software testing process.},\n number = {3},\n urldate = {2014-07-21TZ},\n journal = {Information and Software Technology},\n author = {Ma, Ying and Luo, Guangchun and Zeng, Xue and Chen, Aiguo},\n year = {2012},\n keywords = {Different distribution, Machine learning, Naive Bayes, Software defect prediction, Transfer learning, _done},\n pages = {248--256}\n}","bibtype":"article","doi":"10.1016/j.infsof.2011.09.007","id":"ma_transfer_2012","issn":"0950-5849","journal":"Information and Software Technology","key":"ma_transfer_2012","keywords":"Different distribution, Machine learning, Naive Bayes, Software defect prediction, Transfer learning, _done","number":"3","pages":"248--256","title":"Transfer learning for cross-company software defect prediction","type":"article","url":"http://www.sciencedirect.com/science/article/pii/S0950584911001996","urldate":"2014-07-21TZ","volume":"54","year":"2012","bibbaseid":"ma-luo-zeng-chen-transferlearningforcrosscompanysoftwaredefectprediction-2012","role":"author","urls":{"Paper":"http://www.sciencedirect.com/science/article/pii/S0950584911001996"},"keyword":["Different distribution","Machine learning","Naive Bayes","Software defect prediction","Transfer learning","_done"],"downloads":0},"search_terms":["transfer","learning","cross","company","software","defect","prediction","ma","luo","zeng","chen"],"keywords":["different distribution","machine learning","naive bayes","software defect prediction","transfer learning","_done"],"authorIDs":[],"dataSources":["zHc5HdgBCDgkarEqH"]}