Calibrated Adaptive Teacher for Domain-Adaptive Intelligent Fault Diagnosis. Forest, F. & Fink, O. Sensors, November, 2024. 
![Calibrated Adaptive Teacher for Domain-Adaptive Intelligent Fault Diagnosis [link]](https://bibbase.org/img/filetypes/link.svg "link")
Link Code doi abstract bibtex Intelligent fault diagnosis (IFD) based on deep learning can achieve high accuracy from raw condition monitoring signals. However, models usually perform well on the training distribution only, and experience severe performance drops when applied to a different distribution. This is also observed in fault diagnosis, where assets are often operated in working conditions different from the ones in which the labeled data have been collected. The scenario where labeled data are available in a source domain and only unlabeled data are available in a target domain has been addressed recently by unsupervised domain adaptation (UDA) approaches for IFD. Recent methods have relied on self-training with confident pseudo-labels for the unlabeled target samples. However, the confidence-based selection of pseudo-labels is hindered by poorly calibrated uncertainty estimates in the target domain, primarily due to over-confident predictions, which limits the quality of pseudo-labels and leads to error accumulation. In this paper, we propose a novel method called Calibrated Adaptive Teacher (CAT), where we propose to calibrate the predictions of the teacher network on target samples throughout the self-training process, leveraging post hoc calibration techniques. We evaluate CAT on domain-adaptive IFD and perform extensive experiments on the Paderborn University (PU) benchmark for fault diagnosis of rolling bearings under varying operating conditions, using both time- and frequency-domain inputs. We compare four different calibration techniques within our framework, where temperature scaling is both the most effective and lightweight one. The resulting method—CAT+TempScaling—achieves state-of-the-art performance on most transfer tasks, with on average 7.5% higher accuracy and 4 times lower calibration error compared to domain-adversarial neural networks (DANNs) across the twelve PU transfer tasks.
@article{forest2023calibratedadaptive,
title = {Calibrated {Adaptive} {Teacher} for {Domain}-{Adaptive} {Intelligent} {Fault} {Diagnosis}},
author = {Forest, Florent and Fink, Olga},
journal = {Sensors},
month = nov,
year = {2024},
volume = {24},
number = {23},
issn = {1424-8220},
doi = {10.3390/s24237539},
abstract = {Intelligent fault diagnosis (IFD) based on deep learning can achieve high accuracy from raw condition monitoring signals. However, models usually perform well on the training distribution only, and experience severe performance drops when applied to a different distribution. This is also observed in fault diagnosis, where assets are often operated in working conditions different from the ones in which the labeled data have been collected. The scenario where labeled data are available in a source domain and only unlabeled data are available in a target domain has been addressed recently by unsupervised domain adaptation (UDA) approaches for IFD. Recent methods have relied on self-training with confident pseudo-labels for the unlabeled target samples. However, the confidence-based selection of pseudo-labels is hindered by poorly calibrated uncertainty estimates in the target domain, primarily due to over-confident predictions, which limits the quality of pseudo-labels and leads to error accumulation. In this paper, we propose a novel method called Calibrated Adaptive Teacher (CAT), where we propose to calibrate the predictions of the teacher network on target samples throughout the self-training process, leveraging post hoc calibration techniques. We evaluate CAT on domain-adaptive IFD and perform extensive experiments on the Paderborn University (PU) benchmark for fault diagnosis of rolling bearings under varying operating conditions, using both time- and frequency-domain inputs. We compare four different calibration techniques within our framework, where temperature scaling is both the most effective and lightweight one. The resulting method—CAT+TempScaling—achieves state-of-the-art performance on most transfer tasks, with on average 7.5% higher accuracy and 4 times lower calibration error compared to domain-adversarial neural networks (DANNs) across the twelve PU transfer tasks.},
url_Link = {https://www.mdpi.com/1424-8220/24/23/7539},
url_Code = {https://github.com/EPFL-IMOS/CAT},
bibbase_note = {<img src="assets/img/papers/cat.png">}
}
Downloads: 0
{"_id":"yFNEXFno9jAhX5Jgr","bibbaseid":"forest-fink-calibratedadaptiveteacherfordomainadaptiveintelligentfaultdiagnosis-2024","author_short":["Forest, F.","Fink, O."],"bibdata":{"bibtype":"article","type":"article","title":"Calibrated Adaptive Teacher for Domain-Adaptive Intelligent Fault Diagnosis","author":[{"propositions":[],"lastnames":["Forest"],"firstnames":["Florent"],"suffixes":[]},{"propositions":[],"lastnames":["Fink"],"firstnames":["Olga"],"suffixes":[]}],"journal":"Sensors","month":"November","year":"2024","volume":"24","number":"23","issn":"1424-8220","doi":"10.3390/s24237539","abstract":"Intelligent fault diagnosis (IFD) based on deep learning can achieve high accuracy from raw condition monitoring signals. However, models usually perform well on the training distribution only, and experience severe performance drops when applied to a different distribution. This is also observed in fault diagnosis, where assets are often operated in working conditions different from the ones in which the labeled data have been collected. The scenario where labeled data are available in a source domain and only unlabeled data are available in a target domain has been addressed recently by unsupervised domain adaptation (UDA) approaches for IFD. Recent methods have relied on self-training with confident pseudo-labels for the unlabeled target samples. However, the confidence-based selection of pseudo-labels is hindered by poorly calibrated uncertainty estimates in the target domain, primarily due to over-confident predictions, which limits the quality of pseudo-labels and leads to error accumulation. In this paper, we propose a novel method called Calibrated Adaptive Teacher (CAT), where we propose to calibrate the predictions of the teacher network on target samples throughout the self-training process, leveraging post hoc calibration techniques. We evaluate CAT on domain-adaptive IFD and perform extensive experiments on the Paderborn University (PU) benchmark for fault diagnosis of rolling bearings under varying operating conditions, using both time- and frequency-domain inputs. We compare four different calibration techniques within our framework, where temperature scaling is both the most effective and lightweight one. The resulting method—CAT+TempScaling—achieves state-of-the-art performance on most transfer tasks, with on average 7.5% higher accuracy and 4 times lower calibration error compared to domain-adversarial neural networks (DANNs) across the twelve PU transfer tasks.","url_link":"https://www.mdpi.com/1424-8220/24/23/7539","url_code":"https://github.com/EPFL-IMOS/CAT","bibbase_note":"<img src=\"assets/img/papers/cat.png\">","bibtex":"@article{forest2023calibratedadaptive,\n\ttitle = {Calibrated {Adaptive} {Teacher} for {Domain}-{Adaptive} {Intelligent} {Fault} {Diagnosis}},\n\tauthor = {Forest, Florent and Fink, Olga},\n\tjournal = {Sensors},\n\tmonth = nov,\n\tyear = {2024},\n\tvolume = {24},\n\tnumber = {23},\n\tissn = {1424-8220},\n\tdoi = {10.3390/s24237539},\n\tabstract = {Intelligent fault diagnosis (IFD) based on deep learning can achieve high accuracy from raw condition monitoring signals. However, models usually perform well on the training distribution only, and experience severe performance drops when applied to a different distribution. This is also observed in fault diagnosis, where assets are often operated in working conditions different from the ones in which the labeled data have been collected. The scenario where labeled data are available in a source domain and only unlabeled data are available in a target domain has been addressed recently by unsupervised domain adaptation (UDA) approaches for IFD. Recent methods have relied on self-training with confident pseudo-labels for the unlabeled target samples. However, the confidence-based selection of pseudo-labels is hindered by poorly calibrated uncertainty estimates in the target domain, primarily due to over-confident predictions, which limits the quality of pseudo-labels and leads to error accumulation. In this paper, we propose a novel method called Calibrated Adaptive Teacher (CAT), where we propose to calibrate the predictions of the teacher network on target samples throughout the self-training process, leveraging post hoc calibration techniques. We evaluate CAT on domain-adaptive IFD and perform extensive experiments on the Paderborn University (PU) benchmark for fault diagnosis of rolling bearings under varying operating conditions, using both time- and frequency-domain inputs. We compare four different calibration techniques within our framework, where temperature scaling is both the most effective and lightweight one. The resulting method—CAT+TempScaling—achieves state-of-the-art performance on most transfer tasks, with on average 7.5% higher accuracy and 4 times lower calibration error compared to domain-adversarial neural networks (DANNs) across the twelve PU transfer tasks.},\n url_Link = {https://www.mdpi.com/1424-8220/24/23/7539},\n\turl_Code = {https://github.com/EPFL-IMOS/CAT},\n\tbibbase_note = {<img src=\"assets/img/papers/cat.png\">}\n}\n\n","author_short":["Forest, F.","Fink, O."],"key":"forest2023calibratedadaptive","id":"forest2023calibratedadaptive","bibbaseid":"forest-fink-calibratedadaptiveteacherfordomainadaptiveintelligentfaultdiagnosis-2024","role":"author","urls":{" link":"https://www.mdpi.com/1424-8220/24/23/7539"," code":"https://github.com/EPFL-IMOS/CAT"},"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"https://florentfo.rest/files/publications.bib","dataSources":["2puawT8ZAQyYRypA3"],"keywords":[],"search_terms":["calibrated","adaptive","teacher","domain","adaptive","intelligent","fault","diagnosis","forest","fink"],"title":"Calibrated Adaptive Teacher for Domain-Adaptive Intelligent Fault Diagnosis","year":2024}