Towards Robust Neural Networks via Close-loop Control. Chen, Z., Li, Q., & Zhang, Z. 2021. cite arxiv:2102.01862Comment: Published as a conference paper at ICLR 2021
Towards Robust Neural Networks via Close-loop Control [link]Paper  abstract   bibtex   
Despite their success in massive engineering applications, deep neural networks are vulnerable to various perturbations due to their black-box nature. Recent study has shown that a deep neural network can misclassify the data even if the input data is perturbed by an imperceptible amount. In this paper, we address the robustness issue of neural networks by a novel close-loop control method from the perspective of dynamic systems. Instead of modifying the parameters in a fixed neural network architecture, a close-loop control process is added to generate control signals adaptively for the perturbed or corrupted data. We connect the robustness of neural networks with optimal control using the geometrical information of underlying data to design the control objective. The detailed analysis shows how the embedding manifolds of state trajectory affect error estimation of the proposed method. Our approach can simultaneously maintain the performance on clean data and improve the robustness against many types of data perturbations. It can also further improve the performance of robustly trained neural networks against different perturbations. To the best of our knowledge, this is the first work that improves the robustness of neural networks with close-loop control.
@misc{chen2021towards,
  abstract = {Despite their success in massive engineering applications, deep neural
networks are vulnerable to various perturbations due to their black-box nature.
Recent study has shown that a deep neural network can misclassify the data even
if the input data is perturbed by an imperceptible amount. In this paper, we
address the robustness issue of neural networks by a novel close-loop control
method from the perspective of dynamic systems. Instead of modifying the
parameters in a fixed neural network architecture, a close-loop control process
is added to generate control signals adaptively for the perturbed or corrupted
data. We connect the robustness of neural networks with optimal control using
the geometrical information of underlying data to design the control objective.
The detailed analysis shows how the embedding manifolds of state trajectory
affect error estimation of the proposed method. Our approach can simultaneously
maintain the performance on clean data and improve the robustness against many
types of data perturbations. It can also further improve the performance of
robustly trained neural networks against different perturbations. To the best
of our knowledge, this is the first work that improves the robustness of neural
networks with close-loop control.},
  added-at = {2021-12-17T10:42:46.000+0100},
  author = {Chen, Zhuotong and Li, Qianxiao and Zhang, Zheng},
  biburl = {https://www.bibsonomy.org/bibtex/2bc10f3451a4f4b8f83b9643c5f646141/annakrause},
  description = {[2102.01862] Towards Robust Neural Networks via Close-loop Control},
  interhash = {c3ed41d544ac231ef640982f90342c5e},
  intrahash = {bc10f3451a4f4b8f83b9643c5f646141},
  keywords = {closedloop todo:read},
  note = {cite arxiv:2102.01862Comment: Published as a conference paper at ICLR 2021},
  timestamp = {2021-12-17T10:42:46.000+0100},
  title = {Towards Robust Neural Networks via Close-loop Control},
  url = {http://arxiv.org/abs/2102.01862},
  year = 2021
}

Downloads: 0