Decision-Focused Learning for Inverse Noncooperative Games: Generalization Bounds and Convergence Analysis. Al-Tawaha, A., Kaushik, H., Sel, B., Jia, R., & Jin, M. IFAC World Congress, 2023. ![Decision-Focused Learning for Inverse Noncooperative Games: Generalization Bounds and Convergence Analysis [pdf]](https://bibbase.org/img/filetypes/pdf.svg "pdf")
Pdf abstract bibtex 23 downloads Finding the equilibrium strategy of agents is one of the central problems in game theory. Perhaps equally intriguing is the inverse of the above problem: from the available finite set of actions at equilibrium, how can we learn the utilities of players competing against each other and eventually use the learned models to predict their future actions? Instead of following an estimate-then-predict approach, this work proposes a decision-focused learning (DFL) method that directly learns the utility function to improve prediction accuracy. The game's equilibrium is represented as a layer and integrated into an end-to-end optimization framework. We discuss the statistical bounds of covering numbers for the set of solution functions corresponding to the solution of a generic parametric variational inequality. Also, we establish the generalization bound for the set of solution functions with respect to smooth loss function with an improved rate. Moreover, we proposed an algorithm based on the iterative differentiation strategy to forward and back propagate through the equilibrium layer. The convergence analysis of the proposed algorithm is established. Finally, We numerically validate the proposed framework in the utility learning problem among the agents whose utility functions are approximated by partially input convex neural networks (PICNN).
@article{2023_2C_CyberPower,
title={Decision-Focused Learning for Inverse Noncooperative Games: Generalization Bounds and Convergence Analysis},
author={Ahmad Al-Tawaha and Harshal Kaushik and Bilgehan Sel and Ruoxi Jia and Ming Jin},
year={2023},
journal = {IFAC World Congress},
url_pdf={DFL-conf2022.pdf},
keywords = {Machine Learning, Optimization},
abstract={Finding the equilibrium strategy of agents is one of the central problems in game theory. Perhaps equally intriguing is the inverse of the above problem: from the available finite set of actions at equilibrium, how can we learn the utilities of players competing against each other and eventually use the learned models to predict their future actions? Instead of following an estimate-then-predict approach, this work proposes a decision-focused learning (DFL) method that directly learns the utility function to improve prediction accuracy. The game's equilibrium is represented as a layer and integrated into an end-to-end optimization framework. We discuss the statistical bounds of covering numbers for the set of solution functions corresponding to the solution of a generic parametric variational inequality. Also, we establish the generalization bound for the set of solution functions with respect to smooth loss function with an improved rate. Moreover, we proposed an algorithm based on the iterative differentiation strategy to forward and back propagate through the equilibrium layer. The convergence analysis of the proposed algorithm is established. Finally, We numerically validate the proposed framework in the utility learning problem among the agents whose utility functions are approximated by partially input convex neural networks (PICNN). }
}
Downloads: 23
{"_id":"aDrpr65BHL364vzKf","bibbaseid":"altawaha-kaushik-sel-jia-jin-decisionfocusedlearningforinversenoncooperativegamesgeneralizationboundsandconvergenceanalysis-2023","author_short":["Al-Tawaha, A.","Kaushik, H.","Sel, B.","Jia, R.","Jin, M."],"bibdata":{"bibtype":"article","type":"article","title":"Decision-Focused Learning for Inverse Noncooperative Games: Generalization Bounds and Convergence Analysis","author":[{"firstnames":["Ahmad"],"propositions":[],"lastnames":["Al-Tawaha"],"suffixes":[]},{"firstnames":["Harshal"],"propositions":[],"lastnames":["Kaushik"],"suffixes":[]},{"firstnames":["Bilgehan"],"propositions":[],"lastnames":["Sel"],"suffixes":[]},{"firstnames":["Ruoxi"],"propositions":[],"lastnames":["Jia"],"suffixes":[]},{"firstnames":["Ming"],"propositions":[],"lastnames":["Jin"],"suffixes":[]}],"year":"2023","journal":"IFAC World Congress","url_pdf":"DFL-conf2022.pdf","keywords":"Machine Learning, Optimization","abstract":"Finding the equilibrium strategy of agents is one of the central problems in game theory. Perhaps equally intriguing is the inverse of the above problem: from the available finite set of actions at equilibrium, how can we learn the utilities of players competing against each other and eventually use the learned models to predict their future actions? Instead of following an estimate-then-predict approach, this work proposes a decision-focused learning (DFL) method that directly learns the utility function to improve prediction accuracy. The game's equilibrium is represented as a layer and integrated into an end-to-end optimization framework. We discuss the statistical bounds of covering numbers for the set of solution functions corresponding to the solution of a generic parametric variational inequality. Also, we establish the generalization bound for the set of solution functions with respect to smooth loss function with an improved rate. Moreover, we proposed an algorithm based on the iterative differentiation strategy to forward and back propagate through the equilibrium layer. The convergence analysis of the proposed algorithm is established. Finally, We numerically validate the proposed framework in the utility learning problem among the agents whose utility functions are approximated by partially input convex neural networks (PICNN). ","bibtex":"@article{2023_2C_CyberPower,\n title={Decision-Focused Learning for Inverse Noncooperative Games: Generalization Bounds and Convergence Analysis},\n author={Ahmad Al-Tawaha and Harshal Kaushik and Bilgehan Sel and Ruoxi Jia and Ming Jin},\n year={2023},\n journal = {IFAC World Congress}, \n url_pdf={DFL-conf2022.pdf},\n keywords = {Machine Learning, Optimization},\n abstract={Finding the equilibrium strategy of agents is one of the central problems in game theory. Perhaps equally intriguing is the inverse of the above problem: from the available finite set of actions at equilibrium, how can we learn the utilities of players competing against each other and eventually use the learned models to predict their future actions? Instead of following an estimate-then-predict approach, this work proposes a decision-focused learning (DFL) method that directly learns the utility function to improve prediction accuracy. The game's equilibrium is represented as a layer and integrated into an end-to-end optimization framework. We discuss the statistical bounds of covering numbers for the set of solution functions corresponding to the solution of a generic parametric variational inequality. Also, we establish the generalization bound for the set of solution functions with respect to smooth loss function with an improved rate. Moreover, we proposed an algorithm based on the iterative differentiation strategy to forward and back propagate through the equilibrium layer. The convergence analysis of the proposed algorithm is established. Finally, We numerically validate the proposed framework in the utility learning problem among the agents whose utility functions are approximated by partially input convex neural networks (PICNN). }\n}\n\n","author_short":["Al-Tawaha, A.","Kaushik, H.","Sel, B.","Jia, R.","Jin, M."],"key":"2023_2C_CyberPower","id":"2023_2C_CyberPower","bibbaseid":"altawaha-kaushik-sel-jia-jin-decisionfocusedlearningforinversenoncooperativegamesgeneralizationboundsandconvergenceanalysis-2023","role":"author","urls":{" pdf":"http://www.jinming.tech/papers/DFL-conf2022.pdf"},"keyword":["Machine Learning","Optimization"],"metadata":{"authorlinks":{}},"downloads":23},"bibtype":"article","biburl":"http://www.jinming.tech/papers/myref.bib","dataSources":["sTzDHHaipTZWjp8oe","Y64tp2HnDCfXgLdc5"],"keywords":["machine learning","optimization"],"search_terms":["decision","focused","learning","inverse","noncooperative","games","generalization","bounds","convergence","analysis","al-tawaha","kaushik","sel","jia","jin"],"title":"Decision-Focused Learning for Inverse Noncooperative Games: Generalization Bounds and Convergence Analysis","year":2023,"downloads":23}