Neural Combinatorial Optimization with Reinforcement Learning. Bello, I., Pham, H., Le, Q. V., Norouzi, M., & Bengio, S. In Workshop Track of the International Conference on Learning Representations, ICLR, 2017.
Paper abstract bibtex We present a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent neural network that, given a set of city coordinates, predicts a distribution over different city permutations. Using negative tour length as the reward signal, we optimize the parameters of the recurrent neural network using a policy gradient method. Without much engineering and heuristic designing, Neural Combinatorial Optimization achieves close to optimal results on 2D Euclidean graphs with up to 100 nodes. These results, albeit still quite far from state-of-the-art, give insights into how neural networks can be used as a general tool for tackling combinatorial optimization problems.
@inproceedings{bello:2017:iclr_workshop,
author = {I. Bello and H. Pham and Q. V. Le and M. Norouzi and S. Bengio},
title = {Neural Combinatorial Optimization with Reinforcement Learning},
booktitle = {Workshop Track of the International Conference on Learning Representations, {ICLR}},
year = 2017,
web = {https://openreview.net/forum?id=Bk9mxlSFx¬eId=Bk9mxlSFx},
url = {publications/ps/bello_2017_iclr_workshop.ps.gz},
pdf = {publications/pdf/bello_2017_iclr_workshop.pdf},
djvu = {publications/djvu/bello_2017_iclr_workshop.djvu},
abstract = {We present a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent neural network that, given a set of city coordinates, predicts a distribution over different city permutations. Using negative tour length as the reward signal, we optimize the parameters of the recurrent neural network using a policy gradient method. Without much engineering and heuristic designing, Neural Combinatorial Optimization achieves close to optimal results on 2D Euclidean graphs with up to 100 nodes. These results, albeit still quite far from state-of-the-art, give insights into how neural networks can be used as a general tool for tackling combinatorial optimization problems.},
categorie = {C},
}
Downloads: 0
{"_id":"HtCLp9Zou4hZcPMth","bibbaseid":"bello-pham-le-norouzi-bengio-neuralcombinatorialoptimizationwithreinforcementlearning-2017","authorIDs":[],"author_short":["Bello, I.","Pham, H.","Le, Q. V.","Norouzi, M.","Bengio, S."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","author":[{"firstnames":["I."],"propositions":[],"lastnames":["Bello"],"suffixes":[]},{"firstnames":["H."],"propositions":[],"lastnames":["Pham"],"suffixes":[]},{"firstnames":["Q.","V."],"propositions":[],"lastnames":["Le"],"suffixes":[]},{"firstnames":["M."],"propositions":[],"lastnames":["Norouzi"],"suffixes":[]},{"firstnames":["S."],"propositions":[],"lastnames":["Bengio"],"suffixes":[]}],"title":"Neural Combinatorial Optimization with Reinforcement Learning","booktitle":"Workshop Track of the International Conference on Learning Representations, ICLR","year":"2017","web":"https://openreview.net/forum?id=Bk9mxlSFx¬eId=Bk9mxlSFx","url":"publications/ps/bello_2017_iclr_workshop.ps.gz","pdf":"publications/pdf/bello_2017_iclr_workshop.pdf","djvu":"publications/djvu/bello_2017_iclr_workshop.djvu","abstract":"We present a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent neural network that, given a set of city coordinates, predicts a distribution over different city permutations. Using negative tour length as the reward signal, we optimize the parameters of the recurrent neural network using a policy gradient method. Without much engineering and heuristic designing, Neural Combinatorial Optimization achieves close to optimal results on 2D Euclidean graphs with up to 100 nodes. These results, albeit still quite far from state-of-the-art, give insights into how neural networks can be used as a general tool for tackling combinatorial optimization problems.","categorie":"C","bibtex":"@inproceedings{bello:2017:iclr_workshop,\n author = {I. Bello and H. Pham and Q. V. Le and M. Norouzi and S. Bengio},\n title = {Neural Combinatorial Optimization with Reinforcement Learning},\n booktitle = {Workshop Track of the International Conference on Learning Representations, {ICLR}},\n year = 2017,\n web = {https://openreview.net/forum?id=Bk9mxlSFx¬eId=Bk9mxlSFx},\n url = {publications/ps/bello_2017_iclr_workshop.ps.gz},\n pdf = {publications/pdf/bello_2017_iclr_workshop.pdf},\n djvu = {publications/djvu/bello_2017_iclr_workshop.djvu},\n abstract = {We present a framework to tackle combinatorial optimization problems using neural networks and reinforcement learning. We focus on the traveling salesman problem (TSP) and train a recurrent neural network that, given a set of city coordinates, predicts a distribution over different city permutations. Using negative tour length as the reward signal, we optimize the parameters of the recurrent neural network using a policy gradient method. Without much engineering and heuristic designing, Neural Combinatorial Optimization achieves close to optimal results on 2D Euclidean graphs with up to 100 nodes. These results, albeit still quite far from state-of-the-art, give insights into how neural networks can be used as a general tool for tackling combinatorial optimization problems.},\n categorie = {C},\n}\n\n","author_short":["Bello, I.","Pham, H.","Le, Q. V.","Norouzi, M.","Bengio, S."],"key":"bello:2017:iclr_workshop","id":"bello:2017:iclr_workshop","bibbaseid":"bello-pham-le-norouzi-bengio-neuralcombinatorialoptimizationwithreinforcementlearning-2017","role":"author","urls":{"Paper":"http://bengio.abracadoudou.com/publications/ps/bello_2017_iclr_workshop.ps.gz"},"downloads":0},"bibtype":"inproceedings","biburl":"http://bengio.abracadoudou.com/samy.bib","creationDate":"2020-03-18T03:43:27.326Z","downloads":0,"keywords":[],"search_terms":["neural","combinatorial","optimization","reinforcement","learning","bello","pham","le","norouzi","bengio"],"title":"Neural Combinatorial Optimization with Reinforcement Learning","year":2017,"dataSources":["9NCW2CDr4M3s5DvNX"]}