Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively. Booth, S., Muise, C., & Shah, J. In The 28th International Joint Conference on Artificial Intelligence (IJCAI), 2019.
![Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively [pdf]](https://bibbase.org/img/filetypes/pdf.svg "pdf")
Paper abstract bibtex 6 downloads
Paper abstract bibtex 6 downloads Knowledge compilation techniques translate propositional theories into equivalent forms to increase their computational tractability. But, how should we best present these propositional theories to a human? We analyze the standard taxonomy of propositional theories for relative \emphinterpretability across three model domains: highway driving, emergency triage, and the chopsticks game. We generate decision-making agents which produce logical explanations for their actions and apply knowledge compilation to these explanations. Then, we evaluate how quickly, accurately, and confidently users comprehend the generated explanations to make decisions. We find that domain, formula size, and negated logical connectives significantly affect comprehension while formula properties typically associated with interpretability are not strong predictors of human ability to comprehend the theory.
@inproceedings{booth-ijcai19,
title={Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively},
author={Serena Booth and Christian Muise and Julie Shah},
booktitle={The 28th International Joint Conference on Artificial Intelligence (IJCAI)},
year={2019},
url={https://www.ijcai.org/proceedings/2019/0804.pdf},
abstract={Knowledge compilation techniques translate propositional theories into equivalent forms to increase their computational tractability. But, how should we best present these propositional theories to a human? We analyze the standard taxonomy of propositional theories for relative \emph{interpretability} across three model domains: highway driving, emergency triage, and the chopsticks game. We generate decision-making agents which produce logical explanations for their actions and apply knowledge compilation to these explanations. Then, we evaluate how quickly, accurately, and confidently users comprehend the generated explanations to make decisions. We find that domain, formula size, and negated logical connectives significantly affect comprehension while formula properties typically associated with interpretability are not strong predictors of human ability to comprehend the theory.}
}Downloads: 6
{"_id":"574jaQgX8CYF2XRRD","bibbaseid":"booth-muise-shah-evaluatingtheinterpretabilityoftheknowledgecompilationmapcommunicatinglogicalstatementseffectively-2019","authorIDs":["3ZsuB8kFuBazYSYay","3aQBFJkJYCcndwCjR","3hYo439g2MuAaCX6e","4QhCAt6rJiarXgGTG","5456f48b8b01c819300000ab","5de6d3d8abd988de010000ca","5deb0462a31587de010000a3","5df13ef7630a9ee0010000b3","5df52514ea1457de01000126","5df7e072dc100cde0100014e","5dfaab875481b4de0100001d","5dfe6b5e4e3a44de0100001f","5dff511bddf837de01000075","5e03673eb1544ef201000082","5e044e70705486df010000b8","5e0602f7e95bcdde0100005b","5e0623ba8e1565f2010000cf","5e12ae713f181ade01000085","5e136ddaf16095df0100010c","5e15ebbcefa1cddf0100005f","5e16303adf1bb4de01000195","5e175171883585df010001f5","5e185337809b84f20100000a","5e194fb886b4aade010000f1","5e1c6302e556c6de010001e8","5e1d8ada3a6d8cde0100011c","5e1dc2b98d71ddde010000f2","5e1eadd6bedb58de01000124","5e1f7406e8f5ddde01000229","5e2093efbdda1fde0100003c","5e21b52196aea7de010000a0","5e270f9cf51e02de0100005a","5e27b36b28f7a6de01000151","5e2dae33732e89de0100005c","5e2e0116524f94de0100005d","5e2ea3edb84405df01000035","5e3081b4cb949bdf01000044","5e3627ac1727e7df010000c2","5e3874ed1f8af9e001000122","5e3b054855f0f2df0100017f","5e3c5333c798e0de01000129","5e3ec74c86a596de0100000b","5e3ffc1d17f17dde01000002","5e3ffd7017f17dde01000014","5e41b0910b4861de01000111","5e441c71fdc393de01000118","5e446fd5084293df010000fd","5e44bf6a7759a7df0100007c","5e4628077f6322df01000042","5e4c5496271596df010000c6","5e4c93785cc521f2010000e0","5e4ea00e64b624de01000072","5e4f7499a01931de010000b6","5e503b938c3a2cde0100013d","5e535d7e45815bf20100006c","5e53f9acd26e87df010001df","5e556ca4e11ab9df01000032","5e56d52696127bde0100020e","5e5d6d8b0b73f6de01000003","5e5eab682fd1fade010000e2","5e66fa7685689bf30100010e","5e670701511133df0100006d","5e68f51f1a389bdf0100045c","5yN3GPwHiapRhtuj9","6C5wfAZryB8LaY2PJ","6Z2RfBdBMBFMMobst","6jNNJBuk6HAtcnEvy","7AuroeLTMFPfJCoc5","8j3GdPnZ34L7MwaRH","BELXag98NmsXoYgsH","CeALjMgBHZmr9SzLQ","D7u3CRvfQdZb2Nsvb","DTvS4QdpaPswfTdKK","Dcjwdot9d5rJFoLNW","EZxoX4JE4byz9dLBS","FE3yhyj5fmmfLuJXZ","FTTuMEgm3yh9QH7pw","GQWTrxJz3HKdJcAEM","GfiiL4m6PWnSrb5pM","HwSBgNFgx9YdcbTkD","J9Cn8pzsqP9mpr6xy","JJ4YdoB6PqRk2mbBH","JjhEWvgeq8Qx6LZof","Jw793vyTqsyX5daKz","KZfCyiyswf4sBtGjP","KgBg49s7JcYbLSctC","KpA6noWknYigzPP4i","MroboN368do5mezgH","NAb7GKwczGhpSRtaE","NAyJtGS6K2wBWJMx2","NBcXbcFrQdwCtndaF","PFRbwQewWEdMfk4Mk","PZYJkWyWoKeykNsHr","QvNgkQwXWMDTxciYq","QwjvvLtMervWzsLig","SLJpkXgMzHPLEP33v","TcNBkSpMyeu2oxw5A","WAx35JxHCScRCfQYK","WMHiPYnuEnrhKxJWi","WiXjNSHmtpmkHsPYF","XDyEccztzCgSrH8JK","YYXt22tWnAnS4ohf4","Yo9NwQNbXRfSjd5LR","Zpzs3SDfCjG7mJAEC","ZysMM8RRSrhEZt4rm","a7KzaH4ok4HAJxnyP","axB6kamRvmWu5vw6X","b6ZAdn6ZpgQcDuejh","bNHECCPaQAsthaP2z","cavuN3YH45oms9mKy","cgdaZmm5NDtBmBJcL","crArqS5DKyENjHyEF","dJyb7wbihKdDzgkGr","emJa7LZmACzm5bbpv","esY7FSKsHpLphjhKg","f4LpZ8LcDrvDyGuip","g2oQsrCb47Nfxjnes","goA6xywLeZi8P9Z3N","grCkvcC8cTZqJzGKu","hfmvhLcJ6rSarhyHM","htW24MBmx67vY4Dky","j6foRqya6fLiniZC3","jBLcydKWE5xxJKofs","jtKbSfonQ5YmGvpfh","jvXSefynz5Ba7gqX2","kYGNCbRdzB9CHBr5s","karY5HSFumjds5vuz","mwfq6DupsNxXZhwFK","n8ip3yxvw6k38QpZL","nhPAKwaJ3yD2ihuqD","o39uWBuFedviW43Cw","ow6c7LGcrn2X6iWQd","qwPzsaveEtEvDqBPs","rhiD5xJXuoWPMReit","rkDRNeSmuJeNswCfv","sYAXaopmi2wx9uPsF","tMexbXp8PoEkbZnrv","uHSZiLRwEgNpbmmRw","wfhA6qG7fcni6LQuw","wsyXZn5iRF2dciL8t","xTKWRxJPtd5N9aKTq","yEypGxYJaM52ipscR","zSHM8azk4tdTPDvou","zzk9ihDtxJrpejbzN"],"author_short":["Booth, S.","Muise, C.","Shah, J."],"bibdata":{"bibtype":"inproceedings","type":"inproceedings","title":"Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively","author":[{"firstnames":["Serena"],"propositions":[],"lastnames":["Booth"],"suffixes":[]},{"firstnames":["Christian"],"propositions":[],"lastnames":["Muise"],"suffixes":[]},{"firstnames":["Julie"],"propositions":[],"lastnames":["Shah"],"suffixes":[]}],"booktitle":"The 28th International Joint Conference on Artificial Intelligence (IJCAI)","year":"2019","url":"https://www.ijcai.org/proceedings/2019/0804.pdf","abstract":"Knowledge compilation techniques translate propositional theories into equivalent forms to increase their computational tractability. But, how should we best present these propositional theories to a human? We analyze the standard taxonomy of propositional theories for relative \\emphinterpretability across three model domains: highway driving, emergency triage, and the chopsticks game. We generate decision-making agents which produce logical explanations for their actions and apply knowledge compilation to these explanations. Then, we evaluate how quickly, accurately, and confidently users comprehend the generated explanations to make decisions. We find that domain, formula size, and negated logical connectives significantly affect comprehension while formula properties typically associated with interpretability are not strong predictors of human ability to comprehend the theory.","bibtex":"@inproceedings{booth-ijcai19,\n title={Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively},\n author={Serena Booth and Christian Muise and Julie Shah},\n booktitle={The 28th International Joint Conference on Artificial Intelligence (IJCAI)},\n year={2019},\n url={https://www.ijcai.org/proceedings/2019/0804.pdf},\n abstract={Knowledge compilation techniques translate propositional theories into equivalent forms to increase their computational tractability. But, how should we best present these propositional theories to a human? We analyze the standard taxonomy of propositional theories for relative \\emph{interpretability} across three model domains: highway driving, emergency triage, and the chopsticks game. We generate decision-making agents which produce logical explanations for their actions and apply knowledge compilation to these explanations. Then, we evaluate how quickly, accurately, and confidently users comprehend the generated explanations to make decisions. We find that domain, formula size, and negated logical connectives significantly affect comprehension while formula properties typically associated with interpretability are not strong predictors of human ability to comprehend the theory.}\n}\n\n","author_short":["Booth, S.","Muise, C.","Shah, J."],"key":"booth-ijcai19","id":"booth-ijcai19","bibbaseid":"booth-muise-shah-evaluatingtheinterpretabilityoftheknowledgecompilationmapcommunicatinglogicalstatementseffectively-2019","role":"author","urls":{"Paper":"https://www.ijcai.org/proceedings/2019/0804.pdf"},"metadata":{"authorlinks":{"muise, c":"https://www.haz.ca/academic-publications.html"}},"downloads":6},"bibtype":"inproceedings","biburl":"www.haz.ca/publications.bib","creationDate":"2019-05-17T02:13:57.398Z","downloads":6,"keywords":[],"search_terms":["evaluating","interpretability","knowledge","compilation","map","communicating","logical","statements","effectively","booth","muise","shah"],"title":"Evaluating the Interpretability of the Knowledge Compilation Map: Communicating Logical Statements Effectively","year":2019,"dataSources":["94txRcb2YKX3ChmqR","DprwGzu9heN5GXy3u"]}