Towards a Measurement Framework for Tools' Ceiling and Threshold

Towards a Measurement Framework for Tools' Ceiling and Threshold. Alves, R., Teixeira, C., Nascimento, M., Marinho, A., & Nunes, N. J. In Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems, of EICS '14, pages 283--288, New York, NY, USA, 2014. ACM.

Paper doi abstract bibtex

Software development tools are not catching up with the requirements of increasingly complex interactive software products and services. Successful tools are claimed to either be low-threshold/low-ceiling or high-threshold/high-ceiling, however no research to date addressed how to define and measure these concepts. This is increasingly important as these tools undergo an evaluation and adoption process by end-users. Here we hypothesized that the evaluation and adoption of tools is associated with the threshold (learnability). To assess this we conducted a learnability and usability study using three commercial Platform-as-a-Service tools. In this study we used an augmented think-aloud protocol with question asking where ten subjects were asked to create a simple web application. Our data shows that most learnability issues fall into two categories: understanding or locating. No evidence was found that usability defects correlate with the tools learnability score. Though we found an inverse correlation between the amount of issues and the learnability score.

@inproceedings{alves_towards_2014,
	address = {New York, NY, USA},
	series = {{EICS} '14},
	title = {Towards a {Measurement} {Framework} for {Tools}' {Ceiling} and {Threshold}},
	isbn = {978-1-4503-2725-1},
	url = {http://doi.acm.org/10.1145/2607023.2610269},
	doi = {10.1145/2607023.2610269},
	abstract = {Software development tools are not catching up with the requirements of increasingly complex interactive software products and services. Successful tools are claimed to either be low-threshold/low-ceiling or high-threshold/high-ceiling, however no research to date addressed how to define and measure these concepts. This is increasingly important as these tools undergo an evaluation and adoption process by end-users. Here we hypothesized that the evaluation and adoption of tools is associated with the threshold (learnability). To assess this we conducted a learnability and usability study using three commercial Platform-as-a-Service tools. In this study we used an augmented think-aloud protocol with question asking where ten subjects were asked to create a simple web application. Our data shows that most learnability issues fall into two categories: understanding or locating. No evidence was found that usability defects correlate with the tools learnability score. Though we found an inverse correlation between the amount of issues and the learnability score.},
	urldate = {2014-06-26TZ},
	booktitle = {Proceedings of the 2014 {ACM} {SIGCHI} {Symposium} on {Engineering} {Interactive} {Computing} {Systems}},
	publisher = {ACM},
	author = {Alves, Rui and Teixeira, Claudio and Nascimento, Monica and Marinho, Amanda and Nunes, Nuno Jardim},
	year = {2014},
	pages = {283--288}
}

Downloads: 0

{"_id":"KsrsMk4j8zAfaTJHt","bibbaseid":"alves-teixeira-nascimento-marinho-nunes-towardsameasurementframeworkfortoolsceilingandthreshold-2014","downloads":0,"creationDate":"2016-10-05T13:48:42.696Z","title":"Towards a Measurement Framework for Tools' Ceiling and Threshold","author_short":["Alves, R.","Teixeira, C.","Nascimento, M.","Marinho, A.","Nunes, N. J."],"year":2014,"bibtype":"inproceedings","biburl":"http://bibbase.org/zotero/alanlivio","bibdata":{"bibtype":"inproceedings","type":"inproceedings","address":"New York, NY, USA","series":"EICS '14","title":"Towards a Measurement Framework for Tools' Ceiling and Threshold","isbn":"978-1-4503-2725-1","url":"http://doi.acm.org/10.1145/2607023.2610269","doi":"10.1145/2607023.2610269","abstract":"Software development tools are not catching up with the requirements of increasingly complex interactive software products and services. Successful tools are claimed to either be low-threshold/low-ceiling or high-threshold/high-ceiling, however no research to date addressed how to define and measure these concepts. This is increasingly important as these tools undergo an evaluation and adoption process by end-users. Here we hypothesized that the evaluation and adoption of tools is associated with the threshold (learnability). To assess this we conducted a learnability and usability study using three commercial Platform-as-a-Service tools. In this study we used an augmented think-aloud protocol with question asking where ten subjects were asked to create a simple web application. Our data shows that most learnability issues fall into two categories: understanding or locating. No evidence was found that usability defects correlate with the tools learnability score. Though we found an inverse correlation between the amount of issues and the learnability score.","urldate":"2014-06-26TZ","booktitle":"Proceedings of the 2014 ACM SIGCHI Symposium on Engineering Interactive Computing Systems","publisher":"ACM","author":[{"propositions":[],"lastnames":["Alves"],"firstnames":["Rui"],"suffixes":[]},{"propositions":[],"lastnames":["Teixeira"],"firstnames":["Claudio"],"suffixes":[]},{"propositions":[],"lastnames":["Nascimento"],"firstnames":["Monica"],"suffixes":[]},{"propositions":[],"lastnames":["Marinho"],"firstnames":["Amanda"],"suffixes":[]},{"propositions":[],"lastnames":["Nunes"],"firstnames":["Nuno","Jardim"],"suffixes":[]}],"year":"2014","pages":"283--288","bibtex":"@inproceedings{alves_towards_2014,\n\taddress = {New York, NY, USA},\n\tseries = {{EICS} '14},\n\ttitle = {Towards a {Measurement} {Framework} for {Tools}' {Ceiling} and {Threshold}},\n\tisbn = {978-1-4503-2725-1},\n\turl = {http://doi.acm.org/10.1145/2607023.2610269},\n\tdoi = {10.1145/2607023.2610269},\n\tabstract = {Software development tools are not catching up with the requirements of increasingly complex interactive software products and services. Successful tools are claimed to either be low-threshold/low-ceiling or high-threshold/high-ceiling, however no research to date addressed how to define and measure these concepts. This is increasingly important as these tools undergo an evaluation and adoption process by end-users. Here we hypothesized that the evaluation and adoption of tools is associated with the threshold (learnability). To assess this we conducted a learnability and usability study using three commercial Platform-as-a-Service tools. In this study we used an augmented think-aloud protocol with question asking where ten subjects were asked to create a simple web application. Our data shows that most learnability issues fall into two categories: understanding or locating. No evidence was found that usability defects correlate with the tools learnability score. Though we found an inverse correlation between the amount of issues and the learnability score.},\n\turldate = {2014-06-26TZ},\n\tbooktitle = {Proceedings of the 2014 {ACM} {SIGCHI} {Symposium} on {Engineering} {Interactive} {Computing} {Systems}},\n\tpublisher = {ACM},\n\tauthor = {Alves, Rui and Teixeira, Claudio and Nascimento, Monica and Marinho, Amanda and Nunes, Nuno Jardim},\n\tyear = {2014},\n\tpages = {283--288}\n}\n\n","author_short":["Alves, R.","Teixeira, C.","Nascimento, M.","Marinho, A.","Nunes, N. J."],"key":"alves_towards_2014","id":"alves_towards_2014","bibbaseid":"alves-teixeira-nascimento-marinho-nunes-towardsameasurementframeworkfortoolsceilingandthreshold-2014","role":"author","urls":{"Paper":"http://doi.acm.org/10.1145/2607023.2610269"},"downloads":0},"search_terms":["towards","measurement","framework","tools","ceiling","threshold","alves","teixeira","nascimento","marinho","nunes"],"keywords":[],"authorIDs":[],"dataSources":["tudya6YojbqEiF783"]}