The importance of subjectivity in computational stylistic assessment. Baljko, M. & Hirst, G. Text Technology, 9(1):5–17, Spring, 1999. abstract bibtex Often, a text that has been written collaboratively does not ``speak with a single voice.'' Such a text is stylistically incongruous — as opposed to merely stylistically inconsistent, which might or might not be deleterious to the quality of the text. This widespread problem reduces the overall quality of a text and reflects poorly on its authors. We would like to design a facility for revising style that augments the software environments in which collaborative writing takes place, but before doing so, a question must be answered: what is the role of subjectivity in stylistic assessment for a style-revision facility? We describe an experiment designed to measure the agreement between the stylistic assessments performed by a group of subjects, based on a free-sort of writing samples. The results show that there is a statistically significant level of agreement between the subjects' assessments and, furthermore, there was a small number of groupings (three) of even more similar stylistic assessments. The results also show the invalidity of using authorship as an indicator of the reader's perceptions of stylistic similarity between the writing samples.
@Article{ baljko6,
author = {Melanie Baljko and Graeme Hirst},
title = {The importance of subjectivity in computational stylistic
assessment},
journal = {{Text Technology}},
volume = {9},
number = {1},
month = {Spring},
year = {1999},
pages = {5--17},
abstract = {Often, a text that has been written collaboratively does
not ``speak with a single voice.'' Such a text is
stylistically incongruous --- as opposed to merely
stylistically inconsistent, which might or might not be
deleterious to the quality of the text. This widespread
problem reduces the overall quality of a text and reflects
poorly on its authors. We would like to design a facility
for revising style that augments the software environments
in which collaborative writing takes place, but before
doing so, a question must be answered: what is the role of
subjectivity in stylistic assessment for a style-revision
facility? We describe an experiment designed to measure the
agreement between the stylistic assessments performed by a
group of subjects, based on a free-sort of writing samples.
The results show that there is a statistically significant
level of agreement between the subjects' assessments and,
furthermore, there was a small number of groupings (three)
of even more similar stylistic assessments. The results
also show the invalidity of using authorship as an
indicator of the reader's perceptions of stylistic
similarity between the writing samples.},
download = {http://ftp.cs.toronto.edu/pub/gh/Baljko+Hirst-Text-98.pdf}
}
Downloads: 0
{"_id":{"_str":"534282740e946d920a001b2f"},"__v":7,"authorIDs":["545761622abc8e9f3700033e","54594084b43425b7720003e6"],"author_short":["Baljko, M.","Hirst, G."],"bibbaseid":"baljko-hirst-theimportanceofsubjectivityincomputationalstylisticassessment-1999","bibdata":{"bibtype":"article","type":"article","author":[{"firstnames":["Melanie"],"propositions":[],"lastnames":["Baljko"],"suffixes":[]},{"firstnames":["Graeme"],"propositions":[],"lastnames":["Hirst"],"suffixes":[]}],"title":"The importance of subjectivity in computational stylistic assessment","journal":"Text Technology","volume":"9","number":"1","month":"Spring","year":"1999","pages":"5–17","abstract":"Often, a text that has been written collaboratively does not ``speak with a single voice.'' Such a text is stylistically incongruous — as opposed to merely stylistically inconsistent, which might or might not be deleterious to the quality of the text. This widespread problem reduces the overall quality of a text and reflects poorly on its authors. We would like to design a facility for revising style that augments the software environments in which collaborative writing takes place, but before doing so, a question must be answered: what is the role of subjectivity in stylistic assessment for a style-revision facility? We describe an experiment designed to measure the agreement between the stylistic assessments performed by a group of subjects, based on a free-sort of writing samples. The results show that there is a statistically significant level of agreement between the subjects' assessments and, furthermore, there was a small number of groupings (three) of even more similar stylistic assessments. The results also show the invalidity of using authorship as an indicator of the reader's perceptions of stylistic similarity between the writing samples.","download":"http://ftp.cs.toronto.edu/pub/gh/Baljko+Hirst-Text-98.pdf","bibtex":"@Article{\t baljko6,\n author\t= {Melanie Baljko and Graeme Hirst},\n title\t\t= {The importance of subjectivity in computational stylistic\n\t\t assessment},\n journal\t= {{Text Technology}},\n volume\t= {9},\n number\t= {1},\n month\t\t= {Spring},\n year\t\t= {1999},\n pages\t\t= {5--17},\n abstract\t= {Often, a text that has been written collaboratively does\n\t\t not ``speak with a single voice.'' Such a text is\n\t\t stylistically incongruous --- as opposed to merely\n\t\t stylistically inconsistent, which might or might not be\n\t\t deleterious to the quality of the text. This widespread\n\t\t problem reduces the overall quality of a text and reflects\n\t\t poorly on its authors. We would like to design a facility\n\t\t for revising style that augments the software environments\n\t\t in which collaborative writing takes place, but before\n\t\t doing so, a question must be answered: what is the role of\n\t\t subjectivity in stylistic assessment for a style-revision\n\t\t facility? We describe an experiment designed to measure the\n\t\t agreement between the stylistic assessments performed by a\n\t\t group of subjects, based on a free-sort of writing samples.\n\t\t The results show that there is a statistically significant\n\t\t level of agreement between the subjects' assessments and,\n\t\t furthermore, there was a small number of groupings (three)\n\t\t of even more similar stylistic assessments. The results\n\t\t also show the invalidity of using authorship as an\n\t\t indicator of the reader's perceptions of stylistic\n\t\t similarity between the writing samples.},\n download\t= {http://ftp.cs.toronto.edu/pub/gh/Baljko+Hirst-Text-98.pdf}\n}\n\n","author_short":["Baljko, M.","Hirst, G."],"key":"baljko6","id":"baljko6","bibbaseid":"baljko-hirst-theimportanceofsubjectivityincomputationalstylisticassessment-1999","role":"author","urls":{},"metadata":{"authorlinks":{}}},"bibtype":"article","biburl":"www.cs.toronto.edu/~fritz/tmp/compling.bib","downloads":0,"keywords":[],"search_terms":["importance","subjectivity","computational","stylistic","assessment","baljko","hirst"],"title":"The importance of subjectivity in computational stylistic assessment","year":1999,"dataSources":["6b6A9kbkw4CsEGnRX"]}