DOI - Mendel University Press

DOI identifiers

DOI: 10.11118/978-80-7509-772-9-0035

STYLOMETRIC COMPARISON OF PROFESSIONALLY GHOST-WRITTEN AND STUDENT-WRITTEN ASSIGNMENTS

Robin Crockett, Kirstie Best
University of Northampton, United Kingdom

We report a stylometric investigation of a portfolio of 20 assignments submitted by an individual student over two consecutive academic years. This investigation followed a formal disciplinary investigation which had identified that eight of the assignments had been ghost- written, with seven of those showing explicit ghost-writer ID information and three of those showing ID information from the same commercial provider. The stylometric investigation involved a conventional word and bigram frequency analysis and a prototype word complexity analysis. The word and bigram analysis identified four consistent groups of assignments, which associate other assignments with the eight known to have been ghost-written, indicating that those were probably also ghost-written. One of those groups comprises the three assignments from the same provider, plus another assignment, implying that the provider has a ‘house style’ and that the other assignment also came from that provider. The prototype analysis clearly categorised the core members of two of those same groups, including the group from the identified provider, adding further weight those associations. More generally, this investigation shows that it is possible to categorise assignments according to aspects of writing style: we would have obtained the same groups even if we had not possessed the ghost-writer ID information. Where such consistent groups are identified it implies, on balance of probabilities, multiple authorship of assignments and that the student concerned cannot have written all the submitted assignments and that some were ghost-written.

Keywords: Commissioning; Contract-Cheating; Essay-Mill; Ghost-Writer; Stylometry

pages: 35-49



References

  1. BRETAG, T., & MAHMUD, S. (2009). A model for determining student plagiarism: Electronic detection and academic judgement. Paper presented at the 4th Asia Pacific Conference on Education Integrity (4APCEI), Wollongong 28-30 September 2009. Journal of University Teaching and Learning Practice, 6, 1, 49-60. http://ro.uow.edu.au/jutlp Go to original source...
  2. BROCARDO, M., TRAORE, I., SAAD, S., & WOUNGANG, I. (2013). Authorship Verification for Short Messages Using Stylometry, Proc. IEEE Intl. Conference on Computer,Information and Telecommunication Systems (CITS 2013), Athens, Greece, 7-8 May 2013. Go to original source...
  3. CAMBRIDGE ENGLISH DICTIONARY. (20/02/2020). Cambridge University Press, dictionary.cambridge.org/dictionary/english/essay-mill
  4. CLARKE, R., & LANCASTER, T., (2006). Eliminating the successor to plagiarism? Identifying the use of contract cheating sites. Proc. 2nd International Plagiarism Conference, Gateshead, UK, 19-21 June 2006. Learning Press.
  5. CLARKE, R., & LANCASTER, T. (2007). Establishing a Systematic Six-Stage Process for Detecting Contract Cheating. Presented at the 2007 2nd International Conference on Pervasive Computing and Applications, Birmingham, UK. 26-27 July 2007. Go to original source...
  6. DAWSON, P., & SUTHERLAND-SMITH, W. (2017). Can markers detect contract cheating? Results from a pilot study. Assessment & Evaluation in Higher Education, 1-8. doi:10.1080/02602938.2017.1336746 Go to original source...
  7. EDER, M. (2012). Computational stylistics and biblical translation: how reliable can a dendrogram be? In Piotrowski, T. Grabowski, L. editors, The Translator and the Computer, 155-170. WSF Press, Wroclaw.
  8. ELLIS, C., ZUCKER, I., & RANDALL, D. (2018). The infernal business of contract cheating: understanding the business processes and models of academic custom writing sites. International Journal for Educational Integrity, 14(1), 1-21. Springer. doi:10.1007/s40979-017-0024-3. Go to original source...
  9. GILLAM, L. (2013). Readability for author profiling? Notebook for PAN at CLEF 2013. Proc. Int. Conference and Labs of the Evaluation Forum (CLEF) Notebook PAN. 23-26 September 2013, Valencia, Spain.
  10. GREETHAM, B. (2014). How to Write Your Undergraduate Dissertation. 2nd edition. Palgrave McMillan, UK. GUERRERO, F. (2009). A new look at the classical entropy of written English. arXiv preprint arXiv:0911.2284, 2009. www.arxiv.org Go to original source...
  11. JUOLA, P. (2013). How a Computer Program Helped Show J. K. Rowling wrote A Cuckoo's Calling. Scientific American, 20 August 2013, Springer Nature.
  12. JUOLA, P. (2017). Detecting Contract Cheating via Stylometric Methods. Proc. Plagiarism across Europe and Beyond. Brno, Czech Republic. 24-26 May 2017. 187-198.
  13. KULIG, A., KWAPIEN, J., STANISZ, T., & DROZDZ, S. (2017). In narrative texts punctuation marks obey the same statistics as words. Information Sciences, 375, 98-113. Elsevier. doi:10.1016/j.ins.2016.09.051. Go to original source...
  14. LANCASTER, T., & CLARKE, R. (2007). Assessing contract cheating through auction sites - a computing perspective. Proc. 8th annual conference for information and computer sciences, University of Southampton, 28-30 August 2007.
  15. LOPEZ-ESCOBEDO, F., MENDEZ-CRUZ, C.-F., SIERRA, G., & SOLORZANO-SOTO, J. (2013). Analysis of Stylometric Variables in Long and Short Texts. Procedia - Social and Behavioral Sciences, 95, 604-611. Elsevier. doi:10.1016/j.sbspro.2013.10.688. Go to original source...
  16. MCMILLAN, K., & WEYERS, J. (2011). How to Write Essays & Assignments. 2nd edition. Prentice-Hall, USA. NEWTON, P. (2018). How Common Is Commercial Contract Cheating in Higher Education and Is It Increasing? A Systematic Review. Frontiers in Education, 3. doi:10.3389/feduc.2018.00067. Go to original source...
  17. QAA. (2017). Contracting to Cheat in Higher Education. www.qaa.ac.uk/about-us/what-we-do/academic-integrity/publications-and-guidance\#
  18. ROGERSON, A. (2014). Detecting the work of essay mills and file swapping sites: some clues they leave behind. Proc. 6th International Integrity & Plagiarism Conference, 1-9. Newcastle-on-Tyne, UK. 16-18 June 2014.
  19. ROGERSON, A. (2017). Detecting contract cheating in essay and report submissions: process, patterns, clues and conversations. International Journal for Educational Integrity, 13:10. Springer. doi:10.1007/s40979-017-0021-6. Go to original source...
  20. SHANNON, C. (1948). A Mathematical Theory of Communication. Bell System Technical Journal. 27 (3): 379-423. Go to original source...
  21. SIVASUBRAMANIAM, S., KOSTELIDOU, K., & RAMACHANDRAN, S. (2016). A close encounter with ghost-writers: an initial exploration study on background, strategies and attitudes of independent essay providers. International Journal for Educational Integrity, 12(1) 1:14. Springer. doi:10.1007/s40979-016-0007-9. Go to original source...
  22. STAMATATOS, E. (2008). A Survey of Modern Authorship Attribution Method. Journal of the American Society for Information Science and Technology, 60(3) 538-556. doi:10.1002/asi.21001. Go to original source...