Ai and human created media texts: experiment results

Authors

DOI:

https://doi.org/10.26577/HJ.2022.v64.i2.08

Abstract

Abstract. Many journalists and experts are concerned about how widespread of AI-machines may affect the world of information. Changes can affect both the journalists themselves and the audiences. There are already a number of projects in Kazakhstan introducing the AI usage, however, they do not relate to journalism. Texts created by AI are still not typical for the domestic media sector. In order to understand how Kazakhstani consumers of information relate to such texts, we conducted an experiment based on an electronic questionnaire (the main research method). There was no data in the domestic scientific literature on the question whether people are able to distinguish the text written by AI from the text written by a real journalist. This research question formed the basis of our experiment.

The purpose of the study is to determine the qualities of a journalistic text that make it possible to distinguish it from a robotic text. The scientific significance is due to the relevance of the topic, the in- terdisciplinary direction of work. Practical significance lies in the ability to use data in several scientific fields. The results show that the majority of media consumers (135 participants out of 153) were able to distinguish two texts and identify which of them belongs to the robot. Additionally, according to the an- swers, Kazakhstani mediaconsumers are not ready for the appearance of AI texts in the mass media, they consider them poor quality, incomprehensible, logically unrelated and, in principle, respondents prefer texts written by a person – a professional journalist. Most likely, this trend will continue over the next several years. This work contributes to solving the problem of using AI in the media sphere.

Key words: journalism, AI, media text, mass media, robo-journalism.

References

1. Barbara, G. Facts, fakes, figures: artificial intelligence and journalism//Goethe Institute. Retrieved from https://www.goethe.de/prj/one/ru/lin/22042768.html.
2. Check J., Schutt R. K. (2012) Survey research. In: J. Check, R. K. Schutt., editors. Research methods in education. Thousand Oaks, CA: Sage Publications. - 2012. - Pp. 159–185.
3. Dierickx, L. (06.04.2021). Artificial intelligence and journalism: a race with machines// EqualTimes. Retrieved from https://www.equaltimes.org/artificial-intelligence- and?lang=en#.YW5yDRpBw2w.
4. Dillman D. A., Smyth J. D., Christian L. M. (2014) Internet, phone, mail, and mixed-mode surveys: The tailored design method. Hoboken, NJ: John Wiley & Sons, Inc. - 2014.
5. Economist (23.12.2017). How soon will computers replace The Economist's writers?// The Economist. Retrieved from https://www.economist.com/science-and-technology/2017/12/19/how-soon-will- computers-replace-the-economists-writers.
6. Galily, Ya. (2018). Artificial intelligence and sports journalism: Is it a sweeping change? //Technology in Society. 10.1016/j.techsoc.2018.03.001.
7. Keefe, J., Zhou, Y., Merill, J. (12.05.2021). The present and potential of AI in journalism// Knight Foundation. Retrieved from https://knightfoundation.org/articles/the-present-and- potential-of-ai-in-journalism/.
8. McCarthy, I., Kunova, M. (26.05. 2021). How artificial intelligence can help solve journalism’s problems// Journalism.co. Retrieved from https://www.journalism.co.uk/news/how- artificial-intelligence-can-help-solve-journalism-s-problems-/s2/a825693/.
9. Overchenko, M. (21.12.2017). The Economist publishes an AI-written article on technology// Vedomosty. Retrieved from https://www.vedomosti.ru/technology/articles/2017/12/21/746085- economist-iskusstvennii-intellekt-napisat-statyu.
10. Sarsenova, M. (5.02.2021). National cluster of artificial intelligence will appear in Kazakhstan// Kapital. Retrieved from https://kapital.kz/tehnology/93211/natsional-nyy-klaster- iskusstvennogo-intellekta-poyavit-sya-v-kazakhstane.html.
11. Trocenko, P. (9.04.2021). Вячеслав Половинко: «У казахстанской журналистики нет задачи поменять мир, есть задача выжить» [Vyacheslav Polovinko: "Kazakh journalism has no task to change the world, there is a task to survive"]// Radio Azattyq. Retrieved from https://rus.azattyq.org/a/kazakhstan-dialogi-polovinko-interview/31193579.html.
12. van Dalen, A. (2012). The algorithms behind the headlines//Journalism Practice, 6:5-6. – 2012. – Pp. 648-658. DOI: 10.1080/17512786.2012.667268.
13. Weiss M. (2019). Deepfake bot submissions to federal public comment websites cannot be distinguished from human submissions//Technology Science. - 121(801). - 2019. Retrieved from https://techscience.org/a/2019121801/.
14. Wu, S., Tandoc, E. C. & Salmon, C. T. (2019). When journalism and automation intersect: assessing the influence of the technological field on contemporary newsrooms. Journalism Practice, 13(10), 1238-1254. https://dx.doi.org/10.1080/17512786.2019.1585198.
15. X media (22.06.2021). Experts have compared the human brain and artificial intelligence// X-media.
Retrieved from https://www.iksmedia.ru/news/5844239-Eksperty-sravnili-chelovecheskij.html.

Downloads

Published

2022-06-21