Systematic review of trends in the application of artificial intelligence to the field of academic writing in the social sciences

Authors

DOI:

https://doi.org/10.1344/der.2024.45.37-42

Keywords:

ChatGPT, Academic writing, Trend

Abstract

The study of the application of artificial intelligence (AI) in academic writing is important to promote efficiency in the generation of scientific content. Additionally, there is a need to investigate how AI can help improve the clarity and accuracy of scientific communication. In this sense, a systematic review of the literature (scoping review) has been carried out that has addressed the use of AI, specifically ChatGPT, in relation to academic writing. The objective is to identify the thematic approaches and inquiry designs applied in the works published on this topic and, thus, guide future projects in this line of research. To carry out this study, we proceeded to locate articles in Web of Science and Scopus. The main results of the work reveal the interest in academic writing and AI in relation to its possible applications, specific tools and the detection of plagiarism, as well as its ethical and responsible use. Besides, this study stated the application of various research methods. The final discussion focuses on how the integration of AI in academic writing poses both opportunities and challenges in terms of ethics, quality and intellectual autonomy.

Author Biography

Francesc Martínez-Olmo, IDP-ICE; Universitat de Barcelona

Professor

Department of Educational Research Methods and Diagnosis

References

Alberth. (2023). The use of ChatGPT in academic writing: a blessing or a curse in disguise? Teflin Journal, 34(2), 337-352. Scopus. https://doi.org/10.15639/teflinjournal.v34i2/337-352

Alkaissi, H., & McFarlane, S. I. (2023). Artificial Hallucinations in ChatGPT: Implications in Scientific Writing. Cureus Journal of Medical Science, 15(2). https://doi.org/10.7759/cureus.35179

Altmäe, S., Sola-Leyva, A., & Salumets, A. (2023). Artificial intelligence in scientific writing: A friend or a foe? Reproductive Biomedicione Online, 47(1), 3-9. https://doi.org/10.1016/j.rbmo.2023.04.009

Calvo, R. A., O’Rourke, S. T., Jones, J., Yacef, K., & Reimann, P. (2011). Collaborative Writing Support Tools on the Cloud. IEEE Transactions on Learning Technologies, 4(1), 88-97. https://doi.org/10.1109/TLT.2010.43

Dergaa, I., Chamari, K., Zmijewski, P., & Ben Saad, H. (2023). From human writing to artificial intelligence generated text: Examining the prospects and potential threats of ChatGPT in academic writing. Biology of Sport, 40(2), 615-622. https://doi.org/10.5114/biolsport.2023.125623

Desaire, H., Chua, A., Isom, M., Jarosova, R., & Hua, D. (2023). Distinguishing academic science writing from humans or ChatGPT with over 99% accuracy using off-the-shelf machine learning tools. Cell Reports Physical Science, 4(6). https://doi.org/10.1016/j.xcrp.2023.101426

Giray, L. (2023). Prompt Engineering with ChatGPT: A Guide for Academic Writers. Annals of Biomedical Engineering, 51(12), 2629-2633. https://doi.org/10.1007/s10439-023-03272-4

Golan, R., Reddy, R., Muthigi, A., & Ramasamy, R. (2023). Artificial intelligence in academic writing: A paradigm-shifting technological advance. Nature Reviews Urology, 20(6), 327-328. https://doi.org/10.1038/s41585-023-00746-x

Goldbort, R. (2006). Writing for Science. Yale University Press.

Haddaway, N. R., Page, M. J., Pritchard, C. C., & McGuinness, L. A. (2022). PRISMA2020: An R package and Shiny app for producing PRISMA 2020‐compliant flow diagrams, with interactivity for optimised digital transparency and Open Synthesis. Campbell Systematic Reviews, 18(2), e1230. https://doi.org/10.1002/cl2.1230

Hamamah, H., Emaliana, I., Hapsari, Y., Degeng, P. D. D., & Fadillah, A. C. (2023). Using Nominal Group Technique to Explore Publication Challenges and the Usefulness of AI-Based Writing Technologies: Insights From Indonesian Scholars. Theory and Practice in Language Studies, 13(8), 2038-2047. Scopus. https://doi.org/10.17507/tpls.1308.20

Imran, M., & Almusharraf, N. (2023). Analyzing the role of ChatGPT as a writing assistant at higher education level: A systematic review of the literature. Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13605

Ivanič, R. (1998). Writing and Identity. The discoursal construction of identity in academic writing. John Benjamins Publishing. https://doi.org/10.1075/swll.5

Jarrah, A. M., Wardat, Y., & Fidalgo, P. (2023). Using ChatGPT in academic writing is (not) a form of plagiarism: What does the literature say? Online Journal of Communication and Media Technologies, 13(4). Scopus. https://doi.org/10.30935/ojcmt/13572

Johnston, H., Wells, R. F., Shanks, E. M., Boey, T., & Parsons, B. N. (2024). Student perspectives on the use of generative artificial intelligence technologies in higher education. International Journal for Educational Integrity, 20(1). Scopus. https://doi.org/10.1007/s40979-024-00149-4

Kandeel, M. E., & Eldakak, A. (2024). Legal dangers of using ChatGPT as a co-author according to academic research regulations. Journal of Governance and Regulation, 13(1 Special issue), 289-298. Scopus. https://doi.org/10.22495/jgrv13i1siart3

Khlaif, Z. N., Mousa, A., Hattab, M. K., Itmazi, J., Hassan, A. A., Sanmugam, M., & Ayyoub, A. (2023). The Potential and Concerns of Using AI in Scientific Research: ChatGPT Performance Evaluation. JMIR Medical Education, 9(1), e47049-e47049. https://doi.org/10.2196/47049

Kong, S.-C., Lee, J. C.-K., & Tsang, O. (2024). A pedagogical design for self-regulated learning in academic writing using text-based generative artificial intelligence tools: 6-P pedagogy of plan, prompt, preview, produce, peer-review, portfolio-tracking. Research and Practice in Technology Enhanced Learning, 19. Scopus. https://doi.org/10.58459/rptel.2024.19030

Krajka, J., & Olszak, I. (2024). “AI, will you help?” How learners use Artificial Intelligence when writing. XLinguae, 17(1), 34-48. Scopus. https://doi.org/10.18355/XL.2024.17.01.03

Livberber, T. (2023). Toward non-human-centered design: Designing an academic article with ChatGPT. Profesional de la Informacion, 32(5). https://doi.org/10.3145/epi.2023.sep.12

Mahyoob, M., Algaraady, J., & Alblwi, A. (2023). A Proposed Framework for Human-like Language Processing of ChatGPT in Academic Writing. International Journal of Emerging Technologies in Learning, 18(14), 282-293. Scopus. https://doi.org/10.3991/ijet.v18i14.41725

Malik, A. R., Pratiwi, Y., Andajani, K., Numertayasa, I. W., Suharti, S., & Darwis, A. (2023). Exploring Artificial Intelligence in Academic Essay: Higher Education Student’s Perspective. International Journal of Educational Research Open, 5. https://doi.org/10.1016/j.ijedro.2023.100296

Martin-Marchante, B. (2022). The use of ICTs and artificial intelligence in the revision of the writing process in Valencian public universities. Research in Education and Learning Innovation Archives-REALIA, 28, 16-31. https://doi.org/10.7203/realia.28.20622

Mondal, H., & Mondal, S. (2023). ChatGPT in academic writing: Maximizing its benefits and minimizing the risks. Indian Journal of Ophthalmology, 71(12), 3600-3606. https://doi.org/10.4103/IJO.IJO_718_23

Nguyen, A., Hong, Y., Dang, B., & Huang, X. (2024). Human-AI collaboration patterns in AI-assisted academic writing. Studies in Higher Education, 1-18. https://doi.org/10.1080/03075079.2024.2323593

OpenAI. (2022). Introducing ChatGPT. https://openai.com/blog/chatgpt

Ossa, C., & Willatt, C. (2023). Providing academic writing feedback assisted by Generative Artificial Intelligence in initial teacher education contexts. European Journal of Education and Psychology, 16(2). https://doi.org/10.32457/ejep.v16i2.2412

Ou, A. W., Stöhr, C., & Malmström, H. (2024). Academic communication with AI-powered language tools in higher education: From a post-humanist perspective. System, 121. https://doi.org/10.1016/j.system.2024.103225

Page, M. J., Moher, D., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., Chou, R., Glanville, J., Grimshaw, J. M., Hróbjartsson, A., Lalu, M. M., Li, T., Loder, E. W., Mayo-Wilson, E., McDonald, S., … McKenzie, J. E. (2021). PRISMA 2020 explanation and elaboration: Updated guidance and exemplars for reporting systematic reviews. BMJ, n160. https://doi.org/10.1136/bmj.n160

Patel, A., Bakhtiyari, K., & Taghavi, M. (2011). Evaluation of cheating detection methods in academic writings. LIBRARY HI TECH, 29(4), 623-640. https://doi.org/10.1108/07378831111189732

Sabariego-Puig, M., Vilà-Baños, R., y Sandín-Esteban, M. (2014). El análisis cualitativo de datos con ATLAS.ti. REIRE Revista d'Innovació I Recerca en Educació, 7(2), 119–133. https://doi.org/10.1344/reire2014.7.2728

Semrl, N., Feigl, S., Taumberger, N., Bracic, T., Fluhr, H., Blockeel, C., & Kollmann, M. (2023). AI language models in human reproduction research: Exploring ChatGPT’s potential to assist academic writing. HumanN Reproduction, 38(12), 2281-2288. https://doi.org/10.1093/humrep/dead207

Storey, V. A. (2023). AI Technology and Academic Writing: Knowing and Mastering the «Craft Skills». International Journal of Adult Education and Technology-IJAET, 14(1). https://doi.org/10.4018/IJAET.325795

Tail, A. M. Y., Meyer, M., Varidel, M., Prodan, A., Vogel, M., Lorfino, F., & Krausz, R. M. (2023). Exploring the potential and limitations of ChatGPT for academic peer-reviewed writing: Addressing linguistic injustice and ethical concerns. Journal of Academic Language and Learning, 17(1), T16-T30.

Tang, A., Li, K.-K., Kwok, K. O., Cao, L., Luong, S., & Tam, W. (2024). The importance of transparency: Declaring the use of generative artificial intelligence (AI) in academic writing. Journal of Nursing Scholarship, 56(2), 314-318. https://doi.org/10.1111/jnu.12938

Thurlow, S. (2023). The other side of AI: Writing, thinking and creativity in an age of Artificial Intelligence. Journal of Academic Language and Learning, 17(1), T92-T102.

Tolchinsky, L. (2013). La escritura académica a través de las disciplinas. Octaedro / ICE-UB.

Utami, S. P. T., & Winarni, R. (2023). Utilization of artificial intelligence technology in an academic writing class: How do Indonesian students perceive? Contemporary Educational Technology, 15(4). https://doi.org/10.30935/cedtech/13419

Wale, B. D. (2024). Artificial intelligence in education: Effects of using integrative automated writing evaluation programs on honing academic writing instruction. Cakrawala Pendidikan, 43(1), 273-287. https://doi.org/10.21831/cp.v43i1.67715

Downloads

Published

2024-07-01

Issue

No. 45 (2024): Number 45, June 2024 [Monographic] Artificial intelligence from the perspective of educability

Section

Monographic Articles

License

Copyright (c) 2024 Francesc Martínez-Olmo, Felipe González Catalán

Creative Commons License

This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.

The authors who publish in this journal agree to the following terms:

  1. Authors retain copyright and grant the journal the right of first publication.
  2. The texts published in Digital Education Review, DER, are under a license Attribution-Noncommercial-No Derivative Works 4,0 Spain, of Creative Commons. All the conditions of use in: Creative Commons,
  3. In order to mention the works, you must give credit to the authors and to this Journal.
  4. Digital Education Review, DER,  does not accept any responsibility for the points of view and statements made by the authors in their work.