Leveraging Machine Learning Techniques to Investigate Media and Information Literacy Competence in Tackling Disinformation
Authors: José Manuel Alcalde-Llergo, Mariana Buenestado Fernández, Carlos Enrique George-Reyes, Andrea Zingoni, Enrique Yeguas-Bolívar
Organizations: Dept. of Computer Science, University of Córdoba, Córdoba, Spain · Dept. of Economics, Engineering, Society and Business Organization, University of Tuscia, Viterbo, Italy · Dept. of Education, University of Córdoba, Córdoba, Spain · Universidad Politécnica Metropolitana de Hidalgo, México
This study develops machine learning models to assess Media and Information Literacy (MIL) skills specifically in the context of disinformation among students, particularly future educators and communicators. While the digital revolution has expanded access to information, it has also amplified the spread of false and misleading content, making MIL essential for fostering critical thinking and responsible media engagement. Despite its relevance, predictive modeling of MIL in relation to disinformation remains underexplored. To address this gap, a quantitative study was conducted with 723 students in education and communication programs using a validated survey. Classification and regression algorithms were applied to predict MIL competencies and identify key influencing factors. Results show that complex models outperform simpler approaches, with variables such as academic year and prior training significantly improving prediction accuracy. These findings can inform the design of targeted educational interventions and personalized strategies to enhance students' ability to critically navigate and respond to disinformation in digital environments.
The intentional creation and spread of disinformation poses a significant threat to public discourse. However, existing English datasets and research rarely address the intentionality behind the disinformation. This work presents MALINT, the first human-annotated English corpus developed in collaboration with expert fact-checkers to capture disinformation and its malicious intent. We utilize our novel corpus to benchmark 12 language models, including small language models (SLMs) such as BERT and large language models (LLMs) like Llama 3.3, on binary and multilabel intent classification tasks. Moreover, inspired by inoculation theory from psychology and communication studies, we investigate whether incorporating knowledge of malicious intent can improve disinformation detection. To this end, we propose intent-based inoculation, an intent-augmented reasoning for LLMs that integrates intent analysis to mitigate the persuasive impact of disinformation. Analysis on six disinformation datasets, five LLMs, and seven languages shows that intent-augmented reasoning improves zero-shot disinformation detection. To support research in intent-aware disinformation detection, we release the MALINT dataset with annotations from each annotation step.
Student attrition represents a significant challenge for higher education institutions because it impacts both academic results and financial viability. Machine learning provides an effective solution to identify students who require assistance before they leave their academic programs. The research investigates how machine learning approaches enable institutions to predict student withdrawal and enrollment cancellation through data-driven insights for strategic decisionmaking. The evaluation of models includes Logistic Regression, Random Forest, Support Vector Machines (SVM), and K-Nearest Neighbors (KNN) based on academic performance and demographic data and enrollment records. The results show that logistic regression and linear SVM models produced the highest accuracy which demonstrates ML's capability to detect students at risk.
Soheila Gheisari, Hamid Salarian
Department of Information Technology, Sydney International School of Technology and Commerce, Sydney, NSW 2000, Australia
In contemporary societies, the threat of disinformation has reached alarming levels, exacerbated by the proliferation of electronic communication, social media, and advancements in artificial intelligence. As a result, there is an urgent need to develop effective countermeasures to mitigate this menace. However, the sheer scale of the problem renders manual fact-checking and human-based verification inadequate, underscoring the necessity for automated methods to detect and debunk disinformation. This article proposes a novel approach based on a multi-agent system that emulates the decision-making processes of human annotators engaged in disinformation detection tasks. By incorporating a consensus mechanism, diversity in cognition and diversity in knowledge, and also hierarchical structure, inspired by human annotators' behavior, the proposed method achieves superior results compared to individual Large Language Models (LLMs), including GPT 4 and GPT 3.5. The system leverages open models (e.g., LLaMA, Kimi, Qwen, Deepseek and LLaMA-Nemotron) to ensure greater transparency. The evaluation of the proposed method encompasses datasets in languages with varying resource availability, including English (high-resource), Polish (medium-resource), Slovak (low-resource) and Bulgarian (low-resource). Experiments were conducted on tasks such as direct disinformation detection, identification of texts worthy of verification, and detection of texts containing verifiable factual claims.
Sebastian Kula, Martin Tamajka
Kempelen Institute of Intelligent Technologies, Bratislava, Slovakia · West Pomeranian University of Technology in Szczecin, Szczecin, Poland