FEU Institute of Technology

Educational Innovation and Technology Hub

Loading...

SentimentGPT-Driven Community Outreach Assessment: A Comparative Study of GPT-4.1-mini Against Conventional NLP Methods for Real-Time Feedback Classification

2026 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS), (2026), pp. 268-273

Mar Eli C. Sagsagat a , Elmerito D. Pineda a , Jayson M. Victoriano b , Enrico P. Chavez c , Ace C. Lagman d , Isagani M. Tano e

a Graduate School Department, La Consolacion University Philippines, Philippines

b Research Management Office, Bulacan State University, Malolos, Philippines

c College of Computer Studies and Multimedia Arts Department, FEU Institute of Technology, Philippines

d Graduate School Department, FEU Institute of Technology, Philippines

e Graduate School Department, Quezon City University, Quezon City, Philippines

Abstract: Conventional sentiment analysis methods, which include lexicon-based tools (TextBlob, VADER) and conventional machine learning classifiers (Naive Bayes, SVM), show limited effectiveness when applied to community outreach feedback because of their inability to interpret sarcasm, mixed emotions, and context-dependent language. This paper presents a comparative evaluation of OpenAI’s GPT-4.1-mini model versus four baseline methods for sentiment classification of community extension service feedback, integrated in a real-time web-based information system. A benchmark experimentation using 100 manually labeled community feedback entries on three sentiment classes (positive, neutral, negative) indicates that the proposed GPT-4.1-mini approach achieves 91.0% overall accuracy with an F1-score of 92.4%, outperforming TextBlob (62.5% accuracy), VADER (68.3%), Naive Bayes (74.8%), and SVM (78.2%) across all evaluated methods. The information system implements a dual-model architecture—GPT-3.5-turbo for dashboard insight synthesis and GPT-4.1-mini for granular feedback classification using an engineered prompt design which applies structured JSON output at a temperature of 0.3 for classification consistency. Cost-performance analysis reveals that the GPT-4.1-mini approach processes 1000 feedback entries at approximately ₱36.43 with an average latency of 1.4 seconds per request, achieving a 97% cost reduction compared to full GPT-4 with comparable accuracy. System evaluation by 38 respondents using the ISO/IEC 25010 software product quality model achieved weighted mean scores of 4.82 (Functional Suitability), 4.55 (Performance Efficiency), 4.71 (Usability), 4.67 (Maintainability), and 4.75 (Decision Support Effectiveness). The CESO staff indicator "Sentiment recommendations improve activities" has a perfect 5.00 score, confirming the practical impact of AI-driven sentiment analysis for institutional community engagement.

Recommended Citation

Sagsagat, M. E. C., Pineda, E. D., Victoriano, J. M., Chavez, E. P., Lagman, A. C., & Tano, I. M. (2026). SentimentGPT-Driven Community Outreach Assessment: A Comparative Study of GPT-4.1-mini Against Conventional NLP Methods for Real-Time Feedback Classification. 2026 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS), 268-273. https://doi.org/10.1109/I2CACIS69435.2026.11600377
M. E. C. Sagsagat, E. D. Pineda, J. M. Victoriano, E. P. Chavez, A. C. Lagman, and I. M. Tano, "SentimentGPT-Driven Community Outreach Assessment: A Comparative Study of GPT-4.1-mini Against Conventional NLP Methods for Real-Time Feedback Classification," 2026 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS), pp. 268-273, 2026. doi: 10.1109/I2CACIS69435.2026.11600377.
Sagsagat, Mar Eli C., et al.. "SentimentGPT-Driven Community Outreach Assessment: A Comparative Study of GPT-4.1-mini Against Conventional NLP Methods for Real-Time Feedback Classification." 2026 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS), 2026, pp. 268-273. https://doi.org/10.1109/I2CACIS69435.2026.11600377.
Sagsagat, M. E. C., Pineda, E. D., Victoriano, J. M., Chavez, E. P., Lagman, A. C., & Tano, I. M.. 2026. "SentimentGPT-Driven Community Outreach Assessment: A Comparative Study of GPT-4.1-mini Against Conventional NLP Methods for Real-Time Feedback Classification." 2026 IEEE International Conference on Automatic Control and Intelligent Systems (I2CACIS): 268-273. https://doi.org/10.1109/I2CACIS69435.2026.11600377.

A Time Capsule Where Research Rests, Legends Linger, and PDFs Live Forever

Repository is the home for every research paper and capstone project created across our institution. It’s where knowledge kicks back, ideas live on, and your hard work finds the spotlight it deserves.

© 2026 Educational Innovation and Technology Hub. All Rights Reserved.