A computer-based evaluation system: Its design, implementation and results obtained on a general chemistry course
Vol 8, Issue 11, 2024
VIEWS - 39 (Abstract) 13 (PDF)
Abstract
Using multiple evaluation methods and systems give a comprehensive assessment. A computer-based multiple-choice assessment system was designed, implemented, posted online, and used to assess students as part of their final evaluation marks for a discipline. The online system of evaluation was intended to be used multiple times for evaluating the assimilation degree of a specific course at the end of the course. The data recorded for the period 2017–2023 with about 1400 distinct users were used to analyze the performance of the evaluation system. The system worked fine and a slight modification of it served well on remote evaluation during COVID-19 period. However, the upturn of mobile phone applications requires the creation of a system adapted to the new virtual reality.
Keywords
Full Text:
PDFReferences
Alagarsamy, S., Vijay, M. (2019) Construction and Validation of the Learning Management System Success Scale in the Higher Education Setting. Available online: http://gatrenterprise.com/GATRJournals/GJBSSR/pdf_files/GJBSSRVol7(2)2019/5.Subburaj.pdf (accessed on 9 October 2023).
Al-Hunaiyyan, A., Alhajri, R., Al-Sharhan, S., et al. (2021). Factors Influencing the Acceptance and Adoption of Online Learning in Response to the COVID-19 Pandemic. International Journal of Web-Based Learning and Teaching Technologies, 16(6), 1–16. https://doi.org/10.4018/ijwltt.20211101.oa5
Alsayyari, A., Alblawi, A., Elhajji M. (2019). Engineering students’ acceptance and experience of learning management systems: a case study at Shaqra university. Available online: https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=8632633 (accessed on 5 October 2023).
Alzahrani, L., & Seth, K. P. (2021). Factors influencing students’ satisfaction with continuous use of learning management systems during the COVID-19 pandemic: An empirical study. Education and Information Technologies, 26(6), 6787–6805. https://doi.org/10.1007/s10639-021-10492-5
Anglin, G. J., Vaez, H., & Cunningham, K. L. (2004). Visual Representations and Learning: The Role of Static and Animated Graphics. Available online: https://www.taylorfrancis.com/books/edit/10.4324/9781410609519/handbook-research-educational-communications-technology-david-jonassen-marcy-driscoll?refId=ad1dd4f7-2f5c-4cee-b954-852075fee1fa&context=ubx (accessed on 15 October 2023).
Balkaya, S., & Akkucuk, U. (2021). Adoption and Use of Learning Management Systems in Education: The Role of Playfulness and Self-Management. Sustainability, 13(3), 1127. https://doi.org/10.3390/su13031127
Baragash, R. S., & Al-Samarraie, H. (2018). Blended learning: Investigating the influence of engagement in multiple learning delivery modes on students’ performance. Telematics and Informatics, 35(7), 2082–2098. https://doi.org/10.1016/j.tele.2018.07.010
Barrot, J. S., Llenares, I. I., & del Rosario, L. S. (2021). Students’ online learning challenges during the pandemic and how they cope with them: The case of the Philippines. Education and Information Technologies, 26(6), 7321–7338. https://doi.org/10.1007/s10639-021-10589-x
Bayazit, A., & Aşkar, P. (2012). Performance and duration differences between online and paper-pencil tests. Asia Pacific Education Review, 13(2), 219–226. https://doi.org/10.1007/s12564-011-9190-9
Bloem, J., Doorn, M. V., Duivestein, S., et al. (2014). The Fourth Industrial Revolution. Available online: https://docslib.org/doc/12519523/the-fourth-industrial-revolution-things-to-tighten-the-link-between-it-and-ot (accessed on 9 October 2023).
Bolboacă, S. D., Achimaş-Cadariu, B. A. (2004a). Binomial Distribution Sample Confidence Intervals Estimation 6. Available online: http://lejpt.academicdirect.org/A04/01_21.pdf (accessed on 9 October 2023).
Bolboacă, S. D., Achimaş-Cadariu, B. A. (2004b). Binomial Distribution Sample Confidence Intervals Estimation 5. Available on: http://ljs.academicdirect.org/A04/26_43.pdf (accessed on 9 October 2023).
Burton, R. F. (2001). Quantifying the Effects of Chance in Multiple Choice and True/False Tests: Question selection and guessing of answers. Assessment & Evaluation in Higher Education, 26(1), 41–50. https://doi.org/10.1080/02602930020022273
Camilleri, M. A., & Camilleri, A. C. (2021). The Acceptance of Learning Management Systems and Video Conferencing Technologies: Lessons Learned from COVID-19. Technology, Knowledge and Learning, 27(4), 1311–1333. https://doi.org/10.1007/s10758-021-09561-y
Cavus, N., Mohammed, Y. B., & Yakubu, M. N. (2021). Determinants of Learning Management Systems during COVID-19 Pandemic for Sustainable Education. Sustainability, 13(9), 5189. https://doi.org/10.3390/su13095189
Chang, J. C., & Akahori, K. (1999). An Evaluation of Japanese CALL Systems on the WWW Comparing a Freely Input Approach with Multiple Selection. Computer Assisted Language Learning, 12(1), 59–79. https://doi.org/10.1076/call.12.1.59.5717
Chang, C. T., Hajiyev, J., & Su, C. R. (2017). Examining the students’ behavioral intention to use e-learning in Azerbaijan? The General Extended Technology Acceptance Model for E-learning approach. Computers & Education, 111, 128–143. https://doi.org/10.1016/j.compedu.2017.04.010
Dannenberg, R. B., & Hu, N. (2003). Pattern Discovery Techniques for Music Audio. Journal of New Music Research, 32(2), 153–163. https://doi.org/10.1076/jnmr.32.2.153.16738
Dobre, I. (2015). Learning Management Systems for Higher Education—An Overview of Available Options for Higher Education Organizations. Procedia—Social and Behavioral Sciences, 180, 313–320. https://doi.org/10.1016/j.sbspro.2015.02.122
Fallows, S., & Steven, C. (2000). Building employability skills into the higher education curriculum: a university—wide initiative. Education + Training, 42(2), 75–83. https://doi.org/10.1108/00400910010331620
Garcia, J. G., Gangan, M. G., Tolentino, M. N., et al. (2020). Canvas adoption: Assessment and acceptance of the learning management system on a web-based platform. Available online: https://www.researchgate.net/publication/347404623_Canvas_Adoption_Assessment_and_Acceptance_of_the_Learning_Management_System_on_a_Web-based_Platform#fullTextFileContent (accessed on 8 April 2024).
Hashemi Hosseinabad, S., Safayani, M., & Mirzaei, A. (2021). Multiple answers to a question: a new approach for visual question answering. The Visual Computer, 37(1), 119–131. https://doi.org/10.1007/s00371-019-01786-4
Hestenes, D. (1987). Toward a modeling theory of physics instruction. American Journal of Physics, 55(5), 440–454. https://doi.org/10.1119/1.15129
Holmes, P. (2002). Multiple evaluation versus multiple choice as testing paradigm feasibility, reliability and validity in practice [PhD thesis]. University of Twente.
Jäntschi, L., & Bolboacă, S. D. (2006). Auto-calibrated online evaluation: database design and implementation. Leonardo Electron. J. Pract. Technol., 5(9), 179–192.
Jäntschi, L., Stoenoiu, C. E., & Bolboaca, S. D. (2007). Linking Assessment to e-Learning in Microbiology and Toxicology for Undergraduate Students. In: Proceedings of the EUROCON 2007—The International Conference on “Computer as a Tool”. pp. 2447–2452.
Jäntschi, L. (2013). General Chemistry. Available online: http://lori.academicdirect.org/books/pdf/2013_gcc.pdf (accessed on 4 November 2023).
Jäntschi, L. (2021). Formulas, Algorithms and Examples for Binomial Distributed Data Confidence Interval Calculation: Excess Risk, Relative Risk and Odds Ratio. Mathematics, 9(19), 2506. https://doi.org/10.3390/math9192506
Jäntschi, L. (2022). Binomial Distributed Data Confidence Interval Calculation: Formulas, Algorithms and Examples. Symmetry, 14(6), 1104. https://doi.org/10.3390/sym14061104
Jäntschi, L. (2023). General chemistry laboratory work: a practical guide (Romanian). Available online: http://ph.academicdirect.org/llcggp.pdf (accessed on 5 November 2023).
Jiang, P., Yan, K., Chen, H., et al. (2022). Building of online evaluation system based on socket protocol. Computer Science and Information Systems, 19(1), 185–204. https://doi.org/10.2298/csis210201047j
Joaquin, J. J. B., Biana, H. T., & Dacela, M. A. (2020). The Philippine Higher Education Sector in the Time of COVID-19. Frontiers in Education, 5. https://doi.org/10.3389/feduc.2020.576371
Labrak, Y., Bazoge, A., Dufour, R., et al. (2022). FrenchMedMCQA: A French multiple-choice question answering dataset for medical domain. In: Proceedings of the 13th International Workshop on Health Text Mining and Information Analysis (LOUHI); Abu Dhabi, United Arab Emirates. pp. 41–46.
Loftis, J. R. (2019). Beyond Information Recall. American Association of Philosophy Teachers Studies in Pedagogy, 5, 89–122. https://doi.org/10.5840/aaptstudies2019121144
Matteson, S. M. (2006). Mathematical Literacy and Standardized Mathematical Assessments. Reading Psychology, 27(2–3), 205–233. https://doi.org/10.1080/02702710600642491
Mehrolia, S., Alagarsamy, S., & Indhu Sabari, M. (2021). Moderating effects of academic involvement in web-based learning management system success: A multigroup analysis. Heliyon, 7(5), e07000. https://doi.org/10.1016/j.heliyon.2021.e07000
Munyengabe, S., Yiyi, Z., Haiyan, H., & Hitimana, S. (2017). Primary teachers’ perceptions on ICT integration for enhancing teaching and learning through the implementation of One Laptop Per Child Program in primary schools of Rwanda. Eurasia Journal of Mathematics, Science and Technology Education, 13(11), 7193e7204. https://doi.org/10.12973/ejmste/79044
Nașcu, H. I., & Jäntschi, L. (2004a). Multiple choice examination system 1. Database Design and Implementation for General Chemistry. Available online: http://ljs.academicdirect.org/A05/18_33.htm (accessed on 4 November 2023).
Nașcu, H. I., & Jäntschi, L. (2004b). Multiple Choice Examination System 2. Online Quizzes for General Chemistry. Available online: http://ljs.academicdirect.org/A05/18_33.htm (accessed on 4 November 2023).
Nguyen, N. T. (2021). A study on satisfaction of users towards learning management system at International University—Vietnam National University HCMC. Asia Pacific Management Review, 26(4), 186–196. https://doi.org/10.1016/j.apmrv.2021.02.001
Nguyen, T., Bui, T., Fujita, H., et al. (2021). Multiple-objective optimization applied in extracting multiple-choice tests. Engineering Applications of Artificial Intelligence, 105, 104439. https://doi.org/10.1016/j.engappai.2021.104439
Nicol, D. (2007). E-assessment by design: using multiple-choice tests to good effect. Journal of Further and Higher Education, 31(1), 53–64. https://doi.org/10.1080/03098770601167922
Omari, A. (2013). An Evaluation and Assessment System for Online MCQ’s Exams. International Journal of Electronics and Electrical Engineering, 1(3), 219–222. https://doi.org/10.12720/ijeee.1.3.219-222
Ramírez-Correa, P. E., Rondan-Cataluña, F. J., Arenas-Gaitán, J., et al. (2017). Moderating effect of learning styles on a learning management system’s success. Telematics and Informatics, 34(1), 272–286. https://doi.org/10.1016/j.tele.2016.04.006
Raza, S. A., Qazi, W., Khan, K. A., et al. (2020). Social Isolation and Acceptance of the Learning Management System (LMS) in the time of COVID-19 Pandemic: An Expansion of the UTAUT Model. Journal of Educational Computing Research, 59(2), 183–208. https://doi.org/10.1177/0735633120960421
Regulation (EU). (2016). 2016/679 of the European Parliament and of the Council of 27 April 2016 on the protection of natural persons with regard to the processing of personal data and on the free movement of such data, and repealing Directive 95/46/EC (General Data Protection Regulation). Available online: https://eur-lex.europa.eu/legal-content/EN/TXT/?uri=CELEX%3A32016R0679 (accessed on 8 October 2023).
Suleman, F. (2018). The employability skills of higher education graduates: insights into conceptual frameworks and methodological options. Higher Education, 76(2), 263–278. https://doi.org/10.1007/s10734-017-0207-0
Tasdemir, S., Balcı, M., Cabi, A., et al. (2015). The Design and Application of Online Exam System Supported by Database. International Journal of Applied Mathematics, Electronics and Computers, 3(3), 204–207. https://doi.org/10.18100/ijamec.43348
Tinmaz, H., & Lee, J. H. (2020). An analysis of users’ preferences on learning management systems: a case on German versus Spanish students. Smart Learning Environments, 7(1). https://doi.org/10.1186/s40561-020-00141-8
Tilak, J. B. G., & Kumar, A. G. (2022). Policy Changes in Global Higher Education: What Lessons Do We Learn from the COVID-19 Pandemic? Higher Education Policy, 35(3), 610–628. https://doi.org/10.1057/s41307-022-00266-0
Zhu, X., & Liu, J. (2020). Education in and After COVID-19: Immediate Responses and Long-Term Visions. Postdigital Science and Education, 2(3), 695–699. https://doi.org/10.1007/s42438-020-00126-3
DOI: https://doi.org/10.24294/jipd.v8i11.8839
Refbacks
- There are currently no refbacks.
Copyright (c) 2024 Carmen Elena Stoenoiu, Lorentz Jäntschi
License URL: https://creativecommons.org/licenses/by/4.0/
This site is licensed under a Creative Commons Attribution 4.0 International License.