Manuscript received February 27, 2023; revised April 17, 2023; accepted June 13, 2023.
Abstract—This research considers the application of a
multi-criteria approach to assess the quality of textbook content.
The issues of determining evaluation criteria and organizing the
work of experts are brought to the fore, as these factors directly
affect the objectivity and efficiency of the evaluation process.
The definition of criteria consisted of reviewing common
mistakes and comments on the quality of textbooks, forming a
preliminary and final list of criteria. The organization of the
work of the experts consisted in the development of a platform
with the introduction of a multi-criteria approach. As a result,
39 criteria were formulated and proposed, grouped into 10 main
sections such as “Structure and organization”, “Content”,
“Didactic aspects”, “Methodological aspects”, “Language level”,
“Psychological and psycholinguistic aspects”, “Cultural and
Value Aspects”, “ICT Integration”, “Differentiation Aspects”,
and “Layout and Design”. The work of experts in the developed
expert system is described, which helps in making a decision.
The implementation of the multi-criteria approach in this expert
system is the main contribution of the research work, which
helps to improve the process of evaluating textbooks. The paper
presents the results of the survey among 44 experts that helped
to identify the most significant criteria which affect the
evaluation a textbook. The paper presents the results of the
survey among 44 experts that helped to identify the most
significant criteria which affect the evaluation a textbook.
Moreover, the base of allowed errors was formulated for the
following types: for illustrations, QR codes, for texts, for the
language of presentation, technical errors, content errors, errors
for multimedia objects.
Index Terms—Assessment, descriptors, multicriteria
assessment, textbook
Zhanat Nurbekova is with the Department of Informatics and
Informatization of education, Institute of Mathematics, Physics and
Informatics, Abai Kazakh National Pedagogical University, Almaty,
Republic of Kazakhstan.
Talgat Sembayev is with the Department of Physical-Mathematical
Sciences and Informatics, Faculty of Natural Sciences and Mathematics,
Shakarim University, Semey, Republic of Kazakhstan.
Dauren Dossymbek is with the Department of Computer Science,
Information Technologies Faculty, L.N. Gumilyov Eurasian National
University, Astana, Republic of Kazakhstan.
Kanagat Baigusheva is with LLP ―Digital Experts Group‖, Astana,
Republic of Kazakhstan.
Sayat Omarov and Yeldos Nurlanov are with the Republican
Research-to-practice Center for Educational Content Expertise under the
Ministry of Education of the Republic of Kazakhstan, Astana, Republic of
Kazakhstan.
*Correspondence: talgat_sembayev@shakarim.kz (T.S.)
Cite: Zhanat Nurbekova, Talgat Sembayev*, Dauren Dossymbek, Kanagat Baigusheva, Sayat Omarov, and Yeldos Nurlanov, "A Multi-criteria-Based Expert Modeling for Assessing the Textbook Quality," International Journal of Information and Education Technology vol. 13, no. 9, pp. 1408-1421, 2023.
Copyright © 2023 by the authors. This is an open access article distributed under the Creative Commons Attribution License which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited (CC BY 4.0).