Page 686 - ISC PROCEEDINGS 21.4
P. 686

Table 1. Survey results on student satisfaction, usage intention and responses to
                                                     negative feedback
                                                                        Mean Score
                       Survey Item
                                                                        (Maximum Score: 5.00)
                       1. Satisfaction
                       I am satisfied with the performance of the AI-   4.21
                       assisted System for Assignment
                       2. Usage Intention
                       Based on my experience, I am very likely to use  4.16
                       the AI-assisted System for Assignment
                       3. *Effect of Negative Feedback
                       **I felt motivated after receiving negative      3.51
                       feedback from the AI system
                       I used the negative feedback from the AI         3.81
                       system to revise and improve my assignment
                        *Negative feedback refers to constructive comments that highlight errors or areas
                  for improvement (e.g., structure, writing style, critical thinking, language use, spelling,
                  and                                                                           grammar).
                  **The original item was negatively phrased; it was reworded positively and reverse-coded
                  to ensure consistency in interpretation.
                        As this study employed single-item measures for the constructs Satisfaction and
                  Usage Intention, internal consistency reliability indices such as Cronbach’s alpha are not
                  applicable. Nevertheless, these items were adapted from a previously validated multi-
                  item instrument that demonstrated strong internal consistency reliability. As shown in
                  Table 2, the original scale reported high Cronbach’s alpha values for key constructs,
                  namely Intention to Use (α = 0.96) and Satisfaction (α = 0.97), indicating excellent
                  reliability.
                     Table 2. Reliability coefficients of the original multi-item scale (original instrument)
                             Construct                                          Cronbach’s Alpha
                             Intention to Use (3 items)                         0.96
                             Satisfaction (3 items)                             0.97
                             Perception of Negative Feedback (3                 0.40
                        items)


                        However, the construct of Perception of Negative Feedback exhibited a relatively
                  low reliability coefficient (α = 0.40), suggesting potential variability in how respondents
                  interpret or respond to negatively framed feedback items. Despite this limitation, two
                  items from this construct were retained to capture learners’ immediate affective
                  reactions to negative feedback, which remains a critical dimension of the study.
                        7. Discussion
                        The results indicate an overall positive response to the AI-assisted feedback system
                  for assignments. Students reported high satisfaction (mean = 4.21) and a strong intention
                  to continue using the system (mean = 4.16), suggesting that it is perceived as a useful and
                  effective support tool in the ODL context. These findings align with prior studies showing
                  strong acceptance of AI--assisted feedback when it is timely and supports self-regulated
                  learning (Er et al., 2024; Zawacki-Richter et al., 2019). The system’s ability to provide
                  immediate feedback also reflects key principles of formative assessment, helping learners


                  685
   681   682   683   684   685   686   687   688   689   690   691