Plenary Talk at NCTTVTE 2026: Beyond Measuring Outcomes

Saturday, October 31, 2026

On Friday, 30 October 2026, I had the honour of sharing a talk titled Beyond Measuring Outcomes: Rethinking Program-Level Assessment and Continuous Improvement in Technology-Oriented Academic Programs at the 1st National Conference on Technology and Technical-Vocational Teacher Education (NCTTVTE 2026). The conference was hosted online by the College of Industrial Education (CIE), Technological University of the Philippines (TUP), Manila. The invitation followed the online iOBE workshop conducted for CIE earlier this month, and it reflects the relevance of iOBE to outcomes assessment at TUP.
The conference brought together more than 200 participants from universities and colleges across the Philippines, many of them teacher educators who prepare the next generation of technical and vocational teachers and trainers. Since their graduates will themselves assess and report learning outcomes, the central question of the talk carried added weight: how do you know whether your students have attained each outcome? The Commission on Higher Education (CHED) asks this of every program in the Philippines, the same as in Malaysia.

The talk showed that conventional reports reduce each outcome to a single number, such as an average or a pass rate, while two classes with the same average can tell very different stories. iOBE’s box plots and population charts reveal the whole class at once, and the same visuals apply from a single quiz to a course, a program and beyond. This richness also makes AI analysis genuinely useful: AI can compare, find patterns and help draft reports, while educators verify, interpret and decide.
The talk concluded that outcomes-based education works as a Plan–Do–Check–Act cycle, and the loop closes only when the Check is rich enough to tell the Act what to change, where, and for whom. Five principles summed up this approach: measure to see deeper, not only to report outputs; read distributions, not only averages; evaluate across various scales with the same visuals; use AI to analyse data, with educators to judge meaning; and close every loop with evidence.

Sincere thanks go to Assoc. Prof. Dr. Neil Andrew F. Calayag, Conference Chair, for the kind invitation and for coordinating the programme, and to Prof. Dr. Apollo P. Portez, Dean of the College of Industrial Education, for his continued support. Thanks also go to the organising committee and to all participants for their attention and interest.

Read more...

First International iOBE Workshop: Technological University of the Philippines

Friday, October 9, 2026

On Friday, 9 October 2026, I had the honour of conducting an online seminar-workshop, Introduction and Application of the iOBE Software for the Assessment of Learning Outcomes, for the Technological University of the Philippines (TUP), Manila. This was the first official iOBE workshop delivered to a university outside Malaysia, and a meaningful milestone for The Integrated OBE Software (iOBE).

The workshop was organised by the College of Industrial Education (CIE) and brought together close to 60 faculty members from colleges across TUP Manila.
The heart of the session was an extended, live demonstration of iOBE in action. Working through a sample course from start to finish, I showed how a course’s assessment data and outcome mappings are prepared and run through the software. I then took participants carefully through each output: the graphs of individual student marks, the box plots of marks for each assessment and outcome, and the population charts showing how students are distributed across mark bands. Together, these outputs reveal how student assessment results translate into measurable attainment of course and program outcomes, at a level of detail that grades alone cannot provide.

The demonstration then moved to what proved to be a real game changer: using AI to analyse iOBE results. Typical outcomes reports summarise each outcome with only three to five data points, such as the average mark and the percentages of students passing or failing. iOBE, by contrast, produces 14 data points for every course or program outcome. Its box plots give the full statistical profile of marks, including outliers, and its population charts show the share of students in each of six mark bands alongside the outcome’s weightage. This richness is what makes AI analysis so powerful. Working from iOBE’s outputs, AI examined each outcome in depth, uncovered patterns that the eye alone would miss, and recommended targeted improvements for both students and the course. It then brought these findings together into a complete course-level report, showing participants how outcomes data can move quickly from analysis to evidence-based continuous quality improvement.

The discussion reflected the strong commitment of TUP faculty to outcomes-based education. It also showed a shared interest in moving from documenting outcomes to measuring and using them, and that is exactly where iOBE aims to help.

I would like to express my sincere thanks to Prof. Dr. Apollo P. Portez, Dean of the College of Industrial Education, for the kind invitation and support. I also thank Assoc. prof. Dr. Neil Andrew F. Calayag, Head of the Professional Industrial Education Department and Project Leader of the activity, who coordinated the workshop programme and liased with me throughout the preparations. My thanks also go to the TUP faculty members who joined and participated in the workshop.

I look forward to continuing this collaboration with TUP and supporting more institutions in strengthening their outcomes assessment.

Read more...

3rd iOBE Workshop @ UPNM Engineering

Friday, September 18, 2026

The third iOBE workshop for the Faculty of Engineering, Universiti Pertahanan Nasional Malaysia (UPNM) was conducted online on 17 September 2026. This half-day session, titled "Strengthening the iOBE Implementation" builds on the introductory seminar held in March 2025 and the full-day hands-on workshop in May 2025.
A key focus this time was a deeper exploration of the foundational mathematical formulations underlying the iOBE software — a topic the participants had been keen to understand further since the previous sessions. The workshop walked through how assessment marks are converted into course and programme outcomes through the AT-CO and AT-PO mapping matrices, and how the weightage and normalisation mechanisms work across different mapping styles.

The participants then moved into the hands-on segment, with successful implementation of the iOBE software in processing several data at the course and multiple-course levels, generating outcomes reports with box plots and population charts ready for use in their Course Assessment Reports.

A major highlight of this workshop was the introduction of an AI Analyst developed specifically to work with iOBE output data. The AI Analyst interprets and provides deep insights on course and student performance by triangulating across the different graphs and statistical outputs that iOBE produces. This represents a significant step forward in how iOBE data can be used — moving beyond visual inspection of charts towards AI-assisted analysis that can identify patterns, flag areas of concern, and suggest targeted improvements for CQI at both the course and programme levels.

Many thanks to the Dean of the Faculty of Engineering, PM Dr Mohd Taufik, for the invitation, and to the Deputy Dean of Academic, PM Dr Ku Zarina, Mrs Hapsa, and Mrs Santy for coordinating and facilitating the workshop. This third session with FK UPNM marks a maturing partnership, with the faculty now well-positioned to integrate iOBE and its AI capabilities into their assessment and accreditation workflows.
This workshop marks the second contribution to the Malaysian tertiary academic community by the Centre for Academic Excellence (ÆXcel) of i-CATS UC.

Read more...

iOBE Seminar at the University of Nottingham Malaysia

Friday, August 28, 2026

I had the pleasure of conducting an online workshop this morning titled "iOBE: Introduction, Usage and Benefits" for the Faculty of Science and Engineering (FOSE) at the University of Nottingham Malaysia, representing the Centre for Academic Excellence (ÆXcel) at i-CATS University College, Kuching, Sarawak.
I would like to thank Assoc. Prof. Bee Yean Low, Chair of the FOSE Accreditation and Quality Assurance Working Group and Programme Director of BPharm (Hons) at the School of Pharmacy, for the kind invitation and for coordinating the session.

The workshop was structured in two parts. The first hour focused on the conceptual foundations — the context and challenges of implementing Outcome-Based Education (OBE), how student outcomes are typically evaluated, the limitations of conventional approaches, and how iOBE addresses these challenges through compact, detailed outcomes visuals such as box plots and population charts. I also shared the mathematical framework behind the software, covering how assessment marks are converted into course outcomes and programme outcomes through flexible mapping.

The second hour was practical. I demonstrated iOBE on real course data, showing how the software computes and visualises outcomes at both the course level and the programme level. Participants saw how iOBE generates assessment-level outcomes, course outcomes with box plots and population charts, programme outcomes aggregated from multiple courses, and iCGPA spiderweb charts for individual students. I also demonstrated how iOBE can be used to assess specific skills such as problem-solving through the 3-Step Approach.

The participants came from a wide range of backgrounds and experience levels. Many were encountering iOBE for the first time, while a smaller group had some prior awareness of the software. I was pleasantly surprised to learn that one of the lecturers at the faculty had previously used iOBE for her programme at another university and had introduced it to her colleagues at UNM. It was gratifying to hear of this firsthand experience, and it reinforced the value of the software being adopted across different institutions.

It was encouraging to introduce iOBE to a new audience and to see the interest in how it can support their OBE assessment and accreditation needs.

Thank you once again to Assoc. Prof. Bee Yean Low and the Faculty of Science and Engineering at UNM for the opportunity.

Read more...

Presenting iOBE at the REES & I-PHEX 2025

Sunday, October 5, 2025

From September 30 to October 1, 2025, the REES & I-PHEX 2025 conference was held in Johor Bahru, Malaysia, hosted by UTM’s Centre for Engineering Education (CEE). I presented a paper here on “Implementing iOBE for Visualizing and Interpreting Student Outcomes: A Course-Level Assessment”, demonstrating the use of the iOBE software across multiple cohorts of a third-year engineering course.

The presentation showcased how iOBE was applied to analyze student outcome data across three consecutive cohorts in an advanced engineering course. By aggregating diverse assessment tools mapped to Programme Outcomes, the software generated box plots and population graphs that revealed consistent patterns — stronger performance in collaborative tasks and recurring gaps in individual problem-solving. This multi-year analysis highlighted meaningful trends and supported targeted, data-informed improvements in teaching and learning.
This work was also presented as a poster exhibition at the I-PHEX Expo titled "From Complexity to Clarity: Transforming Outcome-Based Assessment through iOBE", recognized with a Silver Award. The poster highlighted key aspects of the software, particularly its advantages, significance, impact, and potential for all educational levels.
With Prof. Homero Murzi of Texas A&M University (Chairman of the Research in Engineering Education Network).

Read more...

  © Designed and managed by zmk. Modified from OBT

Back to TOP