NotesFAQContact Us
Search Tips
Peer reviewed Peer reviewed
Direct linkDirect link
ERIC Number: EJ848646
Record Type: Journal
Publication Date: 2004
Pages: 17
Abstractor: As Provided
Reference Count: 38
ISSN: ISSN-1547-9714
Designing Online Information Systems for Portfolio-Based Assessment: Design Criteria and Heuristics
Love, Terence; Cooper, Trudi
Journal of Information Technology Education, v3 p65-81 2004
This paper outlines the main findings of research about online portfolio information systems. This research focused on the educational integrity of these educational systems and the maximisation of value across all stakeholders, in particular the value gained from the automation and interaction potential of the online environment. The findings and analyses were based on a review of current practices in online portfolios along with secondary analysis of the existing literature on portfolios and online portfolios. The research focused on the ways stakeholder value is created through different approaches to design composition. From this perspective, the paper explores issues relating to: the automation of administrative functions; matching context, discipline and technology; information storage; interface issues; quality assurance; equity issues; security, fraud and plagiarism detection; and the ability to realise curriculum innovations, such as providing and assessing evidence of professional skills and graduate attributes. The authors propose these are the central functional issues in designing of online portfolio assessment system and as such takes precedence over decision making about the technical means by which online portfolio systems are instantiated and implemented. The findings of this critical review of contemporary practice in designing online portfolio systems indicated a widespread neglect of those factors necessary to achieving educational integrity and maximising value across all stakeholders. Typically, design processes were marked by an over-emphasis on technical issues about facilitating implementation rather than addressing the primary educational goals. In conclusion, the research suggests that most online portfolio systems fall significantly short of their potential, and, in many cases, are inferior to conventional portfolio assessment and traditional assessment approaches. The analyses suggest the design of online portfolio assessment systems should, like any other educational process, be grounded in achieving educational integrity, and, to gain the benefits of the online environment, focus on those factors that maximise value across all stakeholders. In particular, the research draws attention to the most significant, and most commonly under-realised, benefit offered by online environments: the ability to efficiently automate many of the time consuming routine administrative tasks associated with education and assessment without loss of teaching and learning benefits. (Contains 1 table.)
Informing Science Institute. 131 Brookhill Court, Santa Rosa, CA 95409. Tel: 707-537-2211; Fax: 480-247-5724; Web site:
Publication Type: Journal Articles; Reports - Research
Education Level: N/A
Audience: N/A
Language: English
Sponsor: N/A
Authoring Institution: N/A