Lecture Notes in Computer Science Commenced Publication in 1973 Founding and Former Series Editors: Gerhard Goos, Juris Hartmanis, and Jan van Leeuwen
Editorial Board David Hutchison Lancaster University, UK Takeo Kanade Carnegie Mellon University, Pittsburgh, PA, USA Josef Kittler University of Surrey, Guildford, UK Jon M. Kleinberg Cornell University, Ithaca, NY, USA Alfred Kobsa University of California, Irvine, CA, USA Friedemann Mattern ETH Zurich, Switzerland John C. Mitchell Stanford University, CA, USA Moni Naor Weizmann Institute of Science, Rehovot, Israel Oscar Nierstrasz University of Bern, Switzerland C. Pandu Rangan Indian Institute of Technology, Madras, India Bernhard Steffen University of Dortmund, Germany Madhu Sudan Massachusetts Institute of Technology, MA, USA Demetri Terzopoulos University of California, Los Angeles, CA, USA Doug Tygar University of California, Berkeley, CA, USA Gerhard Weikum Max-Planck Institute of Computer Science, Saarbruecken, Germany
5618
Gavriel Salvendy Michael J. Smith (Eds.)
Human Interface and the Management of Information Information and Interaction Symposium on Human Interface 2009 Held as Part of HCI International 2009 San Diego, CA, USA, July 19-24, 2009 Proceedings, Part II
13
Volume Editors Gavriel Salvendy Purdue University, Grissom Hall, Room 263 315 North Grant Street, West Lafayette, IN, 47907-2023, USA E-mail:
[email protected] and Tsinghua University, Department of Industrial Engineering Beijing 10084, P.R. China Michael J. Smith University of Wisconsin Department of Industrial and Systems Engineering 1513 University Avenue, Madison, WI 53706, USA E-mail:
[email protected]
Library of Congress Control Number: Applied for CR Subject Classification (1998): H.5, H.3, H.4, K.4.3, D.2 LNCS Sublibrary: SL 3 – Information Systems and Application, incl. Internet/Web and HCI ISSN ISBN-10 ISBN-13
0302-9743 3-642-02558-7 Springer Berlin Heidelberg New York 978-3-642-02558-7 Springer Berlin Heidelberg New York
This work is subject to copyright. All rights are reserved, whether the whole or part of the material is concerned, specifically the rights of translation, reprinting, re-use of illustrations, recitation, broadcasting, reproduction on microfilms or in any other way, and storage in data banks. Duplication of this publication or parts thereof is permitted only under the provisions of the German Copyright Law of September 9, 1965, in its current version, and permission for use must always be obtained from Springer. Violations are liable to prosecution under the German Copyright Law. springer.com © Springer-Verlag Berlin Heidelberg 2009 Printed in Germany Typesetting: Camera-ready by author, data conversion by Scientific Publishing Services, Chennai, India Printed on acid-free paper SPIN: 12704330 06/3180 543210
Foreword
The 13th International Conference on Human–Computer Interaction, HCI International 2009, was held in San Diego, California, USA, July 19–24, 2009, jointly with the Symposium on Human Interface (Japan) 2009, the 8th International Conference on Engineering Psychology and Cognitive Ergonomics, the 5th International Conference on Universal Access in Human–Computer Interaction, the Third International Conference on Virtual and Mixed Reality, the Third International Conference on Internationalization, Design and Global Development, the Third International Conference on Online Communities and Social Computing, the 5th International Conference on Augmented Cognition, the Second International Conference on Digital Human Modeling, and the First International Conference on Human-Centered Design. A total of 4,348 individuals from academia, research institutes, industry and governmental agencies from 73 countries submitted contributions, and 1,425 papers that were judged to be of high scientific quality were included in the program. These papers address the latest research and development efforts and highlight the human aspects of the design and use of computing systems. The papers accepted for presentation thoroughly cover the entire field of human–computer interaction, addressing major advances in knowledge and effective use of computers in a variety of application areas. This volume, edited by Gavriel Salvendy and Michael J. Smith, contains papers in the thematic area of Human Interface and the Management of Information, addressing the following major topics: • • • • • • •
Interacting with the World Wide Web Intelligent Techniques for Access to Information and Personalization Visual Interfaces, Visualization and Images Mobile Devices and Services eHealth Applications and Services Education, Learning and Entertainment Information Systems in Safety-Critical Domains
The remaining volumes of the HCI International 2009 proceedings are: • • • • •
Volume 1, LNCS 5610, Human–Computer Interaction––New Trends (Part I), edited by Julie A. Jacko Volume 2, LNCS 5611, Human–Computer Interaction––Novel Interaction Methods and Techniques (Part II), edited by Julie A. Jacko Volume 3, LNCS 5612, Human–Computer Interaction––Ambient, Ubiquitous and Intelligent Interaction (Part III), edited by Julie A. Jacko Volume 4, LNCS 5613, Human–Computer Interaction––Interacting in Various Application Domains (Part IV), edited by Julie A. Jacko Volume 5, LNCS 5614, Universal Access in Human–Computer Interaction––Addressing Diversity (Part I), edited by Constantine Stephanidis
VI
Foreword
• • • • • • • • • • •
Volume 6, LNCS 5615, Universal Access in Human–Computer Interaction––Intelligent and Ubiquitous Interaction Environments (Part II), edited by Constantine Stephanidis Volume 7, LNCS 5616, Universal Access in Human–Computer Interaction––Applications and Services (Part III), edited by Constantine Stephanidis Volume 8, LNCS 5617, Human Interface and the Management of Information––Designing Information Environments (Part I), edited by Michael J. Smith and Gavriel Salvendy Volume 10, LNCS 5619, Human-Centered Design, edited by Masaaki Kurosu Volume 11, LNCS 5620, Digital Human Modeling, edited by Vincent G. Duffy Volume 12, LNCS 5621, Online Communities and Social Computing, edited by A. Ant Ozok and Panayiotis Zaphiris Volume 13, LNCS 5622, Virtual and Mixed Reality, edited by Randall Shumaker Volume 14, LNCS 5623, Internationalization, Design and Global Development, edited by Nuray Aykin Volume 15, LNCS 5624, Ergonomics and Health Aspects of Work with Computers, edited by Ben-Tzion Karsh Volume 16, LNAI 5638, The Foundations of Augmented Cognition: Neuroergonomics and Operational Neuroscience, edited by Dylan Schmorrow, Ivy Estabrooke and Marc Grootjen Volume 17, LNAI 5639, Engineering Psychology and Cognitive Ergonomics, edited by Don Harris
I would like to thank the Program Chairs and the members of the Program Boards of all thematic areas, listed below, for their contribution to the highest scientific quality and the overall success of HCI International 2009.
Ergonomics and Health Aspects of Work with Computers Program Chair: Ben-Tzion Karsh Arne Aarås, Norway Pascale Carayon, USA Barbara G.F. Cohen, USA Wolfgang Friesdorf, Germany John Gosbee, USA Martin Helander, Singapore Ed Israelski, USA Waldemar Karwowski, USA Peter Kern, Germany Danuta Koradecka, Poland Kari Lindström, Finland
Holger Luczak, Germany Aura C. Matias, Philippines Kyung (Ken) Park, Korea Michelle M. Robertson, USA Michelle L. Rogers, USA Steven L. Sauter, USA Dominique L. Scapin, France Naomi Swanson, USA Peter Vink, The Netherlands John Wilson, UK Teresa Zayas-Cabán, USA
Foreword
Human Interface and the Management of Information Program Chair: Michael J. Smith Gunilla Bradley, Sweden Hans-Jörg Bullinger, Germany Alan Chan, Hong Kong Klaus-Peter Fähnrich, Germany Michitaka Hirose, Japan Jhilmil Jain, USA Yasufumi Kume, Japan Mark Lehto, USA Fiona Fui-Hoon Nah, USA Shogo Nishida, Japan Robert Proctor, USA Youngho Rhee, Korea
Anxo Cereijo Roibás, UK Katsunori Shimohara, Japan Dieter Spath, Germany Tsutomu Tabe, Japan Alvaro D. Taveira, USA Kim-Phuong L. Vu, USA Tomio Watanabe, Japan Sakae Yamamoto, Japan Hidekazu Yoshikawa, Japan Li Zheng, P.R. China Bernhard Zimolong, Germany
Human–Computer Interaction Program Chair: Julie A. Jacko Sebastiano Bagnara, Italy Sherry Y. Chen, UK Marvin J. Dainoff, USA Jianming Dong, USA John Eklund, Australia Xiaowen Fang, USA Ayse Gurses, USA Vicki L. Hanson, UK Sheue-Ling Hwang, Taiwan Wonil Hwang, Korea Yong Gu Ji, Korea Steven Landry, USA
Gitte Lindgaard, Canada Chen Ling, USA Yan Liu, USA Chang S. Nam, USA Celestine A. Ntuen, USA Philippe Palanque, France P.L. Patrick Rau, P.R. China Ling Rothrock, USA Guangfeng Song, USA Steffen Staab, Germany Wan Chul Yoon, Korea Wenli Zhu, P.R. China
Engineering Psychology and Cognitive Ergonomics Program Chair: Don Harris Guy A. Boy, USA John Huddlestone, UK Kenji Itoh, Japan Hung-Sying Jing, Taiwan Ron Laughery, USA Wen-Chin Li, Taiwan James T. Luxhøj, USA
Nicolas Marmaras, Greece Sundaram Narayanan, USA Mark A. Neerincx, The Netherlands Jan M. Noyes, UK Kjell Ohlsson, Sweden Axel Schulte, Germany Sarah C. Sharples, UK
VII
VIII
Foreword
Neville A. Stanton, UK Xianghong Sun, P.R. China Andrew Thatcher, South Africa
Matthew J.W. Thomas, Australia Mark Young, UK
Universal Access in Human–Computer Interaction Program Chair: Constantine Stephanidis Julio Abascal, Spain Ray Adams, UK Elisabeth André, Germany Margherita Antona, Greece Chieko Asakawa, Japan Christian Bühler, Germany Noelle Carbonell, France Jerzy Charytonowicz, Poland Pier Luigi Emiliani, Italy Michael Fairhurst, UK Dimitris Grammenos, Greece Andreas Holzinger, Austria Arthur I. Karshmer, USA Simeon Keates, Denmark Georgios Kouroupetroglou, Greece Sri Kurniawan, USA
Patrick M. Langdon, UK Seongil Lee, Korea Zhengjie Liu, P.R. China Klaus Miesenberger, Austria Helen Petrie, UK Michael Pieper, Germany Anthony Savidis, Greece Andrew Sears, USA Christian Stary, Austria Hirotada Ueda, Japan Jean Vanderdonckt, Belgium Gregg C. Vanderheiden, USA Gerhard Weber, Germany Harald Weber, Germany Toshiki Yamaoka, Japan Panayiotis Zaphiris, UK
Virtual and Mixed Reality Program Chair: Randall Shumaker Pat Banerjee, USA Mark Billinghurst, New Zealand Charles E. Hughes, USA David Kaber, USA Hirokazu Kato, Japan Robert S. Kennedy, USA Young J. Kim, Korea Ben Lawson, USA
Gordon M. Mair, UK Miguel A. Otaduy, Switzerland David Pratt, UK Albert “Skip” Rizzo, USA Lawrence Rosenblum, USA Dieter Schmalstieg, Austria Dylan Schmorrow, USA Mark Wiederhold, USA
Internationalization, Design and Global Development Program Chair: Nuray Aykin Michael L. Best, USA Ram Bishu, USA Alan Chan, Hong Kong Andy M. Dearden, UK
Susan M. Dray, USA Vanessa Evers, The Netherlands Paul Fu, USA Emilie Gould, USA
Foreword
Sung H. Han, Korea Veikko Ikonen, Finland Esin Kiris, USA Masaaki Kurosu, Japan Apala Lahiri Chavan, USA James R. Lewis, USA Ann Light, UK James J.W. Lin, USA Rungtai Lin, Taiwan Zhengjie Liu, P.R. China Aaron Marcus, USA Allen E. Milewski, USA
Elizabeth D. Mynatt, USA Oguzhan Ozcan, Turkey Girish Prabhu, India Kerstin Röse, Germany Eunice Ratna Sari, Indonesia Supriya Singh, Australia Christian Sturm, Spain Adi Tedjasaputra, Singapore Kentaro Toyama, India Alvin W. Yeo, Malaysia Chen Zhao, P.R. China Wei Zhou, P.R. China
Online Communities and Social Computing Program Chairs: A. Ant Ozok, Panayiotis Zaphiris Chadia N. Abras, USA Chee Siang Ang, UK Amy Bruckman, USA Peter Day, UK Fiorella De Cindio, Italy Michael Gurstein, Canada Tom Horan, USA Anita Komlodi, USA Piet A.M. Kommers, The Netherlands Jonathan Lazar, USA Stefanie Lindstaedt, Austria
Gabriele Meiselwitz, USA Hideyuki Nakanishi, Japan Anthony F. Norcio, USA Jennifer Preece, USA Elaine M. Raybourn, USA Douglas Schuler, USA Gilson Schwartz, Brazil Sergei Stafeev, Russia Charalambos Vrasidas, Cyprus Cheng-Yen Wang, Taiwan
Augmented Cognition Program Chair: Dylan D. Schmorrow Andy Bellenkes, USA Andrew Belyavin, UK Joseph Cohn, USA Martha E. Crosby, USA Tjerk de Greef, The Netherlands Blair Dickson, UK Traci Downs, USA Julie Drexler, USA Ivy Estabrooke, USA Cali Fidopiastis, USA Chris Forsythe, USA Wai Tat Fu, USA Henry Girolamo, USA
Marc Grootjen, The Netherlands Taro Kanno, Japan Wilhelm E. Kincses, Germany David Kobus, USA Santosh Mathan, USA Rob Matthews, Australia Dennis McBride, USA Robert McCann, USA Jeff Morrison, USA Eric Muth, USA Mark A. Neerincx, The Netherlands Denise Nicholson, USA Glenn Osga, USA
IX
X
Foreword
Dennis Proffitt, USA Leah Reeves, USA Mike Russo, USA Kay Stanney, USA Roy Stripling, USA Mike Swetnam, USA Rob Taylor, UK
Maria L.Thomas, USA Peter-Paul van Maanen, The Netherlands Karl van Orden, USA Roman Vilimek, Germany Glenn Wilson, USA Thorsten Zander, Germany
Digital Human Modeling Program Chair: Vincent G. Duffy Karim Abdel-Malek, USA Thomas J. Armstrong, USA Norm Badler, USA Kathryn Cormican, Ireland Afzal Godil, USA Ravindra Goonetilleke, Hong Kong Anand Gramopadhye, USA Sung H. Han, Korea Lars Hanson, Sweden Pheng Ann Heng, Hong Kong Tianzi Jiang, P.R. China
Kang Li, USA Zhizhong Li, P.R. China Timo J. Määttä, Finland Woojin Park, USA Matthew Parkinson, USA Jim Potvin, Canada Rajesh Subramanian, USA Xuguang Wang, France John F. Wiechel, USA Jingzhou (James) Yang, USA Xiu-gan Yuan, P.R. China
Human Centered Design Program Chair: Masaaki Kurosu Gerhard Fischer, USA Tom Gross, Germany Naotake Hirasawa, Japan Yasuhiro Horibe, Japan Minna Isomursu, Finland Mitsuhiko Karashima, Japan Tadashi Kobayashi, Japan
Kun-Pyo Lee, Korea Loïc Martínez-Normand, Spain Dominique L. Scapin, France Haruhiko Urokohara, Japan Gerrit C. van der Veer, The Netherlands Kazuhiko Yamazaki, Japan
In addition to the members of the Program Boards above, I also wish to thank the following volunteer external reviewers: Gavin Lew from the USA, Daniel Su from the UK, and Ilia Adami, Ioannis Basdekis, Yannis Georgalis, Panagiotis Karampelas, Iosif Klironomos, Alexandros Mourouzis, and Stavroula Ntoa from Greece. This conference could not have been possible without the continuous support and advice of the Conference Scientific Advisor, Gavriel Salvendy, as well as the dedicated work and outstanding efforts of the Communications Chair and Editor of HCI International News, Abbas Moallem.
Foreword
XI
I would also like to thank for their contribution toward the organization of the HCI International 2009 conference the members of the Human–Computer Interaction Laboratory of ICS-FORTH, and in particular Margherita Antona, George Paparoulis, Maria Pitsoulaki, Stavroula Ntoa, and Maria Bouhli. Constantine Stephanidis
HCI International 2011
The 14th International Conference on Human–Computer Interaction, HCI International 2011, will be held jointly with the affiliated conferences in the summer of 2011. It will cover a broad spectrum of themes related to human–computer interaction, including theoretical issues, methods, tools, processes and case studies in HCI design, as well as novel interaction techniques, interfaces and applications. The proceedings will be published by Springer. More information about the topics, as well as the venue and dates of the conference, will be announced through the HCI International Conference series website: http://www.hci-international.org/
General Chair Professor Constantine Stephanidis University of Crete and ICS-FORTH Heraklion, Crete, Greece Email:
[email protected]
Table of Contents
Part I: Interacting with the World Wide Web Development of a Coloration Support Tool for Making Web Page Screens User-Friendly for Color Blind . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Michiko Anse and Tsutomu Tabe The Persuasive Effects from Web 2.0 Marketing: A Case Study Investigating the Persuasive Effect from an Online Design Competition . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Asle Fagerstrøm and Gheorghita Ghinea
3
10
Formalizing Design Guidelines of Legibility on Web Pages . . . . . . . . . . . . . Fong-Ling Fu and Chiu-Hung Su
17
The Assessment of Credibility of e-Government: Users’ Perspective . . . . . Zhao Huang, Laurence Brooks, and Sherry Chen
26
Auto-complete for Improving Reliability on Semantic Web Service Framework . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Hanmin Jung, Mi-Kyoung Lee, Won-Kyung Sung, and Beom-Jong You
36
Effects of AJAX Technology on the Usability of Blogs . . . . . . . . . . . . . . . . Sumonta Kasemvilas and Daniel Firpo
45
Usability Evaluation of Dynamic RSVP Interface on Web Page . . . . . . . . Ya-Li Lin and Darcy Lin
55
“Online Legitimacy”: Defining Institutional Symbolisms for the Design of Information Artifact in the Web Mediated Information Environment (W-MIE) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Emma Nuraihan Mior Ibrahim and Nor Laila Md Noor Evaluation of Web User Interfaces for the Online Retail of Apparel . . . . . Dominik Rupprecht, Rainer Blum, and Karim Khakzar
65 74
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination on Corporate Discussion Web Sites . . . . . . . . . . . . . . . . . . . . . Shinji Takao, Tadashi Iijima, and Akito Sakurai
84
An Empirical Study the Effects of Language Factors on Web Site Use Intention . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Hui-Jen Yang and Yun-Long Lay
94
XVI
Table of Contents
Part II: Intelligent Techniques for Access to Information and Personalization Enhancing Document Clustering through Heuristics and Summary-Based Pre-processing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Sri Harsha Allamraju and Robert Chun Email Reply Prediction: A Machine Learning Approach . . . . . . . . . . . . . . . Taiwo Ayodele, Shikun Zhou, and Rinat Khusainov An End-to-End Proactive TCP Based on Available Bandwidth Estimation with Congestion Level Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . Sangtae Bae, Doohyung Lee, Chihoon Lee, Jinwook Chung, Jahwan Koo, and Suman Banerjee Smart Privacy Management in Ubiquitous Computing Environments . . . Christian B¨ unnig A Fuzzy Multiple Criteria Decision Making Model for Selecting the Distribution Center Location in China: A Taiwanese Manufacturer’s Perspective . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chien-Chang Chou and Pei-Chann Chang A Hierarchical Data Dissemination Protocol Using Probability-Based Clustering for Wireless Sensor Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . Moonseong Kim, Matt W. Mutka, and Hyunseung Choo An OWL-Based Knowledge Model for Combined-Process-and-Location Aware Service . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Gunhee Kim, Manchul Han, Jukyung Park, Hyunchul Park, Sehyung Park, Laehyun Kim, and Sungdo Ha Human-Biometric Sensor Interaction: Impact of Training on Biometric System and User Performance . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Eric P. Kukula and Robert W. Proctor Representing Logical Inference Steps with Digital Circuits . . . . . . . . . . . . . Erika Matsak
105
114
124
131
140
149
159
168
178
An Interactive-Content Technique Based Approach to Generating Personalized Advertisement for Privacy Protection . . . . . . . . . . . . . . . . . . . Wook-Hee Min and Yun-Gyung Cheong
185
Loopo: Integrated Text Miner for FACT-Graph-Based Trend Analysis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ryosuke Saga, Hiroshi Tsuji, and Kuniaki Tabata
192
Table of Contents
Using Graphical Models for an Intelligent Mixed-Initiative Dialog Management System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Stefan Schw¨ arzler, G¨ unther Ruske, Frank Wallhoff, and Gerhard Rigoll Input Text Repairing for Multi-lingual Chat System . . . . . . . . . . . . . . . . . . Kenichi Yoshida and Fumio Hattori
XVII
201
210
Part III: Visual Interfaces, Visualization and Images Interactive Object Segmentation System from a Video Sequence . . . . . . . Guntae Bae, Sooyeong Kwak, and Hyeran Byun COBRA – A Visualization Solution to Monitor and Analyze Consumer Generated Medias . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Amit Behal, Julia Grace, Linda Kato, Ying Chen, Shixia Liu, Weijia Cai, and Weihong Qian Visual String of Reformulation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Arne Berger, Jens K¨ ursten, and Maximilian Eibl Industrial E-Commerce and Visualization of Products: 3D Rotation versus 2D Metamorphosis . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Francisco V. Cipolla Ficarra, Miguel Cipolla Ficarra, and Daniel A. Giulianelli Evaluating the Effectiveness and the Efficiency of a Vector Image Search Tool . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Patrizia Di Marco, Tania Di Mascio, Daniele Frigioni, and Massimo Gastaldi
221
229
239
249
259
Building and Browsing Tropos Models: The AVI Design . . . . . . . . . . . . . . . Tania Di Mascio, Anna Perini, Luca Sabatucci, and Angelo Susi
269
A Multiple-Aspects Visualization Tool for Exploring Social Networks . . . Jie Gao, Kazuo Misue, and Jiro Tanaka
277
Multi-hierarchy Information Visualization Research Based on Three-Dimensional Display of Products System . . . . . . . . . . . . . . . . . . . . . . Zhou Hui and Hou WenJun Efficient Annotation Visualization Using Distinctive Features . . . . . . . . . . Seok Kyoo Kim, Sung Hyun Moon, Jun Park, and Sang Yong Han Content Based Image Retrieval Using Adaptive Inverse Pyramid Representation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Mariofanna Milanova, Roumen Kountchev, Stuart Rubin, Vladimir Todorov, and Roumiana Kountcheva
287 295
304
XVIII
Table of Contents
Event Extraction and Visualization for Obtaining Personal Experiences from Blogs . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yoko Nishihara, Keita Sato, and Wataru Sunayama
315
Minato: Integrated Visualization Environment for Embedded Systems Learning . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yosuke Nishino and Eiichi Hayakawa
325
Batik KR Semantic Network: Visualizations of Creative Process and Design Knowledge for the Malaysian Batik Designers’ Community . . . . . Ariza Nordin, Nor Laila Md. Noor, and Ahmad Zainuddin
334
A Tool for Analyzing Categorical Data Visually with Granular Representation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Kousuke Shiraishi, Kazuo Misue, and Jiro Tanaka
342
Part IV: Mobile Devices and Services Understanding Key Attributes in Mobile Service: Kano Model Approach . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Seung Ik Baek, Seung Kuk Paik, and Weon Sang Yoo Discovering User Interface Requirements of Search Results for Mobile Clients by Contextual Inquiry . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . David L. Chan, Robert W.P. Luk, Hong Va Leong, and Edward K.S. Ho Evaluation of Pointing Efficiency on Small Screen Touch User Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Ryosuke Fujioka, Takayuki Akiba, and Hidehiko Okada An Integrated Approach towards the Homogeneous Provision of Geographically Dispersed Info-Mobility Services to Mobile Users . . . . . . . Dimitrios Giakoumis, Dimitrios Tzovaras, Dionisis Kehagias, Evangelos Bekiaris, and George Hassapis Legible Character Size on Mobile Terminal Screens: Estimation Using Pinch-in/Out on the iPod Touch Panel . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Satoshi Hasegawa, Masako Omori, Tomoyuki Watanabe, Shohei Matsunuma, and Masaru Miyao
355
365
375
385
395
Location-Based Mixed-Map Application Development for Mobile Devices . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Hyo-Haeng Lee, Kil-Ram Ha, and Kwang-Seok Hong
403
A Comparison of Artifact Reduction Methods for Real-Time Analysis of fNIRS Data . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Takayuki Nozawa and Toshiyuki Kondo
413
Table of Contents
Investigation on Relation between Index of Difficulty in Fitts’ Law and Device Screen Sizes . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Hidehiko Okada, Takayuki Akiba, and Ryosuke Fujioka Influence of Vertical Length of Characters on Readability in Mobile Phones . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Masako Omori, Satoshi Hasegawa, Tomoyuki Watanabe, Shohei Matsunuma, and Masaru Miyao
XIX
423
430
Intelligent Photo Management System Enhancing Browsing Experience . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yuki Orii, Takayuki Nozawa, and Toshiyuki Kondo
439
Freeze TCPv2: An Enhancement of Freeze TCP for Efficient Handoff in Heterogeneous Networks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Minu Park, Jaehyung Lee, Jahwan Koo, and Hyunseung Choo
448
Expanding SNS Features with CE Devices: Space, Profile, Communication . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Youngho Rhee, Hyunjoo Kang, Yeojin Kim, Juyeon Lee, and IlKu Chang Empirical Evaluation of Throwing Method to Move Object for Long Distance in 3D Information Space on Mobile Device . . . . . . . . . . . . . . . . . . Yu Shibuya, Keiichiro Nagatomo, Kazuyoshi Murata, Itaru Kuramoto, and Yoshihiro Tsujino Usefulness of Mobile Information Provision Systems Using Graphic Text -Visibility of Graphic Text on Mobile Phones . . . . . . . . . . . . . . . . . . . Tomoyuki Watanabe, Masako Omori, Satoshi Hasegawa, Shohei Matsunuma, and Masaru Miyao
458
468
476
Part V: eHealth Applications and Services The Importance of Information in the Process of Acquisition and Usage of a Medicine for Patient Safety: A Study of the Brazilian Context . . . . . Patricia Lopes Fujita and Carla Galv˜ ao Spinillo
489
A Proposal of Collection and Analysis System of Near Miss Incident in Nursing Duties . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Akihisa Furukawa and Yusaku Okada
497
Effects of Information Displays for Hyperlipidemia . . . . . . . . . . . . . . . . . . . Yang Gong and Jiajie Zhang Clinical Usefulness of Human-Computer Interface for Training Targeted Facial Expression: Application to Patients with Cleft Lip and/or Palate . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Kyoko Ito, Ai Takami, Shumpei Hanibuchi, Shogo Nishida, Masakazu Yagi, Setsuko Uematsu, Naoko Sigenaga, and Kenji Takada
503
513
XX
Table of Contents
The Evaluation of Pharmaceutical Package Designs for the Elderly People . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Akira Izumiya, Michiko Ohkura, and Fumito Tsuchiya
522
Implications for Developing Information System on Nursing Administration – Case Study on Nurse Scheduling System – . . . . . . . . . . . Mitsuhiko Karashima and Naotake Hirasawa
529
Analysis on Descriptions of Dosage Regimens in Package Inserts of Medicines . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Masaomi Kimura, Kazuhiro Okada, Keita Nabeta, Michiko Ohkura, and Fumito Tsuchiya Non-intrusive Human Behavior Monitoring Sensor for Health Care System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Noriyuki Kushiro, Makoto Katsukura, Masanori Nakata, and Yoshiaki Ito Impact of Healthcare Information Technology Systems on Patient Safety . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Byung Cheol Lee and Vincent G. Duffy Patient Standardization Identification as a Healthcare Issue . . . . . . . . . . . Mario Macedo and Pedro Isa´ıas A Proposal of a Method to Extract Active Ingredient Names from Package Inserts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Keita Nabeta, Masaomi Kimura, Michiko Ohkura, and Fumito Tsuchiya Examination of Evaluation Method for Appearance Similarity of PTP Sheets . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yoshitaka Ootsuki, Akira Izumiya, Michiko Ohkura, and Fumito Tsuchiya Identifying Latent Similarities among Near-Miss Incident Records Using a Text-Mining Method and a Scenario-Based Approach . . . . . . . . . Tetsuo Sawaragi, Kouichi Ito, Yukio Horiguchi, and Hiroaki Nakanishi Patient Safety: Contributions from a Task Analysis Study on Medicine Usage by Brazilians . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Carla Spinillo, Stephania Padovani, and Cristine Lanzoni Remote Consultation System Using Hierarchically Structured Agents . . . Hiroshi Yajima, Jun Sawamoto, and Kazuo Matsuda
539
549
559 566
576
586
594
604 609
Part VI: Education, Learning and Entertainement How Mobile Interaction Motivates Students in a Class? . . . . . . . . . . . . . . . Akinobu Ando and Kazunari Morimoto
621
Table of Contents
XXI
Sensation Seeking, Self Forgetfulness, and Computer Game Enjoyment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Xiaowen Fang and Fan Zhao
632
Development of an Annotation-Based Classroom Activities Support Environment Using Digital Appliance, Mobile Device and PC . . . . . . . . . . Yoshiaki Hada and Masanori Shinohara
642
An Empirical Investigation on the Effectiveness of Virtual Learning Environment in Supporting Collaborative Learning: A System Design Perspective . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Na Liu, Yingqin Zhong, and John Lim
650
Personalization for Specific Users: Designing Decision Support Systems to Support Stimulating Learning Environments . . . . . . . . . . . . . . . . . . . . . . Laura M˘ aru¸ster, Niels R. Faber, and Rob J. van Haren
660
Construction of Systematic Learning Support System of Business Theory and Method . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yoshiki Nakamura and Katsuhiro Sakamoto
669
Learning by Design in a Digital World: Students’ Attitudes towards a New Pedagogical Model for Online Academic Learning . . . . . . . . . . . . . . . . Karen Precel, Yoram Eshet-Alkalai, and Yael Alberton
679
Promoting a Central Learning Management System by Encouraging Its Use for Other Purposes Than Teaching . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Franz Reichl and Andreas Hruska
689
Framework for Supporting Decision Making in Learning Management System Selection . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yuki Terawaki
699
Statistics-Based Cognitive Human-Robot Interfaces for Board Games – Let’s Play! . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Frank Wallhoff, Alexander Bannat, J¨ urgen Gast, Tobias Rehrl, Moritz Dausinger, and Gerhard Rigoll The Design and Development of an Adaptive Web-Based Learning System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Chian Wang
708
716
Part VII: Information Systems in Safety-Critical Domains Human-System Interface (HSI) Challenges in Nuclear Power Plant Control Rooms . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Jo-Ling Chang, Huafei Liao, and Liang Zeng
729
XXII
Table of Contents
The Impact of Automation Assisted Aircraft Separation on Situation Awareness . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Arik-Quang V. Dao, Summer L. Brandt, Vernol Battiste, Kim-Phuong L. Vu, Thomas Strybel, and Walter W. Johnson Separation Assurance and Collision Avoidance Concepts for the Next Generation Air Transportation System . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . John P. Dwyer and Steven Landry Analysis of Team Communication and Collaboration in En-Route Air Traffic Control . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Kazuo Furuta, Yusuke Soraji, Taro Kanno, Hisae Aoyama, Daisuke Karikawa, and Makoto Takahashi Comparison of Pilot Recovery and Response Times in Two Types of Cockpits . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Vishal Hiremath, Robert W. Proctor, Richard O. Fanjoy, Robert G. Feyen, and John P. Young
738
748
758
766
Information Requirements and Sharing for NGATS Function Allocation Concepts . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Nhut Tan Ho, Patrick Martin, Joseph Bellissimo, and Barry Berson
776
HILAS: Human Interaction in the Lifecycle of Aviation Systems – Collaboration, Innovation and Learning . . . . . . . . . . . . . . . . . . . David Jacobson, Nick McDonald, and Bernard Musyck
786
Redefining Interoperability: Understanding Police Communication Task Environments . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Gyu H. Kwon, Tonya L. Smith-Jackson, and Charles W. Bostian
797
Unique Reporting Form: Flight Crew Auditing of Everyday Performance in an Airline Safety Management System . . . . . . . . . . . . . . . . . . . . . . . . . . . . Maria Chiara Leva, Alison Kay, Joan Cahill, Gabriel Losa, Sharon Keating, Diogo Serradas, and Nick McDonald Pilot Confidence with ATC Automation Using Cockpit Situation Display Tools in a Distributed Traffic Management Environment . . . . . . . Sarah V. Ligda, Nancy Johnson, Joel Lachter, and Walter W. Johnson A Study of Auditory Warning Signals for the Design Guidelines of Man-Machine Interfaces . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Mie Nakatani, Daisuke Suzuki, Nobuchika Sakata, and Shogo Nishida Computer-Aided Collaborative Work into War Rooms: A New Approach of Collaboration . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Jeremy Ringard, Samuel Degrande, St´ephane Louis-dit-Picard, and Christophe Chaillou
806
816
826
835
Table of Contents
Optimizing Online Situation Awareness Probes in Air Traffic Management Tasks . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Thomas Z. Strybel, Katsumi Minakata, Jimmy Nguyen, Russell Pierce, and Kim-Phuong L. Vu A Development of Information System for Disaster Victims with Autonomous Wireless Network . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Yuichi Takahashi, Daiji Kobayashi, and Sakae Yamamoto Situation Awareness and Performance of Student versus Experienced Air Traffic Controllers . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Kim-Phuong L. Vu, Katsumi Minakata, Jimmy Nguyen, Josh Kraut, Hamzah Raza, Vernol Battiste, and Thomas Z. Strybel Author Index . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .
XXIII
845
855
865
875
Development of a Coloration Support Tool for Making Web Page Screens User-Friendly for Color Blind Michiko Anse and Tsutomu Tabe Aoyama Gakuin University, Department of Industrial and Systems Engineering, 5-10-1 Fuchinobe, Sagamihara-city, Kanagawa, Japan {anse,tabe}@ise.aoyama.ac.jp
Abstract. Websites are providing more and more information because of their convenience. Information is often discriminated by color vision ability between individuals. Some people cannot discriminate information depending on the coloration. In these cases, information cannot be correctly discerned. Therefore, the development of a supporting tool for configuring screens is needed. Keywords: color blind, web page, coloration support tool.
1 Introduction Difference in color vision between individuals is caused by three types of nerve cells (cone cells that absorb different wavelengths). Persons who have normal chromatic vision perceive color with all three types of cone. Color deficient observers perceive colors at different levels depending on the status of impaired cone function. Color deficient observers include protanopes (red cone does not function), deuteranopes (green cone does not function) and tritanopes (blue cone does not function), which, when only two colors are perceived, is called dichromatic vision. Color deficient observers account for 5% and 0.2% of East Asian males and females, respectively. They account for 8% and 4% of Caucasian males and black males respectively. According to the ratio, one out of 20 Japanese is color deficient, which is a considerable number [1, 2]. Information collection is indispensable in daily life. The spread of the Internet is allowing websites to provide more and more information. The use of colors is effective for emphasizing information to be provided because colors increase image discrimination. Therefore, colors are widely used in websites. However, information dispensed by colors may not be passed on correctly because color vision varies between individuals. We should thus use picturesque colors for passing information, and this information should be able to be understood even by color deficient observers.
2 Methods Offering Support to Make Color Web Page Screens That Can Be Discriminated by Color Blind 2.1 Methods to Simulate Color Vision There are two main methods to simulate the vision of color deficient observers. The first method is to look through a filter to simulate imperfect color vision or to use a M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 3–9, 2009. © Springer-Verlag Berlin Heidelberg 2009
4
M. Anse and T. Tabe
liquid crystal display monitor with a color vision simulating function. The second method is to convert normal color vision to anomalous color vision via VsCheck software, etc, after reading a file on a personal computer. By these methods, we can see what normal color vision looks like when converted into abnormal color vision, allowing us to realize how color deficient observers see things and find our extensive use of colors confusing. 2.2 Methods for Detecting Confusing Colorations Uding (software) can detect confusing colorations displayed by simulation software and change the coloration [3]. ColorSelector (software) determines whether or not a specified combination of colors can be discriminated by color deficient observer [4]. They modify already existing files or determine whether two chosen colors can be discriminated or not. Therefore, they have a disadvantage in that they can be used only after files have been created or require time-consuming work to investigate whether two colors chosen from many combinations can be discriminated. 2.3 A Method for Supporting Coloring-Decisions When Making Web Page Screens Using a color vision simulator or ColorSelector for determining coloration when creating web page screens, is quite troublesome. Therefore, the author has devised a tool that supports the determination of coloration when making web page screens, and has created and verified the prototype.
3 Functions of the Web Page Screen Coloration Support Tool It should be provided as an add-in function of web page creation software. A user selects an area requiring the support of coloration during the creation of a web page. Then, the user calls up the coloration support tool. The functions of the tool consist of “Select color,” “Diagnose” and “Display.” The user can determine coloration with the consideration of color deficient observers by calling up this tool and reflecting the coloration on the screen. This tool helps a user make colorations so that two colors on a background color can be discriminated by color deficient observers. This tool has two modes, one for characters and the other for illustrations only. 3.1 “Select Color” Function A user can select a background color and two colors on the background color from color palette tabs. Each color palette has 216 colors called web-safe colors that appear as almost the same color on both Windows and Macintosh. A user can specify a color he/she wants to use by clicking a color on the color palette or drawing a color out of the screen by using a dropper. A user selects a combination of colors, for example, “background and character color” whose coloration the user wants to evaluate. The color of any character which is inappropriate for the selected background color is
Development of a Coloration Support Tool for Making Web Page Screens User-Friendly
5
crossed out on the tab. Character colors which are appropriate for the selected background color, yet requiring some caution are checked with a triangular symbol. Color combinations which are deemed to be inappropriate for even one color vision out of the four types are also crossed out. 3.2 “Diagnosis” Function In the “Select color” mode, the color palette displays whether color combinations are appropriate or not. After determining the background color, and colors 1 and 2, visibility by the four vision types is diagnosed. The result is displayed by circle (appropriate), triangle (Due consideration is required though it is not inappropriate) and cross (inappropriate). The value of RGB of persons with normal color vision displayed on the color palette is converted to the value of RGB of the other three types of vision and saved in the table in order to diagnose colorations in the four types of color vision. The RGB value is used in the calculations listed below. In the diagnosis, combinations of colors are determined to be appropriate if they meet certain standards (i.e., differences in brightness, luminance and color). Other combinations are determined to be inappropriate. Color combinations with a color difference of 500 or more and a brightness difference of 96 through 125 are determined that caution be exercised, though they are not inappropriate. In WCAG, when the RGB of two colors is assumed to be (R1, G1, B1) and (R2, G2, B2), if the conditions listed below are met, the two colors are considered to be discriminated from each other concerning brightness and color difference. However, the WCAG standard is too strict and the number of usable colors becomes too small. Thus, in this study, among combinations of colors with a color difference of 500 or more, it was ascertained that the brightness difference can be alleviated to 96 in an experiment, expanding the range of options. In WCAG, Brightness difference, Contrast ratio and Color difference are defined as these expressions (1), (2) and (3) [5]. Brightness difference: ((R1 - R2) * 299 + (G1 - G2) * 587 + (B1 - B2) * 114 ) / 1000 ≥ 126 . Contrast ratio: (L1+0.5) / (L2+0.5) ≥ 5 . Where L1=max(((R1 / 255) ^ 2.2*0.2126 + (G1 / 255) ^ 2.2 * 0.7152 + (B2 / 255) ^ 2.2 * 0.0722), ((R2 / 255) ^ 2.2 * 0.2126 + (G2 / 255) ^ 2.2 * 0.7152 + (B2 / 255) ^ 2.2 * 0.0722) L2=min(((R1 / 255) ^ 2.2 * 0.2126 + (G1 / 255) ^ 2.2 * 0.7152 + (B2 / 255) ^ 2.2 * 0.0722), ((R2 / 255) ^ 2.2 * 0.2126 + (G2 / 255) ^ 2.2 * 0.7152 + (B2 / 255) ^ 2.2 * 0.0722) Color difference: (max (R1, R2) – min (R1, R2)) + (max (G1, G2) – min (G1, G2)) + (max (B1, B2) – min (B1, B2)) ≥ 500 .
(1)
(2)
(3)
6
M. Anse and T. Tabe
Fig .1. shows the methods of the diagnosis to appropriate combinations of colors.
Fig. 1. The flow of the diagnosis to appropriate combinations of colors
3.3 “Display” Function First, colors selected by the color palette are judged whether they are appropriate or not. Second, the vision of color deficient observers is simulated. Third, the coloration is determined to be appropriate or not. Finally, coloration of the selected area is replaced with a new one on the web page screen being created. The area that was saved is colored by the background color. The other two areas are colored by a new coloration. They are put to the original position to make an image with the new coloration.
4 Tools This study has two types of coloration support tool. One is for the area including characters. The other is the area consisting of only images. The number of target areas is limited to three. If there are four or more areas, this tool must be used repeatedly. Each tool has tabs for each area. A tab has a color palette which displays whether the
Development of a Coloration Support Tool for Making Web Page Screens User-Friendly
7
coloration is appropriate or not. A user can select combinations of colors which are deemed to be appropriate from the color palette or select colors from the screen by using the dropper function. A user can understand the vision parameters of selected combinations of colors by the color deficient observers. He/she can understand whether the coloration on the selected areas is appropriate or not by the four vision types. Selected areas can be colored with the coloration. 4.1 Tool for Characters A user selects an area including a character string and background to be colored. Then, the user calls up the coloration support tool. The selected area is displayed on the tool. The coloration support tool has three tabs. The first tab is for the color of the characters. The second tab is for the background color which surrounds the color of the characters. The third tab is for the color which surrounds the background color. A user can specify a color from 216 colors from the color palette on the tab. A user can also use a dropper to select a color from the screen being created. After selecting a color, a user can display the vision seen by a normal color observer, protanope, deuteranope and tritanope by the “Reproduce defective color vision function.” The “Diagnose” function displays the evaluation (i.e., circle, triangle and cross) of the total color combination by the color vision. The “Reflect on screen” function draws the selected color combination on the selected area on the web page screen. Fig. 2. shows the main and sub screens of the character coloration support tool.
Fig. 2. Character coloration support tool
8
M. Anse and T. Tabe
4.2 Graphic Drawing Tool A user selects an area which he/she wants coloration support. Then, the user calls up the graphic drawing coloration support tool. The user selects the background color, and first and second color. Then, visibility of the two specified colors by the four color vision types is displayed on the tool. The originally selected image is displayed in a separate window. The window has three buttons denoting the defective color combinations above them. Pressing the button displays a window with the coloration corresponding to the “visibility” of each color combination. The user selects a tab and a new color to exchange with the first color. Then, selecting the second color tab displays compatibility with the new first color using symbols (no symbol, triangle and cross). The user selects a color other than the colors with the cross symbol. Presses “See all” to open a window with the selected coloration. Presses buttons in the window to check the vision by the color deficient observers. After determining a satisfactory combination, presses “Diagnose” to check the vision by the four color visions. If all color visions have no problem (circle), presses “Reflect on screen” to re-draw the coloration of the original graphic. Fig. 3. shows the main and sub screens of the Graphic coloration support tool.
Fig. 3. Graphic coloration support tool
Development of a Coloration Support Tool for Making Web Page Screens User-Friendly
9
5 Verification of Effectiveness A test was performed to draw graphics which can be discriminated by color deficient observers by using the character coloration tool and graphic drawing coloration tool. Subjects included 20 university students (males: 8, females: 12). Subjects were made to understand color vision deficiency by reading a manual. Then, they were ordered to make two screens by using the tools. After the test, the vision by color deficient observers was displayed by using a color vision simulator to check whether coloration that could be discriminated by color deficient observers was made or not. Two color deficient observers were ordered to view the screens made by all the subjects. It was proven that the coloration had no problem. Therefore, all subjects could make graphics which could be discriminated by color deficient observers. All subjects answered that the tool had supported them. Some subjects answered that the tool was difficult to use. As a result, the functions selected for developing this “web page screen preparation support tool in consideration of color deficient observers” are appropriate.
6 Conclusions We are not really aware that color deficient observers account for approximately 5% of the total population. It is understood that normal color observers can enjoy rich expressions of various color while color deficient observers cannot enjoy them as readily. As W3C proposed, we should be careful not to express information that is dependant solely on colors. We should use easy tools to make coloration in consideration of color deficient observers, especially when creating highly public information websites. For that purpose, we should develop tools to support coloration in combination with existing software. Acknowledgements. The author sincerely appreciates Ms. Saori Azuma and Ms. Kazuko Sato who graduated in 2007 from the Department of Industrial and Systems Engineering, College of Engineering and Science, Aoyama Gakuin University for their considerable contribution to this study.
References 1. 2. 3. 4.
Ikeda, M.: Basic Color Engineering. Asakura shoten, Tokyo (2000) Fukami, K.: Color Discrimination. Kanehara-shuppan, Tokyo (2003) UDing, http://www.toyoink.co.jp/ud/index.html Color Selector, http://jp.fujitsu.com/about/design/ud/assistance/ colorselector/ 5. Techniques For Accessibility Evaluation And Repair Tools W3C Working Draft, April 26 (2000), http://www.w3.org/TR/AERT
The Persuasive Effects from Web 2.0 Marketing: A Case Study Investigating the Persuasive Effect from an Online Design Competition Asle Fagerstrøm1 and Gheorghita Ghinea2 1
The Norwegian School of Information Technology, Schweigaardsgt. 14, 0185 Oslo, Norway
[email protected] 2 School of Information Systems, Computing and Mathematics, Brunel University, Uxbridge UB8 3PH, London, United Kingdom
[email protected]
Abstract. This case study investigates the effect from a Web 2.0 campaign, an online design competition, accomplished by a company that produces and marketed feminine care products (sanitary towels). The target segment for the campaign was girls in four Nordic countries, in the age between 14 and 25. The main characteristic for the target segment is that they are not much interested in the product category. Our interpretation is that the online design competition had a persuasive effect towards the target segment. By using the internet in an interactive and social way, companies can achieve brand awareness and create a positive attitude towards a brand in low-involvement segments. Suggestions for further research are given. Keywords: Web 2.0, Interactivity, Persuasion, Involvement, Interactive marketing.
1 Introduction Web 2.0 can be used to do what traditional advertising does: to push information to persuade consumers to buy products or services. For example, a company may implement a blog on its web site and regularly publish information about products and their benefits. However, according to Parise et. al. [1] that kind of approach misses the point of Web 2.0. Instead, companies should use the Web 2.0 tools to get the consumers involved. To investigate to what extent Web 2.0 marketing has the ability to influence the target segments’ intentional effort, we used the elaboration likelihood model (ELM) of persuasion as a guide to data analysis and interpretation. The ELM, developed by Petty et al. [2], is based on the idea that attitudes are central in guiding the consumer’s decisions and other behaviors. While attitudes can result from a number of cues in the consumers setting, persuasion is a primary source. The ELM framework suggests that important variations in the nature of persuasion are a function of the likelihood that receivers will engage in elaboration of (thinking about) information relevant to the persuasive issue [2]. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 10–16, 2009. © Springer-Verlag Berlin Heidelberg 2009
The Persuasive Effects from Web 2.0 Marketing
11
By investigating the persuasive effect from interactive and social campaign companies could better understand why Web 2.0 communication works, and as a result increase their benefits from marketing activities online. This paper is structured as follows: In the first section we give a presentation of present studies on the effect from online interactive and social marketing. Second, there will be a short presentation of the ELM framework. Third, based on a case study we discuss the persuasive effect that the Web 2.0 marketing may have had on the target segment. Finally, our last section contains concluding comments on the use of Web 2.0 activities to influence consumers’ intention to purchase by means of interactive and social marketing. Suggestions for further research are given.
2 Related Work Web 2.0 is a term that is used to describe changing trends in the use of World Wide Web technology and web design. The term was introduced for the first time in 2004 by Dale Dougherty, a web pioneer and O´Reilly VP, at a conference brainstorming session between O´Reilly and MediaLive International. Web 2.0 is, according to Tim O´Reilly, the business revolution in the computer industry caused by the move to the Internet as platform, and an attempt to understand the rules for success on that new platform. The rules for success entail using the Internet in a interactive and social way [3]. Most authors focus on describing the way of using Web 2.0 in interactive online campaigns in general [e.g. 4]. However, little has been done to explain the persuasive effect that Web 2.0 marketing has toward consumers. Hoffman and Novak [5] point out that the Web frees customers from their traditional passive role as receivers of marketing communications, gives them much greater control over the information search and acquisition process, and allows them to become active participants in the marketing process. The unique forms of interactivity, “machine interaction” and “personal interaction” respectively, have contributed to a rapid diffusion of the Web as a commercial medium in the last several years [5]. Interactivity can be conceptualized from various scopes. For example, Ghose and Dou [6] conceptualize interactivity from a marketing perspective, identifying 23 functions of interactivity mainly driven by communication-based conceptualization of interactivity. Another example is Ha and James [7] who conceptualize interactivity from an interpersonal communication perspective focusing on interactivity as communication, either through a medium or without the aid of a medium. The latter conceptualization of interactivity will be used in this paper as basis for discussion and interpretations. Some studies have examined the effect of interactivity on companies’ web sites. Accordingly, Coyle and Thorson [8] did an experiment on the effect of interactivity and vividness on commercial web sites. Results show that perception of telepresence (simulated perception of direct experience) grew stronger as levels of interactivity and levels of vividness in web sites increased. In a study on the attractiveness of a web site, Ghose and Dou [6] found that the greater the degree of interactivity, the more likely it is for the company’s web site to be considered as a top site. In addition, they find that the “customer support” component of interactivity has a significant positive
12
A. Fagerstrøm and G. Ghinea
impact on the likelihood of a company’s web site being included in a list of highquality web sites. Interesting studies have been done on the effect from interactivity. On the other hand, none of these studies investigate the persuasive effect that interactivity has on the consumer’s intention to purchase a brand.
3 The Elaboration Likelihood Model According to O`Keefe [9], persuasion can be defined as: “a successful intentional effort at influencing another’s mental state through communication in a circumstance in which the persuaded has some measure of freedom.” The ELM, developed by Petty et al. [2], is a theory that proposes a global view of how attitudes are formed and changed. The basic idea is that the receivers (e.g. online consumers) will vary in the degree to which they are likely to engage in elaboration (thinking about) of information relevant to the persuasive issue. For example, when information becomes more personally relevant, consumers are willing to engage in extensive issue-relevant thinking. They will pay attention to a specific web site or an online campaign, evaluate thoroughly the information that is presented, and, recall from memory other issues that are relevant to the specific situation. However, sometimes when the information is not personally relevant, consumers will not undertake much issuerelevant thinking and display relatively little elaboration. The degree to which consumers engage in issue-relevant thinking forms a continuum, from cases of extremely high elaboration to cases of little or no elaboration. The ELM suggests that important variations in the nature of persuasion are a function of the likelihood that receivers will engage in elaboration of information relevant to the persuasive issue. Two types of persuasion process can be engaged depending on the degree of elaboration [2]: a central route involving systematic cognitive thinking and a peripheral route involving cognitive shortcuts. The central route to persuasion represents the persuasion processes involved when elaboration is relatively high, and persuasion is achieved through the consumer’s thoughtful examination of issue-relevant considerations. The peripheral route is the persuasion processes involved when elaboration is relatively low. When persuasion is achieved through peripheral routes it usually comes about because the consumer uses some simple decision rules to evaluate the advocated position. For example, the consumer may be guided by whether they like the color or the design of the web site. That is, the consumer may rely on peripheral cues as guide to attitude, rather than to engage in extensive issue-relevant information processing.
4 Case: An Online Design Competition Our research has an inductive approach which indicates that we gather empirical data without having a hypothesis in advance. Because it is difficult to separate the object to be studied from its context, we found that a case study was an appropriate method to use [see 10]. The rationale for this choice is also that the case study is suitable for investigating up-to-date processes or behaviors of others, which happen in their reallife context but are little known [11]. The key to successfully designing a case study is
The Persuasive Effects from Web 2.0 Marketing
13
to have developed beforehand a theoretical proposition to guide data collection and data analysis [10]. A company that had accomplished a Web 2.0 campaign was chosen. The company produces and marketed feminine care products (sanitary towels) in 85 countries worldwide. In Europe the products occur under the brand name Libresse™. Besides demographics (gender and age) the company reported that there are two main characteristics of the target segment for feminine care products: first the consumer often stick to the brand she decides to choose first time, and, second the consumer is not much interested in the product category (sanitary towels). This is a challenging situation for the marketing department of Libresse™. To be able to achieve brand awareness and attitude towards the brand the company accomplished additional research to better understand the target segment. Results from the market research (survey and focus groups) show that the target segment has varying interests. However, fashion design was one of the most dominant interests reported by the respondents. As many as 25 % of the respondents, age 14 to 25, reported that they want to work with fashion and design. The owner of Libresse™ sees this as an opportunity for their 2007 campaign. A two month online design competition was created as the main communication activity in the campaign toward the Nordic segment (Iceland was not included). The other communication channel that was part of the campaign was print, TV and stores. Libresse™ did also create a package design exclusively for the online design competition. The target segment was invited to design a pair of underpants on the Libresse™ web site. The competition was open for each and everyone but the main target segment was girls between 14 and 25 years of age. Girls who were attracted to the invitation were able to use a design tool to choose color and patterns for their underpants (see figure 1). With help of the drawing program, she could create the submission by choosing between templates, complete figures, and by freehand drawing. The Libresse™ brand name was strategically placed on the top left of the web site. The web site also presented the jury and the attractive prizes. When the consumer was satisfied with the underpants design, she could submit it on the Libresse™ web site and join the design competition. However, she could also
Fig. 1. Design tool on Libresse™ web page
14
A. Fagerstrøm and G. Ghinea
invite friends by Facebook™ to vote for her design underpants. If she didn’t want to design a pair of underpants, she could vote for her favorite pattern, and in addition send it as a postcard. Every week the winner in each country was lining up for the final. The winner of the design competition obtains a sum of money and, even more important, her underpants were launched in 180 JC™ stores around the Nordic countries. So, the dream of being a fashion designer could be realized on Libresse™ web site.
5 Campaign Outcomes One goal that Libresse™ had for the campaign was to increase the number of visitors to each country’s website by 25 %. In total (see figure 2), the number of visitors increased from 277 657 to 483 036, in other words, an increase of 205 379 visitors (+ 74 %). The time consumers spent at the web site also increased by 60 % from approximately 12 minutes to 19 minutes.
Fig. 2. Visitors at Libresse™ web site
The response from the target segments was enormous. As much as 90 000 underpants were designed and submitted to the design competition by girls in the Nordic countries (see figure 3). Sweden had the highest participation with 40 500 submitted underpants. Norway was second with 17 100, and then Denmark and Finland with both 16 200 submitted underpants. Impact-wise, the media impact was extremely strong, especially the digital. Within the blog world, the competition was one of the major topics during the summer 2007. In regard to sale, Libresse™ also witnessed an increase in sale in the campaign period.
The Persuasive Effects from Web 2.0 Marketing
15
Fig. 3. Numbers of submissions in Nordic segments
6 Discussion The increase in sale in the campaign period can be explained by means of the ELM. The ELM is based on the idea that under different conditions, receivers will vary in the degree to which they are likely to engage in elaboration of information relevant to the persuasive issue [2]. The basic idea is that consumers are more likely to carefully evaluate the attributes of a product when the purchase is of high relevance to them. Conversely, the likelihood is great that consumers will engage in a very limited information search and attribute evaluation when the product holds little relevance or importance to them. The target segment of Libresse™ reported that they are not much involved in the product category (feminine care products). Their engagement in information search and attribute evaluation will therefore most probably be limited. As presented in the introduction, ELM makes a distinction between two routes to persuasion [2]: a central and a peripheral route. The central route to persuasion represents the persuasion processes involved when elaboration is relatively high, and the peripheral route represents the persuasion processes involved when elaboration is relatively low. According to Petty et al. [2] attitude changes that occur via the peripheral route occur because the attitude issue or object is associated with positive or negative cues. In the Libresse™ design competition campaign, brand awareness and a positive attitude towards the brand are most probably achieved because the brand Libresse™ is associated with fashion design (positive cues). The peripheral route to persuasion can explain the brand awareness, positive attitude towards the brand, and finally, increase in sale for Libresse™ in the campaign period.
7 Conclusion This case study has demonstrated that the peripheral route to persuasion strategy can be realized with the support of Web 2.0 marketing towards low-involvement
16
A. Fagerstrøm and G. Ghinea
consumers. By using the Internet in an interactive and social way, companies can achieve brand awareness, positive attitude towards a brand, and finally, increase in sales in the target segment. This study is not without limitations. One limitation is its lack of empirical data. Its interpretative design has obvious limitations, especially with regards to internal validity (to what extent the interactive design competition is a cause to the increase in sales). In spite of the limitations, the online marketing implication of the ELM is apparent: when planning an online campaign, companies should consider to what extent the target segments are involved in the product category. A follow up study could be to conduct an experiment which would increase validity regarding causal conclusions. Another follow up study could be to investigate the persuasive effect of Web 2.0 marketing towards high-involvement consumers. To what extent can companies use Internet in an interactive and social way toward target segments that are likely to engage in elaboration of information relevant to the persuasive issue? A third follow up study could be to replicate the present study in different contexts and see if it gives the same results.
References 1. Parise, S., Guinan, P.J., Weinberg, B.D.: The Secrets of Marketing in a Web 2.0 World. The Wall Street Journal (2009) 2. Petty, R.E., Cacioppo, J.T., Schumann, D.: Central and Peripheral Routes to Advertising Effectiveness: The Moderating Role of Involvement. Journal of Consumer Research 10(2), 135–146 (1983) 3. O’Reilly, T.: What Is Web 2.0: Design Patterns and Business Models for the Next Generation of Software. Communication & Strategies, First Quarter (1), 17–37 (2007) 4. Moran, M.: Do It Wrong Quickly: How the Web Changes the Old Marketing Rules. IBM Press, Upper Saddle River (2008) 5. Hoffman, D.L., Novak, T.P., Chatterjee, P.: Commercial scenarios for the Web: Opportunities and challenges. Journal of computer-mediated communication 3(3) (1995) 6. Ghose, S., Dou, W.: Interactive functions and their impacts on the appeal of internet presence site. Journal of Advertising research 38, 29–43 (1998) 7. Ha, L., Lincoln, J.E.: Interactivity reexamined: A baseline analysis of early business Web sites. Journal of Broadcasting & Electronic Media 42(4), 456–473 (1998) 8. Coyle, J.R., Thorson, E.: The Effects of progressive levels of interactivity and vividness in web marketing sites. The Journal of advertising 30(3), 65–77 (2001) 9. O’Keefe, D.J.: Persuasion: Theory & Research, 2nd edn. Sage Publications, Inc., London (2002) 10. Yin, R.K.: Case study research: Design and Methods, 3rd edn. Applied social research methods series, vol. 5. Sage publications, Thousand Oaks (2003) 11. Amaratunga, D., et al.: Quantitative and qualitative research in the built environment: application of “mixed” research approach. Work Study 51(1), 17–31 (2002)
Formalizing Design Guidelines of Legibility on Web Pages Fong-Ling Fu and Chiu-Hung Su Department of Management Information Systems, National Cheng-chi University, Taipei 11605, Taiwan
[email protected],
[email protected]
Abstract. Screen design of web pages is challenging because web pages contain lot of icons, consisting not only of texts with various fonts but also graphics with different sizes and content. The objectives for screen design of a web page can be either to provide aesthetic beauty, to convey complex information, to improve legibility, or some combination of the above. This study chooses to formalize design guidelines of legibility because information is becoming more and more complicated in web pages and hampering the efficiency of information searching. This study proposes six measurements of screen legibility: screen ratio of navigator to content, font size variety, variety of icon types, color contrast between background and foreground, content density, and number of alignment points. These six factors were then use to measure the legibility effectiveness of the startup page on four different yahoo.com sites. Combined with the results from a survey study, we concluded that all six factors were validated to be attributes with a significant and measurable impact on web site legibility. Keywords: Guidelines of Web pages, Web pages design, Screen layout design, Legibility design, Complexity measurement.
1 Introduction A Web site is like a big house: it should be firm in its basic structure (e.g. secure and stable), should be functionally convenient (e.g. easy to use), and should be a delight to use [6], [16]. Proper interface design helps all the above needs to be satisfied. Screen design is very challenging because a web page contains lot of icons, which consist of not only texts with various forms but also graphics with different sizes and contents [13], [14]. The objectives for screen design of a web page can be either to provide aesthetic beauty, to convey complex information, to improve legibility, or some combination of the above [14]. Among them, previous studies seem to have been more focused on aesthetics. This study chooses to formalize design guidelines of legibility because information is becoming more and more complicated in web pages and hampering the efficiency of information searching. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 17–25, 2009. © Springer-Verlag Berlin Heidelberg 2009
18
F.-L. Fu and C.-H. Su
2 Experimental Design The objectives of a Web site design are influenced by its tasks [18]. There are three different types of Web sites based on the nature of the tasks: pleasure-oriented (hedonic), productivity-oriented (utilitarian), or hybrid [21], [8], [19]. At one end of the continuum, Web sites that provide solutions to problems and are typically visited out of necessity to effectively support utilitarian tasks [19]. Utilitarian tasks would include many e-shopping behaviors such as information searching, analysis, comparison, and evaluation. In such situations, users would like to accomplish their tasks effectively and efficiently. At the other end of the continuum, Web sites that are experiential, entertaining, and gratifying to the senses effectively support more hedonic tasks such as games[19]. Along the continuum between utilitarian and hedonic Web sites, there are also hybrid Web sites with most e-retailers supporting both task types [19] [21]. The more emphasis placed on hedonic importance, the more influence by aesthetic design of interface. On the other hand, the more emphasis placed on utilitarian importance, the more influence by efficiency on information searching [19]. Therefore, to validate the measurements of legibility, this study selected four startup screens of four Yahoo websites from Japan, USA, Taiwan, and Korea as controls to the same task. The home page of any website can be quite large, but when entering the site, the initial content to display is limited to whatever fits into the space of the user’s screen; this is what is referred to as the “startup screen” in our experiment. The startup screen
Fig. 1. Startup screen and structure model of yahoo.com.jp
Fig. 2. Startup screen and structure model of yahoo.com
Formalizing Design Guidelines of Legibility on Web Pages
19
Fig. 3. Startup screen and structure model of yahoo.com.tw
Fig. 4. Startup screen and structure model of yahoo.com.ka
of the Yahoo.com used in four different countries, and each of their structure models are listed below in Fig. 1 to 4. The unit of web page measured is a ‘block’ which is represented as a rectangle in the structure model [4]. To formulize the Design Guidelines of Legibility on Web pages, we based our experiment on the findings and results of previous research into this topic. A summary of the key findings from previous research is provided below: (1) Legibility of screen ratio (LR) involved the ratio of navigator/content with best performance achieved using a 23/77 ratio [20]. In terms of the magnitude or size of the LR, the closer to the perfect ratio the better the results, as shown by the following analysis: LR = 1/
|W
nav
- 23
| ∈ [0,1]
(1)
where Wnav is the width ratio of navigator to total screen. (2) Legibility of font size variety (LS) is based on the Principle of Economy - a careful and discreet use of display elements to get the message across as simply as possible [3]. LS involved the categorization of elements into groups according to actual physical size and variation in those sizes [5]. LS =
1 nsize
∈ [0,1]
where nsize is the number of sizes and n is the total number of objects.
(2)
20
F.-L. Fu and C.-H. Su
(3) Legibility of density (LD) is the extent to which the screen is filled with objects [4].
∑a LD= 1 − 2 n
i
i
a frame
∈ [0,1]
(3)
where ai and aframe are the areas of object i and the frame, respectively; and n is the number of objects on the frame. (4) Legibility of alignment (LA): In order to achieve simplicity on the screen, the smaller the number of alignment points, the better [17], [9]. LA =
( n vap
3 ∈ [0,1] + n hap + n )
(4)
where nvap and nhap are the numbers of vertical and horizontal alignment points, respectively; and n is the number of objects on the frame [3]. (5) Legibility of icon type (LI): Graphic ingredients enabled considerable presentation enhancements, making screens easier to understand and use [2]. Every icon was perceived as an information unit. Icons with same size and font were perceived as one type of icon. Every graph icon is different from others because graph icons contain different graphs and texts with different size, color, or font. LI =
1 ntype
∈ [0,1]
(5)
where ntype is the number of sizes and n is the total number of objects. (6) Legibility of color contrast (LC): The combination of colors that had higher levels of contrast between background and foreground (BW, YB) generally led to better performance than combinations of lower contrast [7], [12], [1]. Color design is better when simple, not exceeding more than 4 per screen [15]. Also, the impact of color on
Fig. 5. I.R.I 116 Palette [23]
Formalizing Design Guidelines of Legibility on Web Pages
21
visualization depends on the area size which the color is used [10], [11]. Therefore, the formula for calculating LC is as follows: LC =
∑ C × A − ∑ C × A ∈ [0,1] 4
n
i
i
i
5
(6)
i
i
where Ci is the degree of contrast between background and foreground and Ai is the % of icon area in the web page. According to I.R.I 116 palette, the contrast of the hues was classified as either identity, similarity, analogous, contrast, blur, contrast or complementary (fig. 5). The researchers set the degree of contrast Ci as: identity is 0, similarity is 0.2, analogous is 0.4, blur 0.6, contrast 0.8 and complementary 1,
3 Results The indicators of legibility, LR, LS, LI, LC, LD, and LA are calculated based on formulae 1 to 6 as mentioned above, and the legibility results for each of the four web pages are shown in the following six tables. Table 1. LR of four web pages
Japen
USA
Taiwan
Korea
% area of navigator
17
15
16
15
% area of Content
77
79
78
79
0.203
0.142
0.167
0.142
LR
Table 2. LS of four web pages
Japen
USA
Taiwan
Korea
n
145
109
146
146
nsize
40
52
55
66
LS
0.025
0.019
0.018
0.015
Taiwan
Korea
Table 3. LI of four pages
Japen
USA
ntype
47
62
69
81
n
145
109
146
146
LI
0.021
0.016
0.014
0.012
22
F.-L. Fu and C.-H. Su Table 4. LC of four pages
Japen
USA
Taiwan
Korea
C1, W1
0.099
0.095
0.104
C2, W2 C3, W3
0.051 0.017
0.025 0.015
0.035 0.027
0.130 0.026
C4, W4
--
0.006
0.007
C5, W5
--
0.009
LC
0.167
0.132
--
0.012 0.010 --
0.173
0.178
Table 5. LD of four pages
Japen
USA
Taiwan
Korea
270353
243785
281157
976 665
976 665
976 665
288123 976
Σaframe
649040
649040
649040
649040
LD
0.167
0.249
0.134
0.112
Σai area width area high
665
Table 6. LA of four web pages
Japen
USA
Taiwan
Korea
nhap
53
61
71
79
nvap
63
69
75
n nhap + nvap + n
145 261
109 239
146 292
61 146 286
LA
0.011
0.013
0.010
0.010
A summary of the legibility values is shown in Table 7. According to the average of all the legibility values, we consider Yahoo Japan to be the best; it got the highest values in LR (ratio of navigator/content), LS (font size variety), and LI (icon type variety). The Yahoo USA Web page came in second; it got highest values in LD (density) and LA (alignment). Yahoo Taiwan is a little lower than the previous two while Yahoo Korea ranks last.
Formalizing Design Guidelines of Legibility on Web Pages
23
Table 7. Summary of legibility of four web pages
indicator
Japen
USA
Taiwan
Korea
LR
0.203
0.142
0.167
0.142
LS
0.025
0.019
0.018
0.015
LI
0.021
0.016
0.014
0.012
LC
0.167
0.132
0.173
0.178
LD
0.167
0.249
0.134
0.112
LA
0.011
0.013
0.010
0.010
average
0.099
0.095
0.086
0.078
rank
1
2
3
4
Research into information systems has proposed that the solution to managing complexity is to include enough variety in the attributes of the system’s basic elements. By manipulating attributes such as position, size, icon type and color, web elements are allowed to be distinguishable yet grouped. The other important factor is how strongly and in how many different ways these groups can be related to the task at hand, such as density and alignment in the study performed by Xing [22]. Based on the data in Table 7, we consider the Yahoo Japan home page to be the best at providing distinctiveness to the web page elements (block) through variety in position of navigator (index), text size, and icon type. Yahoo USA also provided stronger relations to group the blocks, through density and alignment, than the other websites included in this study.
4 Survey A survey study was conducted to test the robustness of the formulae for legibility using model screens. The subjects who judged the legibility of actual screens comprised of 64 undergraduate student volunteers from a university in Taiwan who each took the course “Introduction of software”. The subjects consisted of 26 males and 38 females; the average age was 29.2 years old, with 35 majoring in business, 1 computer science major and 28 others. The average previous experience on web is 7.8 years. The average web usage per week was 20.6 hours. The questionnaire contained pictures of the Web pages of Fig. 1-4 and questions regarding the rating the legibility of pair on figures. For each pair, viewers assigned a numerical value between one and nine, indicating their perception of the Web pages’ difference in legibility. Value of five meant no difference between the pair. Values from one to four represented “very much distinct clear and legible”, “distinct clear and legible”, “more clear”, and “a little clear” the former compared to the latter respectively. Values from six to nine represent the degree of legibility which the latter is better than the former. The means and standard deviations of viewer’s judgment are listed in Table 8.
24
F.-L. Fu and C.-H. Su Table 8. Statistics of the pair comparisons
Japan Korea Taiwan USA
Japan Mean (S.D.) -2.81 (1.7) 3.32 (1.7) 5.64 (1.7)
Korea Mean (S.D.) 6.19 (1.7) -5.98 (1.7) 7.03 (1.6)
Taiwan Mean (S.D.) 5.68 (1.7) 3.02 (1.7) -6.29 (1.6)
USA Mean (S.D.) 3.36 (1.7) 1.97 (1.6) 2.71 (1.6) --
The values of comparisons in Table 8 indicates that Yahoo Korea is the worst, Yahoo Taiwan is worse than Yahoo USA and Yahoo Japan, but better than Yahoo Korea. Yahoo USA and Yahoo Japan are better than the other two and Yahoo Japan is a little better than Yahoo USA. The order of legibility from best to worst is USA Japan > Taiwan > Korea. The results of viewers’ judgments on legibility almost resemble those obtained using the measures proposed by the above formulae, with the exception of Yahoo Japan. The mean score of legibility of Yahoo Japan was 0.099 and that of Yahoo USA was 0.095. We can ignore the difference between the web pages Yahoo USA and Japan because it is very small. Based on the similar results generated, we conclude that the proposed formulae are valid.
≧
5 Conclusions Web site designers are in need of practical guidelines on how to create and measure effective design. This study proposed six measurements of screen legibility: ratio of navigator to content size, font size variety, variety of icon type, color contrast between background and foreground, content density, and number of alignment points. The former four are the factors that help the viewers to distinguish differences in the blocks on a web page, and the last two help the viewers to connect the groups of blocks to a function or task. All of them are useful for decreasing information complexity. Utilizing these six legibility factors to evaluate display pages of four international yahoo.com sites, we calculated the legibility ranking, in order from most legible to least, to be: USA, Japan, Taiwan, Korea. We then conducted a survey with real human users to verify the theoretical results, finding our theoretical projections to be a validate match to recorded human opinion. Yahoo Japan was effective in providing variety in: position of navigator, font size and icon type. Yahoo USA was effective in providing connections between groups using space and alignment. In the end, we can conclude each of the six legibility factors contains a real and significant impact on web page legibility. As legibility is more important for utilitarian and hybrid web sites, and aesthetics is more important to pleasure-oriented web sites, further studies can help advance understanding of the relationship and complementary nature between aesthetics and legibility.
Formalizing Design Guidelines of Legibility on Web Pages
25
References 1. Bedrogi, P.: Chromaticity Contrast in Visual Search on the Multi-colour User Interface. Displays 24, 39–48 (2003) 2. Ch’ng, E., Ngo, D.C.L.: Screen Design: a Dynamic Symmetry Grid Based Approach. Displays 24, 125–135 (2003) 3. Ngo, D.C.L., Teo, L.S., Byrne, J.G.: Formalising Guidelines for the Design of Screen Layouts. Display 21, 3–15 (2000) 4. Dong, Y., Ling, C., Hua, L.: Effect of Glance Duration on Perceived Complexity and Segmentation of User Interfaces. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 605–614. Springer, Heidelberg (2007) 5. Fu, F.L., Su, C.H.: Measuring the Screen Complexity on Web Pages. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4558, pp. 720–729. Springer, Heidelberg (2007) 6. Kim, J., Lee, J., Han, K., Lee, M.: Businesses as Buildings: Metrics for the Architectural Quality of Internet Businesses. Information System Research 13(3), 239–254 (2002) 7. Ling, J., van Schaik, P.: The effect of text and background colour on visual search of Web pages. Displays 23, 223–230 (2002) 8. Massey, A.P., Khatri, V., Montoya-Weiss, M.: Usability of online services: The role of technology readiness and context. Decision Sciences 38(2), 277–308 (2007) 9. Miyoshi, T., Murata, A.: A Method to Evaluate Properness of GUI Design Based on Complexity Indexes of size, Local Density, Aliment, and Grouping. In: 2001 IEEE International Conference on Man and Cybernetics, vol. 1, pp. 221–226 (2001) 10. Parry, M., Eberle, S.D.: Aesthetic measure applied to color harmony. Journal of the Optical Society of America 34(4), 234–242 (1944) 11. Moon, P., Spencer, D.E.: Area in Color Harmony. Journal of the Optical Society of America 34(2), 93–103 (1944) 12. Näsänen, R., Ojanpäa, H.: Effect of Image Contrast and Sharpness on Visual Search for Computer Icons. Display 24, 137–144 (2003) 13. Ngo, D.C.L., Teo, L.S., Byrne, J.G.: Modeling Interface Aesthetics. Information Science 152, 25–46 (2003) 14. Schenjkam, B.O., Jönsson, F.U.: Aesthetics and Preferences of Web Pages. Behaviour & Information Technology 19(5), 367–377 (2000) 15. Shneiderman, B., Plaisant, C.: Designing the User Interface, 4th edn. Addison Wesley, England (2004) 16. Palmer, J.: Web Site Usability, Design, and Performance Metrics. Information Systems Research 13(2), 151–167 (2002) 17. Parush, A., Nadir, R., Shtub, A.: Evaluating the Layout of Graphical User Interface screens: Validation of a Numerical Computerlized mode. International Journal of HumanComputer Interaction (2005) 18. van Schaik, P., Ling, J.: The effects of screen ratio and order on information retrieval in web pages. Displays 24, 187–195 (2003) 19. Valacich, J.S., Parboteeah, D.V., Wells, J.D.: The Online Consumers Hierarchy of Needs. Communications of the ACM 50(9), 84–90 (2007) 20. van Schaik, P., Ling, J.: The effects of screen ratio and order on information retrieval in web pages. Displays 24, 187–195 (2003) 21. Van der Heijden, H.: User Acceptance of Hedonic Information Systems. MIS Quarterly 28(4), 695–704 (2004) 22. Xing, J.: Measures of Information Complexity and the Implications for Automation Design, National Technical Information Service, Springfield, Virginia (2004) 23. I.R. I 116 Palette, http://www.iricolor.com/04_colorinfo/sensetest.html
The Assessment of Credibility of e-Government: Users’ Perspective Zhao Huang, Laurence Brooks, and Sherry Chen School of Information System, Computing and Mathematics, Brunel University, Uxbridge, Middlesex UB8 3PH, UK {zhao.huang,Laurence.brooks,Sherry.chen}@brunel.ac.uk
Abstract. Electronic government is increasing worldwide; however there are still some problems which influence users’ interaction with them. One of these problems is trustworthiness, which appears to be affected by whether e-government websites demonstrate their credibility. This study uses an empirical approach to evaluate credibility of e-government websites, especially at the local level in the UK. The evaluation consists of three steps: free interaction, task-based interaction and questionnaire. The results indicate that the majority of credibility problems are related to “site easy use”, “site looks professional” and “site update”. The value of the study is that it provides guidance for designers to improve the credibility of e-government websites. Keywords: e-government website, credibility, web-based online systems.
1 Introduction With the rapid development of the Internet, users have increasingly been able to interact with Web-based online systems. Among a variety of Web-based online systems, electronic government (e-government) is becoming part of the revolution applied in the public sector. Nowadays, thousands of e-government websites are widely accessible via the Internet. Such a rapid growth arises from the way that e-government websites have the potential to change the working environment of the traditional government to enhance access and delivery of government services [1]. However, e-government is still facing a big challenge to interact with users. Trustworthiness can be seen as the underlying catalyst for e-government adoption [2]. With higher trustworthiness, users can overcome perceptions of risk and uncertainty in the use and acceptance of online systems [3]. Trustworthiness can be affected by whether online systems demonstrate their credibility [4]. In general, credibility refers to reliability, accuracy, authority and quality [5]. Regarding e-government website particularly, credibility can be enhanced by the site look, information quality and readability [4]. This suggests that there is a need to consider credibility when developing e-government websites. By doing so, egovernment websites can be accepted by a wider range of users. As such, credibility evaluation of e-government website becomes crucial in order to develop user-centered e-government. However, existing research has not paid much attention to evaluating credibility. To this end, the paper aims to assess M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 26–35, 2009. © Springer-Verlag Berlin Heidelberg 2009
The Assessment of Credibility of e-Government: Users’ Perspective
27
credibility of e-government websites, particularly focusing on the local level in the UK. To carry out the evaluation, an empirical study has been conducted based on Fogg’s credibility guidelines [6]. Accordingly, the paper is presented as follows: Section 2 presents the theoretical background from literature to demonstrate the importance of credibility to e-government website. In section 3, an empirical study is designed to evaluate credibility of e-government websites. This allows the detection of credibility problems which are discussed in section 4. Finally, conclusions are drawn and possibilities for future study are recommended in section 5.
2 Theoretical Background: e-Government Websites Governments worldwide have caught on to the revolution in Internet and Web technologies and made significant attempts to deliver their services to citizens, business and other government agencies via the Internet in the public sector [9]. Generally, e-government is the use of the Internet, as a tool to achieve better government, which enables richer information resources, higher quality services and greater participation [10]. All services of e-government can be produced via information presentation, interaction, transaction and integration [11]. The benefits of e-government can increase transparency; service delivery; civil service performance; policy effectiveness; strengthen citizen trust and achieve big cost savings [10]. Equally, the number of e-government website worldwide has increased from 142 in 1995 to more than 50,000 in 2001 [8]. In the U.S., more than one million users visit federal websites every week [12]. A survey reports that 60% of respondents prefer to choose e-government to deal with their demands [13]. This suggests that there are a large number of users who are using and have been willing to engage in e-government website services during the last decade. However, with the rapid growth of e-government websites, there is still a big challenge for e-government to interact with users. Sillence et al. [14] found that trustworthiness is a key factor in user decisions about website engagement. In other words, the success of e-government websites will largely depend on reliability [15]. Further, a range of studies demonstrate and adopt credibility to explain interaction between users and information system. In these, credibility of the website directly results in users’ satisfaction [7]. The evidence indicates that credibility is an important factor which influences users’ interaction with system. 2.1 Credibility Credibility is a highly complex concept. A simple definition is “believability” [6]. Many studies attempt to identify multiple criteria in credibility assessment. Berlo, et al. [16] extend believability by adding “safety,” “qualification,” “dynamism,” and “sociability”. Robins and Holmes [17] argue that “sociability” is a strong factor relating to credibility. Within web-based systems, Rieh [5] indicates that except for “trustworthiness” and “dynamism”, “authority” can be used instead of “expertise”. However, Toms and Taves [18] argue “reputation” as a comprehensive factor which includes “trustworthiness”. Fogg [19] defines credibility as consisting of trustworthi-ness and expertise. Trustworthiness is the users’ perception in terms of goodness and the unbiased nature of
28
Z. Huang, L. Brooks, and S. Chen
the system [19]. Expertise is seen as the users’ perception regarding knowledge and skill with the system resources [6]. Based on this concept, the major problems of credibility lie within “Aesthetic design”; “Information structure”; “Information focus”; “Company motive”; “Usefulness of information” and “Accuracy of information” [19]. It seems that credibility is a key factor in determining the success of e-government [4]. Users will not fully accept, satisfy and interact with e-government until credibility issues have been addressed in sufficient details in e-government design. Thus, there is a need to evaluate credibility in current e-government in order to develop more user centered e-government.
3 Methodology Design 3.1 Conceptual Framework Having demonstrated the importance of credibility to e-government website, this paper reports an empirical study to evaluate credibility of e-government websites. Firstly, a set of tasks is developed for participants to perform (Section 3.2). Subsequently, a guideline-based questionnaire is designed to capture participants’ perception about credibility (Section 3.3). Then, three local e-government websites in U.K. are selected to be evaluated (Section 3.4). The evaluation procedure composes of three steps: a free interaction; a task based interaction and questionnaire (Section 3.5). Once the evaluation is completed, a score is assigned to each questionnaire question to indicate the seriousness of credibility problems. Finally, the data collected is presented and discussed (Section 4), and these findings can be used to help credibility design in further development of e-government websites (Section 5). 3.2 Task Design The study aims to detect the credibility problems of e-government websites. In the evaluation, the participants are required to perform a set of practical tasks on e-government websites. These tasks are representative activities that users would be expected to perform. Generally, three characteristics are used to categorize the services on e-government websites: information dissemination, products offer and user participation [8]. Information dissemination is the presentation of information. Products offer refers to one-way delivery services, such as forms download; registration; job searching. User participation is regarded as the interactive services which involve users in two-way communication, for example, participating in government decision making. 3.3 The Guidelines Based Questionnaire Design To measure credibility, a questionnaire based on Fogg’s credibility guidelines [6] is used to capture participants’ perception. Three phases are constructed of the questionnaire design. Firstly, there is a need to extend existing guidelines to meet the specific requirements of e-government websites. Secondly, since Fogg’s guidelines are broad principles which can not prescribe a step by step approach to cover specific elements, it is important to develop associated criteria for each guideline. Finally, the
The Assessment of Credibility of e-Government: Users’ Perspective
29
questionnaire consists of a series of questions which are developed based on associated criteria from the extended Fogg’s guidelines. Extension of Guidelines. Fogg’s set of guidelines (see Table 1) is used as a benchmark for assessing credibility [7]. However, as Fogg’s ten guidelines were developed 10 years ago and for general websites, it is important to extend these guidelines in order to fit the specific needs of e-government websites. As e-government serves the public, users’ participation is given more attention [11]. Barnes [20] demonstrates that the service interaction quality is the main factor in users’ satisfaction. Furthermore, Garcia et al. [15] use privacy and transparency as criteria to evaluate e-government Therefore, the existing guidelines are extended by adding three new guidelines: Transparency; Service agility and Privacy (see Table 2). Table 1. Fogg’s credibility guidelines [6] Credibility Guidelines G1. Site looks professional G2. Information accuracy G3. A real organization behind site G4. Highlight the expertise in site G5. Show the trustworthy people G6. Make it easy to contact you G7. Site ease to use and useful G8. Update site’s content often G9. Restraint promotional content G10. Avoid errors of all type
Explanations The site considers layout, typography, consistency The site shows the validation of the materials The site needs to prove it is a legitimate organization The site indicates an expert team and authority services The site shows people who convey trust through the site The site provide clear contact information at any time Users can easily complete their tasks using the site The site is up to date and review its content regularly The site should clearly distinguish sponsored content The site prevents a problem occurring in the first place
Table 2. Extended Guidelines Extended Guidelines G11. Transparency G12. Service agility G13. Privacy
Explanations The site should keep users informed a clear governmental operations The site should provide flexible services to fit in different user paths The site should protect users’ information and secure its services
Development Criteria. Although Fogg’s guidelines are extended, it may encounter difficulties to assess detailed aspects of credibility in questionnaire. Therefore, associated criteria for each guideline need to be developed. The precise criteria for each guideline may provide a step to step process to closely focus on specific aspects so that the specific question in the questionnaire can be exactly designed based on those criteria. Credibility Questionnaire. A questionnaire ensures that all participants are asked the same questions and provide quick responses. Therefore, a questionnaire is created to assess credibility. The participants will be asked to complete a set of questions using five-point Likert scales, which presents their level of agreement to those statements. The main advantage of five-point scales is that an odd number of response formats with a neutral level in the middle may not force the participants to choice a positive or negative option when they really do not have. The other advantages include gathering
30
Z. Huang, L. Brooks, and S. Chen
respondents’ opinion by summing up the participants’ responses to the same latent variable and the options are approximately equal spaces across the continuum of approval [21]. 3.4 e-Government Website Selection The evaluation is conducted using three local e-government websites in the U.K. so that evaluation results can be comparatively analyzed. The reason behind choosing the local level to evaluate is that the local e-government website is the closest level for citizens, frequently used by the general public and an important role for citizens’ participation [22]. In addition, previous studies have found the various problems in local e-government. For example, Yang and Paul [23] detect that the majority of problems in local e-government lie within security and content update issues. The three local e-government websites will be called: London Authority1, London Authority2 and London Authority3. 3.5 Experimental Evaluation Procedure To conduct the experiment, 30 participants are assigned to evaluate three e-government websites (10 participants for each site). Each evaluation follows the same three steps: free interaction; task-based interaction and questionnaire. Firstly, the participants freely look at the e-government website so that a general perception and initial interaction are developed. Subsequently, task-based interaction requires participants to complete a number of practical tasks. User scenario is used as the technique to translate and present the selected tasks to the participants. Having completed all tasks, the participants communicate their perceptions of credibility in the questionnaire.
4 Discussion of the Results To obtain a comprehensive evaluation, both quantitative and qualitative approaches are used to analyze the results. The former uses the numeric results from the closed questions of the questionnaire to identify the overall credibility of each e-government website (Section 4.1), while the latter presents the useful features and problems from open-ended questions to indentify the strengths and weaknesses of credibility (Section 4.2). 4.1 Quantitative Measurement In order to comparatively evaluate the results, a score has been assigned to each question in the questionnaire. This has been calculated by multiplying the number of answers under each weight of five-point scale. Subsequently, the sum of these calculations is added together to obtain the score for each question. Lower scores indicate the most serious credibility problems (see Table 3). By assigning the scores in this way, it is easy to identify the most serious problems in each e-government website. More importantly, it can comparatively highlight the specific categories of credibility that cause the most common credibility problems among the e-government websites evaluated.
The Assessment of Credibility of e-Government: Users’ Perspective
31
Overall, the three e-government websites appear to be clear and fairly straightforward. Different parts of information are properly displayed in the various formats so that users can easily read information presented, which can also be quickly accessed. The main menu is suitably located on the left side of the page and the quick links are always available at the top of each page. It helps users to easily start the tasks and quickly access shortcuts whenever they need. In addition, a clear logo and staff photos add to the credibility of the site. Meanwhile, other reliable government websites are presented and linked with the target e-government website. This helps to improve the reputation of the site. After that, the navigation descriptions are useful to support users identify where they are in the site, with advertisements restrained to help users’ concentrations. However, some serious credibility problems have been found in each egovernment website evaluated (Table 3). In London Authority 1, firstly, information is not consistently presented in the different colors, so users feel a little confused when they try to identify information through the site. Secondly, it dose not offer concise instruments or messages to support user selection of sub-options correctly. Subsequently, although advertisements are restrained, there are still some difficulties in distinguishing ads from content. Finally, the structure of the site is quite unclear, massive number of option makes site looks less credible. The most serious problems in London Authority 2 are (see Table 3): firstly, information may not be presented in consistent colors, so users may spend extra time to identify information. Secondly, any awards earned by the website are not displayed properly. Thirdly, the site may need to improve its usability. Fourthly, the information about latest updates is not clearly indicated, especially for online forms and documents. Lastly, the site lacks a secure message to keep users informed during the data transaction process. The problems in London Authority 3 indicate the similar difficulty of information identification by colors. Moreover, some information lacks a good balance between breadth and depth. During online transactions, the site does not clearly indicate progress which may cause users to lose their patience easily. Lastly, privacy needs to be considered, such as personal information protection and secure message presentation. The quantitative results indicate that the most common credibility problems of the three e-government websites are related to “site ease to use”, “site looks professional” and “site update”. For example, in “site ease to use”, users feel difficulty with the links because the links already visited are not clearly marked. This suggests that more attention needs to be drawn to information access and navigation [8]. There is also a lack of balance in information presentation between breadth and depth. This suggests that designers need to consider different users’ tendencies in searching information. More specifically, if users want an overview of information, more categories with fewer levels can be used. Conversely, if users search for detailed information, fewer categories with more levels are needed. In addition, users expect a clear indication of progress in the process. This suggests that user control over the process is paramount. With regard to “site looks”, users find it hard to identify relevant information. The reasons may be firstly layout, instruction and colors are not used consistently throughout the site. Secondly, some information can not exactly match with its
32
Z. Huang, L. Brooks, and S. Chen Table 3. Crediblity problems
London Authority 1 Guidelines Questions 2 G1 4 G2 6 G4 14 G6 20 21 22 23 G7 24 G8 25 G9 27 G10 30 G12 37 London Authority 2 Guidelines Questions G1 2 15 G5 16 22 23 G7 24 G8 25 G13 39 London Authority 3 Guidelines Questions G1 2 G3 10 16 G5 17 G7 23 G8 25 38 G13 39
Problems Information is not identified in the different colors Page is not labeled to show its relation to others The information is not well organized Instruments displayed by the system are not concise The site does not show detailed contact information The system is not easy to use Navigating the system is not easy It is not clear how far left of the quote process The site is not in a way that makes sense to user The system has not a latest update It is not easy to distinguish ads from content The site is not free from typographical errors The site does not offer agile functions Problems Information is not identified in the different colors It is not easy to find an “about us” page The site does not display any awards it has owned Navigating the system is not easy It is not clear how far left of the quote process The site is not in a way that makes sense to user The system has not a latest update A secure message is not appeared Problems Information is not identified in the different colors The site does display photos of offices or staff The site does not display any awards it has owned No enough information about who is in charge of It is not clear how far left of the quote process The system has not a latest update Confidential areas are not secure A secure message is not appeared
Top five lowest scores 31 36 35 33 35 36 36 35 35 35 34 36 36 Top five lowest scores 26 29 25 26 26 27 25 28 Top five lowest scores 31 31 26 28 31 26 25 29
categories; especially where the pictures are too vague to make sense. This suggests that a higher aesthetic treatment is needed to increase credibility [17]. Regarding “site update”, users find difficulty with identifying updated versions for forms, documents and system. In addition, users worry about privacy and security associated with personal information and safety. The possible solution is widespread adoption of digital certificates and a public key infrastructure [20]. On the other hand, by summing the scores together for each e-government website, an overall assessment can be made of the credibility problem of each e-government website. In details, London Authority 2 has the lowest score with a total score of 1305. London Authority 3 is placed next one with a total score of 1386. The egovernment website with the fewest credibility problems is found to be London Authority 1 which has a total score of 1470.
The Assessment of Credibility of e-Government: Users’ Perspective
33
4.2 Qualitative Assessment During the evaluation, comments about the problems and the good features which are not covered in the questions are recorded. The most frequently cited useful features are regarded as strengths and the most frequently encountered problems are considered as weaknesses (Table 4). Table 4. Qualitative results for London Authority 1,2 amd 3
1G 2G 3G 4G 5G 6G 7G 8G 9G 10G 11G 12G 13G
London Authority1 Strengths Weaknesses Consistent Too many colors options Content is Irrelevant reliable Pictures Democracy Irrelevant offered info. Full info. Too much info. Staff photos Confused options General No detailed contact contact Easily Too many access options None No clear update Few ads None Clear Message is not categories concise Terms, None conditions User’ path Search is limited A sign-in None offered
London Authority2 Strengths Weaknesses Logo, Flashed format images None Unclear pictures Relevant None contents Lots of No user ID info. required Staff No award photos presented Relevant None contact Easily Poor category access None No updated date No ads None FAQs is Site map is not provided helpful None No term, conditions None No secure messages None No password required
London Authority3 Strengths Weaknesses A clear loge Color is not constant Detailed info. Unclear subhead Right URL None None
No services feedback None No sources of news Quick contact None Links work properly None
Search engine is limited No site update
No ads None
None Unclear categories No transparency
None None None
No languages support None
Common Strengths • Site looks professional: generally, the logos are used consistently. In addition, the content designed can properly match the organization and be organized logically. Information can be easily read in the sites, which can also be quickly accessed. • Easy to contact: a fixed contact location on each page. Users can quickly find general contact information whenever need. Most contact information is categorized by different departments and offer various contact methods. • Easy to verify the information accuracy: all e-government websites offer much information. Most information is presented at the right level of detail. Furthermore, the URL can properly match the content presented on each page. In particular, the news on the sites indicates their source and the latest update with a clear date.
34
Z. Huang, L. Brooks, and S. Chen
• Restraint with promotional content: in e-government websites, most advertisements are restrained to help users’ concentrations. Common Weaknesses • Highlight expertise in the organization: some information can not be matched to categories, especially for pictures. Users easily lose patience if they choose irrelevant categories. Moreover, the instruments for options are not concisely explained. • Easy to use: users often get confused where links already used are not clearly marked and the key links are not located in an important place. Additionally, too much information is presented at the home page so that users have to spend more time reading it carefully. In particular, users feel it is difficult to find information because the site search engine can not support advanced search. • Site update: not all information is updated regularly with a clear date, especially for forms and documents. Furthermore, the updated date and version of the website is not indicated at the main page.
5 Conclusion This paper reports an empirical study which assesses credibility in existing egovernment websites, focusing on three local e-government websites in the UK. The evaluation results indicate that the current e-government websites have a much room for improvement of their credibility. The most significant problems are found within the areas of “site easy to use”, “site looks professional” and “site update”. These evaluation results suggest that designers need to pay more attention to credibility in egovernment website design so that e-government websites may be more widely accepted and accessed, ultimately to achieve user centered e-government. Therefore, this study develops an approach to identify credibility problems of e-government websites. The value of this study not only lies within the guidance for designers to improve the credibility of e-governments, but also help designers of other web-based systems to enhance their credibility. However, this study uses a questionnaire-based approach to evaluate credibility, which emphasizes on user perception. In order to obtain a more comprehensive evaluation, both user perception and user performance are recommended. Future studies are needed to assess users performance with the tasks In addition, the results of this study indicate that usability difficulties have an important impact on credibility. Designers who enhance the usability of a web site are likely to enhance the site’s credibility [19]. This suggests that there is a need to conduct future research to evaluate usability of e-government website. The findings of such a study can be used to analyze the relationship between usability and credibility.
References 1. Basu, S.: E-government and developing countries: an overview. International Review of Law Computers & Technology 18(1), 109–132 (2004) 2. Warkentin, M., Gefen, D., Pavlou, P.A., Rose, G.M.: Encouraging citizen adoption of egovernment by building trust. Electronic Markets 12(3), 157–162 (2002)
The Assessment of Credibility of e-Government: Users’ Perspective
35
3. Pavlou, P.A., Gefen, D.: Building effective online marketplaces with institution-based trust. Information Systems Research 15(1), 37–59 (2004) 4. Araujo, M.C.R., Grande, J.I.C.: Performance in e-government: website orientation to the citizens in Spanish Municipalities. In: Proceedings of european conference on egovernment, Trinity College, Dublin (2003) 5. Rieh, S.Y.: Judgment of information quality and cognitive authority in the web. Journal of the American Society for Information Science and Technology 55(8), 743–753 (2002) 6. Fogg, B.J., Tseng, H.: The elements of computer credibility. In: Proceedings of the CHI 1999 conference on human factors and computer system, pp. 80–87 (1999) 7. Grady, L.O.: Future directions for depicting credibility in health care web sites. International Journal of Medical Informatics 75, 58–65 (2006) 8. Kumar, V., Mukerji, B., Butt, I., Persaud, A.: Factors for successful e-government adoption: a conceptual framework. Electronic Journal of E-Government 5(1), 63–76 (2007) 9. Tambouris, S.: European cities platform for online transaction services. In: Proceedings of the European Conference on E-Government (2001) 10. OECD: The E-government imperative. In: OECD E-Government Studies. OECD, Paris (2003) 11. Tapscott, D.: Blueprint to the Digital Economy. McGraw-Hill, New York (1998) 12. Eschenfelder, K.R., Beachboard, J.C., McClure, C.R., Wyman, S.K.: Assessing U.S. federal government websites. Government Information Quarterly 14(2), 173–189 (1997) 13. James, G.: Empowering bureaucrats. MC Technology Marketing Intelligence 20(12), 62– 68 (2000) 14. Sillence, E., Briggs, P., Harris, P., Fishwick, L.: A framework for understanding trust factors in web-based health advice. International Journal Human-Computer Studies 64, 697–713 (2006) 15. Garcia, A.C.B., Maciel, C., Pinto, F.B.: Electronic government: a quality inspection method to evaluate e-government sites. Springer, Heidelberg (2005) 16. Berlo, D.K., Lemert, J.B., Mertz, R.J.: Dimensions for evaluating the acceptability of message sources. The Public Opinion Quarterly 33(4), 563–576 (1969) 17. Robins, D., Holmes, J.: Aesthetics and credibility in web site design. Information Processing & Management 44(1), 386–399 (2007) 18. Toms, E.G., Taves, A.R.: Measuring user perceptions of web site reputation. Information Processing and Management 40, 291–317 (2004) 19. Fogg, B.J.: Credibility and the world wide web. Persuasive Technology, 147–181 (2003) 20. Barnes, S.J., Vidgen, R.: Interactive e-government services: modeling user perceptions with eQual. International Journal of Electronic Government 1(2), 213–228 (2004) 21. Gill, J., Johnson, P.: Research methods for managers. Paul Chapman Publishing Ltd., Boca Raton (1991) 22. Michael, C., John, F.: Capacity building: facilitating citizen participation in local governmence. Australian Journal of Public Administration 64(4), 64–80 (2005) 23. Yang, J.Q., Paul, S.: E-government application at local level: issues and challenges: an empirical study. International Journal of Electronic Government 2(1), 56–76 (2005)
Auto-complete for Improving Reliability on Semantic Web Service Framework Hanmin Jung1, Mi-Kyoung Lee1, Won-Kyung Sung2, and Beom-Jong You1 1
Information Technology Research Lab., KISTI, Korea 2 Dept. of Policy Research, KISTI, Korea {jhm,jerryis,wksung,ybj}@kisti.re.kr
Abstract. This paper presents two methods for enhancing auto-complete which providing search keywords that the user wants. The first is to display only search keywords that can guarantee a successful search result in real time regardless of document’s insertion, deletion, and update. The second is to display search keywords with their entity types such as person, institution, and topic. To accomplish them, we introduce an auto-complete table that stores the entities extracted and indexed from input documents and their document frequency (DF). An auto-complete manager checks whether each entity in the table can guarantee a successful search result or not by considering its DF, and provides proper entities with their types to the user. To verify the effect of the auto-complete, we are designing a comparative experiment. OntoFrame 2007 without the functions will be compared with OntoFrame 2008 with the functions for discovering the effect of our auto-complete on the reliability of Semantic Web services. Keywords: Auto-complete, Semantic Web, Semantic Web Framework, OntoFrame, Reliability, Document Indexing.
1 Introduction Auto-complete is a feature for predicting a word or phrase that the user wants to type in without the user actually typing it completely. Auto-complete on the Web is usually implemented by Ajax (Asynchronous JavaScript and XML) which is one of key technologies classified in Web 2.0 (see fig. 1). They are widely applied over the Web sites including digital libraries, commercial portals, and enterprise applications [1]. It is expected to be applied more and more in the viewpoint of enhancement of the user experience. However, most auto-completes simply display search keywords retrieved from the user’s query logs and system dictionaries without considering the quality of search results. The reliability of such auto-completes would be dropped in case that the user selects a search keyword which can not generate a successful search result. It is not a special case for small/medium enterprise portals because they suffer from relative short of contents compared with commercial portals such as Google, Yahoo, and Amazon. Even worse, different types of search keywords are mixed in their auto-complete lists. It compels the users to look up whole of the list for finding a M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 36–44, 2009. © Springer-Verlag Berlin Heidelberg 2009
Auto-complete for Improving Reliability on Semantic Web Service Framework
37
Fig. 1. Classic Web application model and Ajax Web application model1
search keyword they want. These problems can be solved by introducing two methods that display only search keywords that can guarantee a successful search result and provide their entity types such as person, institution, and topic. This research deals with the way how the two methods can be achieved on a Semantic Web service framework.
2 Related Studies Han and Lee deals with costs and benefits of internet search with costumers’ prospective [2]. They reveal the fact that pains during the search are closely related with the user satisfaction, thus it should be designed to minimize the time and effort required. Auto-complete is an important function in that it can reduce the pains of the user by providing a way to select a search keyword without typing it completely. Another study on the usability of auto-complete concludes that the user satisfaction and search efficiency (the time needed to complete a given task) are affected by the function [3]. It also reports many positive comments were received from the users. Even for mobile devices, auto-complete enables the users to finish their tasks with fewer errors [4]. The study has clearly proven its advantages in terms of satisfaction, efficiency, and stability. However, studies on auto-complete enhancement are comparatively insufficient against its importance. A patent created by Lee and Wales proposes auto-complete using multiple dictionaries in ways of lookup and merge [5]. Auto-complete introduced 1
http://www.adaptivepath.com/images/publications/essays/ajax-fig1_small.png
38
H. Jung et al.
by Miki et al. can be classified as an advanced function in that it deals with ontology and data conversion [6]. An application form is generated in ways of referring the ontology data that knowledge managers have constructed manually. When the users input data in the form, the auto-complete function recognizes language types and field types in order to convert the data into appropriate values. However, the study is not closely concerned with ours because we concentrate on only the construction of search keywords in auto-complete list. A study on auto-complete for predicting Chinese characters with partial uses a prefix tree decoder [7]. It also adopts speech recognition for supporting bi-modal Chinese character input. Liu et al. found the bi-modality improves the input speed, but their research scope does not match with us exactly. Bangalore et al., as a significant study on auto-complete for improving reliability, introduces a method for providing search keywords that are able to generate a successful search result in the UMLKSK interface [8]. It uses a flag to mark the success or failure of search results. In case of success, the corresponding search keyword is marked with the flag. This method ensures a successful search result by displaying only the search keywords by considering the flag when the auto-complete list is provided. However, the auto-complete list would be occasionally out-of-date because the marking occurs only when the user enters a search keyword. Even after adding an input document which includes a search keyword that has caused the failure previously, the keyword will not be display in the auto-complete list until the user types manually the search keyword without referring to the list.
Fig. 2. Example of a search result with failure caused by selecting an improper search keyword in auto-complete list (‘Wizwid’ online shopping mall)
Many popular Web sites, even including enterprise portals, provide auto-complete for helping the users to find search keywords in ease. They usually use the popularity of the users’ input regardless of success/failure of search results as shown in fig 2. Because they do not consider incremental data add-up, which would cause mismatch problem between auto-complete and search results, search using auto-complete occasionally fails. As a new technology, Google offers keyword suggestions in real time in the form of auto-complete. However, mismatch in the number of documents occurs as shown in fig. 3. It may be caused by incomplete incremental indexing
Auto-complete for Improving Reliability on Semantic Web Service Framework
39
Fig. 3. Example of mismatch between auto-complete and search results in the number of documents (‘Google’ suggest; 7,710,000 results in auto-complete and 7,300,000 in search results)
management related with auto-complete. The following section explains how we resolve these problems with an auto-complete manager and an auto-complete table.
3 Auto-Complete in OntoFrame OntoFrame, a Semantic Web service framework [9] [10], aims at search and discovery of science and technology information using Semantic Web technologies. It includes a search engine and a reasoning engine. The former searches full-text documents and the latter discovers implicit knowledge by exploiting relations between instances, i.e. entities. OntoFrame gathers legacy data and transforms them into RDF (Resource Description Framework) triples by referring to predefined ontology schema designed for a specific application domain. The reasoning engine expands the triples at idle time, i.e. forward chaining, using user-defined rules, and puts back the results into an RDF triple store. OntoFrame-based service communicates with the two engines through Web Services, SPARQL (Simple Protocol and RDF Query Language) queries, and XML documents. OntoFrame provides entity-centric unified search 2 . Predefined entities are managed in a URI server which is a semantic data management tool with the RDF triple store. The server is referred by a document indexer for acquiring entities and their types from an input document (see fig. 4). Auto-complete is applied to OntoFrame for helping the user to search with convenience and efficiency. To sustain reliability, auto-complete should provide search keywords that guarantee successful search results. However, the previous version of OntoFrame (OntoFrame 2007) provided a simple auto-complete function which just shows a search keyword list matched with the user’s input string. The keywords are pre-extracted and refined topic keywords from test collection. Even the case that a keyword never appears in indexed documents, it can be displayed in auto-complete list, 2
Entity-centric unified search can be defined as a unified search generating a Web page which consists of service components selected dynamically according to the user’s input corresponding with an entity reserved in the system. Different kinds of search result pages would be generated in case of different entity types.
40
H. Jung et al.
Document
Document Indexing OntoFrame Service URI Server
Auto-complete Manager Auto-complete Table
Fig. 4. Auto-complete process
Fig. 5. Example of changes in the auto-complete table according to document’s indexing (P: person, I: institution, T: topic)
which will cause a failed search result. Even worse, the use of all of the topic keywords increased the load of auto-complete. We also found the users’ reliability of the service is degraded when they select improper keywords, i.e. keywords that can not guarantee a successful search result, in the list. Thus, this version of OntoFrame (OntoFrame 2008) introduces an auto-complete manager for guaranteeing successful search results from selecting a search keyword in auto-complete and further increasing usability by displaying entity types additionally. After extracting entities from an input document, the auto-complete manager updates the document frequency (DF) of the entities in an auto-complete table, i.e. DF of the entities would increase by one as shown in fig. 5.
Auto-complete for Improving Reliability on Semantic Web Service Framework
41
When the user enters a search keyword, the auto-complete manager finds the entities matched with the keyword by looking up the auto-complete table. Then, it checks whether DF of each retrieved entity is zero or not. Those entities with more than zero are displayed in the auto-complete list. Since the entities in the list are extracted from indexed documents, search results generated from them would be always successful. This method is different from that of Bangalore et al. because DF of entities is updated instantly according to document’s indexing, and only proper entities are always displayed in the auto-complete list [8]. The following pseudo codes explain how the auto-complete manager deals with the auto-complete table for generating an auto-complete list corresponding with the user’s input. manage_auto_complete(String) { Entity[] = get_matched_entity_list(String); Valid_entity[] = check_doc_frequency(Entity[]); sort_entity_by_type(Valid_entity[]); return Valid_entity[]; } sort_entity_by_type(Entity[]) { find_entity_type(Entity[], Person_entity[], Institution_entity[], Topic_entity[]); sort_entity(Person_entity[]); sort_entity(Institution_entity[]); sort_entity(Topic_entity[]); sorted_entity[] = merge_entity(Person_entity[], Institution_entity[], Topic_entity[]); return Sorted_entity[]; } update_auto_complete_table(String[], Operation) { While (Entity = get_next_string(String[])) { Switch (Opreation) { Case Insert: increase_doc_frequency(Entity); Case Delete: decrease_doc_frequency(Entity); } } } The above functions lookup and manage the auto-complete table. Manage_auto_complete() gets the user’s input string from OntoFrame service. It finds the entities of which name is matched with the input string. Check_doc_frequency() checks each entity whether it has DF of more than zero. Entities with document frequency of zero are excluded. By referring the auto-complete table, sort_entity_by_type() makes a merged entity list sorted by their types, e.g. topic and person. Then manage_auto_complete() returns them to the service. DF of each entity is managed by update_auto_complete_table(). The function increases or decreases DF according to operation types, i.e. insert and delete. In case of document’s update, insert process would follow delete process. Finally, the auto-complete manager returns a proper entity list as shown in the following example and fig. 6.
42
H. Jung et al.
Fig. 6. Example of auto-complete in OntoFrame (It shows topic and person entities matched with “Seman.”)
API: EntityList manage_auto_complete(String keyword) Calling example: manage_auto_complete(“sem”) Result example (see fig. 3): [semantic activation, Topic] [semantic association, Topic] [semantic blocking, Topic] … [Semantha,Ellis, Person] Current number of the entities stored in the service is 923,449 (652,507 for topic and 270,942 for person). We found that 362,319 topic entities (55.53% when compared
Fig. 7. Example of search result generated from topic entity “neural network”
Auto-complete for Improving Reliability on Semantic Web Service Framework
43
Fig. 8. Example of search result generated from person entity “Jinde Cao”
with total topic entities) acquired from indexing of about 200,000 journal papers on information technology and bioinformatics lead to successful search results. Fig. 7 and fig. 8 show examples of successful search results for topic and person entities.
4 Conclusion We introduced an enhanced auto-complete with two functions; displaying only search keywords that can guarantee a successful search result in real time regardless of document’s insertion, deletion, and update and displaying search keywords with their types such as person, institution, and topic. For accomplishing them, an auto-complete manager and an auto-complete table are used. The manager gets the user’s input string and returns a proper entity list by looking up the table. To verify the effect of the auto-complete, we are designing a comparative experiment. The task to be achieved is “Find a representative researcher and an institution for top 5 topics in the auto-complete list corresponding with ‘neural’.” OntoFrame 2007 3 without the functions will be compared with OntoFrame 20084 with the functions. We expect to find the effect of our auto-complete on the reliability of Semantic Web services.
References 1. Beauheim, C., Wymore, F., Nitzberg, M., Zachariah, Z., Jin, H., Skene, J., Ball, C., Sherlock, G.: OntologyWidget – a Reusable, Embeddable Widget for Easily Locating Ontology Terms. J. BMC Bioinformatics 8, 338 (2007) 3 4
http://isrl.kisti.re.kr/wsearch/search/main.jsp http://150.183.113.186:8080/OntoFrame_ISRL/2008_new/main.jsp
44
H. Jung et al.
2. Han, D., Lee, E.: Exploring the Costs and Benefits of Internet Search from the Online Customers’ Perspective: Implications for the Consumer Adoption of the Semantic WebBased Search Engines. J. Business Education Research 11(1) (2007) (in Korean with English Abstract) 3. Kluge, J., Kargl, F., Weber, M.: The Effects of the Ajax Technology on Web Application Usability. In: International Conference on Web Information Systems and Technologies (WEBIST 2007) (2007) 4. Udyaver, S.: Experimental Comparison of Usability of Hybrid Mobile Devices. In: The 20th Computer Science Seminar (2004) 5. Lee, K., Wales, K.: Methods and Systems for Implementing Auto-complete in a Web Page. US 2004/0039988 A1 (US. Patent) (2004) 6. Miki, T., Ogawa, H., Matsuda, N., Miura, H., Taki, H., Hori, S., Abe, N.: Auto Complete Method for Web Application from Based on Term Hierarchy. In: The 20th Annual Conference of the Japanese Society for Artificial Intelligence (2006) (in Japanese with English Abstract) 7. Liu, P., Ma, L., Soong, F.: Prefix Tree Based Auto-Completion for Convenient Bi-modal Chinese Character Input. In: IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP 2008) (2008) 8. Bangalore, A., Browne, A., Divita, G.: UMLSKS SUGGEST: An Auto-complete Feature for the UMLSKS Interface Using AJAX. In: AMIA 2006 Annual Symposium (2006) 9. Jung, H., Lee, M., Kang, I., Lee, S., Sung, W.: Finding Topic-Centric Identified Experts Based on Full Text Analysis. In: The 2nd International Expert Finder Workshop at ISWC 2007 + ASWC 2007 (2007) 10. Sung, W., Jung, H., Kim, P., Kang, I., Lee, S., Lee, M., Park, D., Hahn, S.: A Semantic Portal for Researchers Using OntoFrame. In: The 6th International Semantic Web Conference and the 2nd Asian Semantic Web Conference (ISWC 2007 + ASWC 2007) (2007)
Effects of AJAX Technology on the Usability of Blogs Sumonta Kasemvilas and Daniel Firpo School of Information Systems and Technology, Claremont Graduate University, 130 E. 9th Street, Claremont, CA 91711, USA {Sumonta.Kasemvilas,Daniel.Firpo}@cgu.edu
Abstract. AJAX can enhance Web applications by updating a part of the Web page instead of the whole page. This change of technology relates to a usability issue. We used WordPress 2.3 to create two versions of blogs: non-AJAX and AJAX. Then we conducted an experiment by giving a task scenario to eight participants. We collected performance data by recording users’ mouse movements during the experiment and collected preference data by providing a questionnaire after the tasks. Finally, we conducted post-experiment interviews to gather participants’ experiences. The quantitative results show that AJAX did not improve users’ performances the first time they used it, while qualitative interviews demonstrate participants’ satisfaction with AJAX blogs. Keywords: AJAX, Blog, Ease of Learning, Efficiency of Use, Error Frequency and Severity, Experiment, Satisfaction, Usability, WordPress.
1 Introduction AJAX (Asynchronous JavaScript and XML) is a set of technologies such as eXtensible Markup Language (XML), XMLHttpRequest, Cascading StyleSheets (CSS), and the Document Object Model (DOM), combined with JavaScript. It is not a single technology, but several technologies that, when used together, enhance the capability of Web applications in innovative ways [1]. Many corporations use AJAX in applications, such as Google Maps, Gmail, iGoogle, Hotmail, and Yahoo Flickr. An advantage of AJAX is that Web browsers do not need to refresh the whole page. They only need to reload a portion of the page, which makes the Web site load faster and increases performance, because users can receive responses from the server faster than in classical Web applications. However, this also leads to a problem with AJAX. Users who are familiar with old-style Web applications may not be able to effectively use Web applications that contain AJAX technology due to a lack of understanding of how AJAX works. The users may not notice what has changed on the screen, or they might be waiting for the results to display, or for a response from the browser. Users might need to get accustomed to new conventions. This change of technology relates to a usability issue [2]. Blogs, a slang form of the term “Web logs,” are a Web 2.0 technology used extensively on the World Wide Web. Blogging has gained quite a bit of popularity in the recent years. “Blog” was named as the “word of the year” in 2004 by MerriamWebster. The large increase in popularity of blogs has led to the rapid growth in the M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 45–54, 2009. © Springer-Verlag Berlin Heidelberg 2009
46
S. Kasemvilas and D. Firpo
number of blog users, from individuals using them for personal use, to larger entities such as companies or universities. Blogs play a vital role not only in businesses and organizations, but also in academia. For example, the Brisbane Graduate School of Business at Queensland University of Technology records students’ experiences through the use of the ‘MBA blog’ [3]. Thus, it is in our interest to study human computer interaction of AJAX technology in blogs.
2 AJAX Classical Web applications use HTTP protocol to give requests to and receive responses from the server. This process takes time and refreshes the user’s whole screen, and a sign such as a rotating globe, a spinner, or a progress bar shows the user that the browser is loading. However, now we have moved on to a JavaScript-based paradigm, which calls an AJAX engine to send asynchronous HTTP requests to the server. AJAX supposedly improves the effectiveness of the Web by updating a part of the Web page instead of the whole page. It seamlessly exchanges small quantities of data between the browser client and the server. Because refreshing the Web page is not required when updating, the page becomes more interactive. This results in higher responsiveness, speed, and functionality [2]. AJAX is a client-side technology. In the AJAX Web application model, instead of sending an HTTP request from client to server as before, the user interface of the browser client will send a JavaScript call to the AJAX engine. Then, the AJAX engine sends an asynchronous HTTP request to the Web and/or XML servers. From the server side to the client side, the server sends XML data to the AJAX engine, and the AJAX engine sends HTML and CSS data to the user interface of the client. This also decreases bandwidth usage when compared to classical Web applications. AJAX also gains the advantage of JavaScript, in which developers only need to code once, and their code can work across different platforms. This makes AJAX more adaptable. However, AJAX has several disadvantages. Because it does not require a whole page reload, users cannot push the back button to go back to a prior state. This can cause problems because most users become accustomed to this behavior when they use Web browsers. Moreover, users cannot add bookmarks to keep a certain stage of the page when the page dynamically updates only small portions on the screen [4]. These problems may be solved by adding more complicated programming. Recently, Kluge, Kargl, and Weber [5] reported on the effects of AJAX technology on usability in Web applications such as message boards and auto-completion widgets, while our study focuses specifically on blogs. They studied only user satisfaction and time for completion of tasks. They looked at time for completion of tasks as a parameter of efficiency of use. They concluded that AJAX technology dramatically improves users’ satisfactions and efficiency of use in some scenarios. However, our study not only focuses on efficiency of use and satisfaction, as in Kluge et al’s [5] study, but also on other measures of usability, such as ease of learning and error frequency and severity, which were not measured in their study.
Effects of AJAX Technology on the Usability of Blogs
47
3 Research Question and Hypotheses Development Krug [6] asserts that one of the most important factors for Web usability is when users glimpse the Web page and are capable of easily interacting with it. Users should not have to take a long time to think about how to use the Web page. Oulasvirta and Salovaara [7] assert that it is important for a user interface to be invisible, as an interface must be uncomplicated (requiring no other knowledge besides the common sense of the user to operate) and interactive (ready to respond to the user on a continuous basis). Usability relates to the ability of users to learn and utilize a system or a product, such as a Web site or a computer application, to accomplish their purposes [8]. It includes the degree of satisfaction they perceive from learning and using the system [8]. Measurement of usability involves a group of factors that we need to consider for a user interface [8], [9]. First, ease of learning is measured from the ability of users who have never seen the user interface before to easily accomplish simple tasks without substantial training [8], [9], [10]. This includes effectiveness or the ability of users to successfully achieve tasks. Second, efficiency of use refers to how quickly users who have used the system before can complete their tasks easily and without frustration [8], [9], [10]. Third, memorability refers to how easily users can capably use the system again after not using the system for a period of time [8], [9]. Fourth, error frequency and severity refers to how often users make mistakes when using the system, the severity of these mistakes, and how easily they can recover from these mistakes [8], [9]. Finally, participative satisfaction refers to the extent to which users are satisfied with the system [8], [9], [10]. Currently, few studies have been conducted on the relationship between AJAX technology and Web usability when users utilize blogs. We are interested in finding out if AJAX technology within a blog leads to improvements in Web usability. We will examine whether adding AJAX plugins to a blog has a positive effect on the usability of that blog. To measure if AJAX technology affects the usability of a blog, we categorize these factors into two groups: preference and performance [10]. First, preference is measured from participative satisfaction. Second, performance is measured from ease of learning, error frequency and severity, as well as efficiency of use. We did not measure memorability because the experiment was done in one session. In addition, Kluge et al. [5] concluded that user satisfaction and efficiency of use when using AJAX technology are higher than when not using AJAX. Thus, we hypothesize that: HYPOTHESIS 1: The usability of blogs with AJAX technology is greater than in regular blogs. H1a: The ease of learning in blogs using AJAX technology is greater than in regular blogs. H1b: The error frequency and severity in blogs using AJAX technology is lower than in regular blogs. H1c: The participation satisfaction of users using blogs with AJAX technology is greater than the participation satisfaction of users using regular blogs. HYPOTHESIS 2: The efficiency of use in blogs using AJAX technology is high when users have used AJAX-enhanced blogs before.
48
S. Kasemvilas and D. Firpo
4 Experiment Design 4.1 System Design To test Web usability, we created two versions of a blog that had similar interfaces. The first version did not have AJAX plugins, but the second version did. We used WordPress 2.31 to create blogs in this study. WordPress is a well-known blog application that provides easy installation and usage. Calendar, search box, and comment are basic functions of blogs in WordPress. One can find these functions in most WordPress blogs. This makes it easier to compare the usability of regular blogs and blogs using AJAX technology. In this study, we installed three AJAX plugins. First, AJAX Calendar2 was used to find articles for each day and month. This plugin allows the reader to click a special button to show all articles in a specific month, a service which the regular calendar does not offer. When the user clicks that button, AJAX will retrieve all articles in that particular month and display them on the bottom of the calendar. This plugin makes AJAX blogs faster than their non-AJAX counterpart, since it refreshes only this specific part of the page. Second, LiveSearch3 allowed users to search articles within the blog. This plugin shows the results in a pop-up style menu using AJAX technology (similar to how in Google Suggest, as users type each character, the software displays a set of words that relates to these characters to predict what the user is searching for). Finally, Inline AJAX Comment4 allowed users to add comments and auto-update those comments without a full page reload. With AJAX technology, this plugin provides a much smoother, faster commenting feature in the blog. Users can also click to Show or Hide comments. 4.2 Task Scenario A task scenario was designed for readers because most people use blogs in their daily lives to find information about specific interests and participate with other users. The set of tasks is a basic operation readers perform when they visit a blog. The readers will find interesting articles, read them, search for related information, and add comments. In AJAX version, participants complete a set of tasks by using plugins that contain AJAX technology, while in non-AJAX version, participants use the default plugins that come with the original version of WordPress. To test Web usability, participants needed to accomplish a set of tasks that was listed on the instruction sheet. First, participants needed to login as guests. Second, they needed to use the calendar in the left sidebar to find an article named “Blog#2” in September, and post a comment on that article. Third, before writing any comments, participants needed to use the search box in the left sidebar, input the word “dog,” and find the article related to this word. Then, they had to copy the paragraph from the article to add in a comment box of the blog’s article. They needed to do the same set of tasks in both non-AJAX and AJAX 1
http://codex.wordpress.org/Version_2.3 http://wordpress.org/extend/plugins/ajax-calendar/ 3 http://wordpress.org/extend/plugins/livesearch/ 4 http://www.ditii.com/2006/07/07/wordpress-plugin-inline-ajax-comments/ 2
Effects of AJAX Technology on the Usability of Blogs
49
versions. Then, they used an AJAX version one more time at the end of the experiment so we could measure efficiency of use. 4.3 Method and Procedure To identify usability problems, our experiment was conducted on a small group of users as per Nielsen’s suggestion [9]. Nielsen [11] claimed that “[t]he best results come from testing no more than 5 users and running as many small tests as you can afford.” More test subjects would only result in a marginal increase in the number of problems, errors, and different completion times for tasks found [11]. Moreover, the small number of participants for qualitative usability testing is enough [9]. We recruited eight participants for this study. All users had to complete all three experiments (non-AJAX, AJAX for the first time, and AJAX for the second time) within the same day, back to back to back. To decrease participant bias and avoid an order effect resulting from the participants’ expectations and impressions for the next version of the blog after completing the first one, we used counterbalanced design. Half the participants used the non-AJAX version first, then did the same tasks again with AJAX version, while the other half used the AJAX version before the non-AJAX version. After all eight participants finished the set of tasks with these two versions (AJAX and non-AJAX), we asked them to repeat the set of tasks with the AJAX version to measure efficiency of use. We measured whether they improved performance efficiently after they learned how to use the new kind of blog that incorporated AJAX technology the first time around [12]. At the end of the experiment, participants were asked to complete questionnaires about their background, blog experience, and questions about satisfaction with the blogs. After participants finished answering the questionnaire, we conducted postexperiment interviews to collect qualitative data to substantiate quantitative results. 4.4 Usability Measurement In the usability test, we collected quantitative data of both participants’ performance and participants’ preference (Table 1). We collected two types of data: what really happened when participants used the blog (performance data) and what participants thought when they used it (preference data) [10]. For the performance metric, we used the free trial software All In One Keylogger5 for Windows. This software can visually capture users’ mouse movements and to be reported in visual logs and HTML reports. It records where users click on the screen, how they move the mouse, and when they perform certain actions. We used this information to calculate a performance metric for the usability test. To prevent threats to validity, this software has a “hidden mode” feature. Participants were not aware that the researcher observed their movements when they used the blog. For user preference, we used a questionnaire to measure how satisfied the users were when using the blog. In the questionnaire, ratings on a 1 to 5 Likert scale were used to allow for variation in data. For example, to find out to what extent participants prefer any version, the participants could express their feelings from ‘strongly disagree’ (1) to ‘strongly agree’ (5). 5
http://www.relytec.com/download.htm
50
S. Kasemvilas and D. Firpo Table 1. Usability metric (Adapted from [10])
Performance Usability Metric Total time to completion (Time) Number of steps (Step)
Amount of confusion (Confusion) Pathway analysis and the number of user errors (Error) Preference Usability Metric User satisfaction User comments Preference ratings
Usability Measure Ease of learning: - Can participants complete the task scenario quickly? Ease of learning: - How many steps do participants take in order to successfully complete the tasks? Error frequency and severity: - How many times do participants get confused? Error frequency and severity: - How many errors do participants make when they use the blog? Usability Measure Participative satisfaction: - Do participants get pleasure from using the blog? Participative satisfaction: - Are participants confused when they use the blog? Participative satisfaction: - Do participants prefer the design of the blog?
5 Results 5.1 Data Analysis The participants were eight graduate students aged between 20-40 years old. Three of them were male and the other five were female. All participants were familiar with using the Internet, and half of them had their own blogs. In hypothesis H1a, we were interested in whether the ease of learning in blogs using AJAX technology is greater than in regular blogs. H1a was tested by paired sample t-test on Time and Step parameters of participants using non-AJAX blogs and AJAX blogs for the first time (Table 2). The results indicated that the presence of AJAX increases the time needed to complete tasks for first-time users. At the significant level of .05 (1-tailed), users spent significantly more time completing tasks in AJAX blogs than in regular blogs. However, number of steps participants took to complete tasks in AJAX and nonAJAX blogs were not significantly different. Thus, H1a was disconfirmed. In hypothesis H1b, we were interested in whether or not the error frequency and severity in blogs using AJAX technology was lower than in regular blogs. To test H1b, paired sample t-test was performed on the participants’ Confusion and Error parameters when they used non-AJAX blogs and AJAX blogs for the first time (Table 2). At the significant level of .05 (1-tailed), contrary to our hypothesis, users had more confusion and errors in AJAX blogs than in regular blogs. Thus, H1b was also disconfirmed. In hypothesis H1c, we were interested in whether the participation satisfaction of users when they used blogs with AJAX technology was greater than their participation satisfaction when they used regular blogs. We calculated mean and standard deviation to examine whether the average preference of users when using non-AJAX blogs was different from when they used AJAX blogs. We tested the hypothesis H1c by using paired sample t-test of preference between the two versions
Effects of AJAX Technology on the Usability of Blogs
51
Table 2. Difference of performance scores between AJAX for the first time (AJAX1) and NON-AJAX Usability Dimension (N = 8) Time Step Confusion Error
AJAX1 M SD 455.88 144.21 13.13 4.36 6.25 5.31 4.50 5.10
NON-AJAX M SD 322.13 109.90 14.75 3.92 1.50 2.73 0.50 0.76
t
p
2.01 -0.60 1.91 2.11
.042 .284 .049 .037
Table 3. Difference of preference scores between AJAX and NON-AJAX Usability Dimension (N = 8) Satisfaction
AJAX M SD 3.58 0.97
NON-AJAX M SD 3.13 0.56
t
p
0.89
.201
Table 4. Difference of performance scores between AJAX for the first time (AJAX1) and AJAX for the second time (AJAX2) Usability Dimension (N = 8) Time Step Confusion Error
AJAX1 M SD 455.88 144.21 13.13 4.36 6.25 5.31 4.50 5.10
AJAX2 M SD 176.13 86.63 9.13 1.25 0.13 0.35 0.00 0.00
t
p
5.87 2.50 3.20 2.50
.000 .021 .008 .021
of blogs, non-AJAX and AJAX (Table 3). The results indicated that, at the significant level of .05 (1-tailed), users’ satisfaction with AJAX blogs was not greater than their satisfaction with regular blogs. Thus, H1c was not supported. In hypothesis H2, we were interested in whether the efficiency of use in blogs using AJAX technology is high when users have used AJAX-enhanced blogs before. Thus, H2 was tested by paired sample t-test on participants’ Time, Step, Confusion, and Error parameters when they used AJAX for the first time and when they used it again for the second time (Table 4). At the significant level of .05 (1-tailed), users spent less time, took fewer steps, with less confusions and errors in AJAX blogs the second time around. Thus, H2 was confirmed. From the data, participants using AJAX for the first time took more time to finish the task (Figure 1), felt more confused, and made more errors compared to when they did the same set of tasks without AJAX. Therefore, H1 was disconfirmed. However, in H2 when using the AJAX version for the second time, participants spent less time (Figure 1), used fewer links, were less confused, and made slightly fewer errors than when they performed the set of tasks without AJAX. Thus, the data supports H2. This indicates that learning is a very important step for introducing a new technology.
52
S. Kasemvilas and D. Firpo
Total Time to Completion 800 700
687 637
Time (seconds)
600 500
497
475
454
436
409
400
376
300
370 326
298
AJAX1
339 299
308
309
295
AJAX2
246
215
200
Non-AJAX
164 127
106
100
123
117
119
0 1
2
3
4
5
6
7
8
Participants
Fig. 1. This graph shows the time to completion of each participant when each participant used Non-AJAX blogs, AJAX blogs for the first time, and AJAX blogs for the second time. Three participants out of eight spent less time when they used the AJAX version for the first time as compared with the non-AJAX version. Seven out of eight spent less time on the AJAX version the second time as compared with the non-AJAX version. All participants spent less time when they used the AJAX version for the second time as compared with the first time.
5.2 Post-experiment Interview Although the number of participants was not large, which may cause the power of the statistical test to be low, the results of most statistical analyses reached significant level of alpha .05. However, most of the results surprisingly stand in direct contrast to our hypothesis. Thus, we would like to triangulate the results using both quantitative and qualitative methods. We conducted post-experiment interviews to collect impression of participants when they used two versions of blogs and to see whether their satisfaction matched their performance when they worked with the blogging software. Some sample questions were asked such as: Were you confused when you used the AJAX blog for the first time? Why? If you prefer the AJAX blog to the non-AJAX blog, please give your reasons why. In the study, we had eight participants, and two of them did not like the AJAX version because the interface was more complicated than a non-AJAX version. One participant explained that I prefer non-AJAX version especially if I know exactly what I am searching for. AJAX version confuses my usage. In general, I prefer simplicity rather than sophistication when I search any web browsers. Another participant said: I don’t like it because it is too complicated. It is not necessary. The rest of the participants liked the AJAX version because it provided functions that help users do their jobs faster and more interactively. The following comments point out the potential benefits of AJAX version:
Effects of AJAX Technology on the Usability of Blogs
53
It’s much easier to find what I want using calendar and search box. I like search box the most due to the ease of use. It works like Google Suggest. The interface is much better than non-AJAX version. The AJAX blog has functions that help users do their jobs faster. I love the search box. AJAX blog has more functions and takes less time to refresh. It’s more useful when one knows how it works. AJAX should have increased usability performance and preference, and while the interviews showed that most of the participants liked AJAX, the statistical results did not support our first hypothesis. This may be because some of the AJAX-specific features were confusing for them when compared with regular blogs. Participants expressed that when they used the AJAX blog, they felt confused with issues such as how AJAX Calendar only changes a small portion of the screen. They did not understand how it worked and found it difficult to use when compared with the nonAJAX version. This may be explained with the need for time to get used to new technology. Participants’ performances were low when they used the AJAX blog for the first time, and they confessed that they had not knowingly used AJAX technology before. Thus, they felt unfamiliar with the new interface conventions. However, the participants’ performance when they used AJAX for the second time showed that after the users learned and understood how to use AJAX technology, their performance improved significantly.
6 Discussion and Conclusion This study attempts to measure how AJAX technology affects Web usability when users use a blog. We designed two versions of a blog, which have a similar user interface. However, WordPress provides many different theme styles. Thus, a theme chosen in this study may not have the same result as if we had used other themes. The experiment was controlled in a closed environment to record users’ mouse movements but it still depended on the speed of the Internet and CPU of the computer used during the experiment. This may cause delay times or load times that do not relate to user performance. Kluge et al’s [5] study shows that AJAX technology increases efficiency of use and satisfaction in AJAX Web application in some task scenarios, but our study showed that AJAX technology does not always increase usability. This may point out that learning for new technology is vital, especially when users are familiar with traditional technology. In the United States, the National Institute of Standards and Technology (NIST) has begun to address some of the AJAX technology issues in the need for Web administrators and IT Management to monitor usability and security of Webcode design, development, test, and maintenance [13]. Blogs are a prevalent Web 2.0 tool that has been widely adopted amongst a broad subset of society, including many users who are not particularly tech savvy. To us, it is important to investigate what happens when one applies new technology to a tool so we can learn how to improve the technology and enhance human computer interaction. From our results, we can see
54
S. Kasemvilas and D. Firpo
that although in an easy-to-use tool with widespread adoption, such as blogs, there are many challenges to overcome in applying new technology that users are not familiar with. From this perspective, the results of this paper suggest the problems of using AJAX technology in a blog and may help Web developers use AJAX technology to improve Web usability of a blog.
References 1. Garrett, J.J.: Ajax: A New Approach to Web Applications, http://www.adaptivepath.com/ideas/essays/archives/000385.php 2. Paulson, L.D.: Building Rich Web Applications with Ajax. Computer, 14–17 (2005) 3. Williams, J.B., Jacobs, J.: Exploring the Use of Blogs as Learning Spaces in the Higher Education Sector. Australasian Journal of Educational Technology 20(2), 232–247 (2004) 4. West, J.: Ajax: not just another acronym or is it? Searcher 14, 13–15 (2006) 5. Kluge, J., Kargl, F., Weber, M.: The Effects of the AJAX Technology on Web Application Usability. In: WEBIST 2007 International Conference on Web Information Systems and Technologies, pp. 289–294 (2007) 6. Krug, S.: Don’t Make Me Think: A Common Sense Approach to Web Usability. New Riders Press, New York (2000) 7. Oulasvirta, A., Salovaara, A.: A Cognitive Meta-analysis of Design Approaches to Interruptions in Intelligent Environments. In: Conference on Human Factors in Computing Systems, pp. 1155–1158. ACM, New York (2004) 8. Usability gov., http://www.usability.gov/basics/whatusa.html 9. Jakob Nielsen’s Alertbox: Usability 101: Introduction to Usability, http://www.useit.com/alertbox/20030825.html 10. Usability gov., http://www.usability.gov/basics/measured.html 11. Jakob Nielsen’s Alertbox: Why You Only Need to Test With 5 Users, March 19 (2000), http://www.useit.com/alertbox/20000319.html 12. Nielsen, J.: Usability Engineering. Morgan Kaufmann, San Francisco (1993) 13. National Institute of Standards and Technology, http://csrc.nist.gov/publications/nistpubs/800-28-ver2/ SP800-28v2.pdf
Usability Evaluation of Dynamic RSVP Interface on Web Page Ya-Li Lin and Darcy Lin Department of Statistics, Tunghai University, Taichung, Taiwan 40704
[email protected]
Abstract. The usability of rapid serial visual presentation (RSVP) interface was evaluated using subjective preference questionnaire and performance measurement methods. Forty-two students voluntarily participated in this study. The results indicated the shelf interface moving from bottom-left to upper-right along a linear trajectory with moving speed of 20~30 frame per second (FPS) are most preferable. The carousel interface following circular trajectory in clockwise with moving speed of 10~15 FPS are most preferable. “Meets user experience”, “aesthetic and simple design”, “effective to use”, and “easy to learn” all conform to the usability goals. In addition, the results based on performance measurement showed a logistic regression model with RSVP mode and moving speed are fitted very well. There is the highest probability estimation of correct recognition for the carousel interface and moving speed of 30 FPS, however, the shelf interface and 15 FPS has the lowest probability estimation of correct recognition. Keywords: Dynamic Interface, Subjective Preference, Rapid Serial Visual Presentation (RSVP), Usability Evaluation.
1 Introduction Search for stock and weather information, prices for flights and mortgages, and new book issued is common in Internet search. A typical search session consists of: (1) formulating and entering the query, (2) browsing the search results, and (3) viewing selected result page. Our work aims to investigate and provide a user-centered interface for browsing the search results in the process of search session. Once a user has launched a query, the search engine must look in a variety of databases and return a set of relevant results. There are multiple ways to deliver information to the user and multiple ways to let the user use the result. However, there must be a phased implementation of content searches, both from a consumer usability perspective, as well as an advertiser/merchant perspective. Performance measures will be carrying out on the second phase of browsing the search results. Foster (1970) first used Rapid Serial Visual Presentation (RSVP) to mean rapidly displaying words in a sequence in the same visual location. RSVP originated as a tool for studying reading behavior [3], but lately has received more attention as a M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 55–64, 2009. © Springer-Verlag Berlin Heidelberg 2009
56
Y.-L. Lin and D. Lin
presentation technique with a promise of optimizing reading efficiency, especially when screen space is limited [9]. The reason for the interest is that the process of reading works a little different when RSVP is used and that it requires much smaller screen space than traditional text presentation [8]. RSVP is a method of displaying information using a limited space in which each piece of information is displayed briefly in sequential order [2, 4, 5, 11]. With the development of dynamic design, fastmoving RSVP interface could emphasize its advantage of showing more image information at a time, but compared with slow-moving RSVP interface, its relative advantage could be less mental workload [8]. Can user experience of search results be improved by using dynamic RSVP interface? The images of shelf RSVP interface shown in the fixation area are used to compare with carousel RSVP interface [2, 11]. We are going to provide usability evaluation of image visualization of dynamic RSVP interface in this study. The objective of this study is to evaluate the usability of RSVP interface using subjective preference questionnaire and performance measurement methods. A prototype of simulated E-bookstore system is designed to collect the subjective preference ratings of predetermined designing factors at the beginning of the study. To evaluate the usability for web users, usability evaluation is used to achieve specified goals with effectiveness, efficiency, learnability, memorability, and user satisfaction [7]. Both RSVP display (carousel and shelf) and moving speed (10, 15, 20, 30, and 40 FPS) were varied in the simulated interface of E-bookstore. We would like to propose the following researcher’s hypotheses: (1) Could the design factors, such as RSVP, moving speed, and moving direction affect the subjective preference rating on dynamic RSVP interface? (2) Could the design factors affect the performance of recognition on dynamic RSVP interface? (3) Are there usability goals conforming to user experience?
2 Design of the Dynamic RSVP Interface The simulated E-bookstore interface would contain contents of web searching result. The searching results will be shown on the dynamic RSVP interface as the experimental Web pages. Two kinds of RSVP interfaces were considered based on their trajectory. The carousel RSVP interface is defined as a series of images display appear successively running from the bottom of page in a clockwise (Carousel I) or counterclockwise (Carousel II) along the circular trajectory. The shelf RSVP interface is defined as the linear trajectory of the images followed the diagonal running from bottom-left to upper-right (Shelf-I), from bottom-right to upper-left (Shelf-II), from upper-right to bottom-left (Shelf-III), and from upper-left to bottom-right (Shelf-IV). Specifications of design factors and their factor levels for subjective preference questionnaire and performance measurement are shown in Table 1. The prototypes of simulated E-bookstore interface used in the preference-based phase were illustrated in Table 1. The layer design and the number of frames per second (FPS) were used to produce the moving effect of image visualization. FPS in Micromedia Flash MX means the moving speed for each image [6]. The exposure times for one image are 20, 13.3, 10, 6.67 and 5 seconds corresponding to 10, 15, 20, 30 and 40 FPS. The task assigned to each participant is to browse the searching results after entering a query.
Usability Evaluation of Dynamic RSVP Interface on Web Page
57
Table 1. The specifications of design parameters and their factor levels for dynamic RSVP interface Design parameter RSVP Trajectory
Factor level Carousel I Circular Clockwise
Carousel II Circular Counterclockwise
Shelf I Shelf II Linear Linear Bottom-left to Bottom-right upper-right to upper-left
Shelf III Linear Upper-right Moving to bottomdirection left Growing to Growing to Constant to Constant to Growing to Image size Shrinking Shrinking Shrinking Shrinking Constant Dynamic Dynamic Dynamic Dynamic Dynamic Image position Bottom-right Bottom-left Position of the From 9-12-3 From 3-12-9 Bottom-left o’clock maximum image o’clock Number of 5 5 5 5 5 images visible Total number 10 10 10 10 10 of images
Shelf IV Linear Upper-left to bottomright Growing to Constant Dynamic Bottomright 5 10
Example
3 Research Methods Before the usability experiment the preparation work included the selection of participants and experimental factors, construction and design of the experimental Web pages and the dynamic RSVP Interface, and design of searching results. 3.1 Subjective Preference Questionnaire The subjective preference questionnaire is a structured field of usability assessment. It is useful in the early stages of user-centered design development. The International Organization for Standardization (ISO) defines usability of a product as “the extent to which the product can be used by specified users to achieve specified goals with effectiveness, efficiency, and satisfaction in a specified context of use.” Usability is generally regarded as ensuring that interactive products are easy to learn, effective to use, and enjoyable from user’s perspective [10]. More specifically, usability is broken down into the following goals: effectiveness, efficiency, safety, utility, learnability, and memorability. 3.2 Participants Forty-two undergraduate and graduate students (21 females and 21 males) coming from Tunghai University voluntarily participated in the subjective preference questionnaires. The distribution of age ranged form 23 to 30 years old (mean age of 24.6 years old and standard deviation of 1.72 years old). They all had the experience of surfing the internet and had normal vision or corrected vision reaching at least 20/25 and no color-blindness.
58
Y.-L. Lin and D. Lin
3.3 Experimental Design Dynamic RSVP interface consisted of ten images shown in turn on the Web page of Ebookstore (see Figure 1). Objective function is defined as the correct recognition of targeted image. Design factors are RSVP mode and moving speed. RSVP modes include clockwise and counterclockwise carousel RSVP and four types of shelf RSVP modes (shelf I-IV) (see Table 1). Moving speeds include five levels of 10, 15, 20, 30, and 40 FPS which their exposure time for each frame is 20, 13.3, 10, 6.67, and 5 seconds respectively. Each participant continuously viewed sixteen different searching results imposed on Web pages of E-bookstore and a recognition task was assigned.
(a)
(b)
Fig. 1. Illustration of (a) shelf RSVP and (b) carousel RSVP shown on the simulating E-bookstore interface
3.4 Experimental Procedure After filling in the self-reported background document, the rules of answering subjective preference questionnaire were explained by the experimenter. The varied combinations of RSVP interface on the simulated E-bookstore Webpage were shown one factor at a time. Subjective preference questionnaire was implemented associated with a simulated E-bookstore interface. The favorite display type of RSVP interface on the simulated E-bookstore Webpage was chosen individually by each participant until she/he has finished all the question items of subjective preference questionnaire. In addition, each participant continuously viewed sixteen different searching results presented on Web pages of E-bookstore and a browsing task was assigned. The participants are asked to correctly recognize whether a targeted image has been shown or nor after they finished the browsing task. The questionnaire for user interface satisfaction (QUIS for short) will be implemented after finishing the experiment of performance measurement. 3.5 Apparatus and Materials This study uses a Pentium IV desktop computer (CPU1.62GHZ, 896MB RAM) with Microsoft Internet Explorer 6.0, a 17-inches TFT-LCD monitor (1280×1024 pixels). Micromedia Flash, Dreamweaver and Firework MX 2004 (copyright @Cyberlink Corporation) were used to design the simulated E-bookstore Webpage.
Usability Evaluation of Dynamic RSVP Interface on Web Page
59
3.6 Model Building of Recognition Based on the design of experiment, the objective function of browsing task is collected. Logistic regression model is appropriate for the fitting of probability of correct recognition [1]. Design factors include RSVP mode and moving speed. RSVP modes include carousel and shelf RSVP displays based on the major difference of circular and linear trajectory (Table 1). Moving speeds include four levels of 10~15 (the groups of 10 and 15 FPS being combined due to the consideration of sample sizes), 20, 30, and 40 FPS with the exposure time of 20~13.3, 10, 6.67, and 5 seconds per frame respectively. In addition, gender and college background variables are considered as individual difference. Define Y as the recognition variable of targeted image. The value of Y equals 1 if the participant could correctly recognize the targeted image; otherwise, Y equals 0. Let π be the probability of correct recognition, we have the odds of correct recognition to be [π/(1 - π )] . The logit function log [π/(1 - π )] of π , symbolized by “ logit (π ), ” is the log odds of correct recognition. Whereas π is restricted to the 0-1 range, the logit can be any real number. The proposed model for the fitting of probability of correct recognition initially concludes the main effects of gender, college, RSVP mode, and moving speed as well as the interaction of RSVP mode and moving speed and is shown as follows: π = P( Y = 1 | X ) =
exp (X ′β ) , 1 + exp( X ′β )
(1)
where X denotes the design matrix of two-factor interaction of RSVP mode (RSVP for short) and moving speed (FPS for short), gender (G for short), and college (C for short), that is, X ′ = [1 : G, C , RSVP | FPS] (use “|” for interaction), β is the parameter vector corresponding to X the logistic regression model is expressed as follows:
,
⎛ π ⎞ logit[P(Y = 1 )] = logit(π) = log⎜ ⎟ = X ′β , ⎝1− π⎠
(2)
The nominal-scale explanatory variable with k categories in Equations (1) and (2) is appropriate to be treated using (k-1) indicator variables. For example, design factor RSVP is a categorical variable with two categories using one indicator variable. FPS may be regarded as continuous or regarded as categorical with four categories. If FPS is regarded as nominal-scale explanatory variable, it is going to use three indicator variables to describe their four categories. The frequencies of recognition for the groups of 10 and 15 FPS are combined and renamed as FPS15. We have the value of FPS15 equals 1 if the moving speed is 10 FPS or 15 FPS; otherwise, FPS15 equals 0. Similarly, the value of FPS20 equals 1 if the moving speed is 20 FPS; otherwise, FPS20 equals 0. The value of FPS30 equals 1 if the moving speed is 30 FPS; otherwise, FPS30 equals 0. The value of FPS40 equals 1 if the moving speed is 40 FPS; otherwise, FPS40 equals 0. Let (G, C, RSVP, FPS15, FPS20, FPS30) each take values 0 and 1 to represent the nominal-scalar categories of explanatory variables. The coding values of indicator variables corresponding to the nominal-scale explanatory variables are described as follows:
60
Y.-L. Lin and D. Lin ⎧1, if Female , G=⎨ if Male ⎩0,
⎧1, if major in Art and Design C =⎨ if major in Management ⎩0,
⎧1, if carousel mode , RSVP = ⎨ otherwise ⎩0,
⎧1, if FPS = 20 FPS 20 = ⎨ ⎩0, otherwise
,
⎧1, if FPS = 10 or 15 , FPS15 = ⎨ otherwise ⎩0, ⎧1, if FPS = 30 FPS 30 = ⎨ ⎩0, otherwise
Rewrite Equation (2) as following: ⎛ π ⎞ logit[P(Y = 1)] = logit(π ) = log⎜ ⎟ = β 0 + β1G + β 2C + β 3RSVP + β 4 FPS15 ⎝1− π ⎠ + β 5 FPS20 + β 6 FPS30 + β 7 RSVP × FPS15 + β 8RSVP × FPS20 + β 9 RSVP × FPS30,
(3)
The parameter corresponding to indicator variable RSVP in Equation (3) are β 3 . The value of e β 3 represents the odds ratio defined as the ratio of correct recognition odds between carousel and shelf RSVP interfaces. The values of FPS15 = 1, FPS 20 = 0, FPS30 = 0 in Equation (3) are being substituted for moving speed of 15 FPS. The values of FPS15 = 0, FPS 20 = 1, FPS30 = 0 are being substituted for moving speed of 20 FPS. The values of FPS15 = 0, FPS 20 = 0, FPS30 = 1 are being substituted for moving speed of 30 FPS. The parameters corresponding to indicator variables FPS15 , FPS 20 , and FPS 30 in Equation (3) are β 4 , β 5 and β 6 . The value of e β 4 represents the odds ratio defined as the ratio of correct recognition odds between 15 FPS and 40 FPS. Similarly, the values of e β 5 and e β 6 represents the odds ratios of correct recognition between 20 FPS and 40 FPS as well as between 30 FPS and 40 FPS.
4 Results and Discussion 4.1
Comparison of Subjective Preference
Based on the result of subjective preference questionnaire, the favorite percentage distribution of moving direction for RSVP displays is shown in Figure 2. For shelf RSVP display, 57% of users chose the direction of moving from bottom-left to upperright as their favorite one, however, only 5% of users chose the direction of moving from bottom-right to upper-left (Figure 2(a)). The differences of subjective preference proportions among four moving directions of shelf RSVP display are statistically 2 significant ( χ = 25.62 , P-value <0.001). For carousel RSVP display, 69% of users chose the moving direction of clockwise as their favorite one (Figure 2(b)) and there is 2 a significant difference between clockwise and counterclockwise directions ( χ = 6.10 , P-value= 0.0136). In addition, the disfavored percentage distribution of moving speed for RSVP displays is shown in Figure 3. There are 40% of users choosing 40 FPS (the fastest speed) as their disfavored moving speed and 36% of users choosing 10 FPS (the slowest speed) as their disfavored moving speed (Figure 3(a)). The differences of disfavored proportions among five moving speeds of shelf RSVP display are
Usability Evaluation of Dynamic RSVP Interface on Web Page
5% 17%
57%
21%
Bottom-left to upper-right Upper-left to bottom-right Upper-right to bottom-left Bottom-right to upper-left
61
Clockwise
31%
Counterclockwise 69%
Fig. 2. The favorite percentage distribution of moving direction for (a) shelf and (b) carousel RSVP displays
36%
40%
7%2% 7%
10FPS
15FPS
15FPS
20FPS
20FPS 7% 5%
12%
30FPS
30FPS 40FPS
10FPS
84%
40FPS
Fig. 3. The disfavored percentage distribution of moving speed for (a) shelf and (b) carousel RSVP displays 2 statistically significant ( χ = 23.71, P-value <0.001). For carousel RSVP display, there are as many as 84% of users choosing 40 FPS (the fastest speed) as their disfavored moving speed (Figure 3(b)). The differences of disfavored proportions among five 2 moving speeds are statistically significant ( χ = 76.48 , P-value <0.001).
4.2 Logistic Regression Model Fitting Iteratively compare models and conduct inference about parameters to fit the recognition data. The best fitting of logistic regression model is , ⎛ πˆ ⎞ log it (πˆ ) = log⎜ ⎟ = 1.276*RSVP − 1.084*FPS15 − 0 .023*FPS 20 + 1.323*FPS 30 ⎝ 1 − πˆ ⎠
(4)
The estimated correct recognition rate (ECRR) is obtained by the following estimated probability of correct recognition. ECRR = πˆ =
exp( X ′βˆ )
1 + exp( X ′βˆ ) exp(1.515 + 1.276 * RSVP − 1.084 * FPS15 − 0.023 * FPS 20 + 1.323 * FPS 30) = 1 + exp(1.515 + 1.276 * RSVP − 1.084 * FPS15 − 0.023 * FPS 20 + 1.323 * FPS 30)
,
(5)
The parameter estimate corresponding to indicator variable RSVP in Equation (5) are 1.276. The value of e1.276 = 3.6 represents the estimated odds that carousel RSVP
62
Y.-L. Lin and D. Lin
interface provides correct recognition of a browsing task odds are 3.6 times the estimated odds for shelf RSVP interface. It indicates carousel RSVP interface provides higher ECRR than shelf one. Similarly, moving speed of 30 FPS provides higher ECRR than others since the parameter estimates corresponding to indicator variables FPS15, FPS20, and FPS30 in Equation (5) are -1.084, -0.023, and 1.323. The highest ECRR is 0.9839 for the combination of carousel RSVP and 30 FPS, however, the combination of shelf RSVP and 15 FPS has the lowest ECRR of 0.6060. Based on the performance measure of recognition, the best combination of correct recognition is carousel RSVP interface and 30 FPS and the worst combination of correct recognition is shelf RSVP interface and 15 FPS. 4.3 Statistical Tests for QUIS The result of questionnaire for user interface satisfaction is illustrated in Figure 4. There are 86% of users agreeing upon this interface is easy to learn and reaching 2 statistical significance ( χ = 21.43 , P-value <0.001). It means RSVP interface is not only providing information visualization on Webpage, but also providing the function with ease to learn. There are 69% of users agreeing upon this interface is effective to 2 use and reaching statistical significance ( χ = 6.10 , P-value =0.014). It means RSVP interface would carry out browsing tasks efficiently and provide the function with effective to use in a limited space without scrolling the Webpage. In addition, dynamic Catch my attention
31
11
Aesthetics
14
28
Efficiency
13
29
0%
Agree
36
6
Learnability
Disagree
20%
40%
60%
80%
100%
Fig. 4. Frequency (Percentage) distributions of agreeing upon the heuristic principles Table 2. Usability evaluation for user experience
Chi-squared Test Criteria Easy to learn Effective to use Efficient to use Aesthetics Attraction
χ2
P-value1
21.43 6.10 1.52 4.67 9.52
<0.001* 0.014* 0.217 0.031* 0.002*
Note 1: “*” denotes it reaches significance level of 0.05.
Usability Evaluation of Dynamic RSVP Interface on Web Page
63
RSVP interface would also reduce the time of saccadic eye movement to reach efficiency. Over 60% of users (67%) agree upon this interface conforming to the 2 principle of aesthetics and reach statistical significance ( χ = 4.67 , P-value=0.031). Over 70% of users (74%) agree upon catching user’s attention for this RSVP interface 2 and reach statistical significance ( χ = 9.52 , P-value =0.002). It indicates easy to learn, effective to use, aesthetics and attracting user’s attention all conform to the usability principles except the principle of efficient to use.
5 Conclusions Based on the results of subjective preference questionnaire, the design of preferencebased search results interface for Web users will be suggested in this study. For shelf RSVP interface, users prefer moving direction from bottom-left shrinking to upperright and moving speed between 20 and 30 FPS (exposure time is about 6.67~10 seconds). For carousel RSVP interface, users prefer moving direction of clockwise and moving speed between 10 and 15 FPS (exposure time is about 13.33~20 seconds). However, based on the performance measure of recognition, the best combination of correct recognition is carousel RSVP interface and 30 FPS and the worst combination of correct recognition is shelf RSVP interface and 15 FPS. It looks like individual bias exists between users and needs to investigate the possibility deeply. Based on the questionnaire for user interface satisfaction (QUIS), easy to learn, effective to use, aesthetics, and attraction all conform to the usability principles except the principle of efficient to use. Acknowledgements. The support of the National Science Council, Taiwan (grant NSC 97-2221-E-029 -011) is gratefully acknowledged.
References 1. Agresti, A.: An Introduction to Categorical Data Analysis, 2nd edn. John Wiley & Sons, Inc., Chichester (2007) 2. De Bruijn, O., Spence, R.: Patterns of eye gaze during rapid serial visual presentation. In: Proceedings of Advanced Visual Interface (AVI 2002), Trenton, Italy, pp. 209–217 (2002) 3. Foster, K.L.: Visual perception of rapidly presented word sequences of varying complexity. Perception & psychophysics 8, 215–221 (1970) 4. Lin, Y.L., Ho, C.M.: Evaluation of RSVP and display types on decoding performance of information extraction tasks. In: Stephanidis, C. (ed.) HCI 2007. LNCS, vol. 4556, pp. 380–388. Springer, Heidelberg (2007) 5. Lin, Y.L., Wang, P.C.: Effects of RSVP and Graphical Displays on the Visual Performance of Mobile Devices. In: International Conference on Applied Human Factors and Ergonomics (AHFE), Las Vegas, USA, July 14-17 (2008) 6. Micromedia Flash MX (2004), http://www.adobe.com/support/documentation/en/flash/ 7. Nielsen, J.: Ten usability heuristics (2005), http://www.useit.com/paper/heuristic/heuristic_list.html
64
Y.-L. Lin and D. Lin
8. Öquist, G., Goldstein, M.: Towards an improved readability on mobile devices: Evaluating adaptive rapid serial visual presentation. Interacting with Computers 5, 539–558 (2003) 9. Rahman, T., Muter, P.: Designing an interface to optimize reading with small display windows. Human Factors 41, 106–117 (1999) 10. Sharp, S., Rogers, Y., Preece, J.: Interaction Design: Beyond Human-Computer Interaction, 2nd edn. John Wiley & Sons, Ltd., Chichester (2007) 11. Spence, R.: Rapid, serial and visual: a presentation technique with potential. Information Visualization 1(1), 13–19 (2002)
“Online Legitimacy”: Defining Institutional Symbolisms for the Design of Information Artifact in the Web Mediated Information Environment (W-MIE) Emma Nuraihan Mior Ibrahim and Nor Laila Md Noor Department of System Sciences, Faculty of InformationTechnology and Quantitative Sciences, Universiti Teknologi MARA, 40450, Shah Alam, Selangor, Malaysia {emma,norlaila}@uitm.edu.my
Abstract. The global nature of the Internet raises questions about variety of ways, whether and how trust is established that guide people’s behavior and beliefs. This study explores on the understanding of trust from the non technical perspectives in the context of web mediated information environment (W-MIE); conceptualized within the notion of online legitimacy [1]. We take up the problem of how to enhance the trustworthiness of information on the web through the design deployment that can be rationalized and understood by the ordinary users. The paper highlights four dimensions of design elements that make up the Institutional Trust Inducing Features framework [2] which warrants increased attention. This paper is merely situating our comments in designing information artifact within a sensitive context that is culturally imbued beyond the typical security scope but rather the conceptual understanding on how user’s engage with information interactions. Keywords: information artifact, culturally sensitive design, online legitimacy, web mediated information environment (W-MIE), institutional symbolisms.
1 Introduction As the Internet becomes more pervasive in our everyday lives, our social and economic aspects now are governed by the ‘virtual’ world where interaction are mediated or executed with technology. Its emergence has become the critical part of the overall infrastructure of a society, affecting the social, community, cultural and political life. However, these interactions via the web involved different types and level of risks that are either caused by the uncertainty of using open technological infrastructure for the electronic exchange or can be explained by the conduct of users who are involved in the exchange activities [3]. This is due to the fact that in an online environment the degree of uncertainty of economic transaction is higher than in traditional settings. Today, however, consumer’s interaction is not only involved within the interpersonal or inter-organizational transaction within the electronic exchange model (e.g. e-commerce) but also in the knowledge transaction and exchange within the information exchange mode [4] (e.g. providing services in terms of online advices, information, discussion on topics like career, relationship, M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 65–73, 2009. © Springer-Verlag Berlin Heidelberg 2009
66
E.N.M. Ibrahim and N.L. Md Noor
matrimonial, health, financial, legal, politics and religion sermons). These are some of the evidences that the user nowadays are extending their web uses to access information about matters that affect their lives, also to establish personal and organizational connections. Nevertheless, issues like fraudulent behavior, forgery and pretense, questions concerning the original and the copy [5], the evaluation of goods that are the object of commercial transactions have given rise to new problems in the electronic mediated environment. What is at stake here is the entire range of mechanisms that will facilitate interpersonal and inter-organizational transactions, given the new conditions for knowledge transactions and exchanges: increasing specialization, increasing asymmetrical distribution of information and assessment capabilities, greater anonymity among interculotors and more opportunities for forgery identity [4]. As more and more security breaches occurred due to malicious or innocent attacks, the public opinion on security and trustworthiness of using the Internet for online activities has been towards an attitude of distrust. Hence, the value of trust for a robust online world is obvious. It reduces the complexity of a chaotic situation [6]. In the HCI literature, much of the initial research on consumer’s judgment of trust on information is conceptualized through its credibility perceptions [7] or quality indicators [8]. However some of the works are heavily criticized because the operationalization of trust was not understandable [9]. However, empirical research in this area is beset by conflicting conceptualizations of the trust constructs, inadequate understanding of the relationship between trust and its antecedents and consequents and the frequent use of trust scales that are neither theoretically derived nor rigorously validated [9]. 1.1 Trust within the W-MIE The notion of trust in information conforms to the interpersonal model of trust whereby it is a social attitude of the trustor towards a technological artifact (the trustee), in this case the electronic information or document such as web page or electronic article [10]. A person may browse or retrieve information for several reasons, e.g. as an evidentiary support for a decision making process, as reference material or facts to supplement one’s knowledge. However, limitations can be seen through the questionable quality of the information provided and the risk of getting false information [8]. Less critical and uninformed people are more likely to accept an untruth as a truth [8]. Falsity on the web is seldom revealed because there is too much information. The more information is put on the Internet, the chance of discovering misinformation increases. In addition, most people neither have the time to verify its accuracy nor go back to the same site because the browser may fail to find it again e.g. broken links [11]. Hence, deliberate users trusting decision to use their own knowledge to evaluate the information in its own terms. It is noted, trust exercises on consumer behavior and decision making processes [6]. The Internet spans the globe in all languages and culture. Users and organizations communicate their business ideas, knowledge and information across vast distances. When people are engaged in the knowledge and information exchanges in the virtual world, it is critical to avoid misunderstanding and misinterpretations. Users must comprehend accurately the meaning of what is said. How things are said is as important as what actually is said. This is inhibited by differences in value systems, attitude, beliefs, and
“Online Legitimacy”: Defining Institutional Symbolisms for the Design
67
communication styles. Such differences shall be taken into account in order to ensure that the design of an interface are usable and acceptable as the cultural background of users which in turn affects how they operate and interact with an interface. The communication style one uses for generating ideas, exchanging opinions, sharing knowledge and expressing ideas is indeed cultural centric [12]. However, these key issues rooted in deep cultural identities represented via the interface element within information context have not been fully explored and understood empirically. Some researchers have done work in the area of culture and design [13] but results have been either inconclusive or unrelated to develop an IS for information settings in sensitive context. Moreover there is no consensus as to how the trust constructs should be operationalized. Clearly new methods need to be devised to “certify” the knowledge circulating on the Internet within a context where inputs are no longer subject to control [4]. Another big issue concerns regulation and social behavior and the formation of cooperation based upon trust and shared ethos/ identity in virtual context [14]. This is because, trust and culture are interconnected. The meaning, antecedents, and effects of trust are indeed determined by one’s culture [14]. Indeed, there is a longstanding interest in designing information and computational systems that support enduring human values within sensitive context of design [15]. The need of a deeper understanding for design can be obtained by taking an information perspective on design activities. Under this perspective the major unit of analysis is the information transaction or known as design informatics – the specific needs and tasks associated with capturing, storing, updating, linking and accessing information by describing them with a technologically-neutral vocabulary. This approach offers a strategy for developing a more unified view of design which in turn can provide insight into the requirements of design information systems and elucidate new areas of design competency and opportunity. By analyzing information needs of design and how design teams create capacities to satisfy these needs, we may begin to recognize the invariant, technologically-neutral requirements that emerge from any design methodology. Our goal here is to position our arguments from a non-technical point of view of designing an information artifact which is culturally sensitive in context and design requirements – a theoretically driven approach.
2 Conceptualization of Online Trust in W-MIE In the IS community and the wider human computer interaction (HCI) aspects, trust has been discussed widely in the context of e-tailing environment (e.g. e-commerce) varies in its models, dimensions and constructs [3]. The problems of trust often conceptualized rather loosely to technical security [3, 10] and technologies mechanisms of understanding such as encryption, communication protocols, cryptography and trusted information architectures [16]. It focuses on the tangible trust or hard trust dimensions comprising formal mathematical and cognitive models of trust. The emphasis is placed on the role of trust for e-commerce adoption and the short term transactional values. Nevertheless, we are not interested in addressing neither trust nor trustworthiness as security or through security but are guided by conceptions of trust developed in the theoretical and empirical work of social scientists and philosophers.
68
E.N.M. Ibrahim and N.L. Md Noor
We contend that online trust will not be achieved through security because that vision is founded on a misconstrued notion of trust, missing the point on why we care about trust and making mistaken assumptions about human nature along the way. This separates the view of trust from the conceptual and technical scope because the technological realm of which we speak is so extensive and intricate, and the conceptual domain of trust so broad and varied hence we must not make some qualifications and simplifying assumptions. In addition, the technical point of view on trust derives from the worry about the dependability of these systems, their resilience to various forms of failure and attack and their capacity to protect the integrity of online interactions and transactions. These cases are sufficiently distinct from the W-MIE context that they deserve separate treatment in terms of its setting and veiling properties that affect the formation, readiness or inclination to trust. Hence we cannot rely on traditional mechanisms for articulating and supporting trust in W-MIE as we lack the explicit framework of assurance that support them. We argued that the “logical” model or factor is not sufficient to model of how natural actors behave. Although some of these measures are surely useful and needed, we believed that the idea of total control and a purely technical solution to protect against deception and to favor non-self interested cooperation is unrealistic. Undeniably, the fact that to understand rational actors (human beings) one must take both affect (emotion, values or socialization) and cognitive views into consideration. Hence, researchers need to identify specific user requirements, identify risk problems and thereby the appropriate trust building strategies especially within a cultural setting. Hence this paper put forward the notion of trust from a non-functional perspective as an emotional, “intangible” response to computer based stimuli [17] or known as the “non technical mechanism” of trust perspectives or “soft trust dimension” [3] to answer in what ways of visualizing trust would be acceptable and understandable for the users. How can we map the user’s expressions of trust with existing security technology or should we create a new set of security technologies from scratch that would better take into account the novel uses and novel users? We believed requirements elicitation in sensitive settings demand us to draw a line between the perception of the designers, who often seen to construct solutions and thereby design for people essentially like themselves but not the perception and the understanding of “the other” which includes the novice and non novice users whose views are excluded from design. Hence the emphasis should be on ensuring the design for user sovereignty where it can be signaled, rationalized and understood as part of the overall interface design strategy of information systems for the laymen rather the design for user friendliness. As more people go online for seeking information regardless of context it becomes increasingly important to identify what makes people choose to trust some sites and reject others. In this sense, while not disregarding the importance of online security and the evolving systems that support it, we believe that security has little to do with general consumer trust. This leads to the assumptions that current trust research in IS are hampered by designing for computers rather than humans. Hence we posited that designing trust metrics requires an understanding of not only the technical nuances of security but also the human subtleties of trust perception. The aim of this research is to study trust more closely at end user level, what is trust from the user point of view, what kind of processes of trust decision making based on the interaction with the website and how the words and images are
“Online Legitimacy”: Defining Institutional Symbolisms for the Design
69
encountered and perceived. What is needed here is to find a way for computers to understand what “human trust” is made of and gives way to our initial assumptions on how to design an information artifact that is perceived trustworthy. It looks into on how human reasoning trust online triggered by the perceived trustworthy elements of an interface apparent to the users. It is necessary to have a more cognitive and affective view on trust as a complex mental structure of beliefs and goals, which would imply that the trustor has a “theory of mind” of the trustee possibly including personality, shared values, morality, goodwill etc. In addition we further emphasis on how people perceived trustworthy information by approaching the information mediated exchange activities bringing with them previous experiences of online trust activities and apply it to the new computer mediated situations rather than being tabulae rasae onto which the design for information based systems can write their preferred responses. We argue the facts that trust are not only reduced to rational decisions, but trust is also socially embedded by the institutions, norms, culture and etc. The focus of this paper is to reveal in greater depth on the understanding of trust within W-MIE that takes into account of trust determinants from the perspective of human actor’s reasoning in the context where the sense of a community with common norms and values are significant. A website is merely an extension of human interaction and therefore there is a need in the ability to transfer human trust reasoning mechanisms into the design of a web interface. 2.1 Online Legitimacy – Institutional Symbolisms and Its Dimensions Based on the above considerations, we offer the following suggestions for the design to enhance the trustworthiness of information artifact. Our work links the social science theories of trust and semiotic principles to form the basis of the Institutional Symbolisms Trust Inducing Features framework as explained in our previous works [1, 2]. The perspective of the framework is a descriptive one, since it categorizes the trust dimensions that act as communication embedded in cultural influence features to support the emergence of trustworthy behavior. In the literature, institutional trust is a type of trust that is also known as system trust [10], reputed credibility [7], and is similar to the transference process described in [10] and control trust [18]. Lewicki et al. [19] describe institutional based trust as the trust that develops when individuals generalize their personal trust to a large organizations made up of individuals with whom they have low familiarity, low inter-dependence and low continuity of interaction. For example, we trust the government system to ensure the stability of a state or we place our trust in a juridical system to uphold the law enforcement and sanctions. We conceptualized institutional based trust as a form of symbolism, the system of representations and symbols through institutional trust inducing features on the web which we define as institutional symbolism. The term institutional symbolism refers to a visible, physical manifestation of the institutional characteristics, behavior and values. Institutional symbolism is the trust marks, signs that depicting and presenting connoted message of some assurance. On the basis of these expectations, we content that the trust marks represent the beliefs (values) and expectancies held by individual about the overall impersonal structures and situations construed as to network both cognitive and affective trust warranting properties. These beliefs implying that the
70
E.N.M. Ibrahim and N.L. Md Noor
institutional symbolisms carry its own disposition and attribution meaning, an institutional manifestation through textually or graphically presentation on the web site. We contend, trust on this institutional symbolism act as a form of social trust where trust initiated from the social mechanism, behavior and values through the means of institutional symbolism representation. These elements represented what constituted “online legitimacy”. a) We proposed the need for content credibility which often referred to believability [7], trustworthiness [3, 6, 9, 10], reliability [10] e.g. links, navigation whereby the ease of navigation was frequently mentioned as a key to promote online trust and sources of content. It gives an emphasis on the information dissemination is free from alteration, biasness or falsification which are ways to reassure the users about the quality of the information and its comprehensiveness [8,11] in terms of accuracy and currency. The information provider needs to explain and summarize its general information gathering practices over the web, perhaps what the information is used for and with whom the information may be shared. It should also consider the necessity of legislation to create civil remedies for users in the event of untrustworthy interactions with the information provider. These evoke the need of elements of truth and validity, lawful and evidential when it involves certain ethics or principles associate with one’s beliefs such as in a religious context; appearance and functionality to ensure the reliability of the content presented and written. It defines the overall organization and accessibility of displayed information on the website. It is said users are more confident using a clear design and format of interface elements of website because it reduces the perceived risks, wasting time, deception and frustration [20]. Example, a content that highlights on a legal matter should derived from someone expert within the subject matter, an authority or affiliation appointed by the organizations, institutions or government. In addition, one’s believability can also evolves out of their past experience and prior interaction with the information provider as trust emerged as the relationship matures [19]. For example, the testimonials and user’s feedback placed special regards to this developing, building and declining of trust in order to identify the reliability (e.g. on site performance) and believability (e.g. deliverables) of the information provider. b) Emotional assurance or known as benevolence [3, 6, 9, 10] is an important trust element as it depicts the degree to which the information provider (trustee) is believed want to do good to the users. In the aspect of information dissemination it considers the essence of good intention portrayed by the organization/ institution in adherence to their code of conduct. Positive intentions should leads to the overall public benefits without taking advantage by other means, misleading intention or creating confusion. Example, by disclosing ownership of the information up front, it hopes to inform the users about the nature of the relationship of the organization and its affiliations and thus prevent misconceptions or perceived inherent biases. c) Trustworthy content can also be signaled by the symbols of trusted third party (TTP)/ seals of approval which is usually seen in any online transaction websites. Well known TTP such as TRUSTe seal was perceived by users as a stamp of approval for the quality of a web site’s privacy policy and security [21, 22]. These TTP should effectively capture the process involved in demonstrating user’s satisfaction, guarantees and safety nets and information practices. For example the need for assurance that the information collected or distributed is being handled as outlined in the privacy guidelines and disclosure policies. In addition, the TTP will act as a
“Online Legitimacy”: Defining Institutional Symbolisms for the Design
71
guarantee that the information or data transferred is well protected and secured and some kind of a stamp in validating or certifying the truth presented in the content displayed on the web. d) We also believe that to design trustworthy information artifact should reflect or create the essence of brand and reputation of the information provider. This is because when a person perceives the brand name or symbol associate to it; it is the interplay of the associations of the branded object that manifests as image constructed by the user which in turn influence the reputation of an organization in general. It is noted that brand image bears great potentialities to strengthen trust [23, 24]. The design can take into account from the creation of the domain name, trademarks or logo which in turn highlights on the trustee ethical values, expertness (authority, knowledge) and familiarity (general business sense).
3 Discussions and Future Directions We conclude our working suggestions with a key point that designing trustworthy information artifact does not stand apart from other enduring human values, expressions and perceptions especially within the sensitive context of application. In our eagerness to create the tools and conditions to support online legitimacy within the creation of information artifact on the web, we should not depict trust in its narrower sense. We should not address the problem of trust in its mathematical, technical or logical sense where the truth, say of a sentence in a formal language can be formally examined on a meta-linguistics level. Often people feel threatened by these technological processes simply because they are not necessarily ideally devised and constructed to serve people especially the laymen and often tend to dominate people by their complexity. We are interested of the nature of understanding online trust within W-MIE in the sense of its correspondence to reality or at least its pragmatic utility in predicting real events or in solving practical problems by utilizing the right technology facilities. We are also aware that this question can be and have been very diversely interpreted in philosophy resulted in the conclusion that trust has social value and is the basis of sound social interaction, is even an elementary requirement of evolution of social cooperation in the virtual world. It should be noted, not all users are technically well versed. Technology should be the servant, not the master of people and many technology producers put their technology into dominant position; hence force its users to behave as they think she or he should behave. Therefore we stressed again, every new technology imposed should respect the principle of again the user sovereignty not only of user friendliness. Hence, in our previous works [1, 2] and in this paper, we introduce the basis of the discussion by evaluating the relative complexity of processing visual and textual information as part of the trustworthiness processes in imposing and sanctioning behavior online. We proceed then to the evolutionary rational and irrational trust in relation to the psychology definition of trustworthy information. And in the future discussion on the validation of these design definitions and how the consequences enable us to understand the design deployment of an information artifact, its constitutive parts and the epistemological aspects will take place. This will eventually provide us clearer design guidance for suitable technologies that support trust and effective security and privacy protecting behaviors within the culturally sensitive design in W-MIE.
72
E.N.M. Ibrahim and N.L. Md Noor
References 1. Mior Ibrahim, E.N., Noor, N.L.M., Mehad, S.: Wisdom on the Web: On Trust, Institution and Symbolisms, A Preliminary Investigations. In: Proceedings of Enterprise Information Systems, ICEIS, Barcelona, Spain, vol. (5), pp. 13–20 (2008) 2. Ibrahim, E.N.M., Md Noor, N.L., Mehad, S.: Seeing Is Not Believing But Interpreting, Inducing Trust Through Institutional Symbolism: A Conceptual Framework for Online Trust Building in a Web Mediated Information Environment. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4558, pp. 64–73. Springer, Heidelberg (2007) 3. Kräuter-Grabner, Kaluscha, S., Ewald, A., Marliese, F.: Perspectives of Online Trust and Similar Constructs – A Conceptual Clarification. In: Proceedings of The Eighth International Conference on Electronic Commerce, pp. 235–243. ACM, New York (2006) 4. Collini, S. (ed.): Eco, Umberto, Interpretation and Overinterpretation. Tanner Lectures In Human Values. Cambridge University Press, Cambridge (1992) 5. Forray, D.: The Economics of Knowledge. MIT Press, Cambridge (2004) 6. Corritore, C.L., Wiedenbeck, S., Kracher, B.: On-line Trust: Concepts, evolving themes. A model in International Journal of Human Computer Studies (58), 737–758 (2003) 7. Fogg, B., Tseng, H.: The Elements of Computer Credibility. In: Proceedings of CHI 1999. ACM Press, New York (1999) 8. Alexander, J.E., Tate, M.: Web wisdom: How to evaluate and create information quality on the Web. Lawrence Erlbaum, Mahwah (1999) 9. Kräuter-Grabner, S., Kaluscha, A.E.: Empirical research in on-line trust: a review and critical assessment. International Journal of Human-Computer Studies 58(6), 783 (2003) 10. Chopra, K., Wallace, W.A.: Trust in electronic environments. In: 36th Annual Hawaii International Conference on System Sciences, Big Island, Hawaii, January 2003, pp. 331– 340 (2003) 11. Marchand, D.: Managing information quality. In: Wormell, I. (ed.) Information Quality: Definitions and Dimensions. Taylor Graham, London (1990) 12. Bonnani, C., Cyr, D.: Trust and Loyalty: A Cultural Comparison. In: Proceedings of International Conference on Business, Canada (2004) 13. Matsumoto, D.: People: Psychology from a cultural perspective. Brooks/Cole, California (1994) 14. Hofstede, G.: Culture’s Consequences: comparing values, behaviors, institutions, and organizations across nations, 2nd edn. SAGE Publications, Thousand Oaks (2001) 15. Friedman, B., Kahn Jr., P.H., Borning, A.: Value Sensitive Design and information systems. In: Zhang, P., Galletta, D. (eds.) Human-computer interaction in management information systems: Foundations, Armonk, New York, pp. 348–372. M.E. Sharpe, London (2006) 16. Ratnasingam, P., Pavlou, P.A.: Technology Trust in B2B Electronic Commerce: Conceptual Foundations. In: Kangas, K. (ed.) Business Strategies for Information Technology Management, pp. 200–215. Idea Group Publishing, Hershey (2004) 17. French, T., Liu, K., Springett, M.A.: Card-sorting Probe for E-Banking. In: Proceedings of British Human Computer Interaction, vol. 1. BCS Publications (2007) 18. Pavlou, P.A., Gefen, D.: Building Effective Online Marketplaces with Institution-Based Trust. Information Systems Research 15(1), 37–59 (2004) 19. Lewicki, R.J., Bunker, B.B.: Developing and maintaining trust in work relationships. In: Kramer, R., Tyler, T. (eds.) Trust in Organizations: Frontiers of Theory and Research, pp. 114–139. Sage, Newbury Park (1996)
“Online Legitimacy”: Defining Institutional Symbolisms for the Design
73
20. Wang, Y.D., Emurian, H.H.: Inducing Consumer Trust Online: An Empirical Approach to Testing E-Commerce Interface Design Features. In: Proceedings of the International Conference of the Information Resources Management Association: Innovations Through Information Technology, New Orleans, USA, May 23-26, pp. 41–44 (2005) 21. Head, M., Hassanein, K.: Trust in e-Commerce: Evaluating the Impact of Third Party Seals. Quarterly Journal of Electronic Commerce 3(3), 307–325 (2002) 22. Hu, X., Lin, Z., Zhang, H.: Myth or reality: Effect of trust promoting seals in electronic markets. Presented at WITS 2001, New Orleans, LA, USA (2001) 23. Aaker, D.: Managing Brand Equity. The Free Press, New York (1991) 24. Einwiller, S., Will, M.: The role of reputation to engender trust in electronic markets. In: Proceedings for the 5th International Conference on Corporate Reputation, Identity and Competitive (2002)
Evaluation of Web User Interfaces for the Online Retail of Apparel Dominik Rupprecht, Rainer Blum, and Karim Khakzar Hochschule Fulda - University of Applied Sciences, Marquardstr. 35, 36039 Fulda, Germany {Dominik.Rupprecht,Rainer.Blum,Karim.Khakzar}@hs-fulda.de
Abstract. In this paper we present intermediate findings of the ongoing research project SiMaKon. It presents results of user tests, on how to design a web-based user interface for the online retail of apparel. The aim was to increase both the usability and the shopping experience. The study focuses on the manner of the product catalogue navigation and presentation in relation to different “modalities of needs”. The results indicate that not only one approach for an interface is to be chosen, but that a combination of several concepts should be combined. Keywords: E-Commerce, Evaluation, Web-Based User Interface, Apparel, Rapid Prototyping, Modalities of Need.
1 Introduction Many scientific studies have investigated online shopping service attributes. These studies have classified the important attributes of online stores into four categories: merchandise, customer service and promotions, navigation and convenience, and security [1]. Concerning the third attribute category (navigation), aspects like store layout, organization features, information presentation as well as usability, media richness, accessibility, personalization, adaptation or experience-related traits (like design quality, entertainment, playfulness etc.) have been identified as relevant and important. In the research project SiMaKon, “Simulation of Made-to-measure and Readymade Clothing Online for Fit Checking” at Fulda University of Applied Sciences the development of an e-commerce user interface for the B2C retail sector is a current subject. In doing so, the aforesaid navigation and design-related attributes are regarded as fundamental quality criteria. With focus on these aspects, it was evident, that a wide range of fundamental user interface design options already exists. These options do not only cover small details like user interface controls or the structuring of individual pages, but also higher-level functional components of online shops like shopping carts and product catalogues. Due to missing standards or universally accepted guidelines on best practise for online shops, it was obvious that a controlled experiment comparing different design M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 74–83, 2009. © Springer-Verlag Berlin Heidelberg 2009
Evaluation of Web User Interfaces for the Online Retail of Apparel
75
alternatives may point the way for the future development of the SiMaKon system’s web user interfaces. This paper describes the chosen procedure in the following sections. Section 2 depicts the method of using four different concepts and building rapid prototypes for each and section 3 discusses how the tests were conducted and executed. Finally in section 4 the results are shown and discussed in section 5. 1.1 Objectives and Significance In this paper we present intermediate findings of the ongoing research project SiMaKon. Focus of its research activities is an innovative, interactive system for the support of apparel retail via Internet. This paper presents results of user tests carried out, on how to design a web-based user interface for an online shop in order to increase both the usability and the shopping experience. To interpret our findings correctly and to transfer them to other research contexts, we provide details on the study’s context. 1.2 The SiMaKon Project The ongoing research project SiMaKon deals with trying on and reliably appraising clothing in online shops with the help of individual virtual bodies. It tries to find solutions for the following challenges: • reliable fit checking and appraisal of optical characteristics in relation to a virtual representation of one’s own body • seamless integration with product catalogue respectively product configurator • comprehensive interactivity, thorough usability and absorbing shopping/ user experience • high customer acceptance An integrated system composed of different functional components is developed and continuously evaluated. The first component needed is an e-commerce back-end and online shop front-end. The second is a three-dimensional virtual try-on scene, again consisting of three elements. On the one hand, an avatar generator to create individual virtual human bodies (avatars) with configurable body measurements, hair style, skin tone and face characteristics. On the other hand, a clothing pattern generator to build the virtual garment construction of all apparel available in the online-shop. The most important part in the end is the three-dimensional simulation. It renders the 3D content with avatar, complete clothing outfit and background scenery displayed in the Web browser, integrated in the online shop. In doing so, the sewing of the cloth is based on real garment pattern data. The result is a realistic simulation of the garments’ drape and cloth surface. The simulation is capable of representing subtle details like sewing threads and knobs, as well as of high-quality lightning and shading. Customers can interactively change perspective and background scenery as well as zoom into details.
76
D. Rupprecht, R. Blum, and K. Khakzar
After entering the online shop customers may start by first configuring their avatar(s) or by browsing the product catalogue. There, interesting clothing can spontaneously be selected for try-on and appraisal with the currently activated avatar. In cooperation with the simulation customers can interactively swap pieces of clothing or made-to-measure garment components directly from the product catalogue for easy comparison. The user-related criteria are dealt with in a cyclic user-centred design process based on ISO 13407 [2]. As many fundamental user interface design options exist for the system’s different functional components, comparative experiments with prototypic mock-ups are continuously conducted in order to come to well-founded design decisions. The functional component relevant for the study reported in this paper is the product catalogue navigation and presentation. 1.3 Modalities of Needs Modality of needs is one concept to describe the ways a customer usually proceeds through the decision making process, depending on the consumer’s current intension. It forms the main aspect of the evaluation of different product catalogue navigation and presentation concepts in this study. Michele Ambayé [3] describes three different kinds of modalities. A customer may start the shopping process with any one of these three types. Pre-knowledge driven customers know exactly what they are looking for. So, the purchasing criteria are quite clearly defined in the customer’s mind, because for example a customer has previously bought some brand jeans (and has been satisfied with it) and would now purchase another piece again. From this it follows that the customer only needs to search on limited additional criteria like best price and delivery. In contrast, if the customer only knows what sort of product is needed, the modality is called function driven. For example the customers is looking for a suit shirt, but has not yet established specific criteria intrinsic to the product, such as for example its style or material. Therefore, the purchasing process is driven by the need for the function provided by the product: it must be a shirt, that fits well and maybe has a certain colour. Impulse driven consumers are just browsing the Internet and have no conscious knowledge of a need. The need is established for example as a result of interacting with an Internet site or looking at an advertising banner. Even though the customer does not really needs the found product, the purchase decision is made impulsively. One important point is, that people may possibly switch between modalities during the purchasing process (shifts in mode). This occurs, when the consumer’s current need changes. For e-commerce user interfaces trying to optimally support modalities of needs including shifts between them may be a promising way to best serve an otherwise extensive, heterogeneous audience. Furthermore, it is likely that a particular e-commerce user interface design may serve one modality of needs better than another.
Evaluation of Web User Interfaces for the Online Retail of Apparel
77
2 Method Four different concepts, each implemented with a rapid prototype with basic functionality, were chosen for the comparative study - based on three aspects: • support of the depicted modalities of needs • potential for high usability and user experience for a broad spectrum of apparel consumers and, • innovativeness. Each prototype was assembled with 162 products for men and women with a large array of product types like trousers, blouses, shirts, jackets etc. and different labels and trademarks in various colours and patterns. The following chronology of different approaches is the one used in the realised study. It tries to alternate new concepts with rather known ones, to give the participants a variety between the separate prototypes. 2.1 Associative Approach The first approach is an associative one. In an associative navigation structure, the user does not have to think the way the designer has organized the navigation like in an ordinary hierarchical structure, because the navigation is based on every decision the user takes. Every click on a navigation link makes the chosen link the new central topic and arranges related topics around the central topic [4]. The Transfer of this idea to an online shop for the purpose of this test is described in the next paragraph.
Fig. 1. Screenshot of the associative prototype
78
D. Rupprecht, R. Blum, and K. Khakzar
On the front page the customer can choose between different categories separated by men and women. Selecting one category results in showing a picture of one random cloth item of the category in the middle of the page surrounded by four different types of classes: brand, colour, type and pattern. In each of the classes the pieces that are most alike the selected item in terms of the class attribute are visually grouped near it (see Fig. 1). Every new selection by the user is resulting in a new sorting of the shown catalogue by placing the selected item in the middle with a new sorting around it. A navigation throughout the whole catalogue is achieved with navigation arrows at the edges of the screen to even reach items, which are invisible due to their distance from the center space. 2.2 Adaptive Approach The second approach is to use adaptation in the interface. So, the interface adapts itself automatically to one of the three modalities of needs. This is done by changing part of the navigation on the web front-end according to the customer’s current mode. In this test an ordinary organized product catalogue is complemented by additional navigation components on the right side of the web page. This results in a segmentation of the page into three parts: at the left resides a hierarchical navigation structure based on categories, the content is placed in the middle and at the right side the adaptive interface is shown.
Fig. 2. Screenshot of the adaptive prototype in impulse driven mode
This adaptive interface uses an advanced search in pre-knowledge driven mode with search filters for various product features like colour, material or pattern. In function driven mode all featured trademarks are used as root categories with the respective types of garment as subcategories. Listing different thematic, life-style
Evaluation of Web User Interfaces for the Online Retail of Apparel
79
oriented areas like winter, sports or outdoor should help to browse through the catalogue in impulse driven mode (see Fig. 2). 2.3 3D Approach The third one uses a three-dimensional environment to display the catalogue like a real store. In this way, the customers can walk through the store similar to real life. Each product item is displayed in two-dimensional information spaces located on separate wall sections. Using several floors with several virtual rooms the product range is structured spatially like in a real store based on garment types. In the middle of each room outline maps in the form of a schematic presentation of the room and level structure allow the transfer between the separate floors. Navigation means, all used via mouse and keyboard, are moving forward, backward, to the right and to the left, turning around at the current position and automatically moving along a predefined path to a certain destination, while observing the crossed environment. The prototype was realised using the 3B software for creating virtual three-dimensional rooms [5].
Fig. 3. Screenshot of the 3D prototype
2.4 Classic Approach The fourth and last prototype is a classic, hierarchical presentation for comparative purposes, to see if one of the other concepts is better than the traditional way to present a catalogue. It consists of a hierarchical category tree on the left and a selection and detail view in the middle. The detail view presents either the items belonging to the currently selected product category or detailed information about a chosen product (see Fig. 4).
80
D. Rupprecht, R. Blum, and K. Khakzar
Fig. 4. Screenshot of the classic prototype
3 Tests Each prototype was built and tested under laboratory conditions with sixteen mixedgender test candidates, which did not have to have special prior knowledge. A user interview with a questionnaire of one hour per person, one person at a time was conducted by two test assistants, one for the overall questions and one to observe the behaviour of the test candidate during the test. The study employed a 3 (modality of needs) by 4 (prototype approaches) factorial design with both factors manipulated within subjects. All candidates had to try out the respective prototype in all three modalities of needs controlled via scenario descriptions that were presented to the participants. Each description detailed a typical situation for the respective modality. For example, for the pre-knowledge driven modality it stated: “Imagine, you had run across an advertisement for a certain name-branded product, you want to buy. Therefore, you are browsing the catalogue of an Internet shop for products of this brand”. Prepared like this, the test subjects had to accomplish three to four given tasks with each of the prototypes. The tasks were characteristic for the current modality, e.g. “Please chose the women’s trousers XY of the brand YZ.” During task execution the test assistants collected usability related performance measures like speed, success, effort of completion, occurrence and severity of difficulties, noted observations and estimated user experience attributes on Likert items, e.g. joy, fun or how interesting the candidate conceived the prototype. After having passed through all the modality scenarios, the interview concerning the prototype was conducted. First, the candidates had to rate the tasks’ complexity. Then, for each prototype general usability-related questions were raised, involving estimation, e.g. usefulness for the given task or comfort and orientation in the prototype, and open-end questions, e.g. if the participant especially likes a specific
Evaluation of Web User Interfaces for the Online Retail of Apparel
81
feature and why or if the subject missed some known functionalities. This was followed by prototype-specific questions, e.g. concerning characteristic features. Finally, the participants had to appraise the same user experience attributes concerning the shopping experience as mentioned above. At the end of the whole process the test candidates had to bring the single prototypes in a sequence from best to worst prototype.
4 Results For each of the four prototypes the results of the tests are summarized in the following: 4.1 Associative Approach This prototype was difficult to use for the test candidates und they needed some training period to understand the part of the system that shows the product catalogue. The problem was, that the participants did not recognize the sorting and resorting in the four different classes and conceived it as chaotic. In terms of usability the statement of the test persons is, that the system is something completely new to them but is to confusing with too many pictures and an overloaded page. On the other hand, the prototype got relative neutral ratings regarding shopping experience. It was conceived very interesting but was no fun to use. 4.2 Adaptive Approach This prototype was very easy to use and the additional navigation on the right side was considered to be a very useful addition. The usability was rated very positive throughout all criteria. One thing that annoyed and confused some test candidates was the automatically done changes per modality of needs. They desired to switch the adaptive changes independently on their own. Just as the usability the shopping experience was rated positive, too. Using the prototype was perceived as pleasant. 4.3 3D Approach This prototype caused the most problems during the testing process. So, the processing was often only possible with the support of the test assistants and two participants even abandoned the test with this prototype. Most of the problems resulted from the candidates loosing the overview in the three-dimensional world and having problems with the navigation. Hence a very long process time emerged. Therefore, this prototype had the worst result relating to the usability - despite the fact that the first impression of the system was very positive and well-known from PC games by some test candidates. Another critical comment was, while the shop was of a three-dimensional kind, the products were presented only in two-dimensional pictures. It is not surprising that the user experience was classified as very unpleasant by most of the participants. But on the other hand it was the most interesting und exciting prototype for the remaining attendees.
82
D. Rupprecht, R. Blum, and K. Khakzar
4.4 Classic Approach Like the adaptive prototype this one showed a very easy handling for all the participants. Referred to usability the prototype gave a good orientation and clarity in the used navigation structure, but felt ordinary and standard. Furthermore, the adaptive additions of prototype two were missed during the work with this one. The shopping experience was sensed as rather boring, with no big fun and not interesting but with a relatively pleasant usage experience. 4.5 Order of Prototypes and General Notes The adaptive concept was rated as best ahead of the classic and the associative one. Due to the problems in the three-dimensional world the 3D approach comes in last of this sequence, whereas it is to say, that half of the test candidates think this one is the best, while the other half uttered the opposite. In all four prototypes search, filter and help functions were missed by the participants, owed to the fact, that the shops are only realized as rapid prototypes with basic functionality.
5 Conclusion The results of the interviews show, that no clear statement for a single concept can be found. A good starting point is to use a classic, hierarchical construction and improve it with a selection of the other concepts. The traditional way to present a catalogue was familiar and easy to use for the test participants, but provided no real shopping experience. In general, the concept of adaptation got an overall positive feedback, but the automatic adaptation of the interface displeased the test candidates. So, giving the customers the choice to select the adaptive components themselves, like an advanced search mode, would improve the interface. Both the three-dimensional and the associative interface should not be used for navigation in a catalogue alone, but they can possibly be useful as additional components of the interface. Especially, the three-dimensional aspect is very important for improving the shopping experience concerning fun or how interesting the prototype is. On the other hand, it became apparent, that this concept is very controversial. Half of the test candidates were amazed by using the 3D prototype and the other half had severe problems navigating through the 3D world. So, using this approach for only parts of a web site, like a virtual try-on as an addition to the “normal” page, would possibly increase the shopping experience. The associative prototype needed some initial training of the candidates and the sorting of the items was not recognised but experienced as chaotic. On the other hand, using this prototype proved to be very interesting. So as a consequence, a possible approach is not to take only one concept, but to combine aspects of all four ideas, like described above.
Evaluation of Web User Interfaces for the Online Retail of Apparel
83
Acknowledgments. This research was financially supported by the German Federal Ministry of Education and Research within the framework of the program “Forschung an Fachhochschulen mit Unternehmen (FHprofUnd)”.
References 1. Park, C.-H., Kim, Y.-G.: Identifying key factors affecting consumer purchase behavior in an online shopping context. International Journal of Retail & Distribution Management 31, 16– 29 (2003) 2. ISO 13407, Human-centred design processes for interactive systems (1999) 3. Ambayé, M.: A Consumer Decision Process Model For The Internet. Brunel University Information Systems and Computing PhD Theses (2005) 4. Peake, R.: An Experiment in Associative Navigation (2007), http://www.robertpeake.com/archives/ 365-An-Experiment-In-Associative-Navigation.html 5. Three-B International Limited, 3B, http://3b.net/browser/newhome.html
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination on Corporate Discussion Web Sites Shinji Takao1, Tadashi Iijima2, and Akito Sakurai2 1
NTT Advanced Technology Corporation 12-1, Ekimaehoncho, Kawasaki-ku, Kawasaki-shi, Kanagawa 210-0007, Japan
[email protected] 2 Keio University Faculty of Science and Technology 3-14-1, Hiyoshi, Kouhoku-ku, Yokohama-shi, Kanagawa 223-8522, Japan {iijima,sakurai}@ae.keio.ac.jp
Abstract. This paper states the issues faced, and the role played by keyword dictionaries with regard to discussion based web sites which aim to achieve a 'collective knowledge' through the voluntary participation of corporate employees, and proposes a corrective strategy. A keyword dictionary is valuable in that it helps to integrate fragmented accumulated knowledge with generalized knowledge. However, this necessitates a method that allows for coauthoring, and Wiki, BBS and other existing tools are still insufficient in this respect. As well as offering a method for expanding BBS, this paper shows a method for assessing use within an actual corporation. Keywords: coauthoring, collective knowledge, wiki, bulletin board system.
1 Introduction In recent years corporate entities have moved to intensify relations and knowledge sharing between employees through the establishment of web sites where the employees can freely exchange opinions [1,2]. The main function of such corporate web sites is often as a Bulletin Board System (BBS) or Diary (Blog). These sites offer a place for discussion and the sharing of personal records through asynchronous text. Web sites based on these functions (discussion web sites) are capable of fulfilling objectives such as discussion, Q&A, and publicity. However, information inputted on a daily basis is fragmented; often meaning it is only useful at that point in time. For this reason, it is quite difficult to systemize this knowledge to allow for its reuse and the further creation of new knowledge. It is thought that a keyword function is a valid method for solving this problem. With this method, registering a certain expression as a “keyword” generates a page for the expression (Figure 1). This page subsequently displays an explanation of the expression, along with a list of links to information within the site that contain the M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 84–93, 2009. © Springer-Verlag Berlin Heidelberg 2009
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination
85
Keyword Keyword Web Page Registration 【Explanation of the Expression】 ・・・・・ User A Inputting of 【Link List】 Explanation Article A for the Article B Expression .... Automatic Generated Mutual Link User B
Writings of BBS or Blog
Fig. 1. Overview of Keyword Functions
expression. Furthermore, links are automatically generated, and explanations for each expression are coauthored by the registrant of the keyword as well as other users. This enables the integration of information within the site centered on keywords, while also allowing for the creation of reusable systematic information based on the integrated information. More specifically, the combination of fragmented information accumulated on corporate discussion sites is promoted, making the creation of new knowledge possible. Services analogous to this are already on the internet [3]. However, while these existent services presently achieve their information integration function, they have not yet led to the creation of sufficient systematic information. This is thought to be due to the following 2 points. 1. Existence of competitive services: Wikipedia already exists as a systematic information source, and users have an inclination to use these services. 2. Issues with the coauthoring method: as the coauthoring method resembles that of Wiki, there are relative few users who can make full use of its features. Issue (1) is rarely directly related to corporate web sites covered by this paper due to the existence of specific corporate issues and knowledge that cannot be obtained with on-line services such as Wikipedia (conversely, an overlapping of objectives between corporate sites and on-line services can lead to the inert use of corporate sites). On the other hand, issue (2) is very directly related. From herein, this issue will be addressed. Although Wikipedia is currently the most successful on-line service utilizing Wiki, it is thought that less than 1% of users join the authoring process on an on-going basis [4]. Despite this, it is thought that the ability to draw many on-line users means that they obtain the assistance of enough overall coauthors. On the other hand, it is thought that relatively small scale services and corporate sites cannot obtain a sufficient amount of coauthor assistance. While even corporate BBS and blog use achieves a certain degree of popularity, Wiki has still not been extensively introduced. This paper proposes a coauthoring method that expands BBS by investigating the issues faced by the Wiki based coauthoring method and by reviewing existent
86
S. Takao, T. Iijima, and A. Sakurai
research regarding coauthoring. Moreover, these proposals are implemented and introduced in depth along with methods for evaluation their effectiveness.
2 Investigation of Coauthoring Methods 2.1 Wiki and BBS Users of the current Wiki service are thought to encounter the following 3 problems. 1. A lack of user friendliness as special tags called *wiki markup* have to be used. 2. More strenuous text creation when compared the personal and fragmented text created with BBS and blogs. 3. Difficulty in finding reference information regarding others opinions and past text. While problem(1) can be solved through the development of additional functions such as GUI featuring editing tools, (2) and (3) are inherent to the basic nature of Wiki, making any ultimate solution difficult as long as Wiki is utilized. (2) and (3) are discussed below. It is expected that text created by Wiki would encompass documents utilized as knowledge and cross-referenced by a large number of people in comparison to BBS and Blogs. The need for direct editing of this is a great burden on the user. In addition, such methods make it difficult to reference information including past records and discussion processes (Wiki's implementing figuration also means records are sometimes not saved). Therefore, this method may increase the feeling of burden felt by users when creating text. On the other hand, BBS and Blog do not target a single document, but individually handle each user's multiple fragmented entries. The difference between BBS and Blog is that while the former focuses on mutual Q&A and discussion through entries, blog mainly consist of entries made by a single person1. These BBS and Blog sites have become extremely popular as a means of communicating on the WWW and other such on-line services. However, they have not been utilized with the aim of creating a single document such as with Wiki. 2.2 Coauthoring Related Research The research of text coauthoring by multiple users in an electronically aided environment has been mainly carried out in the groupware field. Here, it is believed that communication between participants is important. As a result of investigating various jobs and organizations, Couture and Rymer (1991) state that text authoring through the direct participation of several persons (group writing) is actually not undertaken very frequently, but rather it is more often the case that a single person authors the text based on the opinions of coworkers (interactive writing)[5]. Our experiences also persuade us to come to the same conclusion. Therefore, there is little proposal of group writing with groupware research, and a greater emphasis is placed on authoring through the division of responsibilities into 1
There are cases where readers can comment on blog entries as with BBS, but it is generally the case that the blog writer has the ability to reject such comments.
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination
87
the form of multiple authors, commentators and reviewers[6-8], or commenting on text (annotation)[9-11]. Note, however, that the existent groupware research covers complex and special systems, and is not well suited to popularization through simple implementing via WWW technology. Moreover, methods proposed by this research set a certain user within the group as the author. Therefore, this is well suited to use within a small group aiming to create text in a certain period of time, and where responsibilities are clearly divided. However, these methods are not suited to text creation wherein an unspecified number of persons contribute steadily over a long period of time. For the latter, a method where text creation rights are equally shared amongst a large number of users, such as Wiki, is well suited. In addition, related methods that emphasize annotation necessitate the creation of an initial document by a specified author before other participants can comment on the text. Therefore, the existence of some kind of document is a prerequisite of group work. 2.3 Authoring Method That Expands BBS This paper applies a deliberative model [12] that expands BBS based on the problems faced by existent systems such as Wiki, and related research. Figure 2 is a pattern diagram showing the deliberative model. Firstly, each individual enters information as with a BBS or blog (1). Any participant can play a part in integrating this and creating a proposal (2). Proposal creation in (2) is undertaken in the same way messages are posted on BBS. This allows the user to create a proposal based on the BBS discussion utilizing a method that is almost identical to general BBS use. This type of process is similar to that used in meetings where issues are first discussed, and conclusions are made after all opinions are heard and then integrated. The creation of text through discussion allows users to create content with considering multiple aspects, and to share responsibility. This is why our method is called the deliberative model. Identical Group
Rejection (4) (1)
Comment Documentation
Comment
Discussion Acceptance
Comment
(2) Adoption(3) A ny Participant
(5)
Document
Fig. 2. Schematic Diagram of Deliberative Model
88
S. Takao, T. Iijima, and A. Sakurai
The proposal is made official through adoption by the user group(3). A vote is generally taken to decide on adopting the proposal. However, in the case there is no set number of users with voting rights, voting is not always undertaken and the document can be adopted when proposed at (2). It is not problematic because proposals can be made any number of times and results can be renewed. In addition, another proposal (document) is created if the proposed document is not adopted upon voting (4). Moreover, the created document is commented on once again (5) and a cycle of renewal based on this is repeated. Therefore, the deliberative model is an iterative process and it this cycle of iteration that makes it possible to increase document quality.
3 BBS Expansion The deliberative model is realized by expanding existing BBS. An example of such an expansion is shown in Figure 3, screens from the system utilized by this paper for actual evaluation. In this figure the left side is the main BBS screen, showing a list of messages posted, and the screen on the right side is for entering messages to post. First, one clicks the "Input button [A]" on the main BBS screen and opens the message editing screen. Comments posted from here in the same fashion as a general BBS are displayed on the main BBS screen(1). This is how comments are posted. In order to propose a document, one selects "Proposal" under “Message selection field [B]” on the same message editing screen. The posted document proposal is displayed along with comments, and at the top of the main BBS screen(2). A button [C] connected to the voting function is displayed with the document proposal shown at the top. The voting function executed with this button allows for approval rating, inputting of reasons, and voting. Adoption of the proposed document is generally decided by a majority vote. The text of the adopted proposal is newly displayed at the top of the BBS as it stands at the time (3). BBS Present document text (3 )
Proposal with new document text (2 ) Voting function button [C]
Message editing screen Message selection field [B] Comment Proposal
○
[A] Input button
Message 1 Comment
◎
Enter message here (1)
Message 2 Comment Message 3 Proposal
(2 )
Message posting button
Tag to indicate it is a proposal
Fig. 3. BBS Expansion
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination
89
Note, however, that in the case it is immediately adopted without voting at (2), the present text is immediately replaced with the proposed document. Accordingly, in such a case, the present text and the newly proposed text are not displayed along side one another. Upon implementing, standard plugins (modules) used by XOOPS [13] powered BBS were modified. XOOPS is an open source CMS (contents management system) that can incorporate a variety of functions, including BBS. XOOPS is a relatively easy to install, widely used tool that is equipped with broad range of functions required by the on-line community beginning with user administration. Implementing as this type of CMS module increases user-friendliness during actual use. The tool created is called EMCOT (evolution manual coauthoring tool) and is available from a dedicated download site [14,15].
4 Significance and Research Issues Table 1 explains the characteristics of the deliberative model proposed by this paper. The deliberative model is similar to the process used in meetings to draw a conclusion after finishing discussions, allowing the user to create a proposal while referring to other user’s opinions. Therefore, it is easy to undertake discussions centered on text. On the other hand, authoring with the Wiki method (Wiki model) involves the direct editing of text without discussion between users. For this reason, it is thought that text creation based on the deliberative model is more user-friendly than Wiki. Moreover, while the annotation method (annotation model) often used by coauthoring tools in groupware research is suited to text centered discussions, it is not suited to text created over a long period of time with the assistance of multiple users, such as a keyword dictionary, as responsibility for proposal authoring and proposal adoption is allocated to a specific participant. Table 1. Comparison of each type
Wiki model Annotation model Deliberative model
Text centered discussion difficult easy
Responsibility for proposal creation Any participant A specific participant
Responsibility for proposal adoption Any participant A specific participant
easy
Any participant
Majority vote, or Any participant
Accordingly, it is the Wiki model and the deliberative model that can be utilized in the creation of this paper's objective, a keyword dictionary. And upon comparison of these two, it is predicted that the deliberative model facilitates easier text creation due to the nature of its user-friendly text centered discussion. Note, however, that it not yet confirmed whether this is the case with actual use. The research issue of this paper is to actually apply the Wiki model and the deliberative model, and comparatively evaluate them. Methods of application along with evaluation techniques for these models are explained in the next section with regard to keyword dictionary coauthoring.
90
S. Takao, T. Iijima, and A. Sakurai
5 Corporate Evaluation Method 5.1 Applicable Subject A given IT company has been running web site where employees can exchange opinions since 2004. Mainly discussion (opinion exchange) is undertaken at this site, with frequent Q&A exchanges carried out. Recently, as user numbers increase along with an increase in accumulated postings it has become difficult for newly participating users to know what kind of discussion previously look place, subsequently making it difficult to utilize information. By introducing a keyword function to the site users become able to integrate information containing the expression which the user is interested in. The keyword function utilizes a modified version of XWORDS, a XOOPS module. 5.2 Comparative Experiment A function for coauthoring expression explanations was introduced to the above keyword function in the following way. The coauthoring function introduced is based on either the Wiki model or the deliberative model. When a user registers a certain expression as a keyword, one of the above two models is randomly assigned as the coauthoring method for that expression. Keyword Page Expression (Heading) Explanation of Expression [Edit Button] Automatic link to internal information containing the expression
Only valid for Wiki model
Explanation of the authoring method Index list of posted messages
Click to jump to BBS
Fig. 4. Keyword Page
A keyword page is as shown in Figure 4. An expression heading and explanation are displayed at the top of the page, while a list of links to internal information containing that expression is displayed at the bottom left. An explanation of the authoring method is displayed at the middle right hand side. An edit button for jumping to the editing screen is also displayed here for expressions assigned the Wiki model as the authoring method. Expression explanations can be directly edited at the editing screen.
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination
91
An indexed list of BBS comments for the expression is displayed below the explanation of the authoring method. This is common to both the Wiki model and the deliberative model. With the Wiki model, clicking a link in the list jumps to a regular BBS screen where there is no coauthoring function and only message posting is undertaken. On the other hand, with the deliberative model, clicking a link jumps to a BBS screen with coauthoring functions described in section 2.3. Both these BBS are realized by altering the EMCOT operational settings. Therefore, there are almost no differences except the presence/absence of a coauthoring function. Moreover, the markup language utilized during the authoring of explanations was introduced to both models through XOOPS. As you can see, all functional conditions except the comparative subject, the coauthoring method, have been made identical to every possible extent. 5.3 Evaluation This evaluative experiment evaluates logs automatically recorded by the system along with users’ subjective analysis. Table 2 shows a simplified representation of these indexes and research items. The result of this evaluative experiment which began in late January 2009 was not yet available at the point this paper was being written. This evaluative experiment is to be continued for a given period of time into the future and the result reported in a separate paper. Table 2. Indexes & Research Items
Index Log No. of comments No. of revisions Text count No. of text references Subjective evaluation User-friendliness Ease of authoring Burden on user User satisfaction Text adequacy
Research Item Discussion vitality Amount of contribution to the text Text adequacy Text usefulness Ease of operation Authoring model evaluation Authoring model evaluation Authoring model evaluation Text adequacy
6 Summary and Future Research This paper stated that a keyword dictionary is valid for the discussion web sites being employed by corporate bodies of late, and that the adequacy of text content is currently an issue. Then the deliberative model, which is a coauthoring method that expands BBS, was shown as a solution to this problem.
92
S. Takao, T. Iijima, and A. Sakurai
A method based on the deliberative model is similar to Wiki’s method (Wiki model) in that it is well suited to creating text over a long period of time through the steady contribution of multiple participants. In addition to this, another characteristic of the deliberative model is that it facilitates easy text centered discussions. It can be anticipated that creating a proposal after it is thought that sufficient information has been gathered through text centered discussions simplifies text authoring for participants. On the other hand, it is thought that this cannot be sufficiently achieved with the Wiki model. Along with applying an authoring method based on this deliberative model to the keyword dictionary, this paper explained an evaluative experiment method for its comparison with the Wiki model. This evaluative experiment will be continued for a fixed period of time and the result reported on in the future.
Acknowledgement I sincerely thank Mr. Takashi Okada, Mr. Kentaro Shimizu, Mr. Kota Motomura (Nippon Telegraph and Telephone Corporation), Mr. Terunao Soneoka, Mr. Keizo Sugita, Mr. Hiroshi Koyano and Mr. Toshiyuki Iida (NTT Advanced Technology Corporation), for their consideration and support.
References 1. Ministry of internal affairs and communications. Publication of business blog and SNS practical use examples (December 22, 2005), http://www.soumu.go.jp/s-news/ 2005/051222_13.html (retrieved January 25, 2009) 2. IDG Japan. Research on the state of affairs on business blog and SNS in national enterprises (digested version) (October 2007), http://www.idg.co.jp/expo/ research/report/200710.html (retrieved January 25, 2009) 3. HATENA keyword (n.d.), http://k.hatena.ne.jp/ (retrieved December 25, 2007) 4. Imai, M., Hasegawa, H.: (April 2007) Wikipedia: An encyclopedia in the collaborative era, http://www.deepscience.miraikan.jst.go.jp/special/rebazaar/ 2007/04/wikipedia.html (retrieved January 25, 2009) 5. Couture, B., Rymer, J.: Discourse interaction between writer and supervisor: a primary collaboration in workplace writing. In: Lay, M.M., Karis, W.M. (eds.) Collaborative writing in industry: investigation in theory and practice, pp. 87–108. Baywood, Amityville (1991) 6. Leland, M., Fish, R., Kraut, R.: Collaborative document production using Quilt. In: Proceedings of the 1988 ACM conference on Computer-supported cooperative work, Portland, Oregon, pp. 206–215 (1988) 7. Neuwirth, C.M., Kaufer, D.S., Chandhok, R., Morris, J.H.: Issues in the design of computer-support for co-authoring and commenting. In: Proceedings of the third conference on computer-supported cooperative work (CSCW 1990), Baltimore, MD, pp. 183–195 (1990)
A Coauthoring Method of Keyword Dictionaries for Knowledge Combination
93
8. Neuwirth, C.M., Kaufer, D.S., Chandhok, R., Morris, J.H.: Computer support for distributed collaborative writing: a coordination science perspective. In: Olson, G.M., Malone, T.W., Smith, J.B. (eds.) Coordination theory and collaboration technology. Lawrence Erlbaum Associates, New Jersey (2001) 9. Brush, A.J.B.: Annotating digital documents for asynchronous collaboration. Ph.D. dissertation, University of Washington. (2002), http://research.microsoft.com/~ajbrush/papers/TRBrush.pdf 10. Weng, C., Gennari, J.H.: Asynchronous collaborative writing through annotations. In: Proceedings of the 2004 ACM conference on Computer supported cooperative work, Chicago, Illinois, pp. 578–581 (2004) 11. Zheng, Q., Booth, K., McGrenere, J.: Co-authoring with structured annotations. In: Proceedings of the SIGCHI conference on Human Factors in computing systems, Montreal, Quebec, pp. 131–140 (2006) 12. Takao, S., Iijima, T., Akito, S.: Developing bulletin board systems that enable to improve multiple communities and documents. The IEICE transactions on information and systems (Japanese edition) J89-D (12), 2521–2535 (2006) 13. XOOPS Cube Japan (n.d.), http://xoopscube.jp/ (retrieved January 25, 2009) 14. EMCOT (n.d.), http://wwww.emcot.net/ (retrieved January 25, 2009) 15. Takao, S.: A Study of Support Functions for Active Knowledge Sharing and Discussion on an Electronic Bulletin Board. Ph.D. dissertation, Keio University (2008)
An Empirical Study the Effects of Language Factors on Web Site Use Intention Hui-Jen Yang1 and Yun-Long Lay2 1 Department of Information Management, National Chin-Yi University of Technology, Taiwan 2 Department of Electronic Engineering, National Chin-Yi University of Technology, Taiwan
[email protected]
Abstract. Based on the research model, language anxiety, prior non-native language experience, Internet self-efficacy and language self-efficacy are analyzed for the intention to use non-native language commercial web sites, respectively. Prior non-native language experience has affected language anxiety, language self-efficacy and intention to use non-native language commercial web sites, respectively. By the same token, whether or not Internet self-efficacy and language self-efficacy affected by language anxiety is also examined. A valid sample of 418 undergraduates was tested in this study. Path analysis results fully supported the model tested. These results suggest that language anxiety, prior non-native language experience, language self-efficacy and Internet self-efficacy have an effect on the intention to use non-native language commercial web sites. Prior non-native language experience has significantly affected language anxiety, language self-efficacy and the intention to use the non-native language commercial web sites, respectively. Furthermore, language anxiety has significantly affected language self-efficacy and Internet self-efficacy, respectively. Educational research and practitioner implications are provided at the end of the paper. Keywords: non-native language commercial web site; prior non-native language experience, language anxiety; language self-efficacy; Internet self-efficacy.
1 Introduction The function of language is to communicate with other people, so language is likely to play a crucial role as a communication medium [14]. English is one of the most popular languages the world over. In Taiwan, the government encourages students to start learning English from the fifth grade in elementary school. However, will a student with more English learning experience intend to use a commercial web site in English context more easily, have less anxiety using English or have more selfefficacy in English? Hence, the first purpose of this study is to uncover the impact of language experience on language anxiety, language self-efficacy and intention to use non-native language commercial web sites. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 94–102, 2009. © Springer-Verlag Berlin Heidelberg 2009
An Empirical Study the Effects of Language Factors on Web Site Use Intention
95
A number of recent studies have focused on the factors affecting Internet usage, such as Internet self-efficacy, perceived ease of use, social factors, subjective norm and so on [30, 8, 24]. Therefore, it is worth noticing the impact of language anxiety and language self-efficacy on the intention to use non-native language commercial web sites. Previous research has indicated many web users are identifying attractive shopping opportunities on the Internet, but there are barriers and other concerns preventing the purchase from being completed or the users from revisiting international web sites [36-37]. Why do web users hesitate to use commercial web sites? Does language interface play a critical role as the foundation of communication? Previous researches indicated that people possessing better prior language experience and greater fluency in the non-native language have increased opportunities for interaction with nonnative people [12,29]. In fact, language anxiety has been generally missing from information technology behavioral research. Recent estimates suggest that there are over 480 million Internet users globally. Among them, just over half do not use English as their language of communication [18, 20, 21]. Thus, in this research the commercial web site applications in English context were the study cases. The second purpose of this study is to investigate the effect of language anxiety and language self-efficacy on the intention to use commercial web sites.
2 Theoretical Background 2.1 Self-efficacy Self-efficacy plays an important role in affecting one’s behavior and motivation to execute the courses of action required to produce given attainments or behavior [2-3]. People with low self-efficacy will be less likely to perform related behavior in the future [5, 15]. Bandura [2, 5] identified four powerful sources influencing the personal self-efficacy which are performance accomplishment, vicarious experience, verbal persuasion, and emotional arousal. Bandura [2, 5] also suggested three outcomes of self-efficacy that can predict changes in people’s behavior- choice behavior, effort expenditure and persistence and emotional reactions or arousal. Thus, Bandura [5] suggested that the measurement of self-efficacy needed to be tailored to the specific domain of interest to maximize the prediction power. Therefore, in this study, Internet self-efficacy and language self-efficacy are applied to a specific type of self-efficacy in the Internet commercial site environment and language domain, respectively. 2.2 Anxiety Generally, there are three types of anxiety: state anxiety, trait anxiety, and situational anxiety. State anxiety is apprehension experienced at a particular period of time [41]. Trait anxiety refers to relatively stable individual differences that characterize people’s anxiety stated and their prominent defense against such states. Situational
96
H.-J. Yang and Y.-L. Lay
anxiety refers to individuals who suffer from reaching a specific environment, feeling anxious only when certain factors are present. According to Horwitz et al. [22], foreign language anxiety can be associated with three factors: a fear of negative evaluation, test anxiety, and communication apprehension. Hence, in this study we proposed language anxiety is a state anxiety and is then defined it as “a negative emotional state or negative cognition experienced by a user while an individual is accessing a non-native language sites.” 2.3
Language Experience
The word “experience” may refer both to mentally unprocessed immediately-perceived events as well as to the purported wisdom gained in subsequent reflection on those events or interpretation of them. Yates and Chandler’s research presented that prior knowledge or experience provides a great amount of relevant information in specific fields or domains as a foundation for organizing that knowledge [45]. In Eviatar’s research [16], he suggested that the language experience can be operationalized in two ways. One is by the number of language system in which the subject is fluent (nonverus multilingualism), and the other is by a specific characteristic of languages being tested. In this study, we proposed language experience is an experience in reading and writing abilities which accumulate over a period of time.
3 Research Models and Hypotheses According to previous research, we proposed a number of hypotheses related to the intention to use non-native language commercial web sites incorporating the selfefficacy theory and anxiety. 3.1 Prior Non-native Language Experience Prior knowledge or experience provides a great amount of relevant information in specific fields or domains as a foundation for organizing that knowledge [45]. Previous research indicates that if students enter a program with a wide range of prior experience and knowledge, it will help them quickly adopt and develop self-confidence in the new skills or capabilities they are learning [45]. Previous research also has shown that failed and successful feedback from the past experiences significantly affected the subsequent behaviors [6]. Specifically, past success would increase one’s self-efficacy and reduce one’s fear, and thus, increase one’s effort to put into potential new projects [44]. So the hypotheses 1 to 3 were then proposed as follows. H1: Prior non-native language experience has a negative effect on non-native language anxiety. H2: Prior non-native language experience has a positive effect on non-native language self-efficacy. H3: Prior non-native language experience has a positive effect on the intention to use non-native language commercial web sites.
An Empirical Study the Effects of Language Factors on Web Site Use Intention
97
3.2 Internet Self-efficacy, Language Self-efficacy and Language Anxiety Anxiety would inhibit one’s ability to process incoming behavior or performance. Language anxiety can pose potential problems because it can interfere with the acquisition, retention and production of the new language [31]. Thus, language anxiety in this study is defined as “a feeling of tension, apprehension and nervousness associated with the situation of using commercial web sites in English context”. As mentioned above, possessing greater fluency in the non-native language can lead to increased opportunities for interaction with non-native people [19,33]. This means that if an individual is good at a language which is not his native language, it can increase his opportunities to communicate with foreign people. With globalization, English has become one of the most popular languages. Currently, many homepages are designed in English. Therefore, if a person has problems comprehending a foreign language site, it will reduce their confidence or intention to shop or use specific nonnative language commercial web sites. Much previous research supports that the greater the anxiety is, the lower the selfefficacy is [2, 13, 15, 17]. The relationship between anxiety and self-efficacy is a well-established topic in the socio-psychological research field. A number of studies in MIS literature found that there is a negative relationship between computer anxiety and computer self-efficacy [10,34]. Generally speaking, the depressed people would be a self-critical denying his own idea and ability. Bandura [2] presented that the psychological pressure or anxiety would hinder one’s capability to judge the problem he/she faces. H4: Non-native language anxiety has a negative effect on non-native language selfefficacy. H5: Non-native language anxiety has a negative effect on Internet self-efficacy. 3.3 Anxiety, Self-efficacy, and Intention to Use Commercial Web Site Self-efficacy judgments are in turn related to outcome expectations. Outcome expectation depends on how well one thinks he can perform the behavior [2]. Internet self-efficacy and language self-efficacy focus on what individuals believe they can accomplish with online surfing. In turn, a significant amount of research has been conducted to examine the relationship between anxiety and adoption behavior [10, 34, 40, 43]. Previous MIS research also suggests that computer self-efficacy has a positive impact on computer usage [25]. Previous researchers argue that computer self-efficacy is a natural precursor to the Internet, and is invariably a necessary component for use of the Internet [32, 37, 39]. In sum, these studies and theories have laid a firm background for the study of the intention to use commercial web sites. Thus, our research hypotheses six to eight are presented as follows. H6: Non-native language self-efficacy has a positive effect on the intention to use non-native language commercial web sites. H7: Internet self-efficacy has a positive effect on the intention to use the nonnative language commercial web sites. H8: Non-native language anxiety has a negative effect on the intention to use nonnative language commercial web sites.
98
H.-J. Yang and Y.-L. Lay
4 Method 4.1 Participants The target sample for this study was undergraduate students. Complete data sets were obtained for 418 of the original 476 participants of college or university students in Taiwan, which included 218 males (52.2%) and 200 females (47.8%). The age of participants ranged from 18 to 25 years. The native or host language of participants is Mandarin. English is their second language. In the public school system, students have learned English from junior high school till the first year of university study, which is a period of seven years with three to five hours a week of normal study, not including multimedia teaching and computer-aided teaching. The respondents completed a five-section self-report questionnaire in 15-20 minutes. The survey was administered in class by the researcher with a brief introduction regarding the goal of the study. 4.2 Measures The questionnaire items used to operationalize the constructs of each investigated variable were adopted from relevant previous studies, with necessary validations and modification of wording. The Internet self-efficacy and language self-efficacy were adopted from the work of Torkzadeh & Van Dyke’s [42] and Eastin & LaRose’s concept [15] of Internet self-efficacy, replacing the references to computer software and hardware with the non-native language commercial web site environment. The adaptation of the foreign language classroom anxiety scale of Horwitz et al. [23] with modifications made to fit the language anxiety in commercial web sites. The language experience scale was adapted from Oxford [38] and Dobson [13], which is modified into the previous language experience scale. The intention to use commercial web sites. Intention to use the commercial web site use was adopted and modified from the works of Agarwal and Prasad [1] and Davis [11] with modifications to fit the content of non-native language commercial web sites. To ensure the data’s content and face validity and reliability, this study had the questionnaire pre-tested by 26 undergraduate students (10 males and 16 females) in their second year of study in business school. After pre-test, only some wordy in the questionnaire was modified and no items were deleted. 4.3 Reliability and Validity The Cronbach’s alpha values of variables all exceed 0.7, which is recommended as the passing mark of the reliability test for social science research [35]. All items passed the reliability test for language anxiety in general and yielded 0.92 alpha values. Prior non-native language experience has 0.87 alpha values. No items were dropped from language self-efficacy and Internet self-efficacy, which yielded 0.82 and 0.89 alpha values, respectively. The alpha value of the intention to use non-native language commercial web sites is 0.93. This demonstrates good internal consistency of each construct and indicates that the scale is trustworthy.
An Empirical Study the Effects of Language Factors on Web Site Use Intention
99
Discriminant validity was checked by means of factor analysis [28]. The measurement model using exploratory factor analysis (EFA) was assessed to check discriminant validity. The steps of EFA were, in the beginning, using principal component analysis to process factor, then using Varimax as orthogonal rotation and Eigen value equaling to 1 to get factor loading which should be greater than 0.5 [27]. If an item with factor loading values not greater than 0.5, then the item had to deleted and abandoned from further analysis. Among them, no items of factor loading in each construct were less than 0.5, so no items were deleted in each construct.
5 Results Structural equation modeling (SEM), a path analysis, was used to test the postulated hypotheses. Chau [9] and Joreskog et al. [26] suggested some general model fit indices criteria in SEM for identifying model’s goodness-of-fit. The best theoretical model fit was evaluated in terms of chi-square, root mean square residuals (RMR), and a number of goodness-of-fit indices. The chi-square (chi) divided by the degrees of freedom (df) can be seen as a less biased fit estimate (chi²/df) than the chi-square itself because it is dependent on sample size. This ratio should be small, and values below three are considered to be satisfactory (in this study, the ratio is 2) [7]. The root mean square residual should be very small, with values below 0.05 being desirable (0.007). The goodness of fit index (GFI) should be above 0.90 (0.998). The same applies to the adjusted GFI (AGFI; adjusted for degrees of freedom; 0.997). Prior non-native language experience had a significant negative effect on language anxiety ( =-0.331, P<.05), positive effect on language self-efficacy ( =0.374, P<.05) and positive effect on intention to use non-native language commercial web sites ( = 0.467, P<.001), as hypothesized H1, H2 and H3, respectively. Language anxiety had a significant negative effect on language self-efficacy ( =-0.243, P<0.001), Internet self-efficacy ( =-0.062, P<.001) and intention to use non-native language commercial web sites ( =-0.073, P<.001), as hypothesized H4, H5 and H8, respectively. Language self-efficacy and Internet self-efficacy had a significant positive effect on intention to use non-native language commercial web sites ( = = 0.190, P<.001) as hypothesized in H6 and H7. All eight 0.171, P<.001; hypotheses are significantly supported.
β
β
β
β β
β
β
β
6 Discussion and Research Implications The results of this research support the hypotheses that a causal model exists for prior non-native language experience, language anxiety, Internet self-efficacy, and language self-efficacy on the intention to use non-native language commercial web sites. As predicted and consistent with the theoretical perspective, language anxiety has a negative effect among language self-efficacy, Internet self-efficacy and the intention to use non-native language commercial web sites, respectively. This result is also consistent with previous studies [25, 33, 34]. This result indicated that if students have higher anxiety in a non-native language, they would lack confidence of nonnative language and students would be thus afraid to access non-native language
100
H.-J. Yang and Y.-L. Lay
commercial web sites. As to the relationship between language anxiety and Internet self-efficacy, the resulting data suggests a negative relationship in this research. This result indicates that if students have higher anxiety with non-native language usage, they have low Internet self-efficacy. This means that if students with greater nonnative language anxiety, they would not have confidence to access the Internet. This result is consistent with previous research [33, 34]. The results imply that people know what it is which is bothering them, should they try to eliminate or minimize their anxiety in some way. There is a consensus in the literature on the effects of self-efficacy. The extensive self-efficacy literature suggests that users’ self-efficacy with specific domain application influences subsequent behavior [2, 4, 5]. Language self-efficacy and Internet selfefficacy respectively has a positive effect on the intention to use non-native language commercial web sites. These findings are consistent with the theory of self-efficacy [2]. Language self-efficacy has a positive effect on the intention to use non-native language commercial web sites. Additionally, prior non-native language experience, as predicted, has a positive effect on language self-efficacy and intention to use non-native language commercial web sites and a negative effect on language anxiety, respectively. From a theoretical perspective, it seemed logical to hypothesize that more experience with the non-native language would result higher judgment of self-efficacy on the part of individuals because experience would affect one’s self-efficacy. Bateman & Zeithaml [6] proposed that failed and successful feedback from past experiences significantly affected subsequent behavior. Specifically, past success would increase one’s selfefficacy, and thus, increase one’s effort to put into potential new projects [44]. So in this study, students with more positive prior non-native language experience would have both greater language self-efficacy and intention to use non-native language commercial web sites. Whereas, prior non-native language experience as predicted has a negative effect on language anxiety. 6.1 Limitations and Future Research Two weaknesses must be addressed in this study. Firstly, the measurement of prior non-native language experience is based on respondents’ self-reporting about their non-native language experience, which may cause subjective judgment bias. Further research should try to overcome this bias. Secondly, this research concerns applying anxiety and self-efficacy into the scope of commercial web sites. For the intention or confidence to adopt (use) a new technology or new language to be a competent commercial web site user, it is possible that self-efficacy in the scope of Internet is different from the concept of language self-efficacy. More reliable and direct measure of language self-efficacy is needed. Further research should have this limitation rectified. Thus, future follow-up research should improve to further interpret the complex effects of intention to use the commercial web sites and so on. Acknowledgment. This work was supported by the National Science Council of Taiwan, ROC under Grant No. NSC-97-2416-H-167-009.
An Empirical Study the Effects of Language Factors on Web Site Use Intention
101
References 1. Agarwal, R., Prasad, J.: Are Individual Differences Germane to the Acceptance of New Information Technology. Deci. Sci. 30(2), 361–391 (1999) 2. Bandura, A.: Self-efficacy: Toward a Unifying Theory of Behavioral Change. Psychologist 37, 122–147 (1977) 3. Bandura, A.: Self-efficacy: The Exercise of Control. Freeman, New York (1997) 4. Bandura, A.: Self-efficacy Mechanisms in Human Agency. American Psychologist 37, 122–147 (1982) 5. Bandura, A.: Social Foundations of Thought and Action: A Social Cognitive Theory. Prentice Hall, Englewood Cliffs (1986) 6. Bateman, T.S., Zeithmal, C.P.: The Psychological Context of Strategic Decisions: A Model and Convergent Experimental Findings. Strategic Management Journal 10, 59–74 (1989) 7. Bollen, K.A., Long, J.S.: Testing Structural Equation Models. Sage, Newbury Park (1993) 8. Chang, M.K., Cheung, W.: Determinants of the Intention to Use Internet/WWW at Work: A Confirmatory Study. Info. & Manag. 39, 1–14 (2001) 9. Chau, P.Y.K.: Reexamining a Model for Evaluating Information Center Success Using a Structural Equation Modeling Approach. Decision Sciences 28(2), 309–334 (1997) 10. Compeau, D.R., Higgins, C.A.: Application of Social Cognitive Theory for Computer Skills. Information Systems Research 6(2), 118–143 (1995) 11. Davis, F.D.: Perceived Usefulness, Perceived Ease of Use, and User Acceptance of Information Technology. MIS Quarterly 13, 319–340 (1989) 12. de Haan, M., Elbers, E.: Reshaping Diversity in a Local Classroom: Communication and Identity Issues in Multicultural Schools in the Netherlands. Langu. and Comm. 3, 315–333 (2005) 13. Dobson, J.E.: Self-regulated Listening of French Language Students in a Web Environment. Dissertation, Department of Education. Catholic University of America (2001) 14. Dustmann, C.: The Effects of Education, Parental Background and Ethnic Concentration on Language. The Q. Rev. of Eco. and Fin. 37, 245–262 (1997) (special issues) 15. Eastin, M., LaRose, R.: Internet Self-efficacy and the Psychology of the Digital Divide. Journal of Computer-Mediated Communication 6(1) (2000), http://www.ascusc.org/jcmc/vol6/issue1/eastin.html 16. Eviatar, Z.: Language Experience and Right Hemisphere Tasks: The Effects of Scanning Habits and Multilingualism. Brain and Language 58, 157–173 (1997) 17. Gist, M.E., Mitchell, T.R.: Self-efficacy: A Theoretical Analysis of its Determinants and Malleability. Academy of Management Review 17, 183–211 (1992) 18. Global Research, Global Internet statistics (by language) (June 2001), http://www.glreach.com 19. Gullahorn, J.E., Gullahorn, J.T.: American Students Abroad: Professional versus Personal Development. Annals 368, 43–59 (1966) 20. Hass, R.: The Austrian Country Market: A European Case Study on Marketing Products and Service in a Cyber Mall. J. of Bus. Res. 55, 637–646 (2002) 21. Hills, P., Argyle, M.: Uses of the Internet and their Relationships with Individual Differences in Personality. Comp. in Hum. Beha. 19, 59–70 (2003) 22. Horwitz, E.K.: Preliminary Evidence for the Reliability and Validity of a Foreign Language Anxiety Scale. In: Horwitz, E.K., Young, D.J. (eds.) language anxiety: from theory and research classroom implications, pp. 37–39. Prentice-Hall, Englewood Cliffs (1991) 23. Horwitz, E.K., Young, D.J.: Language Anxiety from Theory and Research Classroom Implications, pp. 37–39. Prentice-Hall, Englewood Cliffs (1986)
102
H.-J. Yang and Y.-L. Lay
24. Hu, P.J.H., Clark, T.H.K., Ma, W.W.: Examining Technology Acceptance by School Teachers: A Longitudinal Study. Info. & Manag. 41, 227–241 (2003) 25. Igbaria, M., Iivari, J.: The Effects of Self-efficacy on Computer Usage. Int. J. of Manag. Sci. 23(6), 587–605 (1995) 26. Joreskog, K., Sorbom, D.: LISRELL 8: Structural Equation Modeling with the SIMPLIS Command Language, Erlbaum, Hillsdale, New York (1993) 27. Kaiser, H.: The Varimax Criterion for Analytic Rotation of Factors. Psychometrika 23, 187–200 (1958) 28. Kerlinger, F.N.: Foundations of Behavior Research, 3rd edn. Holt, Rineheart and Winston, Forth Worth (1986) 29. Landau, S.: Security, Liberty, and Electronic Communications. In: Franklin, M. (ed.) CRYPTO 2004. LNCS, vol. 3152, pp. 355–372. Springer, Heidelberg (2004) 30. Liao, S.Y., Shao, Y.P., Wang, H.Q., Chen, A.: The Adoption of Virtual Banking: An Empirical Study. Int. J. of Info. Manag. 19, 63–74 (1999) 31. Maclntyre, P.D., Gardner, R.C.: Methods and Results in the Study of Anxiety and Language Learning: A Review of the Literature. Language Learning 41, 85–117 (1991) 32. Maitland, C.: Measurement of Computer/Internet Self-efficacy: A Preliminary Analysis of Computer Self-efficacy and Internet Self-efficacy Measurement Instruments. Newsbytes New Network (1996), http://www.newsbytes.com/pubNews/97/105125.html (access date, May 5 2004) 33. Mak, A.S., Tran, C.: Big Five Personality and Cultural Relocation Factors in Vietnamese Australian Students Intercultural Social Self-efficacy. International Journal of Intercultural Relations 25, 181–201 (2001) 34. Marakas, G.M., Yi, M.Y., Johnson, R.D.: The Multilevel and Multifaceted Character of Computer Self-efficacy: Toward Clarification of the Construct and an Integrative Framework for Research. Information System Research 9(2), 126–163 (1998) 35. Nunnally, J.C.: Psychometric Theory, 2nd edn. McGraw-Hill, New York (1978) 36. Nvision, 4 out of 5 Users Never Re-visit the Average Web Site. CyberAtlas (1999), http://cyberatlas.internet.com/big-picture/demgraphics/ article/0,1323,5931_212071,000.html (access date, April 25 2008) 37. O’Cass, A., Fenech, T.: Web Retailing Adoption: Exploring the Nature of Internet Users Web Retailing Behavior. J. of Reta. Cons. Service 10, 81–94 (2003) 38. Oxford, R.L.: Language Learning Strategies: What Every Teacher Should Know. Heinle & Heinle Publishers, Boston (1990) 39. Rampodi-Hnilo, L.A.: The Hierarchy of Self-efficacy and Development of an Internet Self-efficacy Scale. Department of telecommunication, Michigan State University (access date, April 25 2004) (1996), http://www.tc.msu.edu/TC960/self.html 40. Reisinger, Y., Mavondo, T.: Travel Anxiety and Intention to Travel Internationally: Implications of Travel Risk Perception. Journal of Travel Research 43(3), 212–225 (2005) 41. Spielberger, C.D.: Manual for the State-trait Anxiety Inventory (Form Y). Consulting Psychological Press, Palo-Alto (1983) 42. Torkazdeh, G., Van Dyke, T.P.: Development and Validation of an Internet Self-efficacy Scale. Behavior and Information Technology 20(4), 275–280 (2001) 43. Tung, C.H., Chang, S.C.: Exploring Adolescents’ Intentions Regarding the Online Learning Courses in Taiwan, October 1, vol. 10, pp. 729–730 (2007) 44. Wood, R., Bandura, A.: Social Cognitive Theory of Organizational Management. Academy of Management Review, 361–384 (July 1989) 45. Yates, G.C.R., Chandler, M.: The Cognitive Psychology of Knowledge: Basic Research Findings and Educational Implications. Australian of Education 35, 131–153 (1991)
Enhancing Document Clustering through Heuristics and Summary-Based Pre-processing Sri Harsha Allamraju and Robert Chun San Jose State University, Department of Computer Science, San Jose, CA 95192
[email protected],
[email protected]
Abstract. Knowledge workers are burdened with information overload. The information they need might be scattered in many places, buried in a file system, in their email, or on the web. Traditional Clustering algorithms help in assimilating these wide sources of information and generating meaningful relationships amongst them. A typical clustering preprocessing involves tokenization, removal of stop words, stemming, pruning etc. In this paper, we propose the use of summary and heuristics of a document as a pre-processing technique. This technique preserves the formatting of a document and uses this information for producing better clusters. In addition, only a summary of a document is used as the basis for clustering instead of the whole document. Clustering algorithms using the proposed pre-processing technique on formatted documents resulted in improved and more meaningful clusters. Keywords: document clustering, clustering, summarization, heuristics.
1 Introduction In today’s information age, a typical computer user’s information is stored in many places. This information is stored in many forms but can be broadly classified into two forms, namely formatted and un-formatted documents. Unformatted documents typically include plain-text files, whereas formatted documents include word documents, presentations, and web pages. File managers allow users to store information in treestructured hierarchies, also known as folders. Thus the user faces the ontological burden of classifying one’s documents and storing them in relevant folders. With hard disk storage space in the orders of gigabytes, the user is burdened with information overload. Clustering algorithms help in grouping objects into one cluster based on a similarity measure. When applied on documents, this can help in grouping similar documents based on content. Many clustering algorithms have been proposed for clustering documents. A typical clustering process involves tokenization, removal of stop words, stemming and pruning. A formatted document such as a word document typically consists of headings, emphasized words, de-emphasized words, italicized words etc. Also the font, size and color of text in these documents vary. This implies that some words in the document are more important than others. This importance is evident from the increased human readability of a formatted document over that of an unformatted one. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 105–113, 2009. © Springer-Verlag Berlin Heidelberg 2009
106
S.H. Allamraju and R. Chun
In the traditional clustering pre-processing step, the document is first tokenized. However, once tokenized, the words lose their formatting. This implies that all words contribute equally to clustering irrespective of its formatting in the original document. In this paper, we propose an additional pre-processing step. For each document, a representative document is generated. This is obtained by combining the summary of a document with its heuristics. The heuristics of a document is the set of words which are emphasized in the document through the author’s use of various formatting techniques. For example, words that are bolded, underlined, italicized, or that appear in headings contribute valuable heuristics concerning the document’s content. The summary of a document is obtained by using a document summarization algorithm. The document’s summary, together with its heuristics, is clustered instead of the whole document. The proposed approach has many advantages. Firstly, it takes into account the formatting of the document. This helps in identifying words in the document which are more important and representative of the document’s content. Secondly, only the summary of the document is utilized for clustering rather than the entire document. This helps in reducing the “noise” in a document and gathers sentences that are of utmost importance. Therefore, the summary of the document presents a realistic view of the document’s content. Thirdly, the proposed pre-processing helps in producing more accurate and realistic clusters. The rest of the paper is organized as follows. Section 2 describes existing work done with relevance to the topic of this paper. Section 3 consists of a detailed explanation of the proposed pre-processing technique. Section 4 provides experimental results. Section 5 outlines some concluding remarks, ongoing research and future direction of work.
2 Related Work Clustering algorithms have a variety of applications and are used in various fields such as image segmentation, object recognition and information retrieval. Different Clustering algorithms work best for different types of data. Jain et al. [1] provides an overview of Data Clustering techniques. Budzik et al. [2] proposed a system which extracts keywords from a document that are representative of the document’s content. These keywords are later fed to a web search engine and web pages related to the context in which the user is working is shown. In order to extract search terms from a document, the authors proposed a set of heuristics. A subset of these heuristics forms the basis of the proposed preprocessing technique discussed here. CACTUS [9] attempts to cluster categorical data using summaries. Visser et al. [3] built an automatic summarizer system based on word frequency count, cue phrase, location, title and query method. In the word frequency method, each sentence is assigned a score based on the relevant words in that sentence. In a cue phrase method, each sentence was assigned a cue score based on the presence of relevant and important phrases. In the location method, a score is assigned to the sentence based on its location in a paragraph or proximity to headings. In the title method, sentences containing words present in the document’s title are given a higher score. In the query method, sentences matching the query words are given more importance. The final score
Enhancing Document Clustering
107
of each sentence is obtained by weighted sum of above-mentioned features. Thus, the summary obtained gives the list of sentences which are of utmost importance and most representative of the document’s content. This summarization technique is also used as a basis of the proposed pre-processing technique described next.
3 Proposed Pre-processing Technique Traditional Clustering algorithms pre-process the input data through tokenization, stemming, pruning and removal of stop words. This works well for unformatted documents such as plain-text files. However by using the same pre-processing technique for formatted documents such as word documents, presentations, web pages etc., certain important information is lost. This is reflected in the quality of clusters thus obtained. This paper stands by the premise that formatted documents contain some more information than plain-text files and so should be treated differently. The proposed pre-processing step consists of two components, namely document heuristics and summarization. The following section describes each of them in detail.
Fig. 1. Positioning of proposed pre-processing technique with respect to existing practice
3.1 Document Heuristics Budzik et al. [2] proposed a set of heuristics for extracting important keywords from a document. They are as follows: 1) remove stop words, 2) value frequently used words, 3) value emphasized words, 4) value words that appear in the beginning of the document rather than at the end, 5) punish words appearing to be intentionally deemphasized, 6) ignore the ordering of words in a list and 7) ignore words that occur in sections of the document that are not indicative of the document’s content. Of the heuristics mentioned above, some of the heuristics are not applied here since they are taken into consideration by the document summarizer. One of the main heuristics used by the proposed pre-processing technique is to value emphasized words and to punish words appearing to be intentionally de-emphasized. Emphasized words refer to the set of words that are formatted as bold characters, italicized, underlined, appear in capital letters and in headings. In addition, words that are colored are also considered emphasized. De-emphasized words refer to words that have a font size smaller than that of the majority of words in the document. Thus, by subjecting a document to heuristics, a set of emphasized words is obtained. However, in the case of plain-text files, there is no formatting present. Therefore, these particular heuristics will not produce any results on plain text documents.
108
S.H. Allamraju and R. Chun
3.2 Document Summary Automatic Text Summarization is one of the important aspects of the proposed preprocessing technique. The main idea of using automatic summarization is to use the portion of the document that is most important and that can represent the whole document in terms of its content and context. By using automatic summarization, only those sentences of the document are obtained which are most relevant. Thus, this reduces the noise in the clustering data that might be obtained due to the presence of unwanted sentences and words. Therefore, instead of performing clustering on the whole document, only the summary and heuristics of the document are used. The automatic summarizer built by Visser et al. [3] was created for generating summaries of scientific documents. Since most of the scientific documents such as research papers are well formatted, the following summarizer was chosen for improved accuracy. The summary is generated by the system based on weighted scores obtained by word frequency count, cue phrase, location, title and query. However, since there is no query involved in clustering, a weight of zero is assigned for the query method. In addition, the original summarizer was designed to work more effectively for scientific documents. The cue phrase method looks for certain phrases most frequently found in research papers and other scientific documents. To keep the summarizer more generic in nature, the cue phrase method is also assigned a weight of zero. 3.3 Process The whole process of the proposed pre-processing technique is as shown in Fig 2. The document is first sent to a heuristic analyzer. It returns a set of emphasized words in the document. Then, the document is fed to an automatic summarizer. This returns the summary of the document. The summary along with the words obtained from heuristics is stored in a file. This new file is a representative document for the original formatted document. Thus for each document in the corpus which is to be clustered, a representative document is generated which consists of its summary and heuristics. These representative documents are used for clustering instead of the original documents. The standard pre-processing techniques are still applied to the representative documents and then sent as input to the clustering engine. Once the representative documents are clustered, they are mapped back to their original document.
Fig. 2. Proposed Pre-processing technique in detail
Enhancing Document Clustering
109
Fig. 3. Comparison between original document and its representative document
4 Experimental Setup 4.1 Clustering Engine The CLUTO [4] clustering toolkit was used for clustering documents. It is a highly scalable toolkit and can be used on high dimensional dataset. A wide variety of clustering algorithms such as partitional, agglomerative and graph-partitioning based have been implemented in this toolkit. An extensive selection of similarity measure functions is available such as Euclidean, Cosine, correlation co-efficient and Jaccard. In addition, a user defined similarity measure can be used. The CLUTO clustering toolkit provides detailed reports for each clustering activity. Different external quality measures such as entropy and purity are computed for each cluster. In addition, CLUTO implements five new clustering criterion functions proposed by Karypis et al. [5]. 4.2 Visualization Engine In order to understand the topology of the clusters that are obtained, gCLUTO [6] was used for visualization. It produces two types of visualizations on cluster data, namely Matrix Visualization and Mountain Visualization. The Mountain Visualization was used here for analyzing the results. The Mountain Visualization technique uses peaks to represent clusters. The degree of separation of one cluster from the other denotes the relative similarity of clusters. Clusters that are very similar to each other are close to each other and in some cases overlap. This visualization is effective in understanding the relationships between clusters. Each peak corresponds to a single cluster. These peaks are of varying height, size and color. The height of the peak represents the internal cluster similarity. The higher the peak the greater is the internal similarity and vice versa. The volume of the peak represents the number of documents in a cluster. The color of the peaks represents the internal standard deviation. Different colors mean different levels of deviation. Red represents a low standard deviation, whereas blue corresponds to high
110
S.H. Allamraju and R. Chun
Fig. 4. Mountain Visualization of sample data showing peaks of different heights and colors
standard deviation. Clusters with high standard deviations are noisy and are definitely unwanted. Colors such as red, orange, yellow and green represent standard deviations from low to medium range, with red representing least standard deviation. Thus an ideal clustering would be expected to have distinct clusters with low standard deviation and high internal cluster similarity. This corresponds to a mountain visualization consisting of high non-overlapping peaks colored in red or orange. 4.3 Clustering Algorithms Different clustering algorithms work best for different datasets. Primarily, the agglomerative clustering algorithm was applied on documents for clustering. Given the required number of clusters, the agglomerative algorithm first assigns each document to its own cluster and then merges other documents repeatedly until the required number of clusters is obtained. The criterion used for merging one document into a cluster depends on the merging schemes. The CLUTO clustering toolkit supports a wide variety of merging schemes, namely single-link, complete-link and group average approaches in addition to seven new merging schemes. 4.4 Dataset The Reuters Transcribed Subset dataset1 was used to evaluate the effectiveness of the proposed pre-processing technique. This dataset is a subset of Reuters-21578 collection2. The Reuters Transcribed dataset consists of 20 files picked from each of the 10 largest classes in the Reuters-21578 collection. These files were generated by an automatic speech recognition (ASR) system. This possibly introduces a certain degree of noise in the data. However, the proposed pre-processing technique is not highly effective when applied to plain-text documents without any formatting. Thus, all the 200 files were manually formatted using headings, bolds, italics and other forms of emphasis. 1 2
Available at http://kdd.ics.uci.edu/databases/reuters_transcribed/reuters_transcribed.html Available at http://www.daviddlewis.com/resources/testcollections/reuters21578/
Enhancing Document Clustering
111
5 Results The Reuters Transcribed dataset is formatted and then subjected to the proposed preprocessing technique. The document is sent to a heuristics analyzer and a document summarizer. The words returned by the heuristic analyzer are merged with the summary obtained from the document summarizer. This merged document becomes the representative document for the original document and is clustered on behalf of the original document. An agglomerative k-means clustering algorithm is used. Since the original dataset is manually classified into 10 categories, the value of k for the k-means clustering algorithm is given as 10. The CLUTO clustering engine applies the agglomerative k-means clustering algorithm and tries to divide the given input dataset into 10 clusters.
Fig. 5. Mountain Visualization of Reuters Transcribed Subset Dataset using standard clustering techniques
Once the clusters are obtained, the gCLUTO software is used to visualize the resulting cluster formation. The gCLUTO software takes a matrix file as input. A matrix file is an intermediate file generated by the CLUTO clustering engine. The columns in the matrix file correspond to unique words in the given document corpus. The rows represent the document number. Once the required matrix file is given as input to gCLUTO, Mountain Visualization of resulting clusters is generated and displayed. In the first experiment, the test dataset is pre-processed using standard clustering techniques and then sent to the clustering engine for k-means agglomerative clustering. The resultant clusters obtained are as shown in Fig. 5. By observing the Mountain Visualization (shown in Fig. 4.) it is seen that some of the clusters are overlapped and are not separated such as clusters (0,6) and (3,7). Most of the peaks (clusters) are green in color indicating a comparatively high standard deviation. In addition, cluster 2 is pale blue in color indicating very high standard deviation. Cluster 4 is the highest of all indicating greater internal similarity. In the second experiment, the test dataset is pre-processed using the proposed preprocessing techniques and then sent to the clustering engine for k-means agglomerative clustering. The resultant clusters obtained are as shown in Fig. 6.
112
S.H. Allamraju and R. Chun
The Mountain Visualization of cluster distribution obtained by applying the proposed summary and heuristics-based pre-processing produced better and elegant results. This is evident from the visualizations obtained as shown in Fig. 6. Most of the clusters are in red, orange or yellow colors indicating a low standard deviation within clusters. Most of the clusters are of similar height indicating a uniform distribution of internal similarity across clusters. Cluster 4 is the highest peak, indicating high internal similarity. The clusters are evenly distributed and well separated from one another. In comparison with the standard clustering technique, it is observed that the proposed pre-processing technique helped in creating distinctly separated clusters. Also, the overall internal similarity of elements within a cluster is increased. Additionally, by using the proposed heuristics and summary-based pre-processing, there has been an improvement in standard deviation within clusters. The proposed pre-processing produced clusters with low internal standard deviation. It can supplement, and can be used in conjunction with, existing approaches to clustering. The augmentation of traditional clustering techniques with our proposed heuristics and summary based technique does not add significant processing times – the analysis of the 200 News articles took just 1.2 seconds more than otherwise.
Fig. 6. Mountain Visualization of Reuters Transcribed Subset Dataset using proposed preprocessing techniques
6 Conclusions and Future Work In this paper, we proposed summary and heuristics-based pre-processing for document clustering. We have shown that this pre-processing technique results in clusters with improved internal and external cluster quality measures than compared to existing clustering techniques. We have used a visualization technique as the basis for such a conclusion. This states that when clustering formatted documents, using just the summary and heuristics themselves are enough and that the whole text of the document may not be necessary. Heuristics and Summary-based pre-processing opens a new dimension in document clustering.
Enhancing Document Clustering
113
The proposed pre-processing technique has been applied only on the Reuters Transcribed Subset dataset. The plain-text dataset was converted into individual word documents and the news article title was manually set to bold for each file. However, in case of research papers, which follow certain naming conventions for headings such as “Abstract”, “Related Work”, “Conclusions” etc. it would be interesting to observe if the proposed pre-processing would actually be able to classify them into different classes. In short, the effectiveness of the proposed pre-processing steps should be examined using a wider variety of input files as test data, and that it is early to conclude the generality of the proposed pre-processing technique. In this paper, the given dataset is pre-processed using the proposed technique and then subjected to agglomerative k-means clustering. However, it would be interesting to see the effect of using other clustering algorithms on the proposed pre-processing technique. In addition, it would be interesting to note the effect of different summary ratios on the quality of clusters. This would lead to finding an ideal summary ratio value where the quality of clusters produced is optimal for this kind of pre-processing. Finally the effect of using a weighted approach to summary and heuristic preprocessing should be investigated.
References 1. Jain, A.K., Murty, M.N., Flynn, P.J.: Data Clustering: A Review. ACM Computing Surveys 31(3), 264–323 (1999) 2. Budzik, J., Hammond, K.J., Birnbaum, L.: Information access in context. Knowledge-Based Systems 14, 37–53 (2001) 3. Visser, W.T., Wieling, M.B.: Sentence-based Summarization of Scientific Documents. The design and implementation of an online available automatic summarizer. Report (2009), http://home.hccnet.nl/m.b.wieling/files/wielingvisser05automa ticsummarization.pdf (last retrieved Febuary 12, 2009) 4. Zhao, Y., Karypis, G.: Evaluation of hierarchical clustering algorithms for documents datasets. In: International Conference on Information and Knowledge Management, McLean, Virginia, United States, pp. 515–524 (2002) 5. Zhao, Y., & Karypis, G.: Criterion functions for document clustering: Experiments and analysis. Technical report, Department of Computer Science, University of Minnesota 6. Rasmussen, M., Karypis, G.: gCLUTO: An interactive clustering, visualization and analysis system. Technical Report 04-021, University of Minnesota, s (2004) 7. Reuters-21578 Dataset, http://kdd.ics.uci.edu/databases/reuters_transcribed/ reuters_transcribed.html 8. Reuters Transcribed Subset Dataset, http://www.daviddlewis.com/resources/ testcollections/reuters21578/ 9. Ganti, V., Gehrke, J., Ramakrishnan, R.: CACTUS-Clustering Categorical Data Using Summaries. In: Proceedings of the ACM-SIGKDD International Conference on Knowledge Discovery and Data Mining, San Diego, CA, United States (1999)
Email Reply Prediction: A Machine Learning Approach Taiwo Ayodele, Shikun Zhou, and Rinat Khusainov Department of Electronics and Computer Engineering, University of Portsmouth, Anglsea Building, Anglsea Road, Portsmouth, PO1 3DJ, Hampshire, United kingdom {taiwo.ayodele,shikun.zhou,rinat.khusainov}@port.ac.uk
Abstract. Email has now become the most-used communication tool in the world and has also become the primary business productivity applications for most organizations and individuals. With the ever increasing popularity of emails, email over-load and prioritization becomes a major problem for many email users. Users spend a lot of time reading, replying and organizing their emails. To help users organize and prioritize their email messages, we propose a new framework; email reply prediction with unsupervised learning. The goal is to provide concise, highly structured and prioritized emails, thus saving the user from browsing through each email one by one and help to save time. In this paper, we discuss the features used to differentiate emails, show promising initial results with unsupervised machine learning model, and outline future directions for this work. Keywords: Email reply prediction, machine learning, email messages, interrogative words, need reply, do not need reply, email headers, unsupervised learning.
1 Introduction One of the annoying things is when someone does not get back after sending so many email messages to them or when one is waiting to hear back from a friend or colleague at work about completing a particular project which can have a severe impact on the overall operation. This can be frustrating. Email prediction is a method of anticipating if email messages received require a reply or did not require any urgent attention. Our email prediction system will enable email users to both manage their email inboxes and at the same time manage their time more efficiently. Whittaker and Sider [1] analyzed the use of email to perform task management, personal archiving and asynchronous communication and referred to the three as “email overload”. They concluded that: • Users perform a large variety of work related task with email and • As a result, users are overwhelmed with the amount of information in their mail box. The existing solutions to email reply prediction relied on the intuition that user’s previous patterns of communication are indicative of future behaviour [2]. Also M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 114–123, 2009. © Springer-Verlag Berlin Heidelberg 2009
Email Reply Prediction: A Machine Learning Approach
115
Dredze et al [3] provided solutions to email reply prediction by assessing date and time in email messages as email containing date and time are time sensitive and may require a reply. Other studies have focused on how people save their email, what purposes it serves for them, and its importance as a tool for coordination in everyday life [5, 6, 7, 8]. This paper proposes to solve the problem of email prioritization and overload by determining if email received needs reply. Our prediction system provides a better and efficient way of prioritizing email messages as well as provides a new method to email reply prediction.
2 Previous Work Because email is one of the most used communication tools in the world. Sproull and Kiesler [8] provide a summary of much of the early work on the social and organizational aspects of email. Here we will focus on work about email reply prediction strategies, as well as research dedicated to alleviating the problem of “email overload and prioritization.” Mackay [7] observed that people used email in highly diverse ways, and Whittaker and Sidner [1] extended this work. They found that in addition to basic communication, email was “overloaded” in the sense of being used for a wide variety of tasks-communication, reminders, contact management, task management, and information storage. Ducheneaut and Bellotti [5] performed a study of email usage in three organizations and found, as had previous authors, that email was being used for a wide variety of functions. In particular, they noted that people used emails as reminders for things they had to do and for task management more generally. Mackay [7] also noted that people fell into one of two categories in handling their email: prioritizers or archivers. Prioritizers managed messages as they came in, keeping tight control of their inbox, whereas archivers archived information for later use, making sure they did not miss important messages. Tyler and Tang in a recent interview study identified several factors that may influence likelihood of response [9].
3 System Framework We used machine learning techniques for finding salient noun phrases, interrogative words, questions marks, date and time that can determine whether email message require a reply. This section describes the three steps involved in this prioritization task: • What representation is appropriate for the information to be prioritized as relevant or non-relevant phrases, interrogative words • Which features should be associated with each and • Which model should be used? We implemented machine learning approach to solve the problem of email reply predictions. Machine learning is learning the theory automatically from the data, through a process of inference, model fitting, or learning from examples. It is also an
116
T. Ayodele, S. Zhou, and R. Khusainov
automated extraction of useful information from a body of data by building a good probabilistic model. 3.1 Importance of Learning Our work involves machine learning because it is the underlying method that enables us to generate high statistical results. These are the importance of machine learning as applied in our work: • Environments change over time, and new knowledge is constantly being discovered. A continuous redesign of the systems “by hand” may be difficult. So, machine that can adapt to changing environment would reduce the need for constant redesign. • New knowledge about tasks is constantly being discovered by humans. Like vocabulary changes, and there is constant stream of new events in the world. Continuing redesign of a system to conform to new knowledge is impractical, but machine learning methods might be able to tract much of it. Figure 1 shows the schematic diagram. Figure 1: A schematic diagram of the architecture for email words extraction from incoming email messages for efficient reply prediction proposes in this work. Raw emails
Algorithm Processing
Predicting Algorithm
Message control
Need reply -1 Do not need reply- 0
Fig. 1. Architecture for words extraction from incoming email
Our proposed prediction system accept email messages as input data and as the emails are passed unto our machine learning algorithm, features are obtained from each emails and the predictor determines in numeric values the mails that require replies and the emails that does not require replies as shown in figure 1 above.
4
Email Reply Prediction (ERP)
This is a decision making system that could determine if emails received require a reply. For any given email datasets, there are multiple email conversations and to capture these different conversations, we assume that if one email was a reply to the sender’s original message, then such a mail may require attention and this is where
Email Reply Prediction: A Machine Learning Approach
117
our email reply scoring method originated. We developed a dictionary of favourite users’ words- this is a dictionary of words that email users keep and noted for their favourable word that they use when communicating using their email, develop a scoring mechanism for each annotated emails and the more score that a mail acquire the more apparent such email needs reply. All emails have same scores zeros at the beginning of the analysis. Negative score is possible. Also each email has been annotated with these properties: • definitely need reply, definitely not need reply If one email have both “definitely need reply” and “definitely not need reply” then this properties delete each other but this case is rare. The term “definitely need reply” status is given if our algorithm detect phrases such as “please reply soon” and “definitely not need reply” status is given when we found phrases such as “do not reply” or address such as
[email protected] or if other extracted features in the email content does not suggest any urgency. In the case that a phrase such as do not reply is found, our system has been designed in such a way that such a mail will still be brought to the attention of the email user but will be flagged as do not need a reply but it will be in the email client to be read any time. Our scoring system changes score allocation to each email before making a decision if they need a reply or not and also, if it founds interrogative words or questions and questions mark (s) in email messages, it increases or decreases the score. The other features that we investigated are: e.g. • Interrogative words: Can…? Could…? will…? Who ls…? has…? have…? may…? need…? are…? is…? Etc • Who…? where…? what…? or common pattern Why…? how…? • Communications from sender: if communication with sender was earlier then increase score (“Re:”-letters) (user sent emails analysis need) • if sender send emails earlier and that was not answered then decrease score(user sent emails analysis need) • Email Domains: if senders name is something like “… .com” then decrease score, it is big companies emailing • Email Fields: when many emails in “CC” field then decrease score • Dictionary of words: if email has many words that interesting to user then increase score, dictionary of favorite users words need • Attachments: if big attachment in letter then increase scores (photo or interesting pdf-article from friend) . 4.1 Scoring Method Our approach analysed the feature of emails namely; phrases, interrogative words, questions and question mark, attachments, early communications of senders and many other aforementioned features in the email and our algorithm prediction system (APS) performs unsupervised scoring methods using weighting measures [4]. All new emails have number – score. Then more score then more email need reply. We calculate the weighting scores on the features of the email by implementing a method called “the inner product” with its elements. We collect n numbers of emails using this function below:
118
T. Ayodele, S. Zhou, and R. Khusainov
S q ,e =
∑ (w
q ,t
.we,t )
T
Here, we ,t is the email-term weight while query-term weight is denoted by wq ,t and we also denote these various set: • • • •
the set E of emails; for each term t, the set Et of emails containing t; the set T distinct terms in the database and the set Te of distinct terms in emails e , and similarly Tq for queries and
Tq ,e = Tq ∩ Te The terms are the features extracted to determine the email prediction namely: phrases, interrogative words, question marks, attachments and many more. When the formula above is applied, the average weighting score is calculated for each email and if it is above the set threshold, then that mail will be categorized as need reply or do not need reply as given relevant item is retrievable without retrieving number of irrelevant items. Our predictor assigns a weight score to any question (s), question mark (s) found in email subject as well as contents of the mail. For example: A question in the subject has a weight score of 3 point of value and a weight score of 2 in the body of the email message. Do note that a question is a sentence that ends with the sign "?" and start with an interrogation pattern like: "where", "when", etc. Also, a score of 1 is assigned to the following sample features: "if communication with sender was earlier (“Re:”letters)", emails from specific domain (.ac.uk, .edu), phrases such as “please reply soon”, if there is email address in cc or bcc, all these are assigned a score of 1. The prediction analysts concluded that the maximum weight score that could be assigned to every email is 10 and choose 7 as the threshold weighting score that a mail must attain before it could be grouped as “need reply- 1” and any email that does not measure up to the threshold will be re-examined and if other factors have been reassessed and could not meet up with the threshold at the second attempt, then it will be grouped as “do not need reply- 0. 4.2 Email Prediction Methods (EPM) Email space is a function of the manner in which terms and term weights are assigned to the various emails with an optimum email space configuration that provides an effective performance. We make use of inner product method. Inner product space is a vector space of arbitrary (possibly infinite) dimension with additional structure, which, among other things, enables generalization of concepts from two or threedimensional Euclidean geometry. Since our annotated emails from Enron corpus are treated like a bulk of dataset, we used term weighting with unsupervised techniques with our approach of heuristic techniques to provide a well organised and prioritized email prediction system.
Email Reply Prediction: A Machine Learning Approach
119
Reply Prediction algorithm 1. Define X as the number of matching needed to mark the message needs reply 2. Define Count as the number of matching =0 3. If CC or BCC contains email addresses then a. Count = Count+1 4. create a rule that a. If the contents contains some of these words i. Count = Count+1 b. must, should, what about, meeting ,priority, i. Count = Count+1 c. Dear, hello, hi i. Count = Count+1 d. Multiple of "?" i. Count = Count+1 e. Dates or months names i. Count = Count+1 f. AM,PM i. Count = Count+1 5. if(Count > X) a. then mail need reply b. Else c. mail doesn’t need reply }
Fig. 2. Algorithm prediction System
4.3
Algorithm Prediction System (APS)
Algorithm prediction system uses a heuristics-based approach with embedded favorite dictionary of word and phrases, with weighting measures. The assumption is that if interrogative words, questions, questions mark(s), phrases such as do reply, when will you, if date and time are found in email messages, such a mail is important and will be assigned some score. The algorithm is shown in figure 2. Algorithm prediction system (APS) for email management is a new unsupervised machine learning techniques that is implemented. APS described above uses a precision and recall to evaluate this new technique in comparison with gold standard (Human participants).
5 Dataset Setup We collected over 5000 email conversations from the Enron email dataset [9], a publicly available corpus with about 150 users and 120,000 emails as the test bed and had 80 human reviewers to review the email prediction system. Notice that having such a gold standard may also be used to verify our assumptions and algorithm. We annotated 5000 emails to determine the original class with numeric values: need reply- 1 and do not need reply- 0. We then used human annotated emails as the gold standard to compare our algorithm result with human review results. The 80 human prediction analysts reviewed those 5000 selected email conversations. All the analysts were undergraduate and graduate in university of Portsmouth. Their discipline covered various areas including Science and Engineering, Arts, Education, Law, Business and IT. Since many emails in the Enron datasets [9] relate to business, IT
120
T. Ayodele, S. Zhou, and R. Khusainov
and law issues, the variety of the human prediction analysts, especially those with business and legal background are of asset to this user study. Each prediction analysts reviewed 50 distinct email conversations in one hour. For each email features extracted as described above, human prediction analysts (hpa) retain the highest weighting score, and then choose threshold and emails found above this threshold to be categorized as need reply and any emails that does not reach up to the threshold will be categorized as do not need reply. Thus, our expectation that human-annotated email prediction will show great variation was borne out, we discuss these differences further in section 6.
6 Evaluations and Results In order to compare different approaches of email reply prediction, a gold standard is needed. In practice, for comparing extractive predictor, we annotated 5000 emails from Enron email corpus to either: • Need reply • Do not need reply We tested our algorithm with the embedded similarity measure approach on the 5000 email datasets. To measure the quality and goodness of the email prediction, gold standards are used as references. It is noticed that our unsupervised machine learning approach achieved 98% accuracy in comparison to the gold standard. A sample output is shown below:
Fig. 3. A sample Reply Predictor System
Figure 3 and 4 show an output sample of our email reply prediction mail client. As emails are being passed unto the prediction system, they aforementioned features are being extracted by our prediction model and the email messages in yellow colour indicate those that require a reply. This section describes experiments using APS system to automatically induced email features classifiers, using the features described in Section 4. Like many learning programmes, APS takes emails as input and the classes to be learned, a set of features names and possible values and training data specifying the class and feature values for each training example. In our case, the training examples are the Enron email datasets. APS outputs a classification model for
Email Reply Prediction: A Machine Learning Approach
121
predicting the class (i.e need reply- 1, do not need reply- 0). We obtained the results presented here using precision and recall. In this paper, we evaluated APS system based on weighting measures, and human judgments. To measure the quality and goodness of the email reply prediction system, gold standards are used as references. Human email predictions make up the gold standards. We evaluate our proposed email prediction system against human email predictions from human participants. Human participant detected replies by matching email features: • Interrogative words in email contents - when, where, can, how as these words indicate a request and a need for an answer. • Phrases - reply soon, need your help, looking forward to hearing from you, interview now as these phrases indicate time and urgency. We build most used phrases from the corpus and our algorithm keeps learning from this and keep expanding its knowledge with the new phrases and becomes more intelligent • previous email conversations - this is important because previous conversation is a clue to discover what has happened in the past and extract the old content and check with the new conversation to determine if such previous communication is vital to our decision making or not. • Attachments - most email users from our survey send attachments when there is need for clarity or as prove of a task or evidence of something and this indicate that an email message that contain attachments may need a reply and other extracted features that we investigated are “extracting interesting words as chosen by email user from dictionary, question mark (s) in emails and reference fields of a message with message Id from original message. Figure 4 below shows more evaluation graphical output.
Fig. 4. A sample of our prediction output
Our solutions to reduce email overloads, unstructured email messages, email congestions were analysed, tested and evaluated by group of participant from the university of Portsmouth and companies around the city ranging from academic and non-academic staffs. Evaluation Result ratio of male to female participant is 50:30
122
T. Ayodele, S. Zhou, and R. Khusainov
Precision and recall (compared to gold standard) Correct predicted group 4897
Total Predicted Group Found 4993
Total Emails 5097
Precision
Recall
98.1%
96.1%
Precision and recall on a per email basis
Fig. 5. Evaluation Result
and the whole group is a mixture of diverse cultures and backgrounds. There are 50 male that participated in the testing and evaluation while 30 females participated. The ratio does not change the output result of the analysts and that their decision is made based on realistic approach. Figure 4 explains how our reply prediction client works. The participants were separated into 2 groups and were given 1500 emails to analyse, annotate and predict the mails that require a reply. Group 1 confirmed that out of 1500 emails, only approximately 668 require a reply while group 2 confirmed that approximately 665 require a reply. With the human participants, the average estimation of mails that need reply is 667 which are estimated as 100% accurate. Our proposed email reply prediction system estimated that approximately 672 require a reply and is approximately 95% accurate as compared with gold standard. We also evaluate our algorithm prediction system using precision and recall as the measurement of evaluation for our system: • For 1500 emails, compute the recall and precision where a correct predicted group is found. • Given our prediction system whose input are email messages, and whose outputs are need reply- 1 and did not need reply- 0. The recall and precision is computed as:
Email Reply Prediction: A Machine Learning Approach
123
We evaluate our prediction algorithm’s performance by comparing performance of human participants with our proposed algorithm result. Figure 5 shows detail results.
7 Conclusion and Future Work In this paper, we presented a better way to prioritized email messages and automatically alert email users regarding email messages that require attention. Our solution to reduce email overload, overcome unstructured email boxes, reduce high volume of emails, reduce email congestions and overcome limited storage space for email messages is one of the better way to manage email messages. We did study the features of over 5000 email messages and train our prediction system based on the aforementioned features to extract and decide the email messages that require replies and keep learning as new incoming emails arrives. Our system appears to work better than existing approach and the unsupervised learning approach help the knowledge based and self learning trait and ability to continue to learn and be more intelligent and all these make our solution a better approach.
References 1. Whittaker, S., Sider, C.: Email overload: exploring personal information management of email. In: CHI 1996, pp. 276–283. ACM Press, New York (1996) 2. Tyler, J., Tang, J.: When can I expect an email response? A study of rhythms in email usage. In: Proc. of ECSCW 2003, pp. 238–258. Oulu Univ. Press (2003) 3. Dredze, M., Blitzer, J., Pereira, F.: Reply Expectation Prediction for Email Management. In: CEAS 2005, 2nd Conference on Email and Anti-Spam, Stanford University, CA (2005) 4. Salton, G., Wong, A., Yang, S.S.: A vector space model for automatic indexing. Communications of the ACM 18, 613–620 (2005) 5. Ducheneaut, N., Belloti, V.: Email as habitat: An exploration of embedded personal information management. Interactions 8(5), 30–38 (2001) 6. Kraut, R.E., Attewell, P.: Media use in a global corporation: Electronic mail and organizational knowledge, in Culture of the Internet, pp. 323–342. Lawrence Erlbaum Associates, Mahwah (1997) 7. Mackay, W.: Diversity in the use of electronic mail: A preliminary inquiry. ACM Transactions on Office Information Systems 6(4), 380–397 (1988) 8. Sproull, L., Kiesler, S.: Connections: New ways of working in the networked organization. MIT Press, Cambridge (1991) 9. Klimt, B., Yang, Y.: The Enron corpus: A new dataset for email classification research. In: Boulicaut, J.-F., Esposito, F., Giannotti, F., Pedreschi, D. (eds.) ECML 2004. LNCS, vol. 3201, pp. 217–226. Springer, Heidelberg (2004)
An End-to-End Proactive TCP Based on Available Bandwidth Estimation with Congestion Level Index Sangtae Bae1, Doohyung Lee2, Chihoon Lee2, Jinwook Chung2, Jahwan Koo3, and Suman Banerjee3 1
Korea Institute of S&T Evaluation and Planning
[email protected] 2 School of Information and Communication Engineering, Sungkyunkwan University, Chunchun-dong 300, Jangan-gu, Suwon 440-746, South Korea
[email protected],
[email protected],
[email protected] 3 Computer Sciences Department, University of Wisconsin-Madison, WI 53706, USA {jhkoo,suman}@cs.wisc.edu
Abstract. Transmission control protocol (TCP) is one of the core communication protocols of the Internet protocol suite. For this reason, significant enhancements on TCP have been made in both wired and wireless networks. In this paper, we propose an end-to-end proactive TCP based on available bandwidth estimation with congestion level index (CLI), called CLI-based TCP. From the previous TCP schemes, we have found that the TCP sender does not know how much the network is congested because network congestion is represented by only two status, congestion exists or not. Therefore, we define the concept of CLI, outline the procedure of the CLI algorithm, and describe how to realize the CLI-based TCP. In addition, we have shown that CLI-based TCP can handle network congestion more minutely and improve overall TCP performance. Simulation results show that under 90% traffic load, the CLIbased TCP outperforms TCP New Jersey by 49.8% improvement in goodput. Keywords: Transmission control protocol, end-to-end proactive approach, available bandwidth estimation, congestion level index.
1 Introduction The conventional transmission control protocol (TCP) may suffer from severe performance degradation in wireless networks due to atmospheric conditions, high transmission errors, temporal disconnections and multipath fading. The main reason for the TCP performance degradation in wireless networks is that the conventional TCP scheme (such as TCP Reno [1]) cannot distinguish between packet losses caused by transmission errors and those caused by network congestion, thus, reacting to these losses by reducing its congestion window cwnd. Consequently, these inappropriate reductions of the cwnd lead to unnecessary throughput degradation [2]. To cope with such limitation and degradation, several schemes have been proposed and are classified in [3] and [4]. In this paper, we focus on the end-to-end proactive approach based on available bandwidth estimation (ABE). M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 124–130, 2009. © Springer-Verlag Berlin Heidelberg 2009
An End-to-End Proactive TCP Based on Available Bandwidth Estimation
125
ABE estimates current end-to-end bandwidth available to a TCP connection and guides the sender to properly adjust its transmission rate. For instance, TCP Westwood [5] measures end-to-end available bandwidth by monitoring the interval of returning acknowledgments (ACKs) and uses it to compute the cwnd in case of three duplicate ACKs (DUPACKs) or a retransmission timeout (RTO) timeout. However, TCP Westwood does not discriminate the cause of packet loss. Therefore, it will adjust the sending rates constantly even upon experiencing packet losses by transmission errors, resulting in a lower throughput in high bit-error-rate (BER) wireless networks. In addition, TCP Westwood's ABE is rather complex because it is calculated by a low-pass filter using Tustin approximation. The other possible approach is to modify the conventional TCP to be implemented both bandwidth estimation and loss differentiation algorithm. For example, TCP New Jersey [6] aims to improve TCP performance using both the ABE at the sender and the congestion warning (CW) at the intermediate router. The CW is an explicit congestion notification that helps the sender to effectively distinguish packet losses caused by network congestion from those caused by transmission errors. In other words, TCP New Jersey calculates the size of its cwnd based on the bandwidth estimation by the ABE and the congestion notification by the CW. Consequently, the joint approach with the combination of ABE and CW allows to improve TCP performance even in high BER wireless networks. However, it requires implementation, deployment and management complexities in terms of the addition and modification of the sender-side and the intermediate router-side modules. Our research goal is to implement a new bandwidth estimation scheme, which has simpler bandwidth estimation than TCP Westwood and better performance than TCP New Jersey without the help of any router-supported modules just like CW. Toward these issues, we propose an end-to-end proactive TCP based on ABE with congestion level index (CLI).
2 Proposed Scheme CLI represents the current congestion status of the bottleneck link as a relative value of between 0 and 1 as shown in Fig. 1. The highest congestion level is the maximum of round trip time RTTmax that is represented by 1, whereas the lowest congestion level is the minimum of round trip time RTTmin that is represented by 0. In other words, current congestion level index CLIcur is matched by current round trip time RTTcur that is a specific value between RTTmin and RTTmax. Therefore, it can be defined as follows: (1) The pseudocode of the algorithm of calculating CLI is presented in the following. The window size W is a scaling factor that controls the size of the circular queue for storing the values of the measured RTTs. Procedure Calculate-CLI with parameter RTTcur is invoked upon receiving an ACK. RTTcur is inserted into the circular queue. After selecting the maximum and minimum RTT in the current circular queue, the current CLI is computed by using the linear function of CLI.
126
S. Bae et al.
Fig. 1. Congestion level index function
The proposed scheme adopts slow start, congestion avoidance, and fast recovery from TCP Reno, but implements the rate-based congestion window control algorithm based on ABE. The bandwidth estimation we propose follows the same idea as TCP Westwood to observe the rate of the returning ACKs in order to estimate the available bandwidth for the connection, but its estimator is simpler. On the other hand, the syndromes at the reverse link, such as ACK compression, ACK delay, and ACK losses, can have a significant impact on ABE's accuracy, and further on the overall performance of the TCP scheme. Thus, we also adopt TCP timestamp option proposed in [7] to overcome this problem. In the proposed scheme, instead of using the ACK arrival time, the packet arrival time, which is stamped by the receiver and delivered by the ACKs, is used in the bandwidth estimation. Its bandwidth estimation is thus less affected by the reverse link conditions. Consequently, upon receiving the nth ACK, the optimized bandwidth OBn is estimated as: (2) where CLIcur is the current CLI, Ln is the size of data acknowledged by the nth ACK, and Δ t is the time interval between nth and (n - 1)th packet arrivals at the receiver. Since the timestamp option is widely implemented in most of the TCP protocols, there will be no additional overhead. Given the segment size segsize, the size of the congestion window in units of segments upon the receipt of the nth ACK is calculated as: (3) To verify the effectiveness of our proposed scheme, called CLI-based TCP, we conducted the following simulation using the NS-2 network simulator [8]. The network topology consists of two network nodes, the sender node and the receiver node. The bottleneck link is configured as a 2 Mb/s error free duplex link with propagation delay of 1 ms. The bottleneck queue is a drop-tail queue that can contain a number of packets equal to the bandwidth-delay product of the connection. FTP traffic and CBR background traffic are simulated between the sender and the receiver.
An End-to-End Proactive TCP Based on Available Bandwidth Estimation
127
Their packet sizes are all equal to 1000 bytes. The rate of the CBR traffic varies during the simulation as follows. From time 20 to 30 s, the CBR source generates traffic at the rate of 1 Mb/s; from 30 to 40 s, the CBR generates traffic at the rate of 0.5 Mb/s, and then stops till the end of the simulation time. The total simulation time is 50 s.
(a) RTT trace
(b) CLI trace
Fig. 2. Behavior of CLI-based TCP
128
S. Bae et al.
(c) Estimated bandwidth Fig. 2. (continued)
Under the considered scenario, we first monitored a part of time traces of RTTs and CLIs as shown in Fig. 2(a) and 2(b), respectively, in which we can see the operation of the proposed scheme. In addition, Fig. 2(c) shows that the CLI based bandwidth estimation follows the changes of the available bandwidth fairly closely. Note that CLIs are based on RTTs and the values of CLIs become one of the main input parameters for the optimized bandwidth estimation.
3 Performance Evaluation The main performance metrics used to evaluate TCP schemes are the average goodput of a single TCP connection and the fairness index between a set of TCP connections. We also compare the proposed scheme with TCP Reno, Westwood and New Jersey in terms of average goodput and fairness index. More specifically, the average goodput of a single TCP connection is defined as the bandwidth delivered to the receiver from the sender, excluding duplicate packets. Meanwhile, the fairness index is normally used to show the fairness between a set of n TCP connections. We first investigated the average goodput for window size W. As mentioned in the previous section, window size W is the length of circular queue that can be optimized. As can be seen in Fig. 3(a), the average goodput for window size W is almost the same in the window sizes of between 1 and 5 regardless traffic loads. However, as the window size increases, the performance decreases significantly beyond the traffic load of 50 %. In addition, the selection of the window size presents a tradeoff: smaller values increase time responsiveness to network changes, but incur more CLI oscillations. Thus, we select window size of 3 in the following simulation. We setup the simulation for the average goodput where a TCP connection running the FTP application and CBR background traffic generated by UDP connections share a 2 Mb/s bottleneck link. UDP sources offer the traffic load of from 10 to 90 % between the sender and the receiver. Even if the performance of TCP Reno, Westwood and New Jersey decreases significantly as shown in Fig. 3(b), the CLIbased scheme is robust to high traffic loads because the CLI can indicate the level of current network congestion explicitly. Under 90 % traffic load, the CLI-based TCP
An End-to-End Proactive TCP Based on Available Bandwidth Estimation
(a) Window Size
129
(b) Goodput
(c) Fairness Fig. 3. Performance comparisons of TCP schemes
outperforms TCP New Jersey by 49.8 % improvement in goodput without any routersupported modules. Next we run the simulation for fairness index between a set of 10 TCP connections. The value of fairness index is between 0 and 1. If the throughput of all TCP connections is the same, the index will take the value of 1. Fig. 3(c) shows all TCP schemes maintain satisfactory fairness index, but the CLI-based TCP provides a more stable fairness than the other schemes in case of high traffic load.
4 Conclusion We have presented a new bandwidth estimation scheme, CLI-based TCP, which has simpler bandwidth estimation than TCP Westwood and better performance than TCP New Jersey without the help of any router-supported modules just like CW. The CLI measured at the sender side explicitly represents the current network congestion status of the end-to-end bottleneck link fairly closely and the optimized bandwidth estimation based on the CLI is calculated upon receiving the ACK arrival with TCP timestamp option. Throughout the simulation, we have evaluated that the CLI-based TCP is fairly robust to high traffic loads with the help of the direct indicator CLI.
130
S. Bae et al.
Acknowledgments This work was supported by the Korea Research Foundation Grant funded by the Korean Government (MOEHRD), under Contract KRF-2007-357-D00162.
References 1. Allman, M., Paxson, V., Stevens, W.: TCP Congestion Control, RFC 2581 (1999) 2. Lakshman, T.V., Madhow, U.: The Performance of TCP/IP for Networks with High Bandwidth-delay Products and Random Loss. IEEE/ACM Trans. Networking 5(3), 336–350 (1997) 3. Balakrishnan, H., Padmanabhan, V.N., Seshan, S., Katz, R.H.: A Comparison of Mechanisms for Improving TCP Performance over Wireless Links. IEEE/ACM Trans. Networking 5(6), 759–769 (1997) 4. Tian, Y., Xu, K., Ansari, N.: TCP in Wireless Environments: Problems and Solutions. IEEE Radio Communications, S27–S32 (2005) 5. Casetti, C., Gerla, M., Mascolo, S., Sansadidi, M.Y., Wang, R.: Westwood: End-to-end Congestion Control for Wired/Wireless Networks. Wireless Networks Journal 8, 467–479 (2002) 6. Xu, K., Tian, Y., Ansari, N.: Improving TCP Performance in Integrated Wireless Communications Networks. Computer Networks 47(2), 219–237 (2005) 7. Jacobson, V., Braden, R., Borman, D.: TCP Extensions for High Performance, RFC 1323 (1992) 8. Network Simulator NS-2, http://www.isi.edu/nsnam/ns
Smart Privacy Management in Ubiquitous Computing Environments Christian B¨ unnig University of Rostock, Institute of Computer Science Chair for Information and Communication Services
[email protected]
Abstract. Privacy in ubiquitous computing environments is primarily considered as a problem of protecting personal information from unauthorized access and misuse. Additionally it can also be seen as a process of interpersonal communication where not hiding but selective disclosure of personal information is the central issue, i.e. how users can practice privacy intuitively and dynamically in computerized environments similar to the analog world. In this work we discuss the management of private information concerning interpersonal privacy implications in smart environments. Existing work mostly does not match the intuitive and dynamic aspects of privacy in context of interpersonal communication. As an alternative we suggest an ad hoc approach to privacy management which uses learning techniques for an in situ disclosure assistance and present user interaction models for this disclosure assistance.
1
Introduction
Privacy in ubiquitous computing environments is still an open research issue. In most cases privacy is considered as a problem of protecting personal information to make it only visible to certain entities or from being misused by malicious entities. While this is an important aspect of privacy on the data level it neglects that privacy is much more than hiding personal information. Often people want to show certain information to other entities, e.g. to utilize personalized services, to receive information from other persons in return or to represent oneself to the public in a specific manner. Especially this self-representation in a social context is a dynamic process in which humans intuitively decide which personal face to show depending on the current situation [10]. The crucial issue is how ubiquitous computing environments with its potentially vast amount of communicated personal information influences intuitive capabilities to practise privacy. When acting in smart environments the personal information communicated within that environment creates further instances of a user’s self-representation which makes privacy management more complex compared to the analog world. Users
Christian B¨ unnig is funded by the German Research Foundation (DFG), Graduate School 1424 (Multimodal Smart Appliance Ensembles for Mobile Applications MuSAMA).
M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009,LNCS 5618, pp.131–139, 2009. c Springer-Verlag Berlin Heidelberg 2009
132
C. B¨ unnig
need an understanding of the implications of communicating specific personal information. In general there are two types of implications. The first is a technical one, e.g. a possible recording and post processing of the communicated information by the environment’s infrastructure. The second relates to interpersonal implications because other persons within the environment directly or indirectly perceive the communicated information. In this work we focus on interpersonal implications and assume a non-malicious infrastructure which handles private data as users expect it. Concerning interpersonal implications, in most cases users intend them as they are the reason for acting within a smart environment, e.g. because they want to collaborate with colleagues or socialize with friends. The point is how users can ensure that actual implications comply with intended ones, or in other words, how users can be enabled to practise interpersonal privacy in smart environments as similar as possible to the way it is done in a non-technical environment. Example Scenario A typical use case for smart environments is the support of collaborative work. Consider the following scenario as an illustrative example. A room is equipped with a collaboration desk – a desk with a touch screen surface used as a shared work space (Fig. 1). Depending on a specific application this desk may display and arrange various information, contributed by the persons working at the desk. A team working on a film project meets at this Fig. 1. A collaboration desk as an exdesk to discuss current results and upcom- ample service for interpersonal commuing tasks in the project. Depending on the nication in smart environments current state of the project, the persons present at the meeting and each person’s task in the project, each team member wants to provide specific information to the meeting by disclosing them to the collaboration desk service. Alice contributes some drafts for a poster, Bob has a story board ready and Clark has some suggestions concerning the crew casting. Dent, the organizer of the team, guides the meeting and controls and arranges the currently displayed information on the desk. Additionally Dent requests to access the calendar of the meeting participants in order to schedule upcoming events. All team members are working as freelancers – they may work at this desk in other projects, in other roles and with other team members too. Special characteristics of this scenario are that there is no distinct hierarchy among the persons and no fixed relationship between the persons and the room. Hence, looking only at the persons and the room, there is no inherent structure that could be used for predefined rule based disclosure models. This shall emphasize the in situ characteristic of information disclosure in such a meeting.
Smart Privacy Management in Ubiquitous Computing Environments
133
Overview The next section presents related work on user side privacy control in smart environments. As a result of this review we motivate an ad hoc approach of privacy management in ubiquitous computing environments. This ad hoc approach is described in section 3. An ad hoc privacy control requires a significant portion of a user’s attention to focus on privacy issues additionally to the actual task to fulfil within the environment. To reduce the necessary user attention we are developing an assistance for deciding the disclosure of personal information based on learning techniques. The general idea of such a learning approach is described in detail in one of our previous work [1]. A crucial aspect of a disclosure assistance is how users can interact with the assistance. The data managed by the assistance may be very sensitive. Thus in most cases users want to be able to understand and control automated disclosure decisions. In section 4 we present different approaches for user interaction with a disclosure assistance. The critical point here is the transparency of the assistance, i.e. how users can verify and align automated ad hoc disclosure decision with actual privacy preferences. Finally, in section 5, we summarize our work and provide an outlook on future work.
2
Related Work
Typical approaches to control personal information disclosure are rule and role based systems. Users can set up rules to decide conditions for disclosing an information and roles for specifying the information to disclose. Alternatively the terms policy (for a rule set) and identity or face (for a role) are used. An example for a policy based approach is given by Langheinrich [5]. He presents pawS, a privacy awareness system that extends P3P/APPEL1 for ubiquitous systems. Services within a smart environment announce their data handling policy expressed in P3P via service related privacy proxies. In return, users express privacy preferences using APPEL and personal privacy proxies. These proxies then negotiate the flow of personal information between a user and services within the environment. It is advantageous that this approach makes use of already existent concepts. On the other side, while there are user friendly tools for specifying privacy preferences and interacting with service-side policies in the realm of web activities [3], there is a lack of such tools for the domain of ubiquitous systems. Further pawS deals with privacy issues concerning the used infrastructure – our work focuses on interpersonal privacy implications. In the domain of location privacy, Myles et al. [9] suggest a rule based system to decide disclosure of location information (also partly using P3P/APPEL). Location information is shared by a location server which contacts user specific validators if someone requests a user’s location. Amongst other methods, these validators decide the location disclosure based on a set of rules defined by its users. The authors suggest that location provider offer appropriate rule set templates and additionally “wizards” help users to comfortably set up rules that 1
Specifications of P3P and APPEL can be found at http://www.w3.org/TR/.
134
C. B¨ unnig
differ from the templates. This approach limits its use for managing location. It could be extended for other types of personal information but that would add complexity to the rule sets users have to specify in their validators. Actually Prabaker et al. [11] have shown that users already have difficulties to set up disclosure rules for location as the only type of information to manage. Next to rules, there exist concepts which utilize virtual roles, identities [2,4,8] or faces [7] for managing disclosure of personal information in smart environments. The basic idea is to abstract a specific set of personal information to a role, e.g. “anonymous”, “private”, “job” or “public”. Roles are supposed to provide an easy to grasp way of managing personal information. However, role concepts always conflict between simple but too general and subtle but too complex. In fact Lederer highlights this problem of generality in a subsequent work [6]. Rule and role based approaches to control communication of personal information try to release users from repeatedly deciding information disclosure ad hoc. On the other side such preconfigured privacy fails in many scenarios as it contradicts to the way users normally practise privacy. Rules require users to specify their privacy preferences in advance in an abstract manner. As long as users have a clear idea of situations to come and how to handle their information in these situations rules and roles are a suitable way for managing personal information. In contrast when situations get more complex and the diversity of potentially communicated personal information grows or is not known in advance, policies are hard to create and maintain [11,6]. Roles, as a concept for managing the possible sets of information to disclose, fail if a user’s privacy preferences do not match a clear scheme like “private”, “job” or “public” but requires a more fine-grained selection of information. In that case the increased number of roles would make it hard for users to distinguish and maintain their roles. The main message of this review is that existent work on user side control of personal information disclosure in smart environments focuses on a priori configured privacy preferences, which conflicts with the dynamic and intuitive aspects of privacy. There are cases when the decision which information to communicate within a smart environment can only be decided ad hoc, in the moment of disclosure: when the number of possible situations is very high, when there are situations which cannot be predicted or when there are many, subtly differing variances in the personal information to disclose.
3
Ad Hoc Privacy Management
An ad hoc approach of controlling the flow of personal information in smart environments has some significant advantages. It releases users from drawing attention to privacy before the actual use of a system. Instead users decide the disclosure of their information in the moment when it is utilized by an environment. Hence, users are able to perceive the immediate implications of information disclosure and can perform privacy in conformance with intuitive and up to date preferences. Obviously a disadvantage is that a significant portion of a user’s attention, while interacting with services, is needed for privacy issues, which reduces the attention a user can draw on the actual task to fulfil with the service.
Smart Privacy Management in Ubiquitous Computing Environments
(a)
(b)
135
(c)
Fig. 2. Users decide the disclosure of personal information with their mobile devices during service interaction. A service lists its required personal information (a). For each information users are able to configure a disclosure for the requested information (b). Detailed meta information for the service in general and each requested information informs users about privacy implications when using this service (c).
In other words, an ad hod privacy control is more similar to natural privacy handling but it may overload a user’s attention. To balance this drawback an assistance is needed, that relieves users of frequently making disclosure decisions while still supporting the general idea of ad hoc privacy management. For this purpose we suggest a learning scheme that observes and learns a user’s decisions which information to disclose to which service in which situation (respectively context). Currently we are doing a user study which observes context and disclosure behavior of users in a virtual smart environment. Virtual means that users can discover and interact with services to negotiate communication of personal information, but the services’ proposed functionality is not present as it is not part of our observations. This enables us to be as flexible as possible in setting up service environments for our observation scenarios. Figure 2 illustrates how users interact with services in the context of ad hoc privacy management. First observation results have shown, that it is possible to correlate user disclosure decisions with context information 2 . Examples for context information utilized in our setting are nearby persons, devices and services, time (day of week, hour of day, . . . ), location and movement patterns of persons within the environment. The intended result of a learning scheme is to generalize this correlation to a disclosure decision model (DDM) that “mirrors” a user’s privacy preferences and that can be used as an agent managing private data on behalf of 2
Complete results and their analysis are part of a separate work, submitted for publication at the Symposium On Usable Privacy and Security, SOUPS 2009.
136
C. B¨ unnig
the user (or at least making suggestions for disclosure decisions) [1]. The challenges on learning a users disclosure behavior are input selection (determining disclosure-relevant context information and its levels of abstraction), learner implementation (choosing an appropriate method with regard to accuracy) and output representation (a user’s view on and interaction with a learned output model). The challenge focused here is the output representation, i.e. how users see and interact with a DDM. A DDM maps a service, its requested information and the context during the request to a disclosure decision. We use the following notation for this mapping. A service S requests several information labeled I1 , .., In . For each information Ii there is a set of possible disclosure configurations D(Ii ) = Ii1 , .., Iim . So D(Ii ) describes all configurations specified by a user for an information Ii . The subset DS (Ii ) ⊆ D(Ii ) describes all disclosure configurations of Ii previously used for the service S. The context C during the request is composed by several context information ci so that C = (ci , .., cm ). Given that, we express a user’s disclosure behavior as follows: S × I1 × .. × In × C → DS (I1 ) × ..DS (In )
(1)
This maps a service S, its requested information Ii and a context C to disclosure configurations DS (Ii ). For now disclosure configurations are simply considered as instances, we do not regard their inner structure. Future work may also deal with integrating the inner parameters of a disclosure configuration (as seen in Fig. 2.b) into the modeling of disclosure decisions.
4
User Interaction with DDMs
In an ideal case the mapping (1) describes privacy preferences in such a way that users are able to match and align them with real preferences (Fig. 3.a). However, this requires a rather small set of disclosure rules. Further, these rules must be expressed with an appropriate abstraction of the context information. Low level context like raw sensor values do not match intuitive privacy preferences which utilize user selected abstract situation characteristics. These requirements on the disclosure model representation limit the learning schemes that can be used to create DDMs and may drop learning schemes which are less transparent but provide better performance. Further the required context abstraction (done by the developer) is a first error source for DDMs, as there is no general abstraction valid for all users. This motivates to also consider learning schemes that create non-transparent DDMs. Since no learning scheme will create a perfect DDM, the question arises, how users can interact with black box DDMs when they cannot control a DDM’s inner decision process. The simplest approach to adjust a black box DDM are user vetoes which mark wrong disclosure decisions (Fig. 3.b). This is simply continued learning. In this case users are only able to react, they cannot integrate distinct preferences into a DDM which have not yet been learned by the DDM’s learning scheme. Such a DDM can only be used as a suggestion mechanism. To automate disclosure
Smart Privacy Management in Ubiquitous Computing Environments
a) Transparent DDM
b) Black box
137
c) Black box + user rules
Fig. 3. User interaction with DDMs depends on the transparency of a DDM’s internal decision process
Fig. 4. A disclosure process integrating a black box DDM, user vetoes and manual user rules. User rules have a higher priority than DDMs to enable users to express clear disclosure decisions for sensitive personal information. A DDM assists the creation of user rules by providing relevant context information for rule parametrization.
decisions, users must be sure that certain sensible information is handled properly by the DDM. Since a black box DDM cannot be adjusted in that manner, it could be backed up by a simple set of disclosure rules manually compiled by users (Fig. 3.c). In fact, a veto based interaction can be combined with a black box DDM backed up by user rules. Whenever users express a veto on a disclosure decision suggested by a DDM, users can be supported in specifying a manual disclosure rule, e.g. by providing the current context information that can be used to parametrize a manual disclosure rule. Figure 4 illustrates the combination of user vetoes and user rules. Here, the first step in deciding a disclosure is to query the user rules, they have priority
138
C. B¨ unnig
over disclosure decisions of the DDM. If the user rules do not apply to the current situation, the DDM is consulted (step 2). At this point users can express a veto if they do not feel comfortable with the automated disclosure decision (step 3). As a result, the DDM hands out a template for a custom rule to set up by the user (step 4). This template is a draft for a rule using current context information and the requested information as parameters. Setting up custom disclosure rules in that manner preserves the aimed ad hoc characteristic of privacy management, it releases users from abstracting privacy preferences to rules a priori.
5
Conclusion and Outlook
In this work we discussed the management of private information concerning interpersonal privacy implications in smart environment. We identified limitations in existing work, which mostly does not match the intuitive and dynamic aspects of privacy. As an alternative we presented an ad hoc approach to privacy management. This approach uses a disclosure assistance based on learning techniques. To enable users to validate and align actual privacy preferences with the assistance, we presented two concepts for the interaction between a user and a disclosure assistance. Currently we are accumulating user disclosure data which is used for implementing a learning scheme as described above. In our future work we use this learning scheme for implementing and evaluating the presented approaches for interacting with the disclosure assistance.
References 1. B¨ unnig, C.: Learning context based disclosure of private information. In: The Internet of Things & Services - 1st Intl. Research Workshop, Valbonne, France (September 2008) 2. Clauß, S., Pfitzmann, A., Hansen, M.: Privacy-enhancing identity management. The IPTS Report 67, 8–16 (September 2002) 3. Cranor, L.F., Guduru, P., Arjula, M.: User interfaces for privacy agents. ACM Trans. Comput.-Hum. Interact. 13(2), 135–178 (2006) 4. Jendricke, U., Kreutzer, M., Zugenmaier, A.: Pervasive privacy with identity management. Technical Report 178, Universit¨ at Freiburg (October 2002) 5. Langheinrich, M.: A privacy awareness system for ubiquitous computing environments. In: Borriello, G., Holmquist, L.E. (eds.) UbiComp 2002. LNCS, vol. 2498, p. 237. Springer, Heidelberg (2002) 6. Lederer, S., Hong, J.I., Dey, A.K., Landay, J.A.: Personal privacy through understanding and action: Five pitfalls for designers. Personal Ubiquitous Computing 8(6), 440–454 (2004) 7. Lederer, S., Mankoff, J., Dey, A.K., Beckmann, C.P.: Managing personal information disclosure in ubiquitous computing environments. Technical Report UCB/CSD-03-1257, University of California, Berkeley (2003) 8. Maibaum, N., Sedov, I., Cap, C.H.: A citizen digital assistant for e-government. In: Traunm¨ uller, R., Lenk, K. (eds.) EGOV 2002. LNCS, vol. 2456, pp. 284–287. Springer, Heidelberg (2002)
Smart Privacy Management in Ubiquitous Computing Environments
139
9. Myles, G., Friday, A., Davies, N.: Preserving privacy in environments with locationbased applications. IEEE Pervasive Computing 2(1), 56–64 (2003) 10. Palen, L., Dourish, P.: Unpacking “privacy” for a networked world. In: CHI 2003: Proc. of the SIGCHI Conference on Human Factors in Computing Systems, pp. 129–136. ACM, New York (2003) 11. Prabaker, M., Rao, J., Fette, I., Kelley, P., Cranor, L., Hong, J., Sadeh, N.: Understanding and capturing people’s privacy policies in a people finder application. In: UBICOMP 2007: Workshop on UBICOMP Privacy (September 2007)
A Fuzzy Multiple Criteria Decision Making Model for Selecting the Distribution Center Location in China: A Taiwanese Manufacturer’s Perspective Chien-Chang Chou1 and Pei-Chann Chang2 1
Department of Shipping Technology, National Kaohsiung Marine University, Taiwan
[email protected] 2 Department of Information Management, Yuan Ze University, Taiwan
[email protected]
Abstract. The purpose of this paper is to propose a fuzzy multiple criteria decision making model for evaluating the distribution center alternative locations in China and selecting the best one for investing distribution center from a Taiwanese manufacturer’s perspective. Although a lot of papers focus on the subject of location selection, few discuss the subject of distribution center location selection in China. Thus this paper summarizes the criteria for evaluating the candidate distribution center locations, and then develops a fuzzy multiple criteria decision making model. Finally, the proposed fuzzy multiple criteria decision making model is tested by a Taiwanese manufacturer’s case. The results show that the fuzzy multiple criteria decision making model can be used to explain the procedures for distribution center location selection decision making.
1 Introduction Due to the rapid growth of economic in China in the recent years, a lot of Taiwanese business companies went to China to invest the manufacturing industry, logistics industry, civil engineering industry, banking industry and so on. It is an important and difficult for the Taiwanese manufacturing business company to select a best location for building the distribution center in China when beginning the investment planning. Thus, the purpose of this paper is to propose a fuzzy multiple criteria decision making model for the Taiwanese manufacturing company to evaluate and select the best location for investing and building the distribution center in China. Location selection is one of the most important decision issues for the decision makers of business companies or industrial organizations. Many precision-based methods for location selection have been developed in the past. Dahlberg and May [13] utilized the simplex method to determine the optimal location of energy facilities. Tompkins and White [33] introduced a method that used the preference theory to assign weights to subjective factors by making all possible pairwise comparisons between factors. Spohrer and Kmak [30] proposed a weight factor analysis method to integrate the quantitative data and qualitative rating to choose a plant location from numerous alternatives. Stevenson [31] proposed a cost-volume analysis method to M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 140–148, 2009. © Springer-Verlag Berlin Heidelberg 2009
A Fuzzy Multiple Criteria Decision Making Model
141
select the best plant location. Multiple criteria decision-making methods were provided to deal with the problem of ranking and selecting locations under multiple criteria [21, 29]. All the methods stated above are based on the concept of accurate measure and crisp evaluation. The decision making of location selection in the real world is complex. The selection of a best location for business companies and industrial organizations from two or more alternatives locations on the basis of two or more factors is a multiple criteria decision-making problem. Under many situations, the values for the qualitative criteria are often imprecisely defined for the decision maker. It is not easy to precisely quantify the rating of each alternative location and the precision-based methods as stated above are not adequate to deal with the location selection problem [8, 24]. Since human judgments including preference are often vague and can not estimate his preference with an exact numerical value. A more realistic way may be to use linguistic terms to describe the desired value and important weight of criteria, e.g. “very low”, “low”, “fair”, “high”, “very high”, etc [2, 36]. Due to this type of existing fuzziness in the location selection process, fuzzy set theory is an appropriate method for deal with uncertainty and the subjective evaluation data can be more adequately expressed in fuzzy linguistic variables [6, 7, 8, 15, 16, 20, 24, 36]. Although a lot of papers focus on the subject of location selection, few discuss the subject of location selection of distribution center in China, in terms of a Taiwanese manufacturer’s perspective. Thus this paper proposed a fuzzy multiple criteria decision making model for selecting the distribution center location in China from a Taiwanese manufacturer’s perspective. The rest of this paper is organized as follows. Section 2 is the literature review. The fuzzy methodology is introduced in section 3, followed by a case study. Finally, conclusions are given in section 5.
2 Literature Review Brenes et al. [4] found key determinants considered important when making decisions for new manufacturing in free zones included labor cost, political stability, social stability, the parent company’s degree of investment diversification, and other relevant factors, such as public utility efficiency, on site customs houses, and labor recruiting and training services. Globerman and Shapiro [18] identified the impact of government policies on the investment in Canada. They presented a set of criteria for investment decision, including the gross domestic product (GDP), the rate of growth of GDP, cost factor, exchange rate and trade variables. Sun et al. [32] investigated the government policy influenced location decision in China. Wu and Strange [34] examined the location of foreign insurance companies in China based on the investment literature. Five important criteria for investment decisions were identified in their study, namely, the market size and the prospects for growth, agglomeration effects produced by the concentration of producer services and other investment, government policy measures and restrictions, infrastructure quality, ranging from the state of the transportation and telecommunications systems to the existence of a specialized labor force, and the cost considerations, both labor and land.
142
C.-C. Chou and P.-C. Chang
Bevan et al. [3] analyzed the impact of different dimensions of the newly created institutional framework in East European transitional economies on investment. Several specific dimensions were found to influence investment: private ownership of business, banking sector reform, foreign exchange rate, trade liberalization, and legal development. Based on the literature review of criteria considered important when evaluating the distribution center investment, this paper summarized four major criteria and twenty three sub-criteria in the questionnaire of this paper as follows. The influential criteria include • the growth of economic (C1) − the present volume of cargoes (C11) − the potential volume of cargoes in the future (C12) − the trade variables (C13) • cost (C2) − the exchange rate (C21) − the labor cost (C22) − the transportation cost (C23) − the operation cost (C24) − the land cost (C25) • government policies (C3) − the efficiency of government department (C31) − the co-operative relationship between the enterprise and government (C32) − the tax break (C33) − other preferential treatment (C34) − the law on investment & investment restrictions (C35). − the political stability (C36) − the social stability (C37) • Other (C4) − the availability of land (C41) − the infrastructure quality (C42) − the labor quality (C43) − the trade liberalization (C44) − the efficiency of Customs (C45) − the future development (C46) − the banking sector (C47) − the private ownership of enterprise (C48)
3 The Fuzzy Methodology The fuzzy set theory was introduced by Zadeh [35]. Fuzzy numbers are a fuzzy subset of real numbers, and they present the expansion of the idea of confidence interval. Fuzzy set theory was developed exactly based on the premise that the key elements in human thinking are not numbers, but linguistic terms or labels of fuzzy sets [2, 35, 37]. Fuzzy set theory has been applied to solve many decision making problems.
A Fuzzy Multiple Criteria Decision Making Model
143
The basic fuzzy arithmetic operations on fuzzy numbers have been proposed in previous literature [1, 5, 14, 17, 19, 22, 23, 25, 26, 27, 28]. Although many fuzzy arithmetic methods proposed in the previous literature, few of these papers presented the representation of multiplication operation on two or more fuzzy numbers. But Chen and Hsieh [9] proposed the Graded Mean Integration Representation method for operation and ranking of fuzzy numbers. Chou [10] proposed the canonical representation of multiplication operation on two triangular fuzzy numbers by the Graded Multiple Integration Representation Method. Chou [11] further propose the canonical representation of multiplication operation on three trapezoidal fuzzy numbers based on the Inverse Function Arithmetic Representation Method, and then this canonical representation is applied to solve the fuzzy multiple criteria decision making problems [12]. Based on the Inverse Function Arithmetic Representation Method, this paper constructs a fuzzy multiple criteria decision making mode for selecting the distribution center location. The Inverse Function Arithmetic Representation Method is introduced briefly as follows. In this section, we first introduce briefly the graded mean integration representation method for presenting the representation of one fuzzy number. Based on the graded mean integration representation method, we further propose the Inverse Function Arithmetic Representation Method for presenting the representation of multiplication operation on multiple fuzzy numbers. Chen and Hsieh [9] proposed the graded mean integration representation method of fuzzy numbers based on the integral value of graded mean h-level of generalized fuzzy number. Here we describe the meaning as follows. Suppose A=(c, a, b, d) is a fuzzy number. The graded mean integration representation of A is P(A)=
1 (c+2a+2b+d) 6
(1)
The triangular fuzzy number Y=(c, a, b) is a special case of generalized trapezoidal fuzzy number. The graded mean integration representation of triangular fuzzy number Y becomes 1 6
P(Y)= (c+4a+b)
(2)
Based on the above graded mean integration representation method, Chou [11, 12] further proposed the Inverse Function Arithmetic Presentation Method for the multiplication operation on multiple fuzzy numbers as follows: P(A1 ⊗ A2 ⊗ A3)=
1 1 1 (c1+4a1+b1) × (c2+4a2+b2) × (c3+4a3+b3) 6 6 6
(3)
4 A Case Study Based on the literature review of criteria considered important when evaluating the preference of distribution center investment, this paper summarized four major criteria (Ci) and twenty three sub-criteria (Cij) in the questionnaire of this paper in Table 1.
144
C.-C. Chou and P.-C. Chang Table 1. The weights and the preference for criteria
Criteria and sub-criteria • The growth of economic (C1) − The present volume of cargoes (C11) − The potential volume of cargoes in the future (C12) − The trade variables (C13) • The cost (C2) − The exchange rate (C21) − The labor cost (C22) − The transportation cost (C23) − The operation cost (C24) − The land cost (C25) • The government policies (C3) − The efficiency of government department (C31) − The co-operative relationship between the enterprise and government (C32) − The tax break (C33) − Other preferential treatment (C34) − The law on investment & investment restrictions (C35). − The political stability (C36) − The social stability (C37) • Other (C4) − The availability of land (C41) − The infrastructure quality (C42) − The labor quality (C43) − The trade liberalization (C44) − The efficiency of Customs (C45) − The future development (C46) − The banking sector (C47) − The private ownership of enterprise (C48)
Fuzzy weights (4.5, 5, 5) (4.5, 5, 5) (3, 4, 5)
Fuzzy preference (4.5, 5, (4.5, 5,
5) 5)
(2, (3, (2, (4.5, (3, (3, (4.5, (2, (3,
3, 4, 3, 5, 4, 4, 5, 3, 4,
4) 5) 4) 5) 5) 5) 5) 4) 5)
(2,
3,
4)
(2, (3, (2, (3, (3,
3, 4, 3, 4, 4,
4) 5) 4) 5) 5)
(1,
2,
3)
(3,
4,
5)
(2,
3,
4)
(2, (3, (3,
3, 4, 4,
4) 5) 5)
(2, (2, (1,
3, 3, 2,
4) 4) 3)
(3, (3, (1, (3, (2, (4.5, (2, (4.5, (3, (2, (3,
4, 4, 2, 4, 3, 5, 3, 5, 4, 3, 4,
5) 5) 3) 5) 4) 5) 4) 5) 5) 4) 5)
(2, (1,
3, 2,
4) 3)
(0, (0, (0, (2, (0, (4.5, (2, (1,
1, 1, 1, 3, 1, 5, 3, 2,
2) 2) 2) 4) 2) 5) 4) 3)
Based on the linguistic variables in Tables 2 and 3, we interviewed one Taiwanese manufacturing company in China and then obtained the weights (wi) for criteria, weights (wij) for sub-criteria, and the preference (pijk) for candidate location k under sub-criteria (Cij). The weights for criteria and sub-criteria, and the preference for candidate location are listed in Table 1. After preliminary screening, five candidate locations in China remain for further evaluation. Table 2. Linguistic variables for preference Very Poor Poor Fair Good Very Good
(0.0,1.0,2.0) (1.0,2.0,3.0) (2.0,3.0,4.0) (3.0,4.0,5.0) (4.5,5.0,5.0)
A Fuzzy Multiple Criteria Decision Making Model
145
Table 3. Linguistic variables for importance weight of criteria Very Low Low Fair High Very High
(0.0,1.0,2.0) (1.0,2.0,3.0) (2.0,3.0,4.0) (3.0,4.0,5.0) (4.5,5.0,5.0)
Solution Process Let AWi be the percentage of importance weight of criteria Ci. Let AWij be the percentage of importance weight of sub-criteria Cij. Let pijk be the preference for candidate location k under sub-criteria Cij, and TPk be the total preference for candidate location k. AWi =
wi
, AWij =
I
∑w i =1
i
I
w ij
, and TPk=
J
∑w
ij
J
∑∑
AWi ⊗ AWij ⊗ pijk
i =1 j=1
j=1
For example, TP1 is the total preference for candidate location Shanghai (k1). I
TP1=
J
∑∑
AWi ⊗ AWij ⊗ pij1
i =1 j=1
=
w1 w 11 ⊗ ⊗ p111 w1 + w 2 + w 3 + w 4 w 11 + w 12 + w 13
+
w1 w 12 ⊗ ⊗ p121 w1 + w 2 + w 3 + w 4 w 11 + w 12 + w 13
+
w 13 w1 ⊗ ⊗ p131 w1 + w 2 + w 3 + w 4 w 11 + w 12 + w 13
w2 w 21 ⊗ ⊗ p211 w1 + w 2 + w 3 + w 4 w 21 + w 22 + w 23 + w 24 + w 25 +… +… +… w 48 w4 ⊗ ⊗ p481 + w1 + w 2 + w 3 + w 4 w 41 + w 42 + w 43 + w 44 + w 45 + w 46 + w 47 + w 48 +
where wi, wij, pijk are all fuzzy numbers. Thus we can obtain the total preference for candidate location Shanghai as follows. TP1=
(4.5, 5, 5) (4.5, 5, 5) ⊗ ⊗ (4.5,5,5) (4.5,5,5) + (3,4,5) + (2,3,4) + (1,2,3) (4.5, 5, 5) + (3,4,5) + (2,3,4)
146
C.-C. Chou and P.-C. Chang
(4.5, 5, 5) (3,4,5) ⊗ ⊗ (4.5,5,5) (4.5,5,5) + (3,4,5) + (2,3,4) + (1,2,3) (4.5, 5, 5) + (3,4,5) + (2,3,4) (4.5, 5, 5) (2,3,4) + ⊗ ⊗ (2,3,4) (4.5,5,5) + (3,4,5) + (2,3,4) + (1,2,3) (4.5, 5, 5) + (3,4,5) + (2,3,4) +… +… +… (1,2,3) ⊗ + (4.5,5,5) + (3,4,5) + (2,3,4) + (1,2,3) (3,4,5) ⊗ (1,2,3) (3,4,5) + (2,3,4) + (4.5,5,5) + (2,3,4) + (4.5,5,5) + (3,4,5) + (2,3,4) + (3,4,5) +
By the formula (3), we can easily obtain
118.85 96.69 44.25 36.00 78.67 48.00 64.00 78.67 + + + + + + + 165.84 165.84 165.84 289.93 289.93 289.93 289.93 289.93 24.00 36.00 27.00 36.00 24.00 36.00 24.00 8.00 + + + + + + + + 375.75 375.75 375.75 375.75 375.75 375.75 375.75 429.10 6.00 9.83 18.00 9.83 39.33 18.00 16.00 + + + + + + + =3.46 429.10 429.10 429.10 429.10 429.10 429.10 429.10
TP1=
By the same solution process, we can obtain the total performance for candidate location TP2= 3.19, TP3= 3.21, TP4= 2.98, TP5= 2.87. The candidate location Shanghai (k1) is selected as the best location for investing and building distribution center in China by the Taiwanese manufacturer.
5 Conclusion This paper proposes a fuzzy multiple criteria decision making model for selecting the distribution center location in China from a Taiwanese manufacturer’s perspective. This fuzzy multiple criteria decision making model is tested by a Taiwanese case in the real world. The results show that this model seems to be promising. This model can be used to explain the decision making procedure for distribution center location selection of manufacturing company well under fuzzy multiple criteria decision making environment. On the other hand, we can see while selecting one distribution center, Taiwanese manufacturer is much care about the present volume of cargoes, potential volume of cargoes in the future, labor cost, transportation cost, operation cost, land cost, efficiency of government department, the co-operative relationship between the enterprise and government, law on investment and investment restrictions, political stability, social stability, availability of land, labor quality, efficiency of Customs, future development and private ownership of enterprise. Finally, Shanghai is selected as the best location for investing and building the distribution center, due to Shanghai has excellent advantages.
A Fuzzy Multiple Criteria Decision Making Model
147
References 1. Adamo, J.M.: Fuzzy Decision Trees. Fuzzy Sets and Systems 4, 207–219 (1980) 2. Bellman, R.E., Zadeh, L.A.: Decision-making in a Fuzzy Environment. Management Science 17(4), 141–164 (1970) 3. Bevan, A., Estrin, S., Meyer, K.: Foreign Investment Location and Institutional Development in Transition Economies. International Business Review 13, 43–64 (2004) 4. Brenes, E.R., Ruddy, V., Castro, R.: Free Zones in E1 Salvador. Journal of Business Research 38(1), 57–65 (1997) 5. Campos, L., Verdegay, J.L.: Linear Programming Problems and Ranking of Fuzzy Numbers. Fuzzy Sets and Systems 32, 1–11 (1989) 6. Chang, P.C., Liu, C.H.: A TSK Type Fuzzy Rule Based System for Stock Price Prediction. Expert Systems with Applications 34(1), 135–144 (2008) 7. Chang, P.C., Wang, Y.W.: Fuzzy Delphi and Back-propagation Model for Sales Forecasting in PCB Industry. Expert Systems with Applications 30(4), 715–726 (2006) 8. Chen, C.T.: A Fuzzy Approach to Select the Location of the Distribution Center. Fuzzy Sets and Systems 118(1), 65–73 (2001) 9. Chen, S.H., Hsieh, C.H.: Graded Mean Integration Representation of Generalized Fuzzy Number. In: Proceeding of 1998 Sixth Conference on Fuzzy Theory and Its Application (CD-ROM), Filename: 031.wdl, Chinese Fuzzy Systems Association, Taiwan, Republic of China, pp. 1–6 (1998) 10. Chou, C.C.: The Canonical Representation of Multiplication Operation on Triangular Fuzzy Numbers. Computers & Mathematics with Applications 45, 1601–1610 (2003) 11. Chou, C.C.: The Representation of Multiplication Operation on Fuzzy Numbers and Application to Solving Fuzzy Multiple Criteria Decision Making Problems. In: Yang, Q., Webb, G. (eds.) PRICAI 2006. LNCS (LNAI), vol. 4099, pp. 161–169. Springer, Heidelberg (2006) 12. Chou, C.C.: A Fuzzy MCDM Method for Solving Marine Transshipment Container Port Selection Problems. Applied Mathematics and Computation 186, 435–444 (2007) 13. Dahlberg, M.D., May, J.H.: Linear Programming for Sitting of Energy Facilities. Journal of Energy Engineering 106, 5–14 (1980) 14. Delgado, M., Vila, M.A., Voxman, W.: On a Canonical Representation of Fuzzy Numbers. Fuzzy Sets and Systems 93, 125–135 (1998) 15. Deng, Y.: Plant Location Selection Based on Fuzzy TOPSIS. International Journal of Advanced Manufacturing Technology 28, 839–844 (2006) 16. Deng, Y., Cheng, S.: Evaluating the Main Battle Tank Using Fuzzy Number Arithmetic Operations. Defence Science Journal 56, 251–257 (2006) 17. Dubois, D., Prade, H.: Operations on Fuzzy Numbers. Journal of Systems Sciences 9, 613– 626 (1978) 18. Globerman, S., Shapiro, D.M.: The Impact of Government Policies on Foreign Direct Investment: the Canadian Experiences. Journal of International Business Studies 30(3), 513– 532 (1999) 19. Heilpern, S.: Representation and Application of Fuzzy numbers. Fuzzy Sets and Systems 91, 259–268 (1997) 20. Hsu, H.M., Chen, C.T.: Fuzzy Credibility Relation Method for Multiple Criteria Decisionmaking Problems. Information Sciences 96, 79–91 (1997) 21. Hwang, C.L., Yoon, K.: Multiple Attributes Decision Making Methods and Applications. Springer, Heidelberg (1981)
148
C.-C. Chou and P.-C. Chang
22. Kaufmann, A., Gupta, M.M.: Introduction to Fuzzy Arithmetic Theory and Applications. Van Nostrand, Reinhold (1991) 23. Li, R.J.: Fuzzy Method in Group Decision Making. Computers and Mathematics with Applications 38, 91–101 (1999) 24. Liang, G.S., Wang, M.J.: A Fuzzy Multiple Criteria Decision-making Method for Facilities Site Selection. International Journal of Production Research 29(11), 2313–2330 (1991) 25. Liou, T.S., Wang, M.J.: Ranking Fuzzy Numbers with Integral Values. Fuzzy Sets and Systems 50, 247–255 (1992) 26. Ma, M., Friedman, M., Kandel, A.: A New Fuzzy Arithmetic. Fuzzy Sets and Systems 108, 83–90 (1999) 27. Mizumoto, M., Tanaka, K.: The Four Operations of Arithmetic on Fuzzy Numbers. Systems Computers Controls 7(5), 73–81 (1976) 28. Nahmias, S.: Fuzzy Variables. Fuzzy Sets and Systems 1(2), 97–111 (1978) 29. Rietveld, P., Ouwersloot, H.: Ordinal Data in Multi-criteria Decision Making, a Stochastic Dominance Approach to Sitting Nuclear Power Plants. European Journal of Operational Research 56, 249–262 (1992) 30. Spohrer, G.A., Kmak, T.R.: Qualitative Analysis Used in Evaluating Alternative Plant Location Scenarios. Industrial Engineering 16, 52–56 (1984) 31. Stevenson, W.J.: Production/ Operation Management. Richard D. Irwin Inc., Illionois (1993) 32. Sun, Q., Tong, W., Yu, Q.: Determinants of Foreign Direct Investment across China. Journal of International Money and Finance 21, 79–113 (2002) 33. Tompkins, J.A., White, J.A.: Facilities Planning. John Wiley & Sons Company, New York (1984) 34. Wu, X., Strange, R.: The Location of Foreign Insurance Companies in China. International Business Review 9, 381–398 (2000) 35. Zadeh, L.: Fuzzy Sets. Information and Control 8, 338–353 (1965) 36. Zadeh, L.A.: The Concept of a Linguistic Variable and Its Application to Approximate Reasoning. Information Sciences 8, 199–249 (1975) 37. Zimmermann, H.J.: Fuzzy Set Theory and Its Applications, 2nd edn. Kluwer Academic Publishers, Boston (1991)
A Hierarchical Data Dissemination Protocol Using Probability-Based Clustering for Wireless Sensor Networks Moonseong Kim1, Matt W. Mutka1, and Hyunseung Choo2 1
Department of Computer Science and Engineering Michigan State University East Lansing, MI 48824, USA
[email protected],
[email protected] 2 School of Information and Communication Engineering Sungkyunkwan University Suwon, 440-746, Korea
[email protected]
Abstract. A major challenge for designing a dissemination protocol for Wireless Sensor Networks (WSNs) is energy efficiency. Recently, researchers have studied this issue, and SPMS, a representative protocol, outperforms the well-known protocol SPIN. One of the characteristics of SPMS uses the shortest path to minimize energy consumption. However, since it repeatedly uses the same shortest path, maximizing network lifetime is impossible, although it reduces the energy consumption. In this paper, we propose a Hierarchical data dissemination protocol using Probability-based clustering, called HiProc. It guarantees energy-efficient data transmission and maximizes network lifetime. HiProc solves the network lifetime problem by a novel probability function, which is related to the residual energy and the distance to a neighbor. The simulation results show that HiProc guarantees energy-efficient transmission and moreover increases the network lifetime by approximately 78% than that of SPMS. Keywords: Wireless Sensor Networks (WSNs), Data Dissemination Protocol, Energy Efficiency, Network Lifetime, SPIN, SPMS.
1 Introduction In a Wireless Sensor Network (WSN) environments, the sensor node performs not only data transmission but also relay of data. When some sensor nodes become energy-exhausted, the whole network lifetime may be reduced. Hence, an efficient low power consumption design is very important not only for the network protocol, but also for the operating system, middleware, and security [1]. Data dissemination is a fundamental feature of a WSN, since thousands of sensor nodes may collect, exchange, and transmit data [2]. Flooding and Sensor Protocols for Information via Negotiation (SPIN) [3], two well-known proactive schemes, have been employed for M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 149–158, 2009. © Springer-Verlag Berlin Heidelberg 2009
150
M. Kim, M.W. Mutka, and H. Choo
data dissemination. First, in Flooding, each node retransmits the received data from all its neighbors. This is a very simple and primitive protocol. It rapidly disseminates the data; however, it quickly wastes energy when a data implosion occurs [4][5]. Second, SPIN solves this issue by exchanging information and negotiating at each node. Even if SPIN exchanges high-level data descriptors called metadata to prevent the duplication of data, there is still another energy problem. That is, it transmits all data at the same power level and thus does not consider the distance to a neighbor. Therefore, SPIN is incapable of energy-efficient transmission. Recently, Khanna, et al. proposed a protocol, called the Shortest Path Minded SPIN (SPMS) [6], to minimize the energy consumption using the shortest path and multi-hop to reach the destination. In order to use the shortest path, each node executes the Bellman-Ford algorithm within its zone, which is defined as the area a node can reach by transmitting at its maximum power level [7]. Thus, SPMS has to maintain a routing table. It can waste minimum energy since it uses the shortest path. However, since specific nodes in the shortest path would be used repeatedly, the network lifetime may decrease. Moreover, once a node failure occurs, parts of the network might not be able to use the shortest path anymore. In this paper, we propose a Hierarchical data dissemination protocol using Probability-based clustering, called the HiProc, which definitely guarantees an energy-efficient data transmission and strongly increases the network lifetime when the sensing data is disseminated throughout the entire network. For transmitting data, HiProc avoids the network lifetime problem of SPMS by selecting a path according to its two attributes. The first attribute is the residual energy for each node. HiProc selects a node that has a high energy level in order to prevent a certain node from being selected repeatedly. The second attribute is the considering transmission distance between nodes. It has to guarantee more efficient energy consumption. The remainder of this paper is organized as follows. Section 2 explains previous dissemination protocols. Section 3 presents details of the proposed protocol. Section 4 evaluates our proposal and finally, Section 5 concludes this paper.
2 Previous Work Traditionally, with proactive dissemination protocols, the source node distributes the sensed data through the entire network. Flooding and SPIN, two well-known proactive schemes, have been previously employed for data dissemination. In Flooding, this protocol need not have a special scheme to disseminate the sensed data. The data are continuously sent to neighbor nodes until it reaches maximum-hop or destination. Flooding is easy to implement but has some problems. Since a node transmits data to its neighbors irrespective of whether or not the neighbor already has the data in Flooding, SPIN is proposed to solve the data duplication problem. To overcome this problem, nodes negotiate with their neighbors before transmitting the data in SPIN, therefore it guarantees that only needed data will be transmitted. SPIN uses metadata, which describes the information to negotiate successfully. The strength of SPIN is simplicity. Nodes make an uncomplicated decision whenever data is received, so it wastes little energy due to computation. Furthermore, an advertising message is very light as compared to the sensing data, SPIN is able to distribute 50%
A Hierarchical Data Dissemination Protocol Using Probability-Based Clustering
151
more data per unit energy than Flooding [3]. However, when SPIN transmits data at the same power level, it does not consider the distance to a neighbor. Since the energy consumption generally increases exponentially with the distance, SPIN is incapable of energy-efficient transmission. SPMS employs the metadata concept used in SPIN and uses a multi-hop model for data transmission to avoid the exponential increase in energy consumption with distance [8]. However, for multi-hop routing, the next hop should be known before transmitting data. It is infeasible to maintain a routing table for each node, since sensor networks comprise thousands of nodes. Thus, SPMS maintains a routing table for a zone, which is defined as the maximum power level of a node, to reduce the cost of building the routing table. Each node can build a routing table with the shortest path using the Distributed Bellman-Ford (DBF) algorithm. After building the routing table, SPMS begins data transmission. SPMS sends data through the shortest path except in the case of a node failure. When the predecessor node on the computed shortest path fails, current node sends a request message to the node, from which it initially received an advertising message instead of using the shortest path. However, it may not guarantee energy-efficient transmission when the distance between the node that sent the advertising message and the current node is too long. Further, if the advertising node fails, there is no way to receive the data. To solve this problem, each node in SPMS maintains a Primary Originator Node (PRONE) and a Secondary Originator Node (SCONE). PRONE is an energy-efficient source from which data can be obtained and SCONE is an alternative node that can be used if PRONE fails. As mentioned, SPMS has the mechanism to overcome its weakness because of only using the shortest path. However, the network lifetime problem still persists.
3 The Proposed Dissemination Protocol: HiProc 3.1 Motivation and Design of HiProc Due to weaknesses of previously mentioned proactive protocols, the purposes of the proposed protocol in this paper are to guarantee an energy efficient data transmission and increase the network lifetime. For energy efficiency, the distance of transmission could be considered. For long network lifetime, the energy consumption could be distributed evenly by considering the residual energy of each node. SPMS maximizes the energy efficiency by transmitting data through the shortest path. However, this may result in a specific node being used repeatedly, since the shortest path has already been selected. This is inefficient in terms of the network lifetime. Further, SPMS does not guarantee maximized energy-efficiency in the case of a node failure, since parts of the network cannot use the shortest path anymore. In this paper, a clustering scheme is proposed that uses a probability function with parameters consisting of the residual energy and the distance to a neighbor. Here, the clustering scheme means that some nodes, called the Cluster Heads (CHs), disseminate the sensed data. Since each node elects itself to be a CH with the probability function, the given appropriate probability function may impact on the performance of the clustering scheme. We propose a Hierarchical data dissemination protocol using Probability-based clustering, called the HiProc, which definitely
152
M. Kim, M.W. Mutka, and H. Choo
guarantees an energy-efficient data transmission and strongly increases the network lifetime when the sensed data is disseminated throughout the entire network. First, we explain the basic concept of clustering scheme in HiProc. As shown in Fig. 1, the source node (src) senses the data and broadcasts the advertising message (ADVold) to its neighbor nodes. The node that has received ADVold elects itself to be the CH. The src transmits the data only to the CHs and each CH node broadcasts ADVnew to its neighbor nodes. If the remaining nodes have received ADVold receive ADVnew, the remaining nodes request its CH to receive the data.
fe Base Ȗ Base 10 Base 100
eres
Fig. 1. The basic concept of clustering scheme in HiProc
eini
Fig. 2. The energy metric from Equation (1) according to each logarithm base
Second, we propose a probability function to be used in the HiProc protocol. The proposed probability function simultaneously takes into account two properties; the level of residual energy and the distance to a neighbor. The energy metric formula is as follows.
⎛ e f e = − log b ⎜⎜ m − res eini ⎝ m=
⎞ ⎟+n ⎟ ⎠
b , n = 1 − log b (b − 1) b −1
(1)
(2)
Equation (1) is energy metric function and the value must be between 0 and 1, which mean the low and high energy level. Equation (2) is obtained by the condition (0,0) and (1,1) from Equation (1). Here, eres and eini are defined as the residual energy and initial energy, respectively. Fig. 2 shows the graph of Equation (1) according to each logarithm base. fd =
distance(node1 , node2 ) transmissi on range
(3)
Equation (3) is a distance metric function. If the distance between two nodes is close to the transmission range, then the value is near 1. In Fig. 3, two cases of the elected
A Hierarchical Data Dissemination Protocol Using Probability-Based Clustering
(a) The elected CHs are located in near transmission range
153
(b) The elected CHs are located in near the nodes sent data
Fig. 3. Two cases of choosing CH nodes
Fig. 4. The proposed probability function Pr (N )
CH nodes are depicted. There is one relay to send the data in Fig. 3(a), but three relays are needed in Fig. 3(b). It means that the unnecessary energy consumption happens in mid course of data transmission. Pr ( N ) = (ω e f e + ω d f d ) 2
− ( N −1)
(4)
where, ωe , ω d ≥ 0 and ω e + ω d = 1 . Equation (4) is the proposed probability function to be used in HiProc. The proposed probability function uses f e and f d as the main parameters. Each attribute can be adjusted by weight factor ωe and ωd . Pr (N ) is power increasing along with the iterative processes N . The power increasing property enables the function having the ability to reach 1 within a few iterations as shown in Fig. 4. 3.2 Operation Overview for HiProc Protocol
In HiProc, a node may have four possible states. Before describing the proposed protocol, we first define the following terms and the detailed pseudo code is as follows.
154
M. Kim, M.W. Mutka, and H. Choo
• State of nodes • Unclustered Node (UN): A node that has received no message up to now, and has no relation with the data. • Cluster Head (CH): A node that is elected as a cluster header. • Cluster Candidate (CC): A node that has received an advertising message, but does not determine its CH. • Cluster Member (CM): A node that was CC, has determined its CH, and requests the CH to receive the data.
HiProc(ωe ,ωd ) 01. Data is generated; 02. The sensing node disseminates the advertising message, ADVold, to its neighbor nodes; 03. N =1; 04. A node that has received the ADVold determines itself whether or not it is CH using Pr (N ) . 05. 06. 07. 08. 09. 10. 11. 12. 13. 14. 15. 16. 17. 18. 19. 20.
That is, if random(0,1) ≤ Pr ( N ) , then the node is CH; If(A node is elected as CH) Disseminate the advertising message, ADVnew, to its neighbor nodes; A node that has received the ADVnew message becomes CC; Else A node becomes UN; While(1) ++N ; The UN redetermines itself whether or not it is CH using Pr (N ) after some waiting time. If(A node is elected as CH) Disseminate the advertising message, ADVnew, to its neighbor nodes; A node that has received the ADVnew message becomes CC; Else A node becomes UN; If(All nodes are CH or CC) Break; CC determines its CH by comparing signal strengths of the received ADVnew. And CC becomes CM; CH requests the data from the node sent ADVold; CM requests the data from its CH;
Fig. 5 shows how CHs are elected and how the sensed data is disseminated. The source node (src) first senses the event and broadcasts ADVold to the nodes within its transmission range. We assume that the node A is elected as CH in Fig. 5(a). The node A also disseminates ADV1new to its neighbor nodes as shown in dotted line in Fig. 5(b). The nodes that have received both ADVold and ADV1new become CC. If the nodes B and C are elected as CH at the next iteration in Fig. 5(c), they also broadcast ADV2new to its neighbor nodes and the nodes that have received both ADVold and ADV2new become CC as well. If all nodes that have received ADVold are CH or CC,
A Hierarchical Data Dissemination Protocol Using Probability-Based Clustering
Pr(1)
155
A
A
(a)
(b)
A
A Pr(1)
B
B
Pr(2) Pr( 2)
C
C
(c)
(d) Fig. 5. Operation scenario for HiProc
then each CC determines its CH by comparing signal strengths of the received ADVnew and becomes CM. Finally, CH and CM request the data from the src and its CH, respectively. Therefore, the sensed data could be shared with all nodes.
4 Performance Evaluation We implemented the proposed HiProc using JAVA to evaluate its performance. The main parameters are listed in Table 1. Sensor nodes with 35m transmission range are randomly distributed in a network over an area of 250m × 250m . Each node has an initial energy level of 0.5 J . The control messages – advertising, request – are 16bytes each, while the sensed data is 500bytes . We use the following energy model [8].
Et = α11 + α 2 d 2
(5)
E r = α12
(6)
where, Et and Er denote the energy consumption for transmitting and receiving a bit over a distance d , respectively. Hence, the energy consumption for a relay is E r + Et . The energy model has values of α11 , α12 = 80nJ / bit and α 2 = 100 pJ / bit / m 2 .
156
M. Kim, M.W. Mutka, and H. Choo Table 1. Simulation variables Network size
250m × 250m
Initial energy
0.5 J
α11 , α12
80nJ / bit
α2
100 pJ / bit / m 2
Packet size
ADV, REQ
16bytes
DATA
500bytes
1.8
1.7
35m
Energy consumption for an event per a node (mJ)
Energy consumption for an event per a node (mJ)
Transmission range
HiProc(1.0, 0.0) HiProc(0.5, 0.5) HiProc(0.0, 1.0) SPMS SPIN
1.6
1.4
1.3
1.2 0.004
0.005
0.006
0.007
0.008
0.009 2
Density (nodes / m )
(a)
0.010
0.011
1.240
1.235
1.230
1.225
1.220
1.215 0.004
HiProc(1.0, 0.0) HiProc(0.5, 0.5) HiProc(0.0, 1.0) 0.005
0.006
0.007
0.008
0.012
0.009
0.010
0.011
0.012
2
Density (nodes / m )
(b)
Fig. 6. Average energy consumption for an event per a node
Here, α11 is the energy/bit consumed by the transmitter electronics, α 2 is the energy dissipated in the transmit op-amp, and α12 is the energy/bit consumed by the receiver electronics. We also set the logarithm base is 10 in Equation (1). Fig. 6 shows a graph of each scheme’s average energy consumption according to the density. SPIN has the highest energy consumption. SPMS exhibits a better performance than SPIN, although its energy consumption increases with density as compared to that of HiProc. The energy efficiency enhancement of HiProc is up to 33% and 13% compared with SPIN and SPMS, respectively. On the other hand, HiProc differs with SPIN and SPMS, the energy consumption does not increase greatly. Fig. 6(b) illustrates the energy consumption of HiProc for each ω d. It is noted that the efficiency of the energy consumption increases when ω d is increasing to 1. Fig. 7 explains the network lifetime according to the density. Due to HiProc distributes a data over the entire network by considering the residual energy, the network lifetime might be significantly prolonged rather than the other protocols. When ωe is 1 especially, HiProc has the longest network lifetime and the enhancement is 71~78% compared with SPMS. Finally, we continuously generate 400 events. As shown in Fig. 8, the energy distribution of SPIN is very exhaustive; however, the energy consumption of HiProc could be distributed evenly.
A Hierarchical Data Dissemination Protocol Using Probability-Based Clustering
157
Network Lifetime (Number of Events)
700
600
500
400
300
HiProc(1.0, 0.0) HiProc(0.0, 1.0)
HiProc(0.5, 0.5) SPMS SPIN
0.006
0.009
200 0.004
0.005
0.007
0.008
0.010
0.011
0.012
2
Density (Nodes / m )
Low
High
Fig. 7. Network Lifetime
(a) SPIN
(b) HiProc(1,0)
(c) Energy
Fig. 8. Distribution for energy consumption
5 Conclusion This paper describes proactive protocols, such as Flooding, SPIN, and SPMS for WSNs. We proposed a Hierarchical data dissemination protocol using Probabilitybased clustering, called the HiProc. HiProc solves the energy consumption and the network lifetime problems by a novel probability function, which is related to the residual energy and the distance to a neighbor. We have compared SPIN and SPMS through simulation experiments and have proved that the performance of HiProc is superior to earlier protocols. This proves that HiProc guarantees the energy efficient transmission and the longer network lifetime. Furthermore, HiProc provides a more flexible dissemination protocol due to it uses two weighted attributes. Acknowledgments. The authors thank Jihoon Cho for supporting simulation. This research was supported in part by MKE (Korea) under ITRC IITA-2008-(C10900801-0046) and NSF (USA) Grants No. OCI-0753362, CNS-0721441, and CNS0551464.
158
M. Kim, M.W. Mutka, and H. Choo
References 1. Akyildiz, I.F., Su, W., Sankarasubramaniam, Y., Cayirci, E.: Wireless sensor networks: a survey. Computer Networks 38, 393–422 (2002) 2. Al-Karaki, J.N., Kamal, A.E.: Routing techniques in wireless sensor networks: a survey. Wireless Communications 11(6), 6–28 (2004) 3. Heinzelman, W.R., Kulik, J., Balakrishnan, H.: Adaptive Protocols for Information Dissemination in Wireless Sensor Networks. In: Proceeding of MOBICOM. ACM/IEEE (1999) 4. Ni, S.-Y., Tseng, Y.-C., Chen, Y.-S., Sheu, J.-P.: The Broadcast Storm Problem in a Mobile Ad Hoc Network. In: Proceeding of MOBICOM, pp. 151–162. ACM/IEEE (1999) 5. Le, T.D., Choo, H.: Efficient Flooding Scheme Based on 2-Hop Backward Information in Ad Hoc Networks. In: Proceeding of ICC, pp. 2443–2447. IEEE, Los Alamitos (2008) 6. Khanna, G., Bagchi, S., Wu, Y.-S.: Fault Tolerant Energy Aware Data Dissemination Protocol in Sensor Networks. In: Proceeding of DSN, pp. 739–748. IEEE, Los Alamitos (2004) 7. Haas, Z.J., Pearlman, M.R.: The performance of query control schemes for the zone routing protocol. Transactions on Networking 9(4), 427–438 (2001) 8. Bhardwaj, M., Garnett, T., Chandrakasan, A.P.: Upper bounds on the lifetime of sensor networks. In: Proceeding of ICC, vol. 3, pp. 785–790. IEEE, Los Alamitos (2001)
An OWL-Based Knowledge Model for Combined-Process-and-Location Aware Service Gunhee Kim, Manchul Han, Jukyung Park, Hyunchul Park, Sehyung Park, Laehyun Kim, and Sungdo Ha Intelligence and Interaction Research Center, Korea Institute of Science and Technology, Seoul, Korea {kani,manchul.han,parkjk,hyunchul.park,sehyung, laehyunk,s.ha}@kist.re.kr
Abstract. This paper presents a knowledge model for spatiotemporal context awareness. The knowledge model is designed to understand user goals and to guide users who perform complicated tasks involving several routes, such as tasks at a hospital. An information system should be able to consider both the location and process context to provide relevant guidance regarding tasks, their location, and their process, as location and process information are collaboratively associated. A service that is both process- and- location-aware is considered, and a knowledge model that represents the semantics of the proposed process- andlocation-aware service is given. Keywords: spatiotemporal context, process, location, knowledge model, OWL (Web Ontology Language).
1 Introduction Context-aware computing has been drawing much attention with the development of u-computing environments. A context-aware system can help users concentrate on their tasks with reduced complexity and can provide users relevant guidance when performing their tasks. Context awareness or situation awareness can be defined as the answer to “what is going on?” [1]. For instance, in a case in which a user is watching a football game without any background knowledge, it would be difficult to infer what is going on. In short, situation awareness is the inference of a situation using background knowledge. Recently, a number of applications have been developed to provide context-aware services, and various context models have also been designed to support these applications. Baldauf et al. [2] present architectures of context-aware systems as well as approaches for context models. Among them, the ontology-based approach has been used widely due to its formal expressive and reasoning techniques. Krummenacher and Strang [3] defined contexts for a context-aware service and suggested criteria for context and ontology modeling. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 159–167, 2009. © Springer-Verlag Berlin Heidelberg 2009
160
G. Kim et al.
In addition, research has centered on a context-aware system with a knowledge model. Ongenae et al. [4] suggested an ontology-based system for context-aware hospital nurse call optimization. The context-aware call system has a context model that includes the status of the nurse, the characteristics of the nurse (gender, language, etc), and the location of the patient and the nurse. With the model, patients can walk around freely, select their preferred nurse (gender, language, etc), and nurses can identify whether calls are urgent or normal. An ontology-based personalized pathfinding system using deviation detection for individuals with cognitive impairment [5] was suggested by Chang et al. They suggested a system and developed a knowledge model for guiding cognitively impaired people to their work places, by showing pictures at crucial places and times. The system considered the leaving time and the expected time of arrival to an area when alerting the system of a problem, using the person’s ID for personalization. Niu and Kay present Pervasive Personalization of Location Information: Personalized Context Ontology (PECO) [6]. The purpose of this system is to provide personalized information to a user using an ontology model with seven parts: location sensors, building plans, technical building data, staff directories, internal email aliases, direct user input. However, these knowledge models of the systems are designed only to focus on location-awareness or limited situations. To provide users guidance with accomplishing complicated tasks, it is necessary to understand the current process and location context together, as the process and the location context are collaboratively associated. This paper presents the design of the knowledge model for a spatiotemporal context-aware service and presents a knowledge model which enables systems to recognize and adapt to changing situations. To validate the proposed knowledge model, scenarios in general hospitals are presented and instances of the knowledge model are developed for the scenarios.
2 System and Considerations A process and location-aware information service system [7] that helps users to handle tasks with complicated procedures was designed. The system provides information via a mobile device such as a PDA or a smart phone regarding what to do, how to do it, and where to go while performing complicated tasks in unfamiliar public places such as hospitals. To give a user relevant guidance, the system first should recognize the time and location from the process data of a local information system and the location data of sensor networks, and must then infer the tasks and location with which the users should proceed. To understand users’ situation and provide relevant information, the system should be able to consider both the process and location context because process and location are collaboratively associated. Moreover, the system should be able to adapt to changes in time and space situations, as processes and locations can change frequently as a task is being completed. Thus, a knowledge model of a context-aware information guide system should be able to reflect the following two features: interrelation between the process and the location, and adaptation to changes of the spatiotemporal context.
An OWL-Based Knowledge Model for Combined-Process-and-Location Aware Service
161
2.1 Interrelation between Process and Location The relationships between the process and location should be expressed collaboratively in the knowledge model because process and location information can be helpful to interpret each context. The location information of a user can be grounds for inferring a user’s task or processes. Additionally, a system should be able to infer the location of the user from process information and provide relevant information services; the meaning of a particular location can be interpreted differently according to a user’s goals and processes. Figure 1 shows the difference between a location-based and the proposed-processand- location-based knowledge structure. In the location-based service, the system provides information only related to the user’s current location. It is difficult to guide the user in terms of his or her next location and process. Moreover, if there are several possible tasks or services at one place, this system cannot easily decide which of these is necessary within the current user’s situation. In comparison, the proposed system can provide information regarding the next service and location as well as the most relevant information among possible candidates related the current location based on recognition of user’s spatiotemporal situation.
Fig. 1. Comparison between the location-based and the combined- process- and- location-based knowledge structure
2.2 Adapting to a Change of the Spatiotemporal Context The system should have a flexible knowledge structure to adapt to changes of the spatiotemporal context, as process and location procedures can vary according to ongoing results or to changes of the user’s intentions. At a hospital, for instance, the patient’s procedure can be modified by the result of a doctor’s examination. In addition, if a patient would like to rest or use the toilet before going to the doctor’s office, the route information should be modified. Figure 2 shows an example of a process adaptation. The initial service sequence (a)->(b)->(c) becomes (a)->(b)->(d)>(e)->(c) due to the result of (b). According to the modified process, the guide information about what to do, how to do it, where to go, and how to go there also changes.
162
G. Kim et al.
Fig. 2. Adaptation to a context change
3 Knowledge Model A knowledge model for a context-aware information guide service that requires consideration of both process and location situations was designed. The knowledge model expresses the relationships between the process and location and has a flexible structure for changes of the spatiotemporal context. The knowledge model includes three main parts: the process, the location, and the user. The process part represents the Process, Service, and Task classes. They are linked to the user and the location classes where they are performed. In the location part, classes are classified into two layers: a physical layer and a logical layer. The classes included in the physical layer represent real-world entities such as rooms. On the other hand, the classes of the logical layer are defined by their use, such as waiting
Fig. 3. Classes and relations
An OWL-Based Knowledge Model for Combined-Process-and-Location Aware Service
163
Table 1. Definition of classes of the knowledge model
User
Goal
Physical
Location Context
Logic -al
Process
Sub Class
Context
Primary Class
Definition A final aim of a user
Process
A flow of Services for accomplishing user`s goal
Service
A unit operation such as examination, inspection
Task
An activity that user to do for the Service
Area
A place where the Services are executed
Zone
A place where the Task is executed
Floor
A level on inside a building
Section
An abstract physical space including Room, Aisle, and Hall
Room
A space within a building enclosed by a ceiling, and walls
Aisle
A passage between rows of rooms
Hall
An opened space linked to rooms and aisles
places, dental departments, etc. Lastly, the User, Goal, and User type classes are defined in the user part. The overall structure of the knowledge model is illustrated in Figure 3, and the definitions of each class are described in Table 1. Figure 3 also represents the relationships between the classes. In particular, the logical location classes play the important role of inferring the relationships between the process classes and the physical location classes. The Area class is defined to match the Service class; the Area denotes the places where the Services occur. In addition, the Zone class is defined on the same level of the Task class, which represents the detailed activities of the user as they pertain to services. At a hospital, for example, a dental examination can be an instance of the Service class, and the dental department can be defined as an instance of the Area class, which is related to the Service of the dental examination. The dental department instance also contains the Floor and Section information so that the guide system can provide location information to patients who are set to receive a dental examination. 3.1 Process Context Model A Process Context model was designed to provide users with guidance regarding what to do and how to do it according to the users’ goal. Figure 4 presents the process model. This model has three classes: Process, Service, and Task. The Process consists of a flow of the Services they are needed for the goal. These Services in the Process can be swapped with other Services depending on ongoing results. Each Service can also have a sequence of the Tasks that users should carry out for the Service. With the Process Context, the system can recognize whether or not users are doing well with the process and can provide users with relevant guidance when they have problems. If a user is waiting for his/her turn in a waiting area without the task ‘take a number’,
164
G. Kim et al.
Fig. 4. Process Context model
the guide system can inform the user that he/she should take a number for his/her service. It also tells the user how to do this. 3.2 Location Context Model The Location Context model was designed to recognize a user’s current position in addition to his or her next destination with the process context. From the location context, the system can provide users with route guidance. Figure 5 describes the Location Context model classified into the Logical Location and Physical Location. The Logical location has Area and Zone classes, and Zones are linked to other Zones so that the path of the user can be expressed as a sequence of Zones. Additionally, the Physical Location includes the Floor and Section classes. The Section class has three subclasses: Room, Aisle, and Hall classes.
Fig. 5. Location Context model
4 An Example of a Knowledge Model 4.1 Hospital Scenarios In order to design a more practical model, a general hospital was chosen as the domain for this research. The services of hospitals and users’ tasks were analyzed before the knowledge model was designed.
An OWL-Based Knowledge Model for Combined-Process-and-Location Aware Service
165
It was assumed that a patient was visiting the hospital to resolve a toothache. During the first step, the process of the patient is set up as a sequence of basic services that include Reception, Examination and Payment. The remaining processes are modified after the completion of each step. After the Examination (Step 2), the doctor requests an X-ray, and the remaining process, Payment, is changed by adding the X-ray inspection. During the last step, the remaining process is only Payment. The scenario shows how the proposed knowledge model reflects the process changes after Step 2. Figure 6 shows the context information at each step.
Fig. 6. Hospital scenarios
4.2 Implementation The knowledge model was built with the OWL language and a scenario-based prototype system to validate the developed knowledge model. The knowledge model was built using a protégé. Figure 7 describes an example how ontology is written in OWL/XML. The Sequence represents the flow of the Tasks, and the flow of the Service is represented as shown below.
Figure 7 also represents the relationships between the Logical and the Physical Locations as well as the relationships between the Services and Tasks. Here, the current location is Dental Surgery Doctor Kim’s room with room number B211. It is a Zone of the Dental surgery Area and provides dental services. The Task of the zone is the dental examination. With these relationships, the reasoning engine RacerPro can infer the
166
G. Kim et al.
Fig. 7. An OWL expression for the Zone and its related Tasks
location of the Zone, what Services are executed in the Zone, and other information. The system can then provide the user spatiotemporal-context-aware guidance.
5 Conclusion In this paper, an OWL-based knowledge model for context-aware system is proposed that considers both the location and the process. The knowledge structure of this model expresses the interrelationships between the process and the location classes as well as adaptations to changes in the spatiotemporal context. With the knowledge model, the system can recognize the combined process- and location-based context of users and can provide users with relevant guidance. The knowledge model was not designed only for a specific domain; hence, the domain of the knowledge model can be expanded easily to other public places such as schools. The knowledge model and the system will be applied to actual public places in future studies in an effort to validate the overall usefulness of the proposed system. Acknowledgments. This work was supported by the IT R&D program of MKE/IITA. [2008-F-045-02, Development of Digital Guardian technology for the disabled and the aged person]
References 1. Kokar, M.M., Matheus, C.J., Baclawski, K.: Ontology-based situation awareness. Information fusion (2007) 2. Baldauf, M., Dustdar, S., Rosenberg, F.: A Survey on Context-Aware Systems. International Jounal of Ad Hoc and Ubiquitous Computing (2007) 3. Krummenacher, R., Strang, T.: Ontology-Based Context-Modeling. In: Third Workshop on Context Awareness for Proactive Systems (CAPS 2007) (2007)
An OWL-Based Knowledge Model for Combined-Process-and-Location Aware Service
167
4. Ongenae, F., Strobbe, M., Hollez, J., Jans, G.D., Turck, F.D., Dhaene, T., Demeester, P.: Ontology Based and Context-Aware Hospital Nurse Call Optimization. Complex, Intelligent and Software Intensive Systems (2008) 5. Chang, Y., Wang, T., Chuang, Y., Tsai, S.: Ontology-based Personalized Wayfinding System Using Deviation Detecting for Individuals with Cognitive Impairments. In: International Conference on Convergence Information Technology, pp. 1844–1848 (2008) 6. Niu, W.T., Kay, J.: Pervasive Personalisation of Location Information; Personalised Context Ontology. In: Adaptive Hypermedia Conference Website, pp. 143–152 (2008) 7. Han, M., Kim, G., Park, S., Kim, L., Ha, S.: Process and Location-aware Information Service System for the Disabled and the Elderly. In: 13th International Conference on Human-Computer. Springer, Heidelberg (2009)
Human-Biometric Sensor Interaction: Impact of Training on Biometric System and User Performance Eric P. Kukula1 and Robert W. Proctor2 1 Department of Industrial Technology, Purdue University, Biometric, Standards, Performance, & Assurance Laboratory 401 North Grant Street, West Lafayette, IN 47907-2021 USA 2 Department of Psychological Sciences, Purdue University 703 Third Street, West Lafayette, IN 47907-2081 USA {kukula,rproctor}@purdue.edu
Abstract. Increasingly sophisticated biometric methods are being used for a variety of applications in which accurate authentication of people is necessary. Because all biometric methods require humans to interact with a device of some type, effective implementation requires consideration of human factors issues. One such issue is the training needed to use a particular device appropriately. In this paper, we review human factors issues in general that are associated with biometric devices and focus more specifically on the role of training. Keywords: biometrics, human-biometric sensor interaction (HBSI), human performance, instruction, training.
1 Introduction Biometrics is defined as the automated recognition of behavioral and physiological characteristics of individuals [1]. Biometric methods are used to authenticate individuals in a multitude of scenarios, including, but not limited to access control, identity management, and time and attendance. Some biometric technologies include: fingerprint, facial, and iris recognition; hand geometry; vein pattern; and signature dynamics. These biometric technologies may be stand-alone systems, utilized as part of a multifactor authentication system (e.g., combined with physical possessions, such as an identification card, or knowledge, such as a personal identification number), or merged to form a multimodal biometric system (e.g., fingerprint and face) with applications varying widely in scope. Applications for biometrics range from military use, such as base access control and third country nationals identification, to protecting consumer information stored on electronic devices such as laptops, personal digital assistants, and cellular phones. These deployments have varied in scale and application, and the outcomes of such implementations have varied as well. However, as the biometrics community analyzes lessons learned, one continually discussed area is that of usability and design of biometric devices [2-7]. Questions that arise include: Can current biometric devices provide rapid and accurate responses when needed? Do existing state-of-the-art M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 168–177, 2009. © Springer-Verlag Berlin Heidelberg 2009
Human-Biometric Sensor Interaction: Impact of Training
169
devices function properly in all applications and environments? Can military personnel capture the biometric sample from a person of interest and not feel endangered? Are consumers satisfied with biometric devices, and do they understand how the devices work? The goal of research in the area of human-biometric sensor interaction (HBSI) is to address usability issues raised by questions of the above type and investigate them in order to develop the next generation of universally usable biometric systems. Historically, the biometrics community has performed limited work in the area of human-computer interaction (HCI), ergonomics, and usability. To reach the goal of universally usable biometric systems, however, further understanding of the user is needed. This understanding includes the exact nature of the physical and cognitive interactions that humans have with the sensor and biometric system, how users can best learn to use biometric technologies successfully, and to what extent users can transfer knowledge regarding use of one biometric system to use of another. Biometrics are ideally supposed to possess five desirable properties [8]: (1) universality – the biometric property is available on all people; (2) invariance – the features extracted are non-changing; (3) high intra-class variability – the features extracted from one user are distinct from those of all other users; (4) acceptability – the characteristic is suitable for use by everyone; (5) extractability – a sensor can extract the features presented in a repeatable manner. Although commonly described in the literature as the ideal characteristics of a biometric measure, each property must overcome challenges, as the majority of biometrics are challenged to satisfy all of these five categories. Though early research was concerned mainly with the design, development, and testing of biometric systems and algorithms, recent research has shown that human physical, behavioral, and social factors affect performance of the overall biometric system. This leads to an approach called biometric system ergonomic design (see Fig. 1). The basic idea is that in order for a biometric system to function properly, ergonomic design principles must be incorporated into its design. Factors to consider include the following. The physical environment may alter the biometric characteristics of a person so as to render that person unidentifiable in particular environmental contexts. Determining those physical limits to use a biometric system is important. Users may be uncertain about where, or how, to position themselves to the biometric sensor to get a valid reading, and they may have concerns about using biometric devices for certain applications and in certain contexts. User acceptance of any biometric system is a factor that must be considered in its implementation. As with any technology with which people are not familiar, instruction and training are necessary when a biometric device is first used. Training is included in biometric system ergonomic design. Training can provide users with knowledge about the properties of the system and with the required steps for their interaction with it. To the extent that biometric devices within a modality have similar features and functions, this training may be generalizable across the set of biometric devices for an entire modality, requiring no additional training when a new device is encountered. To the contrary, if biometric devices within a modality differ in key details regarding their operation, negative transfer may occur in which procedures learned to interact with one device may interfere with use of another device. General principles of training,
170
E.P. Kukula and R.W. Proctor
Fig. 1. Issues that affect biometric system performance and the relationship with the HBSI [9]
described later, can provide a basis for studying training within the specific context of use of biometric devices. If the biometric device is monitored by an assistant, the assistant may instruct the user about the steps in using the device. In most cases, though, an assistant will not be available, in which case training materials must be simple and easy to comprehend. They can consist of a poster that illustrates the steps to be taken by the user, possibly complemented by recorded audio instructions. Feedback is important in learning and performing any perceptual-motor act [10], and it therefore is important that feedback be provided regarding factors such as position of the hand and whether the process was completed successfully. When unsuccessful, the feedback should help enable the user to know what s/he should do to get a successful reading.
2 Biometric System Performance Traditional approaches to evaluate the performance of a biometric system have been system-level, meaning that evaluators and designers are more interested in system reported error rates, some of which include: Failure to Enroll (FTE) rate, Failure to Acquire (FTA) rate, False Accept Rate (FAR), and False Reject Rate (FRR). Traditional performance evaluations have worked well to evaluate emerging technologies, new biometric modalities, and algorithm revisions. Moreover, since biometrics entered the commercial marketplace, most research has been dedicated to development in three areas: improving performance, increasing throughput, and decreasing the size of the sensor or hardware device. Limited research has focused on ergonomic design and usability issues relating to how users interact and use biometric devices. Furthermore, limited research has examined human performance, specifically how training methods or techniques impact the HBSI and biometric performance. 2.1 Development of the Human-Biometric Sensor Interaction Any interaction of a human with a biometric sensor requires a series of steps. For example, human interaction with a biometric device that captures the fingerprint of a single finger will typically include the following [11]: (1) visually sight a prompt on a display terminal that prompts the user to place a finger on the fingerprint reader; (2) visually sight the fingerprint reader; (3) move a hand towards the fingerprint reader until it is in close proximity; (4) rotate the hand until the palm side is down; (5) extend a finger until it fits over the fingerprint reader; (6) visually sight the display terminal for confirmation that the fingerprint read was successful. Because several steps are involved in this interaction, task completion time may be long, errors of
Human-Biometric Sensor Interaction: Impact of Training
171
various types may occur, and, if the problems are very great, user resistance to using the device will increase (see [12] for more extended discussion of these factors). Errors can involve performing the steps out of order, failing to position the finger properly on the fingerprint sensor, failing to keep finger still for long enough to allow the fingerprint to be read, and so on. Seminal research and publication in the area of usability and accessibility, which was concerned with biometric system ergonomic design, were pioneered by the User Research Group at National Cash Register (NCR) [4, 13]. The United Kingdom Home Office Identity and Passport Service has also published reports based on their biometric trials and implementations which discuss biometric usability and ergonomic design [14]. Maple and Norrington [6] have reported on one particular trial of the United Kingdom’s Passport Service Trial Program and its usability, and found issues with each of the three evaluated biometric systems: fingerprint, face, and iris recognition systems. More recently, work in this area has focused on: • Creating an evaluation method for biometrics that examines biometric performance and usability [15, 16], • Determining “optimal” device heights for hand geometry [17] and fingerprint recognition [18], • Usability studies involving a ten print fingerprint capture device [19] and comparison between swipe and large area fingerprint sensors [20], and • Impact of demography on biometric sample quality and performance [21-23]. Research in the area of biometric system ergonomic design has been called the Human-Biometric Sensor Interaction, or HBSI and is shown in Fig. 2. The model shows how the different areas of research and principles of the different fields of ergonomics [26], usability [27], and biometrics [28] converge in the overlapping HBSI area.
Fig. 2. The Human-Biometric Sensor Interaction Model [9, 15, 16, 21, 24]
2.2 The Human-Biometric Sensor Interaction The human and sensor components of the HBSI model are similar to Tayyari and Smith’s human-machine interaction model [26]. Much like the traditional model, the
172
E.P. Kukula and R.W. Proctor
human and biometric sensor components look to achieve the optimal relation between humans and a biometric sensor in a particular environment. The overlap of these two sections is best summarized by ergonomics, with the goal of adapting the sensor so the presentation of a user’s biometric traits to the sensor is more natural to the user. The human and biometric system components of the HBSI model are arranged in the model to accommodate the way biometric sensors, software, and implementations occur and are presented to users. A biometric sensor must not only be designed so that a user can interact with it in a repeatable fashion, but the sensor(s), software, and the way the entire “system” is packaged must be usable. According to ISO 9241-11 [27] usability is comprised of three factors: effectiveness, efficiency, and satisfaction. Each of the three metrics is distinct and important to understand for products to balance between the three. First, biometric systems must be effective, meaning users are able to complete the desired tasks without too much effort. Second, biometric systems must be efficient, meaning users must be able to accomplish the tasks easily and in a timely manner. Third, users must like, or be satisfied, with the biometric system, or they will discontinue use and find alternative methods to accomplish the task. As mentioned in the previous two sections, users need to be able to interact with a sensor in a consistent manner over time, and users must find the entire biometric system usable. To enable this to occur, the third relationship of the HBSI conceptual model emerges – the sensor-biometric system, whose key metric is sample quality. Sample quality is the link between these two components because the image or sample acquired by the biometric sensor must contain the characteristics or features needed by the biometric system to enroll or match a user in the biometric system. It is well documented in the literature that sample quality affects the biometric matching algorithm. Yao, Pankanti, and Haas [29] stated that “in a deployed system, the poor acquisition of samples perhaps constitutes the single most important reason for high false reject/accept rates.” So, not only does the human-sensor relationship need to be functional and the human-biometric system need to be usable, the sensor-biometric system needs to be functional. An efficient sensor-biometric system only occurs if the sensor can capture and pass usable features to the biometric matching algorithm.
Fig. 3. The HBSI Evaluation Method [15, 16, 24]
Human-Biometric Sensor Interaction: Impact of Training
173
To evaluate the model, the overlap of the different components in Fig. 2 has been expanded to reveal the HBSI Evaluation Method (Fig. 3), which addresses how each area of overlap can be measured. Since the conceptual model is derived from different fields, each component (usability, ergonomics, and biometrics) produces a unique output. The authors acknowledge that the metrics used in the HBSI Evaluation Method may produce a trade-off between performance and usability.
3 Training and Instruction An important component for use of biometric devices is training. Users need to be trained how to use the various devices appropriately in order to optimize the biometric system performance. Yet, relatively little work has been done on training to use biometric devices. In addition to concern about training a person to use a particular device within a specific environment, it is also important that the training transfer to different environments in which the same device is used and, more importantly, to different devices of the same general type. 3.1 Principles of Training and Transfer Though research on training and transfer with biometric devices is sparse, research in cognitive psychology has established many broadly applicable principles of training and transfer for both knowledge and skills [30]. Many of these theoretical principles should be applicable to the domain of biometrics. Their application will help determine the best way to train people to use biometric devices and predict how well this training can transfer to new/alternative devices. We describe below various training principles [31] that could be applicable to developing effective training practices for use of biometric devices. One generally accepted principle is the power law of practice. According to this principle, the time to complete a task decreases as a function of the number of times it is performed. This means that having people perform the same task multiple times may be an effective form of training. A related principle is that of deliberate practice: Practice is most beneficial when it is highly motivated and focused. Deliberate practice has been shown to be necessary for skill acquisition in a variety of domains. The principle of depth of processing emphasizes that training which requires deep and elaborate processing, creating distinctive encodings, enhances durability of knowledge and skills. According to the principle of contextual reinstatement, performance of a task at a later time (the test) is improved by training that matches the test conditions as closely as possible. Closely related to this principle is that of procedural vs. declarative training. Procedural training is more durable than declarative training, whereas declarative training leads to better generalization. With regard to instance- vs. rulebased training, instance-based strategies lead to more efficient performance in simple tasks, whereas rule-based strategies lead to more efficient performance in more complex tasks. Also, rules tend to be more durably represented in memory than are instances. People will tend to remember rules better than specific instances.
174
E.P. Kukula and R.W. Proctor
Knowledge seeding is sometimes beneficial for training. When tasks require having a certain type of quantitative knowledge, providing a small number of examples is often sufficient knowledge to encompass an entire domain. The principle of spacing of practice is that knowledge is retained for longer periods of time when training sessions are spaced in time. The power law of forgetting is that performance decreases as a power function of the time since training [32]. One of the more intriguing findings in recent years is that testing impedes forgetting: Testing after initial presentation of material slows forgetting [33]. In the area of information security, this principle has been found to hold for memory of several passwords used to access different e-commerce sites [34]. The final principle is generalization depends on similarity. The gain in performance on one task as a consequence of training on a different task is an exponentially decaying function of the similarity between the two tasks [35]. Thus, transfer can be expected to occur to the extent that the transfer task is similar to the task used at training. 3.2 Training and Instruction Research in Biometrics Not much research has been conducted investigating the impact of training on biometric and usability performance measures. The most extensive study was one conducted by researchers at NIST to evaluate the time to acquire a 10-print slap fingerprint image using three different instruction methods [19]. Participants were told to make a right slap, left slap, and simultaneous thumb prints. One of three instructional techniques was used for each participant: a poster illustrating the steps; verbal instructions spoken by the test administrator; a soundless video demonstrating the procedure. Participants who received the poster instructions made more errors than those who received the verbal or video instructions. Moreover, only 56% of the participants in the poster group completed the fingerprinting process, a smaller percentage than in the other instruction groups, and those who did complete the process took longer to do so than did the participants instructed by the other methods. A limitation of the study is that participants instructed by poster were allowed to selfdetermine the duration for which they examined the poster, whereas participants in verbal and video conditions were required to engage in the training on average approximately 50 s. In fact, the median time spent examining the poster was approximately half the duration of the other instructional conditions. Thus, the poorer performance with the poster instructions may be a consequence of not studying the poster for a sufficiently long duration. We currently are conducting an experiment to evaluate this possibility by allowing one group of participants to self-determine how long to examine the poster, as in [19], but having another group examine the poster for a fixed period of 50 s, a duration comparable to that for the other training methods in [19]. Preliminary results agree with the findings of [19] in suggesting that the poster alone is not a particularly effective instruction method, even when participants are required to view the poster for a longer time than they do when allowed to self-terminate. Kukula, Gresock, Elliott, and Dunning [36] examined the influence of type and amount of user training on interaction with a hand geometry biometric device. Because hand geometry depends on orientation of the user’s hand, most hand geometry devices have pins with respect to which the user’s hand must be positioned
Human-Biometric Sensor Interaction: Impact of Training
175
for correct alignment. Training is perhaps even more important for hand geometry devices than for fingerprint reasons because it needs to convey how users should interact with the alignment pins. Four groups of participants received initial instructions and demonstrations of using a hand geometry device. They then received different amounts of practice with the device one day per week in some weeks of a six-week training period. In the seventh week, all participants were required to achieve a criterion of three consecutive successful readings with the device at a set performance level (threshold set to 30). The control group performed only the criterion task in the last session. The group that received the most practice performed the task to the same criterion of three successful readings in four of the six weeks prior to the final test. This group showed continued improvement in performance over the period and performed the best of any group in the final session. This result is consistent with the power law of practice, for which performance improves with continued practice. Of interest were third and fourth groups, each of which were required to perform only three successful readings prior to the final session, but differed in when those were done. One group performed all three readings in the first session (week 1), whereas the other group had the readings spread out over three different sessions, each separated by a week. The former group did not perform any better in the test session than in week 1 and was the worst of the three practice groups in the week 7 test. In contrast, the latter group showed a benefit of the prior practice. This outcome is consistent with the spacing of practice principle, though differences in retention interval preclude a clear attribution of the difference to that factor. The point of these studies is that various aspects of training, including instructional materials and practice schedules, influence users’ performance with biometric devices. This work is only a start of the research that needs to be done to establish the most effective ways to teach people to use various biometric devices.
4 Summary and Conclusions In this paper, we connect cognitive ergonomics to biometrics because prior work in the area of biometric system ergonomic design has tended to consider mainly physical ergonomics and usability. We focused on principles of training and transfer that need to be applied to and evaluated in biometrics to ensure that users know how to interact with biometric devices. Cognitive ergonomics has tended to be left out of biometric considerations, as in the case of the HBSI Evaluation Method (Fig. 3). Thus, future work needs to be done to further examine and revise the HBSI Evaluation Method to include assessment of training and transfer, as well as other cognitive factors that have been shown to affect performance.
References 1. International Organization for Standardization: ISO/IEC JTC1/SC37 Standing Document 2 - Harmonized Biometric Vocabulary. ISO/IEC, Geneva SC37N1779 (2007) 2. Origin, A.: UK Passport Service Biometrics Enrolment Trial (May 25, 2005) 3. Batch, K., Millett, L., Pato, J.: Summary of a Workshop on the Technology, Policy, and Cultural Dimensions of Biometric Systems. National Research Council 0-309-6578t7-3, March 15-16, 2005 (2006)
176
E.P. Kukula and R.W. Proctor
4. Coventry, L., De Angeli, A., Johnson, G.: Usability and biometric verification at the ATM interface. In: Conference on Human Factors in Computing Systems, Ft. Lauderdale, FL (2003) 5. Jain, A., Pankanti, S., Prabhakar, S., Hong, L., Ross, A.: Biometrics: A Grand Challenge. In: 17th International Conference on Pattern Recognition (ICPR 2004), Guildford, UK (2004) 6. Maple, C., Norrington, P.: The Usability and Practicality of Biometric Authentication in the Workplace. In: First International Conference on Availability, Reliability and Security (ARES 2006), Vienna, Austria (2006) 7. Rood, E., Jain, A.: Biometric Research Agenda: Report of the NSF Workshop. National Science Foundation, Morgantown EIA-0240689, April 29-May 2 (2003) 8. Clarke, R.: Human Identification in Information Systems: Management Challenges and Public Policy Issues. Info. Technol. & People 7, 6–37 (1994) 9. Kukula, E.P., Elliott, S.J.: Biometric System Ergonomic Design. In: Li, S. (ed.) Encyclopedia of Biometrics, 1st edn., p. 1000. Springer, Heidelberg (2009) 10. Swinnen, S.P.: Information Feedback for Motor Skill Learning: A Review. In: Zelaznik, H.N. (ed.) Advances in Motor Learning and Control, pp. 37–65. Human Kinetics, Champaign (1996) 11. Schultz, E.E., Proctor, R.W., Lien, M.-C., Salvendy, G.: Usability and Security: An Appraisal of Usability Issues in Information Security Methods. Computers & Security 20, 620–634 (2001) 12. Proctor, R.W., Lien, M.-C., Salvendy, G., Schultz, E.E.: A Task Analysis of Usability in Third-Party Authentication. Information Security Bulletin, 49–56 (April 2000) 13. Coventry, L., De Angeli, A., Johnson, G.: Biometric Verification at a Self Service Interface. In: McCabe, P. (ed.) Contemporary Ergonomics, pp. 247–252. Taylor & Francis, London (2003) 14. Home Office Identity & Passport Service. Publications, vol. 2007 (2007) 15. Kukula, E.P.: Design and Evaluation of the Human-Biometric Sensor Interaction Method. Ph.D. Dissertation, p. 510. Purdue University, West Lafayette (2008) 16. Kukula, E.P., Elliott, S., Duffy, V.: The Effects of Human Interaction on Biometric System Performance. In: 12th International Conference on Human-Computer Interaction and 1st International Conference on Digital-Human Modeling, Beijing, China (2007) 17. Kukula, E.P., Elliott, S., Tamer, S., Senarith, P.: Biometrics and Manufacturing: A Recommendation of Working Height to Optimize Performance of a Hand Geometry Machine. Biometrics Standards, Performance, & Assurance Laboratory, West Lafayette BSPA/09-0001 (2007) 18. Theofanos, M., Orandi, S., Micheals, R., Stanton, B., Zhang, N.: Effects of Scanner Height on Fingerprint Capture. National Institute of Standards and Technology, Gaithersburg NISTIR 7382 (2006) 19. Theofanos, M., Stanton, B., Orandi, S., Micheals, R., Zhang, N.: Usability Testing of TenPrint Fingerprint Capture. NIST, Gaithersburg NISTIR 7403 (2007) 20. Kukula, E.P., Elliott, S., Wolleschensky, L., Parsons, M., Whitaker, M.: Analysis of Performance and Usability of Small-Area and Swipe Fingerprint Sensors Using FTA and FTE. Purdue University (2007) 21. Elliott, S.J., Kukula, E.P., Modi, S.: Issues Involving the Human Biometric Sensor Interface. In: Yanushkevich, S., Wang, P., Gavrilova, M., Srihari, S. (eds.) Image Pattern Recognition: Synthesis and Analysis in Biometrics, pp. 339–363. World Scientific, Singapore (2007)
Human-Biometric Sensor Interaction: Impact of Training
177
22. Frick, M., Modi, S.S., Elliott, S., Kukula, E.P.: Impact of Gender on Fingerprint Recognition Systems. In: Proceedings of the 5th International Conference on Information Technology and Applications, Cairns, Australia (2008) 23. Modi, S., Elliott, S.: Impact of Image Quality on Performance: Comparison of Young and Elderly Fingerprints. In: 6th International Conference on Recent Advances in Soft Computing (RASC 2006), Canterbury, UK (2006) 24. Kukula, E.: Understanding the Impact of the Human-Biometric Sensor Interaction and System Design on Biometric Image Quality. In: NIST Biometric Quality Workshop II, Gaithersburg, MD (2007) 25. Young, M., Elliott, S.J.: Image Quality and Performance Based on Henry Classification and Finger Location. In: IEEE Workshop on Automatic Identification Advanced Technologies, Alghero, Italy (2007) 26. Tayyari, F., Smith, J.: Occupational Ergonomics: Principles and Applications. Kluwer Academic Publishers, Norwell (2003) 27. International Standards Organization: ISO 9241: Ergonomic Requirements for Office Work with Visual Display Terminals (VDTs) - Part 11: Guidance on Usability. ISO, Geneva (1998) 28. International Standards Organization: Information Technology - Biometric Performance Testing and Reporting - Part 1: Principles and Framework," ISO/IEC, Geneva ISO/IEC 19795-1(E) (2006) 29. Yao, M., Pankanti, S., Haas, N.: Fingerprint Quality Assessment. In: Ratha, N., Bolle, R. (eds.) Automatic Fingerprint Recognition Systems, pp. 55–66. Springer, New York (2004) 30. Proctor, R.W., Dutta, A.: Skill Acquisition and Human Performance. Sage, Thousand Oaks (1995) 31. Healy, A.F.: Skill learning, enhancement of. In: Pashler, H. (ed.) Encyclopedia of the Mind. Sage, Thousand Oaks (in press) 32. Wickelgren, W.A.: Trace Resistance and the Decay of Long-Term Memory. J. of Math. Psychol. 9, 418–455 (1972) 33. Carpenter, S.K., Pashler, H., Wixted, J.T., Vul, E.: The Effects of Tests on Learning and Forgetting. Memory & Cognition 36, 438–448 (2008) 34. Vu, K.-P.L., Proctor, R.W., Bhargav-Spanzel, A., Tai, B.-L., Cook, J., Schultz, E.E.: Improving Password Security and Memorability to Protect Personal and Organizational Information. Int. J. of Human-Computer Studies 65, 744–757 (2007) 35. Shepard, R.N.: Toward a Universal Law of Generalization for Psychological Science. Science 237, 1317–1323 (1987) 36. Kukula, E.P., Gresock, B.P., Elliott, S.J., Dunning, N.W.: Defining Habituation using Hand Geometry. In: IEEE Workshop on Automatic Identification Advanced Technologies, Alghero, Italy (2007)
Representing Logical Inference Steps with Digital Circuits Erika Matsak Tallinn University, Department of Computer Science, 25 Narva Road, 10120 Tallinn, Estonia and Tallinn University of Technology, Department of Computer Engineering, Raja 15, 12618 Tallinn, Estonia [email protected]
Abstract. The use of inference steps in natural language reasoning is observed. An algorithm is presented for representing logically correct inference steps with digital circuits. New foundations for creating decision making systems are studied. Keywords: Logical inference steps, logic gates, digital circuits representing logical inference steps.
1 Introduction Many decisions that are required for efficient results with modern systems need to be made without human intervention. For example, driving a Mars rover remotely from Earth is not practical because the sensor information from Mars takes tens of minutes to reach Earth and it takes equally long for the steering commands to reach the rover. Another example would be taking defensive action in case of cyber attacks: a human will not be able to understand the situation and make a (informed) decision in a fraction of a second. Therefore, computers must make these necessary decisions. At the same time we want that the computer-made decisions would be at least as reliable as the one that an intelligent person would make (if he/she would be able to do that). This brings us to the point that the decision making computer must possess logical instruments: logic formulas (for formulating propositions) and logic inference rules (for constructing an argument). A problem in this case is that a number of different logic systems are in use. For example, classical logic is suitable for operating with legal arguments, while intuitionistic logic [16, 17] can be used for structural program synthesis. One of the ways to distinguish the various logic systems is to use inference rules and the corresponding inference steps. In information technology the inference rules (using inference steps to move between formulae) are implemented in software [1, 2]. However, this does not have to be the only viable option. It is not excluded, in principle, that some of the inference steps could be more efficiently implemented at the hardware level. For this we would first need to develop instruments that allow the separation of logical constructs, such as formulas and inference steps, from natural language [6, 10-14]. We could then proceed to implement these constructs with digital circuits using logic gates [5]. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 178–184, 2009. © Springer-Verlag Berlin Heidelberg 2009
Representing Logical Inference Steps with Digital Circuits
179
2 Inference Steps and Implications in Logic Gate Circuits Let us agree that within this paper we rely on the classic bivalent logic and that we will stay in the confines of first-order predicate calculation. In this case we can use the fact that each correct inference step corresponds to a correct implication, which has the conjunction of the premises of the inference step as an antecedent and the formula of the conclusion of the inference step as a result [6]: M P … Q
- inference step,
(1)
R (M&P& … &Q)⊃R - corresponding implication. From this point on the implication representing an inference step will be matched with a two-part digital circuit, where the first part (above the dotted line on drawings) represents the conjunction of the premises of the inference step M&P& ... &Q, and the second part represents the formula R. Note. In bivalent logic the implication can be replaced by the disjunction of the negation of the antecedent and the result (for example, the implication X⊃Y can be replaced with the disjunction ¬X∨Y). We did not use such replacements above! Therefore, for example, the Modus Ponens inference step is not represented with the formula ¬(A&(¬A∨B))∨B, but with a two part circuit, where the first part represents the formula A&(¬A∨B) and the second part represents the formula B. The solution described above allows for representing inference steps with traditional digital circuits composed of three types of logic gate elements: negation, conjunction and disjunction. As explained previously, each circuit is divided into two parts, where the first part represents the list of premises and the second part represents the conclusion formula. The use of the inference step therefore corresponds to moving from the first part of the circuit to the second part. A separate problem in here is creating such circuits as well as suitable visualization software, which was not as simple as it first appeared.
3 An Algorithm for Using Logic Gates to Design a Digital Circuit That Represents Inference Steps While designing a digital circuit we assume that as we move from left to right in the formula all signals must have reached the corresponding gates. In order to guarantee this property, we will change the formula (and sub-formulas) as necessary: − If the formula contains a conjunction that is not in parentheses and immediately before or after it are other operations then the conjunction must be surrounded by parentheses. − For example we replace the formula A ∨ B & C ⊃ D with the formula A ∨ (B & C) ⊃ D − If the formula contains sub-formulas or their negations then we nest the components from left to right in successive parentheses. − For example we replace the formula ¬A & B & ¬C & D with the formula (((¬A & B) & ¬C) & D). We use an analogous process in a formula consisting of only disjunctions. − If conjunctions (disjunctions) contain sub-formulas of various lengths (including negations or “quantifications” of formulas) then we arrange them from left to right by order of decreasing length (number of symbols).
180
E. Matsak
− For example we replace the formula ( Δ ∨ Γ ) & ( ¬Α & Γ ) ∨ ( ( Α & Β ) & Χ ) with the formula ( ( Α & Β ) & Χ ) ∨ ( ¬Α & Γ ) & ( Δ ∨ Γ ). − We replace implications with applicable formulas consisting of negations, conjunctions and disjunctions. For example we replace the formula X⊃Y with the formula ¬X∨Y. − If following the rearrangements there is a negation at the right end of the formula then we surround it with parentheses. For example we replace Δ&¬B with Δ&(¬B). If there are two conjunctions or two disjunctions without parentheses at the right end of the formula, then we surround them with parentheses. For example we replace Δ & A & B with Δ & ( A & B ). Similarly, we replace Δ ∨ A ∨ B with Δ ∨ ( A ∨ B ). − The final change is perhaps the most unusual. We write the negation symbol after the formula in question, not before. For example, we replace ¬C with C¬. The described changes enable the use of the algorithm in Figure 1.
Fig. 1. The algorithm for designing an inference step
Representing Logical Inference Steps with Digital Circuits
181
Using the algorithm in figure 1 we get the following circuit for the Modus Ponens inference step:
Fig. 2. “Digital” Modus Ponens
By introducing the universal quantifier to the rule [3] ( Α(β) & Γ ) ⊃ Δ ( ∀ξ Α(ξ) & Γ ) ⊃ Δ we get the following digital circuit:
Fig. 3. Digital circuit of the univeral quantifier rule (∀+→)
(2)
182
E. Matsak
4 Circuits in Practice The logic module of decision system could consist of the following components: − a binary matrix of notation-denotation (symbol-meaning) relations, where rows represent notation (symbols, signs) and columns represent denotation (meaning). The intersections contain markers (for example 1 or 0) that indicate that the corresponding notation applies to the denotation (or not). It is important to remember, that according to Lorents [7-9] some notations may have multiple denotations, and some denotations may have multiple notations; − the set of correct formulas; − the set of inference rules. Before implementing the inference steps by using digital circuits, the data in the role of predicates must be inserted. In order to achieve this, the relation between formulas and digital logic gates must be established. Since classically there are two possible truth values 1 and 0 (or true and false) and each logic gate also has two values 1 and 0 (or High Voltage (+5V) and Low Voltage (0V)), then it is natural to connect the gates in a way that correct atomal formulas are represented by the signal “1”. Non-atomal formulas should be treated in the following way: − Identify the part of the circuit that corresponds to the non-atomal formula in question; − Identify the input points (corresponding to the atomal formulas) for that specific circuit part; − Identify an input signal combination for the above input gates that produces “1” as an output for that circuit part. This way we can provide the necessary input signals to the (upper) part of digital circuits, which corresponds to the predicates of the inference step. The construction of decision may take the simple form of “fitting” puzzle pieces, where the “suitable” premise set of an inference rule allows the rule to be matched to a combination of existing formulas that normally do not involve more than a few formulas.
5 Advantages of the Proposed Circuits While creating decision making systems (that are based on, for example, binary decision diagrams (BDD), negation normal form (NNF), propositional directed asyclic graph (PDAG), etc.) data structures related to Boolean functions are often used. The logical operations used to form decisions are simple: AND, OR, NOT. In recent years, several problems have surfaced in solutions relying on neural networks or graphs. This does not mean that these methods should be cast aside (for example, neural networks have advantages in modeling non-linear characteristics of sample data – [4]). However, systems based on implementing inference steps with digital circuits also have advantages. One source of these advantages is the ability to include “regular” operations (AND, OR, NOT), as well as other operations (implication, etc.) and quantifiers. Second and more important advantage is the possibility to notably
Representing Logical Inference Steps with Digital Circuits
183
“shorten” the decision making process (it is well known from logic studies that manipulating with the rules may sometimes allow an exponential (!) decrease in the number of inference steps).
6 Conclusion The described digital circuits consisting of logic gates are not the only way to represent inference steps. In principle, using special transformations one could implement them in neural networks [15] or other circuits. The important part here is how to implement logical inference steps in hardware based on the logical constructs extracted from natural language. It is possible that a similar implementation is present in the human brain, which allows us to use logical constructs, including the ability to formulate propositions and to come up with the correct conclusion. Acknowledgements. The author of the given work expresses profound gratitude to professor Peeter Lorents for assistance in a writing of given clause and to Rain Ottis for English version edition.
References 1. Chang, C., Lee, R.: Symbolic logic and mechanical theorem proving. Academic Press, New York (1973) 2. Fitting, M.: First-Order Logic and Automated Theorem Proving, 2nd edn. Springer, Heidelberg (1996) 3. Gentzen, G.: Die Widerspruchsfreiheit der reinen Zahlentheorie. Mathematische Annalen 112, 493–565 (1936) 4. Kim, D., Lee, J.: Rule Reduction over Numerical Attributes in Decision Trees Using Multilayer Perceptron. In: Cheung, D., Williams, G.J., Li, Q. (eds.) PAKDD 2001. LNCS, vol. 2035, p. 538. Springer, Heidelberg (2001) 5. Kunz, W., Stoffel, D.: Reasoning in Boolean Networks: Logic Synthesis and Verification Using Testin Techniques. Kluwer Academic Publishers, Dordrecht (1997) 6. Lorents, P.: Language and logic. EBS Print, Tallinn (2000) 7. Lorents, P.: Formalization of data and knowledge based on the fundamental notationdenotation relation. In: Proceedings of the International Conference on Artificial Intelligence, ICAI 2001, vol. III, pp. 1297–1301 (2001) 8. Lorents, P.: Knowledge and understanding. In: Proceedings of the International Conference on Artificial Intelligence, ICAI 2004, vol. I, pp. 333–337 (2004) 9. Lorents, P.: Taxonomy of intellect. In: Proceedings of the International Conference on Artificial Intelligence, ICAI 2008, vol. II, pp. 537–544 (2008) 10. Matsak, E.: Dialogue system for extracting Logic constructions in natural language texts. In: Proceedings of the International Conference on Artificial Intelligence, ICAI 2005, vol. II, pp. 791–797 (2005) 11. Matsak, E.: Using Natural Language Dialog System DST for Discovery of Logical Constructions of Children’s Speech. In: The 2006 International Conference on Artificial Intelligence, ICAI 2006, Las Vegas, Nevada, USA (2006)
184
E. Matsak
12. Matsak, E.: System DST for Transforming Natural Language Texts, Representing Estimates and Higher Order Predicates and Functionals. In: The 3rd International Conference on Cybernetics and Information Technologies, Systems and Applications: CITSA 2006, Orlando, Florida, USA (2006) 13. Matsak, E.: The prototype of system for discovering of inference rules. In: Proceedings of the International Conference on Artificial Intelligence. International Conference on Artificial Intelligence, ICAI 2007, vol. II, pp. 489–492 (2007) 14. Matsak, E.: Improved version of the Natural Language Dialog System DST and its application for discovery of logical constructions in children’s speech. In: International Conference on Artificial Intelligence, ICAI 2008, vol. I, pp. 332–338 (2008) 15. Minsky, M.: Finite and Infinite machines. Prentice-Hall, Inc., Englewood Cliffs (1967) 16. Mints, G., Tyugu, E.: Justification of the structural synthesis of programs. Science of computer programming 2(3), 215–240 (1982) 17. Mints, G., Tyugu, E.: The programming system PRIZ. Journal of Symbolic Computation (4) (1987)
An Interactive-Content Technique Based Approach to Generating Personalized Advertisement for Privacy Protection Wook-Hee Min and Yun-Gyung Cheong Graphics&OS Group, Samsung Advanced Institute of Technology Giheung-Gu, Gyeonggi-Do, South Korea {wookhee.min,yuna.cheong}@samsung.com
Abstract. Personalized contents have been getting more attention from industry and academia due to its effective communicative role in product advertisements. However, there exist potential threats to the customer’s privacy in conventional approaches where a data server containing customer profiles is employed or the customer profiles is required to be sent over the public network. To address this, this paper describes a framework that employs a script-based interactive content technique for privacy protection. We illustrate our approach by a sample scenario. Keywords: Privacy, Interactive content, Personalized advertising.
1 Introduction While traditional media (e.g., TV, radio station, newspaper, billboards) advertise products and services to people non-selectively, sponsors are getting more interested in personalized advertisements that present products and services for their prospective customers. Personalized advertisements also have drawn more attentions from researchers in multimedia, e-commerce, and AI because contents and presentations that are tailored to an individual’s preference tend to attract her attention. In a conventional approach for the provision of personalized contents, the service framework either contains a server that keeps track of the customer’s preferences and interactions (e.g., web page visits, search keywords, shopping transactions) or requires that the customer device (e.g., mobile handsets, web browsers, IPTV) send her personal information over the public network in order to select advertisements pertinent to her [1, 3, 9, 12]. These approaches, however, have potential threats to the customer’s privacy. For instance, the customer’s personal information could be disclosed in the process of collecting and managing his profile in a system that employs a server storing user profiles; if the system is violated, the privacy of thousands of customers will be threatened, unfortunately. In this system, additionally, while the user profile is sent to a server over a network, the network shall be guaranteed to be secure. To address this privacy related issues, conventional approaches to generating personalized commercials for privacy protection have focused on data management, M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 185–191, 2009. © Springer-Verlag Berlin Heidelberg 2009
186
W.-H. Min and Y.-G. Cheong
data exchange protocol and security. For example, a server and a client define a privacy policy respectively and the user is asked if he consents the policy provided by the server when the two policies do not match [14]. In anonymous communication approaches, a random number is assigned to each user in order to remove his identifying information, and thus preventing his privacy from being disclosed. [7, 18] As an online practice for this approach, Phorm developed an online advertising system that provides relevant ads for internet users based on keywords acquired from a combination of search terms, URLs and contextual page analysis, etc without infringing their privacies [13]. This system anonymises the users by assigning a unique random number to each user and by incinerating the user’s web surfing traces as it extracts keywords (e.g., cameras, autos, etc.) of products or services that would interest the user. These keywords are kept until appropriate advertising channels for a user are found and their advertisements are delivered to the user. Additionally, Phorm allows users to switch this advertising service on or off at any time while most advertising companies deliver advertisements regardless of users’ preference. Unlike other conventional approaches, our work is closely related to interactive contents structure and script-based graphics that realize 3D animation in real-time. Interactive content unfolds differently as it interacts with the user. There are two primary approaches to representing interactive contents (or stories), branching graphs and planning techniques. In branching graph approaches, interactive contents comprise a series of nodes and conditional branches; a node describes a unit content and a conditional branch refers to a transition from a node to another that is carried out when user inputs and/or story states meet pre-defined logical statements [4, 5, 6, 15, 16]. In the planning formalism, a content plot is constructed as the planner algorithm generates links between unit contents considering users’ interaction, and preconditions and postconditions of the unit contents. In this paper, we present a framework that employs a script-based interactive content technique [2, 6, 8, 10, 17] which can provide personalized advertisements for users without compromising their privacy. The next section details our work followed by a simple example which illustrates personalized commercial generation. In the final section, we conclude this paper by discussing the impact of our research and plan for future work.
2 A Framework for Generating Personalized Contents This section describes our framework that generates personalized advertisement without exchanging the customer’s personal information or her web surfing activities. When a request for a personalized commercial of a product is issued, the system sends entire interactive contents containing complete commercials that would cover all types of prospective customers to the user-side device so that the device can locally determine appropriate contents for the user. One major challenge of this approach is the large data volume transmitted on limited network resources, especially in wireless channels. To address this, our approach employs a script-based 3D graphic engine that converts text into 3D animation [2, 6, 8, 10, 17], as detailed below.
An Interactive-Content Technique Based Approach
187
Fig. 1. A Framework for privacy-safe personalized advertisement
Our framework consists of a server and a user-device (i.e., client) as in Figure 1. When the user asks for content (e.g., an advertisement for a product), the user device sends the request (e.g., a text such as vacuum cleaner) to the server. The server then looks up the content database seeking for an interactive content corresponding to the advertisements for the product, and it sends the interactive content back to the user device over the network. Upon receiving the interactive content from the server, the user device realizes the content as a 3D animation on the device which consists of a rendering module, a branching manager, a planner and a user profile. While producing a 3D animation, our approach achieves to generate a personalized content in a secure manner. Since a branching manager and a planner determine the next node (i.e., unit content) to be presented to the user as they consult with the user profile and then the rendering module realizes each node into an animation, a content can be displayed non-identically but in even more appealing way according to users; here, the user model could include a variety information from relatively fixed personal information such as age, gender and address to changing and complicated information such as the user’s current location or life style. In addition to the matter of personalized advertising, the user profile is stored in the user device and is disclosed outside on no occasion, thereby guaranteeing users’ privacy to be protected. These node selection and realization phases iterate until the last node of the interactive content structure is finally rendered. To minimize the data volume communicated over the network, we utilize a text-based script to represent the interactive content. More details on our script-based interactive-content authoring tool and player which employ the TVML (TV program Making Language) technique as its framework can be found in Cheong et al. [2]. The client device also has a user profile manager that enables a user profile to be updated consistently with detailed version by information induced from analysis on a user’s life pattern and viewing habit, environmental data surrounding a user, etc. A user’s habit to viewing advertisements, for example, could be categorized into one of three propensity: indifferent, greedy or selective; to bypass most of advertisements means that the user is probably indifferent to advertisements and thus the user profile manager can update the value on the corresponding field (e.g., user’s propensity to advertisements) in that user profile.
188
W.-H. Min and Y.-G. Cheong
The process of presenting advertisements with our approach guarantees advertisements to be customized for each device owner and, at the same time, prevents an intrusion of user privacy by preserving the user model in the user-side device. The system, also, continues gathering a series of users’ behaviors and updating the user model based on the analysis about them, thus we expect each user to have a stronger interest in an advertisement than the user would have with advertisements made only with the fixed information.
3 A Simple Example In this section, we deal with an example for our framework and describe how a personalized advertisement could be generated without harming one’s privacy. Figure 2 shows a sample advertisement which is made up with an interactive content structure proposed in Cheong et al. [2, 11], and table 1 describes two user profiles that could be applied to the sample advertisement in figure 2.
.. .
Fig. 2. Sample interactive content for a vacuuming robot advertisement
The nodes in the graph of the figure 2 constitute a sequence of actions, and the branches structure the multi-story line by integrating nodes with events which represents a transition between a pair of nodes. While an event in a conventional interactive content system corresponds to a user input such as mouse movement or text typing, our approach utilizes a user model (e.g., the target user’s profile) as well as the conventional events in order to determine the unit content to be presented in the next sequence.
An Interactive-Content Technique Based Approach
189
Table 1. Sample user profiles for the interactive content described in figure 2
Field name
User profile 1
User profile 2
Name Gender Address Marriage Children Pet Job Current Location
Wooky, Min M San Monica, CA, USA N/A None Cat N/A Town and Country Resort & Convention Center, San Diego, CA, USA
Rita, Lee F Chicago, IL, USA Y 3 year-old baby None Computer Scientist N/A
Figure 2 describes an interactive content for the advertisement of vacuuming robot products. The initial node N1 begins with a voice introduction of a vacuum cleaning robot. On the completion of N1, the system checks if the device owner has a pet by referencing his user profile stored in the device; in the case of a user who corresponds to the user profile 1, an animation that the robot cleans up the pet’s hairs scattered on the floor can be shown to the user (as textually described in N2). A user whose information constitutes the user profile 2, on the other hand, would experience N3 which illustrates a child dropping her cranberry juice on a carpet followed by the vacuum machine removing the stain. The rest of this section discusses an advertising scenario when the user profile 1 is employed. When the presentation of N2 is completed, the system tests the user’s residential district to determine the neighborhood and cultural environment with which the user would feel familiar (e.g., background setting in the advertisement). For instance, a resident in an urban community may prefer an episode in a busy town. This data can be reused for selecting the final node which contains the direction to the nearest store from the user’s place. In case where the user actively tries to check out other aspects of the products which are not explained in the main plot of an advertisement, we define global content units (N31 and N32 in the Figure 2) that can be accessed in response to the user’s input. Since these nodes do not have any incoming or outgoing branches, they are presented to the user only when he directly inquires through an input device such text typing or mouse click. For instance, if he touches a button labeled “specification” in the middle of watching the advertisement, the product specification will be shown to him before the next content unit is presented. More details on managing main plot and global units are explained in Cheong et al. [2, 11].
4 Conclusion In conclusion, we present a personalized advertisement generation approach that protects the target user’s privacy by the use of interactive content techniques. Unlike other conventional approaches, our approach creates personalized advertising contents without exchanging the user’s private information on the communication channel.
190
W.-H. Min and Y.-G. Cheong
Instead, we send an interactive content structure that contains the entire advertisement scenarios to the user device; then the device is responsible for selecting and rendering some of the contents that are appropriate to the user model on the device. Since there is an issue regarding data volume in transmitting the whole content structure as 3D raw images, we also give a brief introduction of our framework that employs a text-based approach in representing 3D animation thereby minimizing the data transmission cost. Up to this point, we have implemented a text-based 3D animation toolkit, which enables users to describe a story in a script format and realizes it into a 3D animation. Our future work is to augment the functionalities of the toolkit to the extent that it supports authoring and rendering interactive contents so that it can facilitate to create and present personalized advertisements and to conduct formal evaluation of our framework.
References 1. Bozios, T., Lekakos, G., Skoularidou, V., Chorianopoulos, K.: Advanced Techniques for Personalized Advertising in a Digital TV Environment: The iMEDIA System. In: Proceedings of the 2001 eBusiness and eWork Conference, Venice, Italy, pp. 1025–1031 (2001) 2. Cheong, Y.-G., Kim, Y.-J., Min, W.-H., Shim, E.-S., Kim, J.-Y.: PRISM: A Framework for Authoring Interactive Narratives. In: Interactive Storytelling 2008, pp. 26–29, Erfurt, Germany (2008) 3. Chorianopoulos, K., Lekakos, G., Spinellis, D.: Intelligent user interfaces in the living room: usability design for personalized television applications. In: Proceedings of the 8th international conference on Intelligent user interfaces, Miami, Florida, USA, pp. 230–232 (2003) 4. INSCAPE (2008), http://www.inscapers.com 5. Iurgel, I.: From Another Point of View: ArtEFact. In: Göbel, S., et al. (eds.) TIDSE 2004. LNCS, vol. 3105, pp. 26–35. Springer, Heidelberg (2004) 6. Kelso, M.T., Weyhrauch, P., Bates, J.: Dramatic Presence. The Journal of Teleoperators and Virtual Environments 2(1), 1–15 (1993) 7. Lucent Personalized Web Assistant, http://www.lpwa.com/ 8. Magerko, B.: Story Representation and Interactive Drama. In: Proceedings of the 1st Annual Conference on Artificial Intelligence and Interactive Digital Entertainment. AAAI Press, Marina del Rey (2005) 9. Langheinrich1, M., Nakamura, A., Abe, N., Kamba, T., Koseki, Y.: Unintrusive Customization Techniques for Web Advertising. In: WWW 1999: Proceeding of the eighth international conference on World Wide Web, New York, USA, pp. 1259–1272 (1999) 10. Mateas, M., Stern, A.: Structuring Content in the Façade Interactive Drama Architecture. In: Proceedings of the 1st Annual Conference on Artificial Intelligence and Interactive Digital Entertainment, pp. 93–98. AAAI Press, Marina del Rey (2005) 11. Min, W.H., Shim, E.S., Kim, Y.J., Cheong, Y.G.: Planning-integrated story graph for interactive narratives. In: Proceeding of the 2nd ACM international workshop on Story representation, mechanism and context, Vancouver, British Columbia, Canada, pp. 27–32 (2008) 12. Otsuka, T., Onozawa, A.: Personal Information Market: Toward a Secure and Efficient Trade of Privacy. In: Kim, W., Ling, T.-W., Lee, Y.-J., Park, S.-S. (eds.) Human. Society. Internet 2001, vol. 2105, p. 151. Springer, Heidelberg (2001)
An Interactive-Content Technique Based Approach
191
13. Phorm, Inc., http://www.phorm.com/ 14. Platform for Privacy Preferences (P3P), http://www.w3.org/P3P/ 15. Spierling, U., Weiß, S.A., Müller, W.: Towards Accessible Authoring Tools for Interactive Storytelling. In: Göbel, S., Malkewitz, R., Iurgel, I. (eds.) TIDSE 2006. LNCS, vol. 4326, pp. 169–180. Springer, Heidelberg (2006) 16. Swartout, W., Hill, R., Gratch, J., Johnson, W.L., Kyriakakis, C., LaBore, C., Lindheim, R., Marsella, S., Miraglia, D., Moore, B., Morie, J., Rickel, J., Thiébaux, M., Tuch, L., Whitney, R., Douglas, J.: Toward the holodeck: integrating graphics, sound, character and story. In: 5th international conference on Autonomous agents, Montreal, Quebec, Canada, pp. 409–416 (2001) 17. Young, R.M., Riedl, M.O., Branly, M., Jhala, A., Martin, R.J., Saretto, C.J.: An Architecture for Integrating Plan-based Behavior Generation with Interactive Game Environments. Journal of Game Development 1(1), 51–70 (2004) 18. Zero-Knowledge System, Inc., http://www.freedom.net/
Loopo: Integrated Text Miner for FACT-Graph-Based Trend Analysis Ryosuke Saga1, Hiroshi Tsuji2, and Kuniaki Tabata1 1
Kanagawa Institute of Technology, School of Information Technology, 1030 Shimo-ogino, Atsugi, Kanagawa, 243-0292, Japan 2 Osaka Prefecture University, Graduate School of Engineering, 1-1 Gakuen-cho, Nakaku, Sakai, 559-8531, Japan {saga,tabata}@ic.kanagawa-it.ac.jp, [email protected]
Abstract. This paper proposes an integrated tool to analyze trend visualization graph called “FACT-Graph”. FACT-Graph is generated from text data with time stamp and is useful for trend analysis. However, it faces three key problems: First, it is difficult to configure parameters (such as analysis span, exceptive keywords and thresholds) to generate FACT-Graph; Second, a FACT-Graph does not provide the required information and interface for trend analysis because the process of generating the FACT-Graph eliminates that information; and third, it cannot reflect a user’s awareness in a FACT-Graph. In order to solve these problems, the authors have developed a tool called “Loopo”. Loopo integrates a term database, analysis components, and a graphdrawing function and provides users (i.e., analyzers) with information for trend analysis. Loopo also provides an interactive GUI for configuring parameters at ease and to reflect a user’s awareness in a FACT-Graph instantly. Keywords: Keyword Visualization, Trend Analysis, Co-occurrence graph, Analysis Tool.
1 Introduction The application and utilization of information has become a vital service as the volume of information stored in companies and organizations increases. Such information includes records such as POS data and access logs as well as text data such as questionnaires and reports. This information is stored in a “data warehouse”, and data mining and text mining are applied to it in order to discover useful knowledge [1]. The researched of text mining cover a wide range of areas, for example, keywords extraction, summarization, visualization [2,3]. Especially for the text mining using time-series text data, we developed a visualization technique called FACT-Graph to analyze trends [4]. FACT-Graph extracts keywords from time-series text data and visualizes trends by co-occurrence graph based on the change of attributes. Using a FACT-Graph, we can get macro trends and topics that consist of plural keywords. The usefulness of analysis by FACT-Graph is confirmed in several references [4,5]. To comprehend a FACT-Graph, the user (i.e., analyzer) is shown clues regarding trends from keywords that look important to them. However, FACT-Graph itself doesn't M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 192–200, 2009. © Springer-Verlag Berlin Heidelberg 2009
Loopo: Integrated Text Miner for FACT-Graph-Based Trend Analysis
193
have concern information such as parameters and user interface to analyze trends. It is also a problem to reflect an analyzer’s awareness in FACT-Graph. This is a barrier to use of FACT-Graph. In light of the above-described issues, the authors have developed integrated software that provides an environment for analysis of a FACT-Graph. This software allows analyzers (called “users” for convenience) users to carry out trial-and-error for trend analysis at ease.
2 FACT-Graph 2.1 Concepts and Architecture A FACT-Graph visualizes the change of keywords trend between two time periods as co-occurrence graph (Figure 1). It treats time-series text data and shows the change between categories provided a certain time period is regarded as a category. One of the components of a FACT-Graph is class transition analysis which separates keywords into four classes based on Term Frequency (TF) and Document Frequency (DF) shown in Table 1, and shows the transition of keyword between two time-periods (Table 2). For example, if a term belongs to Class A in a certain time period and moves into Class D in next time period, then the trend regarding that term is referred to as “fadeout”. FACT-Graph identifies these trends by node’s color.
Fig. 1. FACT-Graph on Front-Page Articles in Japanese newspaper (Jul. 1998 - Aug. 1998, Keywords: 30, TF: 45, DF: 30, Simpson: 0.5) [3]
194
R. Saga, H. Tsuji, and K. Tabata Table 1. Keyword Class based on TF and DF DF High
Low
High
Class A (Major Word)
Class C (Domain Word)
Low
Class B (Complementary Word)
Class D (Minor Word)
TF
Table 2. Transition of Keyword Class
Before
A B C D
A Hot Common Broaden New
After B C Cooling Bipolar Universal Locally Active Widely New Locally New
D Fade Fade Fade Negligible
Fig. 2. Process of generating FACT-Graph
Additionally, a FACT-Graph visualizes keywords and relationships between keywords by using co-occurrence information. As a result, useful keywords can be obtained from their relationship with other keywords, even though that keyword does not seem to be important at a glance, and the user can extract such keywords by using FACT-Graph. Moreover, from the result of the class-transition analysis, the user can comprehend trends in keywords and in topics (consisting of several keywords) by FACT-Graph. The steps for generating a FACT-Graph are as follows shown in Figure 2: 1. 2. 3. 4.
Separate time-series text data according to the analysis periods Extract keywords in each period by morphological analysis and TF-IDF algorithm [7] Carry out class transition analysis and extract co-occurrence relations. Visualize keywords and relations.
Loopo: Integrated Text Miner for FACT-Graph-Based Trend Analysis
195
Fig. 3. Layered architecture of FACT-Graph
A FACT-Graph is composed of three factors: time, keywords, and a co-occurrence network. The user of a FACT-Graph configures several parameters related to these factors such as analysis period, filtering keywords, and threshold of co-occurrence. The software structure of FACT-Graph is shown schematically in Figure 3. The FACT-Graph consists of several components, namely, keywords extraction, class transition analysis, co-occurrence calculation, graph renderer, and a term database. Each component is highly independent (i.e., only loosely coupled to the others). For example, references [4] and [5] use Graphviz for rendering and MeCab1 for keywords extraction [8]. The components do not share information about keywords and cooccurrence relations. 2.2 Problem of Analysis by FACT-Graph Analysis by FACT-Graph necessitates generating FACT-Graph and setting of parameters. Accordingly, the following problems regarding the analysis must be solved. − Parameter setting The user has to configure certain parameters in order to analyze trends by FACTGraph. The user is forced into using trial-and-error method, so the cost of analysis increases. However, the components of FACT-Graph are so highly independent that there is troublesome for the user to configure each parameter of each component. This also raises the problem that it is difficult for the user to manage parameters consistently. − Information reference and interface for analysis Keywords as well as relations change according to analysis period. By analyzing trends from keywords and relations shown in FACT-Graph, the user checks important keywords, and comprehends implied trends in information source such as the original text. 1
MeCab, http://mecab.sourceforge.net/
196
R. Saga, H. Tsuji, and K. Tabata
Reference of the information source is useful for the analysis of trends. However, it takes a lot of effort to refer to the information about the keywords and relations in FACT-Graph. The keywords and relations in a FACT-Graph are shown as a static image. The effectiveness of a FACT-Graph is therefore governed by the loss of links to the information source, so the user cannot access the information directly from the FACT-Graph. Another problem is that multiple FACT-Graphs do not share graph information. For example, information about positions of keywords is shown as nodes in a FACTGraph. However, a FACT-Graph itself does not contain the information about positions of nodes. As a result, even if user analyzes same keywords in two different FACT-Graphs, their positions are changed. This results the problem of understanding trend in noteworthy keywords over periods. In order to solve these problems simply, FACT-Graph has to keep and share information between two periods. However, a FACT-Graph consists of the loosely coupled software shown in Figure 3. It is good a flexibility handling but not so good at collaborative performance. As a result, the components do not share information about keywords and co-occurrence, and a FACT-Graph cannot be linked with that information (that is, nodes to keywords and links to co-occurrence). it is therefore difficult to refer to these clues seamlessly in order to analyze a FACT-Graph. − Awareness in analysis The user analyzes a FACT-Graph as he considers it and gets the idea. They may find out and come up with new awareness in the course of analysis. Also, the user may want to analyze keywords which appear to fadeout words from FACT-Graph. It is important to implement a function to reflect the awareness based on subjectivity in knowledge discovery and knowledge acquisition [9]. In order to reflect the user’s awareness, the user needs to configure parameters. However, it is troublesome for the user to achieve it. For example, keywords shown in FACT-Graph are extracted by TF-IDF algorithm. TF-IDF algorithm is based on TF and DF which are also used for the thresholds whether a FACT-Graph uses a term as a keyword. So it is difficult to appear only one remarkable keyword which user wants to survey because of difficulty of parameters setting. These three above problems may become a barrier to analyzing a FACT-Graph. In light of the above-described problems, we have developed software based on the following requirements: − Information must be shared among components and be managed consistently. − A graphical user interface (GUI) for ease of reference to information (such as keywords and co-occurrence) must be supported. − A user must be able to operate FACT-Graph itself. − The software must reflect the user’s awareness in FACT-Graph immediately. In this paper, the operation of FACT-Graph is restricted to moving, fixing, and holding nodes (that is, keywords). Moreover, a keyword is regarded as a word that reflects awareness, and the software can add a certain keyword and its relations to the FACT-Graph immediately.
Loopo: Integrated Text Miner for FACT-Graph-Based Trend Analysis
197
3 Loopo 3.1 Overview of Loopo In order to satisfy the requirements outlined in Chapter 2, the authors have developed software called “Loopo”. Loopo is software to improve analysis by FACT-Graph. Loopo generates FACTGraph based on the parameters (such as keywords threshold, analysis period), which Loopo can configure easily. Figure 4 is a screenshot that Loopo draws FACT-Graph from certain text data. Loopo consists of four windows: “FACT-Graph View,” which shows and operates the FACT-Graph itself; “Keyword Manager,” which manages keywords; “Time Manager,” which manages information and parameters concerning analysis periods; and “GraphInfo,” which shows and manages parameters concerning the network of the FACT-Graph. Several parameters such as keywords setting, analysis periods can be configured from these windows and the parameters are shared by the windows during multiple analysis periods. The analysis by Loopo starts with the import of time-series text data. After importing text data separated according to analysis period, Loopo carries out morphological analysis, keyword filtering, and several initial setting steps along with the process of generating FACT-Graph. Also, Loopo can also export an image of a FACT-Graph drawn in FACT-Graph View. FACT-Graph View. FACT-Graph View shows the analysis results for the text data which is imported to Loopo as FACT-Graph. The user can move, clear and fix keywords for trend analysis easily via the window. For example, the “fixing keyword” function is used to fix the locations of noteworthy keywords between multiple analysis periods. The user can therefore browse through remarkable keywords and their related keywords over the periods at ease. FACT-Graph View also allows the user to refer to original text data from remarkable keywords and helps them to comprehend macro/micro trends. Time Manager. It is important to configure time period for time-series analysis. Usually, the number of articles is shown as a clue of setting of time periods. By displaying the trend in article volume as a chart, Time Manager helps the user configure the parameter concerning analysis period. The window indicates how the time periods are divided up for analyzing a FACT-Graph (which is output according to the time periods). Time Manager also has a function for setting time periods forward or backward. With this function, the user can view a series of FACT-Graphs via FACT-Graph View along with the change of time period. Keyword Manager. Keyword Manager is the window for listing and managing the keywords currently shown in a FACT-Graph. The user can add and delete keywords, and refer to the original text data from a keyword via Keyword Manager or FACTGraph View. As a result, the window can reflect the user’s awareness in FACTGraph. The user can also configure the parameter, such as thresholds, concerning keyword extraction.
198
R. Saga, H. Tsuji, and K. Tabata
GraphInfo. One of the measures for identifying whether a FACT-Graph is meaningful is network information such as network size and density. GraphInfo shows the network information about FACT-Graph. GraphInfo shows network size, density, and the type of links as an overview of a FACT-Graph. It also shows several centralities such as betweenness centrality and closeness centrality when user selects a node of interest via FACT-Graph View [10]. Moreover, GraphInfo allows the user to change co-occurrence type and thresholds of co-occurrence.
Time Manager FACT-Graph view
Keyword Manager
Graph Info
Fig. 4. Screenshot of Loopo
Fig. 5. Software structure of Loopo
Loopo: Integrated Text Miner for FACT-Graph-Based Trend Analysis
199
3.2 Architecture The software architecture of Loopo is shown schematically in Figure 5. Loopo has four databases concerning network information, parameters, original text data, keywords, and 3 component concerning keyword extraction, class transition, and cooccurrence analysis. It also provided four windows, namely, FACT-Graph View, Time Manager, Keyword Manager, and GraphInfo as user interfaces. Each window (in front end) is operated by user and has a relation to all of the databases. The network-information database is related with and GraphInfo. The textdata and keyword databases are related to Keyword Manager and FACT-Graph View to allow the original text data to be referred to from remarkable keywords and enable operations such as addition and deletion of keywords. The parameter database is related to all windows because each window provides the functions of configuring parameters. For keyword extraction (in back end), Loopo adopts the TF-IDF algorithm [11] of Harman. TF-IDF algorithm calculates the weight of terms based on TF and DF, and Top n weights are regarded as keywords in time period. The value of n is one of the parameters to generate a FACT-Graph and is configured by Loopo. For all databases, SQLite2 is adopted in consideration of ease of installation. For rendering a FACT-Graph, Loopo uses the popular drawing algorithm “Spring Model” of Kameda et al. [12].
4 Discussion Loopo was developed as a mining support tool for analyzing trends. There are many methods concerning visualization such as multi-dimensional scaling and selforganization maps as same as FACT-Graph. However, there are not many tools for mining support. Polaris is one analysis tools [13]. It was developed for easy analysis of “chance discovery” by KeyGraph [14]. The concept of Loopo is similar for that of Polaris. However, Loopo is used for trend analysis, so the goal of Loopo is different from Polaris. Loopo was also developed on the assumption that an inexperienced user is analyzing a FACT-Graph. If the user has data for FACT-Graph, Loopo outputs FACT-Graph for the moment and can provide an opportunity for analyzing a FACTGraph. It is also assumed that even a user unfamiliar with FACT-Graph in detail can carry out simple analysis of trends by FACT-Graph. One of the other problems concerning FACT-Graph itself is that there is no systematic methodology for analyzing a FACT-Graph. Moreover, the results of trend analysis, which are derived from individual subjectivity, are often shared with other people. We consider that these problems can be solved by the functions of information-sharing tools (such as whiteboard and memo) and a wizard (which guides analysis process). These implementations are future works.
5 Conclusion This paper has described a tool called Loopo for analyzing trends from a FACTGraph. In analysis of FACT-Graph, we have discussed problems concerning 2
http://www.sqlite.org
200
R. Saga, H. Tsuji, and K. Tabata
parameter setting, information reference and interface, and reflection of awareness. To resolve these problems, GUI-based software which manages essential parameters via for windows (FACT-Graph View, Time Manager, Keyword Manager, and GraphInfo) has been developed.
References 1. Inmon, W.H.: Building the Data Warehouse. Wiley Publishing, Inc., Chichester (2005) 2. Nanba, H., Okuda, N., Okumura, M.: Extraction and Visualization of Trend Information from Newspaper Articles and Blogs. In: Proceedings of the 6th NTCIR Workshop, pp. 243–248 (2007) 3. Yamanishi, K., Li, H.: Mining Open Answers in Questionnaire Data. IEEE Intelligent Systems 17(5), 58–64 (2002) 4. Saga, R., Terachi, M., Sheng, Z., Tsuji, H.: FACT-Graph: Trend Visualization by Frequency and Co-occurrence. In: Dengel, A.R., Berns, K., Breuel, T.M., Bomarius, F., Roth-Berghofer, T.R. (eds.) KI 2008. LNCS (LNAI), vol. 5243, pp. 308–315. Springer, Heidelberg (2008) 5. Terachi, M., Saga, R., Sheng, Z., Tsuji, H.: Visualized Technique for Trend Analysis of News Articles. In: Nguyen, N.T., Borzemski, L., Grzech, A., Ali, M. (eds.) IEA/AIE 2008. LNCS (LNAI), vol. 5027, pp. 659–668. Springer, Heidelberg (2008) 6. Terachi, M., Saga, R., and Tsuji, H.: Trends Recognition in Journal Papers by Text Mining. In: Proceedings of IEEE International Conference on Systems, Man & Cybernetics (IEEE/SMC 2006), pp. 4784–4789 (2006) 7. Salton, G.: Automatic Text Processing. Addison-Wesley Publishing Company, Reading (1989) 8. Ellson, J., Gansner, E.R., Koutsofios, E., North, S.C., Woodhull, G.: Graphviz - open source graph drawing tools. Graph Drawing, 483–484 (2001) 9. Tabata, K., Mitsumori, S.: An assertion-based information-probe system: Documentskeleton and glossary-skeleton approach. Information, Knowledge, and Systems Management 3(4), 123–152 (2003) 10. Freeman, L.C.: Centrality in social networks: Conceptual clarification. Social Networks 1(3), 215–239 (1979) 11. Harman, D.: Ranking algorithms. In: Information Retrieval, ch.14. Prentice Hall, Englewood Cliffs (1992) 12. Kamada, T., Kawai, S.: An algorithm for drawing general undirected graphs. Information Processing Letters 31(1), 7–15 (1989) 13. Okazaki, N., Ohsawa, Y.: Polaris: An Integrated Data Miner for Chance Discovery. In: Proceedings of Workshop of Chance Discovery and Its Management (in conjunction with International Human Conputer Interaction Conference (HCI 2003), Crete, Greece (2003) 14. Ohsawa, Y., Benson, N.E., Yachida, M.: KeyGraph: Automatic Indexing by Segmenting and Unifing Co-occurrence Graphs. IEICE D-I J82-D-I(2), 391–400 (1999)
Using Graphical Models for an Intelligent Mixed-Initiative Dialog Management System Stefan Schwärzler, Günther Ruske, Frank Wallhoff, and Gerhard Rigoll Institute for Human-Machine Communication Technische Universität München 80290 Munich, Germany {sts,rus,waf,ri}@mmk.ei.tum.de
Abstract. The main goal of dialog management is to provide all information needed to perform e. g. a SQL-query, a navigation task, etc. Two principal approaches for dialog management systems exist: system directed ones and mixed-initiative ones. In this paper, we combine both approaches mentioned above in a novel way, and address the problem of natural intuitive dialog management. The objective of our approach is to provide a natural dialog flow. The whole dialog is therefore represented in a finite state machine: the information gathered during the dialog is represented in the states of the finite state machine; the transitions within the state machine denote the dialog steps into which the dialog is separated. The information is obtained from each natural spoken sentence by hierarchical decoding into tags, e. g. the name-tag and the address-tag. These information tags are gathered during the dialog; either by human initiative or by distinct questioning by the dialog manager. The models use information from the semantic information tags, the dialog history, and the training corpus. From all these integrated parts we achieve the best path to the end of the dialog by Viterbi decoding through the transition network after each information step. From the Air Travel Information System (ATIS) database, we extract all 21650 naturally spoken questions and the SQL-queries as answers for the trainings phase. The experiments have been realized on 200 automatically generated dialog sentences. The system obtains the semantic information in all test-sentences and leads the dialogs successfully to the end. In 66.5% of the sample dialogs we achieve the minimum of the required dialog steps. Hence, 33.5% of the dialogs have over-length. Keywords: dialog management, learning, knowledge management, intelligent systems.
1 Introduction For a spoken dialog system one can distinguish between five task areas. Depending on the system these areas are more or less developed and often their transitions are fluent [6]. The speech recognizer recognizes spoken phonemes and returns a sequence of words according to a lexicon. The sentence analysis (parsing) assigns a meaning to M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 201–209, 2009. © Springer-Verlag Berlin Heidelberg 2009
202
S. Schwärzler et al.
this sequence and translates the ordered relevant information into system language [8]. The dialog management determines the dialog strategy and thus, how the system responds to the user's input. During the communication with external sources, the information is written to or read from databases. The generation answer is virtually the opposite of the sentence analysis and translates words from the system language into a sequence of words that the user understands. The audio front-end is formed by a text-to-speech system. A sequence of written words is converted into a spoken text by a speech synthesis. All components are depicted in Fig. 1.
Dialog policy
Dialog history
b(sm)
D(sm) Belief Estimator
am
b(sm)
Answer generation
amAG Text-to-speech
Dialog managment
auSU Parsing
User
auSR
au
Speech recognition
Fig. 1. Components of a speech dialog system: semantic slots and the dialog history estimates a dialog policy and ask the user over a text-to-speech system
The dialog management differs from all other components in Fig. 1. That is, why standard learning techniques are not suitable. A dialog management system requires a decision on the dialog step and which system answer should be generated in the next step. Two principal approaches for dialog management systems exist: rule-based ones and adaptive probabilistic ones. With trindikit [4] exists a toolkit for rapid development of update rules, information states and dialog transitions. Beside the rule-based systems there are adaptive probabilistic approaches in the dialog procedure, published in [5, 7]. In contrast to the Partial Observable Markov Decision Process (POMDP) [11] we do not calculate the policy in every dialog step. Thereby we reduce the runtime-complexity. In this paper, we use the following components for decision-making: inputs from the user atSR run through a parsing system and deliver semantic slots atSU to the belief estimator [8]. As the next belief state b(t+1) is dependent on the current belief state b(t), the dialog history D(sm) is augmented by the current belief state b(t). Simultaneously, the user is achieved of an action atm by the text-to-speech system. This procedure is repeated until the user reaches the dialog goal or the dialog aborts. The paper is organized as follows: after the introduction of dialog techniques and their strategies, the novel mixed-initiative dialog approach is presented in the next section. A corpus description with concrete use case follows in section 4. After the presentation of the experiments and their results, the treatise closes with a summary and additional experiments to be added in the future.
Using Graphical Models for an Intelligent Mixed-Initiative Dialog Management System
203
2 Dialog Strategies A dialog strategy follows the target to obtain all semantic information to create a SQL1 statement of an estimated user goal. To that end, different methods are described below. System directed Dialog g
h
Frame Base Dialog i Slots
1
a
2 e
b
3
c
f
4
g h i e f
true 0.5 ... ... Frame 1
Value w x y z
0.4 false ... Frame 2
Subframe
Fig. 2. The user inputs are controlled and verified in a system-directed dialog system by finitestate machines. Frame-based dialog systems catch the initiatives from the user [6]. The user is allowed to confront the system with any semantic slot in different time steps.
2.1 System Directed Systems Semantic slots are specified by the system in a fixed sequence, realized by a finitestate machine (see Figure 2). The user has no possibility to form the dialog in runtime. In VoiceXML, the W3Consortium has created a standard for system-directed dialogs [10]. 2.2 Frame Based Systems Frame based systems use semantic templates. The system asks the user to fill open semantic slots. The strategy for filling can be realized in rule-based or probabilistic systems. The user is not constrained to answer directly system directed questions. Optionally the user can answer more semantic slots in one utterance. 2.3 Mixed Initiative Systems In this paper, we combine the advantages of both approaches: An agent based system allows complex combinations between the user and the system, whereas both user and system can initiate the dialog. For passive or inexperienced users or even on problems in the dialog fluency, the system can control the dialog to the user goal. Beside the control of complex dialog actions, the mixed initiative system can change the dialog topic.
3 Novel Approaches The primary goal of this paper is the estimation and the achievement of a user goal to create a SQL statement. To that end, we evolve a semantic frame (frame-based or 1
SQL: Structured Query Language: A database computer language designed for the retrieval and management of data in relational database management systems.
204
S. Schwärzler et al.
mixed-initiative), which can be filled through pointed questions to the user. The dialog strategy is derived from a Graphical Model. The parameters of the model are learned by naturally spoken sentences in the ATIS corpus. 3.1 Graphical Model A Graphical Model combines the theory of probabilities and graphs. Edges model the statistical dependencies between the variables (nodes). Fig. 3 shows the graphical model of a mixed-initiative dialog system. It is an extension of a discrete HMM, which has been realized with the Graphical Model Toolkit (GMTK) [2]. Prolog S0
Chunk
Epilog
S1
S2
ST-1
Observation
O1
O2
OT-1
Future Flag
F1
F2
FT-1
t=1
t=2
t=T-1
ST
State
t=0
t=T
Fig. 3. Dialog strategy design by a stochastic model: The parameters of the states Smt from the dialog model are created from the previous model states Smt-1 and the user utterances aSUt. The future flag F1 controls the matrix of the observation Ot.
The model contains the observable nodes s0 and sT, which are called as prolog and epilog of the graphical model. The chunks s1 till sT-1 are hidden nodes. The observations (ot) of the semantic slots aSUt are linked by an alternating transition with the st. The statistical joint probability in Fig. 3 can be factorized with Eq. 1. (1)
3.2 Information Slots In our novel approach for dialog management, information slots are introduced. They are capable of holding the information tags: if one certain information tag is available, its corresponding information slot is filled. Each dialog step is either initiated by the system or by the human dialog partner. The ending of the user's input also denotes the end of one dialog step. The information available for the current dialog task is evaluated after each dialog step by checking which additional information slots have been filled
Using Graphical Models for an Intelligent Mixed-Initiative Dialog Management System
N=1 2 3 4 20+21= User Goal 3
1
2N possible User Goals 2 3 4 1 2 3 4
21+22= User Goal 5
21+23= User Goal 10
1
205
2 3 4
20+21+23= User Goal 11
Fig. 4. User Goals, defined in binary configuration, are learned from a trainings corpus
Fig. 5. On every time step t the semantic frame will be filled with a slot-value pair. Here the user will at first be asked for the destination, according the trained Graphical Model, before the time.
during the preceding dialog step. Each combination of available information tags, and hence, each filled information slot, is represented by one state in a finite state machine: if N information tags are required, 2N states are defined (see Fig. 4.) A transition from one state to another is made between two dialog steps, depending on the new information gathered and the missing information tags indicated by empty information slots. Missing information can now be asked for by the dialog system by a machine initiative (see Fig. 5). The information tags are thereby weighted depending on their relevance for the current dialog. The more important one certain information tag is for the dialog task, the earlier this information is asked for by the system if not provided during the preceding dialog steps. The transitions within the state machine can be either learned from a database or predefined by the dialog designer. By using a dataset, containing natural, taskspecific example dialogs, as training corpus, the transitions can be adopted or learned in order to provide a natural dialog-flow. This depends on the information tags (and hence, the current state of the finite state machine) being already available or missing. Information tag-combination which can not be found in the training corpus can be provided by the above mentioned weighting and absolute discounting. Thereby, a probabilistic modeling of the dialog is achieved by using various models of dynamic Bayesian networks (DBNs). 3.3 Trellis Representation All possible transitions from a belief state b(t-1) according to b(t) are learned iteratively by [1] and represented in a trellis diagram (see Fig. 6).
206
S. Schwärzler et al.
b(7,t-1) = 0.05
b(7,t) = 0.04
b(6,t-1) = 0.01
b(6,t) = 0.01
b(5,t-1) = 0.04
b(5,t) = 0.02
b(4,t-1) = 0.06
b(4,t) = 0.05
b(3,t-1) = 0.14
b(3,t) = 0.13
b(2,t-1) = 0.1
b(2,t) = 0.1
b(1,t-1) = 0.1
b(1,t) = 0.45
b(0,t-1) = 0.5
b(0,t) = 0.2
Possible Transition Transition
Semantic Slots
t-1
t
Fig. 6. Trellis representation of the semantic slots and their machine learned state transitions
The Viterbi algorithm computes the best path through the trellis diagram [9]. To that end the belief state b(t) describes the probability of one path at time t, which ends in state s(t). The Viterbi algorithm is defined as follows: Initialization: (2)
Recursion: (3)
Termination: (4) The best path is then found by backtracking: (5)
Using Graphical Models for an Intelligent Mixed-Initiative Dialog Management System
0
1
2
t
T-1
207
T
Time t
Fig. 7. The dialog progression through the user goals is described by the Viterbi algorithm
4 Corpus Description This speech database is the first in a series of recordings of natural speech, in the Air Travel Information System (ATIS) domain. Queries collected for these corpora are spoken, without scripts or other constraints to ATIS [3]. Table 1. Example dialog between human and system derived from the ATIS Corpora Speaker Human System Human System Human System
System
Dialogue and Actions Hello. What can I do for you? Show me all the nonstop flights from Atlanta to Philadelphia. Lists/List of flights from cities whose city name is Atlanta and to cities whose city name is Philadelphia and whose stops is 0. Yes, I would like some information on the flights on April 22nd, evening. Lists/List flights from cities whose city name is Dallas and to cities whose city name is Denver and whose departure time is between 1645 and 1715 and flying on flight days whose day name is Sunday. Can’t find any result.
A human wizard simulating the speech recognizer of the future gives the impression of a speech-recognizing computer system. ATIS contains 21650 user utterances and 2195 sessions. For each session, a problem was posed to a subject, such as “find the cheapest way to fly from Atlanta to Dallas by next Thursday”. The subject's queries by SQL to the computer system and the computer system's responses were saved as data. The average dialog length is about eight question and answer steps. A dialog example is shown in Table 1.
208
S. Schwärzler et al.
5 Experiments and Results We analyse the length of a dialog with 200 automatically generated and completely disjoint test-sentences. The experiments show reliability of our system; all dialogs reach the dialog goal with their users goals (stopover). In 66.5% of the tested dialogs, we achieve exactly the same user goals as described in the ATIS corpus. Hence, 33.5% of the dialogs have over-length. The system achieves more user goals than necessary to create a SQL statement to the database. To that end the user is confronted with more questions than required by our approach. There are on average 6 dialog steps necessary for the achievement of the dialog goal. Our system requires about 8 dialog steps before a SQL statement is sent to the database.
6 Conclusion and Future Work In this work a novel mixed-initiative dialog management system based on Graphical Models has been presented. Information slots are introduced and modeled within the Graphical Model to a DBN. Their parameters have been learned from naturally spoken sentences in the ATIS task. The Viterbi algorithm computes iteratively the best path through the trellis. Our approach achieves all dialog goals in 200 test sentences, but 33.5% of the tested dialogs have over-length. However, the first results show, that the system works reliable. In future we plan to analyse, how the model could recognize errors in the information slots and how to correct them.
References 1. Baum, L.E., Petrie, T.: Statistical Inference for Probabilistic Functions of Finite State Markov Chains. The Annals of Mathematical Statistics 37, 1554–1563 (1966) 2. Bilmes, J., Zweig, G.: The Graphical Model Toolkit: An Open Source Software System for Speech and Time-Series Processing. In: Proceedings of the International Conference on Acoustics, Speech and Signal Processing (ICASSP) (2002) 3. Hemphill, C.T., Godfrey, J.J., Doddington, G.R.: The ATIS Spoken Language Systems Pilot Corpus (1990), http://acl.ldc.upenn.edu/H/H90/H90-1021.pdf 4. Larrson, S., Bernman, A., Hallenborg, J., Hjelm, D.: Trindikit Manual (2004) 5. Levin, E., Pieraccini, R., Eckert, W.: Using Markov Decision Processes For Learning Dialogue Strategies. In: Proc. Int. Conf. Acoustics, Speech and Signal Processing, Seattle, USA (1998) 6. McTear, M.F.: Spoken Dialogue Technology. Springer, London (2004) 7. Rieser, V., Lemon, O.: Using Machine Learning to Explore Human Multimodal Clarification Strategies. In: IEEE/ACL Workshop, Palm Beach, Aruba (2006) 8. Schwärzler, S., Geiger, J., Schenk, J., Al-Hames, M., Hörnler, B., Ruske, G., Rigoll, G.: Combining Statistical and Syntactical Systems for Spoken Language Understanding With Graphical Models. In: Proc. of the 9th International Speech Communication Association (Interspeech 2008), Brisbane, Australia (2008)
Using Graphical Models for an Intelligent Mixed-Initiative Dialog Management System
209
9. Viterbi, A.: Error Bounds for Convolutional Codes and an Asymptotically OptimumError Bounds for Convolutional Codes and an Asymptotically Optimum Decoding Algorithm. IEEE Transactions on Information Theory, series 13, 260–267 (1967) 10. W3C Recommendation, Voice Extensible Markup Language (VXML), Version 2.0 (2004), http://www.w3.org/TR/2004/REC-voicexml20-20040316 11. Young, S.: Using POMDPs for dialog management. In: IEEE/ACL Workshop, Palm Beach, Aruba (2006)
Input Text Repairing for Multi-lingual Chat System Kenichi Yoshida and Fumio Hattori Graduate School of Science and Engineering, Ritsumeikan University, Japan [email protected], [email protected]
Abstract. Even though various communication tools have resulted in a remarkable increase of global communications, language barriers remain high and complicate communication across languages. Although the multi-lingual chat system allows users to chat with each other in different language using machine translation. the quality of translation is not so high when the input sentence reflects spoken language. In this paper we propose a method that repairs the input sentences in spoken language by retrieving similar sentences using keywords. Keywords: Language Grid, multi-lingual chat, cross-cultural communication, machine translation.
1 Introduction The advance of the Internet technology and various communication tools have resulted in a remarkable increase of global communications. However, language barriers remain high and complicate inter-cultural communication. The Language Grid Project [1], which is an infrastructure that makes it possible to combine various language resources on the Internet, started to solve this problem in 2006 by improving the understanding of the Internet contents written in different languages and by people from different countries. The multi-lingual chat system1 [2], which is one of the applications developed by the Language Grid Project, allows users to chat with each other in different languages using machine translation. Most sentences in multi-lingual chats are spoken words. However, almost all of the machine translation resources used in multi-lingual chat systems translates written words. Therefore, the translation quality in multi-lingual chat systems is not always ensured. Although a multi-lingual chat system provides such functions as back translation and auto completion, they are insufficient for practical use. To improve the quality, repairing input spoken sentences to written sentences that match the machine translation is expected to be effective. In this paper, a method is proposed that repairs input sentences in spoken language by retrieving similar sentences using keywords. 1
Multi-lingual chat system is developed by College of Informatics, Kyoto University.
M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 210–217, 2009. © Springer-Verlag Berlin Heidelberg 2009
Input Text Repairing for Multi-lingual Chat System
211
In Section 2, the details of the multi-lingual chat system are introduced. An input repairing system is proposed in Section 3. In Section 4, experiments and discussion are described. Section 5 concludes our paper.
2 Multi-lingual Chat System 2.1 Overview of Multi-lingual Chat System A multi-lingual chat system adds a translation function to traditional text chat systems. Users can send messages in their native languages and receive messages from partners. In other words, users can exchange messages with partners whose native languages are different. A multi-lingual chat system utilizes the machine translation resources available on the Internet. However, current machine translation systems are designed to handle written documents: that is, well-formed sentences that are easily and correctly translated. However, the spoken words that often appear in chats are rarely translated correctly because the translation quality is not high in multi-lingual chat systems. For example, “Shukudai susunderu?” in Japanese, which means “How have you finished your homework?” might be translated as “Is homework developed?” The characteristics of the Japanese spoken sentences used in chatting are different from written sentences. First, subjects are often omitted. In addition, people often answer with very simple predicates. Second, the end of a sentence can be spelled in several different ways. Third, several words have the same meaning but the expressions are different. For example, Japanese has at least three expressions that mean “dinner”: “yorugohan,” “yuhan,” and “banmeshi.” These factors prevent machine translation from translating correctly. To improve the quality of the translation of multi-lingual chats, repairing input sentences to adapt to machine translation is considered to be effective. 2.2 Back Translation To repair input sentences, the multi-lingual chat system provides a back translation function. Fundamentally speaking, to confirm whether the input sentence is translated correctly, the target language must be understood. However, this is rare for the users of multi-lingual chat systems. Back translation re-translates the translated sentence in the target language to the source language. Users can compare the original input and the back-translated sentences and confirm whether the meaning of both sentences is the same. If the meanings are identical, users can expect that the input sentence was translated correctly. Conversely, if the meanings are different, the translation might be incorrect. In the latter case, users need to repair the input sentence and translate again by repeating this process until the meanings become equivalent. Using the above example, when “Is homework developed?” is back-translated into “Naishoku ha hatten saserareruka?”, the user realizes that the input sentence was not translated correctly into his/her native language.
212
K. Yoshida and F. Hattori
A preliminary experiment showed that 65% of sentences need to be repaired twice or more using back translation. This means that this function is very useful for improving translation quality. However, it only informs users that the input sentence is not good. Users still have to repair the input sentences by themselves. Learning how to repair input sentences is not easy. The fact that 65% of sentences need to be repaired twice or more impairs the immediacy of the chat system. 2.3 Auto Complete Another function, auto complete, which is also equipped in the multi-lingual chat system of the Language Grid Playground, retrieves example sentences that match the input text. Since the example sentences have corresponding translated sentences, the selected example sentence is translated instantly and correctly. However, it can’t handle the variety of spelling at the end of sentences or the variety of synonyms. In addition, the number of examples is limited, so the auto complete function is only useful in few cases.
3 Input Text Repairing by Retrieving Generalized Sentences 3.1 Method Overview Given an input sentence, this function retrieves generalized sentences in written styles using keywords. A generalized sentence is one in which several words are replaced to generalized words. For example, “ongakushitsu wa doko desuka?” (“Where is the music room?”) can be generalized as “«basho» wa doko desuka?” (“Where is «the place»?”). In this example, «basho» («the place») is the generalized word. The keywords used for retrieval are extracted from the input sentence and generalized. From input sentence “Ongakushitsu, doko?” (“Music room, where?”), “ongakushitsu” (“music room”), “doko” (“where”), and “?” are extracted. Then “ongakushitsu” (“music room”) is generalized as «basho» («the place»), so that the keywords used for retrieval are «basho» («the place»), “doko” (“where”), and “?”. The grammatical structure of the input sentence is disregarded in this method. Retrieving a generalized sentence database might return the following sentence: “«basho» wa doko desuka?” (“Where is «the place»?”). Finally, the generalized words are specialized as they appear in the input sentence, resulting in the following repaired input sentence: “ongakushitsu wa doko desuka?” (“Where is the music room?”). The generalized sentence database includes sentences whose use can be anticipated based on each domain in which the system is used. For example, if the system is used in an elementary school, sentences about schoolwork or classrooms must be registered. It also includes sentences commonly used in daily life such as asking about places or exchanging information. 3.2 Process Flow Fig. 1 shows the process flow of the input repairing method. The example of input repairing for a dialogue between a teacher and a foreign pupil is shown in Fig. 2.
Input Text Repairing for Multi-lingual Chat System
213
Fig. 1. Process flow
Fig. 2. Example of input repairing
1. Extracting keywords: First, by applying morphological analysis, nouns, adjectives, independent verbs, and question or exclamation mark are extracted. For example, from the sentence “Ongakushitsu, doko?” (“Music room, where?”), “ongaku” (noun-generality), “shitsu” (noun-suffix-generality), “doko” (noun-pronoun-generality), and “?” (mark-generality) are extracted. Suffixes are combined with the preceding noun. That is, “noun-suffix-generality” is always combined with the preceding “noungenerality” to form one word. So “ongaku” (noun-generality)” and “shitsu” (nounsuffix-generality)” are combined into “ongakushitsu” (“music room”).
214
K. Yoshida and F. Hattori
2. Keyword generalization: In this step, the extracted words are replaced by generalized words using domain ontology, which is a formal representation of a set of concepts within a domain and the relationships among those concepts. Section 3.3 explains domain ontology in detail. 3. In this paper, only noun-generality is generalized. In the preceding example, “ongakushitsu” (“music room”) is generalized as “«basho»” (“«the place»”). After the generalization, the three keywords, “«basho»” (“«the place»”), “doko” (“where”), and “?”, are used for retrieving a generalized sentence database. 4. Retrieving the generalized sentence database: In the beginning, the generalized sentences match all three keywords perfectly. If no sentence is matched, partial matching is done using one or two keywords. 5. Word specialization: Generalized words in the retrieved generalized sentence are replaced backwards with specialized words, as in step 2. In the preceding example, “«basho»” (“«the place»”) is replaced again with “ongakushitsu” (“music room”), and the sentence is shown to the user. 3.3 Keywords Generalization Using Domain Ontology Sentence variety appears as input of the chat system. Since preparing all example sentences is impractical, we focus on the fact that many sentences have the same structure, but only the noun in the sentence differs. These sentences can be generalized to one sentence that includes generalized words instead of the original nouns. Therefore, keywords extracted from input sentences have to be generalized to retrieve the generalized example sentence. This generalization is done using domain ontology. Fig. 3 shows a sample domain ontology for places in a school. Keywords are generalized by ascending the concept hierarchy in the domain ontology.
Fig. 3. Sample of domain ontology
Input Text Repairing for Multi-lingual Chat System
215
3.4 Retrieval of Generalized Sentences A generalized sentence database is composed of pairs of generalized sentences and corresponding keywords. Fig. 4 shows the structure of the database. Generalized sentences are developed by generalizing examples in the domain using the same method for generalizing input sentences as described above.
Fig. 4. Concept chart of generalized database
Retrieval is done by comparing the keywords extracted from the input sentence with the keywords in the generalized sentence database. If all keywords match, a corresponding generalized sentence is returned. When no sentences match, two options are provided: A and B. Option A retrieves sentences that include more than four words that match three or more keywords. In the example of Section 3.1, “«basho» wa doko ni aruka shitte imasuka?” (“Do you know where «the place» is?” is retrieved using keywords “«basho»” (“«the place»”), “doko” (“where”), and “?”. Option B retrieves generalized sentences from the database with one keyword missing, but the combination of keyword sentences partially matches the keywords, including the generalized keywords. For example, the used keywords are the generalized keyword “«basho»” (“«the place»”) and another keyword, such as “doko” (“where”). The result might be “«basho» ha doko desuka? (“Where is «the place»?”). 3.5 System Architecture Fig. 5 shows the system architecture of the input repairing system. 1. The input sentence is passed through the morphological analysis module to extract keywords from it. 2. Keywords are generalized using the domain ontology. 3. Generalized sentence database are retrieved using generalized keywords. 4. The generalized word is returned to the original one. 5. The repaired sentence is presented to the user. A sample snapshot of the multi-lingual chat system with an input repairing facility is shown in Fig. 6. When a sentence is input into the input field and the translation button is pushed, the repaired candidate sentences appear below.
216
K. Yoshida and F. Hattori
Fig. 5. System configuration
Fig. 6. Sample snapshot of input repairing
4 Experiment 4.1 Experimental Method An experiment was conducted supposing a chatting situation between a Chinese pupil and a Japanese teacher at an elementary school. The translation quality, which was compared with and without input repairing, was measured by the number of back translations needed until an acceptable translation result was obtained. The translation of Japanese into Chinese was assumed. 4.2 Experimental Result and Discussion Using multi-lingual chat without input repairing, 10 of 23 sentences were translated correctly, a success rate of 43%. On the other hand, using the system with the
Input Text Repairing for Multi-lingual Chat System
217
proposed input repairing, 19 of 23 sentences were translated correctly, a success rate of 83%. Table 1 shows several examples of input repairing. In the first, the back translation result implies that the input sentence was mistranslated because an article was inadequately supplemented by the machine translation. In this case, input repairing worked well. The second example shows that input repairing caused a mistranslation. Since the repaired sentence was complex, perhaps the machine translation could not understand it well. The last one was caused by incorrect morphological analysis. Table 1. Examples of input reparing
5 Conclusion A method was proposed to repair input sentences for multi-lingual chat systems. The method retrieves similar generalized sentences using keywords extracted from input sentences. The experiment shows that the successful translation rate was improved from 43% to 83%. The idea of retrieving generalized sentences using keywords might be applicable for young children or people with such language difficulties as aphasia. Input repairing must still be improved. For example, complex sentences must be decomposed into simple sentences. Flexibility that can satisfy the cases of morphological analysis error is also desired.
Acknowledgement This research was supported by the Strategic Information and Communications R&D Promotion Programme of the Ministry of Internal Affairs and Communications, Japan.
References 1. Ishida, T., Grid, L.: An Infrastructure for Intercultural Collaboration. In: IEEE/IPSJ Symposium on Applications and the Internet (SAINT 2006), keynote address, pp. 96–100 (2006), http://langrid.org/ 2. http://langrid.org/playground/chat/ChattingMain.html
Interactive Object Segmentation System from a Video Sequence Guntae Bae, Sooyeong Kwak, and Hyeran Byun Department of Computer Science, Yonsei University 134 Sinchon-Dong, Seodaemun-Gu, Seoul, 120-749, Korea {gtbae,ksy2177,hrbyun}@yonsei.ac.kr
Abstract. In this paper, we present an interactive object segmentation system form video, such as TV products and films, for converting 2D to 3D contents. It is focused on reducing the processing time for the object segmentation, increasing the usability. The proposed system is consist of three steps which are trimap generation based on polygon and object segmentation using Graph Cut algorithm and refinement by a user interfaces (UI) based on rectangle and local features. It makes it easy to get object segmentation rapidly. It is also helpful to create 3D contents. Keywords: Object Segmentation, interactive System, trimap generation, trimap estimation, Graph Cut.
1 Introduction and Related Works In recent years, 3D devices have been developed such as 3D monitors, TVs, projector and screen. On the other hand, 3D contents for these devices are insufficient particularly for the movies. There are two methods for making 3D contents: 1) using the special capture devices, such a stereo camera, 2) combining previously created 2D contents and depth information. The first method is not common because stereo camera is expansive and hard to handle. On the other hand, it is possible to easily obtain 2D contents. Thus there are many works for creating 3D contents using 2D contents which should be able to separate into objects regions for combining with depth information. Therefore the object segmentation is an essential technique. 1.1 Previous Approaches Object segmentation in images or videos is a popular research topic. There are many proposed algorithms and tools. Representative examples are Magnetic Lasso [1] and Pen Tools in Adobe Photoshop. They are the most popular tools due to theirs immediacy and flexibility, M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 221–228, 2009. © Springer-Verlag Berlin Heidelberg 2009
222
G. Bae, S. Kwak, and H. Byun
and thus they are widely used for years. It gives good segmentation results by allowing fine manipulation, but it is too complex to user for beginner and required many phases. The popular algorithms for object segmentation are Graph Cut [2, 3] and Matting [4, 5, 6]. In the Graph Cut, an image is segmented into several regions by using graph concept and color model of the object. Users provide a little information such as trimap that contains the information of foreground and background regions. It is the problem of determining whether it belongs to foreground or background for each node in a graph. Its result value has discrete values, 0 or 1. Lazy snapping [7], proposed by Yin Li, is a representative tool using the Graph Cut algorithm. Literally lazy snapping is a segmentation tool for lazy user. User can segment the object from an image by a few simple marking. It provides border brush and pixel editing user interface for the refinement on the segmentation result. Graph Cut performs on a small border region. Other popular tool is GrabCut [8] using the iterative Graph Cut, proposed by Carsten. In this tool, user can segment with a few interactions that draw a rectangle with a mouse. It is also a user interface for the refinement of inaccurate segmentation result due to the incomplete labeling. Both algorithms well segment for image. However, they repeatedly require a user input about foreground and background, and thus it is not proper for video data. For accurate object segmentation, matting is a popular algorithm. It is the problem of determining whether it is foreground, background or mixture for each pixel in an image. Almost matting algorithms focus on improving the segmentation quality in single image through accurate inference of mixture parameter “alpha” based on sampling the nearby foreground and background pixels. The segmentation results of these algorithms are more accurate than the other segmentation approaches’ for the image compositing. However matting algorithms are generally too slow to use video segmentation because it deals with the number of pixels in image. Soft Scissor [9] proposed by Jue W. is an interactive tool for extracting alpha mattes of foreground objects in real time. For segmenting, user should be marking the boundary regions by using a user interface like a brush which is automatically adjusted its border width. To overcome the time complex problem of matting algorithm, alpha matte extracts locally. It is helpful to reduce time. Matting is good for compositing of image. But it doesn’t correspond to video, because it is still slow for dealing with several images. 1.2 Proposed System In this paper, we propose an object segmentation system form video sequences, such as TV products, films and UCC, for converting 2D to 3D contents. It is focused on reducing the processing time, increasing the usability. It will allow that general person can achieve the high quality object segmentation result from a video. The proposed system is consist of three steps which are follow:(1)trimap generation (2)object segmentation using Graph Cut (3)the refinement by an user interfaces using the local Graph Cut algorithm. Figure 1 shows the workflow of the proposed system.
Interactive Object Segmentation System from a Video Sequence
223
Fig. 1. Work flow of proposed interactive object segmentation system from a video for 3D converting
2 Interactive Object Segmentation System 2.1 Trimap Generation In the object segmentation using Graph Cut algorithm, prior knowledge about object is needed. Rectangle in GrabCut and marking in Lazy snapping correspond to it. Prior knowledge roughly indicates the position and size of the interest object. The quality of segmentation result is depended on user input. If user input is given in detail, we can achieve high quality segmentation result. However it requires high concentration and considerable time, and thus it is not proper for video object segmentation. We propose a method based on polygon and control point for trimap generation. It is consist of three steps which are polygon creating, border width adjusting, and object assigning. Each step is follow: 1. Firstly, user creates the polygon, similar shape of the boundary of interest object by using mouse left button click. If user clicks the mouse button at specific position for pointing, control points needed to control are generated. They are formed into polygon. 2. Secondly, user adjusts border width of the polygon to include the object boundary by scrolling mouse scroll. Region of polygon’s border is assigned as unknown region (U) in trimap. 3. Finally, user determines that which region is assigned as foreground region (F) in trimap by using mouse right button click. Other region separated by polygon is automatically assigned as background region (B). 4. If an image is completely assigned as F, B, and U, trimap generation is completed. Figure 2 shows the steps of the trimap generation. Additionally, the propose system provides a function of adjusting a transparency of trimap. It is helpful for the users to generate and adjust a polygon instinctively. Consequently it can reduce the time for object segmentation.
224
G. Bae, S. Kwak, and H. Byun
Fig. 2. The steps of trimap generation and result of transparency adjustment (a) creation of polygon (b) adjustment of border width (c) region assigning (d) result of transparency adjustment
2.2 Object Segmentation Using Graph Cut Object segmentation can be changed a binary labeling problem. Graph Cut algorithm is an approach which utilize graph concept for solving the problem. In Graph Cut, an image is represented by a graph G
= v, ε , where v is a set of
all node, ε is an edge set of adjacent nodes. It is a method about how to assign each node as foreground (0) or background (1) for separating graph into two regions. Generally, to solve the problem, it firstly defines an energy function and then minimizes it. In the propose system, we define a Gibbs energy function [10] like equation (1). We use the max-flow algorithm [3], proposed by Boykov, to minimize this energy.
E ( X ) = ∑ E1 ( xi ) + λ i∈ν
∑ E (x , x )
( i , j )∈ε
2
i
j
(1)
xi is an assigning result of node i xi ∈ [0,1] , and X is a set of all xi . E1 is a likelihood energy and E 2 is a prior energy. xi and x j are the labels of adjacent nodes i and j . Likelihood energy E1 is computed by the color similarity between each node and pre-assigned foreground/background regions by trimap. If node i which’s color is where
similar to the region, assigned as foreground in the trimap, is labeled as foreground ( xi = 1 ), E1 will be lower (nearby 0). In other case, if it is labeled as background ( xi
= 0 ), E1 will be close to 1. Table 1 shows E1 of Node i in each case. In table 1,
K is a constant, diF and d iB are the minimum distance from its color to foreground and background cluster regions [7]. Prior energy E 2 is energy about boundary region of segmentation result. In the proposed system, it is computed by the L2-Norm of the RGB color difference between two nodes i and j . If similar adjacent nodes are labeled as foreground and background respectively, E 2 will be also larger and it will be lower like E1 in other case.
Interactive Object Segmentation System from a Video Sequence
225
Table 1. Node i ‘s likelihood energy in each case Assigned result F(Foreground) B(Background) U(Unknown)
xi = 1 0 K F d i /(d iF + d iB )
xi = 0 K 0
d iB /(d iF + d iB )
2.3 Refinement and Trimap Estimation Segmentation result is not always good. Therefore a refinement step for correcting mislabeled result is needed. The proposed system provides a refinement tool based on Graph Cut algorithm using local features. If we use the global feature for using Graph Cut, it is occasionally the reason of inaccurate segmentation due to the color similarity of between foreground and background regions. Therefore, the proposed system uses the local feature for reducing the color similarity in the refinement step. Target region is indicated by using mouse drag. If specific region is mislabeled, user simply indicates the rectangle region. At this time, the rectangle should include both foreground and background region, because this information is utilized for the local Graph Cut in the automatic trimap estimation. Boundary between these two regions is assigned as unknown region (U) by dilation operation. Foreground (F) and background (B) regions are used the previous step result. If F, B, and U are completely assigned, trimap estimation is done. The proposed systems perform the local graph by using estimated trimap. In the video sequence, the trimap estimation technique is available to generate trimap for next frame, because the difference between consecutive frames is a small. Therefore it is possible to estimate the trimap for next frame. It is also helpful to reduce the working time. Figure 3 shows the work flow of the trimap estimation.
Fig. 3. Work flow of the automatic trimap estimation
226
G. Bae, S. Kwak, and H. Byun
3 Experimental Results We have performed several experiments that showed the validity of the proposed tool for trimap generating and the proposed interactive system. The proposed system is implemented in VC++ and is run on Pentium D CPU 3.0 GHz PC with 2G RAM. 3.1 Test Dataset To evaluate the propose system we use various test datasets which are captured by webcam, Logitech QuickCam IM(1.3 megapixels). The size of test datasets is 320 by 240. The datasets have a scenario that is a common situation of the indoor visual teleconferencing. 3D converting is able to increase the reality of video.
Fig. 4. Representative frame of test datasets (a) dataset 1 (b) dataset 2 (c) dataset 3 (d) dataset 4
3.2 Performance Evaluation For the performance evaluation of the proposed system, we create the ground truth data manually. It is created by the conventional image segmentation tool such as Adobe Photoshop. The proposed interactive system is measured by two parts. The first is the evaluation of accuracy and efficiency of the trimap estimation method. The second is a usability evaluation of usability of trimap generating tool. First, we compared between ground truth data and segmentation result using estimated trimap for accuracy evaluation of the trimap estimation. For measuring more accurate measurement of proposed algorithm, we measured various dilation degree of boundary region in trimap estimation. Measurement result had a good performance in slow motion video sequence, but it doesn’t in fast case because object boundary escape unknown region in estimated trimap because of large difference between consecutive frames. To evaluate the performance of initial trimap generation method, we measured time of initial trimap generation using tool. And we compared results with results using general graphics tool. In result, the average time took less than 1 minute, so it is fast to general graphics tool. The advantage of the proposed method is that our tool is very easy and intuitive to use quickly for beginner.
Interactive Object Segmentation System from a Video Sequence
227
3.3 Segmentation Results
Fig. 5. Result of the video object segmentation, second row shows well segmented objects from the dataset 1. In the other hand, fourth row shows the miss segmentation result because of strong edge.
4 Conclusion and Future Works In conclusion, we have proposed an interactive system for video object segmentation from 2D video. The propose system makes it easy to get an object segmentation result from video such as movies, UCC, and TV products. It is also helpful to generate the 3D content. We have proposed the user interface for trimap generation and the trimap estimation method for reducing the processing time. Finally, we have shown the validity of the proposed interactive system by experiments. However, we still have some issue for improving the performance. For more automatic segmentation of video object, we should solve the problem of fast moving object and improve the segmentation result more accurately. It is our future works.
Acknowledgments This research was supported by MIC, Korea under ITRC IITA-2008-(C1090-08010046).
228
G. Bae, S. Kwak, and H. Byun
References 1. Mortensen, E.N., Barrett, W.A.: Intelligent scissors for image composition. In: Proceedings of ACM SIGGRAPH 1995, pp. 191–198 (1995) 2. Boykov, Y., Jolly, M.P.: Interactive graph cuts for optimal boundary & region segmentation of objects in n-d images. In: Proceedings of ICCV 2001, vol. 1, pp. 105–112 (2001) 3. Boykov, Y., Kolmogorov, V.: An experimental comparision of min-cut/max-flow algorithms for energy minimization in vision. IEEE Transactions on Pattern Analysis and Machine Intelligence 26(9), 1124–1137 (2004) 4. Chuang, Y.-Y., Curless, B., Salesin, D., Szeliski, R.: A Bayesian Approach to Digital in Matting. In: Proceeding of IEEE Computer Vision and Pattern Recognition, pp. 264–271 (2001) 5. Grady, L.: Random walks for image segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence (2004) 6. Wang, J., Cohen, M.-F.: Optimized color sampling for robust matting. In: Proceedings of IEEE Computer Vision and Pattern Recognition, pp. 264–271 (2007) 7. Li, Y., Sun, J., Tang, C.-K., Shum, H.-Y.: Lazy Snapping. ACM Transaction on Graphics (SIGGRAPH) (2004) 8. Rother, C., Kolmogorov, V., Blake, A.: GrabCut – Interactive Foreground Extraction using Iterated Graph Cuts. ACM Transaction on Graphics (SIGGRAPH) (2004) 9. Wang, J., Agrawala, M., Cohen, M.-F.: Soft Scissors: An Interactive Tool for Realtime High Quality Matting. ACM Transaction on Graphics (SIGGRAPH) (2007) 10. Geman, S., Geman, D.: Stochastic relaxation, gibbs distributions, and the bayesian restoration of images. IEEE Transactions on Pattern Analysis and Machine Intelligence 6, 721–741 (1984)
COBRA – A Visualization Solution to Monitor and Analyze Consumer Generated Medias Amit Behal1, Julia Grace1, Linda Kato1, Ying Chen1, Shixia Liu2, Weijia Cai2, and Weihong Qian2 1
IBM Almaden Research Center, 650 Harry Road, San Jose, CA {abehal,jhgrace,kato,yingchen}@us.ibm.com 2 IBM China Research Lab {liusx,caiweij,qianwh}@cn.ibm.com
Abstract. Consumer Generated Medias (CGMs) -- such as blogs, news forums, message boards, and web pages -- are emerging as locations where consumers trade, discuss and influence each other’s purchasing patterns. Leveraging such CGMs to provide valuable insight into consumer opinions and trends is becoming increasingly attractive to corporations. This paper describes COBRA (COrporate Brand and Reputation Analysis), a visual analytics solution that surfaces the text mining and statistical analysis capabilities described in our earlier COBRA papers. Our interaction technique of search, visualization, and monitor enables detailed analysis of many CGMs without overwhelming the user. A suite of visualization solutions expose a variety of embedded COBRA visual analytics capabilities. Real world client engagements and user studies demonstrate the effectiveness of our approach. Keywords: visual analytics, text mining, semi structured search.
1 Introduction Our COrporate Brand and Reputation Analysis (COBRA) solution allows clients to monitor and analyze a variety of Consumer Generated Medias (CGMs) [1]. We provide a unified view of a variety of datasources – such as blogs, message boards, news feeds, and clients’ internal datasets. The users create initial queries to populate the database with their sources. Users then create and refine text patterns to annotate useful entities, such as their brands and risk hotwords. This setup and refinement process is described in our earlier COBRA paper [1]. The system then extracts relevant snippets from each type of document, and alerts the user of information that matches their criteria. The system also enables the user to search the historical collection of snippets, and conduct deeper analysis on the results. This paper describes COBRA’s interaction layer that is presented to the end user analysts. To provide intuitive interaction with data and analysis, COBRA user interactions are organized around three high level tasks to find relevant information: search to M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 229–238, 2009. © Springer-Verlag Berlin Heidelberg 2009
230
A. Behal et al.
filter down to a subset of documents, visualize to graphically understand the results of analysis on those documents, and monitor to track potential risks to different business entities over time. These tasks are closely integrated through the analytics, but flexible enough to be performed in any order by the end user to allow for a customized workflow. For example, search results are visualized using different techniques; these interactive visualizations can surface interesting concepts within the data to monitor. To enable this, COBRA has a search panel that provides a visual representation of the search query to inform users of any refinements they have made, and allow them to narrow (or expand) the dataset being analyzed. A tabbed interface allows users to investigate attributes of their dataset through a variety of visualization and monitoring capabilities. Users can feed results of one visualization into a different analysis by selecting a document subset and switching tabs. This clean and concise layout provides an intuitive application framework that allows for smooth transition between the three tasks without compromising the ease or capabilities of any one task. To see how COBRA is used, we walk through a possible usage scenario. A typical user starts by viewing the newly generated alerts to monitor potential risks identified that day. The user notices that one corporate brand entity is mentioned with much higher frequency than others, and wants to understand the risk factors causing this. To find the correlations between the brands and risk hotwords, the user switches to the relationships tab. There, the user can easily find pairs of highly correlated brands and risk hotwords. Selecting one such pair and switching to the sentiment tab allows the user to further filter down to the documents with negative sentiment. These selected documents can then be automatically clustered to provide better insights, which can be used to create new risk causes to improve the daily monitoring.
2 Search The top search panel serves many functions in our system. Because COBRA provides a unified view of multiple datasources, the panel quickly informs users of the unified and individual schemas. The panel also selects a subset of the data to be analyzed, specified by a semi-structured search query. This query can be explicitly specified by the user to isolate data of interest, or formed using exploratory visualizations below. In addition, the search panel provides a visual representation of the query so the user does not get lost, similar to the description by Kieliszewski, et al. [2]. The initial search panel surfaces the unified schema of all datasources at the top of the interface. It shows the commonly used dimensions (model, brand, hotword, and source) as multiselect dropdowns, along with a date range and text search inputs. To understand the meaning behind a dimension, the user can open a particular dimension’s dropdown to view its values and associated snippet counts. The advanced search can be expanded to show less commonly used dimensions and source specific dimensions associated with just a subset of the data. The date range is prepopulated with the minimum and maximum dates in the data, and the total snippet count is displayed. This progressive display of schema information allows users to understand the initial data without getting overwhelmed by metadata.
COBRA – A Visualization Solution to Monitor and Analyze CGMs
231
Fig. 1. Search and advanced search interface with an open multiselect dropdown
Users manipulate the search query by adding or removing filters, which allows drilling down or moving up to define subset for analysis. Users can easily add multiple types filters at once by interacting with individual components and hitting the search button. Selecting options from the multi select dropdown adds structured field filters, entering keywords adds a text search filter, and a start and end date allows filtering snippets by date. Filters can also be added by interacting with visualizations that help users explore the data and navigate to an interesting subset. For example, a trend chart that allows users to drill in across time allows an option to apply that filter to the search panel. A correlation matrix will also surface that option, so the search panel can focus on some interesting cells with just one click. This convenience allows users to feed the result dataset of one visualization into the input data of another one, allowing for interesting workflows leveraging a chain of COBRA analytics. To ensure users know their position while navigating the search space, the “Current Search Attributes” area surfaces all active filters and total number of matching snippets. The area also allows users to easily remove filters if they are done analyzing a subset or just accidentally added a filter. To help users save and retrieve context across sessions, we are working to add the ability to save or load search queries.
3 Visualize The essence of COBRA from the end user perspective is a set of graphical features supported by sophisticated analytics that surfaces a unique analytical results of the data through six interactive visualizations. Each visualization surfaces details of the data incrementally, to allow review and interpretation of selected results without overwhelming users with excessive information. For example, the high level charts of the Dashboard can be expanded to show more detailed trend charts and supporting documents. Similarly, relevant summary text in the Alerts tab can be expanded to the full set of supporting documents on particular issues of potential consequence. By providing a suite of visualizations
232
A. Behal et al.
that progressively convey and explain statistical and textual analysis results, we empower users to gain a deep understanding of the vast amounts of data very quickly. Following are more detailed descriptions of the six interactive visualizations. Dashboard. The dashboard is the default tab users see when they log into COBRA. It uses interactive pie charts and trend graphs to provide a quick visual overview of the entire dataset. The dashboard also allows drilling into specific pie chart slices or graph time ranges to help users identify and select interesting results from the analysis. The dashboard is layed-out with the three interactive pie charts on top that show the most important dimensions: source, model and hotword. These three high level dimensions were determined through user studies and client requirements to guide insight. Below each pie chart is an interactive multi-line trend graph that shows the change in distribution over time for the dimensions in the pie chart. Included is an additional, hidden interactive pie chart and trend graph to display any one dimension’s distribution.
Fig. 2. The dashboard screen shows the major pie charts and trend charts at the top. The third row in the dashboard is shown after selection in the top pie charts.
The interaction model of the dashboard is top-down – interacting with any component updates the dataset shown in components below it. Selecting pies in any top pie chart updates the corresponding trend graph to show just the selected snippets, and reveals the third row to break down the selected snippets by a different dimension. Hiding the third row until the user makes a selection above makes it clear that it shows just the selection from above, and also keeps the initial dashboard uncluttered. Optionally, users can select a time span from the trend graph to select snippets by time, which updates the third row.
COBRA – A Visualization Solution to Monitor and Analyze CGMs
233
Each component shows the users’ selection, so they remember their context: selected pies are outlined in black, and the trend graph zooms into the selected time range. Each component also allows users to view the selected snippets’ text, or to apply the selected subset to the top search panel so it can be analyzed in a different tab. The end result is a very useful visualization that fulfills two roles. It provides an important high level view to give the user insight into the underlying dataset, and can be focused to find and isolate anomalies or spikes for deeper analysis. Taxonomies. The taxonomies visualization is useful for exploring the values of one dimension at a time, and allows drilling into one or more values to see the underlying documents. It is useful for exploring any dimension, whether it be a structured field originally present in the data (like source or author), or a dimension annotated by COBRA (such as brand or hotword). In addition, users can run automated text clustering algorithms to categorize their subset by text. These dynamic “text cluster” dimensions can be further modified through editing wordlists and regenerating the clustering, which can help create more meaningful clusters or isolate a subset based on text [3,4].
Fig. 3. The taxonomies view
Relationships. This tab surfaces the relationship between values of any two dimensions. COBRA surfaces three different visualizations of the same relationship data: relationship matrix, relationship table and a relationship network graph. The relationship matrix shows the raw relationship data as a sortable matrix. Each row represents a value of the first dimension, and each column represents a value of the second dimension. Each cell counts the number of documents containing both the
234
A. Behal et al.
value of the row and column. We add a normalized affinity value to the cell, which represents the significance of the count. This affinity value is used to color code each cell, with a red color calling attention to cells with high affinity. Clicking on a row or column header sorts the cells by affinity to a particular dimension value. Geoniem et al. showed that matrix representations outperform node-link diagrams for large or dense graphs in several low-level reading tasks, except path finding [5]. This matrix view is very useful to surface high-level structures, like communities, by finding good permutations of their rows and columns, which are difficult to spot in the relationship or graph views.
Fig. 4. The color coded relationships matrix visualization
The relationship table allows a more navigational, drill down view of the data so users can explore the relationship data one row at a time. Users are presented with a list of individual values of the first dimension, which can be selected to see the related values from the second dimension, along with counts and affinites. The relationship network graph shows the entire matrix at once by creating a bipartite network graph using the cells as edges between nodes representing the rows
Fig. 5. The relationships table allows users to drill in one row at a time
COBRA – A Visualization Solution to Monitor and Analyze CGMs
235
and columns. Graph visualization is an intuitive way to discover and visualize nodelink structures in complex relations and outperforms matrix view and relationship view in critical path finding. We show the top edges corresponding to the highest affinity cells, and allow the user to control the number of edges displayed to reduce the visual clutter, so they can see more important data.
Fig. 6. The relationships network graph visualization
Key Influencer. This tab allows users to pinpoint the key influencer of the ideas in a particular subset. It identifies websites most frequently referenced from the documents in the subset, which might influence the content of the CGMs. It also shows the top website the pages are from, to identify where the ideas are being posted. The look and feel of this tab is similar to the taxonomies tab. Sentiments. This tab surfaces positive and negative sentiments in snippets, which are derived using sentiment scores of the words in the snippet[6]. Instead of just displaying the number of snippets with positive or negative snippets, we allow users to correlate sentiment with a dimension of their choice. We will use an intuitively useful dimension “brand” in our example, as it shows clients which brands have the worst or best sentiment. However, the country or TextCluster can also provide useful results. We provide a sortable color-coded co-occurrence table at the top. This can be used to easily pick out the most positive or negative brands. The user can also filter the rest of the analysis to just selected brands by selecting one or more rows. We also present the user with the positive and negative trend stack plots side by side to convey sentiment’s time evolution and strength. The graphs are also highly interactive; clicking within the graphs narrows the dataset by the selected dimension, and dragging across selects a time range. As with most COBRA visualizations, users are provided with the text of snippets if they select a particular brand or time range. We highlight the positive and negative words in the text, so users can determine the meaning behind the positive or negative sentiment rating.
236
A. Behal et al.
Fig. 7. The sentiment visualization shows positive/negative trend graphs, and document text
Search Results. COBRA provides users with a traditional faceted search results view of their selected dataset. A facet tree on the left allows the user to quickly drill down to further narrow their dataset, and an stackplot graphs the number of documents versus time. The snippets and their documents are also shown below, in a list that is easy to sort and page.
Fig. 8. The search results view showing a tree view, trend graph, and document text
COBRA – A Visualization Solution to Monitor and Analyze CGMs
237
4 Monitor Monitoring new data on a daily basis is important to clients that wish to monitor their brand’s social reputation real time. To facilitate that, the “Alerts” tab allows users to easily isolate documents within a given date range, such as ones from the past business day or week. A tree view at the left shows the distribution of snippets across models and brands, which can be used to filter the data shown in the rest of the screen. The alerts summary at the top shows the count and the most typical snippet for each intersection of alert causes and brands. Drilling into an alerts surfaces the underlying documents, with the alert causes highlighted, so users can decide if an alert poses any business risk.
Fig. 9. The alerts view with tree view, summary table, and underlying documents
5 Conclusion This paper described a web based visual analytics solution that surfaces COBRA’s reputation monitoring and analysis capabilities. The solution provides a suite of interactive visualizations that run textual and statistical analysis, and use progressive information disclosure to allow human validation of the results. Our tabbed interface provides a contained experience that quickly conveys the application’s capabilities to first time users. Combined with our search panel, we provide a relatively flat learning curve for users to monitor reputation alerts, search and analyze the dataset, and perform analysis chains. This combined approach has been tested in user studies and client engagements, and provides users with a flexible yet easy to use CGM monitoring and analysis solution. Moving forward, we plan on surfacing more analytics visualizations. In particular, we will be surfacing deeper word level statistics. Also, we plan to allow more customization of the analytics components and layout, to suit different business and user requirements.
238
A. Behal et al.
References 1. Spangler, S., Chen, Y., Proctor, L., Lelescu, A., Behal, A., He, B., Griffin, T.D., Liu, A., Wade, B., Davis, T.: COBRA - Mining Web for Corporate Brand and Reputation Analysis. In: IEEE/WIC/ACM, International Conference on Web Intelligence, pp. 11–17 (2007) 2. Kieliszewski, C., Cui, J., Behal, A., Lelescu, A., Hubbard, T.: A Visualization Solution for the Analysis and Identification of Workforce Expertise. In: Smith, M.J., Salvendy, G. (eds.) HCII 2007. LNCS, vol. 4557, pp. 317–326. Springer, Heidelberg (2007) 3. Behal, A., Chen, Y., Kieliszewski, Y., Lelescu, A., He, B., Cui, J., Kreulen, J., Rhodes, J., Spangler, S.: Business Insights Workbench – An Interactive Insights Discovery Solution. In: Human Interface and the Management of Information. Interacting in Information Environments, pp. 834–843. Springer, Heidelberg (2007) 4. Spangler, S., Kreulen, J.: Interactive methods for taxonomy editing and validation. In: ACM CIKM (2002) 5. Ghoniem, M., Fekete, J.D., Castagliola, P.: On the readability of graphs using node-link and matrix-based representations: a controlled experiment and statistical analysis. Information Visualization 4(2), 114–135 (2005) 6. Cai, K., Spangler, S., Chen, Y., Zhang, L.: Leveraging Sentiment Analysis for Topic Detection. In: 2008 IEEE/WIC/ACM International Conference on Web Intelligence and Intelligent Agent Technology, pp. 265–271 (2008)
Visual String of Reformulation Arne Berger, Jens Kürsten, and Maximilian Eibl Chair Media Computer Science, Technical University Chemnitz, Strasse der Nationen 62, 09107 Chemnitz, Germany {arne.berger,jens.kuersten,eibl}@informatik.tu-chemnitz.de
Abstract. An interface for query reformulation based on multimedial search widgets is proposed. It allows the co-existence of widgets for unambiguous intellectual metadata and vague, automatically annotated metadata. Keywords: customization, interface, multimodal, query reformulation.
1 Visual String of Query Reformulation The interdisciplinary project SACHSMEDIA conducts research on automatic audio, image and video annotation, high-level semantic metadata, and a user-centered interface approach for combining the above in one information retrieval system. SACHSMEDIA is a joint project of Technical University Chemnitz (Germany), selected solution providers for television production workflow, as well as local TV stations in Saxony (Germany). The project is financed by the Federal Ministry of Education and Research (Bundesministerium für Bildung und Forschung). Our work reflects the information retrieval needs of those TV stations for their growing multi-media repositories, as well as an incorporation of the constantly growing opportunities arising from automatically annotated metadata. This paper summarizes the efforts undertaken to form a fully customizable, user-adaptable textbased retrieval interface based on widgets, reflecting the TV stations' needs for a clean and fast multi-media search interface. It also incorporates graphical search widgets for retrieval based on fuzzy automatically annotated metadata, for evaluating the later under real working conditions and for supporting a more open searching/browsing approach. Our aim is to bridge three gaps in modern information retrieval graphical user interfaces: 1) Heterogeneous user population Text-based retrieval suits many users fine, as daily work usually consists of known item searches, for which textual interfaces are sufficient. However, as the user population is heterogeneous, customized search interfaces improve user satisfaction significantly. 2) Modal gap Plain text-based retrieval is not sufficient for all emerging tasks. It leads to user frustration and confusion, as it requires the user to repeatedly switch their mental M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 239–248, 2009. © Springer-Verlag Berlin Heidelberg 2009
240
A. Berger, J. Kürsten, and M. Eibl
model while refining and reformulating a query. Current multi-media information retrieval is the iterative task of searching, browsing, then editing the query for refining, then browsing. We propose an interface model for searching and refining in order to reduce this modal gap. 3) Content based retrieval approaches We propose a solution for merging information retrieval concepts for multiple media. From a user perspective, there is an out-dated paradigm that automatic audio, image and video annotation, content clustering and ontology browsing reside in separate interfaces. We offer a conceptual model to overcome this by implementing distinct retrieval approaches into one retrieval interface.
2 What End Users Do (And Don't Do) The design view User studies and user evaluation are essential in HCI, we learn. But then, a mere “thumbs up” from a small percentage of a proposed user population is usually sufficient for a product to get a go for implementation. This kind of interface evaluation is the reason why so many interfaces fail to give the feeling that it “fits” like a custom tailored suit. Even worse, software nowadays often succeeds in giving a feeling of comfort, by crippling the softwares' possibilities. While Maeda's design approach [8] is groundbreaking for tailoring usable software that fits for large user groups, it still lacks the flexibility of a custom tailored interface, deriving from an indepth user understanding, and resulting customization. [4], [6] What end users do (and don't do) The end-users we work with are professional researchers, editors and account executives at German TV stations. Every TV station annotates and archives their own footage for later retrieval. Those archives are constantly growing, containing multimedia data that is poorly intellectually annotated and fully lacking high-level semantic metadata. Our research purpose is to support end users with interfaces for easier annotation and retrieval, focusing on encouraging them to add more intellectual metadata when adding footage to the TV stations' archives. Additionally, the archive software must be suited to all (about 70) involved TV stations for later connection and interchangeability. The metadata scheme that we applied is “Regelwerk Mediendokumentation” (system of rules for media documentation from ARD) [20], comprising of 70 metadata fields for annotation of intellectual metadata. Extensive site visits and user studies at seven selected TV stations showed a lot of insight: To start out, we found out that many users are involved in creating an individual program, but they differ greatly in their knowledge about it. But no user involved has the time or the skills to collect all metadata from all involved users and add those to the archive. We studied in depth how the TV stations handle their annotation and search tasks. The following example is prototypical for the distribution of knowledge between individual users. One user was asked to find an individual program. The user shared an office with three co-workers and began to voice her associations with this program. Someone in
Visual String of Reformulation
241
the office remembered that the production in question was commissioned. This prompted the account executive to browse the account book for the client in order to approximate the date of the program. There had been only two commissions by the client in the last two years. This information allowed the editor to search all the tapes from the time in question, tracking down the tape and using the label to find the program's position on the tape. As the users are all aware that their archives are poorly annotated and wish to change it, they are willing to contribute their knowledge about the productions they are involved in for annotation. Based on the findings of the site visits an annotation workflow like this is plausible:
Fig. 1. Annotation Workflow
For our first annotation & retrieval prototype, we examined the three main user groups at the TV stations and asked them to sort all those 70 metadata fields that are searchable and may be annotated, according to a) their relevance for the single user's information needs and b) into metadata sets (groups) of thematic coherence. Not surprisingly, the output showed significant patterns in information need, the metadata selected and the user's engagement in the broadcasting process. Structured qualitative interviews showed that users are willing to annotate more metadata when the annotation interface reveals only those metadata for annotation that are relevant for the user's current involvement in the production cycle. Additionally, users were likely to add more production related metadata than already included. Account executives, for example, have been keen to add additional metadata to Regelwerk Mediendokumentation. As they tend to remember names of people in the footage more, they demanded complete customer contact information as metadata for the single programs. Concluding this, we decided to sort metadata fields into the proposed sets and offer an option to add sets with additional metadata according to the TV stations' needs. This allows every user to get their own metadata annotation sets according to their production involvement. The annotation tool was structured accordingly. Going back to the associated search example at our site visits, properly annotating intellectual metadata was only part of the problem. A second finding of the site visit is that users are highly interested in customizable retrieval interfaces according to their different information needs. The information need usually lies somewhere between
242
A. Berger, J. Kürsten, and M. Eibl
the quasi-standard one query input field approach on the one hand, and an expert search interface with around 70 input fields and adequate combination options for a search in all available metadata fields that are annotated, on the other hand. Using two iterations of paper prototypes, we tested whether an interface for retrieval that was structured similarly to the annotation interface would also enhance user satisfaction. Users instantly made a connection between the annotation and retrieval tool and wanted to use the customizable retrieval interface accordingly. A quantitative comparative evaluation of the performance of our interface versus an ordinary expert search will be conducted at a later stage, but interviews look promising.
Fig. 2. Custom Text Widgets
3 Content-Based Retrieval Based on the finding that widgets suitable for only a small, distinct task are helpful for a step-by-step query specification and reformulation, we expanded this idea to multi-media query formulation. This makes sense in two ways. To begin with, users told us they are constantly in need of better search results, mostly because intellectually annotated metadata are not sufficient. Secondly, users are looking for less restricted ways to formulate queries in their daily work. They are aware of automatically annotated metadata, the chances they offer and the drawbacks they currently have. Users are willing to sacrifice their current fixed text based retrieval systems for a more open way to formulate queries. They are also willing to sacrifice some precision at first – if they are allowed to refine their queries using other widgets at hand when it becomes necessary later on. The above findings of high user acceptance enable us on a technical side to enhance the TV stations' archives with rich high-level semantic metadata without compromising the users' faith in the retrieval engine. In the SACHSMEDIA project, we are attempting to solve the recognition of persons via facial and voice recognition, to be included in the retrieval system. However, it is also plausible to include previously solved parts of our research findings in distinct widgets. Those steps include OCR in the lower third of the screen or automated detection of the presence of persons. It is plausible to include those examples as widgets in a retrieval system, but they alone would not automatically justify a stand alone application.
Visual String of Reformulation
243
Fig. 3. Graphical Widgets
In the information retrieval community, a lot of search engines based on high level metadata are used that are helpful in many ways for distinct retrieval tasks, but are – in and of themselves – not always sufficient for sophisticated search tasks in a professional work environment. Formulated in widgets and combined in a query formulation and reformulation flow, they would be much more useful. There are sketch-based image search engines like “retrievr”, or engines that focus on drilldowns in content clusters such as “cuil” or “quintura”. Tools that feature image search based on the color distribution of the images includes “xcavator”. What is available for searching videos and music is text-entry only and includes “seeqpod” and “veoh”. [21], [22], [23], [24], [25], [26]. Unfortunately, there is a gap between what search applications are possible, and what search applications have already been combined in one interface, as most retrieval systems focus on just one issue. That is why we widened our user-driven approach to engage retrieval experts working on content-based information retrieval. We conducted qualitative interviews with those experts, and they all focus on only one of various different annotation and retrieval concepts which are insufficient to form a distinct search experience for a multi-media repository on their own. As the possibilities in analyzing image, speech and temporal features grow, our proposal can also be used as a model for creating distinct widgets. These widgets contain only those interface elements needed for one distinct query part, corresponding to one specific retrieval concept. Combining them into one search interface would significantly enhance the possibilities of information retrieval.
4 Reformulation Search is an iterative process. This has been thoroughly discussed in, among others, the classical model [13] or the 5-phase framework [15]. The query is iteratively reformulated after an inspection of the results until relevant information has been found. There is a difference between direct and explorative search. Methodic search includes alternating search and browsing. I'm feeling lucky basically trusts the retrieval engine's first suggestion. Our approach focuses on the techniques most frequently performed in the work environment of TV stations: query reformulation and methodic search. On the rare occasion that a user actually performs a known item search, a textbased query or query by example is sufficient. But most of the queries are so vague that users just hope to find something similar to their mental reference, needing to refine their query substantially. Typically, users start out with a short query and
244
A. Berger, J. Kürsten, and M. Eibl
Fig. 4. Retrieval Tasks
incrementally modify their query after inspecting the results, slowly forming a string of reformulation emerging in their heads. The back and forth of re-editing the textbased query leads to an iterative modal break and obstructs the users' string of reformulation as previous versions of the text-based query are no longer present after editing. Moreover, there is no tool to visually memorize all the steps taken in the reformulation. Our proposed interface is based on a graphical metaphor for reformulating multi-media information need. It allows end-users to begin with an initial query, then to add more queries in the form of interface widgets in order to narrow down the search results, all while maintaining a graphical representation of the performed queries. This visual string can be edited.
Fig. 5. Widgets & Flow Of Reformulation
We worked out a basic set of various text-based widgets based on users' needs. We also established design guidelines for producing interface widgets that adhere to our conceptual model. Textual widgets can be individually modeled based on a design styleguide and an XML schema. Additionally, we created graphical widgets built on top of the current research status at SACHSMEDIA for automatic multi-media annotation, and included those as well. This allows end-users to use the most appropriate search widgets for a step-by-step reformulation of their queries according to their needs.
Visual String of Reformulation
245
Based on the rich possibilities of contemporary interface design for creating interactive widgets and a user centered customization approach, we like to advance the common filter/flow metaphors for open multimedia repositories, content-based metadata and unpredictable, vague queries. Shneiderman [16] proposed the metaphor of water flowing through filters for a visual representation of boolean query formulation. In his evaluation, users not familiar with Boolean algorithms, showed significant better search results and user-satisfaction compared to using SQL-syntax. However, Shneidermans concept was only applied for searching in closed databases with descriptive metadata. Repositories have grown ever since and most end-users still do not understand Boolean query formulation properly. Jones proposes Venndiagrams [7] in a similar approach to visualize reformulation. With concepts like the Islands Interface [3], Sentinel [9] or InfoCrystal [18] the basic concept is too difficult for user acceptance. That is why expert search systems nowadays focus on more basic metaphors restricting users to more basic ways of query reformulation. The mismatch between these two concepts still persists. Krause coins it like that: users don‘t want to think about how to interact with a system. On the other hand they insist to adapt to a predefined flow because it feels like narrowing their possibilities. [2] This is the reason we like to let users form their own flow as precise or vague as adequate, leaving it in the users hands to formulate simple or complex queries all within one conceptual model, expanding the visual string accordingly. 1. Widgets: According to Krauses model [10] every widget is conceptionalised as a tool with three capabilities or usage sides. On the users side the widget acts as the most suitable tool according to the users capabilities and knowledge and the query at hand. Although possibilities for interaction are pretty endless here, text based widgets may dominate professional work environments for a while. But basic content based retrieval widgets are already successfully implemented for distinct tasks and are helpful as query terms for reformulation. More complex widgets will be useful for more complex tasks and specific users. Developers and designer may create or customize widgets according to emerging user needs and technical possibilities. As the visual string is already evaluated as usable, distinct widgets may be compared against each other for user acceptance and usability. On its system side the widget transforms the text- or graphic based query to XML the retrieval engine can process. It also features a meta side for valuing its own capabilities (precision/recall) and dependencies (to previously submitted query terms). 2. Flow: Current retrieval interfaces lack any user accepted visualization of the query reformulation process. To visually formulate a multi term query, the widgets may be ordered next to each other. Our proposal lets users position widgets vertically below each other, to combine query terms for reformulation. Our findings show that when users drill down results by adding a widget in order to add another query term for reformulation, they expect widgets to be AND-ed when connected vertically, as single queries from within a widget are also AND-ed. Accordingly, a horizontally added widget will be interpreted as an OR. NOT is an option included in each widget to exclude its term from the query. Removing a search widget eliminates this query term. For a single term known item search users may just use one widget.
246
A. Berger, J. Kürsten, and M. Eibl
5 Discussion From Objective to Subjective: We have discussed the everyday dilemma of heterogeneous user population, as well as the co-existence of unambiguous intellectual metadata and vague, automatically annotated metadata, and ways of handling these in a working environment. From a design-oriented perspective, this is more of an advantage than a drawback, as it demands less dualistic forms of interface design and evaluation. From Quantitative to Qualitative: The mantra of the many right ways is a conceptual thread fundamental to this paper and demands an even deeper investigation. Building on top of what is currently being practiced as “qualitative evaluation” [6], we are categorizing scenarios that profit from users' subjectively ideal interfaces. On the other hand, we are also looking into ways to derive subjective instantiations to be integrated in more quantitative scenarios that usually focus on the “objectively good” interface. Interpretation: It is the designer's job to support users in the interpretation of the system. [18] As the interface is the entry point to a search engine that provides exact and fuzzy results, it has to be interpretable and usable as such for the users. The designer's goal is not to propose a generic search interface that will fit most users and imaginable retrieval scenarios, but to create one that adapts well to different users and various precision/recall ratios, and the users' according expectations and interpretations. The interface therefore has to reflect the range of low level content analysis up to the highest level of sophisticated metadata for the users' interpretation. In this context, a more exact or more vague retrieval outcome has to be communicated. Interface design, incorporating graphic design to a greater extent, will help, managing the increasing complexity of usage scenarios as well as the problem of visualizing various retrieval outcomes. Taking into account that different users and heterogeneous user groups will interpret different retrieval outcomes differently, the system has to communicate actively to the user its current state of helpfulness and therefore its skills. Users' feelings and demands have to be considered more carefully and in all phases of the project. That is: qualitative insight counts more than quantitative insight, as the system instantiates itself differently in certain stages and to different users. There is a range of possibilities offered by the system, and a range of interpretations. Both have to be considered for evaluation. The user interface has also to take into account that users' goals might differ significantly from task to task. It has to stay open for interpretations of what is searchable and how precise this could possibly be.
6 Future Work With the future incorporation of context-aware interpretation of the users' knowledge and tasks, as well as the repository and its metadata, the blurring of what objective/subjective serves the information need, gets more apparent. Suitable ways
Visual String of Reformulation
247
of analyzing tasks on micro, meso and macro layers [14] have to be found and applied for evaluation and for implementation of a recommender system. Two more problems will be discussed in our future work. The next step is an evaluation in comparison to an ordinary expert search, assessing the users' thoughts on the quality of the retrieval outcome. Secondly, we are working on several ways of visualizing the retrieval outcome more efficiently and in a more inviting manner for browsing – in favor of another modal gap in need for closing. Multitouch interfaces look promising for that, as they may easily incorporate the current work on query reformulation and magic lenses as filters. Along with a more efficient and more usable result visualization, this will help users switch more seamlessly between the modalities typical for known item searches and explorative searches.
References 1. Bates, M.J.: The Design of Browsing and Berrypicking Techniques for the online search interface. Graduate School of Library and Information Science, University of California at Los Angeles (1989) 2. Bauer-Wabnegg, W., Krause, J.: Visualisierung und Design - Grundlagen von Softwareergonomie und Mediendesign. Universität Koblenz-Landau (2003) 3. Brooks, M., Campbell, J.: Interactive Graphical Queries for Bibliographic Search. Journal of the American Society for Information Science (JASIS) 50(9), 814–825 (1999) 4. Buxton, W., Greenberg, S.: Usability Evaluation Considered Harmful (Some of the Time). In: Proceedings of the ACM CHI 2008 Conference on Human Factors in Computing Systems. ACM Press, New York (2008) 5. Hearst, M., et al.: Finding the flow in web search. Communcations of the ACM 2002 45(9) (2002) 6. Ireland, C.: Qualitative Methods: From Boring to Brilliant. In: Laurel, B. (ed.) Design Research. The MIT Press, Cambridge (2003) 7. Jones, S., McInnes, S.: A graphical userinterface for Boolean query specification. International Journal on Digital Libraries, 207–223 (1999) 8. Maeda, J.: The Laws of simplicity. The MIT Press, Cambridge (2006) 9. Knepper, M.M., Killiam, R., Fox, K.L.: Information Retrieval and Visualization using SENTINEL. In: Proceedings of the Trec-7 Conference, pp. 393–397 (1997) 10. Krause, J.: Das WOB - Modell - Zur Gestaltung objektorientierter, grafischer Benutzungsoberflächen. In: IZ Sozialwissenschaften. Universität Koblenz-Landau, Bonn (1996) 11. Pangaro, P.: Design as I see it, http://pangaro.com/design-is/index.html 12. Pangaro, P.: Participative systems, http://pangaro.com/PS/index.html 13. Robertson, S.E.: Theories and Models in Information Retrieval. Journal of Documentation 33, 126–148 (1977) 14. Russell, D.M.: What are they thinking? Searching for the mind of the searcher. Invited presentation, JCDL (2007) 15. Shneiderman, B., Plaisant, C.: Designing the user interface. Pearson, Boston (2005) 16. Shneiderman, B., Young, D.: A Graphical Filter/Flow Representation of Boolean Queries. Journal of the American Society for Information Science 44, 327–339 (1993) 17. Sengers, P., Gaver, W.: Staying Open to interpretation: Engaging multiple meanings in design and evaluation. In: DIS 2006 (2006)
248
A. Berger, J. Kürsten, and M. Eibl
18. Spoerri, A.: InfoCrystal: a visual tool for information retrieval & management. In: Proceedings of the second international conference on Information and knowledge management, Washington, D.C, pp. 11–20 (1993) 19. Stempfhuber, M.: Towards Expressive and User friendly interfaces for digital libraries containing heterogeneous data. In: Eibl, M., Wolff, C., Womser Hacker, C. (eds.) Designing Information Systems. Festschrift für Jürgen Krause, pp. 198–208. UVK Verlagsgesellschaft mbh, Konstanz (2005) 20. Regelwerk Mediendokumentation, http://rmd.dra.de/arc/php/main.php (last visited, February 1, 2009) 21. http://labs.systemone.at/retrievr (last visited, February 1, 2009) 22. http://xcavator.net (last visited, February 1, 2009) 23. http://www.cuil.com (last visited, February 1, 2009) 24. http://www.quintura.com (last visited, February 1, 2009) 25. http://www.seeqpod.com (last visited, February 1, 2009) 26. http://www.veoh.com (last visited, February 1, 2009)
Industrial E-Commerce and Visualization of Products: 3D Rotation versus 2D Metamorphosis Francisco V. Cipolla Ficarra1,2, Miguel Cipolla Ficarra2, and Daniel A. Giulianelli2 1 2
ALAIPO: Asociación Latina de Interacción Persona-Ordenador AINCI: Asociación Internacional de la Comunicación Interactiva HCI Lab. – F&F Multimedia Communic@tions Corp. Via Pascoli, S. 15 – CP 7, 24121 Bg, Italy [email protected], [email protected]
Abstract. In this current work we make a study of communicability in industrial websites designed for the on-line sale of products, bearing in mind two kinds of 3D rotational animations, and 2D transformations. A table will be presented for the assessment of the communicability of the objects within e-commerce, in particular those which use mobile phones and the Internet. Also presented will be guidelines for qualitative design that may be employed without the need for a usability lab. The universe of study consists of 20 websites, randomly chosen from a total of 200. The contents of these websites is related to electronics, mechanics and renewable energy. Keywords: Visualization, Rotation, Metamorphosis, Computer Animation, Communicability, User-Centered Design, Quality, E-commerce.
1 Introduction One of the main problems in the evolution of hypermedia systems is the amount of visual information that can be presented in the interface, bearing in mind the diverse dimensions of the screens of the personal computers and other devices that hold a CPU; such as a PDA. Obviously an image, and especially a high definition 3D image with the possibility of mobility in 360º, can tell more than a thousand words. Obviously there are exceptions in the case of designs tending to damage the communicability as is the case of the ambiguity of icons or the vagueness of the content [1], [2], [3]. In these situations some claim that the veracity of the image disappears and it is necessary to resort to the text [4]. However, in the new millienum the digital image is taking a bigger space inside the workplace and the home, through the screens of a bigger dimension and greater resolution for the videoconferences or the fruition of films [5]. Many of these images are emitted thanks to a computer, others, in contrast, are mere electronic devices but which can admit interaction as is the case of the interactive blackboards or the Nintendo Wii, for instance. The new organic interfaces are quickly generating a new way of interacting with 3D images [6]. The user can choose and freely manipulate in the space and virtual scenarios. Perhaps it is an ideal solution to solve the problem of the balance sensation that certain virtual M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 249–258, 2009. © Springer-Verlag Berlin Heidelberg 2009
250
F.V.C. Ficarra, M.C. Ficarra, and D.A. Giulianelli
reality environments generate. As almost always happens with these breakthroughs made with computers, the market aim prevails over the educational purpose. Therefore, the commercial sector, marketing, publicity, etc. are the first to ue them. In some cases, the members of this sector resort to art, tourism, ecology among other contexts to draw the user's attention. Not for nothing we are moving towards an era of hypermedia immersion inside the home, starting with sport videogames (tennis, golf, football, etc.) which work with the physical and real movement of the users in such devices a the Nintendo Wii. That is to say, it is about creating a virtual environment around the user so that he interacts with the new technologies inside the home [7]. In the current work we present the importance of the off-line and on-line art-related multimedia systems to draw the attention of the user towards the use of the computer to visit real museums. That is to say, the transition from a user to a visitor. Then an investigation is amde of virtual characters to draw the attention in the consumption of products and the current evolution in the presentation of products mimicking 3D.
2 Art and 3D Navigation There is a tendency of the user to try to get inside the digital images themselves, especially in works of art of renowned international artists. As a rule this is something that is done in the home with the purpose of entertainment. These are users who avoid resorting to the technology of virtual reality due to the high costs involved which even today implies a need for glasses and gloves for the fruition of virtual reality in many European homes. However, this interaction in some hypermedia artistic products and of optimum quality was possible in off-line supports. An excellent example was the Van Gogh CD-ROM of the late nineties [8]. Tridimensional navigation through the pictures of the Dutch artist makes it possible to go deep into each one of the objects that make up the image, giving unique perspectives and a priori imaginable by the users [9]. With the momentum of Internet there is a growing demand in the design of interfaces to obtain the maximum possible visual information (dynamic and static). Some bidimensional resources such as transparencies and blurring of the pictures are beginning to be insufficient with the Web 2.0 and Web 3.0 [10]. The users need to see in a global way, the results of their on-line searches of videos, animations, photographies, maps and other digital images. Obviously, this operation is feasible if their dimension is considerably cut down in the monitor. Another alternative are the mural pictures or dynamic blackboards where the different interfaces are being displayed in a row. Some applications for this purpose are Searchme and Spacetime (navigator in 3D, which needs to be installed in the computer). Also the Windows Vista operating system offers in its most advanced editions this mode of visualization. Digital tridimensionality takes the ambition of use of the perspective a step further, which has been to plunge us inside the image, making coincide the ‘scape point’ with our point of view [11]. A more recent example is the voyage to the inside of the main works of the El Prado Museum through Google Earth (figure 1). Although the exhibit rooms can't be roamed about freely, sight simulates entry to the museum and presence in front of a picture. This can be seen down to the slightest detail, widening the resolution of the paintings until details are found which are inappreciable in the natural size. After
Industrial E-Commerce and Visualization of Products
251
Fig. 1. El Prado Museum through Google Earth
exploring the work, the user can analyze the works without the need of going to successive frames. That is to say, there is a kind of sequentiality in interactive immersion. These are the new possibilities of counting on a fluent interface which lacks the transitions among the spaces that are visited and which boost and motivate the fruition of the artistic works. This interactive artistic communication process in which the user must merge with the content has been widely experienced in the virtual reality environments [12]. However, the experiences in multimedia off-line commercial products have demonstrated a great acceptance by the young and adult users, thanks to the richness of the colours or the novelty of navigating inside the pictures without a need of having available the typical peripheric of virtual reality: glasses, gloves, etc. The strength of the traditional audiovisual means is greater among the adult users than among the young who have interacted from an early age with tvideogames consoles, multimedia phones and internet. Many of this new generation of users have learned to use systems in an autonomous way or accompanied by virtual assistants [13]. These animated assistants usually have a very important role in the motivation and fostering of interaction. However, they have not been massively included in the sale of products and on-line services.
3 Audiovisual, Computer Animation and Morphing If we make a diachronic study of the current animations we see that the cinematographic principles still stay in force in the computers. Digital animation may be relatively new in hypermedia systems, but the designers, programmers and other
252
F.V.C. Ficarra, M.C. Ficarra, and D.A. Giulianelli
professionals of the audiovisual sector usually have experience and/or cinematographic knowledge. That is to say, these specialists have expertise that has been passed down from those who have been animating since moving pictures were first invented. Their knowledge and experiences have been translated to animations using computers. The diffusion of the animations by computers is also due to the progress of graphic informatics and to the reduction of the cost of hardware in the 90s. Although the personal computer makes the creation of 2D and 3D easier to generate and easy to modify, it is essential to have the theoretical knowledge of the classic animation of the 40s. In regard to commercial software for animation and considering only polygonal modeling, the different programs are similar. That is, there is a tendency to create a common denominator inside the animation software, regardless of the hardware which has been used. The design of the off-line multimedia systems has also made a contribution in this sense, and to the interfaces of the operating systems. This possibility of changing shape in a single space on the screen, where metamorphosis has an essential role. The origin of metamorphosis lies in polygonal modeling [14]. The foundations of polygonal modeling are simple because they are based on three main elements: the vertex, the edge and the polygon. There are a set of operations to manipulate these main elements such as: extrusion, leveling, cutting, joining, lengthening, etc. A 3D animation may arise from a 2D drawing, through the use of the scanner or its realization in 2D and later to insert the ‘z’ coordinate or to scan 3D objects directly, for instance. In both cases it is a priority to maintain the concept of simplicity in animation of the character and its environment because of the costs factor. The 3D commercial programs have a high number of options to build up a virtual character (in the current work we use the terms of animated and virtual character as synonymous). In the modeling of geometry it can be polygonal, nurbs, etc. and it can be generated as a single entity (it is more complex at the moment of carrying out special changes or movements) or to divide it in the parts that make it up, as in the classical drawing mannequin. This segmentation is ideal for virtual characters of the robot kind, and they are usually positively accepted by the users in the teaching process. The realistic characters, that is, emulators of human characters and animals are usually not segmented. However, it is advisable to segment them in their main parts, so that the construction, eventual modifications and animations are faster, since the computer does not have to calculate complex changes in real time. The qualitative disadvantage from the visual point of view is that sometimes these articulations are perceived by the users. A way to solve the problem is through items of clothing, for instance, gloves, trousers, belts, ties, necklaces etc. In the case of these items of clothing, in order to gain realism to using textures in real tissues is a positive course of action. In our universe of study we have not detected virtual characters for the presentation of objects with metamorphoses, for instance. The animation of the objects with metamorphoses may be of two kinds: automatic as in the case of the Italian Design off-line multimedia system [15] (figures 3 and 4), or manual. In the latter case the user has the possibility of swinging the product on the axes x-y-z. Next an example on-line where the user can see each one of the sides of the mobile phone. In some publicity banners it is feasible to find changes of automatic objects (photographs) and the possibility of changing manually the colour of the components, as is the case of the photo cameras from the following example:
Industrial E-Commerce and Visualization of Products
253
Fig. 2. The user can see each one of the sides of the mobile phone (3D rotation)
Fig. 3. Motorcycle morphing (start frame)
Fig. 4. Motorcycle morphing (end frame)
3.1 Morphing and Users There are numerous studies currently that show the high number of variables to be considered at the moment of presenting information in the classical bi-dimensional screens of devices such as computers, e-books, PDAs, etc. [16]. The problem that arises in the international sale and merchandising of industrial products of a similar type is that the products’ unique details and characteristics are not immediately visible to the user (for example, internal components details, material, structure of the products, etc.) Therefore, it is necessary to draw the attention of the user to the product, and eventually to its main details. One solution is to resort to holeography or virtual reality. However, due to other factors, especially the cost of the hardware and
254
F.V.C. Ficarra, M.C. Ficarra, and D.A. Giulianelli
the software to do so, both technologies do not have the same circulation degree as a multimedia phone or iPhone, for instance. Consequently, many manufacturers resort to the use of rotation over the ‘y’ axis of the product in order to see each one of its external aspects. This is particularly the case when we talk about finished products where design is an important factor for its purchase, where potential distributors all around the world are concerned. Obviously, this is a low cost solution if you have the product in a tri-dimensional format, that is to say, if the design has been in advance. Otherwise, making these products may entail high costs because of the time that this involves and the staff that are required. Another alternative is to resort to the transformation or bi-dimensional morphing technique. As a rule, it is a bi-dimensional animation that works on the ‘y’ and ‘x’ axes. Obviously, the possibility of emulating the ‘z’ coordinate in the bi-dimensional metamorphosis exists, through the use of visual perspective and shadows. One can resort to digital photography or graphics databases where obviously, the costs are lower than using 3D [17]. Bi-dimensional metamorphosis usually has a great initial impact on the user, that is to say, the power of drawing attention to the products is superior to that of the simple rotation of a product in one of the three axes. Nevertheless, depending on the culture to which the users belong, the use of this type of animation transformation can encourage users to read publicity banners, for example. Another of the variables to be considered when choosing websites with morphing or rotations is the temporal factor. The rotation movements inside the objects that make up our universe of study have demonstrated that the user feels an identification with the present, whereas metamorphosis breeds a communicative empathy with the past. Rotation and morphing in the context of graphic computer science can be included in the set of operations of object transformation [14]. The rotation in graphic computers consists of making an object spin in some of the following axes in the case of bidimensional objects: x e y or x,y,z, in 3D objects. With simple trigonometric calculations it is feasible to determine the coordinate of a spot, after the transformation in function of the original coordinates and the rotation angles that have been chosen. Now, in the case of the images or a selected region, some inconveniences may arise. The origin of these lies in the fact that some pixels may find themselves after the rotation in a position which does not correspond to the normal position of a generic pixel. In 90º operations the pixels are in the right position, in the rest of the cases it is necessary to carry out an interpolation operation, for instance. The rotations, translations and objects scales belong to the set of flat transformations. Some authors include morphing among the deformation operations [19]. Through these operations programs can be carried out which make it possible to turn an image into another, with a given continuity. This is achieved with an interpolation between two different successive images. The origin of this technique in the audiovisual media is to be found in the cinema, with the use of interrelated close-ups, that is, a series of images that overlap until reaching the final image [9]. In the tridimensional cinematographic framework there are numerous films about it, especially when one talks about special effects, for instance, A.I. Artificial Intelligence; I, Robots; Transformers, etc. Now in the case of morphing it is not always feasible to describe with an equation the transformation of the plan you want to apply. Therefore, there is an approximation, that is to say, we imagine the plan made up by a grid of irregular dots, the final image will be made up by a dotted grid, not necessarily regular, but
Industrial E-Commerce and Visualization of Products
255
Fig. 5. Escher Interactive –2D morphing in central area
from which it is possible to obtain the necessary information of the transformation law from each one of the dots on the grid from the initial to the final position. Therefore, by using an interactive program, the designer can modify the starting grid and later on the program will carry out the transformations in each point of the image. Next an excellent morphing example in a multimedia off-line system about Escher's works [20].
4 Metrics for Morphing The morphing is included in the animation set. The animations are components of the dynamic means of the systems. Consequently, the morphing must have a set of quality attributes such as animations. These quality attributes must be decomposed later on for their evaluation into primitives for their analysis. This is the strategy followed in our methodology, which is made up by a series of techniques for heuristic assessment stemming from communication and usability: observation, interviews and test with users, in the current work. These metrics are inscribed inside the context of software engineering. Concerning this, it is important to locate them following two authors like Fenton [21] and Pressman [22]. Fenton, N. [21] claims that measurement has a purpose to describe the attributes of the entities, but there are three kinds of entities inside the softwares, and each one of them is "aimed" at a given aspect of the software: • The processes (predominance of the temporal component) There is a short number of internal attributes which are applied directly in the processes: time that a given process last, required effort and the total of incidences of a given kind. The first works on the subject go back to 1972, and were aimed at improving the quality of the software and increasing the productivity of the programmers [23]. • The products (as results of the process). They include objects ranging from the lifecycle of the software, such as: specifications and level details or the strategy to be followed to carry out an examination. • The resources (components that intervene in the software process). The cost factor is the one that prevails here. The method that is presented cuts down considerably such expenses, by profiling the figure of the specialists in multimedia heuristic assessment.
256
F.V.C. Ficarra, M.C. Ficarra, and D.A. Giulianelli
The internal attributes of the product, of the process or the resources are those that can be measured in terms of: product, process or resources. Whereas the external attributes of the product, of the process or the resources can only be measured on the basis of how the product, the process or the resources are related to the environment. In some way the metamorphism applied to E-commerce is related to these three aspects. We have a temporal component to assess the transformation of the images in regard to the goal that is pursued in communication, for instance, to show details in a lesson over the evolution of a geographical area. In software engineering, Pressman [22] enumerates the following reasons for the justification of an evaluation: In order to indicate the quality of the product, to evaluate the productivity of the staff who participate in the production; to measure the benefits (productivity/quality) deriving from the use of new methods and tools of software engineering, and to support the professional training or the use of new tools. Therefore, according to Pressman, in relation to the goal to be reached it is possible to differentiate the following software metrics [22]: • Technical metrics: these refer to the software characteristics and not so much to the process that was needed to develop the software. • Productivity metrics: these are aimed at the production process. The statistical data are important in order to establish comparisons between the present and the past. • Quality metrics: these respond to how best to satisfy the needs expressed by the customer/user, and it is usability engineering and semiotics that occupies itself the most with these aspects, whether it is from the point of view of the interaction of the formal and factual sciences [24]. • Size-oriented metrics: through these, direct measures of the result can be observed as well as the quality of software engineering. • Function-aimed metrics: such metrics focus on the functionality or usefulness of the program. • Person-aimed metrics: they give information about the human point of view of effectiveness of the tools and of the used methods. They are the first target of study in usability engineering [25], for instance. Implicitly therein lies communicability. The set of metrics that has been used in the current method regards inside the quality metrics the intersection among those aimed at person [22]. It is the user who decides in E-Commerce which product to buy [26]. The quality of that decision lies in the possibility of viewing different perspectives of the virtual product. We believe it is essential that the virtual shops integrate presentation through the metamorphosis and mimicking of 3D. Obviously, there are products that are sold through the sense of touching, such as the textile, and little can be done by knowing such details about the tissue as color, shape, etc. The quality attributes and a first guide for the assessment of the quality that we have used in our research can be seen in annex #1.
5 Conclusions The current work has made apparent the scarce use of metamorphism in industrial E-commerce on-line. Although it is an instrument of great utility for explaining the
Industrial E-Commerce and Visualization of Products
257
details of components and is accepted in 98% of the studies made with users, currently the designers do not use it in the multimedia systems. Besides, instead of boosting the 2D or 3D products that are intended to be marketed, it has been seen that in 92% of the websites that the use of metamorphosis lies in the bidimensional publicity of the banners. The use of the metrics related to human-computer interaction, semiotics, the design models of multimedia systems and software engineering have made it apparent that those analyzed websites that use it have an excellent quality and are linked to the navigation tridimensional emulation on the computer screen. The off-line multimedia systems of the nineties have used the metamorphoses mainly in design and art contents. Some of the components of graphic, static and dynamic design, such as can be the guides or virtual assistants, are positive for the potential users of industrial products, however currently they are not resorted to in industrial E-commerce.
Acknowledgments Thanks to Emma Nicol (University of Strathclyde) and Maria Ficarra for their helps.
References 1. Nielsen, J., Tahir, M.: Homepage Usability –50 Websites deconstructed. New Riders Publishing, Indianapolis (2002) 2. Cipolla-Ficarra, F.: A User Evaluation of Hypermedia Iconography. In: Proc. Compugraphics, GRASP, Paris, pp. 182–191 (1996) 3. Cipolla-Ficarra, F.: An Evaluation of Meaning and Content Quality in Hypermedia. In: CD-ROM Proc. HCI International 2005, Las Vegas (2005) 4. Debray, R.: Vie et mort de l’image, Gallimard, Paris (1995) 5. Venkatesh, A.: Computers and Other Interactive Technologies for the Home. Communications of the ACM 39, 47–54 (1996) 6. Ishii, H.: The Tangible User Interface and Its Evolution. Communications of the ACM 51, 32–36 (2008) 7. Lundgren, S.: Designing Games: Why and How. Interactions 15, 6–12 (2008) 8. Missione Van Gogh CD-ROM. L’Espresso, Roma (2000) 9. Manovich, L., Kratky, A.: Soft Cinema –Navigation the Database. MIT Press, Cambridge (2005) 10. Silva-Salmerón, J., Rahman, M., El Saddik, A.: Web 3.0: A Vision for Bridging the Gap between Real and Virtual. In: Proc. 1st workshop communicability design and evaluation in cultural and ecological multimedia systems, pp. 9–14. ACM Press, New York (2008) 11. Zeki, S.: A Vision of the Brain. Blackwell, Oxford (1993) 12. Greenberg, D.: A Framework for Realistic Image Synthesis. Communications of the ACM 42, 45–53 (1999) 13. Van Welbergen, H., et al.: Presenting in Virtual Worlds: An Architecture for a 3D Anthropomorphic Presenter. IEEE Intelligent Systems 21, 47–53 (2006) 14. Newman, W., Sproull, R.: Principles of Interactive Computer Graphics. McGraw Hill, New York (1979) 15. Italian Design CD-ROM. Editel, Milano (1994) 16. Carroll, J.: Human-Computer Interaction in the New Millennium. ACM Press, New York (2001)
258
F.V.C. Ficarra, M.C. Ficarra, and D.A. Giulianelli
17. Hays, J., Efros, A.: Scene Completion Using Millions of Photographs. Communications of the ACM 51, 87–94 (2008) 18. Wolberg, G.: Image Morphing: A Survey. The Visual Computer 14, 360–372 (1998) 19. Goes, J., et al.: Warping & Morphing of Graphical Objects. Morgan Kaufmann Publishers, San Francisco (1999) 20. Escher Interactive CD-ROM. Byron Preiss Multimedia, New York (1996) 21. Fenton, N.: Software Metrics: A Rigorous Approach. Chapman & Hall, Cambridge (1997) 22. Pressman, R.: Software Engineering –A Practitioner’s Approach. McGraw-Hill, New York (2005) 23. Fagan, M.: Advances in Software Inspections. IEEE Software 12, 744–751 (1986) 24. Cipolla-Ficarra, F.: Synchronism and Diachronism into Evolution of the Interfaces for Quality Communication in Multimedia Systems. In: HCI International 2005, Las Vegas (2005) 25. Nielsen, J.: Usability Metrics –Tracking Interface Improvements. IEEE Software 13, 12– 13 (1996) 26. Jiang, Z., Wang, W., Benbasat, I.: Multimedia-Based Interactive Advising Technology for Online Consumer Decision Support. Communications of ACM 48, 92–98 (2005)
Appendix Annex #1: Table –Design Categories: Presentation, Navigation and Content • Camera effects: zoom in, zoom out, horizontal movement, vertical movement, angular moviment, travelling shot –crane shot, tracking shot, dolly shot, etc. (P, N) • Deformation control and velocity: automatic and/or manual (P, N) • Dynamic media with morphing: film, animation, pictures collection, etc. (P) • External form (image or object): 2D and/or 3D (P) • External transformation: texture, color, illumination, brightness, contrast, etc. (C, P) • Format image: vectorial or bitmap • Frames form a morph from: pictures, objects, etc. (C) • Morph components: only photos, only pictures 2D and/or 3D, only illustrations –draws, maps, graphs, etc., combination photos and pictures, combination illustrations and photos, etc. (C) • Movement form: scale, translation, rotation, etc. (N, P) • Observer and vision: rotoscopy, angular vision, global vision, etc. (P, N) • Rotation: manual and/or automatic; degrees –static or dynamic, all coordinates –y, x, z, etc. (N, P) • Transition effect: fade, matched cut, dissolve, wipe, etc. (P) • Transformation: image 2D/3D or object 2D/3D (P, N) • ‘Y’ coordinate: add in 2D image or subtract in 3D (P, N, C)
Evaluating the Effectiveness and the Efficiency of a Vector Image Search Tool Patrizia Di Marco, Tania Di Mascio, Daniele Frigioni, and Massimo Gastaldi Department of Electrical and Information Engineering, University of L’Aquila, Poggio di Roio, I-67040 L’Aquila, Italy {tania.dimascio,daniele.frigioni,massimo.gastaldi}@univaq.it
Abstract. In this paper we develop VISTO (Vector Images Search TOol), along two directions: (1) we present a new interface for VISTO which is more sophisticated than the original one, since it has been developed having in mind the users and their retrieval requests; (2) we provide a much deeper evaluation of the effectiveness and the efficiency of VISTO in the specific domain of the Blissymbolic images.
1 Introduction The research in the field of Content Based Image Retrieval (CBIR) has been concentrated in the past mainly on raster images. It was maybe the wide variety of formats available for vector images, along with their strong dependence on application programs, which discouraged research in CBIR systems for vector images. It may also be noticed that raster images rule the roost on the World Wide Web, notwithstanding the convenience of vector images on the web, for their reduced size, as well as for the possibility of client-side scaling, which avoids new images to be sent. However, in the last years, the growing popularity of new vectorial-based web design programs, such as Macromedia Flash, along with the new format SVG (Scalable Vector Graphic) proposed by W3C, are changing this trend, promising to bring vector graphics to ordinary web pages soon. Notwithstanding this increasing interest, the great majority of CBIR systems proposed in the literature still deal with raster images (for a complete survey we refer to [16]). To the best of our knowledge, the unique proposal that try to solve CBIR when images are represented in a vectorial data model is VISTO (Vector Images Search TOol). VISTO has been introduced and developed in [9-11] by considering an initial application domain represented by a 2D animation production environment supporting cartoon episodes management. VISTO was initially developed to meet the cartoonists requirements, and also with the aim of having a system that can be tuned to satisfy the requirements of other application domains. In fact, other application domains utilizing vector images (e.g., Clip-art, and CAD systems) share similar requirements. The main characteristics of VISTO from the engine and the interface point of view have been described in [9, 11], while a preliminary experimental evaluation was M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 259–268, 2009. © Springer-Verlag Berlin Heidelberg 2009
260
P. Di Marco et al.
carried out in [10], whose purpose was to evaluate the effectiveness and the efficiency of VISTO by studying the so-called Precision versus Recall curves (see, e.g., [7, 15]). The effectiveness of VISTO was demonstrated by the fact that the behavior of these curves was always descendent. The contribution of the paper is twofold: We present a new interface developed for VISTO. The first prototype [9] of VISTO interface was developed only for tuning purposes of the system and hence it appeared quite raw. The new interface is more sophisticated and it has been developed having in mind the end-users and their retrieval requests. The main characteristics of the new interface are described in Section 2. We provide a deeper evaluation of the effectiveness and the efficiency of VISTO using the Blissymbolic images application domain. In the evaluation process it is important to follow a consolidated evaluation methodology. To the best of our knowledge, a shared evaluation methodology for CBIR systems is not known in the literature. To this aim, we first studied evaluation methodologies in the area of Multimedia Retrieval. As a result, we derived a set of reasonable choices that can be applied to the evaluation of CBIR systems (described in Section 3). After that we applied the derived rules to the evaluation of VISTO in the Blissymbolic images application domain. The outcome of the experiments is described in Section 4 and can be summarized as follows: (1) the effectiveness and the efficiency of VISTO have been confirmed also in the new application domain; (2) for each category of images, we determined the more appropriate engine among those of VISTO; (3) we determined the image category on which VISTO has the best performance.
2 The VISTO System Similarly to CBIR systems for raster images (see, e.g., [16]), VISTO was initially bound to the application domain and it uses, as feature representation, moments representing visual features of images. Differently from the CBIR systems proposed in the literature, VISTO uses the shape, and not the color, as the main visual feature, since in the context of vectorial images the shape is more important and representative than the color, and allows independence from affine transformations. Moreover, VISTO gives the possibility of interactively setting parameters of the retrieval process; it allows performing queries by sketch and queries by example. These design choices lead to a system supporting application domain users in searching tasks and researchers in domain-oriented tuning tasks. In what follows we concentrate on the aspects related to the engines and to the interface. 2.1 The VISTO Collection of Engines Engines currently available in VISTO follow the classical architecture of CBIR systems (see, e.g., [10]). Given a query image, database images are ranked based on the similarity with the input image, so that more relevant images are re-turned first in the query result vector. The processing hence requires a Feature Description Processor to extract visual features and to create a vector containing a proper descriptor of each
Evaluating the Effectiveness and the Efficiency of a Vector Image Search Tool
261
image, and a Comparison Processor to create a ranking vector representing the query image result using distances between descriptors. The similarity between any two images is computed as the similarity between the two corresponding descriptors. Concerning the Feature Description Processor, the image is considered as an inertial system which is obtained by discretizing the vectorial image, and by associating material points with basic elements obtained by the discretization process. The origin of the inertial system is then moved to the center of mass, to which transformation can be applied. Once an image has been transformed into an inertial system, the natural way to represent image shape is to exploit the first four central moments: average, variance, skew and kurtosis. These moments are indices of distribution providing useful information about the image. In our context, the average represents the dimension of image: low average means image poor in strokes, high average means image rich in strokes. The variance represents how image center of mass area is composed: low variance connotes image center of mass area poor in strokes, high variance connotes image center of mass area rich in strokes. The skew suggests the symmetry of images: high value of skew means low symmetry of image, low value of skew suggests high symmetry of image. Finally, kurtosis represents how image is composed, high kurtosis means image poor in empty areas, low kurtosis means image rich in empty areas. In the literature, different invariant central moments sets have been proposed, differing in the way the moments are computed (see, e.g, [17]). The moment sets supported by VISTO are those of Hu [5], Zernike [1], and Bamieh [17]. Concerning the Comparison Processor, our approach is to use metrics well consolidated in the literature, that is: Cross Correlation [1], Discrimination Cost [1], and Euclidean [17] distances. 2.2 The New VISTO Interface Differently from the first prototype [9], the new VISTO interface is organized in Tabs, each being dedicated to a specific task. In detail, the Basic and the Advanced Search tabs are designed to retrieving tasks, the Testing and the Clustering tabs are designed to tuning tasks. Moreover, three new types of results visualization have been included in the interface that well supports users in browsing results. The new interface supports both query-by-example and query-by-sketch. Result images may be selected as target images in a new search, in an incremental querying process. The new interface has been designed to help both application domain users and researchers in retrieving images and in tuning the engine in an interactive way, based on system feedback. In order to support users in these tasks, the new interface provides a Basic Mode for application domain users, and an Advanced Mode for researchers. The Basic Search Tab supports the Basic Mode, the Advanced Search Tab, the Testing Tab and the Clustering Tab support the Advanced Mode. • The Basic Search Tab is designed to handle users input actions, and it is composed of two windows, the query-selection window that is always displayed, and the query-result window that is invoked only when the results of the query are ready to be visualized.
262
P. Di Marco et al.
− The query-selection window is shown in the left part of Figure 1 and it is composed of two panels, the query-input panel (left part of the window) that accepts user input actions, and the query-view panel (right part of the window) that displays the query image selected. The query-input panel requires the user to provide an image, either by sketching it, or by selecting a file containing it. The image selected is automatically visualized in the query-view panel as shown in the right part of the Basic Search Tab. − The query-result window is composed of two panels; the result-view panel that displays the retrieved images ranked by similarity and the re-query-input panel that allows users to perform an incremental querying process. To better use the display space, the re-query-input panel is visualized by simply clicking on the “Show query panel” button, and the result-view panel use tabs to support different types of visualization. When displayed, the re-query-input panel has the same query-input panel form of the query-selection window; the Tabular visualization, the Detailed visualization and the 3D visualization are the different supported types of results visualization. Users can also just point and click on an individual image result to select it as target image in a new search. • The Advanced Search Tab is composed of two windows, the query-selection window and the query-result window. − The query-selection window is composed of four panels (see the right part of Figure 1); in the high part of this window, there are the query-input panel that accepts user input actions, the query-view panel that displays the query image selected, and the search-engine panel that contains engines supported by VISTO; users can select an engine by browsing different tabs of this panel. The fourth panel, containing the selected engine setting parameters, the available indexing and the folder indexing is automatically zoomed on when users click on the “Hide other parameters” button. The search button and the progression bar appear in the low part of this window. − The query-result window, is composed of three panels; the first is the re-queryinput panel that allows users to perform queries incrementally; the second is the result-view panel that displays query results in tabular, detailed and 3D visualization type; the third is the analysis-panel visualized when clicking on the “Hide statistics” button, it provides an initial indication on the search effectiveness. • The Testing Tab is dedicated to researchers to favor both an in-depth analysis of the tool effectiveness. It is composed of two panels: the test-input panel that supports users in selecting a new image file to be added in the test set, and the testview panel that shows the path of selected image files added in the test set. The “Add to query list” button, in the low part allows the adding operation. It is worth noting that only after that a testing session made using this tab is concluded, the “Hide statistics” button in the query-result window of the Advanced Search Tab is able to work. • The Clustering Tab supports the clustering process, which creates an optimized indexing. The objects of this tab are spatially organized according to the same philosophy used in the design process of the others tabs. This tab supports researchers in the clustering creation process used in the test sessions.
Evaluating the Effectiveness and the Efficiency of a Vector Image Search Tool
263
Fig. 1. The Basic Tab (left) and Advanced Search Tab (right) query-selection
3 Evaluation Methodologies In this section we summarize our study of the literature concerning the evaluation of Multimedia Retrieval system. 3.1 State of the Art Interesting results on evaluation methodologies have been proposed in the text, video and image retrieval areas. Among them we considered the systems of Table 1 and we studied their main features. Table 1. Considered Systems
Each column of Table 1 represents a feature we considered relevant for defining a proper methodology. The Test set column represents the images set used in the experiments: the size (♯im.), the number of categories (♯cat.), and the statistic consistency (st.). The Query set column represents the set of benchmark queries used to evaluate the system. The Query set features we considered is cardinality (♯que.) and statistic consistency (st.). The Ground-truth column represents relevance judgments. The evaluation Parameters column allows evaluators to observe the
264
P. Di Marco et al.
retrieval process and to discover where systems are weak. The Results Analysis column analyzes data obtained during experiments, in order to have correct conclusions about evaluation. The Test sets studied in the literature are often small in size; a large number of images is necessary to assure good results in recognizing differences or analogies among images. To guarantee the Test set goodness, it should be divided in categories to easily verify the statistic consistency. Not all evaluation methodologies of Table 1 consider categories and the statistical analysis lacks. We can conclude that the evaluation methodologies we studied: (1) use different test sets, (2) test set cardinality is often inadequate, (3) do not often use division into categories, (4) do not consider a statistic analysis of test sets. The Query set elements have to represent, as much as possible, all kinds of requests users submit to the system. Also in this case, it is important to check the statistic consistency. The methodologies we studied use a small number of queries. Also in the case of the Query set, statistic consistency analysis completely lacks. According to these considerations we can conclude that in the evaluation methodologies we studied: (1) query set size in often inadequate, (2) statistic consistency analysis of query set is not considered. The Ground-truth is not easy to define since it involves several aspects: environmental aspect (it depends on users’ present needs), dynamic aspect (it changes frequently), subjective aspect (it depends on users’ judgment), and cognitive aspect (it depends on users’ behavior and perception). To define the Ground-truth, it can be helpful to involve real users, in order to make more realistic relevance definition. Some of the considered systems involve real users (10 users in STAR, 9 users in MiAlbum); in some evaluations study the ground truth is not defined. We conclude that (1) real users help is not always used; (2) the ground truth is not always defined for queries. The evaluation Parameters are very important since they determine the system efficiency and effectiveness. In the literature several evaluation parameters exist [15], the more frequently used are Precision (P) and Recall (R) or parameters derived from them. Different parameters are used for example in QBIC [12], denoted as AVRR and IAVRR, and depending on the order of the relevant images and on the ideal order of the relevant images, and in Artisan [3], denoted as LPR, and depending on the position of the last relevant image found. To appreciate experiments results, devices (e.g., tables containing parameters values, graphics device histograms, and Cartesian graphics) are used as support in the Results analysis. During this study, some unpredictable and out of control errors occur; for them it is impossible performing a deterministic analysis and, in order to estimate if a relation between a variable and the observed effect exists, it is necessary a statistical test, as for example the well known ANOVA test (AT). The statistical inaccuracy has to be always included in the Results analysis; Table 1 refers that in VisualSeek and in MiAlbum evaluations graphical devices are used, but statistical tests are never performed.
Evaluating the Effectiveness and the Efficiency of a Vector Image Search Tool
265
3.2 Choices According to the considerations made in the previous section, we can derive the following reasonable choices: 1. A good Test set has to be large and made of heterogeneous images. It is important to define categories to test statistical consistency of the chosen Test set. To obtain a realistic classification it is advisable to involve real users to analyze images and to decide categories and their elements. 2. To define a Query set we can choose the set size and the set structure. We can define the Query set choosing a random sequence of images from Test set or we can choose Query set elements more carefully: we can consider an element (or more) from each category of the Test set. 3. To define the Ground truth it is necessary to define the relevance as follow: for a given query, all images belonging to the same category of the query are relevant. The Ground-truth is automatically defined: for each query the Ground-truth is the category of the query. 4. The evaluation Parameters to be chosen are Precision and Recall; in fact they are intuitive, easy to use and to be graphically elaborate. 5. To obtain good Results analysis, it can be helpful to organize the evaluation process by defining work sessions and operative work sheets. After executing experiments it is necessary a statistical analysis with ANOVA tests and logical analysis to find out data relations. We applied the above choices to the evaluation of VISTO as follows: (1) Test set: we consider a set of 400 Blissymbolic images in SVG format. Thanks to real users (♯real users: 5), the Test set is divided into 12 categories (see Table 2). We use the Indexing VISTO functionality and then we prove statistical consistency of the query set with the ANOVA test. (2) Query set: we consider one element of each Test set category (♯im.: 12); we also prove statistical consistency of Query set with the ANOVA test. (3) Ground truth: using VISTO functionalities for the ground truth definition, we save relevance judgments using the Testing Tab (see Section 2.2). (4) Parameters: VISTO offers charts depicted in the query-result window of Advanced Search Tab (see Section 2.2) to analyze Precision vs Recall curves. (5) Results analysis: tables containing evaluation parameters values, graphics device histograms, and Cartesian graphics are used for the analysis, and ANOVA tests are performed to statistically validate consistency.
4 Evaluation Experiments The goals of our evaluation experiments are the following: • Goal A: to evaluate the effectiveness of our system in terms of retrieval performance of all engines of VISTO over all queries listed in Table 2. • Goal B: to study the retrieval efficiency of each engines. • Goal C: to evaluate the best retrieved category.
266
P. Di Marco et al. Table 2. Blissymbolic images classification
• To these aims, we follow the methodology described in the previous section: 1. Test set: we have used a set of 400 Blissymbolic images in SVG format; 2. Query set: we have randomly selected the 12 queries listed in Table 2; 3. Ground-truth: following the real users judgments, an image j of the Test set is relevant for a query Q on an image i, denoted as Q(i), if and only if j and i belong to the same category. We denote as GTQ(i) the ground-truth set of query Q(i). For instance, for query france.svg in Table 2, the ground-truth set GTQ(france) is the set containing all images in the letters category; 4. Parameters: we used the well-known Precision and Recall measures (see, e.g., [7]); Precision is the fraction of the retrieved images which are relevant and Recall is the fraction of the relevant images which have been retrieved. The tests proceed in steps as follows: • Step 1: 12 ∗ 9 ∗ 96 = 10368 executions are issued to the system, in fact, 12 are the queries, 9 are the VISTO engines, and 96 are the couples cut-off and generality (from now denoted as (k, g)) chosen to evaluate the effectiveness of the system. Given a query Q(i) on a collection CQ(i), we define g = |GTQ(i) |/|CQ(i) | and k = |AQ(i) |, where |CQ(i) | is the cardinality of the collection and AQ(i) is the set containing all images of CQ(i) ranked by similarity with respect to i. According to the cardinality of the Test set categories, we chose fixing k ∈ {3, 6, 9, |GTQ(i) |} (k = 6 means that 6 are the retrieved images) and g ∈ {0.3, 0.5, 0.6, 0.9} (g = 0.5 means that the collection contains 50% of the relevant images). • Step 2: in order to perform executions described in the previous step, for each query Q(i), the collection set CQ(i) must be composed according to the g value we considered; then CQ(i) will contain all images relevant for Q(i) (all images ∈ GTQ(i)) plus a number of images, randomly selected from the Test set, such that |CQ(i) | = |GTQ(i) |/g.
Evaluating the Effectiveness and the Efficiency of a Vector Image Search Tool
267
• Step 3: for each query Q(i), the Precision and Recall values, denoted as PRQ(i) and RCQ(i) respectively, are computed as follows: • PRQ(i) = |GTQ(i) ∩ AQ(i) | / k
(1)
• RCQ(i) = |GTQ(i) ∩ AQ(i) | / |GTQ(i) |
(2)
Formulas (1) and (2) highlight that the Precision and Recall values depend on GTQ(i) and AQ(i) . For the query Q(i), in our experiments, while AQ(i) vary with the chosen engine, |GTQ(i) |, representing the cardinality of the category which i belongs, is fixed. • Step 4: using formulas (1) and (2), for each of the 12 queries in Table 2, for each of the 9 engines of VISTO, and for each couple (k, g), different graphics are calculated for inspection. In particular: − Set I: contains the 10368 PR vs RC curves defined in step 1; − Set II: contains 12 histograms, one for each category. Each histogram contains, the average values of P RQ(i) and RCQ(i) , for each couple (k, g).
Fig. 2. Histogram for the hearts category
In relation to goal A, studying curves of Set I, we observed that all curves are descendent. This behavior demonstrates that, as well described in [4], given a query Q(i), all engines well retrieve images in the same category of image i, independently from (k, g). In relation to goal B, studying histograms of Set II, we individuated the best and the worst engines for each category (the best engine is such that has the higher value bars, see for example Figure 2). In relation to goal C, we can conclude that the best retrieved category in terms of Recall is the Letters category, and the best retrieved category in terms of Precision is the Numbers category. In conclusion, by the above described experiments we have demonstrated that all VISTO engines well works, independently from g (when g increases, the relevant images decreases). We
268
P. Di Marco et al.
also discovered that BE is the best engine for 4 categories (Hearts, Question points, Squares and Segments and points), ZC for 3 categories (Houses and Buildings, Circles and Mixtures), BD for 2 categories (Curves, and Letters ), HC for one category (Arrows), BC for one category (Not classified ), and HD for one category (Numbers ). Finally, we discovered that the best retrieved category is Letters.
References 1. Chim, Y.C., Kassim, A.A., Ibrahim, Y.: Character recognition using statistical moments. Image and Vision Computing 17, 299–307 (1997) 2. de Vries, A.P.: The role of evaluation in the development of content-based retrieval techniques 3. Eakins, J.P., Boardman, J.M., Graham, M.E.: Similarity retrieval of trademark images. IEEE, Multimedia 5(2), 53–63 (1998) 4. Heesch, D., Ruger, S.: Combining features for content-based sketch retrieval: a comparative evaluation of retrieval performance. IEEE Transaction on Image Processing 5. Hu, M.K.: Visual pattern recognition by moments invariants. IRE Transactions on Information Theory 8, 179–187 (1962) 6. Huang, T., Mehrotra, S., Ramchandran, K.: Multimedia analysis and retrieval system (MARS) project. In: Data Processing Clinic (1996) 7. Koskela, M., Laasonen, J., Laakso, S., Oja, E.: Evaluating the performance of content based imag retrieval system. In: Laurini, R. (ed.) VISUAL 2000. LNCS, vol. 1929, pp. 430–441. Springer, Heidelberg (2000) 8. Liu, W., Su, Z., Li, S., Zhang, H.: A performance evaluation protocol for content-based image retrieval algorithms/systems (2001) 9. Di Mascio, T., Francesconi, M., Frigioni, D., Tarantino, L.: Tuning a CBIR system for vector images: The interface support. In: Proceedings of Working Conference on Advanced Visual Interfaces (AVI 2004), pp. 425–428. ACM, New York (2004) 10. Di Mascio, T., Frigioni, D., Tarantino, L.: Evaluation of VISTO: the new vector image search tool. In: Jacko, J.A. (ed.) HCI 2007. LNCS, vol. 4552, pp. 836–845. Springer, Heidelberg (2007) 11. Di Mascio, T., Frigioni, D., Tarantino, L.: A visual environment for tuning content-based vector image retrieval. In: Lawrence Erlbaum Associates (ed.) Proceedings of HCI 2005, Adjunctive Proceedings (2005) 12. Niblack, W., Barber, R.: The qbic project: Querying images by content using color, texture and shape. In: Proceedings of Conference on Storage and Retrieval for Image and Video Databases, pp. 173–187 (1993) 13. Ogle, V.E., Stonebraker, M.: Chabot: Retrieval from a relational database of images. IEEE Computer 28(9), 40–48 (1995) 14. Smith, J.R., Chang, S.-F.: Visualseek: A fully automated content-based image query system. ACM Multimedia, 87–98 (1996) 15. Smith, J.R.: Image retrieval evaluation. In: IEEE WorkShop on Content-Based Access of Image and Video Libreries (June 1998) 16. Veltkamp, R.C., Tanase, M.: A survey of content-based image retrieval systems. In: Proc. of Content-based image and video retrieval, pp. 47–101. Kluwer Academic Publishers, Dordrecht (2002) 17. Yang, L., Albregtsen, F.: Fast computation of invariant geometric moments: a new method giving correct results. In: Proceedings of IEEE International Conference on Pattern Recognition, pp. 201–204 (1994)
Building and Browsing Tropos Models: The AVI Design Tania Di Mascio1, Anna Perini2, Luca Sabatucci2, and Angelo Susi2 1
University of L'Aquila, Monteluco di Roio, L'Aquila, I-64100, Italy [email protected] 2 Fondazione Bruno Kessler –IRST, Trento - Povo, I-38050, Italy {perini,sabatucci,susi}@fbk.eu
Abstract. This paper proposes the use of the HCI paradigm and techniques to support software system designers in building and browsing visual models during the development of complex distributed systems. In particular, we adopt Usability Evaluation Methods (UEMs) to analyse the first version of the interface of TAOM4E, the tool supporting the Tropos Agent-Oriented methodology. Using the results of this usability study, we collect different requirements to design an Advanced Visual Interface (AVI) of TAOM4E taking into account requirements of supporting software designers during Tropos models design process browsing.
1 Introduction Visual modeling is a core activity in the so called model-driven approaches to software development. Tools played a key role in the diffusion of these practices in industrial settings (an example is the use of Object-Oriented modeling tools such as the IBM Rational Rose). In the latest years, Agent-Oriented (AO) modeling is becoming a reference paradigm for the design of complex distributed software systems. Several methodologies have been proposed so far, but only a few are supported by appropriate modeling tools. Current tools have been built giving considerable attention to practical issues, such as model interoperability, while their user interfaces seem to have been designed neglecting relevant principles of HCI. In our opinion, exploiting HCI principles and techniques will allow to build user interfaces which better fit the needs of the different users of these methodologies, resulting in a considerable contribution towards the diffusion of AO methodologies. In this work, we focus on TAOM4E (http://sra.itc.it/tools/taom4e), the tool supporting the Tropos AO methodology, briefly described in Section 2. In order to build a user interface supporting users in Tropos models design process and browsing, the current GUI of TAOM4E has been evaluated. In order to do that, we used the usability evaluation methods (UEMs), which belong to the HCI research field; the different UEMs existing are described in Section 3. The TAOM4E GUI results evaluation, carried out using the Cognitive Walkthrough method [6], confirm that, mapping the actions prescribed by the Tropos methodology process to the TAOM4E AVI, can improve the users' interaction. The design guidelines of TAOM4E AVI, carried out taking into account requirements of supporting software designers, are described in Section 4. Conclusions and future works are described in Section 5. M.J. Smith and G. Salvendy (Eds.): Human Interface, Part II, HCII 2009, LNCS 5618, pp. 269–276, 2009. © Springer-Verlag Berlin Heidelberg 2009
270
T. Di Mascio et al.
2 Tropos and TAOM4E The Tropos AO methodology [8] adopts a model-driven software development process that guides users in building an initial model of domain stakeholders, with their own goals and social dependencies for goal achievement. This model is then incrementally refined and extended into intermediate design models. The methodology provides a visual modeling language that offers primitive concepts such as actor, goal, plan, and resource, together with relationships, such as strategic dependencies between actors and goal and/or decompositions. Actor diagrams and goal diagrams give a view of the actors’ strategic dependencies and of the way an actor's goals have been decomposed into subgoals and implemented via plans, respectively. The modeling process has been defined in terms of the nondeterministic concurrent algorithm (Generate Tropos Model) recalled in Figure 1 [8]. This process guides a user in building Tropos models. During Phase 1 - the initialization step - a set of domain actors and their associated goals, plans and resources are incrementally added to the model. During Phase 2 - i.e. the modeling step - the procedure goal modeling is executed for each goal in the model in order to analyse it. The process goes on till all relevant entities have been elicited from the domain. In the goal modeling procedure described in Figure 2, three possible decisions can be taken by users with respect to a given goal. The delegate choice can be performed in two ways, that is the goal can be delegated to an existing or to a new actor (adding a new dependency relationships). In the latter case, a new actor will be added to the model before delegating it the goal. For the choice expand, the goal is and/or decomposed into subgoals (adding a new decomposition relationship); the new subgoals are added to a list of goals to be processed. Finally, the goal can be solved (the step solve) associating it a plan p (and eventually a set of resources ri) in the model via a means ends relationships that is added to the model. In order to support the specific analysis techniques adopted in Tropos we developed a modelling environment, called TAOM4E (Tool for Agent-Oriented Modelling for Eclipse), which is based on an implementation of the metamodel described in [9].
Fig. 1. The modelling procedure of the Tropos methodology
Building and Browsing Tropos Models: The AVI Design
271
Fig. 2. The goal modelling procedure of the Tropos methodology
Among the main requirements we considered in developing TAOM4E tool are the following: • Visual Modelling. As pointed out before, the visual aspect of the language is one of the fundamental characteristics of the Tropos methodology, so the modelling environment should support the user during the specification of an AO visual model (e.g., according to the Tropos visual notation). Moreover, the environment should allow us to represent new entities that will be included in the Tropos metamodel, language variants, as well as to restrict its use to a subset of entities of the modelling language. • Specification of model entities properties. The modelling environment should allow us to easily annotate the visual model with model properties like invariants, creation or fulfillment conditions that are typically used in Formal Tropos specification. • Extensibility. The modelling environment should be extensible and allow for different configurations by easily integrating other tools at will. An effective solution to the requirement of a flexible architecture and to the component integration issue is offered by the Eclipse Platform. New tools are integrated into the platform through plug-ins that provide the environment with new functionalities. A plug-in is the smallest unit of function in Eclipse and the Eclipse Platform itself is organized as a set of subsystems, implemented in one or more plug-ins, built on the top of a small runtime engine. The TAOM4E architecture is depicted in Figure 3. It follows the Model View Controller
Fig. 3. The architecture of TAOM4E
272
T. Di Mascio et al.
Fig. 4. Snapshot of the current TAOM4E GUI
pattern and has been devised as an extension of two existing plug-ins. First, the EMF plug-in (http://www.eclipse.org/emf/) offers a modelling framework and code generation facilities for building tools and other applications based on a structured data model. Given an XMI model specification, EMF provides functions and runtime support to produce a set of Java classes for the model. Most importantly, EMF provides the foundation for interoperability with other EMF-based tools and applications. The resulting plug-in, called TAOM4E model implements the Tropos metamodel. It represents the Model component of the MVC architecture. Second, the Graphical Editing Framework (GEF) plug-in (http://www.eclipse.org/gef/) allows developers to create a rich graphical editor around an existing metamodel. The functionality of the GEF plug-in helps to cover the essential requirement of the tool, that is supporting a visual development of Tropos models by providing some standard functions like drag & drop, undo-redo, copy & paste and others. The resulting plug-in, called TAOM4E platform represents both the Controller and the Viewer components of the tool. A snapshot of the tool's GUI is depicted in Figure 4. It consists of three main windows: • the project/model browser on the left; • the diagram editing window in the center; • the Tropos entities/relationships palette at the left of the diagram editing window. In particular, the project model window contains the set of model entities and artifacts of the Tropos project; the diagram editor allows the user to specify the Tropos artifacts, in particular actor and goal diagrams, using the Tropos concepts (actors, goals, tasks, resources and the relationships between those concepts) contained in the palette area. A simple example of such a Tropos diagram is shown in Figure 4. In this
Building and Browsing Tropos Models: The AVI Design
273
diagram the actors are represented via circles, goals via elliptical shapes and tasks via hexagons. Moreover, in the figure is shown the internal goal diagram of the Actor 1 contained inside the dashed line ellipse (named balloon in Tropos). Focusing on the relationships specified in the diagram, two dependencies are shown between the two actors (Actor 1 and Actor 2): a goal dependency whose label is the HardGoal 1, and a task dependency whose label is the Plan 1. Inside the balloon the and decompositions of the root goal HardGoal 2 and of the subgoal HardGoal 3 are described together with a means_ends relationship between the Plan 1 and the HardGoal 5. Currently, the model building process, executed by users, is not visually supported by the TAOM4E GUI. In fact, the user can add to the model entities without particular constraints or guidelines, so having also the possibility to specify Tropos models in a way that is not consistent with the process envisaged before. The designer can start building a new Tropos model directly creating the project in the project window and specifying the kind of diagram to start with (actor or goal diagram); at this stage the designer can start specifying model entities having also the possibility to specify goals or tasks without having specified the actors those goals/tasks are associated to; this way the user building task could fail in following the sequence of actions defined by the process, breaking the rational underlying the Tropos methodology. We aim at designing an AVI that improves the user support in building and browsing tasks. In the next section we delineate some HCI guidelines to be followed in the new GUI supporting the design process.
3 Usability Evaluation Methods The introduction of usability evaluation methods (UEMs) to assess and improve usability in which systems has led to a variety of alternative approaches and a general lack of understanding of the capabilities and limitations of each approach. In [4], authors present a practical discussion of factors, comparison criteria, and UEM performance measures that are interesting and useful while comparing different UEMs. A common difference among UEMs is based on the skills of the evaluators (in general, a person using a UEM to evaluate usability of an interaction design); in particular two main criteria exists, Expert-based criteria and User-based criteria. In the former, experts are requested to evaluate a prototype, comparing it with respect to existing rules and guidelines; in the latter evaluators assess usability through real users, having them using a prototype. In particular while the Expert-based Criteria UEMs include, among others, Heuristic Evaluation method [5], Cognitive Walkthrough method [3], and Expert-based method [6], the User-based Criteria UEMs [2] include, among others, Observational evaluation method [10], Survey evaluation method [10], and Controlled experiment method [3]. Among observational evaluation methods, we focus on Verbal Protocols, and Think Aloud Protocol [3]. In what follows, we briefly describe these methods: • Heuristic Evaluation: This criterion foresees a small set of evaluators that evaluate the interface and judge its compliance with well known usability principles (e.g., the heuristics). • Cognitive Walkthrough: This is typically performed by the interface designer and a group of his or her peers. Small-scale walkthroughs of parts of an interface can
274
T. Di Mascio et al.
also be done by individual designers as they consider alternative designs. In a group situation, one of the evaluators usually takes on the duties of scribe, recording the results of the evaluation as it proceeds, and another group member acts as facilitators, to keep the evaluation moving. • Expert evaluation: This method exploits the knowledge of an HCI expert, so obtaining a prediction about the usability of the system. This method has a main disadvantage: it depends upon the quality of the expert(s). • Observational evaluation method involves real users that are observed when performing tasks with the system (depending on the stage of the project, what the system is ranges from paper mock-ups to the real product). This method offers a broad evaluation of usability. Depending on the specific situation, we may either apply the Observational Evaluation by direct observation or record the interaction between the users and the system (using Usability Lab). Recording (done by video camera) is more valuable, since it allows for storing information, for example the critical points during the interaction (e.g., when the user has to consult the manual, when and where s/he is blocked), the time a user spends to perform a task, the mistakes a user makes, and so on. Obviously, recording, using camera, is very expensive (especially for the time required to analyze the record