1 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007 Development Method for...
-
Upload
hector-boyd -
Category
Documents
-
view
213 -
download
0
Transcript of 1 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007 Development Method for...
1 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Development Method for User Interfaces of Rich Internet Applications
By Francisco Javier Martínez RuizPromoteur Dr. Jean Vanderdonckt
Université catholique de Louvain (UCL)Louvain School of Management (LSM)
Information Systems Unit (ISYS)Belgian Laboratory of Computer-Human Interaction (BCHI)
http://www.isys.ucl.ac.be/bchi
2 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Agenda
1. Main Goal of the Work2. Focus3. Introduction / Literature Review4. Method outline
1. Step 1: the Task and Domain Models2. Step 2: the Abstract User Interface3. Step 3: the Concrete User Interface4. Step 4: the Final User Interface
5. Conclusions6. Contributions7. Future work
3 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Main Goal of the Work
The introduction of a meta-model of user interfaces for Rich Internet Applications establishes a common ground to standardize their design and development through a model-based and neutral representation which could be ported by a transformational schema to various web development environments.
What is the goal?
The creation of a Development Method for User Interfaces of
Rich Internet Applications
4 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Focus
What is the focus of this thesis?
Which Type of User Interfaces is studied?
To whom is directed this work?
Web Applications
Graphical User Interfaces
The CHI research community, academics interested in webapps
5 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Introduction| The Web Platform
The World Wide Web (or simply web) is based upon three core components:
The Uniform Resource identifier,
the interaction protocols used by the agents to get the resources and a
representation of the data contained by the resource
6 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Introduction| The Web Architecture
The original function of the web was to deliver plain hypertext documents over a client-server architecture but its success has caused a natural evolution from static and passive contents to dynamic and interactive ones.
7 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Introduction| Web App. Architecture
The web browser remains as the immovable and universal client.
The application server is the most important element in the second-tier (the server one) because it supplies the environment to execute the components of the application.
Finally, in the third-tier is included a repository of data that is available through a data access interface from the second-tier
8 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Introduction| Rich Internet Application
The RIAs are webapps that take into account the power of the client to increase the responsiveness of the Web UI while the management of the application and data remains on the server.
9 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Literature Review | Dialogue models
10 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Literature Review | Dialogue models
11 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Literature Review| Design Approaches
12 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Literature review | CAMELEON Framework
Building a model based application requires a framework to define the design steps needed for describe our computer system, including the features:
Multi-level abstraction, Modality independence, among others
13 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Literature review | Comparison RIA Frameworks
# Description Quick dev Testability License Platform Side Tech Deep linking back button support REST Arch SPA
1 GWT - + open AJAX/java C + ++ - +
2 ZK - + open java S - - - +
3 OpenLaszlo + - open flash/dhtml C + ++ - ++
4 FLEX ++ - comm flash C - - - +
5 Echo2 + + open java S + - - +
6 Wicket - + open java S + - - +
7 RubyonRails - - open ruby S + - - +
8 Rialto - - open AJAX C ++ - - +
9 Thinwire - - open AJAX S ++ - - +
10 CURL - - comm CURL VM C - - - +
11 Nexaweb - + open AJAX/java C + - - +
12 Backbase - + open AJAX C ++ - - +
13 XUIMLcarrousel - + open java S + - - +
14 RIBAX - + open Applet/java C + - - +
15 TIBCO - - open AJAX C ++ - - +
16 ARP - - open Flash C - - - ++
17 Zimbra - - open AJAX C - - - +
18 silverlight ++ + comm NET C + - - ++
14 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Method outline
15 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
The Role of XLST
The reification process is the process to iterating from the abstract representation to more concrete levels and ultimately arrives to the Final User Interface.
This overall procedure is called: forward engineering.
The CAMALEON framework requires from each UI representation a process of transformation to deliver the next step.
16 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Task & Domain modeling
17 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Running Example
18 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Task model – Panoramic view
19 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Task model – Price Details
20 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Task types in RIA
21 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Task types in RIA
22 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1| Domain modeling
23 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Categorization of RIAs
The Data/Complexity continuum in Web Applications
24 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Categorization of RIAs
Data accessComplexity
Inte
ract
ivity
Web Application HTML with Client Technologies (JavaScript)
Rich Internet Application
Traditional Web Application HTML and CGI
25 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Categorization of RIAs
26 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Categorization of RIAs
27 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 1 | Categorization of RIAs
Size
<=3
>3
AmountOf ChoiceOperators
>2
<=2
AmountOf classes
AmountOf Methods
<=8
>8
>=3
I
II
II
I
AmountOf Concurrentoperators
0..1
>=2
II
III
<3
28 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Abstract User Interface
29 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Container Structure
30 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Container Structure
31 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Container Structure Algorithm
32 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Container Structure Algorithm
33 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Container Structure Algorithm
SopQPwnBR
FopQw
FopPwnCopQw
CopPw
nB
n
nG
0
1
)(
Let w = {sons tasks which father is the root of v} op = operators interacting with the tasksP = {inner tasks}Q = {leave tasks}C = {|||, |[ ]|, |=| } all the concurrent operatorsF = {[ ]} the Selection operator S = {>>, []>>,|>, [>} is the set of sequential operatorsn = the amount of son tasks (Beginning with zero)
34 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Container Structure Algorithm
35 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application to Example
36 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application to Example
37 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application to Example
38 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application to Example
39 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application to Example
40 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application to Example
41 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Design of the Menu
Definition
The concept of menu is the activation of a group of actions. A menu is constituted by a name and a list of actions called menu items. Usually, a menu item is followed by an accelerator, i.e. a combination of keywords that allows selecting an item without mouse or keyboard selection.
The advantage of menus is allowing the utilization of the options of the application without worrying about memorizing commands [Vand98]
42 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Design of the Menu
43 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Design of the Menu
44 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Design of the Menu
function Generate-Menu (CTT tree) returns menu-structure or failureinitialize the search tree to root nodeloop do if there are no candidate nodes for expansion then return exit
choose a node and expand its sons if the sons of candidate node include only choice operators then include it in MenuList[ ] and its sons as menu items. if candidate node previously marked as menu item then change the label to submenu associate to upper menu element
if candidate node is unconnected to hierarchy of MenuList thenmark it as flying menu and localized /*isolated*/
45 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application of Menu Algorithm
46 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 2 | Application of Menu Algorithm
47 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 3 |Concrete User Interface
48 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 3| Selection of Target Platform
Graphic Modality components
49 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 3| Concrete Interaction Objects
50 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 3| Concrete Interaction Objects
<?xml version="1.0" encoding="UTF-8"?><uiModel xmlns="http://www.usixml.org" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance"xsi:schemaLocation="http://www.usixml.org/ http://www.usixml.org/spec/UsiXML-ui_model.xsd" id="FruitStore_31" name="FruitStore" creationDate="2006-03-31T11:03:50.109-06:00" schemaVersion="1.6.3" xsi:type="uiModel"> <head> <version modifDate="2006-03-31T11:03:50.109-06:00">1</version> <authorName>Javier Martinez</authorName> <comment>Generated by GrafiXML 1.1.999 build id : 200602081036</comment> </head><window id="window_component_0" name="window_component_0" width="400" height="350"> <box id="box_1" name="box_1" type="vertical"> <imageComponent id="image_component_2" name="image_component_2" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_2']/resource/@tooltip" defaultTooltip="Apples (£5)" content="/uiModel/resourceModel/cioRef[@cioId='image_component_2']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> <imageComponent id="image_component_3" name="image_component_3" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_3']/resource/@tooltip" defaultTooltip="Bananas (£7)" content="/uiModel/resourceModel/cioRef[@cioId='image_component_3']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> <imageComponent id="image_component_4" name="image_component_4" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_4']/resource/@tooltip" defaultTooltip="Grapes (£9)" content="/uiModel/resourceModel/cioRef[@cioId='image_component_4']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> <imageComponent id="image_component_5" name="image_component_5" tooltip="/uiModel/resourceModel/cioRef[@cioId='image_component_5']/resource/@tooltip" defaultTooltip="Ready to buy? double click in basket" content="/uiModel/resourceModel/cioRef[@cioId='image_component_5']/resource/@content" defaultContent="/resources/00/" isVisible="true" isEnabled="true" textColor="#000000"/> </box> </window>
51 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 3|Behavior
52 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 4 | Final User Interface (FUI)
53 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 4 | Generating the FUI
54 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 4 | XSLT Transformation Doc
<?xml version="1.0" encoding="UTF-8"?><xsl:stylesheet xmlns:xsl="http://www.w3.org/1999/XSL/Transform" xmlns:wf="http://schemas.microsoft.com/2003/xaml/" version="1.0"> <xsl:output method="xml" omit-xml-declaration="yes" /> <xsl:template match="*|/"> <wf:UserControl Name="WebForm1" ClientSize="200, 200" xmlns="http://schemas.microsoft.com/2003/xaml/" xmlns:def="Definition" xmlns:wf="wf" def:Class="XamlonApplication8.WebForm1" def:CodeBehind="WebForm1.xaml.cs"> <xsl:apply-templates select="/cuiModel/window"/> </wf:UserControl> </xsl:template> <xsl:template match="window"> <wf:UserControl.Controls> <xsl:apply-templates select="/cuiModel/window/box/inputText"/> <xsl:apply-templates select="/cuiModel/window/box/button"/> <xsl:apply-templates select="/cuiModel/window/box/outputText"/> <xsl:apply-templates select="/cuiModel/window/box/slider"/> </wf:UserControl.Controls> </xsl:template> <xsl:template match="inputText"> <wf:TextBox Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template> <xsl:template match="button"> <wf:Button Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template> <xsl:template match="outputText "> <wf:Label Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template> <xsl:template match="slider "> <wf:TrackBar Text="{@defaultContent}" TabIndex="1" Name="{@name}"/> </xsl:template></xsl:stylesheet>
55 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Step 4 |resultant file
<wf:UserControl xmlns:wf="wf" xmlns="http://schemas.microsoft.com/2003/xaml/" xmlns:def="Definition" Name="WebForm1" ClientSize="200, 200" def:Class="XamlonApplication8.WebForm1" def:CodeBehind="WebForm1.xaml.cs"><wf:UserControl.Controls xmlns:wf="http://schemas.microsoft.com/2003/xaml/">
<wf:TextBox Text="" TabIndex="1" Name="input_text_component_9"/><wf:TextBox Text="" TabIndex="1" Name="input_text_component_11"/>
<wf:TextBox Text="0.00" TabIndex="1" Name="input_text_component_13"/><wf:Button Text="Submit order" TabIndex="1" Name="button_component_14"/><wf:Label Text="Name" TabIndex="1" Name="output_text_component_8"/><wf:Label Text="Address" TabIndex="1" Name="output_text_component_10"/><wf:Label Text="Total to Pay:" TabIndex="1" Name="output_text_component_12"/>
</wf:UserControl.Controls></wf:UserControl>
56 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Conclusion
The purpose of this work was to establish the master plan of our method to develop RUIs.
All the steps have been presented in the current document. These steps are the beginning of a variation/expansion of the UsiXML family of tools and models in order to target RIAs is an ongoing work.
57 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
A Development Method for User Interfaces of RIAs
58 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Summary of contributions
• The contributions are expanded in a series of exploratory papers in which we began to understand more the model of the RIAs: – [Mart06], where present the first attempt to tackle the problem– [Muño06] where we propose a taxonomy of RIAs– [Mart06a] a study case based on XAML UIs.
• We have integrated here a proposal of extensions to the task types and menu features relevant to RIAs (see chapter 3 and 4).
• A proposal of a method for the generation of the container structure
• And Finally, The generation of menus based on task trees
59 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Future work
• The process of making grow our repository of the UI widgets used in RIAs (for complete the XSLT templates).
• The integration of the RIA frameworks GWT into the GrafiXML tool as target language (extension to UsiXML).
• The integration of some elements to make simpler the translation between models, specifically the collecting of patterns to reduce the process of conversion (simplify the XLST translation).
• The web is a distributed environment, we have to profit of that and integrate to the solution the power of the cooperative systems i.e., web agents.
• A proposal of a RIA Behaviour model
60 Belgian Laboratory of Computer-Human Interaction (BCHI) ::: UCL August 2007
Development Method for User Interfaces of Rich Internet Applications
By Francisco Javier Martínez RuizPromoteur Dr. Jean Vanderdonckt
Université catholique de Louvain (UCL)Louvain School of Management (LSM)
Information Systems Unit (ISYS)Belgian Laboratory of Computer-Human Interaction (BCHI)
http://www.isys.ucl.ac.be/bchi