Evaluation master thesis

12
Evaluation master thesis Visualization and Control of Distributed Component Compositions in Wireless Sensor Networks Michael Gobbers Promoter: Prof. Danny Hughes Counselors: PedroJavier delCidGarcia, Klaas Thoelen

Transcript of Evaluation master thesis

Page 1: Evaluation master thesis

Evaluation master thesisVisualization and Control of Distributed Component Compositions in Wireless Sensor Networks

Michael Gobbers

Promoter: Prof. Danny Hughes Counselors: PedroJavier delCidGarcia, Klaas Thoelen

Page 2: Evaluation master thesis

2

Contents• Tool introduction

o What?o Viewso Visualization methodso Available interactions

• Demo• Evaluation

o Criteriao Scenarioso Scenario setupo Expected resultso Doodle

Page 3: Evaluation master thesis

Tool introductionWhat?

• Visual based tool• Introspection and Control of

o Component compositionso Distribution concerns

• Based on LooCI V2

3

Page 4: Evaluation master thesis

4

Tool introductionViews

• Distribution viewo Locate components and codebases based on their

parent nodeo Visibility of node loads and distributed application

dependencieso Node platforms

• Composition viewo Component compositionso Component state, properties, codebase and interfaces

Page 5: Evaluation master thesis

5

Tool introductionVisualization method

• Use of visual attributes -> information density ^ -> visible information ^

• Customized graphs for:o Component compositions in composition viewo Node interconnections in distribution view

• Two zoom levelso Zoomed in: detailed textual informationo Zoomed out: distribution and composition overview

Page 6: Evaluation master thesis

6

Tool introductionAvailable interactions

• Hand tool -> graph moving, rotating and shearing• Cursor tool -> graph manipulation, vertex/edge selection• Right mouse button -> Control on LooCI network• Refresh button -> update the view with complete

introspection of the network.• Log button -> shows introspection/control commands sent

to the network (Shows errors in red)

Page 7: Evaluation master thesis

DEMO

Page 8: Evaluation master thesis

EvaluationCriteria

• Comparison against other toolso LooCI Management Consoleo Tuscany

• 3 scenarioso Each test person gets 1 scenario per tool. Scenario/tool combination

will vary per test• Evaluation criteria

o Usability -> SUS questionnaireso Time efficiency -> experiment time measuremento #telnet commands (programmatically) -> analysis of logged telnet

commandso #telnet commands (user initiated) -> automatic counto Count of wrong control commands -> manual counto What data is being searched for? -> think aloud protocol8

Page 9: Evaluation master thesis

9

EvaluationScenarios

• Instructions will be given before the test• Scenario 1: partially deployed composition needs to be

enhanced (add functionality)• Scenario 2: create a new composition• Scenario 3: change application behavior by changing

properties of components

Page 10: Evaluation master thesis

10

EvaluationScenario setup

• Scenario sizeo 3 nodes with a total of 7-10 components.

• OSGi nodes running on VM’s on same machine• Codebases and nodes will be ready for codebase

deployment• No details will be given of already deployed codebases or

components

Page 11: Evaluation master thesis

11

EvaluationExpected results

• The user will have a quicker understanding of the existing composition

• Telnet messages sent will be higher then when using the LooCI management console

• The visual approach will be less error prone• The user will be able to locate components faster when

using a visual approach

Page 12: Evaluation master thesis

12

EvaluationDoodle

• Please pick dates on which you are available at:http://www.doodle.com/ytmmuvkfcmv668bq

• 3 slots every Tuesday and Thursday afternoon from 16-7 to 8-8

• Preferred scheduling in July