& Nele Russwinkel & Sabine Prezenski , Germany ACT-R AnDroid · •Android Studio with the source...
1
ACT-Droid: ACT-R Interacting with Android Applications Sekr. MAR 3-2 Marchstraße 23 10587 Berlin www.kmodys.tu-berlin.de Lisa-Madeleine Dörr & Nele Russwinkel & Sabine Prezenski Technische Universität Berlin, Germany Chair of Cognitive Modelling in Dynamic Human-Machine-Systems (KMoDyS) Introduction Keywords: ACT-R; Android; granularity; usability testing; modeling; mobile context; tool. ACT-Droid is a tool that connects ACT-R models with Android applications on smartphones. It is based on „Hello Java!” (Büttner, 2010). The main benefits of ACT-Droid are: • no prototyping of the application is needed, • no lisp code for normal use of ACT-R modeling necessary, • usability testing is feasible (in submission), (Prezenski & Russwinkel, in submission) • the content of the screen can be described as detailed as necessary, the granularity is only limited by the structure of the visicon, • attributes of the elements appearing in the visicon can also be adjusted. Lisa-Madeleine Dörr Email: [email protected] Nele Russwinkel Email: [email protected] Sabine Prezenski Email: [email protected] Technical Details The app interface provides a description of everything that is visible. It searches recursively through all views and generates descriptions of every visible checkbox, button and textfield. It is possible to define special objects, too. The model interface then loads the description into the visicon. How To Outlook • implementing scrolling • thorough tests with different apps • further simplification of the set-up and usage, e.g. when having more than one Android activity (common) Soon, we will provide a version with the touch commands of ACT-Touch instead of the mouse commands. This is the next step towards an adequate tool for efficient usability testing of apps. References Büttner, P. (2010). "Hello Java": Linking ACT-R 6 with a Java Simulation. In D. D. Salvucci & G. Gunzelmann (Eds.), Proceedings of the 10th International Conference on Cognitive Modeling (pp. 289-290). Philadelphia, PA: Drexel University. Greene, K. K., Tamborello, F. P., & Micheals, R. J. (2013). LNCS 8007 - Computational cognitive modeling of touch and gesture on mobile multitouch devices: applications and challenges for existing theory. Proceedings of the 15th international conference on Human-Computer Interaction (pp. 449-455). Las Vegas, USA: ACM. Prezenski, S., & Russwinkel, N. (in submission). Towards a general model of repeated app usage. In D. Reitter & F. E. Ritter (Eds.), Proceedings of the 14th International Conference on Cognitive Modeling. Pennsylvania. ACT-R Lisp device AnDroid Currently, ACT-R’s mouse commands are interpreted as fingertip touches by the Android app. So, if the app interface receives a click command, it performs a tap. Soon, it will be possible to use the touch commands of ACT-Touch (Greene, Tamborello, & Micheals, 2013). The two main tasks ACT-Droid fulfills are: performing motor output of ACT-R within the app and updating the visicon of ACT-R according to the changing app screen. These functionalities are provided by the model interface and the app interface. Motor Visual app ACT-Droid App visual motor Model name kind value color size position ========================================= oval7 oval Peripherie black ... ... oval6 oval Fuellung black ... ... oval8 oval Zurueck black ... ... oval9 oval Menue black ... ... triangle1 triangle red ... ... Visicon app inter- face model inter- face (load device.lisp) (setf *ip* 192.168.1.1) (run 20) . : ACT-Droid can be downloaded from http://dx.doi.org/10.14279/depositonce-5181 (see Qr-Code left). Included are detailed instructions, an app example and a very basic ACT-R model. This simple model will randomly explore and click on everything. The prerequisites for using ACT-Droid are the following: • Lispworks, • ACT-R source files, • Android Studio with the source files of the app (only necessary during set-up), • an Android smartphone to run the extended app on, • and the computer and the smartphone have to be in the same network. To run the model you only have to start the app and afterwards the ACT-R model. The model will then interact directly with the app. Model Download ACT-Droid
Transcript of & Nele Russwinkel & Sabine Prezenski , Germany ACT-R AnDroid · •Android Studio with the source...
ACT-Droid: ACT-R Interacting with Android Applications
Sekr. MAR 3-2 Marchstraße 23
10587 Berlin
www.kmodys.tu-berlin.de
Lisa-Madeleine Dörr & Nele Russwinkel & Sabine Prezenski Technische Universität Berlin, Germany Chair of Cognitive Modelling in Dynamic Human-Machine-Systems (KMoDyS)
Introduction
Keywords: ACT-R; Android; granularity; usability testing; modeling; mobile context; tool.
ACT-Droid is a tool that connects ACT-R models with Android applications on smartphones. It is based on „Hello Java!” (Büttner, 2010).
The main benefits of ACT-Droid are:
• no prototyping of the application is needed, • no lisp code for normal use of ACT-R modeling necessary, • usability testing is feasible (in submission), (Prezenski & Russwinkel, in submission) • the content of the screen can be described as detailed as necessary, the granularity is only
limited by the structure of the visicon, • attributes of the elements appearing in the visicon can also be adjusted.
Lisa-Madeleine Dörr Email: [email protected]
Nele Russwinkel Email: [email protected]
Sabine Prezenski Email: [email protected]
Technical Details
The app interface provides a description of everything that is visible. It searches recursively through all views and generates descriptions of every visible checkbox, button and textfield. It is possible to define special objects, too.
The model interface then loads the description into the visicon.
How To Outlook
• implementing scrolling
• thorough tests with different apps
• further simplification of the set-up and usage, e.g. when having more than one Android activity (common)
Soon, we will provide a version with the touch commands of ACT-Touch instead of the mouse commands. This is the next step towards an adequate tool for efficient usability testing of apps.
References Büttner, P. (2010). "Hello Java": Linking ACT-R 6 with a Java Simulation. In D. D. Salvucci & G. Gunzelmann
(Eds.), Proceedings of the 10th International Conference on Cognitive Modeling (pp. 289-290). Philadelphia, PA: Drexel University.
Greene, K. K., Tamborello, F. P., & Micheals, R. J. (2013). LNCS 8007 - Computational cognitive modeling of touch and gesture on mobile multitouch devices: applications and challenges for existing theory. Proceedings of the 15th international conference on Human-Computer Interaction (pp. 449-455). Las Vegas, USA: ACM.
Prezenski, S., & Russwinkel, N. (in submission). Towards a general model of repeated app usage. In D. Reitter & F. E. Ritter (Eds.), Proceedings of the 14th International Conference on Cognitive Modeling. Pennsylvania.
ACT-R
Lisp device
AnDroid
Currently, ACT-R’s mouse commands are interpreted as fingertip touches by the Android app. So, if the app interface receives a click command, it performs a tap.
Soon, it will be possible to use the touch commands of ACT-Touch (Greene, Tamborello, & Micheals, 2013).
The two main tasks ACT-Droid fulfills are: performing motor output of ACT-R within the app and updating the visicon of ACT-R according to the changing app screen. These functionalities are provided by the model interface and the app interface.
Motor Visual
app
ACT-Droid App
visual
motor
Model
name kind value color size position ========================================= oval7 oval Peripherie black ... ... oval6 oval Fuellung black ... ... oval8 oval Zurueck black ... ... oval9 oval Menue black ... ... triangle1 triangle red ... ...
Visicon
app inter-face
model inter- face
(load device.lisp) (setf *ip* 192.168.1.1) (run 20) . :
ACT-Droid can be downloaded from http://dx.doi.org/10.14279/depositonce-5181 (see Qr-Code left). Included are detailed instructions, an app example and a very basic ACT-R model. This simple model will randomly explore and click on everything. The prerequisites for using ACT-Droid are the following: • Lispworks, • ACT-R source files, • Android Studio with the source files of the app (only
necessary during set-up), • an Android smartphone to run the extended app on, • and the computer and the smartphone have to be in the
same network.
To run the model you only have to start the app and afterwards the ACT-R model. The model will then interact directly with the app.
Model
Download ACT-Droid
