Designing New Music interaction enhancing sound 2016-02-02آ  Designing New Music interaction...

download Designing New Music interaction enhancing sound 2016-02-02آ  Designing New Music interaction enhancing

of 44

  • date post

    26-Jun-2020
  • Category

    Documents

  • view

    0
  • download

    0

Embed Size (px)

Transcript of Designing New Music interaction enhancing sound 2016-02-02آ  Designing New Music interaction...

  • Designing New Music interaction

    enhancing sound affordance

    Ju young, Shin

    The Graduate School

    Sungkyunkwan University

    Department of Human ICT Convergence

  • Designing New Music interaction

    enhancing sound affordance

    Ju young, Shin

    The Graduate School

    Sungkyunkwan University

    Department of Human ICT Convergence

  • Designing New Music interaction

    enhancing sound affordance

    Ju young, Shin

    A Masters Thesis Submitted to the Department of Human ICT convergence

    and the Graduate School of Sungkyunkwan University

    in partial fulfillment of the requirements

    for the degree of Master of Science in Human ICT Convergence

    October, 2015

    Approved by

    Jun Dong, Cho

    Major Advisor

  • This certifies that the masters thesis

    of Ju Young Shin is approved.

    ___________________________

    Thesis Supervisor: Jun-dong Cho

    ___________________________

    Hyunjin Park

    ___________________________

    Sekekyu Lee

    The Graduate School

    Sungkyunkwan University

    December 2015

  • - i-

    TABLE OF CONTENTS

    Abstract ........................................................................................................................... 1

    I. Introduction ............................................................................................................. 3

    1. Background of research ............................................................................................... 3

    2. Purpose of Study .......................................................................................................... 4

    II. Related Work .................................................................................................... 6

    1. Sound Mixing ............................................................................................................... 6

    2. Previous Work .............................................................................................................. 7

    III. Gesture Interaction .......................................................................................... 9

    1. Gesture type .................................................................................................................. 9

    A. Touch Gesture ...................................................................................................... 10

    B. Motion Gesture ..................................................................................................... 11

    C. Vision Gesture ...................................................................................................... 12

    IV. User Study of Gesture Interaction Design .................................................... 13

    1. User Study .................................................................................................................. 13

    2. Survey ......................................................................................................................... 14

    3. Participatory Design .................................................................................................. 15

  • - ii-

    4. Interface Development .............................................................................................. 19

    V. User Study of Gesture Interaction Design .................................................... 23

    1. User test Overview ................................................................................................... 23

    2. Result ........................................................................................................................ 25

    VI. Conclusion ....................................................................................................... 29

    Reference ....................................................................................................................... 30

    Affendix ......................................................................................................................... 33

    국문초록 ........................................................................................................................ 35

  • - iii-

    LISTS OF FIGURE AND TABLE

    Table 1. Categories based on interface and interaction ........................................................... 6

    Figure 1. 3 Type of gesture .......................................................................................................... 9

    Table 2. Touch Gesture (Vilamor, C., 2010) ............................................................................ 10

    Table 3. Motion Gesture............................................................................................................ 11

    Figure 2. User Study Flow ........................................................................................................ 13

    Table 4. 5 Feature Effects ......................................................................................................... 14

    Table 5. Cross fader - gesture ................................................................................................... 15

    Table 6. Loop - gesture .............................................................................................................. 16

    Table 7. Flanger - gesture ......................................................................................................... 17

    Table 8. VCF – gesture .............................................................................................................. 18

    Table 9. Scratch – gesture ......................................................................................................... 19

    Figure 3. Touch only interface .................................................................................................. 20

    Table 10. Touch only interface – gesture ............................................................................... 20

    Figure 4. Touch + Motion interface ......................................................................................... 21

    Table 11. Touch + Motion interface – gesture....................................................................... 21

  • - iv-

    Figure 5. Motion only interface ............................................................................................. 22

    Table 12. Touch + Motion interface – gesture....................................................................... 22

    Table 13. User test Overview .................................................................................................... 23

    Figure 6. Experiment enviroment ............................................................................................ 23

    Table 14. Measured values ........................................................................................................ 24

    Table 15. Learnability ............................................................................................................... 25

    Table 16. Efficiency ................................................................................................................... 26

    Table 17. Pleasant to use ........................................................................................................... 26

    Figure 7. Comparison of interface usability A,B,C Type ....................................................... 27

  • - 1-

    Abstract

    Designing New Music interaction

    enhancing sound affordance

    During the last several years, as more ordinary people have developed an interest in disk

    jockeying (DJing), companies have released various DJing applications for novices. The

    applications currently have reproduced the interface and function of professional mixing

    controllers almost exactly, they are difficult for ordinary users to use without professional

    knowledge or manuals. Since the commercialization of smart mobile devices, a more intuitive

    interface is being called for.

    This study suggests a gesture-based sound mixing system for smart mobile devices and

    an interface. In order to define the sound effecter which is frequently used on smartphones, a

    survey was conducted. Based on this survey and through participatory design, three types of

    gestures were concluded and a usability evaluation was conducted.

    This experiment allowed for a categorization of user response for three types of interface.

    A type was deemed to be the most familiar touch interface to users, with high learnability,

    efficiency, and satisfaction. It was also seen as unlikely to generate errors. However, negative

    opinions noted that the two types of effecter functions are difficult to operate with touch. B

    type added motion to touch gesture, and was seen as fun to operate for music. Positive opinions

    came when a beginner added music effectors. In addition, some noted that it would be nice if