Designing an Information Model of Writing for Monitoring and Analytics

Designing an Information Model of Writing for Monitoring and Analytics

Taku Yamaguchi, Michiko Oba, Osamu Takahashi Future University Hakodate

v0.7 2014-09-15 (partial translation of the original Japanese version) http://www.slideshare.net/yamahige

1 2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate

Agenda •  Background large-scale, long-term data acquisition and analysis –  EDUPUB, IMS/GLC Caliper –  Meta-analysis

•  Concept –  Measurement of text editing operations –  Designing an information model for writing –  Interoperability by standardization –  Matrix type text editing model

•  Approach –  Seeds oriented –  proof of concept

•  Results, discussion 2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 2

BACKGROUND

2014-09-09, JSSST2014 Taku Yamaguchi, Future University Hakodate 3

Large-scale and long-term data accumulation and analysis

is realized by interoperability and standardization •  From lock-in to interoperability (*) •  EDUPUB, IMS/GLC Caliper:

–  EDUPUB Tokyo 2014, 16-18 Sept. 2014, @Tokyo •  Benchmarking

–  Many researches, practices; methods for teaching, learning and reviewing

–  Measurement –  Synthesize data and results

(*) Tsuneo Yamada, The MOOC phenomenon ‒ The issues of the forthcoming online course platforms in post-MOOC, JOHO KANRI Vol. 57 (2014) No. 6 pp.367-375


CONCEPTS


Measurement of writing activities


text edi'ng app/system

writing xxx

xxxx xxx xxx xx xx xxxx

researchers

other writers

teacher

the writer

produced text

monitoring, analysis

Point of view: editing operations


text edi'ng system editing operations

xxx xxxx xxx xxx xx xx xxxx

log

researcher

other writer

instructor

writer

produced text

edi'ng opera'on sensor

▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲


Other focus, e.g. produced text


text edi'ng system writing xxx


corpus

researcher

other writer

instructor

writer

Natural Language

Proccessing

produced text


▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲

Digital Humanities


text edi'ng system

writing xxx


log

researcher

writer

produced text

monitoring and analyzing

edi'ng opera'on sensor

▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲

Humani'es cogni've psychological research on wri'ng

process

Digital designing and

implemen'ng wri'ng informa'on model

writing research methods


text edi'ng system

writing xxx


matrix type opera'on sensor

researcher

other writer

instructor

writer


produced text

matrix

operations and their targets

▲▲ ▲ ▲ ▲▲▲ ▲ ▲▲▲▲▲▲

keystroke logging

recording whole

opera'ons

time

測定機能測定機能 more senors

•  thinking aloud protocols •  produced text analysis •  video recording •  eye tracking •  Neurologicals ...

this research

Designing writing information model

information model •  activity •  conceptual information structure on which those activities are based


(2) which provide with fruitful analysis

•  humani'es •  instruc'on •  learning •  document review/ management

(1) What are information models of writing

x x x x x

(3) and can be supported by new and existing applications

apps/systems and the model


•  humani'es •  instruc'on •  learning •  document review/ management

(1) What are information models of writing

x x x x x

Various implementation •  New/existing •  Full/partial support •  Native/activity-translation

(3) and can be supported by new and existing applications

focus here

(2) which provide with fruitful analysis

スマホ、タブレット、PC

文書Y xxxxxxxxxxxxxxxx xxx

Interoperability without Interoperability...



サーバA

編集操作ログ

書き手A

サーバ処理

クラウド・ストレージサーバB

編集操作ログサーバ処理


文書X xxxxxxxxxxxxxxxx xxx

モニター

サーバ処理

文書Xのログ

文書Yのログ

書き手Aのグラフ

書き手Bのグラフ

None

書き手Aのグラフ None


モニター

サーバ処理

書き手B




Interoperability Interoperable



サーバA

編集操作ログ

書き手A

サーバ処理

クラウド・ストレージサーバB

編集操作ログサーバ処理



サーバ処理

文書Xのログ

文書Yのログ

書き手Aのグラフ


モニター

サーバ処理

書き手B


Matrix type information model for "writing"

•  Worksheet model of Explicit/implicit guidelines/instructions for "planning". –  "Write y, as section a1, a2, ... or aN; considering b1, b2, ... and/or bN; audience are c1, c2, ... and/or cN; it will be reviewed criteria d1, d2, ... dN; ..."

–  axis a = { a1, a2, ... }, axis b = { b1, b2, ...}, ... –  cell y = f(a, b, c, d, ...)

•  Activity –  matrix: editing axes, items of an axis, text in a cell –  editing text which is not associated with a cell


Conceptual two dimensional matrix


自分エントリー

科目性格卒研

志望動機力を注いだ科目は、xxxです。そこで、志望動機yyyです。

希望職種 aaaな性格なので、bbb職を希望します．

1) 記入

2) 列追加 = 「自分」軸に「卒研」視点を追加

APPROACH


Proof of concept The model #1 can be implemented – on Open Web Platform – and give reasonable performance

#2 can be used to write – by writers who know the model well – real text: papers, proceedings, etc.

#3 can provide some hypothesis – from some graphics, etc.


RESULTS, DISCUSSION


#1: Reference implementation provide researchers and engineers with a graphical UI to understand the abstract model


planning produced text

This writer (1) wrote this part of text (2) as a part of "Results" considering "BYOD", (3) And the writer considers that "BYOD" is an item of "Call for Paper" axis and "Results" is an item of "IMRAD" axis.


planning in matrix view produced text

(1) (2)

(2)

(3) (3)

Submitting activity log

Request Method:POST … Request Payload … Content-Disposition: form-data; name="edit_log" {"vr":"0.7","level":"detail","console":false,"saveClear":"true","log":[{"op":"cc_cellText","cnt":{"element":{"id":"cc_764","tagName":"P"},"matrix":{"id":"cc_705","tagName":"TABLE"},"td":{"id":"cc_725","tagName":"TD"},"axes":[{"axis":"cc_743","item":"cc_720"},{"axis":"cc_744","item":"cc_749"}]},"dt":"2014-09-09T04:42:16.736Z"}]}

"op": "cc_cellText", "cnt": { "td": { "id": "cc_725", "tagName": "TD" }, "axes": [ { "axis": "cc_743", "item": "cc_720" }, { "axis": "cc_744", "item": "cc_749" } ] },



(1) (2)

(2)

(3) (3)

"op": "cc_cellText", "cnt": { "td": { "id": "cc_725", ← (1) "tagName": "TD" }, "axes": [ { "axis": "cc_743", ← (3) "item": "cc_720" ← (2) }, { "axis": "cc_744", ← (3) "item": "cc_749" ← (2) } ] },

#2, #3: Editing pattern 1


matrix operations done, posted

types of editing operations

time line

paragraphs headings operations

matrix operations

other operations

Editing patter 2

•  less matrix operations,

•  ceased at the early stage


matrix operations

In case of a proceeding


9 Jun. paper submission

4 Jul. acceptance no'fica'on

16 Jul. camera ready submission

matrix operations

Till paper submission


9 Jun. paper submission

matrix operations; planning composition

from notification to camera ready


16 Jul. camera ready matrix

operations

No matrix operations, so the writer may not change the construction of the text

Scalability and Confidentiality


•  Scalability •  Confiden'ality

-‐> Life'me learning

No matrix operations, so the writer may not change the construction of the text

oh!: •  Does the writer

understand the comment of peers?

•  Does the app support sufficiently to change the construc'on of the large text?

the analysis provides these hypotheses without reading or

analyzing wriQen text

Designing an Information Model of Writing for Monitoring and Analytics

Technology

Transcript of Designing an Information Model of Writing for Monitoring and Analytics