Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology,...
-
Upload
bernard-perkins -
Category
Documents
-
view
213 -
download
0
Transcript of Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology,...
![Page 1: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/1.jpg)
Testing and Spacing: Keys to Enhancing
Learning and Retention
Sean KangDepartment of Psychology, UCSD
TDLC BootcampAug 10, 2009
![Page 2: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/2.jpg)
Purpose of Tests / Quizzes
• Traditionally, an assessment tool
• But testing does not merely measure the contents of memory
• Taking a test can serve as a learning opportunity, enhancing memory retention to a greater extent than additional studying…
the testing effect
(also referred to as retrieval practice)
![Page 3: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/3.jpg)
Spitzer (1939)
• 3,605 sixth-graders in Iowa
• Students read ~600-word article on the bamboo plant
• 25-item multiple-choice test (no feedback)
• Varied the retention interval and frequency of testing
![Page 4: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/4.jpg)
Spitzer (1939)Time After Studying (Days)
Group 0 1 7 14 21 28 63
1 T1 T2 T3
2 T1 T2 T3
3 T1 T2
4 T1 T2
5 T1 T2
6 T1 T2
7 T1
8 T1
![Page 5: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/5.jpg)
Spitzer (1939)Time After Studying (Days)
Group 0 1 7 14 21 28 63
1 13.2
2 13.2
3 9.6
4 7.9
5 7.0
6 6.5
7 6.8
8 6.4
![Page 6: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/6.jpg)
Spitzer (1939)Time After Studying (Days)
Group 0 1 7 14 21 28 63
1 13.2 13.1 12.2
2 13.2 11.8 10.7
3 9.6 8.9
4 7.9 8.2
5 7.0 7.1
6 6.5 7.1
7 6.8
8 6.4
![Page 7: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/7.jpg)
The Testing Effect
• Journal of Educational Psychology, 1989:
• Dempster, F. N. (1992). Using tests to promote learning: A neglected classroom resource. Journal of Research & Development in Education, 25, 213–217.
• Resurgence of interest in the testing effect in recent years
![Page 8: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/8.jpg)
![Page 9: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/9.jpg)
Roediger & Karpicke (2006)
• Stimuli: 2 prose passages from TOEFL prep book (~260 words each)
• Learning condition (within-subjects):
– Restudy (two 7-min periods of study) vs. Test (7-min period of study, followed by 7-min period of test)
• Retention interval (between-subjects):
– 5 min, 2 days, or 1 week
![Page 10: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/10.jpg)
![Page 11: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/11.jpg)
![Page 12: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/12.jpg)
• Past research has focused exclusively on verbal materials (or at least required verbal responses at test)
Does testing benefit memory for non-verbal materials?
Carpenter & Pashler (2007)
![Page 13: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/13.jpg)
![Page 14: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/14.jpg)
![Page 15: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/15.jpg)
Roediger & Karpicke (2008)• Stimuli: 40 Swahili-English word pairs
• Subjects studied and were tested on the Swahili words in alternating blocks
![Page 16: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/16.jpg)
d = 4.03
![Page 17: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/17.jpg)
Testing effect: How does it work?
1. Additional (focused) presentation of material
2. Operations/processes engaged by an initial test are also engaged during the final test, resulting in positive transfer to same type of tests (i.e., practice effect)
3. Retrieval itself is a potent memory modifier, with increasing retrieval demand/effort enhancing later retention
![Page 18: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/18.jpg)
![Page 19: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/19.jpg)
Does test format matter?
Initial test type - Short Answer (SA), Multiple Choice (MC), Read Fact
Final, criterial test (SA, MC)
Corrective feedback given after each initial test question.
COMPETING PREDICTIONS: 1) Repeated exposure
MC SA
Initial MC
Initial SA
Final test
2) Transfer appropriate processing 3) Retrieval “effort”
MC SA
Initial MC
Initial SA
Final test
![Page 20: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/20.jpg)
Procedure
Short answer
Multiple choice
Read answer
Control/filler
Within-Subjects,after each article8 items/condition
INTERVENINGEXPERIENCE FINAL TEST
Mult. choice (16): 4 from each of the 4 prior conditions
Short answer (16): 4 from each of the 4 prior conditions
3 days
Read 4 Current Directions articles
~15 mineach
N=48
ENCODING
(Kang, McDermott, & Roediger, 2007)
Feedback provided after each test question
![Page 21: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/21.jpg)
Sample Test Question
(E.g., after reading article on literacy acquisition by Rebecca Treiman)
Read Fact:
Young Joe is more likely to know the name of the letter ‘j’ than Alice or Tom.
Short Answer:
Young Joe is more likely to know the _______ of the letter ‘j’ than Alice or Tom.
Multiple-choice: a. place of articulationb. phonemec. named. sound
![Page 22: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/22.jpg)
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Pro
po
rtio
n C
orr
ect
Testing enhanced later memory, and the enhancement was greater when the initial test format was short answer
None
Read statements
MC
SA
INITIAL TEST
.69 .83 .87 .94
.27 .46 .53 .57
FINAL MC FINAL SA
![Page 23: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/23.jpg)
COMPETING PREDICTIONS:
Transfer appropriate processing
MC SA
Initial MC
Initial SA
MC SA
Initial MC
Initial SA
Retrieval “effort”
Final Test Final Test
![Page 24: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/24.jpg)
Does feedback matter?
Short answer
Multiple choice
Read answer
Control/filler
Within-Subjects,after each article8 items/condition
INTERVENINGEXPERIENCE FINAL TEST
Mult. choice (16): 4 from each of the 4 prior conditions
Short answer (16): 4 from each of the 4 prior conditions
3 days
Read 4 Current Directions articles
~15 mineach
N=48
ENCODING
(Kang, McDermott, & Roediger, 2007)
Feedback provided after each test questionFeedback provided after each test questionFeedback provided after each test questionFeedback provided after each test questionFeedback provided after each test questionFeedback provided after each test question
![Page 25: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/25.jpg)
Does feedback matter?
0
0.1
0.2
0.3
0.4
0.5
0.6
0.7
0.8
0.9
1
Pro
po
rtio
n C
orr
ect
None
Read statements
MC
SA
INITIAL TEST
FINAL MC FINAL SA
.74 .88 .87 .80
.33 .51 .62 .48
Corrective feedback important, especially when initial test performance is not high
![Page 26: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/26.jpg)
The Testing Effect• Taking a test can be a potent learning event, often
yielding better long-term retention than additional studying.
• Testing benefits learning of a diverse range of materials, both verbal and nonverbal.
• Repeated retrieval practice augments the benefit.
• The size of the testing effect is modulated by test format & feedback
– Tests requiring effortful retrieval are more effective at enhancing retention, implicating retrieval as a causal mechanism
– To maximize the benefit of testing, feedback should be provided when initial test performance is low
![Page 27: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/27.jpg)
The Spacing Effect• Reviews are more effective when distributed or spaced out,
rather than massed (with total time equated)
• One of the most robust phenomenon; observed with diverse range of materials / types of learning
• Ebbinghaus (1885):
– When learning to recite a list of 12 nonsense syllables, if 68 repetitions in one day, 7 repetitions required the next day to relearn. If 38 repetitions spread across 3 days, however, 6 repetitions required the following day to relearn.
“…with any considerable number of repetitions a suitable distribution of them over a space of time is decidedly more advantageous than the massing of them at a single time.”
![Page 28: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/28.jpg)
The Spacing Effect
Inter-Study Interval
(ISI)
Or practise retrieving
Spacing effect: Spaced > Massed
Lag effect: Comparison of different levels of spacing
![Page 29: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/29.jpg)
Theoretical accounts• Deficient processing theory
– At short ISI, processing of 2nd presentation is deficient; less attention paid to an item that is relatively more familiar
• Encoding variability theory– Item and its context stored at encoding;– Context is assumed to undergo random drift;– Average distance between any prior context and the current context
will increase with passing of time;– Likelihood of successful retrieval depends on the distance between
context at test and context at encoding;– As ISI increases, increased probability that test context will be
similar to at least one of the study/encoding contexts
![Page 30: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/30.jpg)
The Spacing Effect
• Is there an optimal ISI / gap?
• Does the answer depend on the RI?
![Page 31: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/31.jpg)
![Page 32: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/32.jpg)
<
Cepeda et al. (2006)
![Page 33: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/33.jpg)
![Page 34: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/34.jpg)
The Spacing Effect• For RI >= 1 day, is a 1-day ISI/gap sufficient to produce
most/all of the benefit of spacing?
• Only a handful of studies provide multi-gap comparisons, with RI >= 1 day.
![Page 35: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/35.jpg)
![Page 36: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/36.jpg)
Cepeda et al. (2009), Experiment 1• N = 182
• Stimuli: 40 Swahili-English word pairs
• ISI / Gap (between-subjects):
– 0, 1, 2, 4, 7, and 14 days
• RI: 10 days
• Procedure
– Session 1: All items presented for study once, followed by testing with feedback until all items successfully recalled 2x.
– Session 2: After appropriate gap, all items tested 2x with feedback.
– Session 3: After 10-day RI, final test.
![Page 37: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/37.jpg)
![Page 38: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/38.jpg)
Cepeda et al. (2009), Experiment 2• N = 161
• Stimuli: 2 sets
– Obscure facts (e.g., Who invented snow golf? Rudyard Kipling)
– Photographs of not-well-known objects paired with facts
E.g.,
Name this model, in which Amelia Earhart made her ill fated last flight. Lockheed Electra.
• ISI / Gap (between-subjects):
– 0, 1, 7, 28, 84, 168
• RI: 168 days
![Page 39: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/39.jpg)
![Page 40: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/40.jpg)
Cepeda et al. (2009), Conclusions• Spacing benefits observed with RIs > 1 week
• Gap/ISI had non-monotonic effects on final test performance; accuracy increased then decreased as gap increased.
• For sufficiently long RIs, optimal gap/ISI > 1 day.
![Page 41: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/41.jpg)
![Page 42: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/42.jpg)
Cepeda et al. (2008)• Experiment conducted on the internet
• N = 1,354
• 26 different combinations of gaps and RIs
• Stimuli: 32 obscure facts
• Procedure
– Session 1: Learn 32 facts to criterion of one correct recall of each fact.
– Session 2: After appropriate gap, subjects tested 2x with feedback.
– Session 3: After appropriate RI, final test.
![Page 43: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/43.jpg)
![Page 44: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/44.jpg)
![Page 45: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/45.jpg)
Cepeda et al. (2008), Conclusions• For each RI, final performance initially increased with
increasing gap, then fell as gap increased further.
• The effect of gap was very large: the optimal gap provided a 64% increase (averaged across RIs) in final recall, relative to the 0-day gap condition.
• As RI increases, the optimal gap also increases, but the ratio of optimal gap to RI should decline.
• Smaller costs associated with using gap that is longer than the optimal value than using gap that is shorter.
![Page 46: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/46.jpg)
![Page 47: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/47.jpg)
Expanding vs. Equal Interval Spaced Retrieval
![Page 48: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/48.jpg)
Expanding vs. Equal Interval Spaced Retrieval• Landauer & Bjork (1978) demonstrated the advantage of
expanding over equal interval retrieval practice.• But findings since then have been rather inconsistent,
with several instances of failures to replicate. E.g., Karpicke & Roediger (2007)
![Page 49: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/49.jpg)
![Page 50: Testing and Spacing: Keys to Enhancing Learning and Retention Sean Kang Department of Psychology, UCSD TDLC Bootcamp Aug 10, 2009.](https://reader036.fdocuments.us/reader036/viewer/2022062804/56649e165503460f94b01425/html5/thumbnails/50.jpg)
Applications of Testing & Spacing
• Supermemo www.supermemo.com
• Spaced Edwww.spaceded.com