Ve, a linguistic framework.

76
Ve

Transcript of Ve, a linguistic framework.

Page 1: Ve, a linguistic framework.

Ve

Page 2: Ve, a linguistic framework.

@KIMTARO

Page 3: Ve, a linguistic framework.
Page 4: Ve, a linguistic framework.

JISHO.ORG

Page 5: Ve, a linguistic framework.

LINGUISTICFRAMEWORK

FOR YOU

Page 6: Ve, a linguistic framework.

HOLY SHITWHY AREN’T WE US ING

MORE LINGUISTICS?!?!?!=!??!=!?!111one

Page 7: Ve, a linguistic framework.

USES?

Page 8: Ve, a linguistic framework.

SEARCH

Page 9: Ve, a linguistic framework.

!ies

Page 10: Ve, a linguistic framework.

!ies!y

Page 11: Ve, a linguistic framework.

SENTENCES

Page 12: Ve, a linguistic framework.

The U.S.A. Ambassadorto S. Korea.

Page 13: Ve, a linguistic framework.

The U.S.A. Ambassadorto S. Korea.

Page 14: Ve, a linguistic framework.

WORDS

Page 15: Ve, a linguistic framework.

ビールを飲む

Page 16: Ve, a linguistic framework.

ビール を 飲む

Page 17: Ve, a linguistic framework.

TRANSLITERATIONS

Page 18: Ve, a linguistic framework.

Page 19: Ve, a linguistic framework.

酒さけ

Page 20: Ve, a linguistic framework.

TAGGING

Page 21: Ve, a linguistic framework.

“I like beer„

Page 22: Ve, a linguistic framework.

“I like beer„

beer

Page 23: Ve, a linguistic framework.

PROBLEMS:(

Page 24: Ve, a linguistic framework.

STEMMING

Page 25: Ve, a linguistic framework.

!ies

Page 26: Ve, a linguistic framework.

!ies

!i

Page 27: Ve, a linguistic framework.

!ies

!i

Page 28: Ve, a linguistic framework.

LANGAUGE

Page 29: Ve, a linguistic framework.

HAS

Page 30: Ve, a linguistic framework.

EDGE CASES

Page 31: Ve, a linguistic framework.

IRREGULAR

ITIES

Page 32: Ve, a linguistic framework.

ENGLISH ONLY

Page 33: Ve, a linguistic framework.

PARSERS

Page 34: Ve, a linguistic framework.

ALL. THE.THINGS.

Page 35: Ve, a linguistic framework.

FUCK YEAH

Page 36: Ve, a linguistic framework.
Page 37: Ve, a linguistic framework.
Page 38: Ve, a linguistic framework.

CRASH

Page 39: Ve, a linguistic framework.

BUGGY

Page 40: Ve, a linguistic framework.

MEMORY

Page 41: Ve, a linguistic framework.

I N P U TOUTPUT

Page 42: Ve, a linguistic framework.

CHARACTERENCODINGS

Page 43: Ve, a linguistic framework.

DESTRUCTIVE

Page 44: Ve, a linguistic framework.

CASINGWHITESPACE

PUNCTUATION

Page 45: Ve, a linguistic framework.

LINGUISTSONLY

Page 46: Ve, a linguistic framework.

DIFFERENTPART OF

SPEECH SETS

Page 47: Ve, a linguistic framework.

BROWN CORPUS: 230IPADIC: 120

Page 48: Ve, a linguistic framework.

飲ん�����動詞だ ����助動詞

Page 49: Ve, a linguistic framework.
Page 50: Ve, a linguistic framework.

MANAGESPARSERS

Page 51: Ve, a linguistic framework.

ONE APITO RULE

THEM ALL

Page 52: Ve, a linguistic framework.

MULTIPLELANGUAGES

Page 53: Ve, a linguistic framework.

UNIFIEDPART OF

SPEECH SET

Page 54: Ve, a linguistic framework.

18

Page 55: Ve, a linguistic framework.

LEMMA

Page 56: Ve, a linguistic framework.
Page 57: Ve, a linguistic framework.
Page 58: Ve, a linguistic framework.

!ies

!y

Page 59: Ve, a linguistic framework.

♥YOUR DATA

Page 60: Ve, a linguistic framework.

LOWLEVEL

ACCESS

Page 63: Ve, a linguistic framework.
Page 64: Ve, a linguistic framework.

PARSERS EN EN EN JA JA SW CH

VE SERVER

PROVIDERS

MANAGERS EN JA SW CH

INTERFACES RUBY local JSRUBY remote

SERVER

RUBY gem JS libVE CLIENTS

Page 65: Ve, a linguistic framework.
Page 66: Ve, a linguistic framework.

gem "ve", '0.0.2', :git => 'git://github.com/Kimtaro/ve.git'

Page 67: Ve, a linguistic framework.

words = Ve.in(:ja).words(input)

Page 68: Ve, a linguistic framework.

words.each do |word| word.word word.part_of_speech.name word.extra[:reading].katakana_to_hiraganaend

Page 69: Ve, a linguistic framework.

#<Ve::Word:0x8edfe24@word="melons",@lemma="melon",@part_of_speech=Ve::PartOfSpeech::Noun,@tokens=[{ :raw=>"melons melon NNS 1", :type=>:parsed, :literal=>"melons", :lemma=>"melon", :pos=>"NNS", :accuracy=>"1", :characters=>7..12}],@extra={:grammar=>:plural},@info={}>

Page 70: Ve, a linguistic framework.

#<Ve::Word:0x8edfe24@word="melons",@lemma="melon",@part_of_speech=Ve::PartOfSpeech::Noun,@tokens=[{ :raw=>"melons melon NNS 1", :type=>:parsed, :literal=>"melons", :lemma=>"melon", :pos=>"NNS", :accuracy=>"1", :characters=>7..12}],@extra={:grammar=>:plural},@info={}>

Page 71: Ve, a linguistic framework.

#<Ve::Word:0x8edfe24@word="melons",@lemma="melon",@part_of_speech=Ve::PartOfSpeech::Noun,@tokens=[{ :raw=>"melons melon NNS 1", :type=>:parsed, :literal=>"melons", :lemma=>"melon", :pos=>"NNS", :accuracy=>"1", :characters=>7..12}],@extra={:grammar=>:plural},@info={}>

Page 72: Ve, a linguistic framework.

#<Ve::Word:0x8edfe24@word="melons",@lemma="melon",@part_of_speech=Ve::PartOfSpeech::Noun,@tokens=[{ :raw=>"melons melon NNS 1", :type=>:parsed, :literal=>"melons", :lemma=>"melon", :pos=>"NNS", :accuracy=>"1", :characters=>7..12}],@extra={:grammar=>:plural},@info={}>

Page 73: Ve, a linguistic framework.

Ve.in(:ja).sentences(input)

Page 74: Ve, a linguistic framework.

Ve.in(:ja).transliterate_from_hira_to_latn(input)

Page 75: Ve, a linguistic framework.

<script src="ve.js"></script><script> Ve('en').words('I like beer', function(words) { $.each(words, function(i, w) { w.lemma; w.part_of_speech; }); });</script>

Page 76: Ve, a linguistic framework.

github.com/Kimtaro/ve