parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise...
Transcript of parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise...
![Page 1: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/1.jpg)
Parsing Ruby
Rathesan Iyadurai
1
![Page 2: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/2.jpg)
Goal
2
Extract all classes and their methods without having to define the complete
grammar of Ruby.
![Page 3: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/3.jpg)
Previously on “Parsing Ruby”
![Page 4: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/4.jpg)
4
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 5: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/5.jpg)
5
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 6: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/6.jpg)
6
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 7: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/7.jpg)
7
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 8: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/8.jpg)
8
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 9: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/9.jpg)
'foo class bar' "foo class bar"
%?foo class bar? %{foo class bar} %<foo class bar> %(foo class bar) %[foo class bar] %q{foo class bar} %Q{foo class bar}
<<spongebob.strip foo class bar spongebob
9
![Page 10: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/10.jpg)
Modifiers
10
![Page 11: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/11.jpg)
11
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 12: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/12.jpg)
12
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark str = if age > 3 "wuff" else "wiff" end puts str end
end
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark if age > 3 puts "wuff" else puts "wiff" end end
end
![Page 13: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/13.jpg)
13
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark str = if age > 3 "wuff" else "wiff" end puts str end
end
![Page 14: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/14.jpg)
14
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark str = if age > 3 "wuff" else "wiff" end puts str end
end
modifier := startOfLine , stuffToConsume , newline not , '=' not , 'if'
![Page 15: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/15.jpg)
15
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark str = if age > 3 "wuff" else "wiff" end puts str end
end
modifier := startOfLine , stuffToConsume , newline not , '=' not , 'if'
![Page 16: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/16.jpg)
16
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark str = if age > 3 "wuff" else "wiff" end puts str end
end
modifier := startOfLine , stuffToConsume , newline not , '=' not , 'if'
![Page 17: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/17.jpg)
17
class Dog
attr_accessor :age
def initialize(age) raise "NOO" if age < 1
@name = "foo class bar" @age = age end
def bark str = if age > 3 "wuff" else "wiff" end puts str end
end
modifier := startOfLine , stuffToConsume , newline not , '=' not , 'if'
![Page 18: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/18.jpg)
~ 50 rules
10 for matching “end”s
13 for keywords
18
10 for strings and comments
![Page 19: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/19.jpg)
Keywords
def if endless bado end.class
19
![Page 20: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/20.jpg)
Keywords
def if endless bado end.class
20
![Page 21: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/21.jpg)
String Interpolationname = "Jan" "Hi #{name}!" # => "Hi Jan!"
"Hi #{class Dog; end}"
"Hi #{puts ""}"
"Hi #{list.each { |l| foo }}"
21
![Page 23: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/23.jpg)
class Dog end if foo?
23
![Page 24: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/24.jpg)
Now what?
24
![Page 25: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/25.jpg)
def foo a = "i'm a local variable!" b end
def b "i'm a method!" end
25
![Page 26: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/26.jpg)
def foo(arg) a = "i'm a local variable!" arg.b end
26
![Page 27: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/27.jpg)
Overview
Goal: Extract all classes and their methods without having to define the complete grammar of Ruby
Problems: modifiers, keywords, string interpolation
Goal achieved?
27
![Page 28: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/28.jpg)
0
500
1000
1500
2000
2500
3000
0 5000 10000 15000 20000 25000 30000 35000 40000 45000
Milli
seco
nds
Number of Characters
RubyGrammar Performance
smooth milliseconds per character count
![Page 29: parsing ruby reloaded - scg.unibe.chscg.unibe.ch/...03-23-Iyadurai-ParsingRubyReloaded.pdf · raise "NOO" if age < 1 @name = "foo class bar" @age = age end def bark str = if age](https://reader034.fdocuments.us/reader034/viewer/2022050514/5f9ebf6f8b86510bc96703aa/html5/thumbnails/29.jpg)
0
500
1000
1500
2000
2500
3000
0 20 40 60 80 100 120
Milli
seco
nds
Number of Methods
RubyGrammar Performance
smooth milliseconds per method count