Using LLVM and Sulong for Language C Extensionsllvm.org/devmtg/2016-09/slides/Seaton-Sulong.pdf ·...

Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|

UsingLLVMandSulongforLanguageCExtensions

ChrisSeatonResearchManagerVMResearchGroupOracleLabs

ManuelRigger,MatthiasGrimmerJKULinz


SafeHarborStatementThefollowingisintendedtoprovidesomeinsightintoalineofresearchinOracleLabs.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract. Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Oraclereservestherighttoalteritsdevelopmentplansandpracticesatanytime,andthedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedinconnectionwithanyOracleproductorserviceremainsatthesolediscretionofOracle. AnyviewsexpressedinthispresentationaremyownanddonotnecessarilyreflecttheviewsofOracle.

3


Whoweareandwhatwe’redoing

4


Graal

Truffle

RRuby

Java Scala

JavaScript LLVM

TheRubyLogoisCopyright(c)2006,YukihiroMatsumoto.ItislicensedunderthetermsoftheCreativeCommonsAttribution-ShareAlike 2.5agreementJSLogoCopyright(c)2011ChristopherWilliams<[email protected]>,MITlicence

YoucandistributethelogounderthetermsoftheCreativeCommonsAttribution-ShareAlike 4.0Internationallicense(CC-BY-SA4.0)or(atyouroption)theGNUGeneralPublicLicenseversion2(GPL-2).

JVM


LanguageCextensions

7


TheRubyLogoisCopyright(c)2006,YukihiroMatsumoto.ItislicensedunderthetermsoftheCreativeCommonsAttribution-ShareAlike 2.5agreementJSLogoCopyright(c)2011ChristopherWilliams<[email protected]>,MITlicence

ThePythonlogoisatrademarkofthePythonSoftwareFoundation


PerformanceonRubyCExtensionsOilyPNGandPSDNative

12

M.Grimmer,C.Seaton,T.Würthinger,H.Mössenböck.DynamicallyComposingLanguagesinaModularWay:SupportingCExtensionsforDynamicLanguages.InProceedingsofthe14th InternationalConferenceonModularity,2015.

0

2

4

6

8

10

12

MRIPureRuby MRIWithCExtension


TheCextensionproblem

13


Structs declaredinthepublicAPI

Implementationdetailslikeembeddedstringsandsharing

exposed


RubyStringobject

Exposesinnerchar*

Stringobjectwithchar*alreadyexposednowreturnedtoRuby

CalltoarbitraryCcode

ManagedRubyvalueontheCstack


ValuesneedtobeconvertedastheygofromRubytonative

CallfromRubytonativeisextremelyhot


Arrayimplementationpointertakenandstored

forlater

Whenthey’reusedthere’snoindicationsomeoneelseis

managingthem


Previoussolutions

18


Copy Copy


Ournewsolution

20


• InterpretboththeRubyandtheC• Actually,interprettheLLVMIRoftheCtosimplify• JITcompiletheRubyandtheC• UseasinglehighandlowlevelIRforboth• ForgetwhichlanguagetheIRcamefromandoptimisethemtogether• GivevirtualisedpointerstotheCprogram

21


HowSulong andJRuby+Truffle work

22


Hotspot


Hotspot

JIT


Hotspot

JIT

JIT


Hotspot

JIT

JIT

Truffle


U

U U

U

U I

I I

G

G I

I I

G

G

Node Rewriting for Profiling Feedback

AST InterpreterRewritten Nodes

AST InterpreterUninitialized Nodes

Compilation usingPartial Evaluation

Compiled Code

Node Transitions

S

UI

D

G

Uninitialized Integer

Generic

DoubleString

T.Würthinger,C.Wimmer,A.Wöß,L.Stadler,G.Duboscq,C.Humer,G.Richards,D.Simon,andM.Wolczko.OneVMtorulethemall.InProceedingsofOnward!,2013.


codon.com/compilers-for-free

Presentation,byTomStuart,licensedunderaCreativeCommonsAttributionShareAlike 3.0


U

U U

U

U I

I I

G

G I

I I

G

G

Node Rewriting for Profiling Feedback

AST InterpreterRewritten Nodes

AST InterpreterUninitialized Nodes

Compilation usingPartial Evaluation

Compiled Code

Node Transitions

S

UI

D

G

Uninitialized Integer

Generic

DoubleString


Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|13/09/2016


I

I I

G

G I

I I

G

G

Deoptimizationto AST Interpreter

D

I D

G

G D

I D

G

G

Node Rewriting to Update Profiling Feedback

Recompilation usingPartial Evaluation

Copyright©2016, Oracleand/oritsaffiliates.Allrightsreserved.|13/09/2016 OracleConfidential– Internal/Restricted/HighlyRestricted


I

I I

G

G I

I I

G

G

Deoptimizationto AST Interpreter

D

I D

G

G D

I D

G

G

Node Rewriting to Update Profiling Feedback

Recompilation usingPartial Evaluation


Frequently executed call


BigInteger

double

int


double

int

BigInteger


Hotspot

Graal

Truffle

JS RubyR

Java

C++JVMCI

(JVMCompilerInterface)


Hotspot

Graal

Truffle

JS RubyR

viaMavenetc

Java9


Completeness– languageandcorelibrary

OracleConfidential– Internal

RubylanguageJRuby passes94%

95% RubycorelibraryJRuby passes95%

99%


Completeness– thebasicRailsstack

OracleConfidential– Internal

ActiveModel

ActiveSupport

ActiveRecord

ActionView

ActionPack

ActionMailer

Railties

Sprockets-Rails

ActiveJob

Spring

100%

100%

98%Basicfunctionalityworks

37%


Classicresearchbenchmarks– 10-20xfaster

Confidential– OracleInternal/Restricted/HighlyRestricted 48

05

1015202530354045

Speedu

pCo

mparedtoRub

y

GraalVM JRuby+invokedynamic Ruby

BenchmarksboundbyallocationorBigInteger

performance


HowweimplementCextensions

52


cmyk_to_rgb

psd_native_util_clamp

FIX2INT


InsteadofRARRAY_PTRreturningapointer(anumber),returna

properJavaobject

Operationslikegetelementptr canreturnanewJavaobjectthat

rememberstheoriginalobject,andwhatoffsettouse

LetSSAnamesstoreJavaobjectsaswellasnumbers

TheloadcanthenusewhateverlogicwewanttoactuallyreadavaluefromtheJavaobject– reusenormalRubyarray

logic


Virtualised pointer– reallypointstoaJavaobjectwhichrepresentsourRubystring

TheCprogramhasnowayofknowingit’snotarealchar*

Intrinsicoperationsonthepointerareredirectedtobe

methodcalls


Evaluation

59


Evaluationisbasedonearlierwork• WeusedtohaveaCinterpreter– TruffleC• We’vemovedonfromthis,becausewewanttosupportmorelanguages• Butwearen’tabletorunallthesamebenchmarksyet• Sowe’veshowingresultsfromouroldimplementationinthemeantime• We’reprettysureresultswillbesimilar,asthecompiledcodeissimilar

60



61

0

5

10

15

20

25

30

35


RubiniusWithCExtension

JRubyWithCExtension

JRuby+TruffleWithCExtension


(NoInline)




62

0

5

10

15

20

25

30

35



JRubyWithCExtension



(NoInline)


NativeCextensionsgiveanorderofmagnitudeperformanceboost



63

0

5

10

15

20

25

30

35



JRubyWithCExtension



(NoInline)


Existingattempttomixmanaged/nativearevery

disappointing



64

0

5

10

15

20

25

30

35



JRubyWithCExtension



(NoInline)


Oursolutionis3xfasterthannative!



65

0

5

10

15

20

25

30

35



JRubyWithCExtension



(NoInline)


It’sclearthatcross-languageinlining isakeypartofthe

performance


Conclusions

66


OpenSource• https://github.com/graalvm/graal-core

– Graal compiler• https://github.com/graalvm/truffle

– Trufflelanguageimplementationframework• https://github.com/graalvm/fastr

– FastRruntime• https://github.com/graalvm/sulong

– DynamicruntimeforLLVMbitcode• https://github.com/jruby/jruby/wiki/Truffle

– FastRubyruntime

68


Acknowledgements

69

OracleDaniloAnsaloniStefanAnzingerCosminBascaDanieleBonettaMatthiasBrantnerPetrChalupaJürgenChristLaurentDaynèsGillesDuboscqMartinEntlicherBrandonFishBastianHossbachChristianHumerMickJordanVojinJovanovicPeterKesslerDavidLeopoldsederKevinMenardJakubPodlešákAleksandarProkopecTomRodriguez

Oracle(continued)RolandSchatzChrisSeatonDougSimonŠtěpánŠindelářZbyněkŠlajchrtLukasStadlerCodrutStancuJanŠtolaJaroslavTulachMichaelVanDeVanterAdamWelcChristianWimmerChristianWirthPaulWögererMarioWolczkoAndreasWößThomasWürthinger

JKULinzProf.HanspeterMössenböckBenoitDalozeJosefEislThomasFeichtingerMatthiasGrimmerChristianHäublJosefHaiderChristianHuberStefanMarrManuelRiggerStefanRumzuckerBernhardUrban

Universityof EdinburghChristopheDubachJuanJoséFumero AlfonsoRanjeet SinghToomas Remmelg

LaBRIFloréal Morandat

Universityof California,IrvineProf.MichaelFranzGulfemSavrunYeniceriWeiZhang

Purdue UniversityProf.JanVitekTomasKaliberaPetrMajLeiZhao

T.U.DortmundProf.PeterMarwedelHelenaKotthausIngoKorb

Universityof California,DavisProf.DuncanTempleLangNicholasUlle

Universityof Lugano,SwitzerlandProf.WalterBinderSunHaiyangYudiZheng

OracleInternsBrianBellevilleMiguelGarciaShamsImamAlexeyKaryakinStephenKellAndreasKunftVolkerLantingGeroLeinemannJulianLettnerJoeNashDavidPiorkowskiGregorRichardsRobertSeilbeckRifatShariyar

AlumniErikEcksteinMichaelHauptChristosKotselidisHyunjinLeeDavidLeibsChrisThalingerTillWestmann


SafeHarborStatementTheprecedingisintendedtoprovidesomeinsightintoalineofresearchinOracleLabs.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract. Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Oraclereservestherighttoalteritsdevelopmentplansandpracticesatanytime,andthedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedinconnectionwithanyOracleproductorserviceremainsatthesolediscretionofOracle. AnyviewsexpressedinthispresentationaremyownanddonotnecessarilyreflecttheviewsofOracle.

70

Using LLVM and Sulong for Language C Extensionsllvm.org/devmtg/2016-09/slides/Seaton-Sulong.pdf ·...

Documents

Transcript of Using LLVM and Sulong for Language C Extensionsllvm.org/devmtg/2016-09/slides/Seaton-Sulong.pdf ·...