Another compilation method in java - AOT (Ahead of Time) compilation

AnothercompilationmethodinJavaAOT(AheadofTime)Compilation

AkihiroNishikawaOracleCorporationJapan

SafeHarborStatementThefollowingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

Agenda

JIT(Just-in-Time)Compilation

AOT(Ahead-of-Time)Compilation

Limitations

Summary

Inthissession,ImainlycoverHotSpot.

JIT(JustinTime)Compilation

SourceCode(*.java)

Classfile(*.class)

HotSpot

Compile

ForimprovementofwarmuptimeTieredcompilation

C1(-client/clientuse) C2(-server/serveruse)

• Longercompilationtimeandlongerstartuptime,butgeneratedcoderunsfaster.

• Heavyoptimization

• Incaseofprioritizingperformanceafterinvocation...

• Shortercompilationtimeandshorterstartuptime,butgeneratedcoderunsslow.

• Lessoptimization

• Incaseofprioritizingstartuptime...

CompilationLevel

• 4:C2• 0:Interpreter

C2Interpreter C1

• 1:C1fulloptimization(noprofiling)• 2:C1withprofilingaboutinvocationandback-edgeonly• 3:C1fullprofiling(level2+MDO)

1,500 10,000

AOT– AheadOfTimecompilation•Generatenativecodeinadvance

• JEP295

•BasedonGraal

AOTCompilation

SourceCode(*.java)

Classfile(*.class)

HotSpot

Sharedobjectfile(*.so)

*.java

*.class HotSpot

javac Compile

Abletoshare“*.so”fileamongJVMs

HotSpot

AOTlookslikeCDS/AppCDS…

CDS/AppCDS (ClassDataSharing)• CDSistheschemeforsharingJavaSEclasslibraryonly.• IncaseofAppCDS,applicationclassesarealsoincluded.

ClassDataclasses.jsa

HotSpot

Worksfor...• Quickerwarmup• Lowertotalmemoryfootprint

Doesnotworkfor...• Nofeaturetopersistorsharemachine(native)code.

CDS/AppCDS

IsAOTanewcompilationmethod?

$ gcc -o HelloAoT HelloAoT.c

IncaseofC...

HowaboutotherJavaimplementations?

AOTJavaCompilers• IBMJavaSDKforAIX

• IBMJavaSDKforz/OS

• OracleJavaMEEmbeddedClient

•WebSphereRealTime

• GluonVMetc.

DoesAOTsupporttieredcompilation(C1/C2)?

AOT SupportsTieredCompilation• Non-tieredcompilationmode(default)–SimilartoC1inClientVM–Nocollectingprofilinginformation–NoJITrecompilationifAOTcodeisnotdeoptimized.

• Tiedcompilationmode(--compile-for-tiered)–ProfilinglevelisassameasC1Level2.– IfhittingAOTinvocationthresholds,methodsarerecompiledbyC1atLevel3firstforgatheringfullprofilinginformation.

WhatdoesAOTworkfor?

Benefitsmight begainedfromAOT...• Nocompilationoverheadatruntime.• Improvestartuptimeandabletoachievepeakperformancefaster.• Abletorunontheplatformwherenativecodecannotbenotgeneratedatruntime(e.g.iOS,embedded).• Densityimprovement- Abletosharenativecode.

$ jaotc --output libHelloAOT.so HelloAOT.class

$ jaotc --output libjava.base.so --module java.base

$ jaotc --output libmyapp.so --jar myapp.jar

$ jaotc -J-XX:+UseCompressedOops --output libHelloAOT.so HelloAOT.class

Howtousejaotc

jaotc doesnotresolveallreferencedclasses• jaotc doesnotresolvereferencedclasseswhicharenotsystemclassesorpartofcompiledclasses.1. Havetoaddreferencedclassestoclasspath.

2. Specifyadditionaljavamodules

jaotc --output=libfoo.so --jar foo.jar ¥-J-cp -J./

jaotc --output=libactivation.so --module ¥java.activation -J--add-module=java.se.ee

$ java -XX:AOTLibrary=./libHelloAOT.so HelloAOTHello AOT!

$ java -XX:+PrintAOT ¥-XX:AOTLibrary=./libHelloAoT.so HelloAoT13 1 loaded ./libHelloAoT.so aot library76 1 aot[ 1] HelloAoT.<init>()V76 2 aot[ 1] HelloAoT.main([Ljava/lang/String;)V

Hello AOT!

RunAOTcompiledcode

OnJVMstartup...• AOTinitializationcodelooksforwell-knownAOTlibrariesinwell-knownlocation($JAVA_HOME/lib)orlibrariesspecifiedusing-XX:AOTLibrary.• JVMknowsAOTlibrarynameforthefollowingJavamodules.–java.base–jdk.compiler (javac)–jdk.scripting.nashorn (Nashorn)–jdk.internal.vm.ci (JVMCI)–jdk.internal.vm.compiler (Graal)

VMOptionsshouldbesynchronized.• libjava.base.so-XX:-UseCompressedOops -XX:+UseG1GC• libjava.base-coop.so-XX:+UseCompressedOops -XX:+UseG1GC• libjava.base-nong1.so-XX:-UseCompressedOops -XX:+UseParallelGC• libjava.base-coop-nong1.so-XX:+UseCompressedOops -XX:+UseParallelGC

Limitations

• Experimentalrelease• Nosupport• Noofficialdocument(exceptforJEP)

Firstofall...

Limitations

• AvailableonlywhenusingeitherParallelor G1GConLinuxx64withlibelf.so.• AOTcompilationmustbeexecutedonthesamesystem orasystemwiththesameconfiguration onwhichAOTcodewillbeusedbyJavaapplication.• Unabletocompilejavacodeusingdynamicallygeneratedclassesandbytecode (lambdaexpressions,InvokeDynamic)

TheselimitationsareinJava9,andmaybeaddressedinfuturereleases.

WhenandwheretouseAOT?

• Event-drivenservicessuchasFunctions• Embedded,IoT,mobile• Notofteninvokedclasses...(nothotcode)• Applicationcodewhichshouldbeprotectedfromdecompilers

...etc.

IfAOTisofficiallysupportedandisavailableonseveralplatforms...

Summary• SinceJava9(HotSpot),AOTcompilationisavailable,butpositionedasexperimentalreleaseandnoofficialsupport.

• AOThaveseveralcharacteristicsandisexpectedtoimproveperformanceofapplications,especiallysuchshort-livedobjectsasfunctions

•WorkingtoremovecurrentlimitationandimproveAOT.

SafeHarborStatementTheprecedingisintendedtooutlineourgeneralproductdirection.Itisintendedforinformationpurposesonly,andmaynotbeincorporatedintoanycontract.Itisnotacommitmenttodeliveranymaterial,code,orfunctionality,andshouldnotberelieduponinmakingpurchasingdecisions.Thedevelopment,release,andtimingofanyfeaturesorfunctionalitydescribedforOracle’sproductsremainsatthesolediscretionofOracle.

Another compilation method in java - AOT (Ahead of Time) compilation

Software

Transcript of Another compilation method in java - AOT (Ahead of Time) compilation

AOT: Annual Report 2008

ISCA 2019 Tutorial...• Generate compilation method list from call graph with unreachable methods removed • Do AOT compilations for methods on the compilation method list only •

Master Laporan Praktikum Aot

Just-In-Time Compilation · 2016. 2. 1. · Just-In-Time Compilation Goals: I Tries to ﬁll the gap between Interpreter and AOT compilers I Efﬁciency and platform independency

AOT Annual Report (2018)cdn.amegroups.cn/redmine/2019/07/190726083910_03dbf3bdd8c6a… · AOT Editorial Board Members 4. Geographical Distribution of AOT Editorial Board Members 5.

Angular to React Moda Jovem: Moving from · Better speed and performance than Angular 1 AOT (Ahead-of-Time compilation) Directives and filters are awesome Unit test friendly Pros.

AOT: Annual Report 2011

AOT January 2020

AoT Beta 2 Armies

Java Ahead-Of-Time compilation

Introduction to Android - Tomasz X · In Android 4.4 ART (Android Runtime) has to be enabled in Settings -> Developer options. Advantages: (AOT) Ahead-of-time compilation Improved

ตารางสรุปผลการดำเนินงานแผนปฏิบัติการภายใต AOT Strategy ... · ตารางสรุปผลการดำเนินงานแผนปฏิบัติการภายใต

Coverage-Directed Differential Testing of JVM Implementationscse.sjtu.edu.cn/~zhao/pub/pdf/pldi2016.pdf · time compilation, ahead-of-time compilation, and interpre-tation) and adapt

P2 What is AOT

AOT BridgeLoadingFinalReport2009!01!07 2

2016 AOT D Worldwide

Aot Version 2

A Type System for JavaScript with Fixed Object LayoutWontae Choi @ Static Analysis Symposium 2015 • Ahead-of-time (AOT) compilation -provides a similar performance -without the cost

Cloud Computing Presentation (AOT)

Java para dispositivos móveisapm/CM/docs/14IntroXamarin.pdf · Intro to Xamarin 7 Xamarin.iOS does full Ahead Of Time (AOT) compilation to produce an ARM binary for Apple’s App