JRuby+Truffle. Kevin Menard. Chris Seaton. Benoit Daloze. A tour through a new Ruby Oracle Oracle Labs

Size: px

Start display at page:

Download "JRuby+Truffle. Kevin Menard. Chris Seaton. Benoit Daloze. A tour through a new Ruby Oracle Oracle Labs"

Beatrix Joseph
5 years ago
Views:

2 JRuby+Truffle A tour through a new Ruby implementahon Chris Oracle Labs Benoit JKU Linz Kevin Oracle Labs Ruby logo copyright (c) 2006, Yukihiro Matsumoto, licensed under the terms of the CreaHve Commons AYribuHon- ShareAlike 2.5 agreement Copyright 2015, Oracle and/or its affiliates. All rights reserved.

3 Safe Harbor Statement The following is intended to provide some insight into a line of research in Oracle Labs. It is intended for informahon purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or funchonality, and should not be relied upon in making purchasing decisions. Oracle reserves the right to alter its development plans and prachces at any Hme, and the development, release, and Hming of any features or funchonality described in connechon with any Oracle product or service remains at the sole discrehon of Oracle. Any views expressed in this presentahon are my own and do not necessarily reflect the views of Oracle. Copyright 2015, Oracle and/or its affiliates. All rights reserved. 3

5 Current situation Prototype a new language Parser and language work to build syntax tree (AST), AST Interpreter Write a real VM In C/C++, shll using AST interpreter, spend a lot of Hme implemenhng runhme system, GC, People start using it People complain about performance Define a bytecode format and write bytecode interpreter Performance is shll bad Write a JIT compiler Improve the garbage collector Copyright 2015, Oracle and/or its affiliates. All rights reserved. 5

6 Current situation How it should be Prototype a new language Parser and language work to build syntax tree (AST), AST Interpreter Write a real VM In C/C++, shll using AST interpreter, spend a lot of Hme implemenhng runhme system, GC, Prototype a new language in Java Parser and language work to build syntax tree (AST) Execute using AST interpreter People start using it And it is already fast People start using it People complain about performance Define a bytecode format and write bytecode interpreter Performance is shll bad Write a JIT compiler Improve the garbage collector Copyright 2015, Oracle and/or its affiliates. All rights reserved. 6

8 Truffle: a framework for wrihng AST interpreters for languages in Java Graal: a dynamic compiler (JIT) for Java, wriyen in Java, as a Java library Copyright 2015, Oracle and/or its affiliates. All rights reserved. 8

9 U Node Rewriting for Profiling Feedback G Compilation using Partial Evaluation G U U Node Transitions I G I G U U U Uninitialized Integer I I I I I AST Interpreter Uninitialized Nodes S String G D Double Generic AST Interpreter Rewritten Nodes Compiled Code T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, Copyright 2015, Oracle and/or its affiliates. All rights reserved. 9

13 Deoptimization to AST Interpreter G Node Rewriting to Update Profiling Feedback G Recompilation using Partial Evaluation G G I G I G D G D G I I I D I I I D T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, Copyright 2015, Oracle and/or its affiliates. All rights reserved. 13

John Tenniel illustrahons public domain in the UK and US

16 t1 = Fixnum(a) + Fixnum(b) if t1.overflowed? t1 = Bignum(a) + Bignum(b) t2 = Bignum(t1) + Bignum(c) else t2 = Fixnum(t1) + Fixnum(c) if t2.overflowed? t2 = Bignum(t1) + Bignum(c) end end Copyright 2015, Oracle and/or its affiliates. All rights reserved. 16

Guest Language Truffle AST interpreter Graal VM Copyright

22 SpecializaHons class Array def [](index=fixnum()) # return element at index end def [](index=fixnum(), num=fixnum()) # return num elements starting at index end def [](range=range()) # return elements from range.start to range.end end def [](index) # coerce index and dispatch end B. Shirai, Rubinius 3.0, Part 5, The Language, hyp://rubini.us/2014/11/14/rubinius part- 5- the- language/ Copyright 2015, Oracle and/or its affiliates. All rights reserved. 22

23 SpecializaHons def clamp(num, min, max) [min, num, max].sort[1] end chunky_png and psd.rb, Willem van Bergen, Ryan LeFevre, Kelly SuYon, Layer Vault, Floorplanner et al Copyright 2015, Oracle and/or its affiliates. All rights reserved. 23

From Fixnum#+ to 0x03 0x70 Copyright 2015,

25 Digging through ObjectSpace and deophmizahon l DeopHmize l Get a consistent view of memory: safepoints l Find all reachable objects l Iterate through them Copyright 2015, Oracle and/or its affiliates. All rights reserved. 25

26 Digging through ObjectSpace and deophmizahon public Map<Long, RubyBasicObject> collectliveobjects() { liveobjects = new HashMap<>(); visitor = new ObjectGraphVisitor() public boolean visit(rubybasicobject object) { return liveobjects.put(object.getobjectid(), object) == null; } }; context.getsafepointmanager().pauseallthreadsandexecute(new Consumer<RubyThread>() { public void accept(rubythread currentthread) { synchronized (liveobjects) { visitor.visit(currentthread); context.getcorelibrary().getglobalvariablesobject().visitobjectgraph(visitor); context.getcorelibrary().getmainobject().visitobjectgraph(visitor); context.getcorelibrary().getobjectclass().visitobjectgraph(visitor); visitcallstack(visitor); } } } return Collections.unmodifiableMap(liveObjects); Copyright 2015, Oracle and/or its affiliates. All rights reserved. 26

30 Method invalidahon #send #binding Float Threads Frame- local variables C extensions Encodings ObjectSpace Regexp Thread#raise #eval Fixnum to Bignum promohon set_trace_func Proc#binding Concurrency Constant invalidahon Debugging Closures Copyright 2015, Oracle and/or its affiliates. All rights reserved. 30

31 Method invalidahon #send #binding Float Threads Frame- local variables C extensions Encodings ObjectSpace Regexp Thread#raise #eval Fixnum to Bignum promohon set_trace_func Proc#binding Concurrency Constant invalidahon Debugging Closures Copyright 2015, Oracle and/or its affiliates. All rights reserved. 31

35 chunky_png and psd.rb Willem van Bergen, Ryan LeFevre, Kelly SuYon, Layer Vault, Floorplanner et al Ruby logo copyright (c) 2006, Yukihiro Matsumoto, licensed under the terms of the CreaHve Commons AYribuHon- ShareAlike 2.5 agreement Copyright 2015, Oracle and/or its affiliates. All rights reserved. 35

40 Static Analysis Ahead-of-Time Compilation Java ApplicaHon JDK Substrate VM IniHal Heap Machine Code OS All Java classes from applicahon, JDK, and Substrate VM Reachable methods, fields, and classes ApplicaHon running without compilahon or class loading Copyright 2015, Oracle and/or its affiliates. All rights reserved. 40

41 [msec] Execution Time [MByte] Memory Footprint MRI JRuby Truffle on JVM 14 Truffle on SVM MRI JRuby Truffle on JVM 9 Truffle on SVM Copyright 2015, Oracle and/or its affiliates. All rights reserved. 41

45 Mean Speedup Relative to MRI Without C Extension (s/s) MRI With C Extension Rubinius With C Extension JRuby With C Extension JRuby+Truffle With C Extension JRuby+Truffle With C Extension (No Inline) Copyright 2015, Oracle and/or its affiliates. All rights reserved. 45

Lexer, parser Strings, regexps, IO Command line Build and distribuhon infrastructure Cannot re- use

library wriyen in Ruby Considering trying to use some of the C code Parts of the core library Parts of

copyright (c) Tony Price 2011, licensed under the terms of the CreaHve Commons AYribuHon- NoDerivs 3.

47 Lexer, parser Strings, regexps, IO Command line Build and distribuhon infrastructure Cannot re- use more of the core library due to very different approaches The language design The parts of the standard library wriyen in Ruby Considering trying to use some of the C code Parts of the core library Parts of the standard library RubySpec We have our own implementahons of the Rubinius primihves JRuby logo copyright (c) Tony Price 2011, licensed under the terms of the CreaHve Commons AYribuHon- NoDerivs 3.0 Unported (CC BY- ND 3.0) Ruby logo copyright (c) 2006, Yukihiro Matsumoto, licensed under the terms of the CreaHve Commons AYribuHon- ShareAlike 2.5 agreement Rubinius logo licensed under the terms of the CreaHve Commons AYribuHon- NoDerivs 3.0 Unported Copyright 2015, Oracle and/or its affiliates. All rights reserved. 47

51 M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: SupporEng C Extensions for Dynamic Languages. In Proceedings of the 14th InternaHonal Conference on Modularity, 2015 (to appear) A. Wöß, C. Wirth, D. BoneYa, C. Seaton, C. Humer, and H. Mössenböck. An object storage model for the Truffle language implementaeon framework. In Proceedings of the InternaHonal Conference on Principles and PracHces of Programming on the Java Pla orm (PPPJ), C. Seaton, M. L. Van De Vanter, and M. Haupt. Debugging at full speed. In Proceedings of the 8th Workshop on Dynamic Languages and ApplicaHons (DYLA), 2014 T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, M. Wolczko. One VM to Rule Them All. In Proceedings of Onward! T. Würthinger, A. Wöß, L. Stadler, G. Duboscq, D. Simon, C. Wimmer. Self- OpEmizing AST Interpreters. In Proceedings of the Dynamic Languages Symposium (DLS), 2012 Copyright 2015, Oracle and/or its affiliates. All rights reserved. 51

53 Safe Harbor Statement The preceding is intended to provide some insight into a line of research in Oracle Labs. It is intended for informahon purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or funchonality, and should not be relied upon in making purchasing decisions. Oracle reserves the right to alter its development plans and prachces at any Hme, and the development, release, and Hming of any features or funchonality described in connechon with any Oracle product or service remains at the sole discrehon of Oracle. Any views expressed in this presentahon are my own and do not necessarily reflect the views of Oracle. Copyright 2015, Oracle and/or its affiliates. All rights reserved. 53

Ruby. JRuby+Truffle and the to JITs. Chris Oracle Labs

Ruby. JRuby+Truffle and the to JITs. Chris Oracle Labs John Tenniel illustra@ons public domain in the UK and US Deop@mizing Ruby JRuby+Truffle and the an@dote to JITs Chris Seaton @ChrisGSeaton Oracle Labs Copyright 2014, Oracle and/or its affiliates. All