Using LLVM and Sulong for Language C Extensions

Size: px

Start display at page:

Download "Using LLVM and Sulong for Language C Extensions"

Noah Briggs
6 years ago
Views:

2 Using LLVM and Sulong for Language C Extensions Chris Seaton Research Manager VM Research Group Oracle Labs Manuel Rigger, Matthias Grimmer JKU Linz Copyright 2016, Oracle and/or its affiliates. All rights reserved.

3 Safe Harbor Statement The following is intended to provide some insight into a line of research in Oracle Labs. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. Oracle reserves the right to alter its development plans and practices at any time, and the development, release, and timing of any features or functionality described in connection with any Oracle product or service remains at the sole discretion of Oracle. Any views expressed in this presentation are my own and do not necessarily reflect the views of Oracle. Copyright 2016, Oracle and/or its affiliates. All rights reserved. 3

Attribution-ShareAlike 4.0 International license (CC-BY-SA 4.

6 The Ruby Logo is Copyright (c) 2006, Yukihiro Matsumoto. It is licensed under the terms of the Creative Commons Attribution-ShareAlike 2.5 agreement JS Logo Copyright (c) 2011 Christopher Williams MIT licence You can distribute the logo under the terms of the Creative Commons Attribution-ShareAlike 4.0 International license (CC-BY-SA 4.0) or (at your option) the GNU General Public License version 2 (GPL-2). JavaScript Ruby R LLVM Java Scala Truffle Graal JVM Copyright 2016, Oracle and/or its affiliates. All rights reserved. 6

8 The Ruby Logo is Copyright (c) 2006, Yukihiro Matsumoto. It is licensed under the terms of the Creative Commons Attribution-ShareAlike 2.5 agreement JS Logo Copyright (c) 2011 Christopher Williams MIT licence The Python logo is a trademark of the Python Software Foundation Copyright 2016, Oracle and/or its affiliates. All rights reserved. 8

12 Performance on Ruby C Extensions Oily PNG and PSD Native MRI Pure Ruby MRI With C Extension M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: Supporting C Extensions for Dynamic Languages. In Proceedings of the 14th International Conference on Modularity, Copyright 2016, Oracle and/or its affiliates. All rights reserved. 12

Structs declared in the public API Implementation details like embedded strings and

15 Ruby String object Managed Ruby value on the C stack Exposes inner char* Call to arbitrary C code String object with char* already exposed now returned to Ruby Copyright 2016, Oracle and/or its affiliates. All rights reserved. 15

21 Interpret both the Ruby and the C Actually, interpret the LLVM IR of the C to simplify JIT compile the Ruby and the C Use a single high and low level IR for both Forget which language the IR came from and optimise them together Give virtualised pointers to the C program Copyright 2016, Oracle and/or its affiliates. All rights reserved. 21

29 U U U U U AST Interpreter Uninitialized Nodes T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, Copyright 2016, Oracle and/or its affiliates. All rights reserved.

30 U Node Rewriting for Profiling Feedback U U Node Transitions U U U Uninitialized Integer I AST Interpreter Uninitialized Nodes S String G D Double Generic T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, Copyright 2016, Oracle and/or its affiliates. All rights reserved.

31 G Compilation using Partial Evaluation G I G I G I I I I AST Interpreter Rewritten Nodes Compiled Code T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, Copyright 2016, Oracle and/or its affiliates. All rights reserved.

33 U Node Rewriting for Profiling Feedback G Compilation using Partial Evaluation G U U Node Transitions I G I G U U U Uninitialized Integer I I I I I AST Interpreter Uninitialized Nodes S String G D Double Generic AST Interpreter Rewritten Nodes Compiled Code T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, Copyright 2016, Oracle and/or its affiliates. All rights reserved.

34 Deoptimization to AST Interpreter G Node P G I G I G I I I I T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, /09/2016 Copyright 2016, Oracle and/or its affiliates. All rights reserved.

35 Node Rewriting to Update Profiling Feedback G Recompilation using Partial Evaluation G D G D G I D I D T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, /09/2016 Copyright 2016, Oracle and/or its affiliates. All rights reserved. Oracle Confidential Internal/Restricted/Highly Restricted

36 Deoptimization to AST Interpreter G Node Rewriting to Update Profiling Feedback G Recompilation using Partial Evaluation G G I G I G D G D G I I I D I I I D T. Würthinger, C. Wimmer, A. Wöß, L. Stadler, G. Duboscq, C. Humer, G. Richards, D. Simon, and M. Wolczko. One VM to rule them all. In Proceedings of Onward!, /09/2016 Copyright 2016, Oracle and/or its affiliates. All rights reserved. Oracle Confidential Internal/Restricted/Highly Restricted

46 Completeness language and core library 99% Ruby language JRuby passes 94% 95% Ruby core library JRuby passes 95% Copyright 2016, Oracle and/or its affiliates. All rights reserved. Oracle Confidential Internal

47 Completeness the basic Rails stack 100% Active Support Active Model Active Record 100% Basic functionality works Action View Action Pack Action Mailer Railties Sprockets-Rails Active Job Spring 98% 37% Copyright 2016, Oracle and/or its affiliates. All rights reserved. Oracle Confidential Internal

48 Classic research benchmarks 10-20x faster Speedup Compared to Ruby Benchmarks bound by allocation or BigInteger performance GraalVM JRuby+invokedynamic Ruby Copyright 2016, Oracle and/or its affiliates. All rights reserved. Confidential Oracle Internal/Restricted/Highly Restricted 48

Instead of RARRAY_PTR returning a pointer (a number), return a proper Java object Operations like getelementptr can return a new Java object that remembers the original object, and what offset to use

56 Instead of RARRAY_PTR returning a pointer (a number), return a proper Java object Operations like getelementptr can return a new Java object that remembers the original object, and what offset to use Let SSA names store Java objects as well as numbers The load can then use whatever logic we want to actually read a value from the Java object reuse normal Ruby array logic Copyright 2016, Oracle and/or its affiliates. All rights reserved. 56

58 The C program has no way of knowing it s not a real char * Virtualised pointer really points to a Java object which represents our Ruby string Intrinsic operations on the pointer are redirected to be method calls Copyright 2016, Oracle and/or its affiliates. All rights reserved. 58

60 Evaluation is based on earlier work We used to have a C interpreter TruffleC We ve moved on from this, because we want to support more languages But we aren t able to run all the same benchmarks yet So we ve showing results from our old implementation in the mean time We re pretty sure results will be similar, as the compiled code is similar Copyright 2016, Oracle and/or its affiliates. All rights reserved. 60

61 Performance on Ruby C Extensions Oily PNG and PSD Native MRI Pure Ruby MRI With C Extension Rubinius With C Extension JRuby With C Extension JRuby+Truffle With C Extension JRuby+Truffle With C Extension (No Inline) M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: Supporting C Extensions for Dynamic Languages. In Proceedings of the 14th International Conference on Modularity, Copyright 2016, Oracle and/or its affiliates. All rights reserved. 61

62 Performance on Ruby C Extensions Oily PNG and PSD Native Native C extensions give an order of magnitude performance boost MRI Pure Ruby MRI With C Extension Rubinius With C Extension JRuby With C Extension JRuby+Truffle With C Extension JRuby+Truffle With C Extension (No Inline) M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: Supporting C Extensions for Dynamic Languages. In Proceedings of the 14th International Conference on Modularity, Copyright 2016, Oracle and/or its affiliates. All rights reserved. 62

63 Performance on Ruby C Extensions Oily PNG and PSD Native Existing attempt to mix managed/native are very disappointing MRI Pure Ruby MRI With C Extension Rubinius With C Extension JRuby With C Extension JRuby+Truffle With C Extension JRuby+Truffle With C Extension (No Inline) M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: Supporting C Extensions for Dynamic Languages. In Proceedings of the 14th International Conference on Modularity, Copyright 2016, Oracle and/or its affiliates. All rights reserved. 63

64 Performance on Ruby C Extensions Oily PNG and PSD Native Our solution is 3x faster than native! MRI Pure Ruby MRI With C Extension Rubinius With C Extension JRuby With C Extension JRuby+Truffle With C Extension JRuby+Truffle With C Extension (No Inline) M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: Supporting C Extensions for Dynamic Languages. In Proceedings of the 14th International Conference on Modularity, Copyright 2016, Oracle and/or its affiliates. All rights reserved. 64

65 Performance on Ruby C Extensions Oily PNG and PSD Native It s clear that cross-language inlining is a key part of the performance MRI Pure Ruby MRI With C Extension Rubinius With C Extension JRuby With C Extension JRuby+Truffle With C Extension JRuby+Truffle With C Extension (No Inline) M. Grimmer, C. Seaton, T. Würthinger, H. Mössenböck. Dynamically Composing Languages in a Modular Way: Supporting C Extensions for Dynamic Languages. In Proceedings of the 14th International Conference on Modularity, Copyright 2016, Oracle and/or its affiliates. All rights reserved. 65

68 Open Source Graal compiler Truffle language implementation framework Fast R runtime Dynamic runtime for LLVM bitcode Fast Ruby runtime Copyright 2016, Oracle and/or its affiliates. All rights reserved. 68

69 Acknowledgements Oracle Danilo Ansaloni Stefan Anzinger Cosmin Basca Daniele Bonetta Matthias Brantner Petr Chalupa Jürgen Christ Laurent Daynès Gilles Duboscq Martin Entlicher Brandon Fish Bastian Hossbach Christian Humer Mick Jordan Vojin Jovanovic Peter Kessler David Leopoldseder Kevin Menard Jakub Podlešák Aleksandar Prokopec Tom Rodriguez Oracle (continued) Roland Schatz Chris Seaton Doug Simon Štěpán Šindelář Zbyněk Šlajchrt Lukas Stadler Codrut Stancu Jan Štola Jaroslav Tulach Michael Van De Vanter Adam Welc Christian Wimmer Christian Wirth Paul Wögerer Mario Wolczko Andreas Wöß Thomas Würthinger Oracle Interns Brian Belleville Miguel Garcia Shams Imam Alexey Karyakin Stephen Kell Andreas Kunft Volker Lanting Gero Leinemann Julian Lettner Joe Nash David Piorkowski Gregor Richards Robert Seilbeck Rifat Shariyar Alumni Erik Eckstein Michael Haupt Christos Kotselidis Hyunjin Lee David Leibs Chris Thalinger Till Westmann JKU Linz Prof. Hanspeter Mössenböck Benoit Daloze Josef Eisl Thomas Feichtinger Matthias Grimmer Christian Häubl Josef Haider Christian Huber Stefan Marr Manuel Rigger Stefan Rumzucker Bernhard Urban University of Edinburgh Christophe Dubach Juan José Fumero Alfonso Ranjeet Singh Toomas Remmelg LaBRI Floréal Morandat University of California, Irvine Prof. Michael Franz Gulfem Savrun Yeniceri Wei Zhang Purdue University Prof. Jan Vitek Tomas Kalibera Petr Maj Lei Zhao T. U. Dortmund Prof. Peter Marwedel Helena Kotthaus Ingo Korb University of California, Davis Prof. Duncan Temple Lang Nicholas Ulle University of Lugano, Switzerland Prof. Walter Binder Sun Haiyang Yudi Zheng Copyright 2016, Oracle and/or its affiliates. All rights reserved. 69

70 Safe Harbor Statement The preceding is intended to provide some insight into a line of research in Oracle Labs. It is intended for information purposes only, and may not be incorporated into any contract. It is not a commitment to deliver any material, code, or functionality, and should not be relied upon in making purchasing decisions. Oracle reserves the right to alter its development plans and practices at any time, and the development, release, and timing of any features or functionality described in connection with any Oracle product or service remains at the sole discretion of Oracle. Any views expressed in this presentation are my own and do not necessarily reflect the views of Oracle. Copyright 2016, Oracle and/or its affiliates. All rights reserved. 70

Guilt Free Ruby on the JVM

The Ruby logo is Copyright 2006, Yukihiro Matsumoto. It is licensed under the terms of the Creative Commons Attribution-ShareAlike 2.5 License agreement. Guilt Free Ruby on the JVM Forgetting Conventional