TornadoVM: Running Java on GPUs and FPGAs with Dr Juan Fumero at QCon London

Dr Juan Fumero presented at QCon London on TornadoVM , a plug-in to OpenJDK and GraalVM that runs Java on heterogeneous hardware including Graphical Processing Units (GPUs) and Field Programmable Gate Arrays (FPGAs). Demos during the presentation showed code being speeded up by hundreds of times when running on a GPU vs a CPU.

GPUs and FPGAs can offer 2-3 orders of magnitude speed improvement for highly parallelisable workload. But those speed improvements have been difficult to obtain as programming requires the use of low level languages such as OpenCL and VHDL . TornadoVM makes acceleration accessible to programmers using Java and Node.js, and annotations are used to mark parallelisable code blocks as a hint to the compiler.

TornadoVM supports multi core CPUs, GPUs from Nvidia, AMD and Intel, and Intel FPGAs. The choice of hardware accelerator is passed to TornadoVM as a parameter, and Dr Fumero demonstrated code running on the CPU, embedded Intel GPU, and Nvidia GPU present on his Mac laptop. TornadoVM also offers live task migration between different hardware types, which was also demonstrated. Tensor Processing Units ( TPUs ) aren’t yet supported, but Dr Fumero stated that it would be straightforward to add an additional backend to TornadoVM so long as OpenCL support is present. The TornadoVM team are presently working on adding support for Nvdia’s Parallel Thread Execution ( PTX ).

Dr Fumero and his University of Manchester colleagues don’t yet consider TornadoVM to be production ready, as there’s no organisation to provide support. They do however already have an industry case study of TornadoVM being used by Exus to speed up training for machine learning models working on health care data. Due to limitations in the underlying programming model TornadoVM doesn’t support objects (except for trivial cases), recursion, dynamic memory allocation or exceptions.

The TornadoVM: Java for GPUs and FPGAs presentation is already available to QCon London attendees, and will be opened up to all InfoQ readers in due course. Dr Fumero has published his slides and demos .

以上就是本文的全部内容，希望对大家的学习有所帮助，也希望大家多多支持 码农网

查看所有标签

本站部分资源来源于网络，本站转载出于传递更多信息之目的，版权归原作者或者来源机构所有，如转载稿涉及版权问题，请联系我们。