TornadoVM 7 Enables GPU-Native Workloads from Java Applications

5 comments

• mikepapadim 2 hours ago
  https://github.com/beehive-lab/TornadoVM this is main repo.

  You can use it with any JDK21+ and Nvidia or Apple hardware and their Nvidia libs or MLX libs.

  [-]
  • Akseleu_omirbay 33 minutes ago
    And what about TPU support? Is it compatible with Google TPUs or strictly limited to gpu backends like CUDA and Metal?
    [-]
    • mikepapadim 26 minutes ago
      no TPU support yet, just NVIDIA, Apple and any other HW thats supports OpenCL
• the_arun 2 hours ago
  Does this mean we can use Java to build AI infrastructure?
  [-]
  • vlowrian 1 hour ago
    Or an abstract AI infrastructure factory?
    [-]
    • mikepapadim 1 hour ago
      https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java
    • keeda 27 minutes ago
      That’s probably the next thing after Software Factories.
    • kitd 33 minutes ago
      I'll be disappointed if this isn't named AbstractAiInfrastructureFactory
      [-]
      • pjmlp 23 minutes ago
        These kind of complaints get tiresome, here for some Objective-C fun,

        https://github.com/Quotation/LongestCocoa
• amir734jj 1 hour ago
  Basically JAX for Java instead of Python
  [-]
  • mikepapadim 1 hour ago
    Many components for a jax for java are already tested in https://github.com/beehive-lab/jitllm
• karolosLykos 1 hour ago
  [dead]