61 points | by pjmlp 2 days ago ago
11 comments
https://github.com/beehive-lab/TornadoVM this is main repo.
You can use it with any JDK21+ and Nvidia or Apple hardware and their Nvidia libs or MLX libs.
And what about TPU support? Is it compatible with Google TPUs or strictly limited to gpu backends like CUDA and Metal?
no TPU support yet, just NVIDIA, Apple and any other HW thats supports OpenCL
Does this mean we can use Java to build AI infrastructure?
Or an abstract AI infrastructure factory?
https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java
That’s probably the next thing after Software Factories.
I'll be disappointed if this isn't named AbstractAiInfrastructureFactory
These kind of complaints get tiresome, here for some Objective-C fun,
https://github.com/Quotation/LongestCocoa
Basically JAX for Java instead of Python
Many components for a jax for java are already tested in https://github.com/beehive-lab/jitllm
https://github.com/beehive-lab/TornadoVM this is main repo.
You can use it with any JDK21+ and Nvidia or Apple hardware and their Nvidia libs or MLX libs.
And what about TPU support? Is it compatible with Google TPUs or strictly limited to gpu backends like CUDA and Metal?
no TPU support yet, just NVIDIA, Apple and any other HW thats supports OpenCL
Does this mean we can use Java to build AI infrastructure?
Or an abstract AI infrastructure factory?
https://github.com/beehive-lab/jitllm there is already an vllm-like inference engine that uses tornadovm as the GPU backend all written in java
That’s probably the next thing after Software Factories.
I'll be disappointed if this isn't named AbstractAiInfrastructureFactory
These kind of complaints get tiresome, here for some Objective-C fun,
https://github.com/Quotation/LongestCocoa
Basically JAX for Java instead of Python
Many components for a jax for java are already tested in https://github.com/beehive-lab/jitllm