Spectral Compute Aims to Run CUDA on Non-Nvidia Hardware
Alternative(s) to run CUDA on non-Nvidia hardware
Frustrated by hardware lock-in and high costs, we founded Spectral Compute to free CUDA from Nvidia GPUs. Our SCALE compiler uses LLVM technology to run CUDA code on AMD and other accelerators with near-native performance. Unlike existing tools that require manual migration or suffer performance losses, we offer a drop-in replacement that preserves the de-facto standard for HPC developers while supporting the entire industry.
CUDA is basically the de-facto standard of HPC, and we need to accept that as a fact and just do the work as compiler engineers to make it available on different platforms that are not necessarily Nvidia.
- woctordho
There's nothing wrong to run CUDA on non-Nvidia hardware. CUDA has an interface that is reasonably well-designed, well-documented/reverse-engineered, and battle-tested for decades. What we need is not to invent another interface just under the name of 'open standard', but to implement the same interface. ROCm is exactly doing this, and so are other hardware SDKs such as MooreThread and Alibaba T-Head.
- pjmlp
Most of these "alternatives" focus on CUDA C++, and overlook what actually makes CUDA interesting.
Already in 2020,
https://developer.nvidia.com/blog/cuda-refresher-the-gpu-com...
- HarHarVeryFunny
These efforts to support CUDA on non-Nvidia hardware seem to me misguided. If all you want is to be able to easily use non-NVidia hardware then high level tools like PyTorch already let you do that (and torch.compile uses Triton for target-specific optimization). OTOH if you want to be programming close to the metal to achieve top performance then you are probably not using CUDA in the first place, and using some CUDA translation layer on non-NVidia hardware would be an even worse idea.
- luciana1u
every CUDA alternative follows the same arc: bold launch, works for 3 operations, then a Discord server where the last message is 'any updates?' from 2024
- puschkinfr
In this context AdaptiveCpp should also be mentioned. Started as a SYCL implementation, but recently-ish added a compiler for compiling a CUDA dialect to GPUs and CPUs from basically all vendors