Indian startup Ziroh Labs CPU-fying Gen-AI LLMs as an alternative to expensive GPU processor chips

Year 2017 founded Indian startup Ziroh Labs with around 50+ developers is enabling popular Gen-AI LLMs to run on near-ubiquitous CPUs instead GPUs to help developers use available CPUs with demand and cost of GPUs skyrocketing. The other advantages and features include, these can be deployed either on cloud or edge, enables companies having CPU resources to offer AI computing. 

Ziroh Labs, founded by Hrishikesh Dewan is collaborating with IIT, Madras, ‍IITM Pravartak Technologies Foundation. 

The product named Kompact AI can run models such as DeepSeek-R1, Llama 2, Qwen 2.5 and Phi 3.5. The team is working on other popular models such as T5, Mistral and many such 10s of models. Company also plans to make these models even run on mobile devices such as smart phones and any such minimal hardware. 

Company in its post shared this below points on the benefits:
Unlocks AI potential in environmentsregions with limited GPU access
Makes enterprise and academic adoption faster and cheaper
Validated by Intel, AMD, and other industry leaders
Positions India at the forefront of inclusive AI innovation

On its website Ziroh put up a slogan saying "We work at the intersection of Mathematics and ...