How Taalas Prints an LLM onto a Chip With $169M in Funding
Taalas has secured $169 million in funding to develop a unique approach to AI chips by permanently embedding a specific large language model (LLM) into silicon. This method eliminates the need for external memory and allows for significant efficiency gains in inference tasks. However, the economic viability of this approach remains uncertain, particularly concerning model obsolescence.
- ▪Taalas raised $169 million to create ASICs that hard-code LLM weights into the chip's silicon structure.
- ▪The chips are designed exclusively for inference workloads and cannot be reprogrammed for training.
- ▪The approach aims to reduce power consumption and latency while lowering costs per token.
- ▪Taalas's strategy contrasts with the broader AI chip industry, which focuses on general-purpose fast-memory chips.
Opening excerpt (first ~120 words) tap to expand
try { if(localStorage) { let currentUser = localStorage.getItem('current_user'); if (currentUser) { currentUser = JSON.parse(currentUser); if (currentUser.id === 3765463) { document.getElementById('article-show-container').classList.add('current-user-is-article-author'); } } } } catch (e) { console.error(e); } Maverick-jkp Posted on Jun 3 • Originally published at jakeinsight.com How Taalas Prints an LLM onto a Chip With $169M in Funding #ai #taalas #subtopicai Taalas just raised $169 million to do something most chip engineers considered a category error: permanently bake a specific LLM into silicon. Not "optimized for AI workloads." Not "runs transformers efficiently." Literally hard-wired — weights, architecture, and all — into the physical transistor layout of a custom ASIC.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at DEV.to (Top).
Discussion
0 commentsMore from DEV.to (Top)
