LLM
LLM Reasoning with Chain of Continuous Thought by Meta AI
Facebook Twitter WhatsApp CopyCopied Introduction Large language models (LLMs) have demonstrated incredible reasoning abilities, penetrating an increasing number of domains…
Making AMD GPUs competitive for LLM inference
Aug 9, 2023 • MLC Community TL;DR MLC-LLM makes it possible to compile LLMs and deploy them on AMD GPUs…
IBM wants to be the enterprise LLM king with its new open-source Granite 3.1 models
Join our daily and weekly newsletters for the latest updates and exclusive content on industry-leading AI coverage. Learn More IBM…
Apple collaborates with NVIDIA to research faster LLM performance
In a blog post today, Apple engineers have shared new details on a collaboration with NVIDIA to implement faster text…
Ask HN: Examples of Agentic LLM Systems in Production?
Now that everybody and their mother are fuzzing in social media about LLM agents and agentic LLM systems (or something),…
New LLM optimization technique slashes memory costs up to 75%
Universal Transformer Memory uses neural networks to determine which tokens in the LLM’s context window are useful or redundant.Read More
Task-Specific LLM Evals that Do & Don’t Work
If you’ve ran off-the-shelf evals for your tasks, you may have found that most don’t work. They barely correlate with…
LLM evals platform for enterprises
Problem Code-centric tools and workflows aren’t suited for AI systems that demand iterative, data-driven development guided by domain expertise. Traditional…