Kog is going deeper to squeeze more inference out of GPUs

The idea that GPUs are poorly suited for agentic workflows may be a misconception, according to French startup Kog.

TechCrunch on MSN·2d ago

AMD Presents: Advancing AI Rays Vs Red Sox (mIsWmAoot3)

Mshale·Jul 28

Inference cloud operator General Compute raises $400M in debt financing

Artificial intelligence infrastructure startup General Compute Inc. today announced that it secured $400 million in debt financing. Upper90, the investment firm that is underwriting the round, will...

SiliconANGLE·Jul 17

AMD Presents: Advancing AI Cal Kestis (fIzqZXgojL)

Mshale·Jun 20

AMD is preparing to ship its best AI chips so far

Demand for AI data center chips exceeds supply, creating an imbalance that gives AMD significant pricing power, boosting its profit margins. As a result, the company's adjusted (non-GAAP) earnings ...

The Motley Fool·Jun 10

AMD MI300X performance compared with Nvidia H100 — low-level benchmarks testing cache, latency, inference, and more show strong results for single GPUs

The MI300X is AMD's latest and greatest AI GPU flagship, designed to compete with the Nvidia H100 — the upcoming MI325X will take on the H200, with MI350 and MI400 gunning for the Blackwell B200.

MSN·May 13

Should You Buy Advanced Micro Devices (AMD) Stock After Its 12-Month Return of 200%?

AMD's data center revenue is soaring on strong demand from the artificial intelligence industry.

The Motley Fool on MSN·Aug 8

A video: “When The Underdog Finally Wins: The Rebirth Of AMD”

Continue reading on Medium »

Medium · Erkan Saka·Jul 25

Prediction: Lisa Su Will Deliver Great News for Advanced Micro Devices (AMD) Investors on Aug. 4

Nvidia (NVDA 3.23%) had a near-monopoly in the AI data center market with its H100 GPU until 2023, when AMD entered the race with the MI300X. It attracted some of Nvidia's top customers, like ...

The Motley Fool·Jul 14

AMD’s MI300X Takes On H100

TechInsights·Jun 19

AMD Releases Instella-MoE-16B-A3B: A Fully Open Mixture-of-Experts LLM With 2.8B Active Parameters Trained On Instinct GPUs

AMD released Instella-MoE-16B-A3B, a fully open Mixture-of-Experts language model trained from scratch on Instinct MI300X and MI325X GPUs. It holds 16B total parameters but activates only 2.8B per...

Marktechpost·Aug 1

AMD's Lisa Su Bets on Helios and MI400 After $5.8B Data Center Quarter

StartupHub.ai·Jul 22

MoonMath AI Open-Sources a HIP Attention Kernel for AMD MI300X That Beats AITER v3 on Every Shape and Rounding Mode

MarkTechPost·Jun 22

TensorWave raises $350M in Series B funding led by AMD and Magnetar Capital

TensorWave closed a $350M Series B led by AMD Ventures and Magnetar Capital, reaching a $1.55B valuation as it scales AMD-powered AI cloud infrastructure.

Crypto Briefing·Jun 10

AMD Instinct MI300X accelerator for AI revealed, combines CPU, GPU, and 192 GB of HBM3 memory

Use left and right arrow keys to seek audio. The AMD Instinct MI300X is a new high-performance computing hardware that could dent NVIDIA's dominance in the generative AI space by offering an ...

TweakTown·May 13

AMD Instinct MI300 Series Launch: Accelerating Next-Gen AI and Supercomputing

HPCwire·Apr 23