5 Comments
User's avatar
Interesting Engineering ++'s avatar

Nice Tony. Just saw this. Great stuff. Have repacked it (since I had only done notes earlier). Yours has good relevant details.

Expand full comment
Interesting Engineering ++'s avatar

ReStaCked. Hahah damn spellcheck

Expand full comment
Tony Peng's avatar

haha thanks for reading!

Expand full comment
Paul Triolo's avatar

Great work Tony, I am reference this in new Substack post that will go up tomorrow. Wanted to see what you thought of this: https://www.amd.com/en/developer/resources/technical-articles/amd-instinct-gpus-power-deepseek-v3-revolutionizing-ai-development-with-sglang.html

I am trying to determine what GPU resources DeepSeek has access to. All of the discussion over the past week has focused on H800, A100, and H100, but not on AMD....what is your view of this press release which talks about the "long standing collaboration" between AMD and DeepSeek?

Expand full comment
Tony Peng's avatar

Seemingly AMD optimized its GPU to better run DeepSeek-v3 for inference?

Expand full comment