where to buy 8xB200

[zhuochenKIDD]

hi bro，I am eager to test & investigate your work, but cannot get 8*B200.

Is this work's future roadmap relies heavily on NV's high-end hardware or maybe it will cover low-end & low-cost hw like H20?

[xysmlx]

Hi bro,

Fair point! We know getting hands on an 8x B200 machine is a huge challenge. 😢

Current release is just our first exploratory step for ultra low-latency LLM inference, so we had to start somewhere.

But don't worry, we definitely don't plan to lock TileRT behind a "supercomputer-only" wall. Support for more hardware backends is on our roadmap.

However, as we are a small team, our top priority right now is pushing the absolute limits of performance and low latency. So we currently cannot give an ETA for other hardware support.

Sharing your requirements would be very helpful for future discussions. Thanks!