Man, this is grim. The 3090 is like what, four years old? It's twice the price it was a year ago. The 4090s are starting to crest into $3-4K and are over a year old at least. The A100s are up, H100s are upwards of $10 - 15$ an hour on Amazon each. Every time something crazy…
@alignment_lab
7900 xtx is just out there. Rocm is improving rapidly. Already supports flash attention 2. The AI community should give AMD a chance.
7900 xtx is not close to 4090. But price per dollar for AI, it beats easily.