Ampere consumer silicon from 2020, still racked and still rented, because nothing has replaced what it is actually good at: the most arithmetic per pound in the catalogue. The only question worth a page is which of the five, and the honest answer usually turns on one number — how much memory you need.
Cheapest first. Read down until the memory column holds what you need, then stop — the cards above it are faster at the same job, not capable of a different one.
| Card | Card memory | The card | Cheapest complete machine |
|---|---|---|---|
| RTX 3070 | 8 GB GDDR6 | $139 | $209.93 |
| RTX 3070 Ti | 8 GB GDDR6X | $149 | $222.47 |
| RTX 3080 | 10 GB GDDR6X | $159 | $229.93 |
| RTX 3080 Ti | 12 GB GDDR6X | $199 | $272.47 |
| RTX 3090 | 24 GB GDDR6X | $239 | $309.93 |
Second-generation ray-tracing cores, third-generation tensor cores, PCIe Gen 4 throughout. Figures from NVIDIA’s own GeForce comparison pages, cited in the source of this page.
Ampere
24 GB GDDR6X
10,496
936 GB/s
350 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
12 GB GDDR6X
10,240
912 GB/s
350 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
10 GB GDDR6X
8,704
760 GB/s
320 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
8 GB GDDR6X
6,144
608 GB/s
290 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
8 GB GDDR6
5,888
448 GB/s
220 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
These cards are six years old and we have not retired them, because for a large share of real work they remain the correct purchase rather than the compromise.
Every RTX 30 card is a PCIe Gen 4 part. Three of the four platforms that take them are Gen 3, and one is Gen 4.
| Model | 16-bit | 8-bit | 4-bit |
|---|---|---|---|
| 7-8 billion parameters | 16 GB — fits | 8 GB — fits | 5 GB — fits |
| 13-14 billion parameters | 28 GB — does not fit | 14 GB — fits | 8 GB — fits |
| 30-34 billion parameters | 68 GB — does not fit | 34 GB — does not fit | 19 GB — fits |
| 70 billion parameters | 140 GB — does not fit | 70 GB — does not fit | 38 GB — does not fit |
The card is one line on the invoice and the machine is another. Both halves below come from one reading of the order catalogue, so the price and the specification beside it always belong to each other.
| Card | The machine it goes in | The card | Complete, per month |
|---|---|---|---|
| RTX 3070 | Intel Xeon E5-2600 v1/v2 | $139 | $209.93 Configure this build → |
| RTX 3070 | Intel Xeon E5-2600 v3/v4 | $139 | $212.47 Configure this build → |
| RTX 3070 Ti | Intel Xeon E5-2600 v3/v4 | $149 | $222.47 Configure this build → |
| RTX 3070 | Intel Xeon Silver / Gold | $139 | $222.67 Configure this build → |
| RTX 3080 | Intel Xeon E5-2600 v1/v2 | $159 | $229.93 Configure this build → |
| RTX 3080 | Intel Xeon E5-2600 v3/v4 | $159 | $232.47 Configure this build → |
| RTX 3070 Ti | Intel Xeon Silver / Gold | $149 | $232.67 Configure this build → |
| RTX 3080 | Intel Xeon Silver / Gold | $159 | $242.67 Configure this build → |
| RTX 3080 Ti | Intel Xeon E5-2600 v3/v4 | $199 | $272.47 Configure this build → |
| RTX 3080 Ti | Intel Xeon Silver / Gold | $199 | $282.67 Configure this build → |
| RTX 3090 | Intel Xeon E5-2600 v1/v2 | $239 | $309.93 Configure this build → |
| RTX 3090 | Intel Xeon E5-2600 v3/v4 | $239 | $312.47 Configure this build → |
| RTX 3090 | Intel Xeon Silver / Gold | $239 | $322.67 Configure this build → |
| RTX 3080 | AMD EPYC | $159 | $376.59 Configure this build → |