2020 年的 Ampere 消费级芯片,至今仍在机架上、仍在出租,因为它在真正擅长的领域无可替代:目录中每英镑能买到的算力最多。唯一值得写一页的问题是五张里选哪一张,而诚实的答案通常取决于一个数字 — 你需要多少显存。
从最便宜的开始。往下读,直到显存那一列满足你的需求,然后停下 — 它上面的卡在同一工作上更快,但并不能做不同的事。
| Card | Card memory | The card | Cheapest complete machine |
|---|---|---|---|
| RTX 3070 | 8 GB GDDR6 | $139 | $209.93 |
| RTX 3070 Ti | 8 GB GDDR6X | $149 | $222.47 |
| RTX 3080 | 10 GB GDDR6X | $159 | $229.93 |
| RTX 3080 Ti | 12 GB GDDR6X | $199 | $272.47 |
| RTX 3090 | 24 GB GDDR6X | $239 | $309.93 |
第二代光线追踪核心、第三代张量核心、全线 PCIe Gen 4。数据来自 NVIDIA 自家的 GeForce 对比页面,在本页源码中已注明出处。
Ampere
24 GB GDDR6X
10,496
936 GB/s
350 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
12 GB GDDR6X
10,240
912 GB/s
350 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
10 GB GDDR6X
8,704
760 GB/s
320 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
8 GB GDDR6X
6,144
608 GB/s
290 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
Ampere
8 GB GDDR6
5,888
448 GB/s
220 W
PCIe Gen 4 x16
1 NVENC, 1 NVDEC, no AV1 encode
No
这些卡已经六年了,我们还没有退役它们,因为对大量实际工作而言,它们仍然是正确的选择,而不是妥协。
每张 RTX 30 卡都是 PCIe Gen 4 部件。搭载它们的四个平台中,三个是 Gen 3,一个是 Gen 4。
| Model | 16-bit | 8-bit | 4-bit |
|---|---|---|---|
| 7-8 billion parameters | 16 GB — fits | 8 GB — fits | 5 GB — fits |
| 13-14 billion parameters | 28 GB — does not fit | 14 GB — fits | 8 GB — fits |
| 30-34 billion parameters | 68 GB — does not fit | 34 GB — does not fit | 19 GB — tight |
| 70 billion parameters | 140 GB — does not fit | 70 GB — does not fit | 38 GB — does not fit |
卡是发票上的一行,机器是另一行。下面两半都来自订单目录的同一次读取,所以价格和旁边的规格始终彼此对应。
| Card | The machine it goes in | The card | Complete, per month |
|---|---|---|---|
| RTX 3070 | Intel Xeon E5-2600 v1/v2 | $139 | $209.93 Configure this build → |
| RTX 3070 | Intel Xeon E5-2600 v3/v4 | $139 | $212.47 Configure this build → |
| RTX 3070 Ti | Intel Xeon E5-2600 v3/v4 | $149 | $222.47 Configure this build → |
| RTX 3070 | Intel Xeon Silver / Gold | $139 | $222.67 Configure this build → |
| RTX 3080 | Intel Xeon E5-2600 v1/v2 | $159 | $229.93 Configure this build → |
| RTX 3080 | Intel Xeon E5-2600 v3/v4 | $159 | $232.47 Configure this build → |
| RTX 3070 Ti | Intel Xeon Silver / Gold | $149 | $232.67 Configure this build → |
| RTX 3080 | Intel Xeon Silver / Gold | $159 | $242.67 Configure this build → |
| RTX 3080 Ti | Intel Xeon E5-2600 v3/v4 | $199 | $272.47 Configure this build → |
| RTX 3080 Ti | Intel Xeon Silver / Gold | $199 | $282.67 Configure this build → |
| RTX 3090 | Intel Xeon E5-2600 v1/v2 | $239 | $309.93 Configure this build → |
| RTX 3090 | Intel Xeon E5-2600 v3/v4 | $239 | $312.47 Configure this build → |
| RTX 3090 | Intel Xeon Silver / Gold | $239 | $322.67 Configure this build → |
| RTX 3080 | AMD EPYC | $159 | $376.59 Configure this build → |