Using voltage glitching to unleash the A100 in my mining card (blog.kate.land)
htrp a day ago
cromka a day ago
octoberfranklin 20 hours ago
That's why this works. The yield on those HBM stacks is excellent. The binned cards had failures in the logic die, and hyperscalers want uniformity in their clusters. That's why the mining market took the downbinned cards.
londons_explore 17 hours ago
monster_truck 13 hours ago
octoberfranklin 9 hours ago
Mounting the HBM on the interposer has to happen before putting the interposer in the package.
So it's the "must be in-package" yield tests that drive this.
qurren a day ago
kmike84 a day ago
It is much more of "let's sell cards to crypto people, but nerf them, to not harm our enterprise margins", not "we've got a ton of subpar hardware, let's to something with it".
londons_explore 17 hours ago
legitronics 12 hours ago
tencentshill 20 hours ago
rkagerer 4 hours ago
rootsudo 4 hours ago
nomorewords 3 hours ago
kmike84 2 hours ago
notenchange a day ago
I just don’t know if I’m brave enough (and knowledgeable enough) to go this blown fuses way. Seems a lot more risky.
P.S. I now see this is for the 8GB model, which is insane. The 10G one is the one that until now was proven to have 80G, but never fully accessible through CUDA (it was accessible using CPU memory copy though - much slower).
roger_ 18 hours ago
myself248 19 hours ago
Seems like that would considerably speed up the process, by letting the host continue to run while only the target cycles.
amelius a day ago
(which is the more likely scenario because they can make much more money on enterprise/datacenter products, see DRAM)
stingraycharles a day ago
amelius a day ago
Testing hardware is a complicated matter (you can do a PhD on the topic), and nvidia probably does a better job at it than a hacker in their basement who thinks they can upgrade their GPU for free.
On the other hand ... perhaps a few bit errors is not a problem for AI workloads ... but they could also crash your system ...
swiftcoder 18 hours ago
jamesnorden 2 hours ago
Except he literally did.
mmo93 a day ago
BeeOnRope a day ago
amelius a day ago
Which is why I think these devices are more likely to be faulty.
lukan a day ago
gabrielhidasy 21 hours ago
sidewndr46 a day ago
LoganDark 17 hours ago
hypercube33 14 hours ago
I don't know what Intel is doing as I quit keeping up with them. I do miss the core unlocked boards that you'd put a 2 core cpu and maybe win the lottery on and get all 4 cores.
userbinator 11 hours ago
phelix001 a day ago
nom a day ago
the8472 a day ago
b112 a day ago
wil421 4 hours ago
superxpro12 a day ago
sva_ a day ago
I recently had a faulty A100, for some reason the provider turned off ECC on that card, so it silently failed and gave junk results... Took me a minute to figure out.
fn-mote 20 hours ago
sva_ 20 hours ago
bob1029 a day ago
puzzlingcaptcha 21 hours ago
roger_ a day ago
Hard to believe $1k was a deal a few months ago (and $200 before then).
gravypod a day ago
The highs and lows of my predictive capabilities
roger_ a day ago
Annoying thing is finding a good motherboard to put multiple blower cards in. Mining rigs are a steal but PCIe x1 limitation is annoying. Got a bunch of Volta cards too sitting around until I figure out where to put them (and the performance per watt sucks next to the 170).
octoberfranklin 20 hours ago
ForOldHack 19 hours ago
numpad0 18 hours ago
What an idiotic idea. The price was low because the unlock didn't exist. They won't be selling at the price you weren't buying at after the unlock was discovered! Even 8GB would have been useful if you wpuld only waited for Strata to become a thing.
I'm not saying this to you, I'm trying to punch myself in January knowing about possible 64GB rumor and just telling people about it just like you, into retroactively buying it all by posting it here. Just why, me. This has been a great way to be salty about it for a whole year...
SillyUsername a day ago
Maxious a day ago
nullc 19 hours ago
ForOldHack 19 hours ago
moffkalast 16 hours ago
userbinator 11 hours ago
dylanger 21 hours ago
octoberfranklin 20 hours ago
Not really.
If the fuses are for security, sure. But these aren't.
These fuses are for economic extraction. Doing it the way NVIDIA did it is a safety feature: it ensures that blowing a fuse will never destroy economic value -- it will never turn a card that was previously able to do something correctly into a card that can no longer do that thing correctly.
swinglock 20 hours ago
nomel 20 hours ago
For those unaware, product tiers come naturally with IC's, by disabling physical sections of the chip that can't work due to inevitable manufacturing defects. You don't throw defective chips away, you layout in a way where you can physically cut off those defective sections of the chip, with a saw and/or with a fuse, in a way that minimizes lost sales. This works great in the beginning, when your yields are low and you're still dialing in the manufacturing process. But, as yields increase, you might not have enough of the lower tier chips to meet demand. So you, just fuse otherwise good chips. Chips are cheap, after all! New revisions are not cheap, so features/bugs like this can remain around for a while.
In both IC companies I worked for, had around 6 ICs. If you opened any of them up, you would see the exact same die in every one. After a couple years of great yield, you would then find half missing in the lowest tier.
mitxela a day ago
kmike84 a day ago
userbinator 11 hours ago
AnthonBerg 4 hours ago
Klein-bottle-shaped leopard's eating face
octoberfranklin 20 hours ago
Buy a shitton of these things, spend a year working on the unlock. If you find one, sell the shitton at 5x higher price (which is what happened).
mr_roboto a day ago
judge2020 a day ago
So I guess the next step is to stop selling the lower-binned card? https://www.tomshardware.com/pc-components/gpus/nvidia-repor...
gengelbro a day ago
Aurornis a day ago
It’s also useful for binning: These lower spec locked products can have defects in the unused parts, like flakey memory regions or channels. Not every CMP170 can be fully usable after unlocks.
The alternative to this market segmentation isn’t “Everyone gets the whole thing for the lowest price”. It’s that the lower price version doesn’t exist at all, or if it does it’s a lot more expensive.
WarmWash a day ago
Basically the high price of the fully unlocked models is what makes it possible to sell artificially limited models at the lower price point (while also offering the ability to possibly sell lower binned units). Basically you can gas the profit on the high-end to drive down the cost on the low end, but obviously this only works if you have a distinct High and Low end.
People think that if we banned this practice it would lead to the top shelf models being sold at the bottom shelf price. But that's just naive market confusion. A ban would just mean that the top shelf unit at a higher price and the lower shelf unit at a higher price would be available.
There is no solve to the "problem" that results in "High shelf unit being sold at lower cost", in fact the thing you are complaining about is already the closest to that ideal, as the manufacturer can leverage economies of scale to drive down costs across the product line.
toast0 a day ago
At the beginning of a product, when yields are bad, I could get a low tier chip at a good price, but then as yields get better, low tier chips wouldn't be available and I no longer have a low cost option. Presumably higher yields would lead to reduced prices on the higher tier chips, but I don't think they'd get down to where the low tier chips were.
Another alternative is that the maker only ever sells chips that test successfully as high tier, but I think it's repugnant to not make use of parts with defects if the defects can be gated off.
tintor a day ago
WarmWash a day ago
bethekidyouwant a day ago
WarmWash a day ago
cowlevel 17 hours ago
bethekidyouwant 15 hours ago
tintor 16 hours ago
Each wafer is printed separately. They don't build new custom production line for each new design.
toast0 a day ago
That said, with Zen6 having 12 cores per chiplet, I wouldn't be surprised if they eventually end up designing a smaller chiplet with 6 cores and a dedicated small chiplet carrier. Or push 6 core SKUs to the APU side that doesn't use chiplets, Zen5 APUs already have specialized masks for some of their SKUs.
deaton 20 hours ago
LoganDark 17 hours ago
cowlevel 17 hours ago
toast0 14 hours ago
arjie a day ago
All sorts of reasonable interactions are then policed by people with visceral reactions to normal activity.
IncreasePosts a day ago
That one price would be somewhere between the low price and the high price. So, the world you want to live in would be one where "the poor" who currently pay the low price would need to pay more. And "the rich" would get a discount from their high price they pay currently. That seems morally repugnant beyond words.
Grimeton 19 hours ago
At least not the development of GPUs.
IncreasePosts 18 hours ago
deaton 20 hours ago
rustcleaner 13 hours ago
samlinnfer a day ago
Anyways, that's what I tell myself as I taste my bowl of sour grapes.
whizzter a day ago
That said, 80G for something that you picked up for cheap could be an absolute steal these days.
roger_ a day ago
Currently listening to the soothing drone of my $200 Octominer cooling my cards while I'm fine tuning a model (almost makes a good space heater).
segmondy a day ago
https://www.reddit.com/r/LocalLLaMA/comments/1wjr59t/768gb_v...
roger_ a day ago
How are you dealing with the RAM limit (32GB)? I had upgraded mine to an i7 but it was unstable so I’m back to the stock Celeron class CPU.
segmondy 18 hours ago
roger_ a day ago
Bad RAM isn't a huge issue as you can flag and ignore the relevant regions and be down a few MB.
r_lee a day ago
I even looked into blog posts of using them or unlocking them somehow but I never thought to think that they actually had the full HBM memory and all just fused away??? wow
NoidFonsense 18 hours ago
After which I sold most of them for $2000-$2600 (I believed the panic about the new mac studio launch) instead of holding them to sell for like $5k and making my annual income in a week. And also I failed to do the capacitor mod after buying a couple hundred in soldering equipment. But at least I sold most of them for monero, and that's gone up since and allowed me to avoid massive ebay fees.
The moral of the story here is that you can fantisize about getting in at the bottom, but even if you did you may not have rode it to the top. Plenty of people bought bitcoin when it was half a cent and sold at the local maxima to net $30k and spent it on a used corrolla.
I think my story may make your grapes less sour.
Edit: I knew at the time of purchase that the 10GB->80GB unlocks were problematic but the 8GB->64GB cards were solid. The pricing reflects this, so thats just skill issue.
Foobar8568 18 hours ago
tintor a day ago
tclancy a day ago
ForOldHack 19 hours ago
edg5000 10 hours ago
solyin 9 hours ago
richlow 17 hours ago
Secondly you never spoke about the squeaky bum moment of actually making the change. Crikey that would have been a long moment.
userbinator 11 hours ago
These findings were disclosed to NVIDIA’s product security team ahead of the publication of this article.
WTF. Does the boot taste that good?
Kevin_Flynn a day ago
EmX_3000 15 hours ago
mschuster91 a day ago
wtf, it seems RAM truly was too cheap back then...
throwaway_new_1 a day ago
mitxela a day ago
jeroenhd a day ago
Plus: most of those cards probably have broken RAM chips anyway. Throwing them out would be a waste, limiting trash chips to a small amount of RAM that does work turns recycling costs into a product that can be sold for money.
pwg a day ago
In addition, fabricating the same die for every SKU point in the product line means the maker does not have to guess how many version X vs. version Y vs. version Z dies to fabricate. The just have one fabricated. Then the dies become SKU version X, Y or Z as demand requires during the card assembly process.
dreamcompiler 21 hours ago
Oh wait, cars are like this now.
ForOldHack 19 hours ago
Hacking is a good thing.
ForHackernews a day ago
Wait, so does this unlock it to actually do something useful, or just "mine" marginally more shas?
coffeebeqn a day ago
ipsum2 19 hours ago
KiwiJohnno 13 hours ago
andai 4 hours ago
Isn't it like a bit of solder? Or is the problem that the solder would have to be a nanometer across?
numpad0 4 hours ago
arghwhat 4 hours ago
If you wanted to patch a die the only real means is through a FIB (Focused Ion Beam) workstation, and even then you need the die structure to allow it (you have to mill your way into the chip and can't have any functional layers in between you and the patch you want to makey), and even when doable it would be an insanely expensive, time-consuming and likely fragile project.
gwbas1c a day ago
I disagree: If there's any risk that the fuse will blow with normal usage, then a blown fuse means a defective product.
bluGill a day ago
cowlevel 17 hours ago
low_tech_punk a day ago
Joke aside, good investigation and blog debut, kate!