US chip-maker Nvidia led a rout in tech stocks Monday after the emergence of a low-cost Chinese generative AI model that could threaten US dominance in the fast-growing industry.
The chatbot developed by DeepSeek, a startup based in the eastern Chinese city of Hangzhou, has apparently shown the ability to match the capacity of US AI pace-setters for a fraction of the investments made by American companies.
Shares in Nvidia, whose semiconductors power the AI industry, fell more than 15 percent in midday deals on Wall Street, erasing more than $500 billion of its market value.
The tech-rich Nasdaq index fell more than three percent.
AI players Microsoft and Google parent Alphabet were firmly in the red while Meta bucked the trend to trade in the green.
DeepSeek, whose chatbot became the top-rated free application on Apple’s US App Store, said it spent only $5.6 million developing its model – peanuts when compared with the billions US tech giants have poured into AI.
US “tech dominance is being challenged by China,” said Kathleen Brooks, research director at trading platform XTB.
“The focus is now on whether China can do it better, quicker and more cost effectively than the US, and if they could win the AI race,” she said.
US venture capitalist Marc Andreessen has described DeepSeek’s emergence as a “Sputnik moment” – when the Soviet Union shocked Washington with its 1957 launch of a satellite into orbit.
As DeepSeek rattled markets, the startup on Monday said it was limiting the registration of new users due to “large-scale malicious attacks” on its services.
Meta and Microsoft are among the tech giants scheduled to report earnings later this week, offering opportunity for comment on the emergence of the Chinese company.
Shares in another US chip-maker, Broadcom, fell 16 percent while Dutch firm ASML, which makes the machines used to build semiconductors, saw its stock tumble 6.7 percent.
“Investors have been forced to reconsider the outlook for capital expenditure and valuations given the threat of discount Chinese AI models,” David Morrison, senior market analyst at Trade Nation.
“These appear to be as good, if not better, than US versions.”
Wall Street’s broad-based S&P 500 index shed 1.7 percent while the Dow was flat at midday.
In Europe, the Frankfurt and Paris stock exchanges closed in the red while London finish flat.
Asian stock markets mostly slid.
Just last week following his inauguration, Trump announced a $500 billion venture to build infrastructure for AI in the United States led by Japanese giant SoftBank and ChatGPT-maker OpenAI.
SoftBank tumbled more than eight percent in Tokyo on Monday while Japanese semiconductor firm Advantest was also down more than eight percent and Tokyo Electron off almost five percent.
It’s not a joke, it wont:
It’s even worse / funnier in the app, it will generate the response, then once it realizes its about Taiwan it will delete the whole response and say sorry I can’t do that.
If you ask it “what is the republic of china” it will generate a couple paragraphs of the history of China, then it’ll get a couple sentences in about the retreat to Taiwan and then stop and delete the response.
In fairness that is also exactly what chatgpt, claude and the rest do for their online versions too when you hit their limits (usually around sex). IIRC they work by having a second LLM monitor the output and send a cancel signal if they think its gone over the line.
Okay but one is about puritanical Western cultural standards about sex, and one is about government censorship to maintain totalitarian power. One of these things is not like the other.
Yes I’m aware, I was saying that the method is the same.
Sorry that a chinese made model doesn’t parrot US state dept narratives 😞
You missed the entire point of their comment
Maybe they should have been clearer than saying people were joking about it doing something that it actually does if they wanted to make a point.
People caring more about “China bad” instead of looking at what the tech they made can actually do is the issue.
You needing this explicitly spelled out for you does not help the case.
ngl I’m still confused
It’s AI, it does AI things, is it because China can now do the things we do (coding/development/search queries etc) that are just as good as America that it’s a problem?
It has nothing to do with it being China. They just figured out how to do it more efficiently and with lower powered chips, meaning nvidia’s market dominance in high end chips that they could charge whatever they wanted for just for is legs cut out from under them. If you don’t need as many to run AI, Nvidia won’t sell as many.
So the idea with this comment:
is that people have misplaced their concern, not at the fact that it’s censored but that the US has lost the technology high ground and won’t get it back for at least a generation?
I’m slow, what’s the point? how does people joking about the fact China is censoring output explain
Because they care more about the model not parroting US state dept narratives than the engineering behind it.
Try an abliterated version of the qwen 14b or 32b R1 distills. I just tried it out they will give you a real overview.
Still even when abliterated its just not very knowledgeable about “harmful information”. If you want a truly uncensored model hit up mistral small 22b and its even more uncensored fine tune Beepo 22b
Oh I hadnt realised uncensored version had started coming out yet, I definitely wil look into it once quantised versions drop.
Mradermacher has you covered with quants: https://huggingface.co/mradermacher/DeepSeek-R1-Distill-Qwen-14B-abliterated-v2-GGUF
That’s just dumb. It at least doesn’t suppress that when provided with search results/refuses to search (at least when integrated in Kagi)
What training data did you use?
??? you dont use training data when running models, that’s what is used in training them.
DeepSeek open-sourced their model. Go ahead and train it on different data and try again.
Wow ok, you really dont know what you’re talking about huh?
No I dont have thousands of almost top of the line graphics cards to retain an LLM from scratch, nor the millions of dollars to pay for electricity.
I’m sure someone will and I’m glad this has been open sourced, its a great boon. But that’s still no excuse to sweep under the rug blatant censorship of topics the CCP dont want to be talked about.
Fortunately, you don’t need thousands of top of the line cards to train the DeepSeek model. That’s the innovation people are excited about. The model improves on the original LLM design to reduce time to train and time to retrieve information.
Contrary to common belief, an LLM isn’t just a fancy Wikipedia. Its a schema for building out a graph of individual pieces of data, attached to a translation tool that turns human-language inputs into graph-search parameters. If you put facts about Tianamen Square in 1989 into the model, you’ll get them back as results through the front-end.
You don’t need to be scared of technology just because the team that introduced the original training data didn’t configure this piece of open-source software the way you like it.
https://www.analyticsvidhya.com/blog/2024/12/deepseek-v3/
Huh I guess 6 million USD is not millions eh? The innovation is it’s comparatively cheap to train, compared to the billions OpenAI et al are spending (and that is with acquiring thousands of H800s not included in the cost).
Edit: just realised that was for the wrong model! but r1 was trained in the same budget https://x.com/GavinSBaker/status/1883891311473782995?mx=2
Smaller builds with less comprehensive datasets take less time and money. Again, this doesn’t have to be encyclopedic. You can train your model entirely on a small sample of material detailing historical events in and around Beijing in 1989 if you are exclusively fixated on getting results back about Tienanmen Square.
Oh, by the way, as to your theory of “maybe it just doesnt know about Tiananmen, its not an encyclopedia”…
Ok sure, as I said before I am grateful that they have done this and open sourced it. But it is still deliberately politically censored, and no “Just train your own bro” is not a reasonable reply to that.
Idk why you’re getting downvoted. This right here.
Because the parent comment by Womble is about using the Chinese hosted DeepSeek app, not hosting the model themselves. The user above who responded either didn’t read the original comment carefully enough, or provided a very snarky response. Neither is particularly endearing.
But yeah. Anyone who thinks the app / stock model isn’t going to be heavily censored…
Why else would it be free? It’s absolutely state sponsored media. Or it’s a singularity and they’re just trying to get people to run it from within their networks, the former being far more plausible.
And I know, I know, the latter isn’t how llms work. But would we really know when it isn’t?
No, that was me running the model on my own machine not using deepseek’s hosted one. What they were doing was justifying blatent politcal censorship by saying anyone could spend millions of dollars themselves to follow their method and make your own model.
You’ll notice how they stopped replying to my posts and started replying to others once it became untenable to pretend it wasnt censorship.
Just another normal day in the Lemmyverse
Lol well. When I saw this I knew the model would be censored to hell, and then the ccp abliteration training data repo made a lot more sense. That being said, the open source effort to reproduce it is far more appealing.