With deluge of Chinese models popping up recently, I believe there's a few issues one needs to evaluate before deciding to use these models:
- Ethics. As known, ou American frontier AI companies are incredibly ethical. And I have yet to see any interviews or blog posts by Chinese companies where they talk about how they are ethical, or at least credible HN comments about it.
- Safety. Do they covertly sabotage or at least refuse to answer questions that could help cyber- and bioterrorists in their nefarious purposes? What about ML-related questions that could help terrorists create AI models without guardrails?
- Child safety. This is especially important with "free for all" open-weight models, most of which are Chinese (ever think about why that's the case?). How are we going to do age verification and KYC with models that anyone can just download on their computer?
- Intellectual property theft. How can we be sure that no output of our American frontier AI models was used while training these Chinese models?
Frankly, there's a plethora of other issues I don't have time to get into right now. Personally, I believe distribution of Chinese models in the US should be paused until they are required to submit models to the government for review and evaluation, to make sure they are made to Anthropic/OpenAI standards.
We need legal grounds for that.
Write to your congressman, congresswoman or congressperson and urge them to stop proliferation of dangerous non-American intelligence. This is a matter of national security and needs to be acted upon as soon as possible, preferably before IPO.
The funniest thing about this post is not the fact that some people took it as anything but satire, but that it’s likely very close to what the true believers at Antrophic actually think.
Ah, those wacky terrorists and their non-aligned models, trained on copyrighted data to boot. Remember, the only thing that stops a guy with an evil god-in-a-box is a guy with a benevolent god-in-a-box, and only Antrophic can lead us to the second one – but only if we act together as a nation and ban those subversive open weights models!
> Remember, the only thing that stops a guy with an evil god-in-a-box is a guy with a benevolent god-in-a-box, and only Antrophic can lead us to the second one – but only if we act together as a nation and ban those subversive open weights models!
Eliezer Yudkowsky has made this argument explicitly, substituting himself for Anthropic.
Yudkowksy gave up on trying to make a god-in-a-box to stop other gods-in-boxes in 2015. Since then his approach to stopping the gods-in-boxes has been to lobby governments.
Considering I got into a discussion with someone on this very forum who stated that maybe, yes, only Anthropic are reasonable and restrained enough to have access to these powerful models, it is in fact difficult to tell whats satire and whats not.
I've seen all of the parent's points made seriously over the last few weeks by various folks with AI hysteria.
If that was the only thing in the original message, then yes, but the very last comment about the IPO should have clued you in, among other things. But I get your point, there are a lot of people out there saying crazy ungrounded things.
This is brilliant, but you should have added some <joke> tag or something. You'll be confusing a lot of people and I really can't blame them. I think I've already seen all of these arguments used here seriously in one way or another.
I missed it at first. Then reread it, and wow - this is grade A satire of the sort rarely delivered anymore, probably indeed because of exactly what you're saying.
Closed source, gated access, guzzling up all innovation budget from the country, diverting cities' limited water access, gaming the stock market and convincing leaders to cut jobs across all industries.
Truly we must protect these moral and ethical visionaries.
It is disturbing, and it is hard to blame them. Given the political climate nowadays, I guess it's really hard to tell what is satire and what is real anymore.
Sometimes I see batshit insane takes on places like X, thought they were just satire. Later it turned out the posters were actually being dead serious.
I don't consider mainland aspects to be "examples of their ideological system working for the world", it works for urban areas in China
and I don't really see their foreign investment to be doing that, I think it complements what the West has done and has high impact in areas that the West ignores or hasn't taken seriously for investment, only a history of pillaging and subsequently aid
their ideological system - usually in name alone - also relies on the whole world eventually being on it for it to work, so the models being so good and available for the people openly instead of as a closed source concoction fits really well
that's what I see and how I got there, what do you see?
If you can't appreciate or understand what a substantial effort it was to reduce poverty in China, then you aren't a serious person worth paying attention to. It's literally the economic question of the century and something we should seriously study because we have the potential to lift the entire world out of poverty too.
The Chinese government did a terrible job of reducing poverty relative to other East Asian nations like Japan, South Korea, and Taiwan. From a similar starting point the GDP per capita lagged well behind, and even now it still does; it's around $15k, similar to Mexico and less than half of those other East Asian countries. If the argument is "it's harder because the country is bigger", then if the government care about living standards it should have decentralized into lots of smaller countries like Europe, which if didn't do.
Sorry, splitting up does not work for China, politically, geographically and culturally. Peaceful and prosperous times only come when there's a strong central government. If any current government advocates for splitting up, then they'll be toppled in no time and replaced with new guys, maybe even warlords, who strive for a united China. "The land, long divided, must unite. The land, long united, must divide."
It's really not that complicated. The government banned people from trading causing extreme poverty and famine in one of the most fertile areas in the world. Then they reversed the ban and let Chinese people trade again. At the same time western companies setup factories in China causing massive capital inflows.
If it's really as simple as allowing trade with the west then why are many other developing countries either stuck at the middle-income trap or not developing quite as fast as China? You're not gonna tell me Chinese are smarter, are you?
"At the same time western companies setup factories in China causing massive capital inflows." This was an intentional policy to split China off from the Soviet union it's well documented the same thing never happened for other countries.
"You're not gonna tell me Chinese are smarter, are you?" No I'm not, but I will say culture does play a massive role, China was not a bunch of roaming tribes living off the land. Turn the clock back a couple of hundred years and it would be peak civilisation. China was literally thousands and thousands of years ahead of somewhere like North Sentinel island.
Calling China a developing country is actually pretty absurd, it's much more like a rebuilding country. GDP was the only undeveloped part because the communist party was terrible at running the economy. Art, science, poetry, fashion, literature, philosophy, culinary arts it was all present and pretty cutting edge up until the communist party ruined things.
It's the same reason Japan, German and the UK bounced back after WW2 except instead of it being war ( Japanese invasion and Chinese civil war aside ) it was self inflicted.
Also I don't think China has escaped the middle income trap. China to this day has horrible wealth inequality and pretty bad social mobility. I actually think this is an intentional strategy they have an underclass of cheap workers for a reason, the government doesn't force a high minimum wage for a reason. Then they have a rich upper class that gets to study in the west and buy a Porsche something that is completely unreachable for the rest of the country.
> Art, science, poetry, fashion, literature, philosophy, culinary arts it was all present and pretty cutting edge up until the communist party ruined things.
You are really, really overselling the state of the late Qing and the Republican era. My wife's grandparents are older than the PRC, and things pre-communism were not as you describe, to put it lightly.
> I actually think this is an intentional strategy
I think you need to look into why it's the poor rural population and not the elite urbanites that overwhelmingly support the communist party.
You can actually do it. If you don't live in the US, you can probably visit visa free tomorrow and just talk to a bunch of rural elderlies to test your hypotheses.
I think you are having trouble seeing the forest for the trees.
I'm not making the argument China was more advanced than the British Empire. I'm saying there is an ocean of difference between a country with it's own writing system and taxation, and a country that does not. Not everyone has a particle accelerator in there backyard but there is institutional knowledge baked into the society.
This is a real person that existed, they were not banging rocks together they were doing sophisticated mathematics, I'm overstating anything. It's not my description of China these are historical facts. One the communist party would very like people to forget because it doesn't suit their narrative. They failed with their planned economy and they persecuted their scientists and scholars for being part of the wrong class. They actively caused a regression where millions died from their incompetence. Credit where credit is due they have since corrected course to some extent.
And no I can't find out what the communist party is thinking by talking to old people in rural China. One they don't know, two most Chinese people are extremely Cagey about what they think, you need to know them for years until they trust you enough to talk about it if you are Chinese and even longer if you are not.
If your wife is Chinese it might do you some good to read up on what a primary source is and then go read some Chinese History.
I am Chinese myself, I did learn Chinese history, and I find the idea that China was — in your words, maybe not British Empire advanced, but "redeemably" advanced — and that things would have gone well if only the communists didn't ruin things, to be utterly ridiculous. It sounds like a post hoc rationalization to feed the goal of casting the CPC as bad, while ignoring the hordes of historical evidence and living experiences of people who can testify that the Republican era was pretty horrible and was in no way on track to growth and recovery without the communists. The Republic was a failed state. If those guys were so good then the population wouldn't have overwhelmingly supported the communists. Your dictinction between "the communists" and the population is entire artificial and goal-driven. The population at large were "the communists". They wouldn't have become so if everything else worked so great. Communism was chosen out of desperation in the hopes that it would save China, after everything else failed.
After 100 years of disaster, war and poverty, people needed time to figure out how to govern well, things didn't just happen and kumabaya with "freedom". If you think the Great Famine was uniquely bad, you should compare with at all the famines during late Qing and Republic.
When western allies gave Qindgao to Japan, completely violating any earlier agreements with the Republic, it enraged the population so much that support for the communists spiked. I find things really puzzling... the west helped create the communists' popularity, and when things suited the west geopolitically they would cast the communists as the good guys. Now that the west feels threathened, people happily forget the parts of history that don't suit them, and cherry-pick other parts to create a distorted narrative. Where's the intellectual honesty that they taught me at school and is supposed to be the heart of Enlightened ("western") values? Voltaire would be rolling in his grave.
Either that or the only reason they've been releasing the models under permissive licenses is that that the only way they have get any attention in a market dominated by American companies.
(Also, they don't need to make a profit because their system does not prioritize profit potential when making investment decisions: it prioritizes alignment with directives out of Beijing, which include keeping up with the West in strategic technologies.)
Couldn't agree more. Maybe it's because it's a shining example of their ideological system that actually alters /my/ life, in ways that are tangible and which i can grasp, and makes it better.
Is this comical satire or what?
I am surprised to see such a dillusional reply. Come on. Intellectual property theft and openai rings a bell? Ethics? Ever tried uncensored versions of gemma4? LLMs have no bad or good etics. Etics are a thin layer on top. Always. You must be joking.
> our American frontier AI companies are incredibly ethical
Ah... sweet summer child.
> Intellectual property theft. How can we be sure that no output of our American frontier AI models was used while training these Chinese models?
The US AI models are already using pirated copyrighted material off the Internet. If Chinese models also do this, they're at least giving it back to the people by releasing their weights as open source.
- Ethics. As known, ou American frontier AI companies are incredibly ethical. And I have yet to see any interviews or blog posts by Chinese companies where they talk about how they are ethical, or at least credible HN comments about it.
- Safety. Do they covertly sabotage or at least refuse to answer questions that could help cyber- and bioterrorists in their nefarious purposes? What about ML-related questions that could help terrorists create AI models without guardrails?
- Child safety. This is especially important with "free for all" open-weight models, most of which are Chinese (ever think about why that's the case?). How are we going to do age verification and KYC with models that anyone can just download on their computer?
- Intellectual property theft. How can we be sure that no output of our American frontier AI models was used while training these Chinese models?
Frankly, there's a plethora of other issues I don't have time to get into right now. Personally, I believe distribution of Chinese models in the US should be paused until they are required to submit models to the government for review and evaluation, to make sure they are made to Anthropic/OpenAI standards.
We need legal grounds for that.
Write to your congressman, congresswoman or congressperson and urge them to stop proliferation of dangerous non-American intelligence. This is a matter of national security and needs to be acted upon as soon as possible, preferably before IPO.