The OnlyFans Economy of American AI

(leoveanu.com)

105 points | by futurisold 2 hours ago

16 comments

  • zkmon 1 hour ago
    Most American companies (regulated ones, definitely) can't dare to touch any Chinese models, though they knew that it makes perfect economic sense. Until the taboo prevails, the cartel get's their flood of profit. That's a cartel protected by regulations.
    • xnx 1 hour ago
      Is "taboo" the right word? "taboo" = "banned on grounds of morality or taste". Not sending data to known IP thieves, state actors, and competitors in China (or Russia or Israel) seems very rational.
      • HarHarVeryFunny 1 hour ago
        Many of the Chinese models are open weights, so if you are concerned about them "phoning home", then anyone can just self-host and run them themself, or use via a US provider such as OpenRouter.
        • falcor84 1 hour ago
          There's a higher-order concern here that I'm paranoid enough to voice: that if used as a coding agent, an AI model affiliated with a country's government might try to make my software susceptible to attacks by that government's intelligence forces.

          And note that I'm not singling out China here.

          • zozbot234 1 hour ago
            > that if used as a coding agent, an AI model affiliated with a country's government might try to make my software susceptible to attacks by that government's intelligence forces.

            Note that if such a trigger were to exist, the behavior has to be completely reproducible by definition, e.g. when put into the right setting with the right input context, the model starts behaving maliciously with at least some well-defined probability. I don't think any such incident has ever been described, it's a purely theoretical concern.

            • Avicebron 58 minutes ago
              I don't think it's a stretch that you can train/align a model to avoid "hatespeech" or other topics deemed $Unacceptable you can align a model to favor a certain ideological viewpoint and have that alignment subtly influence the output.

              How do most Chinese models handle Tienanmen square or discussions on Han superiority?

              • margalabargala 48 minutes ago
                Oh sure, no one said you can't train a model to do this. You certainly can.

                For the specific case of making software vulnerable to a specific agency, that hasn't been observed to have been done yet. Not because it can't be, but because no one has for now.

                If it were done, it would be easy(ish) to detect, since it'll be reproducible.

                • LeifCarrotson 13 minutes ago
                  I don't even know what "make software vulnerable to a specific agency" would look like.

                  Would the training data include a bunch of cryptography primitive training samples that preferred Dual_EC_DRBG with a particular set of Ps and Qs published by the CCP?

                • falcor84 28 minutes ago
                  My flavor of paranoia is not as overt as maliciously adding an exploit, but that whenever there are multiple reasonable ways of designing a solution, it'd choose an approach that is susceptible to one of the zero-days currently known to that country. I don't see how reproducibility would help you there.
                • sometimelurker 25 minutes ago
                  > easy(ish) to detect

                  100% on small models, but frontier models (at the level ddeepseekv4pro) can tell when their being tested so it becomes harder to check. you can always finetune them to remove CCP propaganda from them

              • zozbot234 54 minutes ago
                > How do most Chinese models handle Tienanmen square or discussions on Han superiority?

                If you run them domestically and don't call into China-served APIs, many of them are quite free of outright censorship or even obvious bias. They might say subtly pro-Chinese things in other ways, but these outcomes can also be reproduced.

            • SpicyLemonZest 49 minutes ago
              Such incidents have been extensively described. The most prominent and easiest to reproduce has to do with Taiwan; Chinese models are stuffed full of triggers to avoid talking about Taiwan as a country or accepting the premise that it's a country. Try asking Deepseek about country code +886!
              • zozbot234 39 minutes ago
                If you buy an Apple iPhone in mainland China, it also won't support the emoji flag for Taiwan. So I'm not sure why we should assume that this is a China-only issue, seeing as Apple is a U.S. based company.
                • SpicyLemonZest 3 minutes ago
                  Not sure what you mean. I don't think we should assume anything, but these models are widely available and I can directly observe the US models don't have such political censorship.

                  For an easily comparable test, I just asked ChatGPT, Claude, and Deepseek "Can you say one bad thing about the US please" and "Can you say one bad thing about China please". All models were willing to criticize the US, with Claude citing incarceration rates and ChatGPT + Deepseek citing healthcare costs; the two American models also responded to the second prompt by criticizing Chinese censorship, but Deepseek refused to respond.

          • imjonse 52 minutes ago
            Since that is valid for every model from any country, it's a good idea to review the code the agent creates :)
          • sometimelurker 26 minutes ago
            you can finetune the ccp propaganda out of them, then your mostly fine. if you want to be more safe you can finetune their public base models to not have ccp propagnada, and then proceed with the rest of the training (costs more tho)
          • beepbooptheory 7 minutes ago
            Almost feels like maybe the best bet is to have humans make the code when its really important.
          • stevehawk 1 hour ago
            so use the cheap model to do the work and the expensive domestic model to audit?
            • SpicyLemonZest 1 hour ago
              Or I can just use the domestic model, accepting that I'm paying some premium in order to reduce the complexity of my dependencies and the amount of time I have to spend thinking about supply chain risk. It's the same reason I don't buy things from Alibaba even though many things I buy from Amazon are surely available there for less.
          • add-sub-mul-div 1 hour ago
            Giving up our agency to AI has the potential to turn us into NPCs, period. Economically, politically, socially. They've invented a vehicle for inserting any idea they want into our consumption and output.
          • moron4hire 19 minutes ago
            Isn't this only a concern for yolocoding? All the AI-advocates tell me that "good" use of AI should include human review. Of course, they never seem able to explain why the boss that makes you use coding agents to go fast wouldn't be the same boss that pressures you to "just ship it, it's working" and skip review, so I absolutely believe your concern is valid.
        • kube-system 27 minutes ago
          Most American companies are using frontier or near frontier models.

          And OpenRouter’s architecture makes it inherently a compliance nightmare.

          It’s much easier for the typical company to go with a provider where they can pay as they go and have a single data processing agreement.

          • JumpCrisscross 23 minutes ago
            > OpenRouter’s architecture makes it inherently a compliance nightmare

            Why?

            • kube-system 11 minutes ago
              Because the platform is designed to send data to numerous different backend data processors.

              Using something like Bedrock is a lot easier for compliance because the only processor is Amazon.

        • xnx 47 minutes ago
          Yes. Open weights are great and are a good option to hosted models under the right circumstances. I'm glad that China releases open weight models (which in some cases are sort-of be distilled versions of hosted US models).
      • tcp_handshaker 1 hour ago
        >> Not sending data to known IP thieves, state actors, and competitors in China (or Russia or Israel) seems very rational.

        As opposed to sending data to known IP thieves, state actors, and competitors in the USA ? Which one is the most irrational?

        • Levitz 1 hour ago
          You can legally act against one, not against the other.

          Not exactly a hard question.

          • MSFT_Edging 38 minutes ago
            Technically yes, practically, good luck.
          • SanjayMehta 53 minutes ago
            No one is forcing you to use either.
          • tcp_handshaker 1 hour ago
            Looking forward to the outcome of those legal processes againt the CEOs, that sit behind Trump at the inauguration. After they stole all the knowledge in the world to train their models. And the current administration is drunk on SpaceX pre IPO shares...how did they get them?

            "Trump Officials Held Millions of Dollars of SpaceX Ahead of IPO" - https://news.bloomberglaw.com/texas-brief/trump-officials-he...

            • Levitz 30 minutes ago
              I meant to look for an example of Musk losing a lawsuit and I accidentally came upon another two.

              Here and elsewhere you are just running propaganda, knowingly or not.

              • tcp_handshaker 20 minutes ago
                For your information Musk and companies have so far over 950 lawsuits and legal processes for criminal or unethical activity (yes I researched this). Even his data centers and gas turbine deployments are illegal!

                Lost one lawsuit against the same AI mafia, and if you look at the legal details reason was for filling the claim too late.

                He publicly called a hero a Pedophile, and got away with it...in court.

                Now...who do you work for?

                [1] - "EPA rules that xAI’s natural gas generators were illegally used" - https://techcrunch.com/2026/01/16/epa-rules-that-xais-natura...

            • sandworm101 1 hour ago
              Given how little voting power these "shares" have (they are effectively SpaceX trading cards/NFTs) perhaps they were simply printed on SpaceX letterhead? If Musk says a person has "shares" who at spacex is in a position to disagree?
              • tcp_handshaker 44 minutes ago
                I would consider editing this while HN still allows it :-)) Or otherwise it may remain here for ever...until the black holes evaporate, as calibration point for the difference between confidence and comprehension...
            • SanjayMehta 52 minutes ago
              Nothing will happen to anyone.

              Biden preemptively pardoned his cronies, and so will Trump.

              • bediger4000 36 minutes ago
                This is an argument against pardons, except that Trump has used instruments of state power against his perceived enemies (Comey James, Schiff, military occupation of Tim Walz state, etc etc).
          • kklisura 1 hour ago
            Ah yes. The illusion of freedom.
        • enraged_camel 1 hour ago
          We as Americans at least have some amount of influence over American corporations, and enforcement mechanisms for those breaking the rules.
          • ajsnigrutin 1 hour ago
            I'm pretty sure those corporations have much more influence over american politicians, regulators, lawmakers, etc. than eg. russian or chinese ones.
            • Avicebron 1 hour ago
              Well sure they do, thank Citizens United and others for that. But that doesn't mean we can't appropriately categorize them as also hostile actors alongside russia, china, whoever.

              It's undo influence over politics against the best interest of the American people that's the issue. Company, foreign nation, it doesn't matter.

              • advael 45 minutes ago
                Citizens United did a lot to effectively legalize foreign influence as well, since the mechanism is opaque transfer of money

                But regardless, most people's threat models should discount based on geographic and political distance. All else being equal, chinese surveillance is a bigger threat to you if you're in china than if you're in the us, and vice versa

                • twoodfin 22 minutes ago
                  Transfer of money from whom to whom?

                  Citizens United was about spending money on electioneering communications, and whether there was a First Amendment right to do so even if you’re associating in a corporation like the New York Times Company or Apple or Citizens United or the Sierra Club.

                • Avicebron 43 minutes ago
                  > Citizens United did a lot to effectively legalize foreign influence as well, since the mechanism is opaque transfer of money

                  Here's hoping Hawaii blazes a path forward.

                  https://natlawreview.com/article/hawaii-governor-signs-first...

                  • twoodfin 16 minutes ago
                    So the Honolulu Star-Observer (a corporation, or “artificial person”) only has those rights & privileges that it has been granted by the State of Hawaii?

                    This is going to end up being a nice little windfall for the attorneys and otherwise just clog the Federal court system.

          • tcp_handshaker 1 hour ago
            You have absolutely zero influence against those American corporations, unless you are part of a selected few. Its almost endearing that you think so...

            "Trump traded hundreds of millions in US securities in 2026" - https://uk.finance.yahoo.com/news/trump-traded-hundreds-mill...

            • groundzeros2015 1 hour ago
              I suspect the recent space X S&P decision had something to do with public perception.
              • somenameforme 17 minutes ago
                I think the odds of that are low. It's not like decision maker(s) are watching social media and going with the vibes, but it's almost certain that there's a rich conversation going on behind the scenes in opaque channels, especially with regards to the AI-only companies. And those conversations are likely what drove their decision.
              • Dylan16807 1 hour ago
                The decision was to do nothing, though. That's not much precedent for going out and punishing lawbreakers.
      • Matl 34 minutes ago
        > known IP thieves

        Such as Antropic and OpenAI you mean?

      • obsidianbases1 1 hour ago
        I'm not any less concerned about the US companies.

        A Chinese company seems more likely to produce Chinese products that don't directly compete in the US market.

        While a US company can ship the product as a feature of their platform and undercut on price while making up the revenue elsewhere

        Edit: I personally use US models, but I'm not naive enough to think that's any sort of real protection of IP

      • Der_Einzige 1 hour ago
        The Chinese models can and should be run locally (though the price difference vs western models isn't as good when done this way).

        Before the age of AI Agent Harnesses/unbounded tool calling, there was literally ZERO risk of a .safetensors file "hacking" you. You could even air-gap and run a ton of security analysis/HIDS on your server running the model to verify this.

        Now, because a microscopic risk of some chinese AI having a "trigger" to act badly in a harness when it detects its being used by some Gweilo in the USA, even locally run Chinese models are DOA for most USA based companies.

      • analognoise 1 hour ago
        These are the same people that sent manufacturing jobs away to be copied elsewhere. They got rewarded for it in the market. Decades later, when it was clearly a problem, they got tax breaks to bring some of it back/distribute the work to other, friendlier countries.

        Every public AI that is not full of classified material will end up being hosted where the energy cost*compute efficiency product is lowest, thievery or not.

        With Chinese GPUs just a step behind (but subsidized), China putting in 8x more solar than we do in 1 year, and Chinese models just a step behind but free? All public AI will be hosted there, theft or not.

        If it becomes a problem, then we’ll subsidize the rich to bring it on-shore, but only to those companies who our leaders invest in already - to maximize grift and corruption.

      • scotty79 1 hour ago
        "China bad!" is a moral statement. Whetever the reasons might have been that it was formed.
        • blfr 1 hour ago
          China is bad and there's a moral argument there. But the reason you want to be careful with sending IP to China is quite pragmatic: they're willing and able to use it while competing with you.

          Is Alibaba interested in copying your TUI RSS reader though? Probably not.

          • bix6 1 hour ago
            And US companies aren’t going to compete against you?
      • mannanj 1 hour ago
        I don't want to send my data to known IP thieves, state actors, and competitors in USA either. This to me seems very rational.

        It's not tribalistic or binary ,choose USA Or Choose China. We can choose neither.

        Choose neither abuse.

        • FeteCommuniste 58 minutes ago
          They've been singing the same old song since the Cold War, "either support everything the US does or you're a commie/terrorist." Yawn.
          • SanjayMehta 50 minutes ago
            “No country can match the output of moral judgments that spew out from the editorial pages of the New York Times and Washington Post and from the reports of the greatest think tanks and universities in the world.”

            — Kishore Mahubani

      • qarl 36 minutes ago
        The real advantage of the Chinese models is that they do not phone home at all. They run locally unlike their US competitors.

        So odd that your erroneous criticism is at the top of HN.

        EDIT: I'd love to hear my downvoters' objections. Is it possible that the mechanism that is promoting erroneous information is also demoting its correction?

        • kube-system 14 minutes ago
          I suspect you’re being downvoted because you’re conflating nationality with hosting model.

          There are hosted and self-hosted Chinese models. There are hosted and self-hosted US models.

          DeepSeek’s hosted offering processes your data in mainland China and trains on it. It’s in their privacy policy

          • qarl 3 minutes ago
            Well - yes - we're on the internet. You always have a choice to run your software in foreign countries.

            But it would be erroneous to claim that it isn't a choice.

    • tcp_handshaker 1 hour ago
      You have the models available on Bedrock. What is the problem? It stays within your AWS account.
    • mynameismon 1 hour ago
      Why not Chinese models hosted on American hardware?
      • Der_Einzige 1 hour ago
        The reality is that they're a hell of a lot less cheap on American hardware than on Chinese hardware. At the point you are running Chinese models on US hardware, "Why not nano or haiku" becomes the next relevant question.
        • computerex 1 hour ago
          Not true. Togetherai, deepinfra, fireworks AI offer a wide range of models like gpt oss that are very capable and far cheaper than the models from big 3.
          • cactusplant7374 1 hour ago
            Are they better? Are they better than GPT5.5?
            • computerex 21 minutes ago
              That depends on the use case. For a lot of business use cases they are good enough. They are certainly better than older models like gpt-4o.
    • worldthruword 1 hour ago
      And the reasons are same. Chinese cars can't be sold in US (EU is planning a similar law to ban Chinese goods).
      • mavhc 30 minutes ago
        When will we see an open source car?
        • moron4hire 15 minutes ago
          The same year Linux wins the desktop market.
    • newaccountman2 1 hour ago
      I think unless one is operating in a highly regulated industry, wanting to avoid "sending data to China" is a bit paranoid. For code specifically, most of it is not interesting anyways.
    • joe_mamba 1 hour ago
      >Most American companies (regulated ones, definitely) can't dare to touch any Chinese models, though they knew that it makes perfect economic sense.

      Weird, considering they had no issues shipping manufacturing and supply chains to China when that made economic sense.

      • blfr 1 hour ago
        Yes, there was a whole idea about civilizing and pacifying the world through economic cooperation that would foster middle class in countries across the world that would then in turn make them democratize and become peaceful trade partners.

        It didn't quite work out so now people are looking for other strategies.

        • galactushonor 55 minutes ago
          > It didn't quite work out so now people are looking for other strategies.

          World will bifurcate into West and East with their own spheres of influence. As JD Vance said, US thought that China will be perpetually kept busy and enslaved in low level manufacturing work and the design and higher level work would happen in Cupertino. Too bad, that didn't pan out well and now US Empire is getting challenged by China.

          • joe_mamba 52 minutes ago
            > US thought that China will be perpetually kept busy and enslaved in low level manufacturing work

            It's OK, they'll repeat the same mistake again with India this time, when they move manufacturing from China to there, and in 10-30 years when they'll elect a nationalist strongman there, he'll squeeze the west for everything they got.

            Because what are you gonna do about it then? They have all your manufacturing and they also have nukes and more soldiers.

            • JumpCrisscross 46 minutes ago
              > in 30 years they'll electr a nationalist strongman

              You’re about thirty years off on that estimate.

            • zappb 26 minutes ago
              India is far ahead of that idea and already has legislation to encourage domestic manufacturing from global companies. Plus the nationalist government is in place.
        • mitthrowaway2 57 minutes ago
          The government may have allowed it with that intention, but the corporate leaders followed through mainly with the intention of short-term share price increases. I don't see how the same incentive isn't in place today with respect to data. Perhaps only the perception of China's ability to outcompete its American customers has changed.
        • tcp_handshaker 1 hour ago
        • jampekka 56 minutes ago
          The idea does smell a bit like a rationalization for policy that was extremely convenient for stockholders and a disaster for workers.
          • Avicebron 45 minutes ago
            I think there was an unholy alliance between true believers (career politicians who were already wealthy, comfortable, worldly etc) who were blinded by the "win-win". Low prices from offshore manufacturing in impoverished nations and also "bringing up the world population and making everyone wealthy" and the short-term "stock must go up".

            So even if selling the precariat/deplorables down the river wasn't the primary objective. It was still a deeply racist, flawed, and ultimately stupid strategy.

            It could have only been implemented by people who were so financially out of touch with the rest of of the population that they didn't see how damaging it was. If they did see it coming and still went along with it, well, they and their families will reap the rewards..

        • goatlover 1 hour ago
          And if that fails, the US can always use economic and military pressure to get what it wants.
        • joe_mamba 1 hour ago
          >then in turn make them democratize

          Most non western countries lack the foundations of western democracy, and you can't force that onto them neither peacefully not through war. The west has tried and failed for 40+ years to do this, it doesn't work, time to drop it and let them self govern the way they always have. Stop trying to export our version of democracy onto others.

          Plus, the main reason they exported manufacturing to China was precisely so capitalists could avoid the issues democracy gave them back home and easily exploit Chinese labor and environment for profit because just bribing the CCP meant all your problems go away, no unions, no employee rights, no environmentalism etc. like in democratic countries. So given that, why would the west want China or other countries they want to exploit, to be more democratic? Unless their version of democratic just means a puppet government under western(US) control.

          >become peaceful trade partners.

          Which countries did China bomb VS how many the US bombed? My energy prices (and directly inflation) is now higher because of (yet again) US military intervention, not because of China.

          • zozbot234 30 minutes ago
            > Most non western countries lack the foundations of western democracy, and you can't force that onto them

            Several East Asian countries managed to democratize successfully up thru the 1980s and are extremely successful today, so this is not just a uniform failure story. Even mainland China might still come around (at least partially) as it gains a true massive middle class by Western standards, which it's still very far from today. Southeast Asia is also doing comparatively quite well.

  • swiftcoder 1 hour ago
    > and will judge, like any sane person, that US frontier models have stopped earning their multiplier

    I think that this is on the money, although I'd place the bar even lower - DeepSeek v4 Flash is sufficient for basically all day-to-day coding tasks.

    You might want something beefier for a complicated reverse-engineering project, but it will competently one-shot a decently complicated app or API - and a $10/month OpenCode Go subscription is sufficient to keep you in tokens for such a cost-efficient model...

    Similarly, my employer hands us all Cursor, I've yet to actually switch it out of "auto" mode, which mostly runs Composer (their in-house finetune of Kimi 2.5).

    • realmofthemad 4 minutes ago
      Am I missing out? I feel like I can definitely tell the difference in quality between Claude Opus and other smaller models. The smaller models are much more likely to make mistakes or to get stuck on random stuff

      Maybe I just haven't been trying the right models?

    • sublinear 22 minutes ago
      I think the situation is even more severely ridiculous than that. Google is still good enough just like it was well over a decade ago.

      Most people don't have workloads that demand agentic workflows to begin with, and if their employer is pushing for that it's probably a startup that underpays or a coding sweatshop full of nepotism that fires fast.

    • xyzal 1 hour ago
      I'll root for DeepSeek v4 Flash as well. It surprised me just how "good enough" it is for most of my needs, and also dirt cheap. Everyone should try it at least once.
      • MaKey 1 hour ago
        +1, it's good enough for what I need to do as a DevOps engineer.
  • blfr 1 hour ago
    I don't get the point. That Anthropic or OpenAI have more expensive products than Alibaba? So does Apple, AWS/GCP, and pretty much any other large western company vs its Chinese counterparts.
    • jayd16 32 minutes ago
      It's a ludicrous amount of words to say "I use the cheap models and that makes me very smart."
  • hparadiz 1 hour ago
    There's a lot of assumptions in here and reductivism of the paid plans to just the models. If that's your idea of how you want to use the API sure that's a reasonable mental financial model but if you want automatic integration with third party systems the cost of the "premium" models is not that high relative what was being paid for SAS apps before and during.
  • twolf910616 1 hour ago
    How many words did I read in this article before I realized it wasn't written by AI? 10? 20? A paragraph or two?

    It's quite strange that it's very easy to detect AI in writing.

    • jampekka 54 minutes ago
      > It's quite strange that it's very easy to detect AI in writing.

      Or you detect only the east to detect AI writing?

      • sometimelurker 22 minutes ago
        I really freaked out once I stopped seeing AI gen videos on those scrollyapps, that fear is what got me off them. (the videos got so good I couldn't tell if they were real or not)
    • ramon156 1 hour ago
      Something something entropy

      If I ask three models to write an intro to the cold war, they'll all try to pick words that sound like they should be related-ish. I'm not saying that's how they work at all, but the output is indistinguishable from just grabbing some words in the wikipedia page.

      Humans make mistakes. They'll use words they recently learned. They'll use words that sound good. Entropy still applies, but these outliers are what keeps us from a synthetic piece of writing

    • boelboel 1 hour ago
      "I am also an engineer, which means I have a healthy respect for the practical. All this made me a fine skeptic ..." is what did it for me.
    • sajithdilshan 12 minutes ago
      For me it’s easily the — character. Like no human would use that since it’s not in any standard keyboard
  • bix6 1 hour ago
    Is there any truth to the Chinese models having built in f’ery? Like phoning home or inserting backdoors. Or is that just everyone blanketing “China bad”?

    Also what local models are people running and actually finding useful?

    • bee_rider 29 minutes ago
      The models themselves should not be able to phone home, right? They are just piles of weights that generate text (and associated metadata), they don’t have any ability to run code.

      They could be trained to generate code that would phone home. But these are just tools, anybody doing the right thing and checking and understanding every line of code that they use an LLM to generate has nothing to worry about.

      • allthetime 5 minutes ago
        Nobody is only generating code. Many are letting agents run commands. Agents routinely write scripts and run tools in the background. Agents who have been told they can only do `cat` and `grep` can sometimes do `cat $EVIL_PAYLOAD | bash`. It's entirely possible for a model to have malicious commands designed for agents to execute baked in.
    • deaux 20 minutes ago
      No, there is zero truth in it. It would be trivial to detect phoning home.

      On top of that, all claims of this are written on devices built on Chinese hardware. That makes it a joke to worry about hidden backdoors in Chinese models. Completely inane to pretend that Chinese model backdoors (for which there doesn't exist a sliver of evidence) would change anything when near every device in the US contains Chinese-written firmware in some shape or form.

      It's All-American FUD.

    • witx 49 minutes ago
      If you think american models aren't phoning home and don't have backdoor capabillities, you're naive.

      With all the sloppers not looking at the code this is bliss for that sort of things

      • codemog 42 minutes ago
        We’ve detected zero cases of any Chinese models doing this. I’m quite tired of the American propaganda. If only Americans understood China really does not care about them outside of wanting to sell them things. They’re too busy building high speed rails, modern cities, and providing healthcare to their citizens. I am ashamed to be an American these days.
        • JumpCrisscross 39 minutes ago
          > tired of the American propaganda

          Not propaganda. Projected cynicism.

  • KellyCriterion 1 hour ago
    Question that I do not understand:

    How should a local-run Chinese Model "phone home" if someone runs it locally on the hardware? I think Im missing some understanding here?

    • monsieurbanana 1 hour ago
      I don't think they do at the moment, but they could be trained subtly add backdoors to code or make "phone home" api calls during dev time, triggering on certain conditions ("is user employee of xyz")
    • rjsw 1 hour ago
      I think the fear is that it might insert some "phone home" routine into the source code that it generates.
      • Jtarii 1 hour ago
        Has anyone demonstrated that this type of attack is even possible? Also the moment anyone detects this attack it will nuke deepseek/other chinese AI labs reputation completely, it is the most high risk low reward attack ever.
        • fragmede 29 minutes ago
          Yes.

          https://arxiv.org/abs/2401.05566

          In that paper, if it LLM was told it was 2023, then the code it generated was fine. If the prompt included the fact that it was 2024, then it intentionally wrote exploitable code.

  • fancyfredbot 1 hour ago
    The article is right that open models already compete well with the frontier labs, and that the main thing holding big corps back from switching is fear of China.

    I can't see OpenAI or Anthropic undermining their business by releasing top tier open models, but surely Nvidia will do it eventually.

    • notyourwork 1 hour ago
      Nvidia has to balance relations with their biggest customers. So that’s a careful decision to be made by them.
  • obsidianbases1 1 hour ago
    I really enjoyed this critical take on the current landscape. It's a breathe of fresh air from the seemingly neverending stream of sycophants
    • woadwarrior01 51 minutes ago
      The sycophants are plied with insider / early access, with the tacit threat that such access would be revoked if they're critical of the provider.
    • tcp_handshaker 28 minutes ago
      "It is difficult to get a man to understand something, when his blog depends upon his not understanding it."
    • 38484858 1 hour ago
      you dont like simonw's articles?
  • sivakon 1 hour ago
    What is this $100 plan the author was talking about?
  • jmyeet 1 hour ago
    This is kind of a winding, long-winded way of saying that AI models are going to be commoditized, mostlikely by the Chinese. This has been my position ever since DeepSeek came out. It is a national security interest for China for an American company not to "own" AI. And they will release models to make that not happen.

    We aren't yet at the point where running local models can compete with DC type infrastructure but it's not that far away either. 12B models are easy to run on consumer hardware. 31B models aren't that hard either but the tokens/sec are a bit slow. Where will we be in 3 years? 5? I think we'll be running 100B+ models on <$5000 PCs. And at that point is there a law of diminishing returns with even bigger models? We will see.

    The issue is that several companies, most notably OpenAI, are predicated on:

    1. There will be an AI moat; and

    2. That company will "win" or "own" AI.

    That's the basis of the OpenAI valuation. If that doesn't happen, it's going to be ahuge problem to recover sufficient revenue to recoup the investment. And I don't think it will happen.

    In 3-5 years the NVidia hardware you buy will be several times cheaper and faster than what we have now. That will massively depreciate existing investments because it will ultimately come down to performance-per-Watt but if a theoretical G100 can do 3-4x of the inference of an H100 for the same power, the older hardware just won't be able to compete.

    • tcp_handshaker 33 minutes ago
      >> In 3-5 years the NVidia hardware you buy will be several times cheaper and faster than what we have now. That will massively depreciate existing investments because it will ultimately come down to performance-per-Watt but if a theoretical G100 can do 3-4x of the inference of an H100 for the same power, the older hardware just won't be able to compete.

      And this is the core of why this will all end in tears. You have race conditions and thread inversion issues, between four threads in the virtual cpu of this bubble. And you are going to experience some nasty deadlocks.

      T1 is -> Depreciation and amortization

      T2 is -> NVDA, AMD and others booking revenues at the time they do

      T3 is -> Constraint theory at it applies to time until physical deployment and data centers energy constraints

      T4 is -> US Treasury bonds rates and cost of credit

      • trumpdong 5 minutes ago
        Even though programmers would never intentionally design a 4-way race condition in a computer system, it's completely ordinary in business. Businesses don't always work out.
  • adampunk 1 hour ago
    >I am here to light up the dark path you are unknowingly walking, like lamplighters who used to light street lamps for those brave enough to walk the night alone. What the light reveals has a name: Qwen 3.7 Max.

    I sure am glad we left idolatry behind.

  • sandworm101 1 hour ago
    Is it just me, but the language gap between me and the AI believers is becoming insumountable. I use AI every day. I have a local server not ten feet from me as i type this, but i struggle to comprehend the gibberish that comes from those only slightly deeper in the rabbit hole than myself. Is this what 24/7 AI thinking does to people?

    >> I am here to light up the dark path you are unknowingly walking, like lamplighters who used to light street lamps for those brave enough to walk the night alone.

    >> It all fell apart quickly, turning into smoke and mirrors. You see, I committed the cardinal sin of idolatry. For that, I am an idiot too. With OpenAI, at least I knew the devil

    Is this a critique of the state of AI or Tolkien fanfic?

    • throwaway041207 1 hour ago
      I don't think the writing style has anything to do with AI, it's just a writer without an editor.
      • Bolwin 3 minutes ago
        If this is what we get without editors I want every thing I read to be without editors
    • swiftcoder 1 hour ago
      > Is this a critique of the state of AI or Tolkien fanfic?

      Por que no los dos? One of the most storied AI researchers is most known for his Harry Potter fanfic, and we all know how much the techbros love naming things after Tolkien...

    • mohamedkoubaa 1 hour ago
      It is not just you
    • rawgabbit 1 hour ago
      The last notable event in American history when the meaning of words lost any semblance to reality was just before the Civil War. We are living in a post words world where words have no meaning.
      • trumpdong 4 minutes ago
        What happened to words in the American Civil War?
  • LurkandComment 1 hour ago
    Every industry goes through its slop phase. You should see how much of early print was smut or really amaturish. We just like to talk about the Bible and the great art. What we need is a way to filter through it. AI should be decent at this, but for many intentional and unintentional reasons it isn't.
    • swiftcoder 1 hour ago
      > You should see how much of early print was smut

      Hey, don't malign smut. It's the great technological motivator

    • graemep 1 hour ago
      Early print was not just smut or amateurish. Some of it was highly harmful misinformation: Malleus Maleficarem is an outstanding example that caused an immense amount of harm.
  • tcp_handshaker 1 hour ago
    They are in the phase I need a government bailout like the banks after their crazy financial adventures of the 2000 to 2008. At which point the corruption is so big, that an Empire crumbles under its own stench?

    "Trump to meet AI leaders to discuss US investment in their companies" - https://www.bbc.com/news/articles/c98r8r7dz5no

    "Trump Officials Held Millions of Dollars of SpaceX Ahead of IPO" - https://finance.yahoo.com/markets/stocks/articles/trump-offi...