• @zovits@lemmy.world
      link
      fedilink
      English
      025 days ago

      It certainly sounds like they generate the fake content once and serve it from cache every time: “Rather than creating this content on-demand (which could impact performance), we implemented a pre-generation pipeline that sanitizes the content to prevent any XSS vulnerabilities, and stores it in R2 for faster retrieval.”

  • @Onsotumenh@discuss.tchncs.de
    link
    fedilink
    English
    027 days ago

    Why do I have the feeling that I will end up in that nightmare with my privacy focused and ad-free Browser setup. I already end up in captcha hell too often because of it.

    • Dr. Moose
      link
      fedilink
      English
      026 days ago

      Of course it will. Cloudflare has already ruined the web and it’s just another step further.

  • @XeroxCool@lemmy.world
    link
    fedilink
    English
    027 days ago

    Will this further fuck up the inaccurate nature of AI results? While I’m rooting against shitty AI usage, the general population is still trusting it and making results worse will, most likely, make people believe even more wrong stuff.

  • @lily33@lemm.ee
    link
    fedilink
    English
    027 days ago

    while allowing legitimate users and verified crawlers to browse normally.

    What is a “verified crawler” though? What I worry about is, is it only big companies like Google that are allowed to have them now?

      • @lily33@lemm.ee
        link
        fedilink
        English
        0
        edit-2
        27 days ago

        Any accessibility service will also see the “hidden links”, and while a blind person with a screen reader will notice if they wonder off into generated pages, it will waste their time too. Especially if they don’t know about such “feature” they’ll be very confused.

        Also, I don’t know about you, but I absolutely have a use for crawling X, Google maps, Reddit, YouTube, and getting information from there without interacting with the service myself.

    • IninewCrow
      link
      fedilink
      English
      027 days ago

      They should program the actions and reactions of each system to actual battle bots and then televise the event for our entertainment.

          • Singletona082
            link
            fedilink
            English
            027 days ago

            Putting a chopped down lawnmower blade in front of a thing, and having it spin at harddrive speeds is honestly kinda terrifying…

    • @supersquirrel@sopuli.xyz
      link
      fedilink
      English
      0
      edit-2
      26 days ago

      No, it is far less environmentally friendly than rc bots made of metal, plastic, and electronics full of nasty little things like batteries blasting, sawing, burning and smashing one another to pieces.

  • Deebster
    link
    fedilink
    English
    027 days ago

    So they rewrote Nepenthes (or Iocaine, Spigot, Django-llm-poison, Quixotic, Konterfai, Caddy-defender, plus inevitably some Rust versions)

    • 野麦さん
      link
      fedilink
      English
      0
      edit-2
      27 days ago

      It’s the consequences of the MIT and Apache licenses showing up in real time.

      GPL your software, people!

  • @RelativeArea1@sh.itjust.works
    link
    fedilink
    English
    027 days ago

    this is some fucking stupid situation, we somewhat got a faster internet and these bots messing each other are hugging the bandwidth.

    • dual_sport_dork 🐧🗡️
      link
      fedilink
      English
      0
      edit-2
      27 days ago

      Especially since the solution I cooked up for my site works just fine and took a lot less work. This is simply to identify the incoming requests from these damn bots – which is not difficult, since they ignore all directives and sanity and try to slam your site with like 200+ requests per second, that makes 'em easy to spot – and simply IP ban them. This is considerably simpler, and doesn’t require an entire nuclear plant powered AI to combat the opposition’s nuclear plant powered AI.

      In fact, anybody who doesn’t exhibit a sane crawl rate gets blocked from my site automatically. For a while, most of them were coming from Russian IP address zones for some reason. These days Amazon is the worst offender, I guess their Rufus AI or whatever the fuck it is tries to pester other retail sites to “learn” about products rather than sticking to its own domain.

      Fuck 'em. Route those motherfuckers right to /dev/null.

      • Buelldozer
        link
        fedilink
        English
        027 days ago

        and try to slam your site with like 200+ requests per second

        Your solution would do nothing to stop the crawlers that are operating 10ish rps. There’s ones out there operating at a mere 2rps but when multiple companies are doing it at the same time 24x7x365 it adds up.

        Some incredibly talented people have been battling this since last year and your solution has been tried multiple times. It’s not effective in all instances and can require a LOT of manual intervention and SysAdmin time.

        https://thelibre.news/foss-infrastructure-is-under-attack-by-ai-companies/

        • dual_sport_dork 🐧🗡️
          link
          fedilink
          English
          027 days ago

          It’s worked alright for me. Your mileage may vary.

          If someone is scraping my site at a low crawl rate I honestly don’t care so long as it doesn’t impact my performance for everyone else. If I hosted anything that was not just public knowledge or copy regurgitated verbatim from the bumf provided by the vendors of the brands I sell, I might oppose to it ideologically. But I don’t. So I don’t.

          If parallel crawling from multiple organizations legitimately becomes a concern for us I will have to get more creative. But thus far it hasn’t, and honestly just wholesale blocking Amazon from our shit instantly solved 90% of the problem.

        • @confusedbytheBasics@lemmy.world
          link
          fedilink
          English
          027 days ago

          Yep. After you ban all the easy to spot ones you’re still left with far too many hard to ID bots. At least if your site is popular and large.

      • @desktop_user@lemmy.blahaj.zone
        link
        fedilink
        English
        027 days ago

        the only problem with that solution being applied to generic websites is schools and institutions can have many legitimate users from one IP address and many sites don’t want a chance to accidentally block one.

    • Dr. Moose
      link
      fedilink
      English
      026 days ago

      Lol website traffic accounts for like 1% of bandwidth budget. 1 netflix movie is like 20k web pages.

    • IninewCrow
      link
      fedilink
      English
      027 days ago

      It’s what I’ve been saying about technology for the past decade or two … we’ve hit an upper limit to our technological development … that limit is on individual human greed where small groups of people or massively wealthy people hinder or delay any further development because they’re always trying to find ways to make money off it, prevent others from making money off it, monopolize an area or section of society … capitalism is literally our world’s bottleneck and it’s being choked off by an oddly shaped gold bar at this point.

      • @QuarterSwede@lemmy.world
        link
        fedilink
        English
        026 days ago

        The problem you aren’t recognizing is that, until humans are no longer driven by self preservation, there will always be oppression in any system. They all have and will continue to breakdown. It’s easy to blame capitalism but even socialist systems eventually cave under the weight of greed and power. We are the problem mon frère.

            • @Val@lemm.ee
              link
              fedilink
              English
              027 days ago

              So here’s a little bit of lemmy lore for you. You’re instance lemmy.ml is considered to be a tankie instance by some users. lemmy.dbzer0.com is an anarchist instance. The user you responded to probably made a generalisation based on this and assumed you were familiar with anarchist/communist/socialist/leftist discourse. From this comment I assume they were wrong.

              So on behalf of no-one but myself: Hello! Welcome to Anarchism! The belief that authority should not exist. This belief comes from a lot of different places and wears a lot of different faces. Most short explanations aren’t sufficient and long explanation bore most. If you don’t mind a little learning here is a link: https://anarchistfaq.org/afaq/sectionA.html#seca1 and another one https://crimethinc.com/2016/09/28/feature-the-secret-is-to-begin-getting-started-further-resources-frequently-asked-questions#faq or if you like videos: https://youtu.be/lrTzjaXskUU.

              Also a little bit about authority: people use authority to mean many things (this is even bought up in the video I linked above). But as far as anarchists are concerned (in general (no specific statement can be made about a group so vast)) authority is the act of coercing people to follow orders or commit involuntary acts. You’re boss can coerce you to neglect your health by threatening to fire you. Your government can force you to obey gender roles by threatening to jail you. A rich person can make you do whatever demeaning thing they want by dangling money in front of you (for reference see mrbeast) because otherwise your landlord will kick you out. This is authority and it is wrong. Those in authority can make mistakes, become greedy and start to think they have the power to do whatever they want (mostly because they can). This leads to suffering. My meaning of life is to minimise suffering. Anarchy is the belief that no-one should hold power over others. That all leadership should be scrutinised. It rejects blind faith in single people and encourages to think for yourself so no-one can do you wrong. And if you can’t be bothered, it encourages you to find people who genuinely care about you and let them stand up for you.

              • @morrowind@lemmy.ml
                link
                fedilink
                English
                027 days ago

                Thanks, I don’t really care for generalizing instances and didn’t really have a choice when I made my account.

                But also your definition is impossibly broad as you well and I’m pretty sure not the general consensus. The video doesn’t define it as such either.

                For one thing, by your definition we can have absolutely no meaningful human relationships. I can explain this more later when I have time if you don’t see what I mean

                • @Val@lemm.ee
                  link
                  fedilink
                  English
                  026 days ago

                  My explanation of authority wasn’t meant as a definition but rather a brief summarisation of a complex concept, Andrew does a better job actually explaining it. Like pointing out that Authority is confused with a lot of different concepts like respect or influence. Which I’m starting to suspect is happening here. meaningful human relationships are based on mutual respect. This is not authority as it is voluntary, reciprocated and revoked as soon as the other party steps over the line. This is what I believe is the basis of society and what we need to return to in order to live a truly free life. In modern society in most interactions respect has been replaced with authority. People in positions of power even use them synonymously.

          • Ms. ArmoredThirteen
            link
            fedilink
            English
            027 days ago

            Not who you responded to but yeah I want to hear a drug fuelled rant I don’t even care what topic

        • @limer@lemmy.dbzer0.com
          link
          fedilink
          English
          027 days ago

          He is not wrong. Unless people start to take steps , the dependency of tech will be used to chain most of us. Granted, these chains will be the kindest and gentlest chains seen in a long time.

          Social revolution lives on in decentralized services, like this; the true battles will be later though. This year is a mild warm up. I can’t imagine the challenges that await many

      • @IrateAnteater@sh.itjust.works
        link
        fedilink
        English
        027 days ago

        That’s not really relevant here. This is more of a “genie is out of the bottle and now we have to learn how to deal with it situation”. The idea and technology of bots and AI training already exists. There’s no socioeconomic system that is going to magically make that go away.

  • @Empricorn@feddit.nl
    link
    fedilink
    English
    027 days ago

    So we’re burning fossil fuels and destroying the planet so bots can try to deceive one another on the Internet in pursuit of our personal data. I feel like dystopian cyberpunk predictions didn’t fully understand how fucking stupid we are…

  • @MNByChoice@midwest.social
    link
    fedilink
    English
    027 days ago

    Be great if these reinforced facts.

    Earth us an imperfect sphere.

    Humans landed on moon.

    Taiwan is an independent nation.

    • @rocket_dragon@lemmy.dbzer0.com
      link
      fedilink
      English
      027 days ago

      Next step is an AI that detects AI labyrinth.

      It gets trained on labyrinths generated by another AI.

      So you have an AI generating labyrinths to train an AI to detect labyrinths which are generated by another AI so that your original AI crawler doesn’t get lost.

      It’s gonna be AI all the way down.

      • @brucethemoose@lemmy.world
        link
        fedilink
        English
        0
        edit-2
        27 days ago

        LLMs tend to be really bad at detecting AI generated content. I can’t imagine specialized models are much better. For the crawler, it’s also exponentially more expensive and more human work, and must be replicated for every crawler since they’re so freaking secretive.

        I think the hosts win here.

      • @finitebanjo@lemmy.world
        link
        fedilink
        English
        027 days ago

        All the while each AI costs more power than a million human beings to run, and the world burns down around us.

        • @LainTrain@lemmy.dbzer0.com
          link
          fedilink
          English
          027 days ago

          The same way they justify cutting benefits for the disabled to balance budgets instead of putting taxes on the rich or just not giving them bailouts, they will justify cutting power to you before a data centre that’s 10 corporate AIs all fighting each other, unless we as a people stand up and actually demand change.

            • @LainTrain@lemmy.dbzer0.com
              link
              fedilink
              English
              027 days ago

              In my country blue is conservatives… But I agree with the sentiment! It worked for California, it can work for your country, let the Dems stop fearing they lose elections, give them comfortable margins and then massively support progressives who can bring in the good stuff, they won’t have a chance if the party core thinks the very future of elections is on the line, but if they think they’ll likely win anyway, you might just be able to push through a progressive candidate and end the Neoliberal decay.

              • @knexcar@lemmy.world
                link
                fedilink
                English
                026 days ago

                To be fair, California is kind of dysfunctional and constantly trips over its own regulations when trying to get anything built. For instance, needing excessive environmental impact review for things like trains that will obviously help the environment, or limiting ferry boats crossing the bay to protect the environment even though it likely results in more people driving instead.

            • @TronBronson@lemmy.world
              link
              fedilink
              English
              026 days ago

              Plenty of Democrats are voting to put trump nominees in office, plenty are voting on partisan spending bills. The CR vote should tip you off that any democrat is not better than any republican… half of them are complicit too. 10 Senate Dems just financed this authoritarian takeover.

              • @finitebanjo@lemmy.world
                link
                fedilink
                English
                026 days ago

                Not a single Democrat voted to confirm Hegseth and 3 Republicans also didnt but he still got confirmed.

                Every single Democrat was present and voted no for the Budget which passed the House and it still passed.

                Even if 10 dems voted not to shutdown government and enter congressional recess, the CR only exists because Republicans wrote it and won’t compromise.

                Any Democrat is Better than Any Republican.

                • @TronBronson@lemmy.world
                  link
                  fedilink
                  English
                  026 days ago

                  Scheumer rubberstamped autocracy by not filibustering the CR. I think anyone who protects the constitution and their constituents is better than someone who doesn’t. Not that any repuclicans fit the bill, but its not like we can just trust any old democrat. Look at Gavin Newsome sliding to the right to maintain power. That the kinda dems we want?

            • @BeanCounter781@lemm.ee
              link
              fedilink
              English
              025 days ago

              This is why we need a centrists political party. Solutions shouldn’t be a false dichotomy.

              And we shouldn’t downvote people into oblivion. Take my charitable upvote.

              • @finitebanjo@lemmy.world
                link
                fedilink
                English
                025 days ago

                That will require reform of campaign finance laws and progressive reform for elections, both of which are highly partisan issues.

                • @BeanCounter781@lemm.ee
                  link
                  fedilink
                  English
                  025 days ago

                  I bet there are corporations that want regulatory stability over political football. If someone could figure out how to tap that with Super PACs they could capture funding. Probably easier to do in local elections where on party or another has failed to put up a candidate for a judge.

                  I see one party races in Texas for justice of the peace and for judges. The Dems have no viable candidates in some jurisdictions because no one wants a democrat or to be labeled as one. But maybe a centrist could brand themselves as the anti democratic alternative to republicans.

          • @BeanCounter781@lemm.ee
            link
            fedilink
            English
            025 days ago

            In Texas 80% of our water usage is corporate. But when the lakes are low during a drought they tell homeowners to reduce water the grass. Nobody tells the corporations to throw away less water.

            AI will be allowed to use as much energy as it wants. It will even remind people to turn off the lights in a room not being occupied while wasting energy to monitor everyone’s power usage.

        • @Fluke@lemm.ee
          link
          fedilink
          English
          026 days ago

          This is the great filter.

          Why isn’t there detectable life out there? They all do the same thing we’re doing. Undone by greed.

  • @AnthropomorphicCat@lemmy.world
    link
    fedilink
    English
    027 days ago

    So the world is now wasting energy and resources to generate AI content in order to combat AI crawlers, by making them waste more energy and resources. Great! 👍

    • @brucethemoose@lemmy.world
      link
      fedilink
      English
      027 days ago

      The energy cost of inference is overstated. Small models, or “sparse” models like Deepseek are not that expensive to run. Training is a one-time cost that still pales in comparison to industrial processes.

      Basically, only Altman wants it to be cost prohibitive so he can have a monopoly. Also, he’s full of shit.

    • @Slaxis@discuss.tchncs.de
      link
      fedilink
      English
      025 days ago

      The problem is, how? I can set it up on my own computer using open source models and some of my own code. It’s really rough to regulate that.

  • @oldfart@lemm.ee
    link
    fedilink
    English
    027 days ago

    So the web is a corporate war zone now and you can choose feudal protection or being attacked from all sides. What a time to be alive.

    • @theparadox@lemmy.world
      link
      fedilink
      English
      027 days ago

      There is also the corpo verified id route. In order to avoid the onslaught of AI bots and all that comes with them you’ll need to sacrifice freedom, anonymity, and privacy like a good little peasant to prove you aren’t a bot… and so will everyone else. You’ll likely be forced to deal with whatever AI bots are forced upon you while within the walls but better an enemy you know I guess?