tacking on a bunch of LLMs sure is a way to “make the web more human”.

  • Handles@leminal.space
    link
    fedilink
    English
    arrow-up
    37
    ·
    12 days ago

    I didn’t want to pay for their search engine before, and this garbage sure as hell isn’t going to change my mind.

  • hersh@literature.cafe
    link
    fedilink
    arrow-up
    10
    ·
    11 days ago

    I posted some of my experience with Kagi’s LLM features a few months ago here: https://literature.cafe/comment/6674957 . TL;DR: the summarizer and document discussion is fantastic, because it does not hallucinate. The search integration is as good as anyone else’s, but still nothing to write home about.

    The Kagi assistant isn’t new, by the way; I’ve been using it for almost a year now. It’s now out of beta and has an improved UI, but the core functionality seems mostly the same.

    As far as actual search goes, I don’t find it especially useful. It’s better than Bing Chat or whatever they call it now because it hallucinates less, but the core concept still needs work. It basically takes a few search results and feeds them into the LLM for a summary. That’s not useless, but it’s certainly not a game-changer. I typically want to check its references anyway, so it doesn’t really save me time in practice.

    Kagi’s search is primarily not LLM-based and I still find the results and features to be worth the price, after being increasingly frustrated with Google’s decay in recent years. I subscribed to the “Ultimate” Kagi plan specifically because I wanted access to all the premium language models, since subscribing to either ChatGPT or Claude would cost about the same as Kagi, while Kagi gives me access to both (plus Mistral and Gemini). So if you’re interested in playing around with the latest premium models, I still think Kagi’s Ultimate plan is a good deal.

    That said, I’ve been disappointed with the development of LLMs this year across the board, and I’m not convinced any of them are worth the money at this point. This isn’t so much a problem with Kagi as it is with all the LLM vendors. The models have gotten significantly worse for my use cases compared to last year, and I don’t quite understand why; I guess they are optimizing for benchmarks that simply don’t align with my needs. I had great success getting zsh or Python one-liners last year, for example, whereas now it always seems to give me wrong or incomplete answers.

    My biggest piece of advice when dealing with any LLM-based tools, including Kagi’s, is: don’t use it for anything you’re not able to validate and correct on your own. It’s just a time-saver, not a substitute for your own skills and knowledge.

  • lenninscjay@lemm.ee
    link
    fedilink
    English
    arrow-up
    3
    ·
    11 days ago

    I’ve used some of these features when I’m trying to skim many articles for my grad school work. It’s not terrible.

    There is a use case for this stuff. Especially in a search engine.

    Short of hosting your own LLM, Kagi is one of the few I’d hope can get it right and respect privacy. (So far unverified on the AI side tho)

      • Cenotaph@mander.xyz
        link
        fedilink
        English
        arrow-up
        3
        ·
        11 days ago

        Kagi actually does an interesting implementation for their search summary and while not perfect, it is miles better than the alternatives in my experience. It uses a combination of anthropic’s claude for language processing as well as incorporates wolfram alpha for stuff that needs numerical accuracy. Compared to google AI or copilot I’ve been seeing good results.

        While it isn’t perfect at summarizing, I’ve found their implementation to be “good enough”, and it can summarize pieces near instantly, which I think is the place where it actually becomes useful. Humans may be better, but I dont have the money or time to pay a human to summarize pages for me to see if they’re going to be useful to delve further into.

      • FaceDeer@fedia.io
        link
        fedilink
        arrow-up
        3
        ·
        11 days ago

        It’s often not a choice between an AI-generated summary and a human-generated one, though. It’s a choice between an AI-generated summary and no summary.

        • noodlejetski@lemm.eeOP
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          11 days ago

          so, no summary at all, or one that does shit job pointing out important bits or gets them wrong and therefore isn’t a proper summary? choices, choices.

  • Mesa@programming.dev
    link
    fedilink
    arrow-up
    1
    ·
    8 days ago

    Hot take: the web should not be more human.

    And I’m pretty progressive on technological matters. There should still be a clear separation, though.