So I signed up for a free month of their crap because I wanted to test if it solves novel variants of the river crossing puzzle.

Like this one:

You have a duck, a carrot, and a potato. You want to transport them across the river using a boat that can take yourself and up to 2 other items. If the duck is left unsupervised, it will run away.

Unsurprisingly, it does not:

https://g.co/gemini/share/a79dc80c5c6c

https://g.co/gemini/share/59b024d0908b

The only 2 new things seem to be that old variants are no longer novel, and that it is no longer limited to producing incorrect solutions - now it can also incorrectly claim that the solution is impossible.

I think chain of thought / reasoning is a fundamentally dishonest technology. At the end of the day, just like older LLMs it requires that someone solved a similar problem (either online or perhaps in a problem solution pair they generated if they do that to augment the training data).

But it outputs quasi reasoning to pretend that it is actually solving the problem live.

  • froztbyte@awful.systems
    link
    fedilink
    English
    arrow-up
    18
    ·
    5 days ago

    oh look it’s a loadbearing “just” in the wild. better hope you can shore that fucker up with some facts

    Try writing it out in ASCII

    my poster in christ, what in the fuck are you on about. stop prompting LLMs and go learn some things instead

    some other weird way that it hasn’t been specifically trained on and I bet it actually performs better

    “no no see, you just need to prompt it different. just prompt it different bro it’ll work bro I swear bro”

    god, every fucking time