• 0 Posts
  • 126 Comments
Joined 1 year ago
cake
Cake day: June 30th, 2023

help-circle

  • If you ask it to make up nonsense and it does it then you can’t get angry lol. I normally use it to help analyse code or write sections of code, sometimes to teach me how certain functions or principles work - it’s incredibly good at that, I do need to verify it’s doing the right thing but I do that with my code too and I’m not always right either.

    As a research tool it’s great at taking a basic dumb description and pointing me to the right things to look for, especially for things with a lot of technical terms and obscure areas.

    And yes they can occasionally make mistakes or invent things but if you ask properly and verify what you’re told then it’s pretty reliable, far more so than a lot of humans I know.


  • Why would I rebut that? I’m simply arguing that they don’t need to be ‘intelligent’ to accurately determine the colour of the sky and that if you expect an intelligence to know the colour of the sky without ever seeing it then you’re being absurd.

    The way the comment I responded to was written makes no sense to reality and I addressed that.

    Again as I said in other comments you’re arguing that an LLM is not will smith in I Robot and or Scarlett Johansson playing the role of a usb stick but that’s not what anyone sane is suggesting.

    A fork isn’t great for eating soup, neither is a knife required but that doesn’t mean they’re not incredibly useful eating utensils.

    Try thinking of an LLM as a type of NLP or natural language processing tool which allows computers to use normal human text as input to perform a range of tasks. It’s hugely useful and unlocks a vast amount of potential but it’s not going to slap anyone for joking about it’s wife.


  • People do that too, actually we do it a lot more than we realise. Studies of memory for example have shown we create details that we expect to be there to fill in blanks and that we convince ourselves we remember them even when presented with evidence that refutes it.

    A lot of the newer implementations use more complex methods of fact verification, it’s not easy to explain but essentially it comes down to the weight you give different layers. GPT 5 is already training and likely to be out around October but even before that we’re seeing pipelines using LLM to code task based processes - an LLM is bad at chess but could easily install stockfish in a VM and beat you every time.


  • That’s only true on a very basic level, I understand that Turings maths is complex and unintuitive even more so than calculus but it’s a very established fact that relatively simple mathematical operations can have emergent properties when they interact to have far more complexity than initially expected.

    The same way the giraffe gets its spots the same way all the hardware of our brain is built, a strand of code is converted into physical structures that interact and result in more complex behaviours - the actual reality is just math, and that math is almost entirely just probability when you get down to it. We’re all just next word guessing machines.

    We don’t guess words like a Markov chain instead use a rather complex token system in our brain which then gets converted to words, LLMs do this too - that’s how they can learn about a subject in one language then explain it in another.

    Calling an LLM predictive text is a fundamental misunderstanding of reality, it’s somewhat true on a technical level but only when you understand that predicting the next word can be a hugely complex operation which is the fundamental math behind all human thought also.

    Plus they’re not really just predicting one word ahead anymore, they do structured generation much like how image generators do - first they get the higher level principles to a valid state then propagate down into structure and form before making word and grammar choices. You can manually change values in the different layers and see the output change, exploring the latent space like this makes it clear that it’s not simply guessing the next word but guessing the next word which will best fit into a required structure to express a desired point - I don’t know how other people are coming up with sentences but that feels a lot like what I do



  • I use LLMs to create things no human has likely ever said and it’s great at it, for example

    ‘while juggling chainsaws atop a unicycle made of marshmallows, I pondered the existential implications of the colour blue on a pineapples dream of becoming a unicorn’

    When I ask it to do the same using neologisms the output is even better, one of the words was exquimodal which I then asked for it to invent an etymology and it came up with one that combined excuistus and modial to define it as something beyond traditional measures which fits perfectly into the sentence it created.

    You can’t ask a parrot to invent words with meaning and use them in context, that’s a step beyond repetition - of course it’s not full dynamic self aware reasoning but it’s certainly not being a parrot


  • But also the people who seem to think we need a magic soul to perform useful work is way way too high.

    The main problem is Idiots seem to have watched one too many movies about robots with souls and gotten confused between real life and fantasy - especially shitty journalists way out their depth.

    This big gotcha ‘they don’t live upto the hype’ is 100% people who heard ‘ai’ and thought of bad Will Smith movies. LLMs absolutely live upto the actual sensible things people hoped and have exceeded those expectations, they’re also incredibly good at a huge range of very useful tasks which have traditionally been considered as requiring intelligence but they’re not magically able everything, of course they’re not that’s not how anyone actually involved in anything said they would work or expected them to work.




  • Conspiracy loons are wild on Facebook so I know what you mean, it’s so hard not to poke them occasionally. I like that the feed is so broken you just start getting the most insane things - block as many shitty pages as you can, like all the ones that post about how a guy with one leg drove a truck 19 hours a day to pay for his grandsons double cancer so that means poor people shouldn’t get hand outs. Then you start getting into the real weeds, oh and block the bot farm ones, you’ll recognise them they post pickles comics and no human could bring themselves to do that.

    When you start seeing Indian mechanical engineering memes like ‘how to design flat roof pitch common mistake 💯 slope degree 13.5° ☑️’ you’re getting close, you’ll start seeing things like ‘today it takes us two years to build a family home but ancient people could do it in three weeks’ the comments will be full of people who know every facet of whatever conspiracies the post is somehow referencing, which is normally a lot.

    ‘normies don’t realize how much easier life was when we had sonic resonance construction tools, if they did they’d rotate the sixth tower of Thomas Tesla to reopen the Elizabethan Toltec free energy portal’ and you think they’re just in their own world but everyone will be replying ‘yeah, robin Williams was killed because if you watch Mrs doubtfire at the same time as eyes wide shut the dialog syncs up and they warn biden will cover up the free energy machine’

    Except of course they can say it in 20,000 words if they feel like it.


  • Nothing to control the motor, nothing to control the heater, nothing to do timing or turn on and off water in and out?

    Even a really shitty one has door lock sensor, temperature sensor, turbidity sensor…

    Which means logic gates and transformers and things to shift voltages or control power flow.

    That’s before you even get into the logic of controlled programs or advanced features like weight based energy saving.

    A micro controller connected to a few relays and sensors could replace all the complex stuff and it’d cost far less, plus it could tell you which sensor is out. Plus it allows you to do otherwise very complex things like reprogram the current job while it’s running or to sync with other devices to limit max power load.



  • Yeah but washing machines either use a really simple micro controller or a whole load of really complex voltage based logic and control board electronics that even the guy who designed it couldn’t fix without a lot of writing notes and doing maths.

    There’s more to go wrong on an old washing machine and each control board was unique to the machine so tracking down a replacement is hard - a nice simple raspberry pi Pico you can flash over WiFi would make it so easy to switch out one heater for another without too much thought about impedance or upgrade the turbidity sensor without desoldering resistors.

    Plus it gives you infinite control over the program cycles allowing you to update up the best wash method for your detergent and lifestyle.

    Of course you can only do that with an open source one. I think it’s coming, year of the open source desktop kitchen work surface coming soon.


  • Ha, yeah sure, and trains will never go faster than 15mph.

    Natural language computing is huge at the moment because it’s a huge and significant development in computing - yes there are lots of shitty ai girlfriend apps and the same goes for generative ai there are lots of shitty art apps but human language interfaces aren’t going away nor are generative design tools.

    Even just the coding tools already available for free are a game changer, every single programmer I know and all the coding communities I’m in are using chatGPT regularly. When generative design gets into other areas such as cad and cam with natural language and problem solving (as in task based algorithms like the Go solver) then you’ll start to see the how ubiquitous and significant these technologies are.

    I understand why you’d look at the first commercial computers and think that no normal person will ever have a use for them but look at where we are now. The same is true for ai, current stuff is amazing when carefully worked and it takes a lot to get it all wired in but as the ecosystem of code grows and training sets become better established everything becomes much easier which enables more effective use cases.




  • Six year old, easy choice - do something mildly special for a kid that age and get on TV then when they ask you a question the answer is ‘well it was a dream i had, there was a pale horse riding towards us snd the horses name was Tod, it was going to run over everyone but an angel told me to call out to the faithful and save them…’

    Kid can’t even read and from an atheist family then starts quoting bible and making up complex visions and messages no child could ever create - plus very clear predictions that come perfectly true, knowledge of science before it’s discovered… Admit it, you’d get sucked into my cult.

    Could have a huge portion of the world believing, teach them the need for luxury gay space communism then when we’re all living in utopia be like ‘oh btw it was just a time travel prank lol’