• 1 Post
  • 124 Comments
Joined 2 years ago
cake
Cake day: July 22nd, 2023

help-circle
  • No that’s impossible with your voice even for those slow speeds back then. But one could implement a similar system that converts sound to data/images if you invent you own modulation depending on how precise you can make sounds. If you are totally ungifted with your voice like me, the simplest would probably be something like morse. If you have perfect pitch you could use many different frequencies and amplitudes and combine those (a bit like QAM but without phase modulation, because humans can’t control the phase with their vocal cords). The more different frequency-amplitude combinations you can make and the faster you can switch between them the faster you “manual” data transmission could be.

    Sounds actually pretty fun to play around with 🤣

    PS: I personally would drop amplitude modulation and only use different frequencies (FM) and only pick a few different values (maybe four? or eight - one octave cdefgabc’) with variable speed (decoding based on short pauses between notes) to be most reliable.

    PPS: what did you (and adhd) do to me 😅. Now I want to make something like that and have no time on my hands anyway.


  • The screaming was not only during handshake. The acoustic coupler you see in the image was making that “scream” all the time (that’s how the data was transmitted), so no noise, no communication/data.

    People got so used to the noise that some of them could even diagnose connection issues based on the sound the coupler made.

    When modems were updated they internally converted the data directly to electrical signals to be sent over the telephone via, without the audio indirection, but most modems had a built in speaker anyway that still played back the audio during handshake (on default settings) to allow users to hear/debug connection issues.

    Practically all modems from that time allowed you to turn off that noise - even during handshake.

    Over the years the need to “hear” the data went away.



  • I didn’t say they have no knowledge, quite the opposite. Here a quote from the comment you answered:

    LLMs are extremely knowledgeable (as in they “know” a lot) but are completely dumb.

    There is a subtle difference between intelligent and knowledgeable. LLM know a lot in that sense that they can remember a lot of things, but they are dumb in that sense that they are completely unable to draw conclusions and put that knowledge into action in any other means besides spitting out again what they once learned.

    That’s why LLMs can tell you a lot about about all different kinds of game theory about tic tac toe but can’t draw/win that game consistently.

    So knowing a lot and still being dumb is not a contradiction.



  • Coding isn’t special you are right, but it’s a thinking task and LLMs (including reasoning models) don’t know how to think. LLMs are knowledgeable because they remembered a lot of the data and patterns of the training data, but they didn’t learn to think from that. That’s why LLMs can’t replace humans.

    That does certainly not mean that software can’t be smarter than humans. It will and it’s just a matter of time, but to get there we likely have AGI first.

    To show you that LLMs can’t think, try to play ASCII tic tac toe (XXO) against all those models. They are completely dumb even though it “saw” the entire Wikipedia article on how xxo works during training, that it’s a solved game, different strategies and how to consistently draw - but still it can’t do it. It loses most games against my four year old niece and she doesn’t even play good/perfect xxo.

    I wouldn’t trust anything, which is claimed to do thinking tasks, that can’t even beat my niece in xxo, with writing firmware for cars or airplanes.

    LLMs are great if used like search engines or interactive versions of Wikipedia/Stack overflow. But they certainly can’t think. For now, but likely we’ll need different architectures for real thinking models than LLMs have.


  • wischi@programming.devtoProgrammer Humor@programming.devthe beautiful code
    link
    fedilink
    arrow-up
    1
    arrow-down
    1
    ·
    edit-2
    1 month ago

    I don’t see how that follows because I did point out in another comment that they are very useful if used like search engines or interactive stack overflow or Wikipedia.

    LLMs are extremely knowledgeable (as in they “know” a lot) but are completely dumb.

    If you want to anthropomorphise it, current LLMs are like a person that read the entire internet, remembered a lot of it, but still is too stupid to win/draw tic tac toe.

    So there is value in LLMs, if you use them for their knowledge.



  • I can’t speak for Lemmy but I’m personally not against LLMs and also use them on a regular basis. As Pennomi said (and I totally agree with that) LLMs are a tool and we should use that tool for things it’s good for. But “thinking” is not one of the things LLMs are good at. And software engineering requires a ton of thinking. Of course there are things (boilerplate, etc.) where no real thinking is required, but non-AI tools like code completion/intellisense, macros, code snippets/templates can help with that and never was I bottle-necked by my typing speed when writing software.

    It was always the time I needed to plan the structure of the software, design good and correct abstractions and the overall architecture. Exactly the things LLMs can’t do.

    Copilot even fails to stick to coding style from the same file, just because it saw a different style more often during training.




  • wischi@programming.devtoProgrammer Humor@programming.devthe beautiful code
    link
    fedilink
    arrow-up
    14
    arrow-down
    2
    ·
    edit-2
    1 month ago

    A drill press (or the inventors) don’t claim that it can do that, but with LLMs they claim to replace humans on a lot of thinking tasks. They even brag with test benchmarks, claim Bachelor, Master and Phd level intelligence, call them “reasoning” models, but still fail to beat my niece in tic tac toe, which by the way doesn’t have a PhD in anything 🤣

    LLMs are typically good in things that happened a lot during training. If you are writing software there certainly are things which the LLM saw a lot of during training. But this actually is the biggest problem, it will happily generate code that might look ok, even during PR review but might blow up in your face a few weeks later.

    If they can’t handle things they even saw during training (but sparsely, like tic tac toe) it wouldn’t be able to produce code you should use in production. I wouldn’t trust any junior dev that doesn’t set their O right next to the two Xs.


  • I don’t think it’s cherry picking. Why would I trust a tool with way more complex logic, when it can’t even prevent three crosses in a row? Writing pretty much any software that does more than render a few buttons typically requires a lot of planning and thinking and those models clearly don’t have the capability to plan and think when they lose tic tac toe games.



  • wischi@programming.devtoProgrammer Humor@programming.devthe beautiful code
    link
    fedilink
    arrow-up
    15
    arrow-down
    4
    ·
    edit-2
    1 month ago

    Practically all LLMs aren’t good for any logic. Try to play ASCII tic tac toe against it. All GPT models lost against my four year old niece and I wouldn’t trust her writing production code 🤣

    Once a single model (doesn’t have to be a LLM) can beat Stockfish in chess, AlphaGo in Go, my niece in tic tac toe and can one-shot (on the surface, scratch-pad allowed) a Rust program that compiles and works, than we can start thinking about replacing engineers.

    Just take a look at the dotnet runtime source code where Microsoft employees currently try to work with copilot, which writes PRs with errors like forgetting to add files to projects. Write code that doesn’t compile, fix symptoms instead of underlying problems, etc. (just take a look yourself).

    I don’t say that AI (especially AGI) can’t replace humans. It definitely can and will, it’s just a matter of time, but state of the Art LLMs are basically just extremely good “search engines” or interactive versions of “stack overflow” but not good enough to do real “thinking tasks”.



  • Stop using timezones? So every day would actually be two weekdays because at some random point in time it would switch date during the day. Let’s meet next Monday wouldn’t even specify a single day anymore in most countries. And there is no real benefit to stop using timezones, just downsides. Yes you’d know which time it is anywhere but you still wouldn’t know of they are awake or not and have to either look it up or remember it - the same you have to do now.