• 1 Post
  • 45 Comments
Joined 3 months ago
cake
Cake day: March 31st, 2025

help-circle
  • I think the problem is that certain views are much stronger indicators of someone being willing to eventually shove their views down your throat. If I was a big corporation shopping for, say, spam filter software, I’d rather sign a 3 year contract with a regular company than, for example, a company that is openly fundamentalist Christians. Why? Because the Christians are much more likely to start randomly making ridiculous changes that only make sense to other Christians, like spam filtering out anything with the word “Allah”, etc. They may not do that now, but I need to look further than just right now because I don’t want to get locked in to an ecosystem that is going to turn sour. Sure I can always switch, but why not just choose the one that has less risk of that at the onset?

    Now some beliefs that I disagree with are less like this than others. For instance if the devs disagreed with me about their favorite movies, I’m not going to take that into consideration, because that’s not the sort of thing or the sort of person who is likely to abuse their power to aid that cause. But transphobia? That is exactly the sort of thing that someone, as has been proven many times now, will sit on and downplay until they are given power and influence to act on it. Using their software contributes to their influence, especially in the browser world.

    Lastly, all other things equal, I’d rather use the product of a smart team full of smart people, than a dumb team full of dumb people. Transphobia is a dumb belief to have, it is a result of being unintelligent. Many smart people (and let’s be honest, especially developers) won’t want to work with someone like that. Whether you think that’s reasonable or not, it’s hard to deny. It’s certainly hard to picture any great trans developers wanting to contribute. So a lot of things add up, especially when looking a few links down the causal chain, to make it more than just a matter of whether they believe differently than I do.


  • Yeah same. I respect the huge amount of work it takes to make a suite like that, but… I’m lucky I’ve worked with Blender a lot to give me a good impression of open source software. If Libre was my first thing I experimented with in the open source world (and I think for many, many people it probably is), I would probably think “wow open source software is a joke, I guess you get what you pay for after all”. It really makes a horrible impression. I wonder why LibreOffice has so many usability pains vs Blender, despite the fact that both applications have very high demand. Maybe it’s just that LibreOffice seems really dull to contribute to?



  • Those are some good nuances that definitely require a nuanced response and forced me to refine my thinking, thank you! I’m actually not claiming that the brain is the sole boundary of the real me, rather it is the majority of me, but my body is a contributor. The real me does change as my body changes, just in less meaningful ways. Likewise some changes in the brain change the real me more than others. However, regardless of what constitutes the real me or not, (and believe me, the philosophical rabbit hole there is one I love to explore), in this case I’m really just talking about the straightforward immediate implications of a brain implant on my privacy. An arm implant would also be quite bad in this regard, but a brain implant is clearly worse.

    There have already been systems that can display very rough, garbled images of what people are thinking of. I’m less worried about an implant that tells me what to do or controls me directly, and more worried about an implant that has a pretty accurate picture of my thoughts and reports it to authorities. It’s surely possible to build a system that can approximate positive or negative mood states, and in combination this is very dangerous. If the government can tell that I’m happy when I think about Luigi Mangione, then they can respond to that information however they want. Eventually, in the same way that I am conditioned by the panopticon to stop at stop sign, even in the middle of a desolate desert where I can see for miles around that there are no cars, no police, no cameras - no anything that could possibly make a difference to me running the stop sign - the system will similarly condition automatic compliance in thoughts themselves. That is, compliance is brought about not by any actual exertion of power or force, but merely by the omnipresent possibility of its exertion.

    (For this we only need moderately complex brain implants, not sophisticated ones that actually control us physiologically.)


  • I am not depressed, but I will never get a brain implant for any reason. The brain is the final frontier of privacy, it is the one place I am free. If that is taken away I am no longer truly autonomous, I am no longer truly myself.

    I understand this is how older generations feel about lots of things, like smartphones, which I am writing this from, and I understand how stupid it sounds to say “but this is different!”, but like… really. This is different. Whatever scale smartphones, drivers licenses, personalized ads, the internet, smart home speakers… whatever scale all these things lie on in terms of “panopticon-ness”, a brain implant is so exponentially further along that scale as to make all the others vanish to nothingness. You can’t top a brain implant. A brain implant is a fundamentally unspeakable horror which would inevitably be used to subjugate entire peoples in a way so systematically flawless as to be almost irreversible.

    This is how it starts. First it will be used for undeniable goods, curing depression, psychological ailments, anxiety, and so on. Next thing you know it’ll be an optional way to pay your check at restaurants, file your taxes, read a recipe - convenience. Then it will be the main way to do those things, and then suddenly it will be the only way to do those things. And once you have no choice but to use a brain implant to function in society, you’ll have no choice but to accept “thought analytics” being reported to your government and corporations. No benefit is worth a brain implant, don’t even think about it (but luckily, I can’t tell if you do).








  • Sorry, I can see why my original post was confusing, but I think you’ve misunderstood me. I’m not claiming that I know the way humans reason. In fact you and I are on total agreement that it is unscientific to assume hypotheses without evidence. This is exactly what I am saying is the mistake in the statement “AI doesn’t actually reason, it just follows patterns”. That is unscientific if we don’t know whether or “actually reasoning” consists of following patterns, or something else. As far as I know, the jury is out on the fundamental nature of how human reasoning works. It’s my personal, subjective feeling that human reasoning works by following patterns. But I’m not saying “AI does actually reason like humans because it follows patterns like we do”. Again, I see how what I said could have come off that way. What I mean more precisely is:

    It’s not clear whether AI’s pattern-following techniques are the same as human reasoning, because we aren’t clear on how human reasoning works. My intuition tells me that humans doing pattern following seems equally as valid of an initial guess as humans not doing pattern following, so shouldn’t we have studies to back up the direction we lean in one way or the other?

    I think you and I are in agreement, we’re upholding the same principle but in different directions.


  • But for something like solving a Towers of Hanoi puzzle, which is what this study is about, we’re not looking for emotional judgements - we’re trying to evaluate the logical reasoning capabilities. A sociopath would be equally capable of solving logic puzzles compared to a non-sociopath. In fact, simple computer programs do a great job of solving these puzzles, and they certainly have nothing like emotions. So I’m not sure that emotions have much relevance to the topic of AI or human reasoning and problem solving, at least not this particular aspect of it.

    As for analogizing LLMs to sociopaths, I think that’s a bit odd too. The reason why we (stereotypically) find sociopathy concerning is that a person has their own desires which, in combination with a disinterest in others’ feelings, incentivizes them to be deceitful or harmful in some scenarios. But LLMs are largely designed specifically as servile, having no will or desires of their own. If people find it concerning that LLMs imitate emotions, then I think we’re giving them far too much credit as sentient autonomous beings - and this is coming from someone who thinks they think in the same way we do! The think like we do, IMO, but they lack a lot of the other subsystems that are necessary for an entity to function in a way that can be considered as autonomous/having free will/desires of its own choosing, etc.







  • Yeah, a lot of these things actually do make sense, just in a more precise way than even the people using them intend. Gravitational pull is also like this. Earth’s gravitational pull is not weak, it literally keeps everything on Earth tethered to it. More importantly, it happens as an intrinsic property of the Earth, the Earth doesn’t need to “try” to exert gravitational pull on things. Furthermore, gravitational pull attracts more mass which begets even more gravitational pull, like a snowball effect.

    So gravitational pull is not about the strength of the force, but the fact that it is natural, effortless, and often forms a positive feedback loop (borrowing from another comment here lol).

    So if I say someone at work has a lot of gravitational pull, I’m conveying that they do a good job of bringing other people into their area or work, that they naturally do it almost without even trying to, and that as their social influence grows, they just end up with even more social influence. It’s a really deep metaphor which is also physically accurate.


  • Hm, this is interesting. I only have a passing understanding of control theory, but couldn’t a positive feedback loop indeed be good when the output is always desirable in increased quantities? A positive feedback loop doesn’t necessarily lead to instability, like you said. So maybe this is just me actually-ing your actually, lol.

    As for “more optimal”, oof, I say that a lot so maybe I’m biased. When I say that I’m thinking like a percentage. If optimal is X, then 80% of X is indeed more of the optimal amount than 20% of X. Yes, optimality is a point, but “more optimal” just seems like shorthand for “closer to optimal”. Or maybe I should just start saying that?

    This reminds me of a professor I had who hates when people say something is “growing exponentially”, since he argued the exponent could be 1, or fractional, or negative. It’s a technically correct distinction, but the thing is that people who use that term to describe something growing like x^2, are not even wrong that it’s exponential. I feel like when it comes to this type of phrasing, it’s fine not to deal with edge cases, because being specific actually makes what is said more confusing.

    “I’m in a negative feedback loop with respect to my laziness which will soon stabilize with me continually going to the gym daily, which is closer to optimal than before. As a result, my energy levels are going to increase exponentially, where the value of the exponent is greater than 1!”

    Hmm. Now that I say it that doesn’t seem that crazy. Although I do still think some common “default settings” don’t do any harm.