• 0 Posts
  • 65 Comments
Joined 2 years ago
cake
Cake day: June 12th, 2023

help-circle






  • HIPAA allows medical care providers to share your information with each other for the purposes of providing care (whether that sharing happens through MyChart or some other means). It does not require your consent (and this could be a good thing if, for example, you were taken to a hospital while unconscious). You simply may not have a lot of options for preventing this. As NOT_RICK mentioned, you could opt out of Care Everywhere at the psychiatric hospital to prevent them from sharing your information that way. You could also try to amend their record or request that they restrict access to your records, as per https://www.hhs.gov/hipaa/for-professionals/privacy/laws-regulations/index.html#general. All of those options would require interacting with the original psychiatric hospital, so if you’re unwilling to do that, I’m not aware that there are other options available.



  • One of my favorites is the “ladder paradox” in special relativity, although I originally learned is as a pole vaulter rather than a ladder:

    A pole vaulter is running carrying a pole that is 12m long at rest, holding it parallel to the ground. He is running at relativistic speed, such that lengths dilate by 50% (this would be (√3/2)c). And he runs through a barn that is 10m long that has open doors in the front and back.

    Imagine standing inside barn. The pole vaulter is running so fast that the length of the pole, in your frame of reference, has contracted to 6m. So while the pole is entirely inside the barn you press a button the briefly closes the doors, so that for just a moment the pole is entirely closed inside the barn.

    The question is, what does the pole vaulter see? For him, the pole has not contracted; instead the barn has. He’s running with a 12m pole through what, in his frame of reference, is a 5m barn. What happens when the doors shut? How can both the doors shut?

    I will admit that I have never used this thought experiment for any practical end.





  • Cherry-picking a couple of points I want to respond to together

    It is somewhat like a memory buffer but, there is no analysis being linguistics. Short-term memory in biological systems that we know have multi-sensory processing and analysis that occurs inline with “storing”. The chat session is more like RAM than short-term memory that we see in biological systems.

    It is also purely linguistic analysis without other inputs out understanding of abstract meaning. In vacuum, it’s a dead-end towards an AGI.

    I have trouble with this line of reasoning for a couple of reasons. First, it feels overly simplistic to me to write what LLMs do off as purely linguistic analysis. Language is the input and the output, by all means, but the same could be said in a case where you were communicating with a person over email, and I don’t think you’d say that that person wasn’t sentient. And the way that LLMs embed tokens into multidimensional space is, I think, very much analogous to how a person interprets the ideas behind words that they read.

    As a component of a system, it becomes much more promising.

    It sounds to me like you’re more strict about what you’d consider to be “the LLM” than I am; I tend to think of the whole system as the LLM. I feel like drawing lines around a specific part of the system is sort of like asking whether a particular piece of someone’s brain is sentient.

    Conversely, if the afflicted individual has already developed sufficiently to have abstract and synthetic thought, the inability to store long-term memory would not dampen their sentience.

    I’m not sure how to make a philosophical distinction between an amnesiac person with a sufficiently developed psyche, and an LLM with a sufficiently trained model. For now, at least, it just seems that the LLMs are not sufficiently complex to pass scrutiny compared to a person.


  • LLMs, fundamentally, are incapable of sentience as we know it based on studies of neurobiology

    Do you have an example I could check out? I’m curious how a study would show a process to be “fundamentally incapable” in this way.

    LLMs do not synthesize. They do not have persistent context.

    That seems like a really rigid way of putting it. LLMs do synthesize during their initial training. And they do have persistent context if you consider the way that “conversations” with an LLM are really just including all previous parts of the conversation in a new prompt. Isn’t this analagous to short term memory? Now suppose you were to take all of an LLM’s conversations throughout the day, and then retrain it overnight using those conversations as additional training data? There’s no technical reason that this can’t be done, although in practice it’s computationally expensive. Would you consider that LLM system to have persistent context?

    On the flip side, would you consider a person with anterograde amnesia, who is unable to form new memories, to lack sentience?



  • I don’t think it’s just a question of whether AGI can exist. I think AGI is possible, but I don’t think current LLMs can be considered sentient. But I’m also not sure how I’d draw a line between something that is sentient and something that isn’t (or something that “writes” rather than “generates”). That’s kinda why I asked in the first place. I think it’s too easy to say “this program is not sentient because we know that everything it does is just math; weights and values passing through layered matrices; it’s not real thought”. I haven’t heard any good answers to why numbers passing through matrices isn’t thought, but electrical charges passing through neurons is.