• 1 Post
  • 24 Comments
Joined 3 months ago
cake
Cake day: March 31st, 2025

help-circle

  • Those are some good nuances that definitely require a nuanced response and forced me to refine my thinking, thank you! I’m actually not claiming that the brain is the sole boundary of the real me, rather it is the majority of me, but my body is a contributor. The real me does change as my body changes, just in less meaningful ways. Likewise some changes in the brain change the real me more than others. However, regardless of what constitutes the real me or not, (and believe me, the philosophical rabbit hole there is one I love to explore), in this case I’m really just talking about the straightforward immediate implications of a brain implant on my privacy. An arm implant would also be quite bad in this regard, but a brain implant is clearly worse.

    There have already been systems that can display very rough, garbled images of what people are thinking of. I’m less worried about an implant that tells me what to do or controls me directly, and more worried about an implant that has a pretty accurate picture of my thoughts and reports it to authorities. It’s surely possible to build a system that can approximate positive or negative mood states, and in combination this is very dangerous. If the government can tell that I’m happy when I think about Luigi Mangione, then they can respond to that information however they want. Eventually, in the same way that I am conditioned by the panopticon to stop at stop sign, even in the middle of a desolate desert where I can see for miles around that there are no cars, no police, no cameras - no anything that could possibly make a difference to me running the stop sign - the system will similarly condition automatic compliance in thoughts themselves. That is, compliance is brought about not by any actual exertion of power or force, but merely by the omnipresent possibility of its exertion.

    (For this we only need moderately complex brain implants, not sophisticated ones that actually control us physiologically.)


  • I am not depressed, but I will never get a brain implant for any reason. The brain is the final frontier of privacy, it is the one place I am free. If that is taken away I am no longer truly autonomous, I am no longer truly myself.

    I understand this is how older generations feel about lots of things, like smartphones, which I am writing this from, and I understand how stupid it sounds to say “but this is different!”, but like… really. This is different. Whatever scale smartphones, drivers licenses, personalized ads, the internet, smart home speakers… whatever scale all these things lie on in terms of “panopticon-ness”, a brain implant is so exponentially further along that scale as to make all the others vanish to nothingness. You can’t top a brain implant. A brain implant is a fundamentally unspeakable horror which would inevitably be used to subjugate entire peoples in a way so systematically flawless as to be almost irreversible.

    This is how it starts. First it will be used for undeniable goods, curing depression, psychological ailments, anxiety, and so on. Next thing you know it’ll be an optional way to pay your check at restaurants, file your taxes, read a recipe - convenience. Then it will be the main way to do those things, and then suddenly it will be the only way to do those things. And once you have no choice but to use a brain implant to function in society, you’ll have no choice but to accept “thought analytics” being reported to your government and corporations. No benefit is worth a brain implant, don’t even think about it (but luckily, I can’t tell if you do).





  • I think there is a substantial difference though. Meat processing is done in a measured, considered way for a benefit (meat) that cannot be obtained without killing the animal. It is done in isolated facilities away from people who find the process disturbing. Just because people find something gross doesn’t mean it shouldn’t be done - we have sewage maintenance done out of the public eye too - but it does maybe mean it should be done where people don’t have to see it. The only benefit this man gets from killing the animal is some sort of “revenge”. But this is in principle completely contradictory to meat processing, where animals are seen as less capable of higher order experiences and therefore more acceptable to kill. To seek revenge, you would need to be assigning more higher order experience to the seagull than we typically see it as having. You have to see the seagull as selfish, stealing, criminal, rude, etc., even though in reality a more reasonable person understands that it’s just an animal looking for food. Meat processing is not done out of some emotional vendetta against the animals, rather it is the cold detachment of it that is exactly what makes it acceptable. Can you imagine if we killed the same amount of chickens every day, not to eat them, but just because we hate them? This is much more horrifying! Because that would mean we think chickens are having complex enough inner experiences to warrant hatred, yet still we kill them.

    Meat processing maybe isn’t great, but it’s still much better than this seagull killer. It isn’t impulsive, it isn’t disproportionate in response to the situation, it acknowledges and conceals its own horrors; thereby paying respect to important social codes. The actions of this man, though, disregarded the well-being of children and others around him, in an impulsive and disproportionate response - your average meat-eater is indeed better than that, I think. When I have a craving for some meat, I don’t drag a calf down to the nearest playground, cut it in half and spray blood over the children, and proceed to mock the calf’s weakness and inferiority as I beat it to tenderize it before consumption. I just want some food, dude. But what’s this guy’s beef? It’s not beef, and it’s not even seagull meat, but rather some frightening notion of swift and decisive revenge, which reveals that he is just waiting for any excuse to get away with brutalizing things around him.



  • Yeah very true! It’s just too bad that then it wouldn’t be a core/universal feature, but I agree it makes the most sense on the client. I just wish it was possible to make it more universal, since this seems like a feature that would be useful to average users, but selecting clients based on these features seem more like a power-user level of concern. I suppose that would just be a matter of clients all copying useful features from each other if it gets popular.





  • Sorry, I can see why my original post was confusing, but I think you’ve misunderstood me. I’m not claiming that I know the way humans reason. In fact you and I are on total agreement that it is unscientific to assume hypotheses without evidence. This is exactly what I am saying is the mistake in the statement “AI doesn’t actually reason, it just follows patterns”. That is unscientific if we don’t know whether or “actually reasoning” consists of following patterns, or something else. As far as I know, the jury is out on the fundamental nature of how human reasoning works. It’s my personal, subjective feeling that human reasoning works by following patterns. But I’m not saying “AI does actually reason like humans because it follows patterns like we do”. Again, I see how what I said could have come off that way. What I mean more precisely is:

    It’s not clear whether AI’s pattern-following techniques are the same as human reasoning, because we aren’t clear on how human reasoning works. My intuition tells me that humans doing pattern following seems equally as valid of an initial guess as humans not doing pattern following, so shouldn’t we have studies to back up the direction we lean in one way or the other?

    I think you and I are in agreement, we’re upholding the same principle but in different directions.


  • But for something like solving a Towers of Hanoi puzzle, which is what this study is about, we’re not looking for emotional judgements - we’re trying to evaluate the logical reasoning capabilities. A sociopath would be equally capable of solving logic puzzles compared to a non-sociopath. In fact, simple computer programs do a great job of solving these puzzles, and they certainly have nothing like emotions. So I’m not sure that emotions have much relevance to the topic of AI or human reasoning and problem solving, at least not this particular aspect of it.

    As for analogizing LLMs to sociopaths, I think that’s a bit odd too. The reason why we (stereotypically) find sociopathy concerning is that a person has their own desires which, in combination with a disinterest in others’ feelings, incentivizes them to be deceitful or harmful in some scenarios. But LLMs are largely designed specifically as servile, having no will or desires of their own. If people find it concerning that LLMs imitate emotions, then I think we’re giving them far too much credit as sentient autonomous beings - and this is coming from someone who thinks they think in the same way we do! The think like we do, IMO, but they lack a lot of the other subsystems that are necessary for an entity to function in a way that can be considered as autonomous/having free will/desires of its own choosing, etc.








  • Hm, this is interesting. I only have a passing understanding of control theory, but couldn’t a positive feedback loop indeed be good when the output is always desirable in increased quantities? A positive feedback loop doesn’t necessarily lead to instability, like you said. So maybe this is just me actually-ing your actually, lol.

    As for “more optimal”, oof, I say that a lot so maybe I’m biased. When I say that I’m thinking like a percentage. If optimal is X, then 80% of X is indeed more of the optimal amount than 20% of X. Yes, optimality is a point, but “more optimal” just seems like shorthand for “closer to optimal”. Or maybe I should just start saying that?

    This reminds me of a professor I had who hates when people say something is “growing exponentially”, since he argued the exponent could be 1, or fractional, or negative. It’s a technically correct distinction, but the thing is that people who use that term to describe something growing like x^2, are not even wrong that it’s exponential. I feel like when it comes to this type of phrasing, it’s fine not to deal with edge cases, because being specific actually makes what is said more confusing.

    “I’m in a negative feedback loop with respect to my laziness which will soon stabilize with me continually going to the gym daily, which is closer to optimal than before. As a result, my energy levels are going to increase exponentially, where the value of the exponent is greater than 1!”

    Hmm. Now that I say it that doesn’t seem that crazy. Although I do still think some common “default settings” don’t do any harm.