I think some of the responses here, while they may be well-intentioned, are a bit off base because they are confusing the word ‘normal’ (which is what you are asking) with ‘recommended’. Is it normal for someone in your position who has had a lot of time alone due to your health challenges to want more social outlets and someone to talk to? Absolutely. Is it normal to see a character in a work of art (a video game, movie, show etc.) and become attached to them in some degree? I would say yes. Most of us have done that at one point or another. Is it normal to want to be able to communicate with this person to help provide a social outlet and a listening ear for someone in your situation? Again, I’d say probably yeah. Now, is it recommended to have an ‘AI’ like this as your primary social outlet or to see them as a real human friend or even romantic partner? That is much more questionable. But, personally, with the context you provided and the challenging situation you have been in I think the tendency towards doing this is still quite normal and understandable. I think you should strive to validate your feelings of loneliness and the understandable desire to assuage those feelings with what you have available to you in a challenging and socially isolating environment while still understanding that an ‘AI’ like this should not ideally be your primary social outlet and to strive to find more ways in the future to connect with real people who care and are interested in you (and vice versa). It may not seem like it right now, but they are out there! I wish you peace and a speedy recovery!
- 3 Posts
- 29 Comments
Looks like it now has Docling Content Extraction Support for RAG. Has anyone used Docling much?
Oh and I typically get 16-20 tok/s running a 32b model on Ollama using Open WebUI. Also I have experienced issues with 4-bit quantization for the K/V cache on some models myself so just FYI
It really depends on how you quantize the model and the K/V cache as well. This is a useful calculator. https://smcleod.net/vram-estimator/ I can comfortably fit most 32b models quantized to 4-bit (usually KVM or IQ4XS) on my 3090’s 24 GB of VRAM with a reasonable context size. If you’re going to be needing a much larger context window to input large documents etc then you’d need to go smaller with the model size (14b, 27b etc) or get a multi GPU set up or something with unified memory and a lot of ram (like the Mac Minis others are mentioning).
FrankLaskey@lemmy.mlto Technology@beehaw.org•Apple Maps May Soon Feature Ads, But Not Everyone's Onboard - gHacks Tech NewsEnglish1·4 months agoIs it possible to use StreetComplete on iOS?
FrankLaskey@lemmy.mlto Technology@lemmy.world•Perplexity open sources R1 1776, a version of the DeepSeek R1 model that CEO Aravind Srinivas says has been “post-trained to remove the China censorship”.English246·4 months agoI think we can all agree that modifications to these models which remove censorship and propaganda on behalf of one particular country or party is valuable for the sake of accuracy and impartiality, but reading some of the example responses for the new model I honestly find myself wondering if they haven’t gone a bit further than that by replacing some of the old non-responses and positive portrayals of China and the CPC with a highly critical perspective typified by western governments which are hostile to China (in particular the US). Even the name of the model certainly doesn’t make it sound like neutrality and accuracy is their primary aim here.
FrankLaskey@lemmy.mlto Technology@lemmy.world•Linux's Sole Wireless/WiFi Driver Maintainer Is Stepping Down - PhoronixEnglish1730·4 months agoI used to daily drive Ubuntu some years ago for work/personal use but have been back on Win 10 primarily for the last 4-5 years. I was considering trying to go back due to how much Windows sucks (despite some proprietary software only being available on it) but remembering the trouble I had with some networking/printer drivers and troubleshooting those issues and then seeing this article Is definitely making me reconsider…
FrankLaskey@lemmy.mlto News@lemmy.world•Chinese TikTok alternative RedNote could pose greater security risks, experts sayEnglish3913·5 months agoThe US government’s position on this can be summed up as “massive unaccountable US tech firms having all of your data and manipulating public opinion via their black box algorithms is okay, but Chinese companies doing that is a national security concern”. I call BS. The degree to which China is actually a US adversary is being massively overstated by the US government as they see this as a threat to US geopolitical hegemony and America’s ability to propagandize its own citizens. I have spent some time on RedNote (Xiaohongshu) and all I have seen is friendly cross-cultural exchange and discussion between these supposed ‘adversaries’.
FrankLaskey@lemmy.mlto Dull Men's Club@lemmy.world•The front-right tire of my car has 1 PSI higher pressure than the front-leftEnglish2·6 months agoI do care about tire wear but where I live the daily temperature regularly fluctuates by 25+ degrees which means the alert goes off almost all of the time because at least one tire is a degree different or too low at least a couple times a day. I’d have to fill my tires daily to avoid it to be honest. That seems a bit excessive to me.
First time I’ve seen y’all refer to each other as Beeple and I’m just dropping in here to say I love the term.
FrankLaskey@lemmy.mlto Dull Men's Club@lemmy.world•The front-right tire of my car has 1 PSI higher pressure than the front-leftEnglish3·6 months agoMy 2023 Toyota beeps and shows a warning every time I start the car if one of the tires is even 1 PSI lower than the others. It’s ridiculous.
FrankLaskey@lemmy.mlto Ask Lemmy@lemmy.world•Are there good uses for the blockchain?English22·7 months agoI believe alternative methods of validating blocks (series of transactions) such as Proof-of-stake, instead of the vastly more computation and energy-intensive proof-of-work that Bitcoin uses would largely address the issue of computational expense. There are other methods of increasing efficiency and speed of processing as well such as the use of more efficient ‘layer 2’ mechanisms for processing blocks. I remember reading about these and their implementation when I was researching cryptocurrencies out of curiosity. I believe Ethereum and some others have largely implemented these. The decentralized applications aspect of Eth was super interesting to me as well. Basically, you can program software to run on the blockchain which can make it nearly impossible to shut down by a centralized authority so long as the network is sufficiently decentralized. Some of the programmable money (so-called decentralized finance or ‘DeFi’) apps are pretty interesting as well in terms of enabling more people to utilize the more complex financial instruments that Wall Street firms have been using for years. Of course, a lot of that has turned into a Wild West of scams and ‘rug pulls’, not to mention massive targets for hackers who try to exploit vulnerabilities to steal millions so buyer beware for sure.
FrankLaskey@lemmy.mlto No Stupid Questions@lemmy.world•Is Lemmy an effective alternative to Reddit?English2901·8 months agoAs a ‘front page of the internet’ it has been a pretty great replacement for me as it’s where I go each day to just see what’s going on. However, due to the smaller size you do lose a lot of the activity in more niche communities and the sheer volume of posts/comments compared to Reddit. That’s the biggest downside. Still, you also lose the incessant ads/bad UI/UX decisions and ever accelerating late stage capitalism driven enshittification so that’s a big plus.
FrankLaskey@lemmy.mlto Ask Lemmy@lemmy.world•How do you sort your view on Lemmy, mostly?English1·10 months agoTend to start with top (day) for my subs and then switch to scaled once I get down to posts that are below 100 upvotes or so to see more posts from smaller communities that can’t make that ‘top’ cut.
FrankLaskey@lemmy.mlto News@lemmy.world•Some condom and lubricant brands contain alarming levels of PFAS – studyEnglish9·11 months agoThe guardian article only summarizes a limited amount of the product test information. See here for more products that were tested: https://www.mamavation.com/health/condoms-lubricants-pfas-forever-chemicals.html#Not_Our_Favorite_Condoms
FrankLaskey@lemmy.mlto World News@lemmy.world•G20 agrees to work to effectively tax the superrichEnglish1·11 months agoFuriously hammers X to doubt
FrankLaskey@lemmy.mlto News@lemmy.world•Sanders Pushes Harris to Pursue Agenda That 'Speaks to the Needs of the Working Class'.English181·11 months agoThis kind of technocratic approach can sound great and it’s always good to have policy and positions formed by those most knowledgeable in the relevant field. The problem is that the “experts” that will likely have her ear will be the ones that are vetted and approved by the power elite, the wealthiest in this country who will largely recommend what is best to protect their privilege, wealth and position.
FrankLaskey@lemmy.mlto Games@lemmy.world•Day 3 of posting a Daily Screenshot from the games I’ve been playing until I forget to post ScreenshotsEnglish1·11 months agoNot exactly what I was thinking of but still worth a sub!
Interesting project. Is it actually possible to track workouts using your phone or smartwatch without needing proprietary third-party apps like Strava or Garmin Connect though?