I didn’t know that. I thought just one ROCM binary to install, run Ollama and that’s it. Thanks for the explanation

How do you back up your media?

Do you have any recommendations for running the Mistral small model? I’m very interested in it alongside CodeLlama, OogaBooga and others

Wait how does that work? How is 24GB enough for a 38B model?

The 7900XTX was $1000 when it launched, I wouldn’t mind it used either.

I don’t mind multiple GPUs but my motherboard doesn’t have 2+ electrically connected X16 slots. I could build a new homeserver (I’ve been thinking about it) but consumer platforms simply don’t have the PCIE lanes for 2 actual x16 slots. I’d have to go back to Broadwell Xeons for that, which are really power hungry. Oh well, I don’t think it matters considering how power hungry GPUs are now.

I am OK with either Nvidia or AMD especially if Ollama supports it. With that said I have heard that AMD takes some manual effort whilst Nvidia is easier. Depends on how difficult ROCM is

Thank you. Are 14B models the biggest you can run comfortably?

Do you have 2 PCIE X16 slots on your motherboard (speaking in terms of electrical connections)?

Rage-read until the third paragraph lol

I don’t know how PoW works but do you think that TOR and Dread’s PoW can be reused?

Honestly I have no idea how PoW works at all. I’m just happy to see the innovation in this space. With that said, people have raised the idea of using TOR’s PoW mechanism, or in my case, Dread’s PoW. I believe both of them work without JavaScript

Thank you for your comment. Your response had me thinking for a while, and yes I think you uncovered it: I had a theoretical idea without actually considering the practical outcome.

I do not have a 3-letter agency targeting me to my knowledge. I quickly realised that sending signals over VOIP is a bad idea, I won’t be doing that.

You are again correct: I run Debian as my daily driver, and it would be foolish to not consider my computer to have been compromised already. I have removed the built-in camera and microphone but I haven’t attempted to clean out Intel ME from my system.

All of this makes my question look pointless since there’s already so many attack vectors. In which case, I’d be interested in your opinion in physically cutting off attack vectors from an Android phone as an academic question.

Thank you for the wonderful comment.

Anubis without JavaScript is what I’m waiting for. I know that the Darknet forum Dread has a PoW system that doesn’t use JS (or maybe it does something else entirely and I completely missed it)

I don’t think you said anything unusual. I’m going to try and get to this stage myself. It’s pretty normal for people interested in digital privacy

The issue is cost. Purchasing a pixel just to keep it lying around for one app is a bit too expensive. I’ll just use my of phone instead

Dread has something that works without JS. Don’t know much about it though

I’m not putting it in a Faraday cage, just preventing it from listening and seeing anything. I’ll place it closer to my WAP if it needs it

It’s still the same problem no? If I can’t DeGoogle a phone then I don’t know what and how much data is being captured. Honestly I really liked the idea to just keep the desktop app running on a separate PC with headphones plugged in. I’m wondering if USB landline converters exist so I can have it ring when a call comes but then I can speak like when I’m wearing headphones.

Thank you for the suggestion though

Yes I realised that after I posted, sorry. Do you have any other ideas I could look at? I just want to keep my phone locked up and away from me when I’m in the house but still be able to talk to family over the chat apps they use (they are not very technically literate so Simplex is out of the question; it took a lot of convincing to get some of them in Signal)