There’s a lot to cover here but I’ll try to touch on each point:

The key requirement is fast memory that can be addressed by your GPU, and ideally a lot of it - hence the insane cost of this hardware right now.

Remember that you need space for the model’s weights (think of this as its ‘knowledge base’) and the context window, which is basically the data needed for the LLM to keep track of your current conversation with it (effectively its short term memory).

With smaller pools of VRAM (8-16gb) you will have to compromise and either have a more capable model that will lose context quickly and start hallucinating, or a less capable model that can maintain a session for a bit longer but overall less ‘smart’.

For software - there are a couple of options for running the LLM itself, Llama.cpp is one of the more popular tools and is the one that I use. It has a web UI with the usual chat interface, and also exposes an API that you can plug other tools (e.g. opencode) into, depending on your use case.

In terms of hardware recommendations, at 20GB+ of VRAM you do have a bit more headroom compared to more consumer grade GPUs, but to be honest the most cost effective way to get a shitload of VRAM is likely not with a dedicated GPU but actually using a system based around a recent APU.

I got a Minisforum MS-S1 last year for exactly this purpose. It is based on AMD’s Strix Halo platform which it has in common with the Framework Desktop and a couple of other similar devices.

It has 128gb of unified RAM which can be divided between the GPU and CPU however you like, so plenty of capacity for even fairly chunky models. It also uses a tiny amount of power compared to a more traditional system with a dedicated GPU, while also giving really reasonable performance for most AI workloads, more than enough for use in a homelab.

For cloud rental - doable, but pricing is a factor, and of course this will not actually be running locally.

Usability - manage your expectations, but overall for a lot of use cases and of course depending on the model that you are running and the resources you throw at it, it can be comparable with especially older iterations of ChatGPT, Gemini etc.

But remember, you are not a Google or an Anthropic and do not have an infinite pool of compute to throw at your model, nor do you have access to the specific models they are using.

I’m not sure if this is triggering either thalassophobia or submechanophobia but either way thanks I hate it

The main issue was a catastrophic failure of the VC_FRONT module which is one of the critical onboard computers that manages things like the 12v battery and low voltage power distribution (basically a “smart” fuse box). Without it the car is bricked and cannot be driven.

That took several weeks and some back and forth around the extended warranty to resolve, and then even after that module was replaced, on my first drive after the repair it went straight into limp mode and then spent another week at the service centre having that diagnosed.

During this time I decided it might be time to start looking for a new car, ended up selling it a few months later and took delivery of a new Polestar 2.

I’m not sure why anyone expected a new facelift would improve sales. It’s clear the overall decline is associated with Musk going full mask-off fascist, given this, driving around in a car that looks unlike any previous Model Y just makes it completely obvious that you knew this and decided to buy one anyway. If they want to bolster sales, maybe they should have kept producing the pre-facelifted versions for a while.

Full disclosure, I used to own a Model 3. I had it for 5 years and was generally very happy with it - it was a great daily driver, cost very little to run and maintain, and (aside from a few issues later in my ownership, which was one of the reasons I decided to sell it) in general it was very easy to live with.

There are clearly some very skilled engineers at Tesla who know how to build a great product. It is a shame their efforts are being undermined by a fascist lunatic with a narcissist complex.

Play stupid geopolitical games, win stupid prizes…

Sold my Model 3 yesterday. In a sane world, where Tesla is not run by a fascist, I would have considered getting another one as my ownership experience was generally pretty positive.

Instead, my new Polestar arrives next week.

I have owned VWs in the past and been pretty happy with them, however, the last reviews I’ve seen of the ID series indicated there were still some software and build quality issues to iron out.

The front runner for me at the moment is the Polestar 2 - the latest refresh has switched to RWD from FWD and upgraded the motor and battery, which is now 82kWh (about twice the capacity of my current car), and as a result now promises a real world range of somewhere between 200-300 miles depending on conditions - that should be enough to get me from my place to my parents in just about a single charge, whereas currently I need to stop twice en-route.

It’s not priced as competitively as a Model 3, but it’s probably its nearest competitor at the moment. I’ll have to make a call about what I want to do in the next month or two, as there is an upcoming change to vehicle tax over here which would make any EV in this price bracket make less financial sense if purchased after the cutoff date. (Tesla, predictably, have snuck their base level Model 3 in just below this threshold.)

Same, my Model 3 turns 5 years old soon. My original plan was to keep it for at least 8 years until the HV battery warranty expires - but, it has had its first major breakdown in the last 6 months, and although Tesla did manage to fix it I’m now window shopping for a replacement.

I don’t think I’ll get another Tesla, at least not as the situation stands. If Elon decided to sell it to some unobtrusive billionaire who is content to sit there, shut up and get even richer without meddling in geopolitics - and if they put back the fucking turn signal stalks - then maybe I would consider it, as otherwise the car is easy to live with, pleasant to drive and has acceptable range for what I need - and newer versions will go even further. But, there are a lot of alternatives on the market to consider now as well.

I am sure there is a team of very talented engineers at Tesla, and that they are the reason the company has been as successful as it is, despite the moron in charge of it.

That also means we can still use the expansion cards for the Framework in any other device that also has a USB-C port. Need an SD card reader or a 2.5Gb LAN adapter? Not a problem, I’ll just grab one from my laptop.

Not exactly crazy but just mysterious…this was at a software company I worked at many years ago. It was one of the developers in the team adjacent to ours who I worked with occasionally - nice enough person, really friendly and helpful, everyone seemed to get on with them really well and generally seemed like a pretty competent developer. Nothing to suggest any kind of gross misconduct was happening.

Anyway, we all went off to get lunch one day and came back to an email that this person no longer worked at the company, effective immediately. Never saw them again.

No idea what went down - but the culture at that place actually became pretty toxic after a while, which led to a few people (including me) quitting - so maybe they dodged a bullet.

Nah, the SWAT would have to arrest themselves.

You might have seen a quest, where if you stream a specific game to your friends you get a free in-game item, but these are not advertisements.

…

Advertising is the practice and techniques employed to bring attention to a product or service. Advertising aims to put a product or service in the spotlight in hopes of drawing it attention from consumers

I have no interest in streaming “quested” games, and whatever deal Discord has done with the developer to encourage users to engage with such games (and by extension the game’s microtransaction economy), and regardless of what they call it, is by definition an advertisement. If you can’t see that, then you are an ad campaign exec’s wet dream. Either that, or a troll.

Discord enshittification is well under way, just this week I have started seeing ads in the client just above the voice channel status in the bottom left. Cancelled my Nitro immediately, no point if they are going to shove ads in my face anyway.

Currently looking at alternatives, Revolt looks promising, and can be self hosted.

I grew one during lockdown, decided I liked it and kept it. I suspect I am not an anomaly in this.

For digital copies, they could bury this into the EULA and make it a requirement that you agree to it before you make your purchase (IIRC some storefronts do this already).

However for physical copies I suppose there could be a case made if the duration of support was not disclosed at the time of purchase (or it was not printed somewhere on the outside of the packaging).

I don’t have enough superlatives for it. I’m > 300 hours in between three characters, and I’m still finding new stuff to do. Even at full price, worth every penny. Also an amazing co-op experience - played through the whole campaign with a friend, we both agreed it’s probably one of the best games we’ve ever played, period.

It’s also the first game of this genre that I’ve played, off the back of this I also picked up BG1 & 2, and Neverwinter Nights, which I’m excited to try out to see what I missed out on back in the day.

To clarify, I used to do more miles (which is why I bought the car in the first place) but in the last year I’ve moved to working from home full-time. Still need the car for occasional errands and long trips, but obviously tyre wear is now not much of a problem.

However, given the massive amount of torque you can apply from standstill, if you drive like a hoon at all times then yes you can absolutely tear through them.

I own a Model 3 which I took delivery of back in 2020. As a car it’s actually been fine - no major issues, aside from a fault with the AC which was sorted under warranty. It’s been cheap to run, cheap to service (basically just tyres and other consumables like wiper blades), build quality seems perfectly fine and overall it’s generally pleasant to drive.

The charging network is also fantastic and by far the most reliable one, at least here in the UK. It’s now opening up to other makes of vehicles and I regularly see non-Teslas charging there.

Would I buy another one? With their current lineup, probably not. Nothing to do with Elon, douche nozzle though he certainly is. I mean, people still buy VWs (also great cars, used to own one too) and look who founded that company.

No, my issue is with the stupid cost cutting measures with removing critical physical controls from their latest cars. Moving the gear selector to the screen is absurd but at least you are (or should be) stationary when you are swiping the screen to change direction. Removing the indicator stalk however and replacing with buttons on a movable surface seems downright dangerous, especially in EU & UK where there are roundabouts everywhere and you need to be able to indicate while at half lock.

My Tesla is old enough to still have physical controls for all of those things and unless that changes I will not be getting another. I also just don’t do enough miles these days to justify a new car, I’ll just run this one into the ground.

I went from a manual to an EV. For an everyday use point of view there is just no comparison. Acceleration is effortless, start/stop traffic is no longer a nightmare, it’s quiet and refined. It is the ideal daily driver. Even on longer trips I no longer feel fatigued after driving for 4-5 hours (the enforced charging stop helps with that).

I personally would not go back to an ICE car in general, manual or not, for everyday use.

From an enthusiasts perspective, however, this is a different question. I wouldn’t rule out getting an ICE manual for fun/weekend use in the future - the kind of driving where you can actually enjoy the level of fine control and feedback that a manual gives you, rather than just wasting it in traffic. But it would have to be something pretty special.

I can’t speak from experience as I don’t own any Amazon devices, but I have read reports that it seems to work fine with the FireTV variant of Android.

The dev has only tested it against Chromecast with Google TV, with that said I’m using it on a Shield TV and a Shield Pro and it runs fine on both.

Google is already doing this with their default Android TV launcher. I tolerated their home screen ‘recommendations’ for a while as they occasionally highlighted something interesting to watch, but one day I switched on the TV and was greeted with a huge advert banner for a fucking watch on the home screen.

At that point I spent a few hours setting up FLauncher on all my ATV devices.