

Technically this shit isn’t even free (libre); atleast with corpo projects we can always fork them
Technically this shit isn’t even free (libre); atleast with corpo projects we can always fork them
I wish there was a GCC equivalent; but even if clang is a corpowhore project it’s atleast OSS
Well; companies used to get anti-trust laser canon’ed from orbit for less; but good luck with that in modern America
I know people like to hate on google, but google is actually like 3 companies in a trench coat.
They do highly valuable open source / open ecosystem work (I will say the chance of you indirectly using a google tool without knowing is over 90% now) and if the American government, a capitalist fascist government no less, gets their hands on it, we’re fucked
Not all of google is adsense or YouTube.
Inference costs are very, very low. You can run Mistral Small 24B finetunes that are better than GPT-4o and actually quite usable on your own local machine.
As for training costs, Meta’s LLAMA team displace their emissions with environmental programs, which is more green than 99.9% of any company making any product you use
TLDR; don’t use ClosedAI use Mistral or other foss projects
EDIT: I recommend cognitivecomputations Dolphin 3.0 Mistral Small R1 fine tune in particular. I’ve only used it for mathematical workloads in truth, but it has been exceedingly good at my tasks thus far. The training set and the model are both FOSS and uncensored. You’ll need a custom system prompt to activate the Chain of Thought reasoning, and you’ll need a comparatively low temperature to keep the model from creating logic loops for itself (0.1 - 0.4 range should be OK)
I’ve seen this stupidity all over lemmy. It’s like, people “group psychology” -ed this thought into the central culture of lemmy and refuse to budge.
It also doesn’t help that capitalists are using AI to take people’s jobs and also a misunderstanding of how image diffusion works had lead to the artistic line of people to also hate AI
Nobody likes to fucking listen. People like to be smug.
Oh fucking -please-
This place is genuinely more insufferable than Reddit. That is actually an achievement
Whatever dude, writhe in your own ignorance
Mozilla works mainly on LOCAL AI not this corporate trash like closedAI
I don’t fucking understand why Lemmy is permanently stuck in 2023 with AI
Using RAG (retrieval augmented generation) results in much lower, almost negligible confabulation rates
Guys PLEASE PLEASE PLEASE, download it all. The only way to preserve information is to copy it until 1 survives
I am just a poor fucking Iranian with shitass internet and no money to buy a NAS but I’ll try to hawk some part of it as much as I can
Based and GNU pilled
This is why I license my work under GPLv3+ (not going to link my codeberg/GH because I’m not fucking stupid)
download “LM Studio” and you can download models and run them through it
I recommend something like an older Mistral model (FOSS model) for beginners, then move on to Mistral Small 24B, QwQ 32B and the likes
Stalemate means Ukraine is fucked because a war of attrition potentially without US support doesn’t look good for them at all
Like, it’s amazing they managed to hold shit together for all this time and all, but damn they’re looking pretty fucked ngl
First, please answer, do you want everything FOSS or are you OK with a little bit of proprietary code because we can do both
Basically? Wartime propaganda
Ukraine has been doing individual, small wins like this and they obviously toot their horn when it happens
But on a large scale, Ukraine has been slowly losing ground
Fuck ClosedAI
I want everyone here to download an inference engine (use llama.cpp) and get on open source and open data AI RIGHT NOW!
OK you walk the walk I respect that
If you could be arsed, it’s entirely possible to train an LLM with 10 PCs using strictly open source and ethical datasets available on huggingface (although not something that is going to beat SOTA models)
That is a one time cost. Do you add the cost of every single watt of electricity ever generated, the cost of making factories, extracting materials and so on, to the “climate impact” of electrical rail service or EVs?
This is just hysteria, I’m going to be absolutely deadass with you
Also, you theoretically could make an LLM entirely on your own PC, it’d just take a bit of time
This is … Incredibly dumb.
The whole climate impact of AI is overstated a million times over. You can run a perfectly capable, GPT 4o destroying LLM on your own GPU right now. What is the difference between jonkling to vidya gaems or running an LLM for doing something productive for a fucking change?
The servers running the network you posted this shit over , the servers used to develop your favorite Gacha coom game, the servers used to deliver your shit ass Xitter feed, or your Netflix garbage, use more power than AI and LLMs are actually actively more productive than that shit
between lapse and zed I also decided on Lapse because it feels much more community-oriented than Zed; maybe you should look into that