Best hardware for qwen 3.8
So I would like to run qwen 3. 8 27b locally for my ai agents, maybe even in parallel with other small LLMs (such as qwen3.
Older items first published newest-to-oldest across the feed — page 47 of 123.
So I would like to run qwen 3. 8 27b locally for my ai agents, maybe even in parallel with other small LLMs (such as qwen3.
Hi, let's suppose I am working on an algorithm that uses principles x to solve problems A and B. I already implemented a very basic algorithm that used principle "x mini" to just solve problem A,...
Hi all, I'm trying to reproduce a paper where the reported dataset statistics in Table 1 don't match what I get from the public raw data, even after implementing the preprocessing exactly as...
For years, the JVM has watched the AI revolution from the bench. Every model, AI framework, every breakthrough, built with/for Python.
Two months ago I announced I had found a new dynamic quant method called Voodoo Quant which was SOTA for the most aggressive quant levels on some smaller Qwen3. 5 GGUF models.
When Jensen Huang took a live call from Trump, some of us were more focused on the phone he used to take it.
When OpenAI CEO Sam Altman, Anthropic CEO Dario Amodei, Google DeepMind cofounder Demis Hassabis, and SpaceX head Elon Musk loosely agreed over the weekend to slow down AI development, skeptics...
Note - This is translated from the actual blog link right at the bottom. A few days ago, DeepSeek v4.
Now that the dust has settled a bit - here's a write-up on running Qwen3. 8-Flash-Next (125B-A6B MoE + 51B n-gram table) on relatively middle-tier hardware (RTX 4070 12GB + 64GB DDR5-5600 + Gen4...
Though Elon Musk and Sam Altman have supported Dario Amodei's calls to slow the pace of AI development, Jensen Huang seems to feel differently.
Dario Amodei kicked off a flood of statements over the past few days about AI safety by publishing a long essay titled "We Must Pace the Frontier" detailing why AI development should be slowed...
Glass Imaging was founded by a pair of former Apple engineers who previously led the team that developed Apple's Portrait Mode.
The release "Nvidia's RTX 5090 vanishes from online retail in the US — third-party sellers now demand as much as $9,500 for Nvidia's fastest GPU" ..
NVIDIA CEO Jensen Huang speaks during the G20 Innovation Ministerial in Chapel Hill, North Carolina, on September 2, 2026. (Photo by Matt RAMEY / AFP via Getty Images) | AFP via Getty Images...
Do you have something you'd like to share with the r/LocalLLaMA community. This is the place for it!
Christina Koch sits down with James Manyika, Google’s Senior Vice President of Research, Labs, Technology & Society.
A new paper (I'm not a coauthor BTW -- I just found it interesting) argues, basically, that RSI 1 is not on the horizon 2, because current (at the time the study was done) agents cannot do...
Hi, For single-GPU training, I’m using Hugging Face SFTTrainer with auto_find_batch_size=True, which automatically reduces the batch size after a CUDA OOM until it finds a batch size that works. ...
Apple’s long-delayed Siri overhaul is finally here with iOS 27, and it changes how useful the assistant feels day to day.
Thanks to the launch of iOS 27, Daydream's app now includes features that can turn saved outfit photos into shoppable results and search for products through Siri without opening the app.
The code of conduct lays out general principles that Microsoft AI models should uphold — supporting humans rather than replacing them, for instance, and accelerating human flourishing — as well as...
From initial testing it seems pretty solid so far. Asked it to compile the latest llama.
GitHub Copilot auto model selection now offers three tiers: efficiency, balance, and intelligence. Choose the tier that reflects how you want auto to weigh cost, quality, and response time for...
DevFest 2026 is back and here’s how you can connect with one of the more than 800 global events to build, secure, and scale in the agentic AI era.
Hi everybody, we post-trained Qwen 3. 8 27B to be more efficient by figuring out which tokens were linked to overthinking and penalizing them without "attacking" the reasoning length directly then...
I have created a VAE model using PyTorch on White Wine dataset. Basically, the main goal is to discover a brand-new white wine recipe.
If you're building an AI company, the question isn't whether foundation models will continue to evolve. It's whether your company will continue creating value as they do.
The notetaker offers a generous free plan, and that has resulted in over 400,000 monthly active users. The company said that over 1 million people have recorded meetings until now.
TLDR: I made "poor man’s" DSSM (Deep Structured Semantic Model) — the count-based translation table that can enrich the inverted index for full-text search. This trick can improve baseline BM25.
Microsoft is publishing a 37-page " humanist AI code of conduct " today, amid growing safety concerns over AI model progress. Anthropic CEO Dario Amodei called for a coordinated slow down of AI...