splendoruraniumEnglish · edit-23 days agoLocal Voiceover/Audiobook generationplus-squaremessage-squaremessage-square6linkfedilinkarrow-up122arrow-down10
arrow-up122arrow-down1message-squareLocal Voiceover/Audiobook generationplus-squaresplendoruraniumEnglish · edit-23 days agomessage-square6linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-25 days agoMistralAI releases Magistral, their first official reasoning models. magistral small 2506 released under apache 2.0 license!plus-squaremistral.aiexternal-linkmessage-square4linkfedilinkarrow-up131arrow-down13
arrow-up128arrow-down1external-linkMistralAI releases Magistral, their first official reasoning models. magistral small 2506 released under apache 2.0 license!plus-squaremistral.aiSmokeyDope@lemmy.worldMEnglish · edit-25 days agomessage-square4linkfedilink
10001110101@lemm.eeEnglish · 6 days agoCurrent best local models for tool use?plus-squaremessage-squaremessage-square6linkfedilinkarrow-up112arrow-down11
arrow-up111arrow-down1message-squareCurrent best local models for tool use?plus-square10001110101@lemm.eeEnglish · 6 days agomessage-square6linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-28 days agoUpdated guidelines for c/LocaLLama (new rules)plus-squaremessage-squaremessage-square9linkfedilinkarrow-up127arrow-down10
arrow-up127arrow-down1message-squareUpdated guidelines for c/LocaLLama (new rules)plus-squareSmokeyDope@lemmy.worldMEnglish · edit-28 days agomessage-square9linkfedilink
pebbles@sh.itjust.worksEnglish · 7 days agoI'm excited for dots.llm (142BA14B)!plus-squaregithub.comexternal-linkmessage-square3linkfedilinkarrow-up112arrow-down10
arrow-up112arrow-down1external-linkI'm excited for dots.llm (142BA14B)!plus-squaregithub.compebbles@sh.itjust.worksEnglish · 7 days agomessage-square3linkfedilink
HumanPerson@sh.itjust.worksEnglish · edit-28 days agoWhat to Integrate With My AIplus-squaremessage-squaremessage-square7linkfedilinkarrow-up118arrow-down13
arrow-up115arrow-down1message-squareWhat to Integrate With My AIplus-squareHumanPerson@sh.itjust.worksEnglish · edit-28 days agomessage-square7linkfedilink
ikt@aussie.zoneEnglish · 9 days agoAMD’s Untether AI Deal - Bad Signs for GPU-Driven AI trainingplus-squaresemiconductorsinsight.comexternal-linkmessage-square15linkfedilinkarrow-up135arrow-down10
arrow-up135arrow-down1external-linkAMD’s Untether AI Deal - Bad Signs for GPU-Driven AI trainingplus-squaresemiconductorsinsight.comikt@aussie.zoneEnglish · 9 days agomessage-square15linkfedilink
ikt@aussie.zoneEnglish · edit-212 days agoMy AI Skeptic Friends Are All Nutsplus-squarenews.ycombinator.comexternal-linkmessage-square15linkfedilinkarrow-up123arrow-down113
arrow-up110arrow-down1external-linkMy AI Skeptic Friends Are All Nutsplus-squarenews.ycombinator.comikt@aussie.zoneEnglish · edit-212 days agomessage-square15linkfedilink
ThreeJawedChuck@sh.itjust.worksEnglish · 16 days agoNoob experience using local LLM as a D&D style DM.plus-squaremessage-squaremessage-square17linkfedilinkarrow-up127arrow-down14
arrow-up123arrow-down1message-squareNoob experience using local LLM as a D&D style DM.plus-squareThreeJawedChuck@sh.itjust.worksEnglish · 16 days agomessage-square17linkfedilink
ThreeJawedChuck@sh.itjust.worksEnglish · 16 days agoDon't overlook llama.cpp's rpc-server feature.plus-squaremessage-squaremessage-square6linkfedilinkarrow-up119arrow-down10
arrow-up119arrow-down1message-squareDon't overlook llama.cpp's rpc-server feature.plus-squareThreeJawedChuck@sh.itjust.worksEnglish · 16 days agomessage-square6linkfedilink
thickertoofan@lemm.eeEnglish · 16 days agoLLMs and their efficiency, can they really replace humans?plus-squarearxiv.orgexternal-linkmessage-square8linkfedilinkarrow-up112arrow-down11
arrow-up111arrow-down1external-linkLLMs and their efficiency, can they really replace humans?plus-squarearxiv.orgthickertoofan@lemm.eeEnglish · 16 days agomessage-square8linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-218 days agoDeepSeek just released updated r1 models with 'deeper and more complex reasoning patterns'. Includes a r1 distilled qwen3 8b model boasting "10% improved performance" over originalplus-squarehuggingface.coexternal-linkmessage-square8linkfedilinkarrow-up125arrow-down12
arrow-up123arrow-down1external-linkDeepSeek just released updated r1 models with 'deeper and more complex reasoning patterns'. Includes a r1 distilled qwen3 8b model boasting "10% improved performance" over originalplus-squarehuggingface.coSmokeyDope@lemmy.worldMEnglish · edit-218 days agomessage-square8linkfedilink
suoko@feddit.itEnglish · 19 days agoA gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally on your phone. APKplus-squaregithub.comexternal-linkmessage-square1linkfedilinkarrow-up115arrow-down12
arrow-up113arrow-down1external-linkA gallery that showcases on-device ML/GenAI use cases and allows people to try and use models locally on your phone. APKplus-squaregithub.comsuoko@feddit.itEnglish · 19 days agomessage-square1linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-220 days agoUsing local model with basic RAG to help reference rules when playing table top gameplus-squareimagemessage-square3linkfedilinkarrow-up125arrow-down10
arrow-up125arrow-down1imageUsing local model with basic RAG to help reference rules when playing table top gameplus-squareSmokeyDope@lemmy.worldMEnglish · edit-220 days agomessage-square3linkfedilink
ikt@aussie.zoneEnglish · 21 days agoHow Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencearxiv.orgexternal-linkmessage-square16linkfedilinkarrow-up122arrow-down13
arrow-up119arrow-down1external-linkHow Hungry is AI? Benchmarking Energy, Water, and Carbon Footprint of LLM Inferencearxiv.orgikt@aussie.zoneEnglish · 21 days agomessage-square16linkfedilink
SmokeyDope@lemmy.worldMEnglish · edit-222 days agoHas your local thinking model had an 'Aha!' moment similar to the one in Deepeek R1 papers?plus-squareimagemessage-square4linkfedilinkarrow-up112arrow-down10
arrow-up112arrow-down1imageHas your local thinking model had an 'Aha!' moment similar to the one in Deepeek R1 papers?plus-squareSmokeyDope@lemmy.worldMEnglish · edit-222 days agomessage-square4linkfedilink
ikt@aussie.zoneEnglish · edit-223 days agomistralai/Devstral-Small-2505 · Hugging Faceplus-squarehuggingface.coexternal-linkmessage-square0linkfedilinkarrow-up120arrow-down11
arrow-up119arrow-down1external-linkmistralai/Devstral-Small-2505 · Hugging Faceplus-squarehuggingface.coikt@aussie.zoneEnglish · edit-223 days agomessage-square0linkfedilink
pebbles@sh.itjust.worksEnglish · 25 days agoI don't want them to, but Snapchat would have a great dataset to make an actually funny LLM.plus-squaremessage-squaremessage-square2linkfedilinkarrow-up17arrow-down14
arrow-up13arrow-down1message-squareI don't want them to, but Snapchat would have a great dataset to make an actually funny LLM.plus-squarepebbles@sh.itjust.worksEnglish · 25 days agomessage-square2linkfedilink
ikt@aussie.zoneEnglish · edit-226 days agoAnnouncing Gemma 3n preview: powerful, efficient, mobile-first AIplus-squaredevelopers.googleblog.comexternal-linkmessage-square2linkfedilinkarrow-up110arrow-down10
arrow-up110arrow-down1external-linkAnnouncing Gemma 3n preview: powerful, efficient, mobile-first AIplus-squaredevelopers.googleblog.comikt@aussie.zoneEnglish · edit-226 days agomessage-square2linkfedilink
Mechanize@feddit.itEnglish · 26 days ago[Guide] Arch (btw), ROCm (AMD), docker (podman), llama.cpp (server) setupplus-squaremessage-squaremessage-square5linkfedilinkarrow-up129arrow-down10
arrow-up129arrow-down1message-square[Guide] Arch (btw), ROCm (AMD), docker (podman), llama.cpp (server) setupplus-squareMechanize@feddit.itEnglish · 26 days agomessage-square5linkfedilink
