Scaled dot-product attention (SDPA) computes its Attention by computing the similarity-scores of all image-tokens with all query tokens which results in O(N²·d) complexity. SSOG (Sum Of Separable Gaussians) instead learns a few Gaussian atoms for each head and only geometrically steers them based on the query token. Since the atoms can be factorized into a separable sum of Gaussians this leads to a reduced complexity of O(N·√N·d). Experiments show that SSOG clearly beats SDPA on small data (ci
In this commits, the 35B model was removed. Looks like it's confirming the 35B model won't get released. I think they need to be made aware how big the 35 moe is widely used. Think need to make noise on theyre X, huggingface and online places. If they dont know there's no need to release for people group who dont speak up.
You can print ascii art or just regular text. There also is a live stream. Edit: Because some people asked, it's open-source and available here: Edit: I put it to sleep now. Thanks again for the engagement, now I'm trying to put all the +700 messages on my wall. For some progress and higher definition pictures, check here:
Step 1) Find 16k ASAP before it goes up to 20k after a few months Step 2) Buy RTX PRO 6000 (MAXQ) Step 3) Remove RTX PRO 5000 in pcie_1 slot. Replace w/ RTX PRO 6000 Step 4) Buy a NVME to PCIE converter and HPPLEX 500W then move RTX PRO 5000 there Step 5) Power limit RTX PRO 6000, RTX 5090 and RTX PRO 4000 so it fits 1300W PSU ATX 3.1 4 GPUS RTX PRO 6000 (MAXQ) (96GB) gen5 x8 RTX 5090 (32GB) gen5 x8 RTX PRO 5000 (48GB) gen4 x4 RTX PRO 4000 (24GB) gen4 x4 =200GB VRAM !!! How to finish Step 1??
Your AI Slop Bores Me is brilliant in its simplicity. There are two tabs: human and LARP as an AI. On one side you enter a request. On the other, you submit an answer. But the important thing is that there's a human on both sides of the equation. Prompts can request a response as […]
My local inference build, with: ASUS WS C422 PRO/SE 10-core Xeon W-2255 64GB ECC RAM 64GB VRAM Pimped case with TurboLEDz indicating the frequencies of the 10 xeon cores. Running llama.cpp with SYCL back-end. Khronos-stack and MESA stack all built from git sources, running on Ubuntu 26.04
Recent advances in foundation models have enabled AI scientists to automate increasingly complete research workflows, from hypothesis generation and code execution to manuscript preparation. Yet workflow coverage alone does not provide access to the full evidence on which scientific discovery depends. Existing systems typically reason over text, code, labels, or precomputed summaries, leaving scientifically decisive spatial, temporal, cross-channel, and procedural relations unavailable to the ag
Not tested by me in any way :)
I was surprised by the fact that the qwen 3.8 27b download count is about 1 million (globally). This means that even on this subreddit, very few people have used 27b. At most 50k–100k active users, and once you break down the hardware distribution, 8GB, 16GB, 24GB, 32GB cards, Macs, whatever, it's probably under a thousand people who've actually run one on a 24GB+ card. And that figure still counts the tinkerers and casual image-gen gamers. Strip them out and the ones genuinely archieving produc
I've been working on replacing the software stack on a full-size second-generation Amazon Echo. The project is called LibreEcho, and at this point the device is running Linux 6.1 with enough of the original hardware working that it's starting to become genuinely useful rather than just an embedded Linux experiment. So far we have: - boot and recovery - A/B rollback - Wi-Fi - Bluetooth A2DP/AVRCP - AirPlay through the original speakers - LED control - local web administration - signed OTA updates
Large-scale manipulation data is essential for robot learning, yet collecting robot demonstrations remains expensive and difficult to scale. Meanwhile, abundant egocentric human manipulation videos provide rich behavioral experiences, but transferring them across embodiments remains challenging due to differences between human hands and robotic end-effectors. Recent advances in video world models offer a promising pathway to synthesize robot-centric manipulation videos from human observations, w