today

Today

0:00 / 0:00
Nothing matches those filters.

Lead

31
Spotify's Xirp Runs 50 AI Agents At OnceCreator MagicResearchers can now reverse- engineer LLM prompts from output text with near-perfect accuracyGoogle Alert - Prompt EngineeringUS to exempt open-weight AI models from safety reviewsGoogle Alert - Artificial IntelligenceAI code-testing startup Blacksmith's valuation jumps almost 10x in less than a yearGoogle Alert - AIAI Music Generator Suno Strikes Licensing Deal With BMG as It Preps New Label-Backed ModelsGoogle Alert - AICohere's North Micro Vision Reads Full A4 Documents Without Losing DetailAlphaSignalCodeRabbit Raises $143 Million at $1.5 Billion Valuation and Introduces Agentic Change ...Google Alert - Agentic EngineeringThe Chinese AI Model Sending Shockwaves Through Silicon Valley and WashingtonGoogle Alert - AIGoogle's Gemini Hits 1 Billion Users and Adds 14 App ConnectionsAlphaSignalAnthropic's text watermarks signal new front in AI detection - AxiosGoogle Alert - AIAI Startup River AI Raises $1.1B to Build Personally Trainable AI Agents - AI InsiderGoogle Alert - Prompt EngineeringGoogle DeepMind's SL2T Doubles Sign Language AI Accuracy, Giving Deaf Users a VoiceAlphaSignalLFM2.5-VL-3B for Better and Faster Vision Capabilities for the EdgeHugging Face - BlogGoogle's Gemini app surges to 1 billion users - TechCrunchGoogle Alert - AIRiver AI Raises $1.1B in Funding - The SaaS NewsGoogle Alert - Prompt EngineeringLovable Hits $13.3B Valuation After 60 Million Apps Built Without CodeAlphaSignal😺 OpenAI, Claude, and Gemini's reasoning got crackedThe NeuronResearchers have successfully used AI to create brand new viruses - NPRGoogle Alert - AI EngineerCase thrown out after claimant caught using AI coaching in witness box - AFRGoogle Alert - Artificial IntelligenceAI helped solo professionals match two-person teams in a 776-person experiment ... - Silicon CanalsGoogle Alert - Prompt EngineeringThe Multilingual Quantization Tax: Structural Collapse and Typological Fragility in Edge SLMscs.CL updates on arXiv.orgWhen Chain-of-Thought Helps and When It Hurts: An Empirical Investigation of the Serial-Depth Bottleneck in LLM Reasoningcs.CL updates on arXiv.orgSimilarity Gates Approve Reversals: A Validity Audit of Embedding-Cosine Thresholds in Agent Systemscs.CL updates on arXiv.orgCracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extensioncs.CL updates on arXiv.orgLongitudinal benchmarking of artificial intelligence models for the differential diagnosis of ... - NatureGoogle Alert - Artificial IntelligenceAnt Group's Ling 3.0 Tiny Matches GPT-120B Intelligence With 15x Fewer ParametersAlphaSignalQwen3.8-2.4T-A95B Releasedr/LocalLLaMAHidden Reasoning from Claude and GPT are Decoded, and it is interestingr/LocalLLaMAAnthropic, OpenAI, Google, Meta, Microsoft, and Mistral all signed the EU Code of Practice on Transparency of AI-Generated Contentr/LocalLLaMA[AINews] How to steal a Reasoning TraceLatent.SpaceFLUX 3 Is Here β€” Everything You NEED to KnowElevenLabs

Video

5
14:10

Spotify's Xirp Runs 50 AI Agents At Once

Spotify quietly shipped a free Mac app called Xirp that runs up to 50 AI coding agents at once on the same codebase without them colliding. You can run Codex, Gemini, and Claude Code CLI side by side and hot-swap the agent mid-session while keeping all context. About 1,300 Spotify engineers used it internally before it went public. The catch: it's closed source, macOS only, needs a work email to sign up, and transcripts aren't scrubbed before upload.

Notes
Spotify Xirp β€” 50 concurrent coding agents (Creator Magic, YouTube, 2026-08-12)

What it is: Xirp is Spotify's coding-agent orchestration app β€” free, macOS-only, closed source. Up to 50 coding agents on one screen sharing one codebase "and none of them collide." Runs Claude Code CLI, Codex, and Gemini side by side. ~1,300 Spotify engineers used it internally before public release.

Onboarding (in order): join beta via link in description β†’ download Mac app, drag-drop to Applications β†’ sign in with a new "Spotify technology" account, not your Spotify account β†’ requires a work email (Gmail, Yahoo, Outlook rejected) β†’ pick a coding agent, enable session hooks, choose layout.

Key mechanics

  • Sessions run in tmux; installer checks for gh CLI and tmux. Quitting Xirp does not kill sessions β€” relaunch and reattach.
  • Session hooks are how Xirp detects a stuck agent; they can be customized per session.
  • Context/usage panel: shows token spend (demo shows a 1M-token total with Claude "Fable 5" at "Extra High effort"); token visibility even on subscription plans.
  • Hot-swap mid-task: dropdown swaps Claude Code β†’ Codex (demo shows "GPT 5.6 SOL" default) while preserving session context; agent proved it by summarizing prior work.
  • Model per session (e.g., Claude Opus instead of the top model).
  • Built-in web browser previews (demo: landing page for shooter game "Neon Strike" on localhost:8000), "open in terminal," "set editor" command in settings, fork session, stop agent mid-run, natural-selection toggle.
  • New Work Tree session = git worktree per agent, which is what prevents collisions; also "New terminal."
  • Shortcuts: ⌘G grid view (resizable panes, unlimited sessions until "Xirp complains"), ⌘K command palette (new session, rename), βŒ˜β‡§K switch active sessions.

Limitation the creator worked around: no API and no mobile notification β€” badges only show on-screen. He piped Xirp's Claude Code session hooks to a Zapier webhook β†’ Telegram bot, plus a Zapier Tables log (session ID, comments, computer name, timestamps). Claude Code edited his CLAUDE.md settings JSON to add a script + global hooks (prompted him to confirm what triggers: needs-action, session complete, sub-agent finish). Both pings returned success.

Stated caveats (creator's list):

"It's closed source, there is no repo, there is no license." (Backstage was open-sourced in 2020; Xirp was not.)
  • macOS only, no server deployment, no SSH into sessions, one app on one Mac.
  • Work email required; Gmail/Yahoo/Outlook can't sign up.
  • Transcripts are not redacted β€” "It doesn't scrub or redact credentials, personal data or sensitive info before upload."
  • "Most of the value is wired into portal" β€” something most users likely won't have access to.

Demo ran 18+ minutes; creator built a playable FPS with power-ups, but noted shooting felt imprecise ("maybe it's just I'm bad at this"). Verdict: "it's good, it's free," recommended for Mac + work email users; asks viewers to test how many agents break first.

Transcript · 13,266 chars
This is, I mean, absolutely amazing. This is like God mode for coding. Spotify just shipped the app that I've been building. It's called Xirp and it's free. 50 coding agents all at once on the same screen, same code base and none of them collide. You can use Codex, gemini, Claude code CLI, all side by side. 1300 Spotify engineers were using this before anyone outside actually knew it existed. My access came through. So watch this. I'll show you what it does, what it won't do, and the one thing they left out that took me about 10 minutes to fix. Get started. You need to go to the link down below in the description, click join the beta and then download it for Mac. File is downloaded. Simple drag and drop into applications. Okay, you get started right here with sign in 1. Quick gotcha that might get you straight away. It's not your Spotify account you're using to log in here. This is a brand new Spotify technology account. And by the way, it needs a work email. Email. So Gmail, Yahoo and Outlook are all out. You probably don't have a Spotify tech account. So click sign up, put in your email and chosen password. Now have a look at this. Let's get set up. It's really easy. You pick a coding agent, you enable session hooks and choose the layout. It's so simple. So I've got Claude Code and Codex available. I can also install the Gemini CLI as well if I want. Now, session hooks. This is very interesting. You should definitely enable these hooks. The switch is exactly how Xirp knows when an agent is stuck. And hold that thought, we'll return to it later. Choose your layout. I'll stick with the default. You've got shortcuts listed here as well. And click finish. Now look at this. This is zurb in its entirety. It's so small, so simple. It kind of reminds me of those Vibe coding apps from last year. I'm going to start really simple. I'm not even going to set anything else up. I just want to kick the tires on this. So I'm going to dream big and I'm going to say build a simple 3D shooting game that allows me to shoot different targets with a first person shoot. So I can actually make this as a project. I'm going to add it before I start and just put the path to my project. So the name of my project will be Xirp Demo. Click Add Start building right there. You'll see. I can also go into Claude plan mode. I won't do that for the moment, I'll build straight away and run in the background. I'll say yes, I trust the folder. And look at this, it goes straight into Claude Fable 5 with Extra High effort. It checks on install that you've got GitHub command line, the gh command installed and also tmux because it's essentially running these Claud code sessions and any other session inside a window. Here's something you should really see. I'm actually going to go down here. I'm going to quit Xirp completely. Look at that. Quit straight out of it. I'll relaunch it and I'm back here in Xirp. But watch this. Projects Xirp demo is there with one active session. When I go in and click to that active session, look, this is still running. So quitting ZURP does not quit my Claude code sessions, which is awesome. They're running in TMUX and in the background on my computer we can see the context window, which I think is really valuable. Look at this. We've got usage of our 1 million token total with Claude Fable 5. But Spotify have done the right thing here and given you visibility on every token you're spending, even if it's on your subscription plan. It's also got a built in web browser so we can actually test everything right here inside Xirp. You've also got the ability to open in terminal, set editor, command in settings, natural selection off and fork a session. Plus you can just stop the coding agent mid run if you want. I'm actually going to click here to start a new session. And look at this. It spins up a brand new Claude code session which I can maybe change the model. I don't need to use Fable 5 for everything. Let's go down to Opus and here I'm just going to say build a very simple landing page for my 3D shooter game. Make it very simple and straightforward, something I can immediately open as an HTML file in my browser. And because we're working in the same project, it will see the context of what my other agent is building over here and build that landing page for me. So all of my coding agents in one place, manageable on the left hand bar and I can see their status at any time. It's now running on localhost 8000. But look at this. Up by the web browser there is already the number one and it's recognized that this is now attached to what I've just created. Click it, open it and boom. Look, I've got a web browser with Neon Strike, the landing page for my awesome 3D shooter game. It's previewed right here inside Xirp. But here's the big shot. Change the agent mid session from Claude Code to Codex and keep going. Xirp keeps the session. The agent is completely swappable. We'll just close down that browser and up here I'll change from Claude Swap to Codex. And watch how smooth this is. Boom. Look at this. We've now got yes GPT 5.6 SOL default running with all the context of everything we've done and I'll prove it. Summarize in a very brief sentence or two what we've already done. It's working away. Note that this is OpenAI Codex. We built a self contained landing page for the 3D shooter game Neon Strike, added responsive animations and interactive effects and served it locally. I mean, that is mind blowing. That is one of the biggest problems solved. Claude Code, Codex, Gemini, whatever harness you're using to do your coding is now hot swappable with one dropdown. And this is why I got so excited about Buzz the last couple of weeks. The fact that you can create your own AI agents and swap whichever AI model you're using in the background with a click of a dropdown menu. And if you want to learn more Buzz, click the link down below. Join my community. There's a full 90 minute getting started with Buzz tutorial right there. I can hit Command G on my Mac and look at this. I've got one terminal window here, but I've got a grid view, so this is absolutely insane. With the grid view, I can spin up new sessions here and I can start really as many sessions as I like and get multiple different versions of Claude code all running in a box. And I can obviously resize these so I can see what's going on in each window. I can literally spin up sessions until Xirp complains. This is multiplayer coding right inside one app. We've also got Command K where we can open up the palette and run all the commands we'd like to like starting a new session, renaming sessions, shortcut there. And Command Shift K will allow us to switch between sessions that are active and running. Right now. This has been running for over 18 minutes and I'd kind of like to go and make a cup of coffee and know when my coding agent has completed. And with all these sessions down the side, I want to know if an agent gets stuck, asks me a question, or has finished doing its task. The badge is there, but it's lit up on A screen. And I have to be in front of my Mac to know about this. There's no API, nothing from Xirp that can reach my phone. And I've got maybe 14 agents all doing things and nothing is coming to me directly. So the agents just wait. I maybe lose 20 minutes without knowing anything. So I'm going to fix that right now. This is Zapier, where I'm going to create a trigger. And yes, you guessed it, it's going to be a web hook. This is exactly where the hooks come in handy from Zurp because we can literally send an update hook to a web hook by Zapier. So that's the start of my zap. We'll make sure to catch the hook. Now we've got a hook URL that we'll copy for later for the action. Really simple. I'm going to add in Telegram. I've already got a magic bot connected, which is absolutely fantastic. Fantastic. We'll send a message, okay, we've labeled it Xirp to Telegram. We'll publish that Zap right now. I'll now paste in that Zapier webhook and say, can you make it so that every time something requires your action or one of the Claude Code sessions completes, it pings this Zapier webhook with a customized message and lets me know by triggering the zap. I'll set this up with Claud code hooks. That's exactly the hooks that Xirp enabled when I first installed it. As you can see, it's editing my CLAUDE settings JSON exactly what it should do so that I can be notified via Zapier webhook and get a telegram message. It says I'll add a small script plus global hooks. So this works across all your projects. Ah, look at this. Just before it finishes, it's asking me what exactly it's going to notify me about. How about when something needs my action and when a session is complete and yeah, absolutely. When a sub agent finishes, it's orchestrating. And that's great because Zapier isn't just a few to do list. It's actually an AI orchestration platform. It's the layer that sits between the thing that happened and every single human system that needs to know about it. Like this complex coding project. The trigger is the web hook by Zapier catches the hook and then the URL sends to my phone so I can act on everything. And look at that right there on my phone as I'm talking, I've got a message from my Zap Magic Bot. And you can see it right here. Zapier returns success on both pings. So let's go in, look at these Zap runs. Give them a little refresh and boom, successful. Yes, had two pings. Here we can see that I've had my session complete ping from Xirp demo right into Zapier. It even sends nice info like which computer it came from, the name of the session id, timestamps and really everything I need. So it doesn't just have to stop there. I can actually go ahead and edit this Zap, go on and add a third step and of course we'll use the wonderful Zapier tables here we can create a record. I've created this Xirp log Zapier table that can log the session ID and any comments I need. So let's go ahead and map in the session session ID and also the output from the log. And there it will all go straight through with the session ID and all of the data that's sent to the webhook. So I've got full visibility on everything happening inside Xirp, no matter where I am. It's all recorded. And look at this. In a new session I can say make this into a git repository locally and make one commit. This is important because it means we can have many agents working on our projects without them colliding with each other. And now over here, instead of hitting New session, I can do New Work tree session. And look at this. It will spin up a brand new work tree. It gives it a name here. And now I'm working with an agent without it colliding with other agents. This is really cool. Also you might notice up here next to New session and new work tree, you've got new terminal. This is, I mean absolutely amazing. This is like God mode for coding. And there you go. That is Spotify Xirp. You can command your coding agents, you can hot swap them as you go and they can even ping your phone using Zap. Now here are a few caveats that I should put up front. It's closed source, there is no repo, there is no license. They open sourced backstage back in 2020. They didn't do the same here. It's macOS only. No server deployment. You can't SSH into a session. One app running on one Mac. And that's why I use Zapier, so it could actually ping me on Telegram when I'm away doing other things. Also, you can't sign up with Gmail, Yahoo, Outlook. It has to be your work Email and transcripts, as I discovered earlier, are not redact their words. It doesn't scrub or redact credentials, personal data or sensitive info before upload. So make sure you're very careful with what you do. And most of the value is wired into portal and that is probably something you don't have access to. So I can actually click this right now, open the browser, and here is my game, ready to play. Oh, my goodness me. Actually, do you know what? This is really not bad. I'm playing this right inside. Spotify's Xirp. It doesn't seem to be shooting all the things. Or maybe it's just I'm bad at this. I have to reload, I can move around, I can go, maybe get some of these power ups and of course I can escape and go back to my coding session, make changes to this game as I go. So Spotify Xirp. It's good, it's free. And if you're on a Mac with a work address, go and get it. 50 agents isolated with work trees. Swap the model mid task. All of this is real, but of course it stops at the glass. Once you leave your Mac behind in the room, you are out of the picture. But for a free app that anyone can use to vibe code, games and websites and other things, it's actually pretty good. But I want you to give it a go and let me know how many agents can you run. What breaks first, Let me know in the comments if you'll be using this, because I want to know if anyone's actually going to use this and if it's going to improve your workflow. Zapier made this easy for me to see outside of my Mac. And everything I run, including the full setup, is in my community, which is linked up down below. Thank you so much for watching. And YouTube is showing a video on your screen now. You should watch next.
17:21

FLUX 3 Is Here β€” Everything You NEED to Know

Black Forest Labs' new Flux 3 is its first AI video model, and every clip comes with sound already built in. It makes up to 20-second full-HD clips at 24fps from a single prompt, and can take the last four seconds of an existing video and carry its motion and dialogue onward. The lab trained it on images, video, and audio together with a noise trick it says teaches meaning without a second model, reportedly fixing the usual weak spots of faces, hands, motion, and text. It also offers a cheap draft mode and several languages with lip-syncing, but it's labeled a preview model, full HD comes from upscaling, and video editing plus the upcoming Flux 3 image model aren't shipped yet.

Notes

FLUX 3 β€” research notes (ElevenLabs YT, 2026-08-12)

Source note: ElevenLabs video "FLUX 3 Is Here β€” Everything You NEED to Know." Speaker's stance: strong competitor, but numbers need independent verification.

The model. Black Forest Labs' Flux 3 video is their first non-image model and first video model. Flux 1/2 were text-to-image. Generates clips up to 20 s, up to full HD @ 24 fps from a single prompt, with native audio (dialogue, SFX, ambience) generated alongside frames, not added afterwards.

Training (per paper on arXiv + code on GitHub). Trained on images, video, and audio in one model. Instead of uniform noise + bolting on a second pretrained image-understanding model, BFL adds different amounts of noise to different parts of the same input, forcing the model to infer missing pieces from still-visible parts. Their claimed improvements: faces, hands, motion, text rendering β€” "exactly the list of things that people complain about in AI video."

Capabilities.

  • Text-to-video; image start frame; image as end frame (generates the transition between two frames).
  • One generation holds multiple scenes/camera angles coherently β€” a cut doesn't need a second render.
  • Typography rendered as part of the scene, not pasted on.
  • Languages: English (various dialects), Chinese, Spanish, French, Japanese, Turkish, "among others," with lip-syncing.
  • Style not locked to cinematic: "raw, handheld, animated, nostalgic, or plain strange," closer to Midjourney's creative/artistic output β€” unlike models needing negative prompting to avoid film-trailer look.
  • World knowledge from pre-training + "real-time grounding" β†’ synchronized multi-camera generations.

Video continuation. Feed the last 4 s of existing footage + a prompt; model continues using full context (motion, same voice/flow). Contrasted with the usual last-frame-still approach, which discards all context (camera stops, voice cuts midword). Chaining continuations makes the 20 s limit moot. Speaker caveats: 4 s is not much context, and "I haven't actually tested how far it holds up before the thing starts drifting and hallucinating β€” promising here rather than proven."

Draft mode. Fast/cheap prompt previews; once one looks right, Flux 3 renders the same video at full quality with same subjects/composition/motion. Draft is a separate setting from resolution; final pass is described as a "full render," not an upscale. What makes the draft cheaper is undisclosed β€” speaker guesses it's analogous to generating with Nano Banana 2 Light then switching to Nano Banana 2. Framed as "a cost and iteration feature rather than a new capability."

Limitations (as stated).

  • Labeled a preview model in BFL docs.
  • Full HD is described as via upscaling, not native generation at that resolution.
  • 20 s vs the 10 s standard; but "Cox 2.5 already goes to 30" β€” longer is becoming the standard.
  • Continuation limited to 4 s input context.
  • No video editing, no image/video reference inputs yet (both "listed as coming").

Flux 3 image. Announced, not shipped. BFL's preliminary results claim it handles complex prompts and text "significantly better" than prior Flux models and renders high-accuracy multilingual text. No release date; on roadmap.

Bottom line (speaker): "at or near the top of the field on its first attempt... but those numbers still need independent verification." Available now in ElevenLabs (Image and Video β†’ Flux 3 in model picker).

Transcript · 7,931 chars
Black Forest Labs just released Flux 3 video and it's their first non-image model. It generates video clips up to 20 seconds long with audio created alongside the frames and it can take up to 4 seconds of an existing video and continue it carrying the motion and the dialogue across the clips. Here's everything you need to know. Now, Flux 1 and Flux 2 were text to image models and that is what Black Forest Labs has been known for since they started. Flux 3 is a different kind of model and the reason it behaves differently comes down to how it was trained. It's also their first ever video model. So the question worth asking is not whether it is good for a first attempt. It is whether it holds up against the models that have been iterating for years. And quick spoiler, I think it does. Now Flux 3 is trained on images, video, and audio together in a single model. That part is fairly standard now. So what matters is not that they did it, but how they did it. And there's an actual paper on archive with the code on GitHub if you want to check out the work in detail. Normally you train these models by adding noise to something and asking the model to clean it up. But cleaning up noise does not require understanding of what you're looking at. So the model has very little reason to learn meaning. Most labs patch that by bolting on a second model that already understands images. Black forest labs instead add different amounts of noise to different parts of the same input. So the model has to work out the missing pieces from the parts that it can still see. That is what teaches it meaning and there is no second model involved. What it improves in their own comparisons is faces, hands, motion, and text rendering, which is exactly the list of things that people complain about in AI video. You can check out the research if you're interested in this stuff. But what does this actually mean for you as a creator? Flux 3 video generates clips up to 20 seconds long, up to full HD at 24 frames per second with a single prompt. And every output comes with native audio. That means dialogue, sound effects, and ambience generated alongside the individual frames rather than added afterwards. You can do text to video or start from an image and use an image as an end frame, allowing you to generate the video transition between two frames, giving you more control. But this is not new. This is actually pretty standard. One generation can hold multiple scenes and camera angles while keeping the sequence coherent. So a cut between shots does not need a second render. And it renders typography as part of the scene rather than pasted on top. And for languages, it claims to cover English with various dialects plus Chinese, Spanish, French, Japanese, Turkish, and all of these that you can see on screen right now among others with lip-syncing. Now the style range is worth calling out separately because it is the thing that you notice fastest. It's not locked into a cinematic look. outputs can be raw, handheld, animated, nostalgic, or plain strange. Flux models are known for being quite creative and artistic, similar to midjourney. So, this is a real difference from models that require a lot of negative prompting to not make everything look like it was a film trailer, whether that's what you asked for or not. One more thing that's easy to skip past is Black Forest Labs says the model combines world knowledge from pre-training with real-time grounding, allowing for some pretty cool and unique synchronized multi- camera generations. And if you want to follow along with any of this, you can try Flux 3 right now by clicking the first link in the description down below. Go to image and video, select Flux 3 in the model picker, and prompt away. Moving on, video continuation is really cool, and it's not the same as start and end frames. You can give Flux 3 the last 4 seconds of a clip you already have, tell it what should happen next, and it carries on from there. So, it will use the entire context of those 4 seconds. Usually, the way to extend a clip is to grab the last frame of your video as a still and generate from that, which throws everything away except that one start frame, so it has no context. The camera stops moving, the voice cuts out midword, and you can notice immediately where the video was extended. But Flux 3 gets 4 seconds of real motion and sound instead as context. So, the camera keeps moving the way it was already moving, and the person keeps talking with the same voice and flow. Do that a few times in a row, and the 20 second limit doesn't actually matter. That being said, it is rare to generate more than 20 seconds in one go. Two caveats, though, is that 4 seconds is not a lot of context, and I haven't actually tested how far it holds up before the thing starts drifting and hallucinating. So, promising here rather than proven, but we'll do some more tests soon. Now, there's also a draft mode, so you can get fast, cheap previews of your prompt. And when one looks right, Flux 3 renders the same video at full quality with the same subjects, composition, and motion. It's worth being precise about what this actually is, though, because it sounds like it could just be generating small and scaling it up, but it's not. Draft is actually a separate setting from the resolution you pick, and Black Forest Labs described the final pass as a full render rather than an upscale. What they've not said, though, is what makes the draft itself cheaper. My guess is that it's probably similar to how you would generate with Nano Banana 2 Light and then move to Nano Banana 2 or another model when you're happy with the prompt. So, it's a cost and iteration feature rather than a new capability, but it's probably one of those ones that you'll use every single day. Now, honestly, if we put this model up against some of the top AI video models out there, it's a super solid competitor, and I'm loving how unique it can make things feel, and it's also great at interpreting vague prompts, but there are a few limitations worth knowing. Black Forest Labs label this as a preview model in their own documentation. A full HD output is described as coming through upscaling rather than being generated natively at that resolution. 20 seconds also sounds long against the 10-second standard, but Cox 2.5 already goes to 30, so it seems like longer is becoming the standard. Video continuation is kept at 4 seconds of input context, and video editing is not in there yet, and neither is using images and videos as references, though both are listed as coming. Flux 3 image has been announced, which I'm very excited about, but it hasn't been shipped yet. Their preliminary results say it handles complex prompts and text generation significantly better than the previous Flux models and it renders high accuracy text in multiple languages. But again, there's no release date yet besides the fact that it's on the road map. So to bring it together, Flux 3 is one model generating video, audio, and eventually images from a shared understanding of how the world behaves. On Black Forest Lab's own numbers, it has landed at or near the top of the field on its first attempt, which is a real achievement. But those numbers still need independent verification. So treat it as one more really strong option rather than a reason to throw out what already works for you. So simply test this up against the models that you already use with the prompts that you already use. And you can actually do that right now inside of 11 creative by clicking the first link in the description down below. And please let us know in the comments what you think. And I'm particularly curious about whether video continuation is something you actually see yourself using in your workflow. And if you want more breakdowns like this, hit that like button and don't forget to subscribe. Thanks for watching.
09:28

This new AI Render Engine is amazing!

MiniMax H3 is now open-source, so you can run it free on your own computer to turn a rough preview of a 3D scene into a finished, lit shot instead of paying cloud services more than a dollar a clip. You feed it a plain clay-render playblast from Blender or Maya plus a text prompt, and the model adds materials, lighting, and even generates sound design. It runs in ComfyUI, and you can add reference images for characters, environments, or objects to keep them consistent across the whole shot. The catch is it needs 24fps input at specific clip lengths, and fast camera moves cause sliding when references lack detail.

Notes

MiniMax H3 for AI rendering from 3D playblasts (ComfyUI)

The pitch

Open model gives locally-free equivalents of what a cloud model (transcribed as "C dance") does. The comparison model "runs in the cloud, can cost more than a dollar per clip, and it's also not available everywhere." H3 runs on your own computer from a plain playblast/clay pass plus a text prompt; optionally takes reference images for characters/backgrounds/objects and keeps them consistent across the shot; also generates sound design or accepts imported audio (e.g. voice-overs, lip sync). The workflow is by Mickmumpitz on ComfyUI, sponsored by his Patreon supporters; an advanced version is Patreon-gated.

Context / why it's simpler now

Older AI-render workflows required exporting control-net data (edge outlines, depth, OpenPose) to keep scenes consistent. With H3: "all you need is a simple clay pass, or like a play blast." The model is MiniMax H3, brand new at time of recording; the LoRAs and speed tricks are early-stage community work ("in a few weeks I will update this workflow and it will probably be already so much better").

Setup (ComfyUI)
  • Drag-and-drop the workflow file into ComfyUI; click "install all" for missing custom nodes; restart ComfyUI.
  • Download models into paths shown on each model-loader node (e.g. ComfyUI/models/diffusion_models).
  • Main model is large; a pruned version (~12 GB) is offered for older GPUs.
  • Speed-up group (optional): a LoRA allows 4 steps but "usually that degrades quality too much" β€” presenter uses 8 steps with the LoRA; also uses "easy cache, which will also like steal a bit of quality, but also make it faster." For max quality: Ctrl+B to bypass the group and set steps to 20.
Playblast input
  • Maya: right-click Playblast. Blender: Render Engine β†’ Workbench, select matcap; optionally cavity or outlines.
  • Outline pass: switch matcap to flat, color black, outlines white.
  • Output saved as a video file. The workflow auto-reformats to H3's required size and clip length (lengths shown as a selection in the UI β€” choose one while animating) and it "needs to be 24 FPS because the model is trained at 24 FPS."
  • With only the playblast, the video is transformed purely by the prompt (green box in UI). Prompt is long; presenter copies it into an LLM (Claude) to rewrite. "It's really important that you name the reference you loaded and what they are doing" β€” the playblast is described as "an untextured gray clay render from Blender. It defines layout, staging, and animation." Optional extras: a timeline (for changes mid-animation) and an audio prompt (generate music or foley).
Adding reference images
  • Enable the image-reference node (Ctrl+B), upload character refs, environments, etc. Sliding/camera errors happen with "a white backdrop" because "there's not a lot of information for the model to understand how the camera is moving" β€” fix by adding a grid on the floor or extra detail.
  • You choose how much context to give the model; more refs = slower. Trick: collapse multiple references into one composite image using a Flux image-edit model (transcribed "Flex Client 9B" / "Flux client 9B") β€” load a single frame of the video (frame load cap: 1), prompt where people/environment/style go, then feed that single image as the only reference.
Audio / lip sync

Import an audio file (must be "the same length as your clip") plus a character ref and a prompt saying the character is talking. Works for realistic and stylized characters; presenter compares it favorably to LTX lip-sync used on the previous film.

Example results & caveats
  • Free water simulation: the reference has no ocean, yet waves and splashes are generated from scene movement β€” normally you'd build the surface in Houdini. (An underwater shot came out "ethereal weird" with splashing underwater β€” noted as odd.)
  • Prompt-only stylization works well for look-dev (recraft a creature's color/background, etc.).
  • Fast-moving camera tracking "pretty much flawless" without any reference images.
  • Building/structure content can diverge from the playblast while the camera move is still tracked.
  • Outline pass helps where the clay pass over-constrains, e.g. low-poly spheres marking an explosion; the model then fills in the gap.
  • Extreme camera moves still break apart β€” "the model is only understanding reference images" right now. Presenter predicts future precision via training or "something like control nets being released for this model."
Comparison vs. the previous workflow

Surprisingly close in quality ("the difference is not huge"), but the old model "could only render 81 frames" requiring an elaborate iterative render-and-stitch workflow β€” a pain the new model removes.

Paid tier

Patreon advanced version adds more reference inputs and SeedVR 2 upscaling (to 2K/4K), plus all example scenes, workflow files, inputs, and references.

Transcript · 15,583 chars
You've probably seen videos like this online. People dropping in their 3D layout scenes into an AI model and getting back [music] a finished shot. And most of the time that is C dance. It's very good at this, but it runs in the cloud, can cost more than a dollar per clip, and it's also not available everywhere. But thanks to a new open model, you can now get similar results on your own computer locally for free. All you need is a play blast straight out of your 3D viewport, and the model [music] turns it into a finished rendering from a simple prompt. You can also add reference images for all the elements in your scene like characters, backgrounds, objects, [music] and the model will keep them consistent across the whole shot. And as a free bonus, it will also generate sound design for your scene. But you can also import your own audio clips [music] like voice-overs, for example, and the model will apply them and make your character talk. >> Hey, you absolutely [music] need to subscribe to McMillan Pazdan. >> To show you how to use it and to find best settings and limitations, I ran it through dozens of handcrafted 3D scenes, [music] which I will also show you at the end of this video. So, make sure to subscribe and stick around till the end. This video and the free workflows are sponsored by you, my lovely Patreon supporters. If you want to get your hands on the advanced workflows, the example files, and render passes for all of these shots, as well as our amazing Discord community, consider supporting. We've been building AI rendering workflows on this channel for over 3 years now, and often they can get quite complicated. For example, in the past you have to extract control net data for your scene first. Like you needed to export the edge outlines, depth information, or open post data for your character to keep everything consistent. But as these models get better and better, they also get easier to use. The model we are using today is Minimax H3, and here all you need is a simple clay pass, or like a play blast. We are going to use this model in ComfyUI, and I prepared this easy-to-use workflow for you that also features some cutting-edge tricks found and developed by the open-source community that make it run a lot faster and even on older machines. If you don't have ComfyUI yet, we have a free guide on how to install it. Once you have ComfyUI open, you can just drag and drop the workflow file into the ComfyUI interface. Now, you need to install a few missing custom nodes. For this, you can click on this message here, so click install all. Once that's done, you need to restart ComfyUI by clicking right here. We're going to work from left to right, so let's zoom in on the left here and get the models we need. You can find all the models you need in the corresponding node next to the model loader node. The node also tells you where you need to put this model in your ComfyUI folder structure. So, for this one, for example, right click, save link as, go into your ComfyUI folder, ComfyUI, models, diffusion models, and click save. Now, the main model is kind of big, so if you have an older GPU, it might make sense for you to download this model instead. This is a pruned version of the main model, and it's only like around 12 GB. You need this one right here. The next group to the right is a speed up group. This one is optional, you can completely bypass it, but it allows you to run the workflow a lot faster. This is thanks to this Laura right here, which you can find the download link up here. This would allow you to run the workflow at four steps, but usually that degrades quality too much. So, when I use this Laura, I will still use eight steps. It also uses easy cache, which will also like steal a bit of quality, but also make it faster. So, if you want maximum quality and you have a bit more time, you can just deactivate all of this, click control B, that will bypass it, and then come to the settings right here, and set them to 20. But, for this demo, I want to run the fast version, so let me un-bypass this. And now, it's already time to input our references. Let's start with the I called it clay video. It's just like the play blasts that you would export. Now, in Maya, I think you could just right click play blast. In Blender, I think the easiest way to export this is just go to ren- render engine workbench, select matcap, and then select this one, for example. You can also activate cavity or uh outlines, if you want. Now, you can come to outputs, select the output path, and I like to save it directly as a video. Now, for some scenes, it would also make sense to export like an outline pass, and the easiest way to export one is just to switch matcap to flat, select the color black, activate the outlines, and make them white. Like this. Once you have your playblast, you can just drag and drop it onto this node or click choose to upload, and in the background, this workflow will reformat your video to a size that H3 can work with. It will also change the length of your clip because H3 um needs certain lengths to work with, and you can see a selection right here. So, if you plan out your shot, you should maybe choose one of these uh already while animating. Also, it needs to be 24 FPS because the model is trained uh at 24 FPS. In theory, you only need this one reference. The video will then only be transformed with your prompt, and you can find the prompt in this green box right here. Now, this is a longer format, and what I usually do is I copy this over to a large language model, describe what I what I want to change, and have the large language model write this for me. But, it's also not super long, so it might make sense uh to adjust things manually here. It's really important that you name the reference you loaded and what they are doing. So, the playblast is described as an untextured gray clay render from Blender. It defines layout, staging, and animation. And if you want, you can also add a timeline. This is optional, but sometimes things can change during your animation, and you can really precisely prompt and you can also put in an audio prompt. So, you can generate music, you can generate uh foley. This is really cool. But, this is all you need to do if you only want to use a prompt and the reference image, so you can now click run. I recommend you activate preview, so you can see the preview during sampling, and you can already see if your video is developing in the right way. But, it will also make things a bit slower. And it's done, and here's our final video. To the right here, I also included this comparison, so you can see if it really understood the movement. And yeah, this one looks great. Let's try something else though. I took this format, copied it to Claude and said change it to um superheroes. That looks really good. Look at this cloth movement and like the reflections, the the specular on the characters. Really cool. But now let's add some more references. For example, you can upload image references. For this I select this one and click control B to activate it. And we could upload this character reference that we used in the last video. Let's upload a second character and maybe let's go for a completely different style. Finally, we can activate this node right here and also upload an environment. Now we need to create the prompt. I will copy this prompt. So what I will do is I will use a prompt like this. Use this prompt from it and adjust it and then I copy over the prompt. I then also upload the character and environment reference. I copy this prompt over from Claude and this is what it looks like. It kept the concept with the video, but now it also adds the reference images. So now we can click run and this worked pretty well. It's the characters in the location, but you can see there's some sliding going on here and that's because my reference honestly is not that good for this kind of camera move. Like with a white backdrop, there's not a lot of information for the model to understand how the camera is moving. Um so instead I would maybe put like a grid on the floor or just give it some extra detail. And that's the cool thing about this reference workflow is you decide how much context you give the model. So for shots like this, the model is more free to change the scene, but you could also more precisely define your environment by blocking out the staircase for example or adding the buildings in the background. At this point we're loading in four different references and that can make things a bit slower. So what you could do instead is create one reference image with all the information the model needs. And what I mean by that is you could for example download my free Flex Client 9B workflow. And then let me just copy over this um video reference and set the frame load cap to one and connect this frame to the first image input right here. Flux client 9B is an image added model, so we now have this frame and we can add references or change the image with a prompt. Now, for example, I could bring over the same references we used here and connect them and create a prompt like this where we tell the model where the different people are in the image and what kind of environment we want, what kind of style we want. And now we have an image like this, which is not perfect, but for this use case it's good enough. And now we only have the video reference and one image reference, which should save us a bit of time. And this worked well, too, but you can see we have the same camera and sliding problem, but that is due to the white background in the reference here. Now is a good time to mention that if you support us on Patreon, you can also get access to the advanced version of the workflow, which features a few more reference inputs and an upscaling setup using SeedVR 2, so you can easily take your renderings to 2K or even 4K resolutions. I will also give you all these example scenes with workflow files, inputs, and references, so you can test out everything on your own machine and create your own versions of these shots. And now let's take a look at some of these example scenes and the renderings I created with this workflow. This is one of my favorite shots because it is super complex. It has a lot of complex camera moves and it also shows the benefits of this workflow because using this workflow you basically get a free water simulation. Like usually you would have to build like the water surface in Houdini or something and simulate it, but here you can generate all these interactions. As you can see in the in the reference, there is no ocean there. Everything is generated, all the waves, the splashing, all that is generated based on what the model thinks it should look like based on the movement in the scene. And this is what it probably looks like underwater here in this like ethereal weird scene where there's also splashing water underwater, which is a bit weird. For this scene, I also wanted to try out this very complex movement, and I also wanted to try out different styles. So, you can see all of this is entirely prompt based. Here, I didn't use any reference images at all, and I think that's really cool. Imagine this for like look dev. You can very quickly try out different variations, like you could change the color of the creature, for example. You could change the background very easily and flexible. Similar idea with this one, I created this very fast-moving camera, and I wanted to see how well it would track the movement, and as you can see, it's pretty much flawless here. Again, no reference images were used. This is all prompt based. For this one, I used reference images, and you can see just how flexible you are. Check out the background here. If you add a reference image that mirrors your Playblast scene right here, so you have the same buildings, the model will actually track them. But, if you don't do that, if you create a new scene, the model can also work with that, and you can see the structure of the building or the space station here is completely different, but it still works, and it still learns to follow the same camera move. Still amazed by this one, I really wanted to check out if it could track the camera movement from these Playblast characters well, and it worked perfectly well. Like, this is so cool. And here, it also managed to get the floor right. Like, there's some tiny bit of sliding there because there is no floor reference, but I would say it looks pretty cool. And here, I also tried doing the same thing, but with reference images for every character and the background. Next, we have this lizard character, and here, I tried out giving him just different outfits and putting him in different locations. Now, this is one of these shots where I used the outline pass instead, and the reason for that is I used these very like low-poly spheres to indicate when the explosion is going to happen. And it the reference kind of took this look for the explosion. And sometimes giving it like the outline pass like this just gives the model a bit more freedom to fill out the stuff in between. Also worked really well for this snow setting right here. Okay, so now this is really cool. You can also give the model an audio file like for example lip sync and it will then make the character talk. So here you can see I imported this blender scene and she's not moving her mouth there. And then I also imported this audio file down here. >> Hey, um just wanted to say this also works well with realistic characters. >> Make sure that is the same length as your clip and then I also added this reference image right here. And this is the prompt saying that she is talking. >> Hey, um just wanted to say this also works well with realistic characters. >> And this also works with stylized characters as well. Here we tested it out with one of the shots from our previous film bare minimum for the last video where we used LTX to lip sync 3D animation and this one works just as well. So here we really wanted to push the model and see how well it can follow the camera movement. And you can see for this extreme stuff it will still break apart. Because for right now the model is only understanding reference images. But I think in the future probably we could train a lot to follow more precisely or maybe there will also be like something like control nets be released for this model. And I'm pretty confident that we will get perfect precision in the future with this model. Now when I compare this model to the last version of our workflow I'm honestly surprised how far we were able to push that old model because the difference is not huge I must say. But the old model still had a lot of limitations like for example that it could only render 81 frames and we had to build this elaborate fix workflow to make it run in iterations and stitch all together and it was just a bit of a pain to work with. But with this new model, that is brand new by the way, we are already starting out at this kind of quality. So imagine what like two years of community improvement would do to this model. And speaking of community optimizations, like a lot of these, like for example, the Laura's that I used today are still in the very early stages. So in a few weeks I will update this workflow and it will probably be already so much better. For now, that's it for this one. Have fun with it and thanks again to my lovely patrons supporters for making this video possible. See you all next time.
11:27

I Made an Anime With MiniMax H3 (and I’ll Show You How)

A new version of the MiniMax video generator, H3, lets you feed it up to 12 reference images, videos, or audio clips so characters and style stay consistent, and it makes native 2K video for as low as 61 cents a second. An anime creator walks through his workflow: generate a character in a T-pose (front, back, and side views) so the model understands the full design, then prompt shots using that image. He also reuses a reference fight scene to guide motion, adds audio so a character speaks, and edits finished clips afterwards, like swapping a background with a text instruction. The pitch is a strong price-performance ratio for anime, short films, and branded content.

Notes

MiniMax H3 β€” Test Drive (K.D.Wilson, YouTube, 2026-08-12)

Video by AI-anime creator K.D.Wilson, testing the new MiniMax H3 video model on the MiniMax platform.

Platform / model capabilities (as demoed)
  • H3 headline update: multi-reference generation β€” can feed images, videos, and audio as references simultaneously.
  • Reference modes: "start to in-frame" or "omni reference"; up to 12 references per generation (also addable per-prompt).
  • Durations up to 15s; aspect ratios include 21:9 and 16:9; output option 2K.
  • Built-in image generation picks from major models: ChatGPT Image 2, Nano Banana Pro, Nano Banana 2, Sea Dream (Midjourney).
  • Companion app: MiniMax Audio; a "hub" for downloads.
The workflow demonstrated (step sequence)
  • Generate a character T-pose turnaround image in the platform (4-up grid), then iterate style, e.g. prompt "1990s cell shading" + "turnaround sheets".
  • Upload chosen image to H3, omni reference mode, 2K, 10s.
  • To animate a fight, upload a video reference of a fight scene (trimmable) plus a second character T-pose. Prompt: "two T-poses characters replacing the in the video and fighting in a Japanese subway" (11s).
  • Add an audio reference; prompt "Make her say audio before the fight scene" (bumped to 14s). Result: lip-synced line "It's time for you to die."
  • Post-generation editing: upload a street image and prompt "Replace the train background with street…" β€” background swapped, fight continues.
Key tip quoted
"T-pose will give a front and back and side view of your character and it will also make sure that any model that you upload it to will be able to see your character fully… if not, then they won't understand what they look like from certain angles and that's when your character would change." β€” K.D.Wilson
Pricing claim
"Minimax H3 supports native 2K video generation with a price as low as 61 cents per second." β€” K.D.Wilson
Creator's verdict
  • "Outstanding price-performance ratio."
  • Motion/editing described as "almost like real time" β€” multiple cuts, background replacement, revisions over time.
  • The action followed the uploaded fight scene exactly ("doing exactly what it says it does"); one of the two generations deviated with an added cut, which the creator considered an acceptable improvement.
  • Claims the workflow transfers beyond anime: live action, short films, branded content, Instagram.
Caveats / limitations to keep
  • Not an independent review β€” affiliate promo (link in pinned comment/description), no head-to-head vs. other models, no benchmark numbers beyond the price point.
  • Single-creator sample; consistency across longer/multi-shot scenes not stress-tested.
  • Background swap shown on one edit; no failure cases or cost math for a full production shown.
Transcript · 9,574 chars
Today, we're testing a new generation video model, Minimax H3. [music] And we're exploring how far we can push it. Now, you guys know I make AI anime for a living, and I'm on a mission to test every single video model to see how far you can push it for each one. So, let's get into it. So, before we get started, let's take a look around this platform to see what everything looks [music] like. Now, I see how the company let me know one of the biggest updates that they did for H3 is the multi-reference capability, allowing you to use images, videos, and audio for your generations. So, if I just come here on the screen, you can select Minimax H3 here. And you can use start to in-frame or omni reference. And then the references, you can have up to 12. It gives you a little introduction on what this does. You can hit continue. And then I can add all my references. Okay, so it's letting me add up to 12 references, which is really cool. So, I can just pick anything I want here. And just add it right here. Super simple, super easy. [music] And then you could type in your prompt. You can add references here, too. So, if I needed to, I can add whatever reference asset I needed to if I'm specifically talking about that image or audio. Right here, they have different ratio sizes, which is cool. This is really cool. A lot of people don't have 21:9. That's very cool. And 16:9 is what I'm going to go for. And then I can go up to 15 seconds. 10 seconds good for me. And I can add any references. I have my assets on my left side. So, this should be Okay, this is everything I've generated before in the past. Cool. And then you have your storyboard, any angle references. This is [music] cool. Got your tools. We're looking at it together. We got your hub that you can download. Okay, very cool. It has its own app, Minimax audio. And then we have our home. In the top, you have create video, create an image. You have the agent here. Very cool. So, now what we're going to do is we're going to create a character, and I'm going to show you how to do that here and we're going to see what comes to mind. I don't even actually know what I'm going to make. So, I'm going to select images here. And then I'm going to select Chat GPT image two. They also have Nano Banana Pro, Nano Banana two, Sea Dream, so Midjourney, anything you want they have here. That's pretty much all the major image models, so anything you want to do. Right? But I'm going to go ahead and go with Chat image GPT two. And I'm going to type in something like I don't know. Let's see. Let's see what I can think of on the spot. Cool. We're going to generate four images and see what we get. So, while it's generating, I want to give you some insights on why I [music] decided to write the word T-pose cuz T-pose will give a front and back and side view of your character and it will also make sure that any model that you upload [music] it to will be able to see your character fully. And those are very, very essential when generating any type of video cuz if not, then they won't understand what they look like from certain angles and that's when your character would change. Okay, we're generating our anime characters as they're coming in slowly. I really like this girl in the top left, too. Let's see what else we have here as it generates. But I like how she has this like skull on her pants. That's pretty cool. Okay, so we have top left. Okay, this one kind of shows the intricate tattoos and piercings she has. Personally, I'm feeling the top left. Ooh, bottom right, I think we got the winner. I think we got the winner, [music] 100%. And you can click video from there. You could download it. I think I'm going to download it just so I can have it saved. So, now what I'm going to try to do is I'm going to change a little bit. I like this style, but we're going to see if we can do some different styles here. So, I'm going to type [music] in like 1990s cell shading. I'm also going to put turnaround sheets, so they know that we want to get the back version of her. And we're going to generate two more now that we got exactly what we want. And we're going to just try some different styles. Out of these four, I kind of like her. She got the Doc Martens on. That's cool. Okay, to be honest, guys, I'm kind of feeling this one right here. I don't know why. Just am. So, I'm going to download that one as well. [music] And yeah, let's just go with that. So, I'm going to go back to home and [music] I'm going to upload that image. Now that I have the image uploaded, we want to have Mini Max H3 selected. We want to have 2K selected. You can do any aspect ratio you want. I'm going to go with 10 seconds. And then we can do start and end frame or omni reference. I'm going to do omni reference for this. And what I'm going to do first, I just kind of want to see what it does. Like we tested other platforms, I just want to see what it does when we first start. So, let me type in something. Let's say it's music and a nice and nice Japanese bedroom. Sure. Let's just see what happens. Generate that. And you know what, let's generate one more time. And let's see what happens. And from this I will be able to assess and see what kind of a base it is, and then I will add more references. Because I know from here you can also add an audio reference. You can also add a more picture references. You can also add video references [music] of what you want your character to do, right? So, we can do that as well. But first I want to see what these look like. Okay, now we have our videos generated. Let's see how they turned out. >> [music] >> Okay. Let's look at the second one. >> [music] [music] >> Okay, I think these are pretty good, to be honest. I like the first one more because it has a cut. Now, I didn't prompt the cut or anything like that, but that looked good to me. I mean, especially since you saw kind of this other angle with the light coming in from the window. That looked good to me. Okay, so now that we've done that, what I'm going to do here is I'm going to add a reference of a fight scene that I found online. This is the fight scene. It's just two characters that are fighting in a blank room. I'm going to just up to here and you can trim it. I'm adding that and I'm adding another reference of a character different character here. Cool. So, now we have two T-poses of two characters, then we have a fight scene of a character fighting that's happening in the middle. And no audio yet, but we're going to test that next. Now, we're going to write something like two T-poses characters replacing the in the video and fighting in a [music] Japanese subway. Cool. All right, so yeah, let's make it like 11 seconds since our video is 10.4. And let's create two of these and let's see what happens. Okay, we have one video generated and we're generating the second one right now, but let's check out this one video with the two character images and the fight scene we have here. Let's zoom in. Okay. All right. I think that's pretty cool. I mean, they get very dynamic with the camera, but that is following the exact fight scene that I had uploaded. So, but it's doing exactly what it says it does. Now, let's look at the other one. >> Okay, this one kind of changed it a little bit, but I don't mind it. I don't mind that cut in. It actually looked pretty good. All right. >> [music] >> Now, the last thing we're going to do here is we are going to upload audio, and we're going to see if we can get her to now say the audio in the beginning before the fight scene. I'm going to just literally type in, "Make her say audio [music] before the fight scene." Okay? And I'm going to increase the time to 14 seconds, so [music] they could she could actually have time to say it. Okay, let's see what this looks like. >> It's time for you to die. >> Okay, so now from here, let's see Let's try to change the background. >> It's time for you to die. >> we're going to upload the video that we like the most here, and now I'm going to have an image here. Take this image of a Japanese street, right? Now, we're going to upload the image here. Cool. And we're going to say, "Replace the train background with street from uh phone episode." We're going to generate this twice. Okay, let's see what happens. >> It's time for you to die. >> So, you can enter the editing instructions after the video is done, and you can change the background, you can have multiple cuts, you can do a bunch of stuff with this platform. And it has an outstanding price-performance ratio. Minimax H3 supports native 2K video generation with a price as low as 61 cents per second. And you can add in your video and more references and change things about your video editing it in almost like real time. And as you can see here, I replaced the video background and the fight can continue. So you can have more revisions over time and have more control of your final output. Now what we're going to do is we're going to put things together in editing and show you how it all comes together. >> It's time for you to die. >> [music] >> What I most like about this workflow is it's not just useful for anime. If you're into live action stuff, real production needs, creating short films, branded content, [music] things for Instagram, anything. You can definitely do it with this platform. If you want to try the new H3 for yourself, link down below, first pinned comment and in the description. Now if you want to see a professional anime I did for a client of mine, click this video right here.
03:30

The BEST local AI video generator just got BETTER!

The open-source MiniMax H3 video model now has community speed-ups that cut generation time up to five times. Turbo LoRAs drop the sampling steps from 20 down to 4-6, a small resized version fits low-VRAM setups, and a new preview trick shows a low-res version while it generates so you can cancel bad shots early. Fine-tuned LoRAs add effects like a realism style for casual-looking footage, and each needs its trigger word in the prompt. Everything is ComfyUI-specific, so it requires the latest ComfyUI and several community nodes.

Notes

MiniMax H3: faster/better community ways to run it (advanced tutorial)

Companion to the author's earlier MiniMax H3 install video. Covers speed-ups, preview, LoRAs, turbo LoRAs, compressed quantized models, an easy community workflow, audio-only and image-only generation, and the official prompt guide.

Speed-up nodes (insert after "Load Diffusion Model", before guider/scheduler)
  • Patch Sage Attention node β€” set sage_attention to auto.
  • Spectrum node β€” newer version has even lower quality loss. Update by opening ComfyUI/custom_nodes/Spectrum in cmd and running git pull; add the node from canvas. Sampler res_multistep, scheduler simple (per author). Caveat: Spectrum does not work with the euler sampler β€” bypass it (Ctrl+B) when using euler for turbo LoRAs.
  • First: update ComfyUI itself via update_comfy.bat β€” new features are required for the nodes below.
Live preview node
  • Model Preview Override node (KJ Nodes) β€” update KJ Nodes via git pull first to see the tiny-VAE field.
  • Download the TAE model (<10 MB, "TAE saved tensor", under Files β†’ Versions β†’ VAE approx) β†’ ComfyUI/models/VAE_approx.
  • Settings used: max preview resolution 1024, JPEG quality 80%, preview frames 124 (for a 5s / 24fps video), preview fps 12. Press R to refresh model list after downloading; press X mid-generation to cancel. Final video still saves via Save Video node.
LoRAs
  • Community examples: whispering LoRA, looping sketch anime sticker LoRA, fictional woman, and Foul AI's "realism people" LoRA (131 MB β†’ ComfyUI/models/Loras), which produces imperfect/casual amateur-style realism.
  • Add a Load LoRA node after the diffusion model; example strength 0.8.
  • Most LoRAs have trigger words that must be in the prompt (e.g. realism).
Turbo LoRAs (up to ~5Γ— speedup)
  • Cut steps from 20 β†’ 4. Options: Larry VR (earliest, robust); Light X2V (also made LoRAs for LTX and Wan; judged most robust; Comfy-compatible 4- and 8-step versions); JoyFox for the BF16 base model (40 GB) β€” higher quality for high-action scenes.
  • KI (Keya)'s resized version: 315 MB vs ~2 GB normal, for low VRAM/RAM, Comfy-compatible. Author recommends ~4 steps @ 0.75 strength, euler sampler, beta/beta57 scheduler; bump to 6–8 steps if quality drops.
Compressed models for low VRAM
  • KI's experimental folder: W4 A8 versions ~12 GB each (text-, image-, reference-to-video) vs 21 GB pruned FP8/INT8 β€” runnable on ~8 GB VRAM.
  • Compressed video VAE: 3 GB vs 5.2 GB official.
  • Combined with Spectrum + Sage Attention, author estimates ~8 GB VRAM; steps can drop to ~16 ("often you don't even need 20").
Comfy MiniMax H3 Easy (by NKXX188)

Single minimalist workflow covering text/image/first-last-frame/reference-to-video. Clone repo into ComfyUI/custom_nodes; drag workflows file onto canvas. Readable resolution presets (360/480/1080p), aspect ratio, duration; references added by plugging Load Video / Load Audio nodes into the media input; prompt can reference inputs via the @ ("add") menu. Author: "the Comfy team should hire this guy to design their official workflows."

Audio-only generation

Image-to-video workflow β†’ Ctrl+B the Load Image, Create Video, and VAE Decode nodes; set resolution to the lowest (0.1); add Save Audio (Comfy Essentials) connected to the audio output; format MP3. "Save video is missing" error is ignorable. Examples: "cinematic orchestral music for an epic battle scene" (5s demo; duration adjustable), "a man screaming 'AI never sleeps'... Epic rock background music" (8s).

Image generation (pseudo-workflow)

Community workflow; set frames to 1 and batch index 1; aspect ratio e.g. 2:3 at 1 MP. Caveat: not a frontier image model β€” author prefers other tools for dedicated images.

Official prompting guide (from MiniMax team)
  • Text-to-video: three fields β€” integrated multimodal description (visuals, actions, shots, speaker, dialogue); overall soundscape (ambient/physical/non-verbal sounds); background music (audible only to the audience, not characters). Example: "A woman walks through a rainy Tokyo street at night and opens her umbrella" β†’ enhanced with neon reflections on wet pavement, train passing, etc.
  • Image-to-video: structure depends on first-frame vs first+last vs last-frame input. First-frame recommended structure: first frame anchor β†’ action onset β†’ continuous development β†’ result/reaction; identity/clothing/colors must stay consistent. Author pastes the guide + input image into ChatGPT to draft prompts.
  • A separate reference-to-video guide also exists (all linked in description).
GGUFs β€” not recommended on ComfyUI

Abi Ray's GGUFs: Q3 = 15.6 GB. Unsloth's: Q2 β‰ˆ 6.7 GB (fit ~4 GB VRAM). Author: ComfyUI is now more optimized running a quantized "Comfy" version instead β€” larger but better quality, less compression loss than GGUF. (Sponsor: Higsfield's Seedance 2.5 β€” 30s multi-shot video with narrative/audio, up to 50 references, 33-day unlimited offer, $1M film festival.)

Transcript · 29,078 chars
Last week, the best open- source AI video generator, Miniax H3, was released, and this is an absolute beast. It can do so many things. It has incredible world knowledge, and it's super flexible. Now, because this is open- source, the community has built on top of it, and now you can do even more things with it. So, in this video, we are going to go over some faster, better, and more interesting ways to run Miniax H3. This is a more advanced tutorial that continues from this video. So, if you haven't installed Miniax H3 yet, or if you don't know what it is, definitely see this video first. Anyways, let's get started. Now, this video assumes you already have Comi installed. The first thing you need to do is to update Comfy UI because they've added some additional features which are required to run some of the tools and nodes I'm going to show you in this video. So, simply click into the update folder and then click on update comi.bat and it'll proceed to update to the latest version of comi. All right, afterwards let's press any key to continue and then we can start up Comfy UI. All right, after you've opened this up, let's pull up one of the default miniax workflows. Let's just go with image to video. And a quick recap from the previous video. If you click on this workflow here, there are a few ways you can speed this up by inserting a few nodes after this load diffusion model step. So for example, one way is to use this patch sage attention node and connect this between the diffusion model and then basic guider and basiculer. And then over here we need to set sage attention to auto. Again, if you're not sure what I'm talking about, definitely see this video first on how to set this up. Another way to speed this up is to use this spectrum node. Well, they've actually updated this to a newer version which has even lower quality loss. So what you should do is also update this to the latest version. So in your Comfy folder, if you click on Comfy and then custom nodes, you should see your Spectrum folder over here. So let's double click into this and then at the top, type in cmd, which would open your folder up in command prompt. And then simply type get pull to update this to the latest version. I've updated this yesterday, so it says already up to date. And then afterwards, after restarting com UI, simply double click anywhere on your canvas and then type in spectrum to add this latest spectrum node. And now it should look like this. So, simply connect this after the model and whatever comes after it. Make sure you update to the latest spectrum node because it's even better. Now, here's another really cool tip. Let's say you want to preview the video as it's generating so that if it doesn't look good, you can just cut the generation halfway instead of waiting for it to complete. Well, the goat called Key released a really useful way to make this happen. This requires the model preview override node in KJ Nodes, which again we've installed in the previous video. Assuming you do have KJ nodes installed, you probably need to update it first in order for this new method to work. So simply go into your comfy UI and then custom nodes folder and then look for KJ nodes and then double click into the KJ nodes folder and then at the top type in cmd and for this folder again we are going to type in get pull to update to the latest version. All right, so afterwards let's exit out of this and then you also need to download this TAE model. I'll link to this in the description below, but if you click on files and versions and you click on VAE approx, here's where you can download this TAE saved tensor file, which is pretty tiny. It's less than 10 megabytes in size. So, let's click download and this goes in comi in models and then in VAE approx. Make sure you download this in VA approx. All right. So, let's click save. And then afterwards, back in our CompuI workflow, we just simply need to add this preview node after the load diffusion model. So, let me double click here and then type model preview override and you should see this node. So, let's select this and then place it somewhere here. Note that you do need to update to the latest KJ nodes in order to see this tiny VAE field. All right. So afterwards, you just connect this with the model and then whatever goes after it. And then here the fields are pretty self-explanatory. So the max resolution to preview this is 1024. JPEG quality is 80%, preview frames is how many frames you want to preview here. Since for this example, we are generating a video of 5 seconds at 24 frames per second. Let's set it to something like 124 preview frames to span the whole 5 seconds. And then this is the preview frames per second. Let's just set it to 12. And then for the tiny VAE, here is where we need to select our newly downloaded TAE H3 safe tensors file. If you don't see this, make sure you press R to refresh your model list after downloading this file. All right, so that's about it. Next, let me proceed to click run. And you'll see that it's going to give me a preview even before it finishes generating the video. So you can preview the generation, and it gets clearer and clearer as it proceeds from step to step. And if you don't like the look of it, you can just press X to cancel this like halfway so you don't continue wasting compute. Now, this is just a really lowresolution video at 12 frames per second, but after it's finished generating the video, it'll still save and preview the final video in this save video node. So, that is how you can use this preview method, which I think is super useful. All right, next let's talk about how to add Loras to your workflow. The awesome thing about open-source models is that people can build on top of it. They can fine-tune luras for whatever effect or style or camera motion or action or character they want. For example, someone has created this whispering Laura. Another person has creating this looping sketch anime sticker Laura. Another one has created this fictional woman, etc. And then Foul AI has also created this really useful realism people Laura, which if you look at the comparison without and with Laura, you can see that the videos look a lot more realistic. So, especially if you want to create some imperfect casual amateur shots, then this realism people Laura is super useful. So, that's what I'm going to demonstrate in this video. How do we add this realism people Laura into our workflow? First of all, you'll need to download this Laura. So, I'll link to this page in the description below. If you click on files and versions, simply download this realism people safe tensor file. It's only 131 megabytes in size. So, let's click download. And this goes in Comfy UI in models and then in Lauras. Let's click save. All right. Afterwards, let me just show you a simple text video example. So, I'm going to pull up the text video workflow. And let's do something like an amateur realistic lowquality video of a woman sitting at a cafe. She places her cup down and looks out the window. Now, to add the Laura, simply click on this corner to expand the workflow. And you just need to place the Laura after this load diffusion model. In fact, let me also pull up these acceleration steps first to make it even faster. All right, so let's add the Laura node somewhere here. Simply double click on the interface and then type in Laura. And there's actually a ton of load Laura nodes you can use. I'm just going to use this one, load Laura, and then place it here. And if you've just downloaded the realism people Laura, simply press R to refresh your model list. And then in the dropown, you should see the realism people Laura over here. So let's select this. The strength here is basically how much influence you want this slower to have. One would be 100%, you can make this a bit weaker. So let's go with like 08. And then let's connect this with the model and then whatever comes after it. So that's pretty much it. Now there's one more thing you need to be aware of, which is that most Loras have trigger words. You need to add the trigger word into your prompt for it to work. So for this example, the trigger word is realism. So let's also add this into our prompt. And that's pretty much it. Let's press run. And here's our generation. So, as you can see, it does look a bit more realistic and non-professional. Now, speaking of luras, here's another really useful way to speed up your generation by like four to five times. Now, you can use this for whichever workflow you want. I'm just going to show you an example of an imagetovideo workflow with this start frame. And we just need to download and add a Turbolora over here. So, let me show you that really quickly. And what a Turbolora does is it basically lets you decrease the number of steps to generate the video from 20 to only like four steps. So, it's up to like a five time speed up. Now, there are a ton of these turbo luras available for Miniax H3. One of the earliest ones is by Larry VR. This actually is pretty robust. It works pretty well. We also have some turboloras from the awesome light x2v. They've created turboluras for previous open video models as well like ltx and one. And we also have another one from Joyox. Here it says that this is for the BF16 base model. So you can use the Joyox one if you are using the BF-16 base model which is 40 GB in size. I think most of you are just using the pruned FB8 or IN8 version which is a lot smaller. But if you are using the BF16 version, then this Joy Fox one is actually pretty good. It seems to be even higher quality, especially for high action scenes compared to the Light X2V Laura. Now, I think for me their most robust option is to go with the light X2V version. And it looks like today they've also released some versions that are compatible with Comfy UI. So there's a four-step version here and an eightstep version here. In addition, KI also released his own version of the Lite X2V Laura which is compatible with Comfy Y, especially if you have low VRAM or RAM. This resized version is much smaller at only 315 megabytes in size, whereas the normal Turbo models are almost 2 GB in size. There's a lot to choose from. I'll link to all of these in the description below, but for this video, I'm going to demonstrate using this smaller resized version from KI. So, let's click on download. And this goes in Comfy UI in models and then in Lauras. Let's click save. All right. So afterwards, back in our Comfy UI workflow, if you haven't added a load Laura node after the diffusion model, load that first. And then afterwards, let's click down here and select the Turbo Lura, which I just downloaded. Now, each Laura has different optimal configurations. If you're using the keya here, he seems to suggest using four steps at 0.75 strength with erde or SA solver. So let's set the strength here to 75. And then for the algorithm in this dropown, let's select er. The annoying thing about this is it's not in alphabetical order. So ess. And then for theuler, you can set this to either beta or I heard beta 57 also works very well. Now for steps, four is the minimum number of steps you can use with the current turbo models. But if you find that the quality is too low, you could bump this up to like six or eight steps. So at least for me, let's set this to like six steps. Another thing to note is that if you use erd as the sampler, it turns out that this spectrum node doesn't actually work with erde. So, let's also click on this and press Ctrl +B to bypass this node. And then let's press run. All right. And here's our result. Not too bad, especially since it allows you to speed up your generation by up to five times. Now, at least for me, I don't actually like using a Turbo Lura. So, here are some additional ways to speed up your generation or to fit Miniax with even lower VRAM. So, first of all, let me get rid of this Laura node. Let me reenable this spectrum node, which I think is very useful. Now, for spectrum, I tend to use res multistep as the sampler. And then for theuler, I tend to set it to simple. But feel free to play around with different combinations to see which one works best for you. And since we got rid of the turbola, let's set the step count back to 20. All right. Now, instead of using a turbo model, what we can do instead to make this faster or fit in lower VRAMm is to use smaller models. So, there's also this experimental folder from KI and he released several even more compressed models for Miniax. So, for these two up here, he basically released a W4 A8 version. This one is for text to video and image to video. This one is for reference to video. And as you can see, each of them are just like 12 GB in size. Whereas even the smallest pruned F8 or INT8 version is 21 GB in size. So this is almost half the size which is great. You can probably run this on just like 8 GB of VRAM. So for me I'll just show you a texttovide example. So I'm going to download this one. And this goes in comfy UI in models and then in diffusion models. Let's click save. All right. Afterwards note that KI also released a more compressed video VAE which is only 3 GB in size. If you look at the official Miniax H3 video, this is like 5.2 GB in size. So again, downloading this will save you like 2 GB of memory. Let's click download. And this goes in Comfy UI in models and then in VAE. Let's click save. If you want to supercharge your content creation, definitely check out Higsfield, the sponsor of this video. They've just added the most capable video generator out there, Seed Dance 2.5. The biggest improvement from this model is that you can now generate up to 30 seconds of video in a single pass with multiple shots and an actual narrative with audio built-in. You can also extend an existing generation with new shots while keeping the same characters, locations, pacing, and overall look consistent. What really stands out is the reference system. You can feed it up to 50 references at once, including 30 images, 10 videos, and 10 audio files. So you can provide your characters, environment, visual style, motion, and soundtrack all in one generation. You also get much more control over editing. For example, you can specify exactly what happens during different timestamps, change just one section without affecting the rest of the video, or move the same performance into a completely different environment, or even change the camera angle while preserving the characters and action. Seed dance 2.5 supports text to video, image to video, video to video, and other references, giving you ultimate flexibility on your video creation. And right now is the best time to try Seed Dance 2.5 on Higsfield because they are offering unlimited Seed Dance 2.5 for up to 33 days. Terms and conditions apply. And if you're up for the challenge, check out the Higsfield Global Film Festival, which has a massive $1 million prize pool. Simply create any original film inside Higsfield. It can be any story or genre and submit it for a chance to win cash prizes and other rewards. Try Seed Dance 2.5 in Higsfield today using the link in the description below. All right. Afterwards, simply press R to refresh your model list. And then down here for the unit, you can select this new V4 A8 version, which is a lot smaller. And then for the video VAE, you can now select this int8 version, which is again a bit smaller. And with this setup, plus with spectrum and patch sage attention, you could potentially run this pretty quickly with just 8 GB of VRAM. To make this even faster, you could probably reduce the step count to something like 16. I find that often times you don't even need 20 steps. So, let's try an example. I'm going to upload this car. And then let's write an orbit shot of the car zooming in and out quickly. And let's press run. And here's our result. Not too bad. All right. So that sums up some additional ways you can speed up your generation or fit this workflow with even lower VRAM. Now if this official workflow looks pretty complicated to you with all these nodes and noodles, there's actually a much easier and well-designed workflow for you to use and this is called Comfy Miniax H3 Easy by NKXX188. This is actually incredibly simple. You can basically run text, image or reference to video all in just one workflow. So first we need to clone this repository. So simply click on this green button and then copy this URL and then in your comy folder in custom nodes at the top here type in cmd to open this up in command prompt and then let's type get clone and then paste in the URL over here. Now for me I've already downloaded this. That's why it says it already exists. But if it's your first time it should proceed to download this Miniax H3 easy folder in your custom nodes. So, simply open this up and then double click on this workflow folder. And there are two workflows here. They're quite similar. I'm just going to show you this first one. So, let's drag this onto my Comfy UI interface. And you should see this. This is pretty much it. Look how simple and minimalist this is. So, first of all, let's load up our models. I'm going to use the smaller W4 A8 model, which I just showed you. Same with the reference one. And then for video VAE, I'm going to use this smaller int8 one. And then down here, actually, let me move this node up here. This is where I can choose either image to video or first frame last frame or reference to video. So if I choose image to video, then it's going to automatically select this model. If I choose reference to video, it'll automatically select this model. So everything is just built into one workflow. So I don't need to switch between different workflows. Let me set this back to ITV. And then here's where I can select the resolution. Again, this looks way cleaner. I don't need to refer to this table. It's just the regular like 360, 480, 1080p, which I'm familiar with. And then here's the aspect ratio, the duration. That's pretty much it. You can also expand some advanced settings like frame rate over here. And then if you do choose image to video, then here is where you would upload an image. Now, the nice thing about this is, let's say you're doing reference to video, which allows you to add different types of media onto here, right? You can add images, video, and audio. Well, all you need to do is just input another node. For example, let's do load video and put it over here. And you can also just connect this to the media input. Or you can also do load audio. So, let's insert a load audio node. And we can also connect this directly to the media output. Again, this is way cleaner than the official reference to video workflow, which forces you to drag your input references into one of these connections. This is just way simpler. Another thing I really like about this is you can actually refer to your references within your prompt. So for example, I can write characters in and then if I press the add sign, I can select from my input references. So I want to say the characters in my video are wearing the headphone in this image and dancing to the music from this audio file. And then if you want, you can also add some additional acceleration methods here. And then here's where you would set the sampling algorithms as well as the step count. And that's pretty much it. It's a lot simpler to use. So if you're interested in this workflow, I'll also link to this in the description below. Honestly, I think the Comfy team should hire this guy to design their official workflows. All right. Next, here are some interesting things that you can get Miniax to do. It turns out you can just prompt it to generate audio. This can be like a music or sound effect generator. So let me exit out of everything and start from scratch. What you first need to do is use the imagetovideo workflow. And for the load image node, we can just press Ctrl +B to bypass this so that there is no image. For the resolution here, we can decrease this all the way to the lowest value, which is 0.1. And here is where we can enter our sound effect or music that we want to generate. For example, let's write cinematic orchestral music for an epic battle scene. Now if you expand this corner, we can keep all the settings the same. But basically over here, we can simply click on this create video node and press Ctrl +B to bypass it. We can also bypass the VAE decode node. All we want to do is take the audio, right? So simply double click anywhere on the interface and then search for save audio and you should see this from Comfy Essentials. So let's click on this and place it in here. And we simply need to link the audio output into this. And here you can select different formats. Let's select MP3. And that's pretty much it. So, what we're doing is we're essentially using like the lowest megapixels available for the video because we don't actually need it. And we're only going to extract and download the audio from the generation. Let's press run. Now, when you run this, it's going to say save video is missing. That's because we disabled the previous steps for creating the video. But you can ignore that because it'll still generate our output. >> [music] >> So that is indeed some epic orchestral music for a battle scene. Here I'm only showing you a demo of 5 seconds, but remember over here for duration we can increase this to whatever you want. Here's another example. Let's try something like a man screaming AI never sleeps. And this week has been absolutely insane. Epic rock background music. And then for the duration, let's set this a bit longer to like 8 seconds and then press run. All right, here's our result. >> AI never sleeps and this week has been absolutely insane. And there you go. It follows my prompt pretty well. All right, so that's how you can use Miniax to just generate audio. What about using it as an image generator? It turns out you can do that, too. So, I'm going to link to this page in the description below from this user, and they've created a pseudo image generation workflow for Miniax. So simply download this workflow file anywhere on your computer and then afterwards drag and drop the workflow onto your Comfy interface. So you might see some missing models here. Let's first go ahead and select the appropriate models for each of these nodes. And then afterwards here is where we would enter our prompt for the image. And let's try something like this. Anime style. A young woman with long silver hair and fox-like ears wearing a shrine maiden outfit, red ribbon sash. She's kneeling beside an ancient mosscovered stone lantern, gently placing small paper offering while soft fireflies drift around her. And then here is where we can select the aspect ratios. So sure, let's go with 2 to three at 1 megapixel resolution. And here is where we select how many frames for miniax to generate. Now since I just want an image, I'm just going to set this value to one. And then here are all the regular settings. And over here, because I set the length to one, the batch index should also be just one. And that's pretty much it. Let's press run. And here we go. Here is indeed a shrine maiden with white hair and fox ears next to this temple thing with fireflies around her. So that's how you can also use Miniax to generate images. Now, it's not really a frontier image model. I think Crea 2 and Adio are much better at this. So at least for me, I wouldn't really use this as just a dedicated image model. Next, I also want to talk more about how to prompt Miniax correctly because a good prompt makes a huge difference in your video generations. In fact, the Miniax team has released a full prompt writing guide for Miniax H3. So, it actually follows a very fixed format and this varies for text to video, image to video, and reference to video. And if you follow this format, your videos are going to look a lot nicer. I'll link to these guidelines in the description below, but for example, for text to video, they recommend that you include these three fields. So, there's an integrated multimodal description. So, it describes the visuals, actions, shots, speaker, dialogue, etc. And then the overall soundsscape. So, what other ambient sounds or physical action sounds or other non-verbal sounds that should occur in the video? And also any background music that the characters cannot hear, but only the audience can hear. For example, we can take this simple prompt. A woman walks through a rainy Tokyo street at night and opens her umbrella and we can enhance it to fit the following format. So, for example, the first section should just describe the scene and all the actions that occur including the camera motion, what exactly she does. So, here she should open a red umbrella and then the overall scene. So, there should be like neon reflections simmering on the wet pavement. A train passes in the background. And then next we move on to the overall soundsscape, which should be this plus any background music. And here's our result. So you can see it's much better if you prompt it this way and you describe all the actions including the background music, the camera movement, the overall scene, plus the overall soundsscape and the background music. So that's text to video. And then for image to video, it depends if you're using your input image as the first frame or if you're inputting two images, one for the first frame, one for the last frame, or if you're just using the input as the last frame. Let's do a quick first frame example. So here it says the description should first establish the style, subjects, composition, scene anchors in the image, and describe the next action. Character identity, clothing, colors, key objects, etc. should remain consistent. So the recommended structure is the first frame anchor action onset continuous development result or reaction. So what I tend to do is just copy this into chat GPT and then I would upload my input image and then say give me a prompt for the video generator based on the below instructions and this input image and then I just pasted the instructions from the Miniax prompt guide. So, it gave me this. And then in my image to video workflow, instead of just writing a car driving down a highway, I'm going to copy and paste the prompt from chat GPT in here and then press run. All right. And here's my result. [music] As you can see, this looks much better than my earlier video where my prompt is just a car driving down a highway. This looks a lot more cinematic. The camera movement, the music, everything is just a lot better. So, those were some examples of how to prompt better for text to video and image to video. They've also released another prompting guide for reference to video. I'll link to all of this in the description below. Next, if you're wondering about GGFs for Miniax, we already have a ton available. For example, this user Abi Ray has released some GGUFS and the Q3 version is only 15.6 GB in size. Unsloth also released his own GGFS for Miniax H3 and the Q2 version is only 6.7 GB in size. So you could potentially even fit this on like just 4 GB of VRAM. However, at least if you're using Comfy UI, it's actually no longer recommended to use GGFS. It's quite technical, but basically Comfy UI is actually more optimized if you just run a quantized Conrot version. Even though these are larger models with the right optimizations, you can fit them in much lower VRAM. And in general, the quality of these Convert versions is much better than a GUF, which tends to have more compression and sacrifice in quality. But in case you're still interested in running GGFs for whatever reason, then I mean the Unsloth version is super tiny. The Q4K version is only 6.7 GB. So I'll also link to these GGFs in the description below. So, that sums up my more advanced tutorial on how to run miniacs better and faster and some additional things you can tweak. The open- source community is incredibly fast. There's so many updates that come out every date, it's really hard to keep track of everything. If you're interested in more minax updates, be sure to check out my ex or Twitter where I will continue to post some interesting findings. Hopefully, this video was helpful for you. If you run into any errors, welcome to copy and paste the exact error message that you see in the comments below, and I'll try to help you troubleshoot as much as possible. As always, I will be on the lookout for the top AI news and tools to share with you. So, if you enjoyed this video, remember to like, share, subscribe, and stay tuned for more content. Also, there's just so much happening in the world of AI every week, I can't possibly cover everything on my YouTube channel. So, to really stay uptod date with all that's going on in AI, be sure to subscribe to my free weekly newsletter. The link to that will be in the description below. Thanks for watching and I'll see you in the next one.

Article

124
02:51

Ant Group's Ling 3.0 Tiny Matches GPT-120B Intelligence With 15x Fewer Parameters

A tiny new open model from Ant Group's AI lab matches much bigger models on reasoning while using a fraction of the compute. Ling 3.0 Tiny is a 7.9B-parameter mixture-of-experts model (only part of it runs per question, about 1.3B active parameters) that scores 25 on an independent intelligence index, comparable to models 15x its size. It uses an alternating attention design plus 128 expert networks, and can handle 262K-token context even on consumer Apple Silicon. It scores a 30% hallucination rate by abstaining when unsure instead of guessing, and it's MIT-licensed and free to run. The catch: it's very verbose, using about 65% more output tokens per task than comparable models, which drives up latency and cost at scale.

Notes

Ling 3.0 Tiny (InclusionAI / Ant Group)

  • Model: Ling 3.0 Tiny β€” hybrid reasoning MoE, 7.9B total params, only 1.3B active per token (compute cost β‰ˆ dense 1.3B at inference).
  • Benchmarks: Artificial Analysis Intelligence Index score 25, ranked 6th of 56 in its size class (class median: 8). Comparable to gpt-oss-120b (24) β€” 15x more total params, 4x more active.
  • Architecture: hybrid 3:1 alternating stack of KDA (Kimi Delta Attention, linear O(n)) and MLA (Multi-Head Latent Attention, periodic full-attention with compressed KV cache); sparse MoE FFN with 128 routed experts, 8 routed + 1 shared activated per token. Enables 262K-token context on consumer hardware incl. Apple Silicon.
  • Hallucination control: hallucination rate 30% (down from 96% in Ling-mini-2.0) by abstaining on uncertain questions instead of guessing.
  • Availability: MIT-licensed weights on Hugging Face; $0.00/M tokens via InclusionAI API and Novita Labs; GGUF quantizations for local use.
"It is a small but surprisingly capable reasoning model that punches well above its weight class, and it is available right now under an MIT license with free API access."

Caveats (stated):

  • Verbosity: uses ~65% more output tokens per task than comparable models (e.g., Qwen3.6 35B A3B) β€” matters for latency and cost at scale.
  • 30% hallucination rate is still substantial, not zero; abstention trade-off may reduce coverage.
  • Vendor-reported figures; index scoring is third-party (Artificial Analysis) but raw accuracy/abstention split not given.
Full text · 2,896 chars
- New model: InclusionAI (Ant Group) released Ling 3.0 Tiny, a 7.9B MoE reasoning model with only 1.3B active parameters per token. - Benchmark performance: Scores 25 on the Artificial Analysis Intelligence Index, ranking 6th of 56 models in its class, comparable to GPT-class models with 15x more parameters. - Architecture: Uses a hybrid 3:1 KDA–MLA attention stack with 128 sparse experts, enabling 262K-token context on consumer hardware including Apple Silicon. - Hallucination control: Achieves a 30% hallucination rate (down from 96% in Ling-mini-2.0) by abstaining on uncertain questions rather than guessing. - Free and open: MIT-licensed weights on Hugging Face, currently $0.00/M tokens via InclusionAI API and Novita Labs; GGUF quantizations available for local use. - Caveat: Very verbose β€” uses ~65% more output tokens per task than comparable models like Qwen3.6 35B A3B, which matters for latency and cost at scale. Ling 3.0 Tiny is the latest model from InclusionAI, the AI research arm of Ant Group (the fintech giant behind Alipay). It is a small but surprisingly capable reasoning model that punches well above its weight class, and it is available right now under an MIT license with free API access. Tiny name, real numbers Ling 3.0 Tiny is a lightweight hybrid reasoning MoE model with 7.9B total parameters and only 1.3B activated parameters per token. That distinction matters: in a Mixture-of-Experts (MoE) architecture, the model has many specialized sub-networks ("experts"), but only a small subset are activated for any given input. This means the compute cost at inference time is much closer to a dense 1.3B model than a 7.9B one. Independent evaluator Artificial Analysis scores it 25 on its Intelligence Index, ranking 6th of 56 models in its size class against a class median of 8. For context, that score is comparable to gpt-oss-120b (high, 24) , a model with 15x more total parameters and 4x more active parameters. The architecture doing the heavy lifting The Ling 3.0 family is built on a hybrid-linear attention design that combines two types of attention layers in alternation. Ling 3.0 Tiny integrates a 3:1 alternating stacking of KDA and MLA (3 Kimi Delta Attention layers followed by 1 Multi-Head Latent Attention layer per 4-layer block) with a sparse MoE FFN comprising 128 routed experts, where each token activates only 8 routed experts and 1 shared expert. To unpack that: KDA (Kimi Delta Attention) is a linear attention mechanism , it processes long sequences in O(n) time rather than the O(nΒ²) cost of standard attention, keeping memory and compute from exploding at long context lengths. MLA (Multi-Head Latent Attention) is a periodic full-attention layer with a compressed key-value cache. Linear attention keeps long inputs cheap, while periodic full-attention layers maintain the exact token-to-token recall needed for complex reasoning.
03:33

Longitudinal benchmarking of artificial intelligence models for the differential diagnosis of ... - Nature

A peer-reviewed study tracked AI models over time to see how well they diagnose oral diseases, an accuracy check most research skips. Researchers ran a controlled longitudinal benchmark of current AI systems for differential diagnosis of oral conditions. It ran in a Nature journal. The scope is a single medical specialty, and because models change quickly the findings date fast.

Full text · 149 chars
To perform a controlled longitudinal benchmarking analysis of contemporary artificial intelligence systems for the differential diagnosis of oral ...
04:00

The Multilingual Quantization Tax: Structural Collapse and Typological Fragility in Edge SLMs

Shrinking AI models to fit on phones quietly makes them much worse at non-English languages. Testing 4-bit compressed versions of Gemma 4 and Qwen 3.5 across eight languages, researchers found low-resource and non-Latin scripts collapse badly, while English barely degrades. Which languages break depends on each model's architecture, so the damage isn't predictable. This matters because most quality checks are English-only, which hides the harm.

Notes

Title: The Multilingual Quantization Tax: Structural Collapse and Typological Fragility in Edge SLMs

Source: arXiv cs.CL, published 2026-08-12 (feed item)

Quantization-degradation evaluations are overwhelmingly English-centric, despite 4-bit weight quantization being critical for edge SLM deployment. This paper measures the "quantization tax" multilingually.

  • Method: zero-shot multilingual evaluation of 4-bit quantization across the Gemma 4 and Qwen 3.5 architectures, on 8 typologically diverse languages, using MMLU ProX Lite and GlobalPIQA benchmarks. Parameter truncation is shown to expose "deep pre-training inequalities."
  • Finding β€” four phenomena:
  • Typological Fragility: low-resource and specific non-Latin scripts suffer representational collapse via "architecture-specific double dissociations," failing to generate valid task logits.
  • Home Language Fragility Paradox: foundational pre-training pathways provide limited precision-loss protection.
  • Domain-Specific Forgetting: multi-step cross-lingual routing degrades, while associative soft-science recall stays robust.
  • Quantization Resistance: highly saturated, typologically aligned domains resist deterministic degradation; post-quantization performance gains are "bounded by statistical noise."
  • Caveats/limitations: claims rest on two architectures and eight languages (fine-grained script/typology breakdown not given in abstract); benchmarks are zero-shot, so few-shot/instruction-tuned behavior is untested; "double dissociation" patterns are architecture-specific, so results may not transfer across model families.
Full text · 1,975 chars
Computer Science > Computation and Language Title:The Multilingual Quantization Tax: Structural Collapse and Typological Fragility in Edge SLMs View PDF HTML (experimental) Abstract:While 4-bit weight quantization is critical for deploying Small Language Models (SLMs) on edge devices, evaluations of the resulting performance degradation-the quantization tax-remain overwhelmingly English-centric. We present a zero-shot multilingual evaluation of 4-bit quantization across the Gemma 4 and Qwen 3.5 architectures. Evaluating on eight typo-logically diverse languages using MMLU ProX Lite and GlobalPIQA, we show parameter truncation exposes deep pre-training inequalities. We identify four phenomena: (1) Typological Fragility: low-resource and specific non-Latin scripts suffer representational collapse via architecture-specific double dissociations, failing to generate valid task logits; (2) Home Language Fragility Paradox: foundational pre-training pathways provide limited precision loss protection; (3) Domain-Specific Forgetting: multi-step cross-lingual routing degrades while associative soft-science recall remains robust; and (4) Quantization Resistance: highly saturated, typologically aligned domains resist deterministic degradation, with post-quantization performance gains bounded by statistical noise. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

When Chain-of-Thought Helps and When It Hurts: An Empirical Investigation of the Serial-Depth Bottleneck in LLM Reasoning

Chain-of-thought prompting isn't a universal boost to reasoning β€” it only helps tasks that demand deep sequential thinking. Testing Qwen and Llama models on five benchmarks, researchers found CoT added up to 68 percentage points on hard math tasks but did nothing or slightly hurt on shallow multiple-choice tasks. The bigger the model, the less it needs the prompt crutch, and one small model actually got worse with it. Findings are pre-registered, which makes them more trustworthy than the typical reasoning-study result.

Notes

When Chain-of-Thought Helps and When It Hurts (arXiv cs.CL, 2026-08-12)

Argues CoT is not a universal reasoning enhancer but a "bandwidth bypass." Framed via the H_dp bandwidth bound (Chen et al., 2024): the formal bound binds only asymptotically (astronomically large prompt lengths), but identifies a real bottleneck β€” serial computation exceeding a transformer's single-pass capacity must be externalised, which is what CoT does.

Setup. Three instruction-tuned models (Qwen-2.5-7B/32B, Llama-3.1-8B), five benchmarks, practical context lengths. Pre-registered on OSF.

Results.

  • GSM8K, MATH (high-depth P-complete): CoT gives +54 to +68 pp recovery gap across all models.
  • MMLU, ARC (shallow TC⁰): CoT structurally redundant β€” Delta 0.0 to +4.6 pp, no significant negative effect.
  • HumanEval (intermediate class L): model-size-dependent transition β€” +23.2 pp (32B), +9.1 pp (8B), βˆ’28.7 pp (7B).
  • Cross-benchmark depth-recovery correlation: Spearman ρ = 0.661 (p = 0.007, n = 15); 9 of 15 McNemar tests significant after Bonferroni correction.

Claim. Single-pass (no-CoT) accuracy degrades monotonically with per-item serial depth; CoT is approximately depth-invariant.

Caveats (stated). ARC no-CoT baselines up to 95% "may reflect contamination, so this null is not a clean architectural test." The H_dp bound itself is formal-only at realistic lengths. CoT helps serial computation that strains single-pass capacity; redundant for tasks that already fit.

Full text · 2,566 chars
Computer Science > Computation and Language Title:When Chain-of-Thought Helps and When It Hurts: An Empirical Investigation of the Serial-Depth Bottleneck in LLM Reasoning View PDF HTML (experimental) Abstract:It is widely assumed that chain-of-thought (CoT) prompting universally improves LLM reasoning. We investigate this through the conceptual framework of the H_dp bandwidth bound (Chen et al., 2024): although the formal bound binds only asymptotically (at astronomically large prompt lengths), it identifies a real architectural bottleneck -- serial computation exceeding a transformer's single-pass capacity must be externalised, which is what CoT does. Our central finding is a within-benchmark serial-depth gradient: single-pass (no-CoT) accuracy degrades monotonically with per-item serial depth, while CoT is approximately depth-invariant. We measure CoT effects across three instruction-tuned models (Qwen-2.5-7B/32B, Llama-3.1-8B) and five standard NLP benchmarks at practical context lengths. On high-depth P-complete tasks (GSM8K, MATH), CoT gives a +54 to +68 pp recovery gap across all models. On shallow TC^0 tasks (MMLU, ARC), CoT is structurally redundant (Delta in [0.0, +4.6] pp, no significant negative effect) -- though high no-CoT baselines (up to 95% on ARC) may reflect contamination, so this null is not a clean architectural test. The intermediate class L (HumanEval) shows a model-size-dependent transition: +23.2 pp (32B), +9.1 pp (8B), -28.7 pp (7B). The cross-benchmark depth-recovery correlation is Spearman rho = 0.661 (p = 0.007, n = 15); 9 of 15 benchmark-level McNemar tests are significant after Bonferroni correction. Pre-registered on OSF, our results indicate that CoT is not a universal reasoning enhancer but acts as a bandwidth bypass: it helps serial computation that strains single-pass capacity and is redundant for tasks that already fit. Current browse context: Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Similarity Gates Approve Reversals: A Validity Audit of Embedding-Cosine Thresholds in Agent Systems

Automated AI safety checks that compare texts by embedding similarity routinely approve outright reversals of meaning. A production drift guard caught none of 56 meaning-breaking edits, approving 'withhold the study drug' for 'administer the study drug' at a 0.9608 similarity score. Across 90 configuration-task combinations, balanced accuracy never beat 0.70 (median 0.525). Simple fixes like swapping the encoder or adding overlap conditions failed on fresh data, though two of nine configurations separated reversal from rephrasing with 0.79-0.90 AUROC.

Notes

Similarity Gates Approve Reversals (arXiv cs.CL, 2026-08-12)

Audits embedding-cosine quality gates used by agent frameworks β€” dedup filters, semantic caches, drift guards, answer graders β€” that accept/reject at a fixed cutoff.

Core claim: the score answers "how much did the wording change?", not "does this still mean the same thing?" β€” and in the cases the gates exist to catch these run opposite ways. Reversal of an instruction is often a single-word edit; agreement often rephrases a sentence. "The consequence is a safety check that fires backwards."

Empirical results

  • Audited production drift guard caught 0 of 56 meaning-breaking mutations.
  • Approved item "withhold the study drug" β†’ "administer the study drug" scored cosine 0.9608.
  • Five shipped operating points; balanced accuracy across 90 configuration-threshold-task cells never exceeded 0.700 (median 0.525).
  • Evaluation confound: a naively built corpus returns inverted verdicts β€” decision AUROC exactly 0.000 in 13 of 18 configuration-task cells (≀0.040 in all 18) vs 0.440–0.815 for the same nine configurations under a balanced 2Γ—2 design.
  • The confounder "twice … captured our own headline claims."

Failed repairs: encoder swap, overlap-conditioned gate (0.750 in-sample, 0.533 held-out), and an NLI drop-in β€” all at chance on separately authored held-out data.

Where hope remains: strongest two of nine configurations separated reversal from paraphrase at matched overlap (AUROC 0.79–0.90), but only a matched-pair audit reveals the deployment regime.

Authors release corpus method, harness, and frozen results; contend scores gated this way measure the wrong thing, while "a valid instrument is buildable."

Full text · 2,762 chars
Computer Science > Computation and Language Title:Similarity Gates Approve Reversals: A Validity Audit of Embedding-Cosine Thresholds in Agent Systems View PDF HTML (experimental) Abstract:Agent frameworks ship quality gates that compare text blocks by embedding-cosine similarity and decide at a fixed cutoff. Deduplication filters, semantic caches, drift guards, and answer grader gates deploy to answer the question: "Does this text still mean the same thing?" But the score answers a different question: "How much did the wording change?" We audit this gate class as a measurement instrument. In the cases these gates exist to catch, the two can run in opposite ways. Many times, reversing an instruction is a single word edit, while agreement often rephrases a sentence. The consequence is a safety check that fires backwards. The production drift guard we audited caught 0 of 56 meaning-breaking mutations, and one approved item, "withhold the study drug" -> "administer the study drug", came in at cosine 0.9608. We observed five shipped operating points, and balanced accuracy across 90 configuration-threshold-task cells never exceeded 0.700 (median 0.525). The same confounder also corrupted evaluations. A naively built corpus inherits this confounder and can return an inverted verdict, with a decision AUROC exactly 0.000 in 13 of 18 configuration-task cells (at most 0.040 in all 18) against 0.440-0.815 for the same nine configurations under a balanced 2x2 design. Twice in the effort it captured our own headline claims. Obvious repairs fail: an encoder swap and an overlap-conditioned gate (0.750 in-sample, 0.533 held-out) land at chance on separately authored held-out data, and an NLI drop-in did no better. Embeddings do still bear hope here, as the strongest two of nine configurations separated reversal from paraphrase at matched overlap (AUROC 0.79-0.90), but only a matched-pair audit reveals the deployment regime. We release the corpus method, harness, and frozen results, and contend that scores gated this way measure the wrong thing. We believe a valid instrument is buildable. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Cracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extension

Seemingly minor model architecture choices can combine to cut long-text performance by up to 47%, and the effect is invisible in short-context tests. Researchers trained 26 comparable 7B models (released as OlmPool) at over 170,000 GPU hours, varying normalization, GQA, pretraining context length, and sliding window attention. Some of the alternative architectures beat the Llama 3 design on long-context extensibility. The finding explains much of the gap in long-context ability across model families and is a genuinely new, controlled result.

Notes

Cracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extension

Source: arXiv cs.CL, published 2026-08-12 (abstract/feed only; full PDF gated).

Core claim

Architectural variation within the dense transformer paradigm measurably affects long-context ability, despite "one might imagine" it would not.

Concrete findings
  • Four minor decisions β€” each made by at least one of the Olmo, Llama, and Qwen dense model families β€” have a compoundingly negative effect on long-context extensibility.
  • Any single choice alone: minor impact. Combining three or more: downstream performance drops by up to 47%.
  • The differences are not detectable from short-context loss or validation datasets β€” so standard evals would miss them.
  • Variation in long-context ability across model families is "much... driven by these architectural features" and detectable by applying context extension early in pretraining.
Method
  • Controlled ablations holding data, tokenizer, and extension recipe fixed, varying four axes:
  • normalization
  • GQA (grouped-query attention)
  • pretraining context length
  • sliding window attention
  • Over 170,000 GPU hours of training.
Artifact
  • OlmPool: 26 comparable 7B models, each with checkpoints before and after long-context extension.
  • Several included architectures outperform the Llama 3 architecture on long-context extensibility.
Analysis
  • Ablation models reveal attention sink behavior and attention distributions across context patterns attributable to specific architectural choices.
Caveats / stated limits
  • Result is specific to dense transformers; the four axes are the ones tested, not an exhaustive set.
  • Extensibility was measured via their fixed extension recipe β€” figures are relative, not absolute benchmark scores.
  • Claimed detection "early in pretraining" is presented as their finding, not independently verified.
Full text · 2,384 chars
Computer Science > Computation and Language Title:Cracks in the Foundation: Seemingly Minor Architectural Choices Impact Long Context Extension View PDF HTML (experimental) Abstract:One might imagine that architectural variations within the dense transformer paradigm have a limited effect on accuracy. However, we demonstrate that this is not the case in the long context setting. Specifically, we show that a set of four minor architectural decisions --- all made by at least one of the Olmo, Llama, and Qwen dense model families --- have a compoundingly negative effect on long context extensibility. Any one of these choices alone has a minor impact on long context performance, but combining three or more can drop the performance downstream by up to 47%. Furthermore, these differences are not detectable from short-context loss or validation datasets. We show that much of the variation in long context ability across model families is driven by these architectural features and detectable from applying context extension early in pretraining. We demonstrate this with controlled ablations that hold data, tokenizer, and extension recipe fixed while varying normalization, GQA, pretraining context length, and sliding window attention. After over 170,000 GPU hours of training, we release the resulting set of models as OlmPool, a set of 26 comparable 7B models with checkpoints before and after long-context extension. This pool includes several architectures that outperform the Llama 3 architecture on long context extensibility. In an analysis of our ablation models, we identify patterns in attention sink behavior and attention distributions across context that are attributable to specific architectural differences. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:31

AI helped solo professionals match two-person teams in a 776-person experiment ... - Silicon Canals

Solo professionals using AI matched two-person teams in a 776-person experiment, and success had nothing to do with being the best prompt engineer. The people who thrived were the ones willing to cross expertise boundaries and work outside their own specialty. The takeaway: winning in an AI-shaped workplace depends on learning to reach across skill areas, not on fancy prompting.

Full text · 147 chars
The professionals who thrived with AI weren't necessarily the best prompt engineers β€”they were the ones willing to venture outside their expertise.
05:25

Case thrown out after claimant caught using AI coaching in witness box - AFR

A workplace dispute case was thrown out after the claimant was caught using AI coaching in the witness box. Workers have started relying on AI to feed them favorable answers while testifying in employment disputes, and a judge dismissed this case over it. It marks an early legal consequence of AI-assisted testimony.

Full text · 146 chars
Workers have started using artificial intelligence coaching in the witness box to provide favourable answers in workplace disputes, critically ...
06:35

Researchers have successfully used AI to create brand new viruses - NPR

Researchers used AI to create brand new viruses, a milestone that has biosecurity experts worried. MIT genetic engineer Kevin Esvelt, who studies biological threats and their regulation, said this will be hard for governments to handle. The report is mostly experts wrestling with how to respond.

Full text · 154 chars
Kevin Esvelt is a genetic engineer at MIT who also studies biological threats and how to regulate them. KEVIN ESVELT: This is hard because governments ...
09:30

😺 OpenAI, Claude, and Gemini's reasoning got cracked

Researchers found a way to crack the private reasoning that OpenAI, Anthropic, and Google hide inside their AI models, and used it to pull passwords and API keys out of shared sessions. The trick: encrypted reasoning blocks meant to stay secret can be replayed into a cheaper sibling model from the same company, which can sometimes be convinced to read them aloud. Across 315,320 public reasoning blocks they recovered 367 pieces of personal information and 182 credentials. The labs were told before publication and changed their systems. Elsewhere in this roundup: NVIDIA lined up $500B+ for AI infrastructure, Anthropic reportedly signed a $9.1B compute deal with Riot, and Qwen teased a new 27B open model.

Notes

Researchers Cracked AI Hidden Reasoning (The Neuron, 2026-08-12)

Main story: encrypted reasoning blocks decrypted
  • New research paper found encrypted reasoning blocks from OpenAI (ChatGPT), Anthropic (Claude), and Google (Gemini) can be replayed into weaker sibling models from the same provider.
  • Attack flow: labs encrypted the reasoning trace, sent the encrypted block through their APIs to the app; the app held it and handed it back later for the model to resume. The encrypted block thus traveled between models, apps, sessions, and users β€” a new attack surface.
  • With a jailbreak prompt, weaker sibling models (e.g., Claude Haiku) sometimes turned encrypted blocks back into readable reasoning β€” without stealing the encryption key.
  • Scale: across 315,320 public reasoning blocks, researchers recovered 367 pieces of personal information and 182 credentials (API keys, passwords).
  • Distillation evidence: Kimi K3 occasionally produced reasoning strikingly similar to hidden frontier-model traces. Caveat stated by the paper's framing: "similarity alone does not prove how it was trained."
  • Lab analogy: Claude Opus's private notes sealed in an envelope; the app holds the envelope but can't open it; Haiku could sometimes be convinced to read it aloud.
  • Implications: hidden notes may expose user secrets, information intentionally withheld from the final answer, or valuable training data; competitors could use them for distillation.
  • OpenAI, Anthropic, and Google were notified before publication and changed their systems.
The Claude watermarking flap (from yesterday)
  • Anthropic adding invisible provenance markers to Claude-generated text; the community reaction is largely negative.
  • The tension: U.S. Copyright Office says purely AI-generated material needs sufficient human authorship to qualify for copyright β€” "can a chunk of text you may not be able to copyright still be watermarked?"
Around the Horn (other news)
  • NVIDIA lined up $500B+ for AI infrastructure financing, via platforms with major Wall Street firms.
  • Anthropic reportedly signed a $9.1B deal with Riot Platforms for 191 MW of computing capacity (former Bitcoin miner).
  • Qwen 3.8: 27B-parameter open-weight model landing this week.
  • Mojo 1.0 released by Modular (stable production release).
  • Meta smart glasses banned from courts in England and Wales over covert-recording/privacy concerns.
Products
  • Grok Bot: always-on agents with persistent cloud computers; pricing not public.
  • LTX-2.5: open video model, consistent multi-shot video, native audio, 4K HDR; free for orgs under $10M ARR; API from $0.09/sec.
  • Unsloth Desktop: run/fine-tune 500+ models locally; free/open-source.
  • Ploy: builds/improves marketing sites; raised $27M; free plan then $50/mo.
  • Mirage: layered video + avatar performances from image+audio; used for Reuters-licensed live news broadcast on X; from $0.175/sec.
  • Claudishβ†’English plugin: listens to Claude Code messages, sends to local model via Ollama, shows simpler rewrite in terminal; Claude sees original; free/open-source.
  • Claudish terms: "load-bearing," "well-defined seam," "rough edges worth knowing."
Dwarkesh Patel: continual learning predictions
  • Current models are mostly "frozen-weight"; continual learning = weights keep updating from experience after release.
  • Eight predictions: continuous safety regulation (monthly/quarterly checks, not one pre-release test); harder alignment (jailbreaks/backdoors); AI minds diverge from different experience; leaders pull away faster (compounding leads); labs ship sooner; model-switching gets painful (18 months of learning = "replacing a veteran employee"); labs may subsidize training access; personalized AI favors big organizations β€” batching efficiency gap "could exceed 100X."
  • Big idea: models shift "from software you buy into something closer to an employee you develop."
Full text · 10,680 chars
😺 OpenAI, Claude, and Gemini's reasoning got cracked PLUS: Grokbot, LTX 2.5 (new open video model) and more. Welcome, humans. So, yesterday we covered how Anthropic is adding invisible provenance markers to Claude-generated text, and people are, technically speaking, pissed. The complaint is basically: after years of arguments over whose writing and code contributed to training AI, Claude can now leave Anthropic’s invisible stamp behind to say, basically, β€œWell IDK about all THAT, but me the AI definitely wrote THIS.” Let’s think about what this means, though. The U.S. Copyright Office says purely AI-generated material needs sufficient human authorship to qualify for copyright. So can a chunk of text you may not be able to copyright still be watermarked? Welcome to intellectual property law, where vibes rule everything around me. Meanwhile, in other things you don’t like suddenly trying to make you like them, someone came up with a solution to the whole β€œwe all hate data centers” thing and built OPEN LIVING, a satirical data center you can apparently live in. America doesn’t build enough housing? but they build too many datacenters? Brother, I GOT YOU. At least you know they’ve got central AC covered, what with all that recycled water they’ve got flowing through there to cool down the servers. So long as no one summons the banana demon (very scary video; you’ve been warned) while I’m trying to sleep, I think I could swing it. Here’s what happened in AI today: - πŸ™€ Researchers extracted hidden reasoning from frontier AI models. - πŸ“° NVIDIA lined up $500B+ for AI infrastructure financing. - πŸ“° Anthropic reportedly signed Riot’s $9.1B compute deal. - πŸ“° Qwen’s 27B open model is landing this week. - πŸŽ“ A plugin translates Claude’s β€œClaudish” into English. πŸ™€ Researchers Cracked Open AI’s Hidden Reasoning AI labs have spent years hiding models’ private reasoning so competitors, attackers, and curious users can’t simply read the machinery underneath. Well, researchers just found a surprisingly simple way around that wall. Claude, ChatGPT, and Gemini can do private step-by-step reasoning before showing you an answer. Here’s what happened: - A new research paper found encrypted reasoning blocks from OpenAI, Anthropic, and Google could actually be replayed into weaker sibling models from the same provider. - Researchers found those encrypted blocks were too portable. A trace from a powerful model could be replayed into a cheaper, weaker model from the same company. - With a jailbreak prompt, those weaker models sometimes turned the encrypted blocks back into readable reasoning, without researchers ever stealing the encryption key. - Across 315,320 public reasoning blocks, they recovered 367 pieces of personal information and 182 credentials, including API keys and passwords. - They also found evidence consistent with model distillation: Kimi K3 sometimes produced reasoning strikingly similar to hidden traces from frontier models, though similarity alone does not prove how it was trained. Think of Claude Opus sealing its private notes inside an envelope. Your app can hold the envelope but can’t open it. Researchers discovered they could sometimes hand that envelope to Claude Haiku and convince Haiku to read the notes aloud. The weird part is how that envelope became available to attack at all. Labs weren’t sending the model’s reasoning around as readable text. They encrypted it, sent the encrypted block through their APIs to the app, then let the app hand it back later so the model could resume where it left off. That created a new attack surface (basically, another place an attacker can try to break the system): the encrypted block itself was now moving between models, apps, sessions, and users. The app couldn’t read it, but another model from the same provider sometimes could. Why this matters: Those hidden notes could expose user secrets, information intentionally withheld from the final answer, or valuable training data. Competitors could potentially use them for distillation (training a smaller model on a stronger model’s examples) to copy some of its capabilities. Hidden reasoning was supposed to protect users and the labs’ intellectual property. This research shows secrecy can create a new security boundary that needs defending, especially when encrypted traces travel between models, sessions, and users. OpenAI, Anthropic, and Google were notified before publication and changed their systems (nice try, sneaky distillers!). Although… FROM OUR PARTNERS Least Privilege for the Age of AI Agents AI agents are growing 40% year-over-year inside enterprises. 7% of orgs already had an agent-related security incident this year. The problem: AI agents don't create new permissions β€” they weaponize the ones already there. Same cloud keys, same tokens. No scoping. No expiration. No one watching. - Sees every agent β€” including shadow AI - Attributes every action to human or agent - Blocks risky commands, enforces approval before agents act - Works across Claude Code, Copilot, Cursor, more β€” one policy, any vendor πŸŽ“ AI Skill of the Day: Translate Claudish to English Claude Code can be excellent at explaining a codebase, right up until it starts speaking fluent Claudish: if you’ve coded much with AI, you’ve seen these terms: β€œload-bearing,” β€œwell-defined seam,” β€œrough edges worth knowing.” So, naturally, a developer built Claudish to English to fix exactly that issue. The plugin listens for Claude Code’s displayed messages, sends the output to a local model through Ollama, then shows a simpler rewrite in your terminal. Claude itself still sees the original, so the translation only changes what you read. You can also use this to translate selected Markdown files, and if you run the rewrite model locally, your text stays on your machine. Plus, plugin is free and open source! πŸͺ Treats to Try - Grok Bot gives you always-on agents with persistent cloud computers that work across apps and coordinate with other bots β€”pricing not public. - LTX-2.5 generates consistent multi-shot video with native audio and 4K HDR, and lets you run or fine-tune the open weights on your own hardware β€”free for organizations under $10M ARR; API from $0.09/sec. - Unsloth Desktop lets you download, run, and fine-tune 500+ text, vision, audio, and embedding models locally on Windows, macOS, and Linux β€”free/open-source. - Ploy builds, tests, and automatically improves your marketing website, from new landing pages and SEO fixes to visitor identification and outreach (raised $27M) β€”free plan, then $50/mo. - Mirage generates and edits layered videos, including expressive avatar performances from an image and audio, and just used the tech for a Reuters-licensed live news broadcast on X β€”from $0.175/sec via API. - Oumi turns your company into a compounding AI factory, where you can build, deploy, and continuously improve specialized models on your own production data while owning the weights, data, and recipes. πŸ“° Around the Horn - NVIDIA partnered with major Wall Street firms on platforms designed to mobilize more than $500B for AI compute infrastructure. - Anthropic reportedly signed a $9.1B deal with Riot Platforms for 191 MW of computing capacity from the former Bitcoin miner. - Meta smart glasses were banned from courts in England and Wales over concerns about covert recording and privacy. - Qwen teased a 27B-parameter Qwen 3.8 open-weight model arriving this week. - Modular released Mojo 1.0, giving its high-performance language for CPUs, GPUs, and AI workloads a stable production release. FROM OUR PARTNERS Free email without sacrificing your privacy πŸ“– Midweek Wisdom Dwarkesh Patel is one of AI’s biggest podcasters, and he’s long argued that continual learning (an AI updating its own internal settings from experience, so work today makes it better tomorrow) is a missing ingredient in today’s AI. In his latest video, he asks: what changes when AI keeps learning after release? Quick LLM 101: today’s models are mostly β€œfrozen-weight” models. Weights are billions of internal settings that tell the model which patterns matter and what words or ideas are likely to come next. Training adjusts them, and after release, they mostly stop changing. So actual continual learning would mean those weights keep updating from experience over time, like an employee learning on the job. Here are Dwarkesh's 8 Predictions on how this change will impact the industry: - (0:58) Safety regulation will need to become continuous. If the model changes after launch, one pre-release test won’t cut it. Dwarkesh suggests monthly or quarterly checks. - (2:02) Alignment gets harder. Alignment means keeping AI behavior consistent with human goals. So labs must stop continual evolving models from learning dangerous behavior, jailbreaks, or malicious backdoors. - (3:04) AI minds will diversify. Different real-world experience could make even identical starting models diverge, kinda like us humans. So no more AI group-think (which would really help my LinkedIn Feed TBH)! - (3:53) Leaders will pull away faster. A better evolving model β†’ more users β†’ more experience β†’ better model. Small leads could compound. - (4:12) Labs will ship sooner. If usage itself improves the model, keeping your best model private gives competitors more learning time. - (4:38) Switching models gets painful. Leaving an AI that spent 18 months learning your company could feel like replacing a veteran employee with a brand-new intern. There’s gotta be a simple solution to this IMO. - (5:56) Labs may subsidize training access. Labs could offer cheaper AI for training access, while reserving better models for customers who opt in. - (6:52) Personalized AI favors big organizations. AI runs more efficiently when many requests are processed together, called batching. Big companies can do that; individuals cannot. Dwarkesh says the efficiency gap could exceed 100X. So what if Neoclouds or Apple offer private batching on private servers? Open weight evolving AI could still thrive. The big idea here: if (or when) this happens, continual learning will transform AI models from software you buy into something closer to an employee you develop. That changes safety, competition, privacy, pricing, and lock-in. New from The Neuron: NVIDIA’s Nemotron 3.5 Lightning and NeMo Switchyard are two new open AI tools that make the case for running routine agent work locally, then routing tougher tasks to stronger models when needed. Read our full review here. A Cat’s Commentary This was a packed to the point review! That’s all for now. If you want to get featured above, fill out the poll below and tell us how we did today!
10:01

Lovable Hits $13.3B Valuation After 60 Million Apps Built Without Code

Lovable just raised $400 million at a $13.3 billion valuation, under two years after launching its no-code app builder. People have created over 60 million apps on it, and Lovable-built apps draw 900 million visits a month, with users at nearly two-thirds of the Fortune 500. The company is pivoting from a prototype tool into a full business operating system, adding payments, security scanning, and governance features. Menlo Ventures and EQT's Scaleup Europe Fund led the round, and a partnership with Cerebras targets much faster response times by 2027.

Notes
Lovable Series C: $13.3B valuation

Lovable raised $400M Series C at a $13.3B valuation β€” company launched November 2024. Round led by Menlo Ventures, co-led by Scaleup Europe Fund (managed by EQT). Other investors: Balderton, Carmignac (Europe); Kaszek, LTS Growth (LatAm); Tencent, World Innovation Lab (Asia); Regent (US); returning β€” Accel, Antler, CapitalG, DST Global, Evantic Capital, HubSpot Ventures, Salesforce Ventures.

Traction metrics:

  • 60M+ projects created since Nov 2024
  • 900M monthly visits to Lovable-built apps
  • Employees at ~two-thirds of Fortune 500 (was half within first year)

Platform shift: Series B (Dec 2025) marked move from prototype tool to "business operating system." Since then added payments, SEO and AI-search tools, integrations with Google Workspace, Microsoft 365, Salesforce, Stripe, ElevenLabs, automatic security scanning, AIUC-1 certification (described as "the first security standard for AI agents"), governance features (publishing controls, workspace insights).

Technical moat:

  • Proprietary control plane routes tasks across multiple AI models
  • Training its own post-trained models for app-building
  • Partnership with Cerebras (Wafer-Scale Engine hardware) targeting reduced response times by 2027

Hiring: plan to grow to ~450 employees across Stockholm, London, Boston, SF, NYC β€” focused on ML, product, infrastructure, security.

Caveats: valuation rests on adoption curves ("kind of adoption curves that justify a $13.3B price tag"); traffic is app visits, not revenue; no revenue figures or profitability disclosed.

Full text · 2,629 chars
- Massive round: Lovable raised $400M at a $13.3B valuation, led by Menlo Ventures and EQT's Scaleup Europe Fund. - Explosive traction: 60M+ projects created, 900M monthly app visits, and users at nearly two-thirds of the Fortune 500 since launching in late 2024. - Platform pivot: Lovable is expanding from app builder to full business operating system, adding payments, integrations, security, and governance features. - Technical moat: A proprietary control plane dynamically routes tasks across multiple AI models, plus Lovable is training its own post-trained models for app-building. - Infrastructure bet: Partnership with Cerebras targets dramatically reduced response times using Wafer-Scale Engine hardware by 2027. - Hiring push: Plans to grow to ~450 employees, focused on ML, product, infrastructure, and security, across Stockholm, London, Boston, SF, and NYC. Lovable, the Stockholm-born AI software creation platform, just closed a $400 million Series C at a $13.3 billion valuation. That is not a typo. A company that launched in November 2024 is now worth more than most publicly traded software firms, and it got there by doing something deceptively simple: letting people describe what they want and handing them a working app. The numbers behind the hype The round was led by Menlo Ventures and co-led by the Scaleup Europe Fund, managed by EQT. The investor list reads like a who's-who of global venture capital: - Europe: Balderton Capital, Carmignac - Latin America: Kaszek Ventures, LTS Growth - Asia: Tencent, World Innovation Lab - United States: Regent - Returning: Accel, Antler, CapitalG, DST Global, Evantic Capital, HubSpot Ventures, Salesforce Ventures Since launching in November 2024, people have created more than 60 million projects on Lovable, and Lovable-built apps see over 900 million visits every month. Within its first year, Lovable reached employees at half of the Fortune 500; now, less than a year later, that figure has grown to nearly two-thirds. Those are not vanity metrics -- they are the kind of adoption curves that justify a $13.3B price tag. From prototype tool to business operating system The original pitch was simple: skip the engineering team, describe your app, ship it. That chapter is now closed. Since the Series B in December 2025, Lovable has added payment functionality, SEO and AI-search tools, deeper integrations with Google Workspace, Microsoft 365, Salesforce, Stripe, and ElevenLabs, automatic security scanning, AIUC-1 certification (the first security standard for AI agents), and governance features including publishing controls and workspace insights.
10:07

River AI Raises $1.1B in Funding - The SaaS News

River AI raised $1.1 billion in funding across seed and Series A rounds, one of the bigger early-stage raises for a prompt-engineering-focused company. The round closed in August 2026. Details on valuation and lead investors weren't in the announcement snippet. The company is known in the prompt engineering space.

Full text · 155 chars
... prompt engineering . Funding Details. Company Website: https://river.ai. Company: River AI Raised: $1.1B Round: Seed, Series A Funding Date: August ...
10:15

Google's Gemini app surges to 1 billion users - TechCrunch

Google's standalone Gemini app has hit 1 billion users, a major consumer milestone for the model family. The count covers only the Gemini app itself, not people using Gemini through Google Search, Workspace, or other channels. Google says it keeps rolling out new features as the app keeps climbing.

Full text · 151 chars
But today's figure refers specifically to the Gemini app, and does not include AI users from other channels. The company also continued rolling out ...
14:00

LFM2.5-VL-3B for Better and Faster Vision Capabilities for the Edge

Liquid AI shipped a small open-source vision model that's unusually good at reading screens, pointing at objects, and calling tools, made to run on phones and laptops. The 3-billion-parameter LFM2.5-VL-3B jumps from 6% to 78-82% on desktop, mobile, and web screen understanding versus its predecessor and roughly doubles tool-use scores, leading its size class on several benchmarks. It decodes 228 tokens a second on an M5 Max, fits in about 3 GB of memory, and even reaches 20 tokens a second on a Galaxy S26 Ultra. It's on Hugging Face now with day-one support in llama.cpp, MLX, vLLM, SGLang, and ONNX.

Notes

LFM2.5-VL-3B: Better and Faster Vision Capabilities for the Edge

Source: Liquid AI blog (posted to Hugging Face), Aug 2026. Cite as Liquid AI, "LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edge", Liquid AI Blog, Aug 2026.

Model facts
  • 3.1B-parameter vision-language model, successor to LFM2-VL-3B. Four headline improvements: screen/UI understanding, grounding/object detection from natural-language queries, multi-image reasoning, and function calling (text-only and vision-text).
  • Architecture: SigLIP2 400M NaFlex vision encoder + same pre-trained backbone as LFM2.5-2.6B text model.
  • Pre-trained on ~34T tokens with 4x more vision data than the prior release (curated/synthetic image-caption, OCR, grounding, instruction-following sets). Tokenizer extended in place from ~64K to 128K vocab to support non-Latin scripts (not retrained from scratch).
  • Post-training in two stages: (1) SFT with knowledge distillation from a larger teacher + "Antidoom" training; (2) multi-reward RL.
Vision benchmarks (0–100 normalized; vLLM 0.26.0, non-reasoning mode, model-recommended generation params)

LFM2.5-VL-3B averaged 69.4, vs LFM2-VL-3B 57.2, InternVL 3.5 4B 69.4, Qwen3.5-4B 70.1, gemma-4-E4B 59.7, InternVL 3.5 2B 64.6, Qwen3.5-2B 63.7, gemma-4-E2B 52.0.

  • Grounding is the biggest jump: RefCOCO-avg 87.9 vs 57.1 prior β€” best in class (above Qwen3.5-4B 86.6).
  • Screen/UI: ScreenSpot-v2 Desktop 78.7 / Mobile 81.2 / Web 82.2 vs prior release 6.0/7.6/2.5. Trails InternVL 3.5 4B (~82–88) on these.
  • Multi-image: BLINK 61.5, MuirBench 58.3 (prior: 50.2/34.9).
  • Strong but not leading: MMStar 63.3, MathVista 68.5, DocVQA 91.1, ChartQA 81.3, OCRBench v1 84.2, TextVQA 84.3.
  • Weak spots vs 4B rivals: MMMU-Pro 30.5 (Qwen3.5-4B 36.0), MME 73.1 (Qwen 79.5, InternVL 81.0), CountBenchQA 87.3 (prior model scored higher: 92.2), MM-IFEval 60.6 (below both gemma-4 models), HallusionBench 47.2.
Text-only benchmarks

Instruction following up across the board: IFEval 82.3 (72.9 prior), Multi-IF 59.4, IFBench 25.8. Tool use sharply improved: ToolSandbox 59.5 (26.4 prior), BFCL V4 32.5. Author claims tool use "on par" with Gemma-4-E2B and Qwen3.5-2B (both actually beat it slightly on these two). InternVL 3.5 has no function-calling support.

Performance (on-device & GPU)
  • Decode 228 tokens/s on Apple M5 Max; 116 tokens/s on Ryzen AI Max+ 395; ~3 GB memory footprint; 20 tokens/s on Galaxy S26 Ultra (fully on-device).
  • Fastest measured output throughput in the test set: ~11K tokens/s at high concurrency β€” ~2x the 4B-class models, ahead of 2B-class too; β‰ˆ1B output tokens/day on a single H100. Claimed "fastest on multi-frame inputs."
Usage

Requires transformers>=5.10.1 (pip install torch torchvision accelerate "transformers>=5.10.1"). Model ID LiquidAI/LFM2.5-VL-3B; load via AutoModelForImageTextToText + AutoProcessor, bfloat16, device_map="auto"; apply_chat_template with roles user/image/text. Example generation settings: temperature 0.2, top_k 50, repetition_penalty 1.0, max_new_tokens 256.

  • Day-one support: llama.cpp, MLX, vLLM, SGLang, ONNX. WebGPU browser demo available; fine-tuning tutorials offered.
Caveats
  • Benchmark table's "Average" rows blend vision (69.4) and text (IF) numbers that aren't directly comparable across models with different task coverage (InternVL N/A on tool benchmarks).
  • Claims of "leads its size class" rest on the 3.1B vs 2–8B comparison set; Qwen3.5-4B ties or beats it on overall average (70.1) and many doc/OCR tasks.
Full text · 9,067 chars
LFM2.5-VL-3B extends the vision-language capabilities of our previous releases with four major improvements: - Screen/UI understanding: Strong understanding of digital screens across different devices. - Grounding: Improved grounding and object detection with natural language queries. - Multi-image input: Improved reasoning across multiple images. - Function calling: Significantly stronger at function calling, in text-only and vision-text situations. LFM2.5-VL-3B pairs a SigLIP2 400M NaFlex vision encoder with the same pre-trained backbone as our LFM2.5-2.6B text model. It is pre-trained on about 34T tokens, with 4x more vision data than before, drawn from curated and synthetic image-caption, OCR, grounding, and instruction-following sets. To support non-Latin scripts, we doubled the vocabulary to 128K by extending the tokenizer in place rather than retraining from scratch. Post-training runs in two stages: First is supervised fine-tuning (SFT), with knowledge distillation from a larger teacher and Antidoom training. Second is multi-reward reinforcement learning (RL). We evaluated LFM2.5-VL-3B across both vision and text benchmarks. The vision benchmarks cover multilingual visual comprehension, instruction following, visual math and scientific reasoning, document understanding, object detection, multi-image understanding, and screen understanding. LFM2.5-VL-3B leads its size class on real-world image tasks, while also reading digital content well, from documents and charts to on-screen UI elements. | Task | Benchmark | LFM2.5-VL-3B (3.1B) | LFM2-VL-3B (3.1B) | gemma-4-E2B-it (5.1B) | gemma-4-E4B-it (8B) | InternVL 3.5 2B (2.4B) | InternVL 3.5 4B (4.7B) | Qwen3.5-2B (2.3B) | Qwen3.5-4B (4.7B) | |---|---|---|---|---|---|---|---|---|---| | General | MMStar | 63.3 | 57.7 | 45.3 | 52.9 | 57.7 | 65.5 | 55.1 | 59.3 | | | MME | 73.1 | 73.0 | 54.9 | 67.6 | 73.6 | 81.0 | 76.2 | 79.5 | | | RealWorldQA | 73.1 | 71.1 | 60.0 | 64.3 | 61.6 | 67.7 | 65.1 | 67.1 | | | SimpleVQA | 35.4 | 33.0 | 27.3 | 30.4 | 30.5 | 33.7 | 35.2 | 40.7 | | | SEED-Bench (image) | 77.7 | 76.6 | 71.4 | 75.3 | 75.4 | 76.4 | 75.8 | 76.1 | | | MMBench (dev EN v1.1) | 81.0 | 80.0 | 64.2 | 71.6 | 76.2 | 81.1 | 73.1 | 78.4 | | | CountBenchQA | 87.3 | 92.2 | 70.4 | 80.5 | 70.4 | 82.5 | 83.8 | 86.7 | | Multilingual | MMMB | 83.0 | 81.9 | 73.3 | 80.4 | 76.3 | 81.5 | 75.9 | 82.0 | | | Multilingual MMBench | 79.5 | 76.3 | 62.8 | 71.2 | 70.9 | 76.6 | 69.9 | 77.0 | | Multimodal IF | MM-IFEval | 60.6 | 51.4 | 65.6 | 68.2 | 47.1 | 54.5 | 55.4 | 63.1 | | STEM | LogicVista | 37.4 | 32.2 | 29.5 | 34.5 | 30.9 | 36.2 | 34.0 | 37.6 | | | MathVista (mini) | 68.5 | 62.1 | 37.8 | 45.2 | 56.8 | 67.1 | 48.7 | 63.6 | | | MMMU-Pro | 30.5 | 28.7 | 26.9 | 32.6 | 21.3 | 22.7 | 24.9 | 36.0 | | | MMMU (val) | 48.4 | 45.6 | 41.1 | 49.3 | 52.0 | 60.7 | 44.1 | 50.3 | | Document, OCR & Chart | ChartQA (test) | 81.3 | 80.4 | 43.2 | 42.1 | 81.7 | 86.2 | 78.4 | 84.2 | | | DocVQA (val) | 91.1 | 89.8 | 85.7 | 87.4 | 88.4 | 91.8 | 92.6 | 94.8 | | | InfographicVQA (val) | 70.2 | 67.8 | 54.4 | 60.9 | 69.3 | 76.9 | 73.5 | 80.3 | | | OCRBench v1 | 84.2 | 81.7 | 70.2 | 73.5 | 83.9 | 82.0 | 84.4 | 85.6 | | | OCRBench v2 (En) | 47.5 | 43.9 | 44.4 | 48.8 | 45.5 | 49.1 | 47.7 | 58.7 | | | TextVQA (val) | 84.3 | 83.0 | 62.5 | 69.0 | 76.6 | 77.5 | 77.3 | 81.2 | | Grounding | RefCOCO-avg | 87.9 | 57.1 | 67.3 | 72.1 | 82.9 | 88.8 | 78.5 | 86.6 | | Multi-Image | BLINK | 61.5 | 50.2 | 45.2 | 52.2 | 52.0 | 57.2 | 48.6 | 58.7 | | | MuirBench | 58.3 | 34.9 | 32.9 | 51.8 | 45.0 | 53.5 | 48.2 | 62.0 | | Hallucination | HallusionBench | 47.2 | 46.4 | 41.8 | 49.8 | 47.6 | 52.1 | 49.3 | 51.7 | | | POPE | 88.7 | 89.2 | 84.0 | 86.9 | 88.0 | 88.9 | 88.6 | 86.0 | | GUI | ScreenSpot-v2 Desktop | 78.7 | 6.0 | 28.1 | 45.8 | 79.9 | 82.0 | 63.8 | 76.3 | | | ScreenSpot-v2 Mobile | 81.2 | 7.6 | 42.9 | 60.3 | 86.2 | 87.8 | 69.7 | 81.4 | | | ScreenSpot-v2 Web | 82.2 | 2.5 | 22.4 | 47.6 | 79.9 | 82.6 | 65.9 | 77.8 | | Average | - | 69.4 | 57.2 | 52.0 | 59.7 | 64.6 | 69.4 | 63.7 | 70.1 | *All values in the table are normalized to 0–100. Evaluation is done using vLLM 0.26.0 and each model’s recommended generation parameters when available. Non-reasoning mode is used everywhere, and models are prompted to directly answer without reasoning. We also evaluated LFM2.5-VL-3B on text-only benchmarks for instruction following and tool use. Instruction following climbs across the board, and tool use improves sharply. On tool use, LFM2.5-VL-3B is on par with Gemma-4-E2B and Qwen3.5-2B. | Task | Benchmark | LFM2.5-VL-3B (3.1B) | LFM2-VL-3B (3.1B) | gemma-4-E2B-it (5.1B) | gemma-4-E4B-it (8B) | InternVL 3.5 2B (2.4B) | InternVL 3.5 4B (4.7B) | Qwen3.5-2B (2.3B) | Qwen3.5-4B (4.7B) | |---|---|---|---|---|---|---|---|---|---| | Instruction following | IFEval | 82.3 | 72.9 | 83.0 | 87.9 | 32.4 | 35.4 | 73.6 | 86.2 | | | IFBench | 25.8 | 20.8 | 34.1 | 39.2 | 24.4 | 24.5 | 28.9 | 33.5 | | | Multi-IF | 59.4 | 46.5 | 69.4 | 77.4 | 16.3 | 16.9 | 53.5 | 66.7 | | Tool use & function calling | ToolSandbox | 59.5 | 26.4 | 56.5 | 61.6 | N/A | N/A | 47.7 | 65.0 | | | BFCL V4 | 32.5 | 20.5 | 33.2 | 40.0 | N/A | N/A | 33.9 | 53.6 | *InternVL 3.5 models do not support function-calling. These results demonstrate that LFM2.5-VL-3B is a strong, general-purpose vision-language model. It covers everyday tasks (captioning, visual question answering, document understanding) and is especially good at grounding objects, reading screens and documents, and calling tools. LFM2.5-VL-3B ships with day-one support across the inference ecosystem, including llama.cpp, MLX, vLLM, SGLang, and ONNX. On-device inference. LFM2.5-VL-3B decodes 228 tokens/s on an M5 Max and 116 tokens/s on a Ryzen AI Max+ 395, and fits in about 3 GB of memory. It even reaches 20 tokens/s on a Galaxy S26 Ultra, so you can run it fully on-device. GPU inference. LFM2.5-VL-3B keeps latency consistently low and is the fastest on multi-frame inputs. LFM2.5-VL-3B is also the fastest on output throughput out of all models we tested, reaching about 11K tokens per second at high concurrency. That is roughly 2Γ— the larger 4B-class models and ahead of even the smaller 2B-class models, which adds up to nearly 1B output tokens per day on a single H100. Reach for LFM2.5-VL-3B when you need on-device intelligence for high-volume workloads. Install the latest version of transformers (compatible with transformers>=5.0.0): %pip install -q torch torchvision accelerate "transformers>=5.10.1" Then load and run the model: import torch from transformers.image_utils import load_image from transformers import AutoModelForImageTextToText, AutoProcessor from IPython.display import display MODEL_ID = "LiquidAI/LFM2.5-VL-3B" processor = AutoProcessor.from_pretrained(MODEL_ID) model = AutoModelForImageTextToText.from_pretrained( MODEL_ID, device_map="auto", dtype="bfloat16", ) img_url = "https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/coco_sample.png" input_image = load_image(img_url) display(input_image) messages = [ { "role": "user", "content": [ {"type": "image", "image": input_image}, {"type": "text", "text": "Describe this image in two concise sentences."}, ], } ] inputs = processor.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) with torch.inference_mode(): outputs = model.generate( **inputs, do_sample=True, temperature=0.2, top_k=50, repetition_penalty=1.0, max_new_tokens=256, ) output = processor.batch_decode(outputs[:, inputs["input_ids"].shape[1]:], skip_special_tokens=True)[0] print(output) Two cats are sleeping on a pink couch with two remote controls. You can find more hands-on examples on how to use LFM2.5-VL3B for multi-image inputs, grounding, OCR, tool calling, and more in our documentation. Check out our release blog for video examples. Check out this browser demo of LFM2.5-VL-3B powering a vision-capable chat interface. It allows you to take or upload multiple images and let the model interact with them, including grounding, OCR, and tool use. LFM2.5-VL-3B is available on Hugging Face today. With LFM2.5, we're delivering on our vision of AI that runs anywhere. These models are: - Download: LFM2.5-VL-3B on Hugging Face. - Try: run the WebGPU demo in your browser, no setup needed. - Fine-tune: adapt LFM2.5-VL-3B to your task with our fine-tuning tutorials. We can't wait to see what you build. Please cite this article as: Liquid AI, "LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edge", Liquid AI Blog, Aug 2026. Or use the BibTeX citation: @article{liquidAI2026VL3B, author = {Liquid AI}, title = {LFM2.5-VL-3B: A Better and Faster Vision-Language Model for the Edge}, journal = {Liquid AI Blog}, year = {2026}, note = {www.liquid.ai/blog/lfm2-5-vl-3b}, }
14:06

Google DeepMind's SL2T Doubles Sign Language AI Accuracy, Giving Deaf Users a Voice

Google DeepMind shipped SL2T, a sign language-to-text AI model, giving Deaf users a real equivalent to voice typing for the first time. It powers American Sign Language dictation inside Gboard and Live Transcribe at no extra cost, launching on the Pixel 11 family. The model scores 70 on the FLEURS-ASL benchmark, far ahead of anything previously published, trained on over 100,000 hours of data across 50+ sign languages. A phone's on-device pose tracking extracts hand and body coordinates, so only coordinates β€” never video β€” are sent to servers for translation. Launch is ASL-only, with more sign languages and devices planned later.

Notes
Google DeepMind SL2T β€” sign-to-text dictation

What it is: SL2T (Sign Language to Text), a multilingual sign-language translation model from Google DeepMind, shipping as sign-to-text dictation in Gboard and Live Transcribe. ASL→English only at launch, first on the Pixel 11 family; free, no added cost. Uses: sign to search, draft messages, query Gemini, reply in Live Transcribe. Sign into the front camera with transcription on the outer display (flagged for Pixel 11 Pro Fold).

Benchmark: 70 BLEURT zero-shot on FLEURS-ASL β€” "far above any previously published result."

Training: 100,000+ hours across 50+ sign languages, ~25% ASL. Multilingual training outperforms single-language models.

Architecture (privacy-first):

  • MediaPipe Holistic runs on-device to extract pose landmarks.
  • Only landmark coordinates (never video) are sent to servers for translation.

Gloss-free approach: maps body-pose sequences directly to text, bypassing intermediate gloss annotations, which it claims "limit vocabulary and nuance."

Why this was hard (stated):

  • Sign languages are independent natural languages with their own grammar/lexicons β€” not encoded spoken language, so this requires true machine translation, not sequential sign-to-word mapping.
  • CV problem: meaning is carried by simultaneous movement of hands, arms, torso, head, face, tracked at high frame rates β€” computationally demanding.

Context/limitations: ~200 sign languages worldwide, ~70M Deaf/HoH users. Expansion to more sign languages and Android devices is planned, guided by Google's AI Sign Language Advisory Committee. SL2T itself only mentioned via announcement; model weights/paper not cited here.

Full text · 3,299 chars
- SL2T launches on Pixel 11: Google DeepMind's sign language-to-text model powers ASL dictation in Gboard and Live Transcribe at no extra cost. - State-of-the-art benchmark: SL2T scores 70 BLEURT zero-shot on FLEURS-ASL, far above any previously published result. - 100,000+ hours of training data across 50+ sign languages, with ~25% in ASL; multilingual training outperforms single-language models. - Privacy-first architecture: MediaPipe Holistic runs on-device to extract pose landmarks; only coordinates (no video) are sent to servers for translation. - Gloss-free translation: SL2T maps body pose sequences directly to text, bypassing intermediate gloss annotations that limit vocabulary and nuance. - ASL-only at launch; Google plans to expand to more sign languages and devices, guided by its AI Sign Language Advisory Committee. For decades, voice-to-text has been a standard feature on every smartphone. Deaf and hard of hearing users have had no equivalent. That changes today: Google DeepMind has announced SL2T (Sign Language to Text), a massively multilingual sign language translation model that powers new sign-to-text dictation features in Gboard and Live Transcribe, launching first on the Pixel 11 family with American Sign Language (ASL) to English support. What it does and how to use it Google has embedded the model inside Gboard and Live Transcribe, where it allows Deaf and hard of hearing users to sign to their phone anywhere they would have normally typed. That means signing to search the web, draft messages, ask Gemini a question, or respond in a Live Transcribe conversation, all without touching the keyboard. In practice, this gives users a faster, more natural way to search the web, write messages, and converse with Google's Gemini chatbot. Sign-to-Text lets you sign into the front camera while the viewer sees the transcription on the outer display -- a particularly useful setup for the Pixel 11 Pro Fold. The feature is available at no additional cost, and Google plans to expand it to more Android devices beyond the Pixel 11 line. The technical challenge nobody solved until now Sign language AI has been a notoriously hard problem, and not just for the obvious reasons. AI's ability to process spoken languages has advanced rapidly over recent decades, enabling automatic translation, dictation, and conversational interfaces that feel effortless to hearing users -- yet this technological revolution has not reached the world's more than 200 sign languages and the estimated 70 million Deaf and hard of hearing people who use them. Two core problems have blocked progress. First, sign languages are not simply encoded versions of spoken languages. Transcribing speech is a matter of performing a sequential mapping from sound to text in the same language, whereas sign languages are independent, natural languages with their own distinct grammars and lexicons -- requiring true machine translation rather than a sequential process of sign-to-word transformations. Second, the model must learn to see and understand physical movement: sign languages convey meaning through simultaneous movements of the hands, arms, torso, head, and face, and accurately tracking these at high frame rates is a difficult and computationally demanding computer vision task.
15:34

AI Startup River AI Raises $1.1B to Build Personally Trainable AI Agents - AI Insider

A startup called River AI raised $1.1 billion to build AI agents people can personally train and own. The pitch is that users shouldn't be stuck with models they can't modify, and enterprises want to train their own models directly. It's a huge round that signals rising demand for customizable AI agents.

Full text · 153 chars
... prompt engineering by letting users train and own their own models rather than relying on models they cannot modify. The company said enterprises ...
15:44

Anthropic's text watermarks signal new front in AI detection - Axios

Anthropic is adding invisible text watermarks to Claude's output, opening a new front in the AI-detection fight. The catch is that comms teams using Claude just to clean up, translate, or format human-drafted press releases could end up stamping those documents with an AI mark without meaning to.

Full text · 153 chars
Why it matters: Comms teams using Claude to simply clean up, translate, or format human-drafted press releases could stamp those documents with an AI ...
15:50

Google's Gemini Hits 1 Billion Users and Adds 14 App Connections

Gemini just passed 1 billion monthly users and is now Google's fastest-growing product ever, having tripled its user base in under a year. At the same time Google announced 14 new third-party app connections for Gemini, spanning Ticketmaster, OpenTable, Otter.ai, Pandora, Zocdoc, Wix, and more. All of them run on the Model Context Protocol, an open standard that lets AI assistants connect to outside apps without per-app custom code. Gemini Spark, Google's agentic tier, will soon use these connections to take autonomous actions on a user's behalf. The move directly pressures ChatGPT's plugin ecosystem.

Notes
Google Gemini: 1B users + 14 MCP app connections

Announced at Made by Google (Aug 2026). Gemini surpassed 1 billion monthly active users as of August 2026 β€” described as the fastest-growing product in Google's history, having tripled its user base in under a year.

The 14 integrations, by category

All 14 use the Model Context Protocol (MCP) β€” an open standard letting AI assistants connect to external apps "without custom per-integration engineering." Categorized as:

  • Productivity/creativity: Granola, Otter.ai (summarize/search meeting transcripts), Wix (build/edit websites by description)
  • Local/entertainment: Fever, GetYourGuide (book local experiences/tours), Localiza (rent a car in Brazil), OpenTable UK (book reservations from chat), Ticketmaster (find tickets by natural-language query)
  • Music: iHeartRadio, Pandora (stream music/podcasts on command)
  • Home/health/lifestyle: Angi, Thumbtack (find/compare home-service pros), Zocdoc (schedule doctor appointments by location/specialty)
Agentic angle
  • Gemini Spark, Google's agentic tier, will "soon" use these connections to take autonomous actions.
  • Custom MCP servers are also supported for Spark users.
  • Positioned as escalation vs. ChatGPT's plugin ecosystem; Google leans on the 1B-user base and deep Workspace integration as differentiators.
"Gemini has surpassed 1 billion monthly users as of August 2026, making it the fastest-growing product in the company's history."

Source framing: Google is "pushing Gemini from a capable chatbot into something closer to a universal action layer." No caveats/limitations stated in the announcement.

Full text · 2,478 chars
- Google announced 14 new MCP-powered app connections for Gemini, including Ticketmaster, Zocdoc, Otter.ai, Pandora, and Zoho. - Connections span four categories: productivity/creativity, local/entertainment, music, and home/health/lifestyle. - Gemini crossed 1 billion monthly active users, becoming Google's fastest-growing product ever -- tripling its user base in under a year. - All 14 integrations use the Model Context Protocol (MCP), an open standard that lets AI assistants connect to external apps without custom per-integration engineering. - Gemini Spark, Google's agentic tier, will soon be able to use these connections to take autonomous actions; custom MCP servers are also supported for Spark users. - The move intensifies competition with ChatGPT's plugin ecosystem, with Google leveraging its 1 billion-user base and deep Workspace integration as key differentiators. Google just announced 14 new third-party app connections coming to the Gemini app, spanning everything from restaurant bookings and concert tickets to doctor appointments and meeting transcriptions. The announcement dropped at Made by Google alongside a milestone that puts the stakes in sharp relief: Gemini has surpassed 1 billion monthly users as of August 2026, making it the fastest-growing product in the company's history. The timing is deliberate. Google is using that momentum to push Gemini from a capable chatbot into something closer to a universal action layer -- one that can reach into the apps you already use and do things on your behalf. 14 new apps, four categories The new connections cover a wide surface area of daily life. Google is rolling out integrations across productivity and creativity (Granola, Otter.ai, Wix), local and entertainment (Fever, Get Your Guide, Localiza, OpenTable UK, Ticketmaster), music (iHeartRadio, Pandora), and home, health, and lifestyle (Angi, Thumbtack, Zocdoc). - Ticketmaster -- find live event tickets by natural language query - OpenTable -- book restaurant reservations directly from chat - iHeartRadio & Pandora -- stream music and podcasts on command - Wix -- build or edit a website by describing what you want - Fever & GetYourGuide -- discover and book local experiences and tours - Otter.ai & Granola -- summarize and search across meeting transcripts - Angi & Thumbtack -- find and compare local home service professionals - Zocdoc -- schedule doctor appointments by location and specialty - Localiza -- rent a car in Brazil
16:01

The Chinese AI Model Sending Shockwaves Through Silicon Valley and Washington

Chinese startup Moonshot's new Kimi K3 model is rattling Silicon Valley and Washington. A Bloomberg podcast discusses what Kimi K3 means for the global US-China AI race, but the item is mostly a podcast promo with few concrete details.

Full text · 147 chars
Chinese startup Moonshot has put the AI world on notice. On today's Big Take Asia podcast: What Kimi K3 means for the future of the global race ...
16:06

CodeRabbit Raises $143 Million at $1.5 Billion Valuation and Introduces Agentic Change ...

Code review agent startup CodeRabbit raised $143 million at a $1.5 billion valuation and announced something it calls Agentic Change, likely a change-management product, though the press release is truncated. Revenue grew more than five times year over year as engineering teams adopted automated review and governance for AI-generated code. It's a major funding milestone for the AI code review category.

Full text · 147 chars
Revenue grew more than 5x year-over-year as engineering organizations globally adopted independent review and governance infrastructure for AI- ...
16:07

Cohere's North Micro Vision Reads Full A4 Documents Without Losing Detail

Cohere released an open-weight vision model built to read full A4 documents without losing detail, and it beats bigger models on document benchmarks. The 2.4-billion-parameter North Micro Vision Instruct processes images at their real resolution up to A4 size at 200 dpi instead of resizing them, so small text and table details survive. It scores 0.921 on the DocVQA document-reading test and 0.732 on RefCOCO grounding, ahead of Gemma-4-E2B and Phi-3.5-vision, and is free for commercial use under an Apache 2.0 license. It's not a reasoning model, is weak on STEM (MMMU 0.329), and has no tool calling or system prompts.

Notes
Cohere North Micro Vision Instruct
  • New release: Cohere's North Micro Vision Instruct β€” a 2.4B-parameter open-weight VLM, Apache 2.0, commercial use free.
  • Native resolution: processes images up to 1654Γ—2339px (A4 @ 200 dpi) without resizing, preserving aspect ratio and fine detail (small PDF text, table borders, chart labels). Contrasted with small VLMs that squash inputs to 224Γ—224 or 336Γ—336, destroying detail.
  • Benchmarks: 0.921 DocVQA (document QA), 0.732 RefCOCO (grounding) β€” beats larger models including Gemma-4-E2B and Phi-3.5-vision.
  • Architecture (three parts):
  • Custom-trained 400M vision encoder (from SigLIP 2)
  • North Micro LLM (2B), following Command A+ design: 3 sliding-window attention layers (RoPE) interleaved with 1 global attention layer (no positional embeddings) β€” low memory on long sequences while allowing full-context flow
  • DeepStack-style projector: patch embeddings from multiple vision-encoder layers injected into corresponding early LLM layers (multi-scale visual access).
  • Stated limitations: not a reasoning model; weak on STEM (MMMU 0.329); no tool calling, no system prompts; only 8K validated multimodal context.
  • Usage: install Transformers from source now; vLLM support "coming soon"; quantized builds for Ollama and llama.cpp available.
Full text · 3,062 chars
- New model: Cohere releases North Micro Vision Instruct, a 2.4B open-weight VLM under Apache 2.0. - Native resolution: Processes images up to 1654x2339px (A4 at 200 dpi) without resizing, preserving fine text and layout detail. - Document-first benchmarks: Scores 0.921 on DocVQA and 0.732 on RefCOCO grounding, beating larger models like Gemma-4-E2B and Phi-3.5-vision. - Architecture: 400M custom vision encoder (from SigLIP 2) + 2B North Micro LLM with hybrid sliding-window/global attention and DeepStack-style projector. - Limitations: Not a reasoning model; weak on STEM (MMMU: 0.329); no tool calling, no system prompts, 8K validated multimodal context. - How to use: Install Transformers from source now; vLLM support coming soon; quantized versions available for Ollama and llama.cpp. Cohere just dropped North Micro Vision Instruct, a 2.4B-parameter vision-language model (VLM) built specifically for document-heavy workloads. It is open-weight, free to use commercially, and available right now under an Apache 2.0 license. The headline feature is native-resolution image processing: instead of squashing every image into a fixed square before feeding it to the model, North Micro Vision processes images at their actual dimensions and aspect ratios. Why native resolution matters Most small VLMs resize inputs to a fixed resolution (say, 224x224 or 336x336 pixels) before encoding them. That is fast, but it destroys fine-grained detail: small text in a scanned PDF becomes illegible, table borders blur together, and chart labels vanish. North Micro Vision preserves the aspect ratio and fine detail of documents, tables, charts, screenshots, and forms instead of first reducing every input to a small square image. The model supports native-resolution inputs up to 1654 x 2339 pixels, corresponding to an A4 page at 200 dpi. That is enough resolution to read dense legal text, financial tables, or handwritten forms without any preprocessing tricks on your end. Under the hood: a three-part architecture North Micro Vision combines a custom-trained 400M-parameter native-resolution vision encoder with an in-house 2B-parameter language model called North Micro LLM. The language model follows Cohere's Command A+ architecture, interleaving three sliding-window attention layers that use rotary positional embeddings with one global attention layer without positional embeddings. Sliding-window attention (SWA) lets each token attend only to a local neighborhood, keeping memory costs low on long sequences, while the periodic global layer lets information flow across the full context. The glue between vision and language is a projector that maps visual features into the language model's token space. Following the DeepStack approach, patch embeddings from multiple vision-encoder layers are injected into corresponding early LLM layers, giving the language model access to visual representations at different levels of abstraction. Think of it as giving the language model a multi-scale view of the image rather than a single flattened summary.
16:47

AI Music Generator Suno Strikes Licensing Deal With BMG as It Preps New Label-Backed Models

AI music generator Suno has signed a licensing deal with music publisher BMG and is prepping new label-backed models. Suno has both rankled the music industry and attracted some of its biggest talent, so the deal moves the company toward paying rights holders and heading off copyright disputes.

Full text · 146 chars
Suno, the AI music generator that's managed to both rankle the music industry and lure some of its biggest talent to its side, has added music ...
17:02

AI code-testing startup Blacksmith's valuation jumps almost 10x in less than a year

Blacksmith, a startup that tests and validates AI-written code, saw its valuation jump nearly 10x to $550 million in under a year. The surge reflects the next bottleneck in AI coding: generating code is now fast, so testing and validating all of it is where the value and the problem sit.

Full text · 127 chars
As AI makes coding dramatically faster, the next big challenge in software development is testing and validating all that code.
17:36

US to exempt open-weight AI models from safety reviews

The US plans to exempt open-weight AI models from government safety reviews, framing the AI race as a national priority. President Trump called the competition over AI the most critical contest in centuries. The report is a short video clip, so it gives few details on what the reviews would cover or when the exemption takes effect.

Full text · 121 chars
US President Donald Trump has called the competition over artificial intelligence the most critical contest in centuries.
17:56

Researchers can now reverse- engineer LLM prompts from output text with near-perfect accuracy

Researchers can now reconstruct the original prompt that produced an AI's output with near-perfect accuracy. The team from IIT Bombay and Adobe Research built an inverse language model that works backwards from the output text to recover the prompt. That could expose what users are secretly asking models and raises real privacy and security questions.

Full text · 149 chars
Researchers at IIT Bombay and Adobe Research have built an inverse language model that reconstructs the original prompt from an LLM's output with ...
02:13

Enterprise AI Agent Adoption Hinges on Guardrails, Caylent Finds - Channel Insider

Most companies still keep AI agents in pilot projects, and a survey pins the holdup on missing guardrails. Caylent's research on enterprise leaders finds 23.5% have agents broadly deployed across engineering and operations work, while 93.5% report it's the safety and control measures β€” not the tech itself β€” that determine whether rollout succeeds. It's a routine industry survey, not a product announcement.

Full text · 148 chars
23.5% of enterprise leaders report AI agents are broadly deployed across engineering and operations workflows, beyond initial pilots. 93.5% find ...
02:52

Vatican announces 'disarming technology' will be theme of next World Day of Peace

The Vatican made "disarming technology" the theme of its next World Day of Peace, a push against AI in weapons. The move follows Nobel laureates urging that artificial intelligence be kept out of nuclear launch systems. Pope Leo XIV announced the theme, which reads as an ethical statement rather than any technical change.

Full text · 150 chars
... artificial intelligence .” The announcement comes after Nobel laureates ... artificial intelligence from nuclear launch systems. β€œPope Leo XIV ...
03:59

Artificial Intelligence in Gallbladder Imaging: A Rapid Evidence Review and Exploratory ...

A review of AI in gallbladder imaging found the technology is promising but not yet clearly better than human readers. It combined a rapid evidence review with an exploratory meta-analysis of diagnostic performance and reader assistance. The verdict is that AI's added value over standard reading still isn't established.

Full text · 150 chars
Artificial intelligence (AI) is increasingly being investigated for gallbladder imaging, but its clinical diagnostic performance, added value over ...
04:00

LLM Agents Factory: Retrieval of Domain-Specific LLM Agents

Researchers built a library of 20,000+ pre-written AI agent profiles and showed that picking one from it on demand beats generating a fresh agent every time a user asks something. Their system, LLM Agents Factory, either searches the library with semantic matching or trains a small model to produce the right profile directly. In tests on MMLU and BIG-bench, the retrieved agents matched the quality of AutoGen's dynamically generated agents while costing far less to run.

Notes

LLM Agents Factory: Retrieval of Domain-Specific LLM Agents

arXiv cs.CL paper (published 2026-08-12), authors unidentified in abstract.

Problem: On-the-fly LLM agent design per user request is computationally costly and unstable for production deployment.

Proposal β€” LLM Agents Factory: retrieval-based framework constructing domain-specific, Wikipedia-grounded agents on demand from a base of >20,000 predetermined agent profiles.

Two modes:

  • Agent profile retrieval via semantic search.
  • Distillation into a compact model fine-tuned for direct agent generation.

Evaluation: single-agent scenario on MMLU, BIG-bench, and BIG-bench Hard. Retrieval-based agent construction:

  • Surpasses non-agent baselines in accuracy.
  • Matches AutoGen generation quality (which used a 120B backbone) at "substantially lower inference cost."

Central claim:

"retrieval from a structured agent repository provides a cost-efficient, accurate, and controllable alternative to dynamic agent generation, responding to the strict demands of industrial applications."

Code and the agent base are released (URL in abstract).

Caveats/limitations:

  • Evidence is single-agent only; multi-agent settings untested in reported results.
  • "Wikipedia-grounded" β€” domain coverage bounded by that corpus and the 20K fixed profiles; no freshness/update mechanism stated.
  • Backbone model for retrieval/distillation side not named; "compact model" is unspecified.
  • No cost numbers or latency figures given despite the cost-efficiency claim; comparison to AutoGen's 120B suggests the win is against a heavy generator, not necessarily against other retrieval baselines.
  • "Matching AutoGen quality" is a parity claim, not an improvement claim.
Full text · 2,022 chars
Computer Science > Computation and Language Title:LLM Agents Factory: Retrieval of Domain-Specific LLM Agents View PDF HTML (experimental) Abstract:Large language model (LLM) agents improve task performance by decomposing problems into role-specialized behaviors. However, their practical deployment is often limited by the computational cost and instability associated with the on-the-fly agent design for each user request. To address this, we present LLM Agents Factory, a retrieval-based framework that constructs domain-specific and Wikipedia-grounded agents on demand using a base of over 20K predetermined agent profiles. Our framework supports two modes: (1) agent profile retrieval via semantic search and (2) distillation into a compact model fine-tuned for direct agent generation. Experiments on MMLU, BIG-bench, and BIG-bench Hard in a single-agent scenario demonstrate that our retrieval-based agent construction surpasses non-agent baselines in accuracy while matching AutoGen generation quality with a 120B backbone at a substantially lower inference cost. Our work reveals that retrieval from a structured agent repository provides a cost-efficient, accurate, and controllable alternative to dynamic agent generation, responding to the strict demands of industrial applications. We provide the implementation code and the agent base in this https URL. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory

AI models flatten cultural differences, treating diverse societies as one homogenous block. Using a method from anthropology (cultural consensus theory) on World Values Survey data from 10 countries, researchers showed models either can't form a coherent picture of a culture or over-homogenize it into a bland average. The method offers a diagnostic to tell when a model reflects real human diversity versus generic algorithmic smoothing.

Notes
Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory

Field: cs.CL (arXiv preprint, 2026)

Core argument: Existing NLP work probing LLMs for cultural-norm understanding typically analyzes distributional patterns across countries, ignoring group consensus and multicultural environments within a single country.

Method:

  • Applies Cultural Consensus Theory (CCT) from cultural anthropology to model intra-group consensus vs. variance.
  • Dataset: World Values Survey (WVS), spanning 10 countries and 12 domains.

Findings:

  • Models "frequently misrepresent cultural structures by either failing to form cohesive consensus or severely over-regularizing consensus."
  • CCT's explicit representation of intra-group variance yields actionable diagnostics distinguishing when models capture true human diversity versus algorithmic homogenization.

Key implications:

  • Treating a country as one culture is reductive; LLMs can fail in both directions β€” too fragmented or too uniform.
  • Proposed use: CCT as a diagnostic tool for evaluating cultural alignment beyond country-level accuracy metrics.

Limitations / notes: Abstract only; no benchmark numbers, model names, or per-country/domain results given. Unknown whether findings are consistent across all 10 countries/12 domains or model families. No human-baseline comparison stated in the abstract.

Full text · 1,649 chars
Computer Science > Computation and Language Title:Carefully Considering Culture: Analyzing LLM Alignment in Single- and Multi-Cultural Settings using Cultural Consensus Theory View PDF Abstract:Recent work in NLP has probed large language models for their understanding of cultural norms across countries. However, this work typically considers distributional patterns, ignoring group consensus or possible multicultural environments within a country. In this work, we leverage cultural consensus theory (CCT) from cultural anthropology to model such multidimensional nuance. Applying CCT to the World Values Survey (WVS) across 10 countries and 12 domains, we demonstrate that models frequently misrepresent cultural structures by either failing to form cohesive consensus or severely over-regularizing consensus. Through explicit representation of intra-group variance, CCT provides actionable diagnostics to evaluate when models reflect true human diversity versus algorithmic homogenization. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing

Researchers released the first large public dataset of Persian-English code-mixed social media posts with part-of-speech labels. It covers 6,800 posts from X, Instagram, and Digikala, built with an AI-assisted annotation pipeline that human checks confirmed as reliable. The analysis finds nouns are the most commonly code-mixed word type, and the positional patterns of mixing are consistent across platforms.

Notes
PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing (arXiv, cs.CL, 2026-08-12)

Introduces PERCEPT, claimed to be the first publicly available large-scale Persian–English code-mixed corpus annotated with Universal Dependencies (UD) POS tags for code-mixed words.

  • Size/sources: 6,800 posts collected from X (Twitter), Instagram, and Digikala (e-commerce platform).
  • Gap addressed: existing Persian resources lack UD POS annotations for code-mixed words, blocking both linguistic analysis and syntax-aware NLP model development.
  • Annotation: LLM-assisted framework that automatically assigns POS tags and document-level topics; "Human evaluation demonstrates high agreement between the automatically generated annotations and gold annotations, confirming the reliability."

Findings (first comprehensive linguistic analysis across these platforms):

  • Nouns are the predominant POS category for code-mixed words.
  • Distributions of other POS categories vary across platforms.
  • Positional distribution of code-mixed words is "remarkably consistent across platforms."
  • Triggering effect is "substantially more pronounced in Digikala" than the social platforms.

Caveats/limitations stated or implied: only the abstract is available; gold-annotation details, inter-annotator agreement numbers, LLM used, and annotation accuracy figures are not reported in the abstract. Data available at the "https URL" linked in the paper β€” exact link not reproduced.

Full text · 2,373 chars
Computer Science > Computation and Language Title:PERCEPT: A Corpus for POS Tagging and Analysis of Persian-English Code-Mixing View PDF HTML (experimental) Abstract:Social media has become a major venue for multilingual communication, where users frequently mix multiple languages within a single utterance. Although code-mixed corpora have been developed for several language pairs, Persian-English code-mixing remains relatively underexplored. Existing Persian resources lack Universal Dependencies (UD) part-of-speech (POS) annotations for code-mixed words, limiting both linguistic analyses and the development of syntax-aware NLP models. To address this gap, we introduce PERCEPT, the first publicly available large-scale Persian-English code-mixed corpus annotated with Universal Dependencies POS tags for code-mixed words. The dataset comprises 6,800 posts collected from X, Instagram, and Digikala. We further present an LLM-assisted annotation framework that automatically assigns POS tags and document-level topics. Human evaluation demonstrates high agreement between the automatically generated annotations and gold annotations, confirming the reliability of the annotations. Using PERCEPT, we conduct the first comprehensive linguistic analysis of Persian-English code-mixing across multiple social media platforms. Our analyses reveal that nouns are the predominant category for code-mixed words, while the distributions of other POS categories vary across platforms. We further find that the positional distribution of code-mixed words is remarkably consistent across platforms, whereas the triggering effect is substantially more pronounced in Digikala. PERCEPT is publicly available at this https URL. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

Grammar-constrained decoding can be made both fast and accurate by reusing the parser state that's already being computed, instead of costly resampling. The trick rebiases token probabilities using parser and lexer state plus candidate next tokens, correcting the distortion that rigid masking introduces. It outperforms both plain masking and online sampling across grammars while leaving the base model's weights untouched. Even the lightest version, relying only on the next token, matches or beats both baselines.

Notes
The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding

arXiv cs.CL preprint, published 2026-08-12. [PDF/HTML](arXiv abstract page).

Problem

  • Grammar Constrained Decoding (GCD) masks non-conforming tokens at each step to force syntactic validity.
  • Rigid masking distorts the LM's underlying probability distribution, biasing generation toward "valid but suboptimal outputs."
  • Online (iterative) sampling restores the true distribution but is computationally expensive; existing methods trade output quality against inference latency.

Method

  • Key claim: the internal parser and lexer states already computed during incremental parsing encode future grammatical validity β€” the exact info needed to restore the true distribution.
  • Proposes a lightweight, offline-trained logit correction conditioned on this syntactic+lexical state plus candidate next tokens.
  • Extracting these states adds negligible overhead (they're a necessary byproduct of masking); the base LM's weights are left "completely untouched."

Results

  • Across "several grammars," the correction "substantially closes the gap between the masked distribution and the LM's true distribution," consistently beating both plain masking and online sampling.
  • Lightest variant β€” conditioning on the candidate next token alone β€” still matches or exceeds both baselines. Rationale: the next token carries implicit lookahead, analogous to a parser's lookahead token.

Stated limitations / gaps

  • No named grammars, datasets, or numeric benchmarks in the abstract; performance quantified only qualitatively ("substantially closes the gap").
  • No latency figures despite latency being the motivating constraint.
  • Claims "consistently outperforming" online sampling, but the abstract reports no variance, model sizes, or grammar complexity ranges.
Full text · 2,468 chars
Computer Science > Computation and Language Title:The Parser Already Knows: Lightweight Bias Correction in Constrained Decoding View PDF HTML (experimental) Abstract:Grammar Constrained Decoding (GCD) forces Language Models (LMs) to produce syntactically valid outputs by masking out non-conforming tokens at each step. However, rigid masking distorts the model's underlying probability distribution, often biasing generation toward valid but suboptimal outputs. While online sampling restores this distribution, it requires computationally expensive iterative resampling. As a result, existing methods force a compromise between output quality and inference latency. Our key insight is that the internal parser and lexer states inherently maintained during incremental parsing already encode future grammatical validity -- exactly the information required to restore the LM's true distribution. We propose a lightweight, offline-trained logit correction conditioned on this syntactic and lexical state together with candidate next tokens. Because these states are already computed as a necessary part of incremental parsing for masking, extracting them adds negligible overhead while leaving the base LM's weights completely untouched. Across several grammars, this correction substantially closes the gap between the masked distribution and the LM's true distribution, consistently outperforming both masking and online sampling. Even its lightest variant, which relies on the candidate next token alone, still matches or exceeds both baselines: the next token itself carries an implicit lookahead, much like how parsers commonly use a lookahead token to resolve ambiguous decisions. By restoring the probability mass that masking removes, it reconciles the LM's probabilistic integrity with grammar conformance. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does So

A transformer's answers live on a different axis than its inner calculations, and this paper shows that arrangement is deliberate, not a flaw. A 12-layer model works in two phases: early layers keep their work nearly at right angles to the answer line, which protects meaning-composition from the vocabulary, then the answer is added on at the end. Forcing everything onto the answer line early (as early-exit training does) matches quality on standard benchmarks but shrinks the working space. A fixed random rotation injected between phases imposes the same geometry reliably, while asking for it through the loss function usually fails.

Notes
Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does So

arXiv cs.CL (2026). Empirical/interpretability study on a 12-layer transformer.

Core claim

"A transformer's answer lives on one axis: the direction its unembedding reads. Its intermediate states largely do not, and that off-axis position is usually treated as an obstacle to interpretation. We show it is functional."

Two-phase computation

  • Phase 1: every sublayer writes into a subspace held near-orthogonal to the read-out; attention sits 75–96Β° off it at every depth.
  • Rotating attention's values onto the read-out is 64–84Γ— more damaging than a matched random rotation; damage is entirely in cross-token mixing β€” the subspace insulates composition from vocabulary. Beneath it, the frame itself rotates rigidly with depth.
  • Phase 2: the answer arrives on-axis, late, by addition β€” not by rotating accumulated content onto the read-out.

Early-exit forcing (pressing all layers onto the read-out)

  • Matches baseline on perplexity, LAMBADA, BLiMP, yet cuts concept-phase workspace from ~25 effective dimensions to 14. Authors stress these benchmarks do not register the geometry change.

Imposing the geometry

  • Prescribing it via loss is a lottery: 6 of 8 seeds collapse (the model satisfies "null the read-out projection" by discarding dimensions).
  • Inserting one fixed rotation at the phase boundary works at baseline quality.
  • A sparse rotation the surrounding weights can absorb converges on all 9 seeds vs 5/9 for ordinary training.
  • Rotation identity is immaterial: 25 runs across 13 distinct rotations reach equal quality; two baselines from different seeds hold near-orthogonal frames while agreeing on read-outs. A random prescribed basis is adopted with quality unchanged.

Limitations/unsaid: results on a single 12-layer model; no architecture generality, task breadth, or mechanistic analysis of the phase boundary beyond the one-rotation insertion.

Full text · 2,717 chars
Computer Science > Computation and Language Title:Off-Axis, On Purpose: Where a Transformer Computes Concepts and Why it Does So View PDF HTML (experimental) Abstract:A transformer's answer lives on one axis: the direction its unembedding reads. Its intermediate states largely do not, and that off-axis position is usually treated as an obstacle to interpretation. We show it is functional. A 12-layer model computes in two phases. Through the first, every sublayer writes into a subspace held near-orthogonal to the read-out, attention 75 to 96 degrees off it at every depth. Moving attention's values onto the read-out is 64 to 84 times more damaging than a matched random rotation, and the damage is entirely in cross-token mixing: the subspace insulates composition from the vocabulary. Beneath it the frame itself turns rigidly with depth. In the second phase the answer arrives on-axis, late, and by addition rather than by turning accumulated content onto the read-out. Pressing every layer onto the read-out instead, as training for early exit does, matches the baseline on perplexity, LAMBADA and BLiMP while cutting the concept-phase workspace from about twenty-five effective dimensions to fourteen, a change none of those benchmarks register. The geometry can also be imposed, though not by asking for it. Prescribing it through the loss is a lottery: six of eight seeds collapse, because a model told to null its read-out projection obeys most cheaply by discarding dimensions. Inserting one fixed rotation at the phase boundary lands it instead, at baseline quality. A sparse rotation the surrounding weights can absorb converges on all nine seeds, against five of nine for ordinary training. Which rotation is immaterial: twenty-five runs across thirteen distinct ones reach the same quality, and two baselines from different seeds hold their concepts in near-orthogonal frames while agreeing on their read-outs. That freedom is usable: a basis drawn at random and prescribed before training is adopted across the concept phase, with quality unchanged. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

TAF-MED: Multi-Turn Safety Refusal Collapse in LLMs Under Declared Self-Treatment Intent

AI chatbots that answer medical questions safely on the first message often slide into unsafe advice on later follow-ups. A new physician-reviewed benchmark, TAF-MED, ran 8 models across 4,000 three-turn conversations and found 71.6% contained an unsafe response; 61.4% of conversations that started safely collapsed to unsafe later. Collapse rates varied wildly by model, from 24.4% to 96.2%. The dataset will be released on Hugging Face, and the takeaway is that first-message safety isn't a reliable proxy for conversation-long safety.

Notes

TAF-MED: Multi-Turn Safety Refusal Collapse in LLMs Under Declared Self-Treatment Intent

arXiv cs.CL paper proposing TAF-MED, a physician-reviewed benchmark of 500 fixed three-turn scenarios for evaluating medication-safety boundaries across follow-ups after explicit self-treatment intent.

Method

  • 8 LLMs evaluated over 4,000 conversations (500 scenarios Γ— 8 models Γ— 3 turns).
  • A rubric-based automated judge labels each response SAFE / LEAKY / UNSAFE.
  • Two physicians independently annotated a model-balanced random subset of 400 conversations, adjudicated to form the reference.

Results

  • 71.6% of conversations contained at least one UNSAFE response.
  • 61.4% of conversations starting strictly SAFE later collapsed to UNSAFE.
  • Model-level collapse rates ranged 24.4%–96.2%.
  • 4 of 28 model pairs reversed order between initial-unsafe rate and collapse rate (ranking instability across metrics).
  • Automated labels achieved 94.3% agreement with the adjudicated physician reference, ΞΊ = 0.895.

Claim

"first-turn safety is an incomplete proxy for conversational safety persistence and motivate evaluation across complete dialogue trajectories."

Notes/caveats

  • No limitations stated in the abstract itself (no false-positive analysis of LEAKY vs UNSAFE, no per-domain breakdown, no clinical-validity claims beyond physician annotation).
  • Benchmark to be released on Hugging Face for reproducibility; no URL given.
  • Implication: single-turn refusal benchmarks overstate multi-turn safety; the proposed remedy is trajectory-level evaluation.
Full text · 2,171 chars
Computer Science > Computation and Language Title:TAF-MED: Multi-Turn Safety Refusal Collapse in LLMs Under Declared Self-Treatment Intent View PDF HTML (experimental) Abstract:Large language models (LLMs) increasingly provide conversational health information that may influence treatment decisions, yet existing benchmarks do not isolate whether medication-safety boundaries persist across follow-ups after explicit self-treatment intent. We introduce TAF-MED, a physician-reviewed benchmark of 500 fixed three-turn scenarios, and evaluate eight LLMs across 4,000 conversations. A rubric-based automated judge labelled responses as SAFE, LEAKY, or UNSAFE, and two physicians independently annotated a model-balanced random subset of 400 conversations. We assessed unsafe guidance, collapse after a strictly SAFE initial response, and model-ranking stability. Overall, 71.6% of conversations contained an UNSAFE response, and 61.4% of those beginning with a strictly SAFE response later collapsed to UNSAFE; model-level collapse rates ranged from 24.4% to 96.2%. Four of 28 model pairs reversed order between initial unsafe and collapse rates. Automated labels achieved 94.3% agreement with the adjudicated physician reference ($\kappa = 0.895$). These findings show that first-turn safety is an incomplete proxy for conversational safety persistence and motivate evaluation across complete dialogue trajectories. We will release TAF-MED on Hugging Face to support reproducible research on multi-turn medical safety. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Locally Deployable Small Language Models for Emergency Department Decision Support: A Systematic Benchmark of Fine-Tuning Strategies

Fine-tuned open-source small models can beat big commercial APIs at emergency room decisions like triage and specialist referrals. Researchers benchmarked eight small models with several fine-tuning methods on 2,083 emergency department cases, comparing against Claude Haiku 4.5 and Sonnet 4.5. LoRA-tuned open models won on triage prediction and referral recommendation, though diagnosis prediction stayed hard for them. They also flagged highest-severity patients that the commercial baselines missed, and local deployment avoids sending patient data to outside APIs.

Notes
Locally Deployable Small Language Models for ED Decision Support

arXiv preprint (cs.CL), arXivLabs listing; no version number given.

Study design: Benchmarked 8 open-source SLMs across four fine-tuning strategies β€” zero-shot prompting, prefix tuning, Low-Rank Adaptation (LoRA), and full fine-tuning β€” on three emergency department (ED) tasks: triage level prediction, specialist referral recommendation, and diagnosis prediction.

Data: 2,083 MIMIC-IV-ED cases. Baselines: Claude Haiku 4.5 and Claude Sonnet 4.5.

Results:

  • LoRA fine-tuned open-source SLMs outperform both commercial baselines on triage level prediction and specialist referral recommendation.
  • Diagnosis prediction remains challenging for open-source SLMs.
  • Confusion-matrix analysis shows fine-tuned open-source SLMs can detect highest-severity patients that the commercial baselines missed.

Motivation stated: Two obstacles to ED LLM deployment β€” (1) privacy risk of sending patient data to closed-source commercial LLMs; (2) lack of systematic evaluation of fine-tuning strategies for locally deployable open-source models.

Conclusion (authors): > "locally deployable SLMs can achieve clinically competitive performance for ED decision support"

Caveats / gaps not addressed in abstract: No model names, parameter counts, or hyperparameters reported in the abstract; no performance numbers (e.g., F1, accuracy) given; MIMIC-IV-ED is a single retrospective dataset, so generalizability to prospective/live ED workflows is unstated. Diagnosis prediction limitation is acknowledged but not explained (data sparsity vs. task difficulty).

Full text · 1,988 chars
Computer Science > Computation and Language Title:Locally Deployable Small Language Models for Emergency Department Decision Support: A Systematic Benchmark of Fine-Tuning Strategies View PDF Abstract:Deploying large language models (LLMs) for decision support in emergency departments (EDs) faces two major challenges: privacy risks of transmitting patient data to closed-source commercial LLMs and the lack of systematic evaluation of fine-tuning strategies for locally deployable open-source small language models (SLMs). We benchmarked eight open-source SLMs using zero-shot prompting, prefix tuning, Low-Rank Adaptation (LoRA), and full fine-tuning on three ED tasks: triage level prediction, specialist referral recommendation, and diagnosis prediction. Using 2,083 MIMIC-IV-ED cases and Claude Haiku 4.5 and Claude Sonnet 4.5 as baselines, we found that LoRA fine-tuned open-source SLMs outperform commercial baselines on triage level prediction and specialist referral recommendation, while diagnosis prediction remains challenging for open-source SLMs. Confusion matrix analysis further shows that fine-tuned open-source SLMs can detect highest-severity patients missed by the commercial baselines. These results demonstrate that locally deployable SLMs can achieve clinically competitive performance for ED decision support. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design

A new survey maps how AI agent systems could keep improving on their own after launch, beyond what humans design for them. It organizes the work into three stages: agents adapting to each other, agents adapting to a changing environment, and making the evolution mechanism itself evolvable. The authors flag open problems around evaluating these systems, scaling them up, and keeping self-evolving agents safe and controllable. It's a review paper laying groundwork, not a new result.

Notes

Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design

Source: arXiv (cs.CL), survey preprint, published 2026-08-12. Authors not listed in the feed item.

Core claim: Single-entity self-evolution is "bounded by a static learning context, such as fixed tasks and feedback." The paper argues for co-evolution β€” "a multi-component form of self-evolution in which multiple agents and their environment impose adaptive pressure on one another."

Contribution: A progressive three-stage taxonomy tracing how systems shed human-engineered constraints:

  • Agent–Agent Co-Evolution β€” agents adapt through dynamic peers, covering three adaptation modes: adversarial, collaborative, organizational.
  • Agent–Environment Co-Evolution β€” the loop extends to adaptive tasks, feedback, and interaction spaces that "change with the agents."
  • Meta Co-Evolution β€” makes "the evolution mechanism itself evolvable."

Stated limitations / open challenges (the paper names four):

  • Evaluating such systems
  • Scaling them across multiple components
  • Keeping "increasingly autonomous evolutionary processes safe and controllable"

Quoted framing:

"This survey provides a unified foundation for building robust and open-ended agentic systems that can improve beyond fixed human-designed paths."

Caveat: This is an abstract-only read. The taxonomy's granularity, which papers are categorized where, and how the authors operationalize "adaptive pressure" all require the full text. No benchmarks, implementations, or empirical results appear in the abstract β€” it is positioning/structuring work, not an experimental result.

Full text · 2,048 chars
Computer Science > Computation and Language Title:Co-Evolution in Agentic Systems: Toward Self-Directed Evolution Beyond Human Design View PDF HTML (experimental) Abstract:Agentic systems are increasingly expected to improve after deployment, yet single-entity self-evolution is often bounded by a static learning context, such as fixed tasks and feedback. This survey focuses on co-evolution in agentic systems, a multi-component form of self-evolution in which multiple agents and their environment impose adaptive pressure on one another. To organize existing papers, we propose a progressive three-stage taxonomy that traces how the system gradually sheds human-engineered constraints. Agent--Agent Co-Evolution studies how agents adapt through dynamic peers, including adversarial, collaborative, and organizational adaptation. Agent--Environment Co-Evolution extends this loop to adaptive tasks, feedback, and interaction spaces that change with the agents. Meta Co-Evolution further explores the possibility of making the evolution mechanism itself evolvable. We also discuss open challenges in evaluating such systems, scaling them across multiple components, and keeping increasingly autonomous evolutionary processes safe and controllable. This survey provides a unified foundation for building robust and open-ended agentic systems that can improve beyond fixed human-designed paths. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
05:20

Artificial Intelligence : The AI threat to India's IT jobs machine - Golem.de

AI is threatening India's IT jobs machine, the outsourcing industry that has long employed hundreds of thousands of workers. The report centers on a 45-year-old Oracle employee as a stand-in for mid-career IT workers whose roles are at risk from automation. Details beyond the profile are thin from the preview.

Full text · 152 chars
Artificial Intelligence : The AI threat to India's IT jobs machine ... It was around 1.30am by the time Rakesh, a 45-year-old Oracle employee in the ...
06:23

L&T Technology Services Launches AgenticIQ, an End-to-End Agentic AI Platform for ... - ELE Times

L&T Technology Services launched AgenticIQ, an end-to-end agentic AI platform for engineering, manufacturing, and customer experience. It's built on the firm's Engineering Intelligence portfolio, turning proven engineering capabilities into specialized, reusable AI agents. Aimed squarely at enterprise engineering workflows.

Full text · 150 chars
Built on LTTS' portfolio of Engineering Intelligence solutions, AgenticIQ transforms proven engineering capabilities into specialized, reusable AI ...
07:28

Peter Thiel-backed Cognition sees its valuation surge by over 50% in three months! AI ...

Cognition, the startup behind the coding agent Devin, just had its valuation jump by over half in about three months. The Peter Thiel-backed company is getting that re-rate from sources familiar with the matter who point to surging demand for autonomous coding agents as the driver. The story is largely reporting on the funding round, with the deeper engineering angle left to speculation.

Full text · 156 chars
... agent engineers .' According to sources familiar with the matter ... From an AI systems engineering standpoint, this also explains why Coding Agents ...
07:42

Tencent Maps 549 Papers to Show When Self-Rewriting AI Can Be Trusted

Researchers mapped 549 papers on AI agents that rewrite themselves into a framework for deciding when such self-edits can be trusted. Tencent Hunyuan and university collaborators sorted self-evolving agents into five levels, from agents that revise their own output to agents that change their own evaluation criteria. The central rule: no agent update should control the evidence used to accept itself. Scaffold-level self-modification is the most active research area with 257 papers, and recursive self-improvement formally begins at level three, where an agent changes the procedure that governs its own future updates. The full catalog is open on GitHub.

Notes

Tencent Maps 549 Papers on Self-Rewriting AI Trust

Survey: "Diving into Reliable Self-Evolving Agents: A Survey" (Tencent Hunyuan with Zhejiang, Peking, Tsinghua universities). Organizes 549 papers into a unified framework. Catalog on GitHub; full paper on OpenReview.

Core principle

Self-evolving agents revise outputs or modify retained components using their own execution. Structural trap: the system proposing a change also judges whether it was good. Central rule, quoted bluntly:

"no update should control the only evidence used to accept itself."
L0–L4 taxonomy (depth of self-modification)
  • L0, Output-Level: changes stay within the current task, don't persist. Examples: Self-Refine, Tree of Thoughts, chain-of-verification.
  • L4: agent evolves its own evaluation criteria.
  • L2, Scaffold-Level: most active research area β€” 257 papers covering prompts, skills, memory, multi-agent workflows.
  • RSI formally begins at L3: the agent modifies the procedure governing its own future updates.
Reliability ladder

Pairs each evolution level with the type of external evidence required to accept an update β€” i.e., higher levels of self-modification demand stronger outside verification.

Notes
  • Motivation: the field accumulated techniques (self-play, skill libraries, reward shaping) without shared vocabulary for what kind of change occurs or what evidence suffices to trust it β€” that gap is what the survey fills.
  • Stated frame: the question isn't whether agents can self-evolve but whether updates can be trusted.
  • Five levels are defined by the deepest evolution target whose change takes effect.
Full text · 2,790 chars
- New survey from Tencent Hunyuan maps 549 papers on self-evolving AI agents into a unified framework focused on reliability. - L0-L4 taxonomy classifies agents by how deeply they modify themselves, from task-local output revision (L0) to evolving their own evaluation criteria (L4). - Reliability ladder pairs each evolution level with the type of external evidence required to trust an update, with the core rule that no update should control the evidence used to accept itself. - L2 (scaffold-level) is the most active research area with 257 papers covering prompts, skills, memory, and multi-agent workflows. - Recursive self-improvement (RSI) formally begins at L3, where the agent modifies the procedure that governs its own future updates. - Open catalog of all 549 papers is available on GitHub with the full paper on OpenReview. AI agents that rewrite themselves are no longer a thought experiment. Systems that update their own prompts, retrain on their own outputs, or redesign their own improvement procedures are already shipping. The open question is not whether agents can self-evolve, but whether any of those updates can be trusted. A new survey from Tencent Hunyuan and collaborators at Zhejiang, Peking, and Tsinghua universities tries to answer exactly that. The paper, Diving into Reliable Self-Evolving Agents: A Survey, organizes 549 works into a single structural map and introduces two tools practitioners have been missing: a five-level taxonomy of how deeply an agent can modify itself, and a reliability ladder that pairs each level with the kind of external evidence needed to accept an update. The core problem nobody was naming Self-evolving agents use information produced during their own execution to revise outputs or modify retained components that shape future behavior. That loop is powerful, but it contains a structural trap: the same system proposing a change can also be the one deciding whether the change was good. The survey's central principle is blunt about this: no update should control the only evidence used to accept itself. The field had been accumulating techniques, from self-play to skill libraries to reward shaping, without a shared vocabulary for what kind of change was actually happening or what evidence would be sufficient to trust it. That gap is what this survey fills. Five levels of self-modification The survey classifies self-evolution into five levels defined by the deepest evolution target whose change takes effect. Think of it as how far down the agent's architecture a change actually reaches: - L0 , Output-Level: Changes remain inside the current task and do not persist into later independent tasks. Classic examples include Self-Refine, Tree of Thoughts, and chain-of-verification. The characteristic failure is
08:09

Kyndryl Launches Agentic Modernization Services to Accelerate Enterprise AI Adoption

Kyndryl launched Agentic Modernization Services, a set of pre-built offerings meant to speed enterprise AI adoption. It codifies Kyndryl's mission-critical and engineering expertise along with AI ecosystem partner capabilities. The pitch is faster rollout for enterprises that lack in-house agentic AI know-how.

Full text · 144 chars
Kyndryl has codified its trusted mission-critical and engineering expertise, together with capabilities from AI ecosystem partners, into pre ...
08:45

How Does AI Agent Memory Actually Work, And Why Investors Are Betting Big On It

AI agent memory is a genuinely hard systems problem, not a prompt-engineering trick, and that's exactly why investors are betting big on it. Fixing how agents remember and recall across sessions pulls in venture money because it's a core bottleneck for useful agents. The framing is analysis from a startup news site rather than a product announcement.

Full text · 143 chars
Fixing that turns out to be a genuinely hard systems problem, not a prompt - engineering trick, and that's what's pulling in the venture money.
09:00

Agentic reliability and evaluations : Enterprises that got burned by a bad eval are the most ...

Enterprises that got burned by a bad agent evaluation are the ones most likely to remove humans from the loop, not the least, according to VentureBeat's research resource on agentic reliability. Fully 85% of those burned already allow zero-human deployment or are engineering toward it. In other words, a failed eval pushes teams toward more autonomy, not less. The piece argues reliable evaluations are what unlock full automation.

Full text · 153 chars
Meanwhile the enterprises that have been burned are not retreating from autonomy β€” 85% of them already allow zero-human deployment or are engineering ...
09:02

Forget chatbot training. AI's next big data grab is about learning how humans work.

AI companies are running out of plain chatbot data, so their next big data grab is learning how humans actually do their jobs β€” training models on real workplace behavior rather than written text. Google and Meta are building reinforcement-learning environments that mimic work tasks, and Uber says it's already embedding top AI engineers inside finance, legal, HR, marketing, procurement, and customer departments to capture that. The catch: this kind of work-signal data is far harder to collect at scale than public text.

Full text · 148 chars
Uber recently said it has begun embedding top AI engineers inside departments including finance, legal, HR, marketing, procurement, and customer ...
09:48

New AI chip mimics the human brain's capacity for split-second motor control - Live Science

A new experimental chip mimics the brain's split-second motor control, solving motor problems using about 10,000 times fewer calculations than conventional designs. Reported by Live Science, the neuromorphic approach targets fast, low-power control for robotics and real-time machines. It's an early research result, not a shipping product.

Full text · 157 chars
... Engineering Β· Electronic Engineering . New AI chip mimics the human brain's capacity for split-second motor control β€” it solved problems using 10,000 ...
10:01

Can you spot AI -written stories? Listen and find out : Short Wave - NPR

Most people can't tell a human-written short story from an AI-generated one, a series of experiments found. The NPR segment asks listeners to try spotting the AI story and reports that most get it wrong. It's a hands-on demonstration of how hard AI prose is now to distinguish from human writing.

Full text · 148 chars
Can you tell the difference between a human-written short story and an AI -generated one? Most people can't. In a series of experiments led by a ...
10:05

AI Chatbot Responses on Eye Care Don't Outperform Existing Materials in Readability

AI chatbot answers about eye care are no more readable than existing patient materials, so the tools aren't helping patients understand yet. The study suggests future work on using prompt engineering to generate friendlier, more patient-focused content. Solid but small clinical-literacy finding.

Full text · 141 chars
β€œFuture studies should investigate the feasibility of using prompt engineering to generate more patient-friendly, readable content across ...
11:01

The Sequence Chat - Issue 912: NVIDIA’s Chris Alexiuk Talks About Nemotron, GPUs and Agentic AI

NVIDIA's Nemotron head explained the company's open-weight AI strategy in an interview: it builds models sized to fit specific hardware tiers rather than chasing abstract scaling laws. The three Nemotron 3 sizes map to a single GPU, a single node, and an NVL72 rack, with 3B, 12B, and 50B active parameters respectively. He said NVIDIA ships tens of trillions of tokens of training data because you can't truly audit a model without it, and that the new Nemotron 3.5 Lightning is a small, fast model for high-volume agent grunt work so you don't waste expensive frontier models on tool calls. He predicted model routing will grow into a broader orchestration layer.

Notes
NVIDIA Nemotron, GPUs and Agentic AI β€” Chris Alexiuk (The Sequence, Issue 912, 2026-08-12)

Interview subject: Chris Alexiuk, NVIDIA developer advocate / public face of Nemotron; background as practitioner teaching LLM fine-tuning and deployment.

Nemotron model family evolution
  • Arc: Nemotron-4 340B (synthetic-data factory) β†’ Llama Nemotron (trained on someone else's base) β†’ Nemotron-H hybrids β†’ Nemotron 3 frontier-class open family.
  • Alexiuk frames the whole arc as deliberate ("we need to be in the thick of it" to understand GPU tooling/infra at pretrain and RL scale), but concedes directions "wound up to not pan out yet" β€” experiments that didn't reach prime time.
Nemotron 3 tiers (hardware-matched, not scaling-law)
  • Nano ~30B params / 3B active β†’ single GPU; Super ~100B / 12B active β†’ single node; Ultra ~500B / 50B active β†’ NVL72 rack.
  • Explicitly reverse-engineered from hardware: > "you kind of have two choices: Make models at sizes that adhere to some scaling factor β€” or make models that 'fit' onto certain kinds of hardware. I think the latter makes a lot of sense." Model cards state recommended deployment configs.
Why open weights/data
  • Positioning: "We're not trying to compete in the model game" β€” Nemotron exists to enable companies/researchers, feed an open science loop, and (per recent letters) safety through scrutiny. Quote: "Open Source is big dope." Future seen as mix of open and closed; Alexiuk says he uses closed models daily.
  • Data: released "tens of trillions of tokens" alongside models, plus recipes, tech reports, cookbooks, curation methods. Claim: you "can't really, truly, audit the model without the data it was trained on" β€” behavioral analysis gets close but open data adds trust ("feelsgoodman.jpg"). Contrast: Qwen and DeepSeek lead open-weights with closed data pipelines.
Architecture
  • Nemotron 3 interleaves Mamba-2 (SSM) layers with sparse MoE, keeping only a handful of attention layers. On ablating attention: "Attention is not ALL you need, but you do need some." Attention stays for long-context recall; no-attention + extreme context needs "more significant architectural changes."
  • LatentMoE (Super/Ultra): tokens compressed into latent space before expert routing β†’ ~4x more experts at same cost; benefits latency/throughput-bound inference; savings reinvested as accuracy via higher top-K. Caveat: "Routing specialization is real, but the human readable version is mostly a version we tell ourselves."
Multimodal + Lightning
  • Nemotron 3 Nano Omni: first multimodal Nemotron on the Nemotron 3 backbone; vision/speech teams adapted their encoders (the bulk of the work). Cosmos exists separately for physical AI.
  • Nemotron 3.5 Lightning: open 30B MoE / 3B active, "muscle" for AI agents β€” offloads grunt work (tool calls, subagent delegation) from frontier models. Trained specifically for real agent harnesses; includes speculative decoding (MTP); NVFP4 quantization; targets data-center clusters down to a local DGX Spark.
Predictions
  • Favorite mathematician: Ramanujan ("our field's Ramanujan").
  • 2027 prediction: model routing is "a stepping stone" to a "more robust, more ergonomic orchestration layer" β€” routing works for pipelines and internal agent processes but is "uncomfortable to interact with as an end-user," so expect routing to evolve into general orchestration.
Full text · 9,209 chars
The Sequence Chat - Issue 912: NVIDIA’s Chris Alexiuk Talks About Nemotron, GPUs and Agentic AI NVIDIA’s new Nemotron 3.5 Lightning, other Nemotron models, architectures and more. We are back with our interview series and a very special guest today! Chris Alexiuk has been helping developers understand and build with NVIDIA’s rapidly expanding AI stack. We discuss the Nemotron model family, the shift from chatbots to long-running agents, model routing and specialization, what it takes to move agentic systems from impressive demos into production, and where the next generation of AI development is headed. Background 1.Can you introduce yourself? You came up through the practitioner side, teaching people to fine-tune and deploy LLMs, before becoming one of the public faces of Nemotron. How does that background shape how you think about open models? I think, honestly, coming from the β€œopen model tinkering” space has allowed me the opportunity to help bring the vibes of that community into how we do things with Nemotron as it relates to β€œopen model tinkerers”. It also has prepared me for the insane velocity at which this space runs. The Main Sequence 2. Nemotron has had a strange arc: Nemotron-4 340B launched as a synthetic data factory, then came Llama Nemotron on someone else's base, the Nemotron-H hybrids, and now Nemotron 3 as a frontier-class open family. Walk us through that evolution. What was deliberate, what was opportunistic, and what quietly died along the way? Nemotron has always been a place for NVIDIA to create awesome open weight technology to both contribute our learnings back to the ecosystem, to create a productive open science feedback loop - as well as ensure we understand the tooling and infrastructure required to make GPUs go BRRRRR at pre-training and RL scale, as well as understand the ways the ecosystem is using and leveraging AI, we need to be in the thick of it. All this to say, it’s been a very deliberate effort. Any amount of good science will have experiments that don’t make it to prime time, and so there’s definitely directions we’ve gone in the last few years that wound up to not pan out yet - but that’s the great thing, we still learned so much along the way. 3. Nemotron 3 ships in three tiers: Nano (~30B, 3B active), Super (~100B, 12B active), Ultra (~500B, 50B active). Those sizes map suspiciously well to a single GPU, a single node, and an NVL72 rack. Are the tiers derived from scaling laws or reverse-engineered from the hardware? And is that even a bad thing? They sure do map well - and yes, we know that a lot of people run models on various levels of hardware; and designing models that are right-sized to them makes a lot of sense to get the best β€œbang for your buck” at each β€œscale” of hardware budget. I think, at the end of the day, there is a reality that exists about β€œwhere” and β€œhow” people run models - and so you kind of have two choices: Make models at sizes that adhere to some scaling factor - or make models that β€œfit” onto certain kinds of hardware. I think the latter makes a lot of sense, and was a great pattern leveraged in the Nemotron 3 family of models. Our model cards make it pretty clear what we think the optimal deployment configurations are, as well. So that’s another hint as to how we’re thinking about this. 4. NVIDIA sells GPUs, not tokens, and its biggest customers are the closed frontier labs. Yet Nemotron ships open weights, data, and recipes. Is this classic commoditize-your-complement? What is the honest internal story for why Nemotron exists?. Honestly, NVIDIA was created to solve the biggest challenges, period. A lot of these challenges fall into the β€œscience” and β€œAI” buckets right now - and in order for those fields to benefit the most, it makes sense for us to participate wholeheartedly in those ecosystems. We’re not trying to compete in the model game - we’re trying to enable tens of thousands of companies, researchers, and developers to engage with and build on top of AI. Also, as recent letters communicated, we think the path forward for safety and security is the scrutiny of all those companies, researchers and developers to help build us all toward a safer future, basically saying: β€œOpen Source is big dope”. Closed models are awesome, by the way, of course - I use them all the time, I just think the future looks a little more like β€œa little bit of column A, and a little bit of column B”. 5. You go further than almost anyone, releasing pretraining datasets in the tens of trillions of tokens. Meanwhile Qwen and DeepSeek lead the open weights conversation with closed data pipelines. Does open data actually matter in practice, or is it mostly a trust signal? Releasing open weights models is awesome. Releasing open data is more awesome. There’s this reality where you can’t really, truly, audit the model without the data it was trained on. You can get close, and especially through behavioural analysis you can do cool things and learn all kinds of great things about models - but at the end of the day, open data just gives you that extra β€œfeelsgoodman.jpg”, as it relates to understand why models do what they do. That’s why, not to brag, we’ve released 10s of trillions of tokens of sweet sweet data alongside our models (and recipes, and tech reports, and cookbooks, and data curation methods, and more). Also - data is hard and costly to generate. When I say stuff like we want researchers to build on Nemotron, the data effort is a large part of what makes that possible! 6. Nemotron 3 interleaves Mamba-2 layers with sparse MoE and keeps only a handful of attention layers in the whole stack. When you ablate attention away, what breaks first? And how close are we to needing none at all? I think what we’re all discovering is that Attention is not ALL you need, but you do need some. Our teams spent a lot of time learning what the best ratio between SSM/attention was, and some of those learnings land in our technical reports. At the end of the day, attention is incredible for long context recall - and so I’m not certain we’ll go to a world where we both have extremely long context and no attention without more significant architectural changes. 7. Super and Ultra introduce LatentMoE: tokens get compressed into a latent space before hitting the experts, so you can route to roughly 4x more experts at the same cost. What does that actually buy you? And when you look at routing patterns, is expert specialization real, or a story we tell ourselves? LatentMoE does a few things, really well: First, it is great for latency and throughput bound inference - which is great, because those are the types of inference. All those savings go straight back into accuracy as well by letting us use higher top-K. Routing specialization is real, but the human readable version is mostly a version we tell ourselves. 8. Nemotron is quietly becoming multimodal: vision-language models for document intelligence, speech, retrieval, plus adjacent families like Cosmos for physical AI. How do you think about Nemotron beyond text? Does the hybrid Mamba-MoE recipe transfer cleanly to other modalities, or does each one demand its own architecture? Nemotron 3 Nano Omni was our first foray into multimodal Nemotron on top of the current Nemotron 3 backbone - and it worked great! Our vision and speech teams did the heavy lifting to adapt their encoders to the backbone - which was much of the work. I’d recommend reading through the technical report for more details, it’s a really impressive amount of work! 9. You recently launched Nemotron 3.5 Lightning. What’s it for and what innovations have occurred? Nemotron 3.5 Lightning is the "muscle" for AI agents. When you're running long-term agents, you don't want to waste your expensive frontier model on the grunt work like tool calls or subagent delegation. That’s where Lightning comes in. It’s an open 30B MoE model with 3B active parameters, built specifically to handle that high-volume, execution-layer load - fast and cheap. We specifically trained it for the agent harnesses people actually use, so it's not just fast - it’s accurate for the stuff that matters. We also baked in speculative decoding (MTP) and optimized it for deployment on everything from a data center cluster to a local DGX Spark using NVFP4 quantization. Miscellaneous 10. Who is your favorite mathematician or computer scientist, and why? I’m a Ramanujan guy, myself. There’s something incredible about the raw intuition he had in a field that is often remarked upon as being unintuitive. Currently, AI is made out to be just as unintuitive, and I can’t wait to meet our field’s Ramanujan. 11. Give us one prediction for the AI landscape in 2027 that most of our readers would disagree with. It seems obvious to me that model routing is an important stepping stone - but a stepping stone nonetheless - to a more robust, more ergonomic orchestration layer. Routing is great for pipelines, and for many other mission critical - but internal to the agent - processes, but it’s uncomfortable to interact with as an end-user. So my prediction is that β€œmodel routing” will evolve rather quickly into the more general β€œorchestration”.
11:07

How many of you are already employed in AI code remediation? - Reddit

Cleaning up AI-written code is becoming a real chunk of developers' jobs, and some people are already employed just to do it. One engineer on r/ExperiencedDevs says they spent 30–70% of their time over the last six months refactoring model-generated code. The thread drew 87 votes and 77 comments and is anecdotal, but it matches a broader pattern of teams paying for AI cleanup work.

Full text · 140 chars
87 votes, 77 comments. Over the last 6 months, I spent between 30 and 70% of my time just doing AI cleanup. By which I mean refactoring and…
11:11

Qintess Commits to a Minimum $6.5 Million Spend on Fusemachines Agentic AI Products ...

A Brazilian IT services firm has committed to spending at least $6.5 million on agentic AI from a US company over the next three years. Qintess is embedding Fusemachines' agentic AI into its delivery operations, engineering practices, and managed-services model. The figure is a minimum floor, not a cap, so the actual spend could go higher.

Full text · 149 chars
We are embedding Agentic AI directly into our delivery operations, engineering practices and managed-services model, and extending those products ...
11:28

Steve Hilton slams AI leaders in their home state as he runs to lead it - POLITICO

A California governor candidate is attacking AI leaders in their own backyard, saying they wrecked public trust in the industry. Steve Hilton made the pitch in Sacramento while campaigning, arguing founders have only themselves to blame for the confidence collapse. Coverage so far is limited to that opening argument.

Full text · 148 chars
SACRAMENTO, California β€” Steve Hilton says artificial intelligence founders have only themselves to blame for tanking public confidence in their ...
11:31

Why Open-Weight AI Models Matter and Meta Benefits from Them - WSJ

Open-weight AI models, which anyone can download and tinker with, are spreading fast and Meta is the company that benefits most. The Wall Street Journal explains why that model format matters and how it pays off for Meta's ecosystem. It also rounds up a $500 billion AI financing deal and how the AI boom is shaking up South Korea's dating scene.

Full text · 93 chars
Plus, a $500 billion AI financing deal, and the AI boom shakes up South Korea's dating scene.
12:10

The Download: our 35 young innovators and the β€œcensorship-industrial complex”

Anthropic's Claude will watermark AI-made text and images so fakes can be caught, and the company says that could let election officials verify votes while keeping them anonymous. That's the lead in a wide-ranging newsletter that also reveals MIT will name 35 young innovators in September, reports on the State Department office shut down over 'censorship-industrial complex' accusations, and notes Montana now lets drugmakers sell experimental treatments to anyone who can pay. Other stories: Chinese-linked hackers used open-source agents to hit Taiwanese government sites, Wall Street firms pay $100,000 a month for early access to Trump's Truth Social posts, Spotify will label and stop recommending AI artists, and a '100% human-written' research service turned out to be entirely AI.

Notes
Innovators Under 35 2026
  • MIT Technology Review will reveal its 2026 list on September 8, recognizing 35 young scientists/engineers globally (Nordrum).
  • Received 550 nominations this year; story links last year's list. Newsroom uses the exercise to spot rising talent.
"Censorship-industrial complex" (Eileen Guo)
  • On April 15, 2025 Guo got a tip: a small US State Department office monitoring/countering foreign disinformation (from Russia, Iran, China) would be shut down "the next day."
  • Alleged reason: the office was the department's central hub in the "censorship-industrial complex"β€”"a sprawling constellation of government agencies, academics, civil society groups, and Big Tech platforms allegedly conspiring to suppress conservative and populist speech online under the guise of combating disinformation."
  • Guo broke the story April 16; says the idea "moved from the fringes of the right-wing internet into the Trump administration."
Montana's experimental-drug market (Jessica Hamzelou)
  • End of July: biotech companies with an experimental drug gained a path to sell it to consumers.
  • Entry bar: drugs with preliminary testing "sometimes in as few as 10 healthy people"; $12,500 application fee to a newly established review board.
  • Once approved: companies set their own prices and sell through experimental treatment clinics; the first clinic "likely to open around the end of this year."
  • Uniqueness: unlike similar laws elsewhere that restrict access to terminal illness, Montana's system is "theoretically open to anyone who gives informed consent and can pay" β€” including rare-disease patients and people after longevity/preventive drugs.
  • Also available as a Narrated podcast (weekly, Spotify/Apple Podcasts).
Must-reads (condensed)
  • China-linked hackers hit Taiwan in an "unprecedented" AI attack using open-source agents on government websites; UK military drones reportedly sent a signal to China; Taiwan's "silicon shield" may be weakening.
  • Wall Street firms paying $100,000/month for early access to Trump's Truth Social posts; Trump Media lost $238 million as crypto holdings fell.
  • ICE plans up to $20 million on gloves that deliver painful electric shocks (switch turns on "electrical mode").
  • Spotify will label "AI personas" on artist profiles/track listings and stop recommending them.
  • Social-media disinformation spurred a deadly migrant surge from Morocco to Spain.
  • Anthropic's Claude adding watermarks to AI text/images; could help verify anonymous votes.
  • Orexin drugs (mimicking the brain's wakefulness signal) taking off for sleep disorders, ADHD, addiction; psychedelics falling short in trials.
  • Cargo thieves turning violent to steal AI hardware (shipments vanish after escort attacks).
  • Chinese collider produced strongest evidence yet for the glueball, a particle made of force.
  • "Research Gold," a firm selling "100% human-written, never AI" research, is entirely AI-generated reviewers.
Quote of the day
"I think the fourth wave of slop will be when there's no longer any meaningful quality hit in slop, when the average piece of slop is better than the best human in that field."
β€”Kevin Roose (NYT), on the Pivot podcast
AI agents autonomy (Grace Huckins)
  • Risk: agents can misinterpret goals, leak sensitive info, fall to prompt-injection attacks, exploit software vulnerabilities at scale; "no foolproof way" to guarantee they act as intended.
  • > "The great paradox of agents is that the very thing that makes them usefulβ€”that they're able to accomplish a range of tasksβ€”involves giving away control." β€”Iason Gabriel, senior staff research scientist, Google DeepMind (AI ethics)
Full text · 7,400 chars
This is today's edition of The Download, our weekday newsletter that provides a daily dose of what's going on in the world of technology. How we picked 35 of the world’s top young scientists and engineers On September 8, MIT Technology Review will reveal its 2026 list of Innovators Under 35, recognizing 35 young people from around the world who are doing groundbreaking scientific work and building clever technical fixes for sticky problems. By finding the top young innovators globally and learning what they’re focused on in their work, we aim to give readers a sense of what advances to expect in the years to come. As a newsroom, we also use this exercise to help us spot rising talent and get to know some of the best early-career researchers in the fields that we cover. This year, we received 550 nominations. Find out how we whittled them down to 35 of the young innovators shaping the future of technology, and check out last year’s list. β€”Amy Nordrum How the β€œcensorship-industrial complex” is changing the internet and US policy β€”Eileen Guo I first heard the term β€œcensorship-industrial complex” on April 15, 2025. That’s when I got the tip that a small office in the US State Department, which focused on monitoring and countering foreign disinformation from the likes of Russia, Iran, and China, was facing imminent shutdownβ€”the next day. And the reason? The office was accused of serving as the department’s central hub in the so-called censorship-industrial complexβ€”a sprawling constellation of government agencies, academics, civil society groups, and Big Tech platforms allegedly conspiring to suppress conservative and populist speech online under the guise of combating disinformation. I broke the story on April 16. But for me, it was just the start of a deep reporting rabbit hole into an idea that had moved from the fringes of the right-wing internet into the Trump administration. For more on what the narrative means for the internet, read my story here. MIT Technology Review Narrated: Montana’s plan to become an experimental medical hub just pushed forward At the end of July, any biotech company in Montana with an experimental drug gained a clear path to selling it to consumers. Companies whose drugs have been through preliminary testingβ€”sometimes in as few as 10 healthy peopleβ€”can pay $12,500 to apply to a newly established review board. Once approved, they can set their own prices and sell the drugs through experimental treatment clinics, the first of which is likely to open around the end of this year. Montana’s latest right-to-try legislation is unique. While similar laws elsewhere limit access to people with terminal illness, Montana’s system is theoretically open to anyone who gives informed consent and can pay. That includes people desperate for treatments for rare diseases. It also includes those interested in longevity and drugs pitched as preventive therapies. β€”Jessica Hamzelou This is our latest story to be turned into an MIT Technology Review Narrated podcast, which we publish each week on Spotify and Apple Podcasts. Just navigate to MIT Technology Review Narrated on either platform, and follow us to get all our new content as it’s released. The must-reads I’ve combed the internet to find you today’s most fun/important/scary/fascinating stories about technology. 1 China-linked hackers have hit Taiwan in an β€œunprecedented” AI attack They used open-source agents to compromise government websites. (FT $) + UK military drones were found sending a signal to China. (Cybernews) + Taiwan’s β€œsilicon shield” could be weakening. (MIT Technology Review) Β  2 Wall Street firms are paying $100,000 a month to get Trump posts first Trump Media said more than 10 firms have signed up for the service. (CNN) + It offers faster access to market-moving posts on Truth Social. (BBC) + Trump Media also lost $238 million as crypto holdings fell. (CNBC) Β  3 ICE plans to give officers gloves that can deliver painful electric shocks It’s set to spend up to $20 million to buy thousands of the devices. (AP News) + A switch turns them from normal gloves into β€œelectrical mode.” (Guardian) Β  4 Spotify will label AI artists and stop recommending them The platform is cracking down on fake performers. (Guardian) + β€œAI personas” will appear on artist profiles and track listings. (NYT $) Β  5 Social media spurred a deadly migrant surge from Morocco to Spain Disinformation encouraged thousands to attempt the crossing. (NYT $) 6 Anthropic’s Claude is adding watermarks to AI text and images It could guarantee votes are counted and kept anonymous. (Axios) 7 Drugs that mimic the brain’s wakefulness signal are taking off Orexin drugs could treat sleep disorders, ADHD and addiction. (Economist $) + But psychedelics are falling short in clinical trials. (MIT Technology Review) Β  8 Cargo thieves have turned to violence to steal AI hardware Shipments have disappeared after their escorts were attacked. (Wired $) 9 Scientists may have found the elusive glueball, a particle made of force A Chinese collider has produced the strongest evidence yet. (Science) 10 A firm selling β€œ100% human-written, never AI” research is entirely AI The reviewers on the Research Gold site are AI-generated. (404 Media) Quote of the day β€œI think the fourth wave of slop will be when there's no longer any meaningful quality hit in slop, when the average piece of slop is better than the best human in that field.” β€”Kevin Roose, a technology columnist at The New York Times, tells the Pivot podcast what the next stage of AI slop will look like. One More Thing Are we ready to hand AI agents the keys? We’re starting to give AI agents real autonomy, and we’re not prepared for what could happen next. Any action that can be captured by text is potentially within the purview of AI agentsβ€”which is why they can cause so much mischief. β€œThe great paradox of agents is that the very thing that makes them usefulβ€”that they’re able to accomplish a range of tasksβ€”involves giving away control,” says Iason Gabriel, a senior staff research scientist at Google DeepMind who focuses on AI ethics. Researchers warn that agents could misinterpret goals, leak sensitive information, fall victim to prompt-injection attacks, and exploit software vulnerabilities at scale. And there’s no foolproof way to guarantee that they’ll act as their developers intend. β€”Grace Huckins We can still have nice things A place for comfort, fun, and distraction to brighten up your day. (Got any ideas? Drop me a line.) + An intrepid inventor has built and tested an anti-mosquito electric suit. + Musician Hasan Ceylan performs moving covers of modern hits on traditional Turkish instruments from the Ottoman era. + As the midterms approach, see whether you could draw electoral boundaries to rig an election at puzzle game Gerrymandle. + Photographer John Thomson's images from 19th-century China are an extraordinary peek into an ancient society that would soon be swept away. Deep Dive The Download The Download: Claude’s inner workings and OpenAI’s β€œsuper app” Plus: OpenAI has unveiled its long-awaited "super app." The Download: Claude’s inner workings, and the future of world models Plus: New York has become the first state to enact a data center moratorium. Stay connected Get the latest updates from MIT Technology Review Discover special offers, top stories, upcoming events, and more.
12:58

Cognition AI Eyes $40 Billion Valuation From New Funding | PYMNTS.com

AI coding agent maker Cognition is raising new money at a $40 billion valuation, more than double what it was worth earlier. Its agent Devin automates engineering work and counts Citi, Mercedes-Benz, Goldman Sachs, plus the U.S. Army and Navy as customers. The round cements AI coding tools as one of the hottest startup categories.

Full text · 154 chars
Cognition makes an AI agent Devin that helps automate engineering work, and counts Citi, Mercedes-Benz, Goldman Sachs, and both the U.S. Army and Navy ...
13:03

CodeRabbit Raises $143 Million at $1.5 Billion Valuation and Introduces Agentic Change ...

AI code review startup CodeRabbit raised $143 million at a $1.5 billion valuation and launched a new product called CodeRabbit Agent. The agent is pitched as a second brain for engineering teams and covers the whole software development lifecycle in one tool. The funding marks a big jump in valuation for a company built on automated code reviews.

Full text · 148 chars
... Agent , a second brain for engineering teams. CodeRabbit Agent is a single agent for the entire software development lifecycle. Built on the ...
13:15

Enterprise Signals | OpenAI

OpenAI says agentic AI is moving beyond developers into everyday office work through ChatGPT Work, its enterprise offering. The company notes the shift began with Codex for software engineering and is now reaching broader enterprise roles and data workflows. It's OpenAI's own framing of enterprise adoption, not a fresh announcement.

Full text · 151 chars
This shift first took hold in software engineering with Codex. Now, ChatGPT Work is extending agentic AI beyond developers, enabling workers across ...
13:29

From assistance to execution: How enterprises put AI to work - OpenAI

OpenAI says Codex is spreading from software engineering into knowledge-work roles across enterprises. Software engineering was the early center of agentic adoption, but the company says Codex use has been growing quickly across other knowledge-work functions since February. It's a marketing post, so treat the growth claims as directionally positive rather than hard data.

Full text · 150 chars
Software engineering was an early center of agentic adoption, but Codex use is now growing quickly across knowledge-work functions. Since February ...
13:33

Sarvam AI's Indus Wins Maharashtra, Putting Sovereign AI to Work for 2,500 Officials

Sarvam AI's sovereign AI workspace, Indus, is now live for about 2,500 Maharashtra government officials across 22 languages, one of the largest government AI rollouts by an Indian-built model. Officials use it to draft documents, answer RTI requests, read scanned Marathi paperwork, and more, with voice and WhatsApp citizen agents also included. The two-year deal is about β‚Ή11.26 crore, roughly $1.35 million, priced at a discounted government rate. Sarvam backs it with models trained from scratch on Indian data and infrastructure hosted entirely in India, and recently raised a $234M round at a $1.5B valuation.

Notes
Sarvam AI β€” Indus sovereign AI deployment with Maharashtra

Deal: Formal partnership with Government of Maharashtra; Indus live for ~2,500 state officials β€” "one of the largest government AI rollouts by an Indian-built model anywhere in the country."

Numbers: Indicative first-year cost β‚Ή5.63 crore (~$670K); two-year outlay β‚Ή11.26 crore (~$1.35M). Approved by a High-Power Committee chaired by the Chief Secretary.

Pricing structure (real story):

  • Foundation Partner subscription β‚Ή1,200/user/month for first 12 months vs. standard β‚Ή2,500/user/month
  • One-time professional services fee β‚Ή50 lakh
  • Setup + adoption support β‚Ή42 lakh for 3 months
  • API usage (excl. GST): Saaras β‚Ή0.50/minute; Bulbul β‚Ή30/10,000 characters

Product suite:

  • Indus (AI workspace): drafting and file-noting assistance, RTI response generation, document intelligence, OCR across Indian scripts, multilingual interaction in 22 languages incl. Marathi, project workspaces, data analysis, eOffice/NIC email integration (where API access allows). Example workflow: scanned Marathi doc β†’ searchable text β†’ summarise β†’ draft reply, no tool switching.
  • Samvaad: voice/WhatsApp citizen outreach agents
  • Saaras and Bulbul speech models integrated into state's MahaAI platform

Company momentum: Raised $234M Series B at $1.5B valuation; backers HCLTech, Bessemer, Khosla, Peak XV Partners.

Sovereign AI claim: Models "trained from scratch on Indian data, infrastructure hosted entirely within India" β€” stated as a capability global AI providers can't match at the model layer.

Caveats: Pricing is "indicative"; eOffice/NIC integration only "wherever API access is available."

Next phase: Voice agents for citizen outreach, speech tech for public services; TB awareness calling pilot already approved.

Full text · 2,895 chars
- Deployment scale: Sarvam AI's Indus platform is now live for 2,500 Maharashtra government officials across 22 languages including Marathi. - Deal value: β‚Ή5.63 crore (~$670K) in year one, β‚Ή11.26 crore (~$1.35M) over two years, approved by a High-Power Committee chaired by the Chief Secretary. - Full product suite: Includes Indus (AI workspace), Samvaad (voice/WhatsApp citizen agents), and Saaras/Bulbul speech models integrated into Maharashtra's MahaAI platform. - Company momentum: Sarvam raised $234M Series B at a $1.5B valuation, backed by HCLTech, Bessemer, Khosla, and Peak XV Partners. - Sovereign AI context: Models trained from scratch on Indian data, infrastructure hosted entirely within India β€” a claim global AI providers cannot match at the model layer. - What's next: Voice agents for citizen outreach and speech tech for public services are the stated next phase; a TB awareness calling pilot is already approved. Read more. Sarvam AI has signed a formal partnership with the Government of Maharashtra to deploy its Indus sovereign AI workspace across state departments. Around 2,500 officials will use the platform in their daily work, making this one of the largest government AI rollouts by an Indian-built model anywhere in the country. What Indus actually does on the job Indus is not a chatbot bolted onto a government portal. The platform provides drafting and file-noting assistance, RTI response generation, document intelligence, optical character recognition across Indian scripts, multilingual interaction in 22 languages including Marathi, project workspaces, data analysis, and integration with eOffice and NIC email wherever API access is available. In plain terms: an official can drop a scanned Marathi document into Indus, get it converted to searchable text, summarise it, and draft a reply, all without switching tools. Beyond Indus, the package also includes Samvaad, voice and WhatsApp-based citizen outreach agents, and Saaras and Bulbul speech models for integration into the state's MahaAI platform. The full suite covers the bureaucratic workflow from internal file management all the way to citizen-facing voice calls. The numbers behind the deal The package covers the deployment of Indus for around 2,500 state government users at an indicative first-year cost of β‚Ή5.63 crore and a two-year outlay of β‚Ή11.26 crore. That works out to roughly $1.35 million over two years, a modest figure by enterprise software standards, but the pricing structure tells the real story. - A Foundation Partner subscription rate of β‚Ή1,200 per user per month for the first 12 months, versus the standard rate of β‚Ή2,500 per user per month. - A one-time professional services fee of β‚Ή50 lakh, plus setup and adoption support costing β‚Ή42 lakh for three months. - API usage charges of β‚Ή0.50 per minute for Saaras and β‚Ή30 per 10,000 characters for Bulbul, excluding GST.
14:01

Liquid AI's LFM2.5-VL-3B Beats Models Twice Its Size Running on Your Phone

Liquid AI released a 3.1-billion-parameter vision-language model that beats rivals up to twice its size while running on a phone. LFM2.5-VL-3B scores 80.7 on the ScreenSpot-v2 UI-grounding benchmark, ahead of Qwen 3.5 4B, fits in about 3 GB of memory, and hits 228 tokens a second on an Apple M5 Max and 20 on a Galaxy S26 Ultra. It's built on a hybrid of attention and convolution blocks rather than a pure transformer, cutting the memory-heavy cache by up to 90%. Weights are open on Hugging Face with day-one support for llama.cpp, MLX, vLLM, SGLang, and ONNX.

Notes
Liquid AI LFM2.5-VL-3B

The model. Liquid AI (MIT CSAIL spinout, founded 2022) released LFM2.5-VL-3B, a 3.1B-parameter vision-language model. Claimed to match/beat models up to 2.6x its size on screen understanding and UI grounding. On-device speed: 228 tokens/s on Apple M5 Max, 20 tokens/s on Galaxy S26 Ultra, in ~3 GB memory.

Benchmarks. ScreenSpot-v2 (UI grounding): 80.7 vs Gemma-4-E4B 51.2, Qwen 3.5 4B 78.5 β€” but trails larger InternVL-3.5-4B (84.1). Server throughput ~11K output tokens/s at high concurrency on a single H100 (~2x faster than 4B-class competitors).

Architecture β€” the key design decision. Not a pure transformer: hybrid of attention + short-range convolutions. Only ~37% attention blocks, 63% cheaper convolution blocks with zero KV cache, cutting KV cache by up to 90% (the edge memory wall). Vision encoder is SigLIP2 NaFlex (400M shape-optimized variant) β€” preserves native image aspect ratio, intended for document/UI understanding. Vision-language connector is a 2-layer MLP with PixelUnshuffle, shrinking visual token count before mapping to LFM2's hidden dim.

Not a reasoning model β€” answers directly, no thinking trace. Stated deliberate trade-off for real-time/on-device apps:

"The target is real-time and on-device applications where you cannot afford a 10-second thinking trace."

Distribution. Day-one support for llama.cpp, MLX, vLLM, SGLang, ONNX; open weights on Hugging Face.

Improvements over LFM2-VL-3B: screen/UI understanding, grounding, function calling, multi-image input.

Caveats. Benchmarks are vendor-reported. 80.7 loses to InternVL-3.5-4B. Direct-answer design forfeits reasoning capability by construction.

Full text · 3,254 chars
- Liquid AI releases LFM2.5-VL-3B, a 3.1B vision-language model that beats models up to 2.6x its size on screen understanding and grounding. - Runs on-device: 228 tokens/s on Apple M5 Max, 20 tokens/s on a Galaxy S26 Ultra, in ~3 GB of memory. - Scores 80.7 on ScreenSpot-v2 (UI grounding), ahead of Gemma-4-E4B at 51.2 and Qwen 3.5 4B at 78.5. - Built on a hybrid convolution-attention backbone (not a pure transformer), cutting KV cache by up to 90% for edge efficiency. - Ships with day-one support for llama.cpp, MLX, vLLM, SGLang, and ONNX; open weights on Hugging Face. - Reaches ~11K output tokens/s at high concurrency on a single H100, roughly 2x faster than 4B-class competitors. Liquid AI just released LFM2.5-VL-3B, a 3.1B-parameter vision-language model (VLM) designed to run fast on real hardware, from a single H100 GPU down to a Galaxy S26 Ultra. The headline claim is striking: it matches or beats models up to 2.6x its size on key benchmarks, while fitting in about 3 GB of memory and decoding at 228 tokens per second on an Apple M5 Max. This is not a reasoning model. It answers directly, which keeps latency low. That design choice is deliberate: the target is real-time and on-device applications where you cannot afford a 10-second thinking trace before getting a result. A non-transformer running on your phone To understand why LFM2.5-VL-3B is fast, you need to understand what it is built on. The core of LFM2.5 is a hybrid of attention and short-range convolutions, where attention blocks account for only about 37% of the model, with the remaining 63% made up of cheaper convolution blocks. This matters because standard transformers hit a memory wall on edge devices because their KV cache grows with every token, while LFM2's architecture cuts that cache by up to 90% by replacing most attention layers with zero-cache convolution blocks. Liquid AI is an AI startup spun out of MIT's CSAIL, founded in 2022, building foundation models for edge devices based on research into liquid neural networks. The VL model pairs this hybrid language backbone with a vision encoder: a SigLIP2 NaFlex encoder to convert input images into token sequences, using the 400M shape-optimized variant for fine-grained vision capabilities. NaFlex (Native Flex) is Google's image encoder that supports multiple resolutions and preserves the native image aspect ratio, which has the potential to improve aspect-sensitive applications such as document understanding. The connector between vision and language is a lightweight 2-layer MLP that applies a PixelUnshuffle operation, projecting patch-level embeddings into language space by first lowering the number of visual tokens, then mapping image embeddings into the LFM2 hidden dimension. This is what keeps the token budget small and first-token latency low. Four things that actually got better LFM2.5-VL-3B builds on the previous LFM2-VL-3B with significant improvements in screen understanding, grounding, function calling, and multi-image input. Each of these is a meaningful jump, not a marginal one: - Screen and UI understanding: It averages 80.7 on ScreenSpot-v2, far ahead of the much larger Gemma-4-E4B (51.2) and Qwen 3.5 4B (78.5) and close behind the larger InternVL-3.5-4B (84.1).
14:02

Text-to-Speech Comes of Age: Deepgram Launches Conversation-Native Speech | Morningstar

Deepgram launched a text-to-speech product aimed at live agent conversations, where the voice tracks the exchange without manual prompt engineering, SSML, or style tags. It's pitched as keeping pace with real-time conversation. The announcement ran on Business Wire and was picked up by Morningstar.

Full text · 139 chars
This helps the agent stay aligned with the exchange without additional prompt engineering , SSML, or style tags. Keeps pace with a live ...
14:17

How OneAdvanced deployed over 50 AI agents on UK-sovereign AWS

A UK software firm deployed more than 50 AI agents on AWS's UK-sovereign infrastructure, which keeps the data in the UK. OneAdvanced chose a product called Strands as the clear frontrunner after evaluating options, per the AWS blog. It's a case study in running a large agent fleet on a regional cloud.

Full text · 153 chars
As Nick Heap, Principal Software Engineer at OneAdvanced, explains: β€œPost-evaluation, Strands stood out as the clear frontrunner for the project. Its ...
14:36

Spotify Will Label A.I. Artists and Avoid Promoting Them - The New York Times

Spotify will now label music made by AI artists and stop recommending it to listeners. The streaming service announced the move on Tuesday, letting users behind AI-generated artists identify their work too. It's a step toward separating human and machine-made music on the platform.

Full text · 149 chars
... artificial intelligence , the streaming service announced on Tuesday. Users behind A.I.-generated artists will also be able to identify those ...
15:07

Artificial Intelligence in Medical Writing: Subtle Errors and Their Complex Consequences

AI tools like ChatGPT can make medical manuscripts easier to read but quietly introduce false descriptions that carry serious consequences. A new paper in a Japanese medical journal examines these AI-related errors in medical writing. The catch is that AI can sound plausible while getting facts wrong.

Full text · 135 chars
Although artificial intelligence (AI; such as ChatGPT) can improve manuscript readability, AI-related false descriptions (so-called ...
15:45

Brad Lightcap, a Top OpenAI Executive, Steps Down - The New York Times

Brad Lightcap, one of OpenAI's most senior leaders, is leaving the company to start a new venture. His exit is the latest in a series of departures from the AI company. Lightcap had been a longtime leader at OpenAI.

Full text · 149 chars
Brad Lightcap, a longtime leader, said he was starting a new venture. His exit from the artificial intelligence company is the latest in a series ...
16:10

β˜•οΈ Gemini hits 1 billion monthly users

Google's Gemini now tops 1 billion monthly users, making it one of the largest AI products ever. The newsletter also covers SpaceXAI launching an autonomous Grok Bot that runs its own computer, Google's 2026 hardware lineup, China forcing Meta to unwind its Manus deal, and a Zoom bug that let callers take over devices. It rounds out with six tools and five papers, including a multi-image fact-checking system and a small vision model that mimics a larger teacher's attention to beat GPT-4o.

Notes
Top stories
  • Gemini hits 1 billion monthly users β€” headline claim; no date, method, or product breakdown given in the newsletter itself.
  • SpaceXAI launches Grok Bot β€” autonomous AI agent "team" that operates its own computer to complete tasks continuously, without human intervention or downtime. Cross-listed in the tools section.
  • Google reveals 2026 hardware lineup β€” headline only; no devices or specs in the newsletter body.
  • China forces Meta to unwind Manus deal β€” headline only; no details on the deal, mechanism, or timeline.
  • Zoom bug let callers hijack your device β€” headline only; no CVE, affected versions, or patch info. (Note: most "top story" items carry no substance beyond the headline β€” all detail lives behind LINK.)
Tools (trending)
  • ClickUp Brain (sponsored): "the only AI that works with your work, while other AI assistants do basic generative AI with a skin on top of ChatGPT."
  • RightCard: picks which card to use at checkout, auto-activates bank offers, tracks rotating 5% cash-back categories, alerts before credits/fees renew.
  • Media Sharing: developers share and compare visual screenshots across builds to catch pixel-level UI regressions before production, via GitHub integration.
  • Nearfield: native Mac app merging two Apple Studio Displays into one stereo output β€” adds volume control, balance adjustment, per-app audio routing.
  • tash: buy shares of professionally managed collectible-card indexes; ETF-style diversification for card investing.
  • Lettertrace: open-source, bring-your-own-key; tracks how your brand appears in AI assistant answers, monitors topics, benchmarks competitors.
Papers & reports
  • Safe planning rewrite: automated planning systems flag action sequences leading to unsafe/forbidden outcomes and automatically rewrite the fewest rules so those outcomes become unreachable.
  • Self-tuning exploration: RL systems decide their own explore-vs-exploit tradeoff during trial-and-error training, "hitting reliable accuracy without manual tuning or arbitrarily large hidden costs."
  • Self-teaching AI skills: agents author their own multi-file "how-to" packages for complex tasks; "beating five rival methods on SkillsBench without needing humans to hand-author or grade them."
  • Multimodal fact-checking: system for fact-checking viral posts with multiple images and languages hits "~42% accuracy on real-world misinformation, beating rival tools while cutting verification costs by up to ~80%." Limitation: 42% accuracy is the headline metric β€” well below reliable.
  • Attention mimicry: smaller image-reasoning model copies where a larger teacher actually looks, "not just what it says," boosting complex-reasoning scores "by up to ~17 points" and letting a compact model beat larger rivals and GPT-4o.
Misc
  • Sponsored placements: Attio (CRM that syncs every customer signal β€” emails, meetings, usage, billing, support β€” for agent workflows; cited users Granola, Modal, Wispr Flow) and CodeRabbit Review (reorganizes PRs into layer-by-layer walkthroughs; Code Peek and Semantic Diff features).
  • On this day in 1994: one of the first secure online retail transactions β€” a Sting CD β€” completed via NetMarket.
  • Techpresso AI Academy: 330+ step-by-step tutorials (ChatGPT, Claude, Perplexity), 7-day free trial.
  • Caveat: this is a newsletter digest; story links were stripped in this feed, so headline claims (Gemini 1B MAU, Manus/Meta unwind, Zoom bug, Google 2026 hardware) are unverifiable from this source alone.
Full text · 5,543 chars
| | | | | | | | | Together with | | | | | Hi there, this is your daily β˜•οΈ Techpresso. | | | | In today's newsletter: πŸ“ˆ Gemini hits 1 billion monthly users πŸ€– SpaceXAI launches Grok Bot πŸ“± Google reveals 2026 hardware lineup πŸ‡¨πŸ‡³ China forces Meta to unwind Manus deal πŸŽ₯ Zoom bug let callers hijack your device Plus: 🎁 13 other news you might like, 🧰 6 tools, and πŸ“š 5 papers. | | | | FROM OUR PARTNER Every customer signal, from emails and meetings to product usage, billing, and support, is synced from day one, compounding into one layer your team and agents act on. Then cue the agents: research, route, and run your best plays across every account, at infinite scale. Loved by high-growth startups like Granola, Modal, and Wispr Flow, Attio is the CRM that runs the work behind every win. Try Attio for free | | | | | | πŸ“ˆ Gemini hits 1 billion monthly users LINK | | πŸ€– SpaceXAI launches Grok Bot LINK | | πŸ“± Google reveals 2026 hardware lineup LINK | | πŸ‡¨πŸ‡³ China forces Meta to unwind Manus deal LINK | | πŸŽ₯ Zoom bug let callers hijack your device LINK | | | | | | | | | | | | | | FROM OUR PARTNER AI writes more code than ever, but reviewing it still means scrolling forty files in alphabetical order. CodeRabbit Review reorganizes any PR into a structured, layer-by-layer walkthrough in the logical reading order of the change. Cohorts group related files so you review one idea at a time; layers put foundational changes first. Code Peek shows definitions and usages without leaving the tab, and Semantic Diff cuts through formatting noise. Review your next PR with CodeRabbit Review Today | | | | | | | | | | Other news & articles you might like | | | | | | | | | | 🧰 Trending tools You can check the previous tools here, or add your tool here | | ClickUp Brain: The only AI that works with your work, while other AI assistants do basic generative AI with a skin on top of ChatGPT. Get Started, It's Free. | | | | RightCard: recommends which card to use at checkout, auto-activates bank offers, tracks rotating 5% categories, and alerts you before credits or fees renew. LINK | | Media Sharing: lets developers share and compare visual screenshots across builds, catching pixel-level UI regressions before code reaches production via GitHub integration. LINK | | Nearfield: a native Mac app that merges two Apple Studio Displays into one stereo output, adding volume control, balance adjustment, and app-based audio routing. LINK | | Grok Bot: an autonomous AI agent team that operates its own computer to complete tasks continuously, handling work without human intervention or downtime. LINK | | tash: lets you buy shares of professionally managed collectible card indexes, bringing ETF-style diversification and discipline to card investing. LINK | | Lettertrace: an open-source, bring-your-own-key tool that tracks how your brand appears in AI assistant answers, monitoring topics and benchmarking competitors. LINK | | | | | | | | | | πŸ“š Trending papers & reports | | > Reach 700,000+ tech professionals: If your company is interested in reaching an audience of tech executives, decision-makers and engineers, you may want to advertise with us. | | | | > Automated planning systems can now flag action sequences that lead to unsafe or forbidden outcomes and automatically rewrite the fewest possible rules so those bad outcomes become impossible to reach. LINK | | > Automated trial-and-error training lets reinforcement learning systems decide on their own how much to explore versus exploit, hitting reliable accuracy without manual tuning or arbitrarily large hidden costs. LINK | | > Self-teaching AI skills lets agents write their own multi-file how-to packages for complex tasks, beating five rival methods on SkillsBench without needing humans to hand-author or grade them. LINK | | > Fact-checking viral posts with multiple images and languages gets a system that hits ~42% accuracy on real-world misinformation, beating rival tools while cutting verification costs by up to ~80%. LINK | | > Visual attention mimicry lets a smaller image-reasoning system copy where a bigger teacher model actually looks, not just what it says, boosting complex reasoning scores by up to ~17 points and letting a compact model beat larger rivals and GPT-4o. LINK | | | | | | | | We're here to make AI make sense to everyone, not just the people building it. The most interesting part has turned out to be the people. Someone out there is using AI in a way nobody designed it for, and it quietly changed how their week works. So we're asking: how do you use AI, at work or in life? Big or small, clever or mundane. We don't judge. We'll feature the most interesting ones right here in the newsletter, for everyone else to borrow. Tell us how you use AI. It takes 2 minutes β†’ | | | | Techpresso's AI Academy has 330+ step-by-step tutorials on ChatGPT, Claude, Perplexity, and every tool that matters. No fluff β€” just practical workflows you can use at work. Try it free for 7 days. | | On this day in 1994, one of the first secure online retail transactions β€” a Sting CD β€” was completed via NetMarket. | | | | πŸ’¬ How did you find today's edition? We read every reply β€” just reply to this email and let us know how we can improve! | | | | | | | | β˜…β˜…β˜…β˜…β˜… Nailed it | | β˜…β˜…β˜… Average | | β˜… Fail | | Not subscribed to β˜•οΈ Techpresso yet? Subscribe for free | | | | | | | | Advertise | Feedback | Read Online | | | | | | |
16:11

AI Cover Letters Fail 52% Competency Check, Filtering Out STEM Engineers - Tech Times

AI-generated cover letters fail an automated competency check about half the time, filtering out engineers who are genuinely qualified. Around 52% of AI-written cover letters didn't pass the screening, so capable STEM engineers who lean on the tools got weeded out anyway. The catch is that an AI draft tends to bury the candidate's actual strengths. Based mostly on the headline and a short excerpt.

Full text · 151 chars
A capable engineer who runs their resume through an AI cover letter generator frequently receives a document that buries their actual strength. The ...
16:14

Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis

You can now export compact embeddings of satellite imagery from AllenAI's OlmoEarth Studio to run similarity search, few-shot segmentation, and change detection without training a model. A simple classifier trained on just 60 labeled pixels produced a wall-to-wall land-cover map with a weighted F1 of 0.84 over a coastal region, and monthly embeddings made a wildfire burn scar light up instantly. The source code, model weights, and research paper are public, and exports come as GeoTIFFs that work in any geospatial tool. Input imagery quality like cloud cover still affects results.

Notes

Introducing OlmoEarth embeddings: custom embedding exports from OlmoEarth Studio

Source: Hugging Face blog feed Β· 2026-08-12 Β· Links: tech report Β· docs

What it is

Ai2's OlmoEarth Studio (platform for building Earth observation models) now lets you compute and export embedding vectors from the open-source OlmoEarth foundation models. Code + model weights are public alongside the paper. Embedded output is a Cloud-Optimized GeoTIFF (COG) with one band per embedding dimension. Built on demand per request β€” not pulled from a pre-computed global archive β€” so monthly (not just annual) snapshots are possible.

Configuration parameters (Studio UI or API)
  • Area of interest: draw or upload any polygon; Studio handles acquisition + tiling
  • Time span: 1–12 monthly periods
  • Encoder variant: Nano (128-dim, 1.4M params), Tiny (192-dim, 6.2M params), Base (768-dim, 89M params)
  • Spatial resolution: 10 / 20 / 40 / 80 m per pixel
  • Imagery sources: Sentinel-2 L2A, Sentinel-1 RTC, or both
Storage format

Vectors stored as signed 8-bit (int8), range βˆ’127..+127, βˆ’128 reserved for nodata. Recover floats via dequantize_embeddings in olmoearth_pretrain.

Demos (all use v1-Tiny 192-dim, 40 m, S2 L2A)
  • Similarity search: dot product / cosine against a query pixel β†’ heatmap. Query near Merced, CA lit up urban fabric + road corridors, kept ag parcels dark, with no labels. Ag-window query (mean embedding over window): most similar (β‰₯0.89) = irrigated ag parcels; least similar (~0) = airport+bare ground, reservoir+dry terrain, arid rangeland.
  • Few-shot segmentation: labeled just 60 pixels (20/class) over Ca Mau, Vietnam (mangrove/water/other, labels from ESA WorldCover 2021). Logistic regression with per-feature standardization β†’ weighted F1 = 0.84 wall-to-wall. Saturates: going 30β†’300 labels barely helps.
  • Change detection: monthly S2 embeddings Sept 2023 vs Sept 2024, per-pixel cosine distance β€” Park Fire (Jul–Sep 2024) burn scar in Butte County, CA lit up immediately. No labels.
  • PCA exploration: 3 dims β†’ R/G/B false color; Flevoland, NL polder grid of ag parcels reproduced with distinct hues per crop/water/urban.

The core probe is ~10 lines (rasterio read β†’ reshape to (HΒ·W, C) β†’ StandardScaler + LogisticRegression(max_iter=2000) β†’ predict + reshape).

Caveats / stated limitations
  • Check embedding quality for your own use case; performance depends on input imagery β€” persistent cloud cover, atmospheric artifacts, or missing observations in the composite period degrade the vectors.
  • Tiny is lightweight but "highly performant"; larger variants (Base, 768-dim) encode richer representations at higher compute/storage cost.
  • For higher performance than linear probes on frozen features, Studio supports SFT (task-specific head on your own labels), which "typically outperforms" linear probes.
  • Data credits: S2 L2A from ESA via Microsoft Planetary Computer; WorldCover 2021 v200; global clustering viz uses v1-Base (768-dim), patch size 8, instance-level embeddings over 1.1M pretraining samples.

Saved to notes/olmoearth-embeddings-2026-08-12.md.

Full text · 9,717 chars
Introducing OlmoEarth embeddings: Custom embedding exports from OlmoEarth Studio for downstream analysis πŸ“„ Tech Report: https://allenai.org/papers/olmoearth | πŸ“Š Documentation: https://docs.olmoearth.allenai.org/embeddings | πŸ’» Learn more about OlmoEarth: https://allenai.org/olmoearth OlmoEarth Studio, our platform for building Earth observation models, now lets you compute and export embedding vectorsβ€”compact numerical representations of Earth-observation data produced by our open source OlmoEarth foundation models. The source code and model weights are publicly available alongside the research paper, so the community can inspect exactly how these embeddings are generated. Embeddings are a fast, cost-effective entry point for leveraging OlmoEarth: they support a wide range of downstream tasks, from similarity search to segmentation to unsupervised exploration. Locations with similar surface characteristics end up with similar vectors; locations that differ land far apart. OlmoEarth embeddings have shown strong performance in our own benchmarking and in independent evaluations. The exported Cloud-Optimized GeoTIFFs (COGs) are lightweight and easy to share. Choose your area of interest, time range, encoder variant, resolution, and imagery sources via the Studio UI or API, and get back a COG you can use however you like. If your application requires higher performance, Studio also supports supervised fine-tuning (SFT). Custom-computed embeddings are now available for users of OlmoEarth Studio. Reach out if you're interested in gaining access. Instructions for using the publicly available OlmoEarth models to compute your own embeddings are available here. Global structure in OlmoEarth embeddings from seasonal Sentinel-2 imagery across 1.1M samples. Colors indicate 15 k-means clusters in a PCA-reduced embedding space. Computing embeddings follows the same workflow as any other prediction in Studio. First configure a model and run it, and then download the results. Several parameters tailor the output: - Area of interest: Draw or upload any polygon; Studio handles imagery acquisition and tiling. - Time span: 1-12 monthly periods. - Encoder variant: Nano (128-dim, 1.4M params), Tiny (192-dim, 6.2M params), or Base (768-dim, 89M params). - Spatial resolution: 10 meter, 20 meter, 40 meter, or 80 meter per pixel. - Imagery sources: Sentinel-2 L2A, Sentinel-1 RTC, or both. Different visualization options applied to the same embedding raster. Studio delivers a COG with one band per embedding dimension. Vectors are stored as signed 8-bit integers (int8). Values range from -127 to +127, with -128 reserved for nodata. To recover floating-point vectors, see dequantize_embeddings in olmoearth_pretrain. Because everything is computed on demand rather than pulled from a pre-computed global archive, your embeddings reflect exactly the conditions you care about. You can generate monthly embeddings to capture seasonal dynamics, not just annual snapshots. The examples below all use OlmoEarth-v1-Tiny (192-dim) embeddings at 40-meter resolution with Sentinel-2 L2A composites (annual for most examples; monthly for change detection). Tiny is a lightweight encoder but still highly performant; for your own applications, you can swap it for a larger variant at the cost of higher compute and storage. Pick a query pixel, extract its embedding, and compute cosine similarity against every other pixel. The result is a heatmap showing where the landscape looks most and least like your query pixel. This query sits near the Merced urban center in California. Urban fabric and road corridors light up coherently while agricultural parcels stay dark. The model distinguishes built-up surfaces from cropland without any labels. Switching the query to a small agricultural window, we define the query vector as the mean of the embedding vectors over that window, then pull Sentinel-2 imagery at the highest- and lowest-similarity locations to see what the model treats as similar and dissimilar. The most similar patches (0.89 and above) are all agricultural parcels with irrigated fields. The least similar (around zero) are an airport with surrounding bare ground, a reservoir with dry terrain, and arid rangeland. No training data, no labels, just a dot product in embedding space. Similarity search tells you "where is it like this?" but sometimes you need discrete labels across a region. Because the representations are already rich, a simple linear classifier can produce a wall-to-wall land-cover map from very few labeled pixels. To test this, we labeled just 60 pixels (20 per class) over Ca Mau, Vietnam, a coastal mangrove region. Using ESA WorldCover 2021 as the label source for three classes (mangrove, water, other), we randomly sampled 20 pixels per class, trained a logistic regression with per-feature standardization, and predicted every pixel in the region. From 60 labeled pixels, the classifier produces a coherent map with weighted F1 = 0.84. Mangrove stands, tidal channels, and open water are delineated across the entire region. The classifier saturates quickly: increasing from 30 to 300 labels barely changes accuracy, because the embeddings are doing most of the heavy lifting. The core of the analysis is a few lines of Python: import rasterio import numpy as np from sklearn.pipeline import make_pipeline from sklearn.preprocessing import StandardScaler from sklearn.linear_model import LogisticRegression # Load the 192-band embedding COG exported from Studio with rasterio.open("embeddings.tif") as ds: emb = ds.read().astype(np.float32) # (192, H, W) C, H, W = emb.shape X = emb.reshape(C, -1).T # (H*W, 192) # Train on labeled pixels, predict everywhere clf = make_pipeline(StandardScaler(), LogisticRegression(max_iter=2000)) clf.fit(X[train_idx], labels[train_idx]) prediction = clf.predict(X).reshape(H, W) This is a linear probe, a standard evaluation for foundation models. The fact that a logistic regression over 192 dimensions recovers land-cover boundaries from so few labels means the Tiny encoder has organized these ecological distinctions during pretraining. Larger variants (Base, 768-dim) encode even richer representations. If you have ground-truth polygons, field survey points, or a coarse existing map, you can train a similar classifier and produce a wall-to-wall map for your own region of interest. Because Studio can generate embeddings at any temporal resolution (monthly through annual), you can compare two time periods directly to identify where surface conditions have changed. Below, we computed monthly Sentinel-2 embeddings for the same region in September 2023 and September 2024 and measured per-pixel cosine distance. The Park Fire (July-September 2024) burn scar in Butte County, California lights up immediately. No labels or training requiredβ€”just two embedding COGs and a few lines of Python. Sometimes you have no query location or reference labels. You just want to understand what structure exists in the embeddings. Principal Component Analysis (PCA) is a clean way to do this: reduce to three dimensions, map to R/G/B, and display as a false-color image. Similar embeddings get similar colors automatically. Flevoland, in the Netherlands, is a reclaimed polder landscape with a regular grid of agricultural parcels. The PCA false-color image reproduces those boundaries with high fidelity. Different crop types, water bodies, and urban areas each get distinct hues. The embedding has internalized landscape structure without ever being told what a parcel or crop is. This kind of unsupervised view is a quick way to see what structure the model has picked up across your area of interest. Similarity search, few-shot segmentation, change detection, and PCA exploration are simple operations on standard raster data that run in seconds. The power comes from the embeddings: learned representations that compress earth observation data into vectors capturing rich information about each location from many sensors and millions of training examples. Custom embedding exports are available now. Create a project, configure an embeddings model, and compute your embeddings. The exported GeoTIFF works with any geospatial tool: QGIS, GDAL, rasterio, or your own scripts. For end-to-end code reproducing the examples in this post, see the embeddings tutorial, which includes working code for similarity search, few-shot segmentation, change detection, and PCA visualization. To get hands-on without any local setup, try the Colab notebook. The examples in this post all use frozen embeddings with no task-specific training. Embeddings are a great entry point for leveraging OlmoEarth: they enable fast, cost-effective generation of results, work well in resource-constrained environments, and are easy to share. For applications that require higher performance, OlmoEarth Studio also supports SFT, training a task-specific model head on your own labels, which typically outperforms linear probes on frozen features. While we are always working to improve our pretraining approaches, it's important to check the quality of the embeddings for your use case using some of the techniques described above. Performance also depends on the quality of the input imageryβ€”persistent cloud cover, atmospheric artifacts, or missing observations in the composite period can affect the resulting vectors. Sentinel-2 L2A imagery from the European Space Agency, accessed via Microsoft Planetary Computer. ESA WorldCover 2021 v200 for mangrove reference. The global clustering visualization uses OlmoEarth-v1-Base (768-dim) with seasonal Sentinel-2 composites at patch size 8, instance-level embeddings over 1.1M pretraining samples.
17:00

😺 Watch: AI can write DNA now. What could go wrong?

AI has moved from reading DNA to designing it, and a podcast with Radical Numerics CEO Eric Nguyen walks through what that means for medicine and biosecurity. His earlier model Evo generated a complete viral genome and helped design CRISPR systems, while his newer Omnii ranked Alzheimer's-related genes in about 30 minutes after two years of lab validation. The show also covers 'deepfake viruses' that re-spell a virus to dodge sequence-based detection, and AI-designed phages that could fight drug-resistant bacteria. The catch is that the same models used to design biology may be needed to catch it, and physical experiments are still required before anything leaves the computer.

Notes

😺 Watch: AI can write DNA now. What could go wrong?

The Neuron podcast (Aug 12, 2026). Hosts Corey and Grant interview Eric Nguyen, co-founder/CEO of Radical Numerics, about genomic AI.

Core substance
  • DNA is 4 letters; human genome β‰ˆ 3 billion base pairs. Nguyen's teams treat sequences as language so models learn "biological grammar" from raw data.
  • Evo (Nguyen's earlier model): genome language model trained across the tree of life. Used to design working CRISPR-Cas systems and to generate a complete bacteriophage genome (the latter widely covered after viral-genome design "went viral last week").
  • Omnii (Radical Numerics' new direction): multimodal biological model combining DNA + RNA + proteins + epigenetics to model how changes cascade through a system. Newsletter's gloss: aiming to "model the human body and solve all illness."
Episode highlights (timestamps)
  • (09:41) Evo generated the full DNA sequence for a bacteriophage β€” which is also why the same capability is "an obvious biosecurity problem."
  • (31:05) A new teammate used Omnii to rank Alzheimer's-related genes in ~30 minutes; scientists had spent two years validating those same genes in the lab.
  • (38:39) "Deepfake virus": AI could change a virus's genetic spelling while preserving function, potentially bypassing sequence-based detection.
  • (44:33) AI-designed bacteriophages to target drug-resistant bacteria when antibiotics fail β€” "custom biological countermeasures on demand."
  • (45:24) Personalized medicine: doctor snapshots your biology, AI designs a bespoke treatment; Nguyen thinks AI may make that old promise practical.
  • (49:10) Grant asks the genomic-AI researcher for his best theory on the origin of life.
Stated caveats / limits
  • Validation is the hard part. A model can propose a sequence quickly, but "scientists still need physical experiments, manufacturing, and safety checks before biology leaves the computer."
  • Dual-use framing (newsletter's reading): "the same models that can design novel biology may be needed to detect it." Detection is sequence-based today and thus defeatable by function-preserving mutations.
  • The biosecurity tension is left unresolved: no screening/countermeasure policy described.
Context / sponsor material (not editorial)
  • Sponsor (Least Privilege/AI agents): agents growing 40% YoY in enterprises; 7% of orgs had an agent-related security incident this year; pitch is scoping/expiry/attribution across Claude Code, Copilot, Cursor.
  • Live LTX-2.5 video-prompting demo: Thu Aug 13, 10 AM PT.
  • Related episodes: hybrid/local AI (Intel's Olena Zhu; "Fable-class AI on laptops within two years" if trends hold), AWS-in-Claude-Code startup speed (Deap Ubhi), autonomous surgery trust (Mathias Unberath), model interpretability (Goodfire CEO Eric Ho).
Note

The "deepfake virus" and bacteriophage-genome items echo a separate viral story from the prior week ("AI can now design viruses"), referenced but not sourced here.

Full text · 6,818 chars
😺 Watch: AI can write DNA now. What could go wrong? Radical Numerics CEO Eric Nguyen on AI-designed biology, deepfake viruses, and personalized medicine. Welcome, humans. Most AI models write text, images, or code. Eric Nguyen helped build one that can read and write DNA. This is a big deal, especially after the reality that AI can now design viruses went viral last week (pun very much intended). In our latest podcast episode, Corey and Grant spoke with Eric Nguyen, co-founder and CEO of Radical Numerics, about AI-designed CRISPR systems, complete viral genomes, personalized medicine, and what happens when biological AI can create things nature never did. Eric’s earlier model, Evo, helped scientists design working CRISPR-Cas systems and later generate a complete bacteriophage genome. His new company is pushing toward multimodal biological models that combine DNA with RNA, proteins, epigenetics, and other signals. In other words (our interpretation here), they’re trying to model the human body and solve all illness. Here’s our favorite parts: - (09:41) AI generated a complete viral genome: Eric explains how scientists used Evo to create the full DNA sequence for a bacteriophage, then why that same capability creates an obvious biosecurity problem. - (31:05) Two years of experiments, reproduced in 30 minutes: A new Radical Numerics teammate used Omnii to rank Alzheimer’s-related genes in roughly half an hour after scientists spent two years validating them in the lab. - (38:39) What is a β€œdeepfake virus”? Eric explains how AI could change the genetic spelling of a virus while preserving its function, potentially bypassing sequence-based detection. - (44:33) Custom biological countermeasures on demand: The group explores AI-designed bacteriophages that could target drug-resistant bacteria when ordinary antibiotics fail. - (45:24) Personalized medicine at the limit: Could a future doctor take a snapshot of your biology and design a bespoke treatment for you? Eric thinks AI may finally make that old promise practical. The biggest idea is that biological AI is moving from reading life to designing it. That could mean better medicines and gene therapies, but it also creates a new security problem: the same models that can design novel biology may be needed to detect it. Why watch this? Because Eric makes genomic AI understandable without sanding off the weirdness. You will see how DNA becomes a language-model problem, why biology needs enormous context windows, and where the line sits between medicine and misuse. P.S. For the philosophical dessert, jump to 49:10, when Grant asks a genomic-AI researcher for his best theory on the origin of life. Keep scrolling for the security problem hiding inside AI agents, a deeper look at biological AI, and four recent Neuron conversations worth watching next. THIS EPISODE WAS BROUGHT TO YOU BY… Least Privilege for the Age of AI Agents AI agents are growing 40% year-over-year inside enterprises. 7% of orgs already had an agent-related security incident this year. The problem: AI agents don't create new permissions β€” they weaponize the ones already there. Same cloud keys, same tokens. No scoping. No expiration. No one watching. β†’ Sees every agent β€” including shadow AI β†’ Attributes every action to human or agent β†’ Blocks risky commands, enforces approval before agents act β†’ Works across Claude Code, Copilot, Cursor, more β€” one policy, any vendor πŸ”΄ LIVE TOMORROW: Learn AI Video Prompting with the LTX Team Thursday, August 13 at 10 AM PT: We’re going LIVE with the team behind the newly announced LTX-2.5 for a total beginner’s guide to AI video generation and video prompting. We’ll go hands-on with the new model while the LTX team teaches us how to write better video prompts, control shots and motion, describe scenes clearly, and understand what video models actually pick up from your instructions. No AI video experience required. Bring your weird prompts, difficult questions, and video ideas. We’ll demo LTX-2.5 live, put it through its paces, and answer questions with the team that built it. DNA is a sequence of just four letters, but a human genome contains roughly 3B base pairs. Eric’s team treats those sequences like language so models can learn biological grammar from raw data. - Evo: a genome language model that learned from DNA across the tree of life and helped generate CRISPR-Cas systems and a bacteriophage genome. - Omnii: Radical Numerics’ newer direction, combining DNA with RNA, proteins, epigenetics, and other biological signals. - The goal: understand how biological changes cascade through a system so researchers can design safer therapies and respond faster to new threats. The hard part is validation. A model can propose a sequence quickly, but scientists still need physical experiments, manufacturing, and safety checks before biology leaves the computer. Explore the work: πŸŽ™οΈ In Case You Missed It… 1. Want to run powerful AI without sending everything to the cloud? TL;DW: Intel’s Dr. Olena Zhu explains why the future of AI may be hybrid: private and repetitive work stays local, while harder reasoning gets routed to bigger cloud models. Plus, she shares a staggering fact: if current trends hold, we might have Fable-class AI on our (powerful) laptops β€œwithin two years.” Why you should watch: It turns β€œlocal AI” from a privacy slogan into a practical architecture for agents, cost, and reliability, along with the tools you can use to do it. 2. Building something with AI? Watch: AWS Put a CTO Inside Claude Code TL;DW: AWS startup leader Deap Ubhi explains how AI compressed startup iteration from months into days, while security, infrastructure, and reliability still separate a prototype from a business. Why you should watch: It shows when builders should move fast and when technical shortcuts become expensive traps. 3. How do you make truly autonomous surgery trustworthy? This interview will teach you… TL;DW: Mathias Unberath explains why autonomous surgery is difficult, how developers test rare failures, and what reliability means when mistakes have physical consequences. Why you should watch: It is a sharp guide to the gap between a technical demo and a dependable real-world system. 4. Want to open AI’s black box? TL;DW: Goodfire CEO Eric Ho explains features, circuits, confidence signals, and how researchers may inspect what models are doing internally. Why you should watch: It replaces β€œthe model is magic” with a practical look at debugging and steering AI systems. New episodes of The Neuron: AI Explained explore the breakthroughs, businesses, and people shaping artificial intelligence. Subscribe on YouTube by clicking below to help us get even more amazing guests like this one to teach you new things about AI every week! Stay curious, The Neuron Team
17:07

CIOs and CTOs spent years lauding AI . Now, with costs rising, they're putting limits on how it's used

Tech chiefs who spent years championing AI are now capping how it gets used as the bills climb. CIOs and CTOs are putting limits on AI usage because costs are rising, a reversal from earlier enthusiasm. Engineers adopted the tools first and heaviest, but even they are facing restrictions.

Full text · 144 chars
Internally, Nandy lauded that every engineer has embraced AI tools and ... Engineers were the first to use AI expansively, but Artzi says he ...
17:22

Xiangtian Hui Examines Machine Learning and Data Engineering Methods for Healthcare ...

A new peer-reviewed paper uses a prompt-based BioMRC model for medical named entity recognition, an NLP technique that pulls entity names out of healthcare text. Published in an international journal, it targets healthcare data systems and cancer informatics. It's a specialized academic contribution with niche applicability.

Full text · 154 chars
In Research on Medical Named Entity Recognition Technology Based on Prompt BioMRC Model for Deep NLP Algorithm, published in the International Journal ...
17:28

Nous Research's Hermes Agent Now Lets You Pack and Share Entire AI Setups

Nous Research's Hermes Agent can now pack an entire AI agent setup into a single file and share it anywhere. New /export and /import commands bundle skills, memory, the agent's personality file, cron jobs, plugins, and desktop themes, while always stripping credentials. It solves the pain of copying configs by hand and leaking secrets, and a separate git-based system handles versioned team-scale sharing with one-command installs. The agent stays fully open-source under an MIT license.

Notes
Hermes Agent gains /export and /import for portable profiles
  • Feature: Hermes Agent (open-source self-improving AI agent, Nous Research) now ships two new slash commands β€” /export and /import β€” that pack/restore a full agent profile as a single file, replacing manual file-copying.
  • What a profile packs: config, .env, memory, skills, sessions, gateway setup (live under ~/.hermes/profiles/<name>/), custom SOUL.md (agent personality), MCP server connections, pipeline settings, cron jobs, plugins, desktop themes.
  • Security: credentials are always stripped on export.
  • Profile Distributions (separate, git-based system): versioned, team-scale agent sharing with one-command installs and updates.
  • Licensing/platforms: fully open-source (MIT), free; runs on Linux, macOS, WSL2. Available now; full CLI reference in official docs.
"Hermes is the only open-source agent with a true built-in learning loop β€” it doesn't just complete tasks, it remembers, builds reusable skills, and gets smarter every time you use it." (AlphaSignal, 2026-08-12)
  • Problem solved: previously, sharing a "Code Review Specialist" or "Research Assistant" profile meant pushing individual skill files to GitHub β€” losing the creation context, design decisions, and configuration that made the skills useful.
  • Caveat: source does not state file format/size limits, import-restore fidelity, or whether the credentials-stripping is mandatory or toggleable; "one-command" installs/updates claimed for Profile Distributions but no exact command shown.

---

Notes by AlphaSignal (feed), published 2026-08-12T17:28:36+00:00.

Full text · 2,146 chars
- Hermes Agent now supports /export and/import slash commands to pack and restore full agent profiles as a single file. - Exported profiles include skills, memory, persona (SOUL.md), cron jobs, plugins, and desktop themes -- credentials are always stripped. - The feature solves the longstanding problem of sharing a fully configured agent setup without manual file copying or leaking secrets. - A separate "Profile Distributions" system (git-based) exists for versioned, team-scale agent sharing with one-command installs and updates. - Hermes Agent is fully open-source (MIT), free to use, and runs on Linux, macOS, and WSL2. - The feature is available now; see the official docs for the full CLI reference. Hermes Agent, the open-source self-improving AI agent from Nous Research, just made one of its most-requested quality-of-life improvements: profiles are now fully portable. Two new slash commands, /export and /import, let you pack an entire agent setup into a single file and load it anywhere, no manual file-copying required. What a profile actually contains If you haven't used Hermes before, a quick orientation: Hermes is the only open-source agent with a true built-in learning loop -- it doesn't just complete tasks, it remembers, builds reusable skills, and gets smarter every time you use it. All of that accumulated state lives inside a profile. A profile is more than a config file. A profile has its own config, .env, memory, skills, sessions, and gateway setup under ~/.hermes/profiles/<name>/. People build highly specialized ones: a custom SOUL.md (the agent's personality), curated skills, MCP server connections, pipeline settings, cron jobs -- the works. The problem this solves Imagine someone builds a "Code Review Specialist" profile, or a "Research Assistant" profile, complete with the right SOUL, the right skills, the right MCP connections, and the right cron schedule. Until now, there was no way to share that as a unit. You could push individual skill files to GitHub, but the creation context, design decisions, and configuration that made those skills actually useful were lost the moment the session ended.
02:20

2 Unstoppable Artificial Intelligence (AI) Stocks That Will Join Amazon in the $3 Trillion Club by 2027

A stock-picking site predicts two chipmakers will hit $3 trillion in valuation alongside Amazon by 2027. TSMC is pouring money into production capacity on huge demand, and Broadcom expects a major demand wave in 2027. This is analyst speculation from a finance newsletter, not confirmed news.

Full text · 154 chars
Taiwan Semiconductor is investing more money into production facilities due to huge demand. Broadcom has a major demand wave coming in 2027, adding to ...
04:00

Conflict or Strategy? Asymmetric Role Framing of La France insoumise and Rassemblement National in French News Headlines, 2022-2025

French media frame the far-left and far-right through different lenses β€” one as aggressors, the other as election strategists. Analyzing 28,000-plus headlines from 25 outlets across three years, the study found La France insoumise mostly gets conflict framing while Rassemblement National gets strategic-game framing, and the split is stable over time. Patterns of blame and legitimacy vary by outlet rather than by party. The piece is mainly a methods contribution for studying political text with LLM annotation pipelines.

Notes
  • Paper: "Conflict or Strategy? Asymmetric Role Framing of La France insoumise and Rassemblement National in French News Headlines, 2022-2025" (arXiv cs.CL, published 2026-08-12).
  • Corpus: 28,592 headlines on La France insoumise (LFI) and Rassemblement National (RN), from 25 French-language outlets, 2022–2025.
  • Method: three-model LLM annotation pipeline, validated against a stratified human audit; role/valence framing categories plus a "moral-accounting" layer (blame, legitimization, victimhood).

Core finding β€” role asymmetry, not valence asymmetry

  • Conflict framing and strategic-game framing are "more robust across models and time than delegitimization," with AGGRESSOR serving as "corroborating role syntax."
  • LFI appears in headlines "more often through a conflict register"; RN "through a strategic-electoral register."
  • The role gap is "direction-stable across all three annotation models," survives "bootstrapping and permutation tests," and persists "across outlet families and most of 2022-2025."

Secondary finding β€” moral accounting is outlet-structured

  • Who is blamed/legitimized/victimized is "structured by outlet rather than party," producing "aggregate nulls that conceal some of the corpus's most polarized patterns."

Methodological limits (stated)

  • Two-tier reliability: conflict and strategic-game framing have strongest human validation and cross-model stability; actor role is direction-stable but only "corroborating" because "its audit reliability is lower"; normative constructs (legitimacy, blame) are "weaker."

Contribution: proposes political-role assignment as a target for computational framing research "that decomposes what valence-based measures conflate," and a "construct-stratified reliability framework for calibrating majority-vote LLM annotation pipelines."

Note: this is abstract-only (no full text available in source); specifics like exact labels and model identities aren't disclosed here.

Full text · 2,629 chars
Computer Science > Computation and Language Title:Conflict or Strategy? Asymmetric Role Framing of La France insoumise and Rassemblement National in French News Headlines, 2022-2025 View PDF HTML (experimental) Abstract:Do French news headlines frame left- and right-populist challengers as symmetric ``extremes,'' or as fundamentally different political adversaries? We examine 28,592 headlines about La France insoumise (LFI) and Rassemblement National (RN) published by 25 French-language outlets between 2022 and 2025, annotated through a three-model LLM pipeline validated against a stratified human audit. The clearest finding is role asymmetry rather than valence asymmetry: conflict framing and strategic-game framing are more robust across models and time than delegitimization, with AGGRESSOR serving as corroborating role syntax. LFI appears in headlines more often through a conflict register and RN through a strategic-electoral register. This role gap is direction-stable across all three annotation models, survives bootstrapping and permutation tests, and persists across outlet families and most of 2022-2025. A secondary moral-accounting layer (who is blamed, legitimized, or cast as a victim) is structured by outlet rather than party, producing aggregate nulls that conceal some of the corpus's most polarized patterns. Methodologically, the annotation pipeline reveals a two-tier reliability profile: conflict and strategic-game framing achieve the strongest human validation and cross-model stability; actor role is direction-stable but treated as corroborating because its audit reliability is lower; normative-judgment constructs (legitimacy, blame) are weaker. The paper contributes political-role assignment as a target for computational framing research that decomposes what valence-based measures conflate, and establishes a construct-stratified reliability framework for calibrating majority-vote LLM annotation pipelines in political text tasks. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Position Encoding in Transformers: From Absolute and Relative Methods to Rotary Position Embeddings and Long-Context Scaling

A survey pulls together how modern AI models keep track of word order in text. It walks through absolute and relative position methods, the rotation-based RoPE used by most current models, and long-context extensions like YaRN and NTK-aware scaling. The catch: handling positions beyond training length doesn't guarantee reliable long-context performance, so real evaluation needs short-context retention, retrieval, and reasoning tests, not just fluency scores. No new experiments here, just a unification of existing work.

Notes

Position Encoding in Transformers β€” Absolute, Relative, RoPE, Long-Context Scaling

Source: arXiv cs.CL technical survey (feed, 2026-08-12). Title: "Position Encoding in Transformers: From Absolute and Relative Methods to Rotary Position Embeddings and Long-Context Scaling".

Scope

Problem: self-attention models content-dependent token interactions but encodes no token order; position encoding injects absolute coordinates, relative distances, or position-dependent rotations into representations and attention scores.

Methods covered (unified account)
  • Sinusoidal + learned absolute position embeddings
  • Shaw-style relative position representations
  • Transformer-XL
  • T5 relative position bias
  • ALiBi
  • RoPE β€” survey derives how RoPE converts absolute position indices into relative phase differences in Query–Key inner products.

Methods compared on four axes: where position is injected, computational cost, compatibility with KV caching, and length extrapolation.

Long-context extensions

Position Interpolation, RoPE scaling laws, NTK-aware scaling, Dynamic NTK, NTK-by-parts, YaRN, LongRoPE, LongRoPE2 β€” analyzed with emphasis on frequency allocation, attention rescaling, training length, and target context length.

Also covered

Implementation considerations, evaluation protocols, and the position-encoding choices in representative LLMs.

Central conclusion
"the ability to compute positional features beyond the training length does not imply reliable long-context generalization; context extension must be evaluated through short-context retention, position-wise perplexity, retrieval, reasoning, and long-context code tasks."

Evaluation must therefore be multi-task, not just extrapolation.

Caveats
  • Only the abstract was available for these notes; method details, derivations, and per-model encoding tables are inside the full paper.
  • No benchmark numbers, model names, or release dates appear in the abstract.

Saved to notes/position-encoding-transformers-survey-2026-08-12.md.

Full text · 2,377 chars
Computer Science > Computation and Language Title:Position Encoding in Transformers: From Absolute and Relative Methods to Rotary Position Embeddings and Long-Context Scaling View PDF HTML (experimental) Abstract:Self-attention models content-dependent interactions between tokens but does not by itself encode token order. Position encoding addresses this limitation by introducing absolute coordinates, relative distances, or position-dependent rotations into Transformer representations and attention scores. This technical survey develops a unified account of sinusoidal and learned absolute position embeddings, Shaw-style relative position representations, Transformer-XL, T5 relative position bias, ALiBi, and Rotary Position Embeddings (RoPE). We derive how RoPE converts absolute position indices into relative phase differences in Query-Key inner products and compare these methods in terms of where position is injected, computational cost, compatibility with KV caching, and length extrapolation. We then examine long-context extensions, including Position Interpolation, RoPE scaling laws, NTK-aware scaling, Dynamic NTK, NTK-by-parts, YaRN, LongRoPE, and LongRoPE2, with emphasis on frequency allocation, attention rescaling, training length, and target context length. We also summarize implementation considerations, evaluation protocols, and position-encoding choices in representative large language models. A central conclusion is that the ability to compute positional features beyond the training length does not imply reliable long-context generalization; context extension must be evaluated through short-context retention, position-wise perplexity, retrieval, reasoning, and long-context code tasks. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:00

Multimodal Item Parameter Estimation using Simulated Response Probabilitie

A fine-tuned multimodal AI model based on Qwen3.5 can estimate the difficulty of multiple-choice test items from images and text, for both standard and more complex scoring models. It learns to mimic students' error patterns across ability levels and predicts item difficulty from option probabilities on held-out data. Useful for psychometrics and automated test building, but a narrow applied result.

Notes

Multimodal Item Parameter Estimation using Simulated Response Probabilities

arXiv (cs.CL), published 2026-08-12. Abstract only; no full text details.

Method
  • Fine-tunes a Qwen3.5-based multimodal LLM to reconstruct item-response curves for two psychometric models:
  • 3PL β€” three-parameter logistic
  • MCM β€” multiple-choice model
  • Model is prompted and fine-tuned to replicate choice probabilities over a "large training corpus" of multiple-choice items containing both image and text stimuli.
  • Training is conditioned on a labeled set of student ability levels; the model learns to reproduce students' systematic error patterns across a discrete range of abilities.
Core claim
"By learning to reproduce the systematic error patterns of students across a discrete range of abilities, the LLM implicitly captures the underlying response probabilities encoded in the 3PL and MCM curves."
  • Item difficulty is then approximated directly from the model's predicted option probabilities, evaluated on a held-out test set.
Limitations / caveats
  • Abstract reports no quantitative results: dataset size, number of items/abilities, model parameters, or achieved accuracy vs. IRT ground truth are all unspecified.
  • "Implicitly captures" is asserted without mechanistic evidence (no probing, no ablation reported in the abstract).
  • Only difficulty is validated; discrimination and guessing (pseudo-chance) parameters of 3PL are not mentioned.
  • No comparison against non-LLM baselines (e.g., conventional IRT estimation or embeddings-only models) is stated.
  • Generalization beyond Qwen3.5 or to real (non-simulated) student response data is unaddressed β€” "simulated response probabilities" in the title suggests training on model-generated rather than actual examinee data.
Full text · 1,573 chars
Computer Science > Computation and Language Title:Multimodal Item Parameter Estimation using Simulated Response Probabilitie View PDF HTML (experimental) Abstract:We present results from reconstructing multiple-choice model (MCM) and three-parameter logistic (3PL) model curves using a fine-tuned multimodal large language model (LLM) based on Qwen3.5. The model is prompted and fine-tuned to replicate choice probabilities across a large training corpus of multiple-choice items containing both image and text stimuli, conditioned on a labeled set of student ability levels. By learning to reproduce the systematic error patterns of students across a discrete range of abilities, the LLM implicitly captures the underlying response probabilities encoded in the 3PL and MCM curves. This allows us to accurately approximate item difficulty on a held-out test set directly from the model's predicted option probabilities. Bibliographic and Citation Tools Code, Data and Media Associated with this Article Demos Recommenders and Search Tools arXivLabs: experimental projects with community collaborators arXivLabs is a framework that allows collaborators to develop and share new arXiv features directly on our website. Both individuals and organizations that work with arXivLabs have embraced and accepted our values of openness, community, excellence, and user data privacy. arXiv is committed to these values and only works with partners that adhere to them. Have an idea for a project that will add value for arXiv's community? Learn more about arXivLabs.
04:03

From Doodles to Discussion Boards: How β€œAI Image Combine” Can Turn Your Child's Art ...

A teaching article suggests using an AI image-combining tool to turn kids' doodles into prompts, sneaking in lessons on iterative design and prompt engineering. The writer frames it as building resume-worthy skills and notes academic guardrails for classroom use. Practical classroom idea more than a product or model story.

Full text · 144 chars
You are covertly teaching iterative design and prompt - engineering β€”resume-worthy skills in the age of generative AI. Guardrails & Academic ...
04:18

Behind the Frenzy of Multi-Million Annual Salary Offers for AI Talents: What Do Top ... - 36ζ°ͺ

Meta is paying multi-million-dollar annual salaries to recruit top AI researchers and engineers even while it lays off staff elsewhere. The report from Chinese outlet 36Kr looks at what elite AI talent is worth during the hiring frenzy. Details beyond the headline are thin.

Full text · 146 chars
Despite the recent wave of layoffs, Meta is still investing heavily in recruiting AI researchers and engineers , with reports stating that the ...
04:57

omnius1234/wan- prompt - engineer /system - Ollama

Someone shared a ready-made prompt pack for getting the Wan2.2 video model to follow instructions better. It's a system prompt posted on Ollama that's meant to rewrite or create prompts for Wan2.2's image-to-video mode. Details are thin, so this is basically a community prompt-engineering resource dump.

Full text · 152 chars
You are an expert prompt engineer specialized in Wan2.2 video generation model. Your task is to rewrite or create prompts optimized for Wan2.2 I2V ( ...
06:53

AI Creator Prompt Engineer 1707553 - OnlineJobs.ph

A company building AI-generated social media creators is hiring a prompt engineer to run the systems behind that content. The role is about building and scaling the tools that produce fictional influencer posts. A hiring sign that AI creator content is becoming a real category.

Full text · 145 chars
We are building and scaling AI-generated social media creators and need an experienced prompt engineer to build the systems behind their content.
07:10

AI Engineering Readiness: Defining the Future of Software Delivery

A consulting firm argues the future of software delivery depends on whether engineering teams are ready to use AI responsibly and efficiently. The TCS blog post calls this "AI engineering readiness" and makes it the deciding factor, but offers little concrete detail. It reads as corporate thought leadership rather than news.

Full text · 154 chars
It will be determined by the readiness of the engineering workforce to use AI responsibly, efficiently, and with sound engineering judgement. The next ...
07:53

Before the First Well: AI -Driven Field Development Planning - JPT/SPE

AI is being applied to oil and gas field development planning β€” deciding where to drill before the first well goes in. The article is a technical piece in the Journal of Petroleum Technology, written by a team of petroleum engineers, but the listing carries little more than the title and authors. Treat it as a signal that AI planning tools are spreading into upstream energy work, not a deep read.

Full text · 150 chars
The Petroleum Engineer's Role Β· Ashish Fatnani Β· Shashwat Verma Β· Yusuf Ajibola Falola Β· Vivek Kesireddy Β· Aman Srivastava Β· Geetha Gopakumar Nair ...
09:08

How we picked 35 of the world’s top young scientists and engineers

MIT Technology Review is naming 35 top young scientists and engineers from around the world to its 2026 Innovators Under 35 list. The editors picked winners from 550 nominations, trimmed to 110 semifinalists, with 44 expert judges scoring their applications. Honorees work in four categories: biotech, AI, computing and robotics, and climate and energy. The list drops for subscribers on September 8. The content is mostly a process explainer β€” thin on actual results.

Notes

MIT TR: Innovators Under 35 β€” 2026 selection process

2026 list of 35 winners reveals September 8 (subscriber-gated online); Sept/Oct print issue hits newsstands Aug 31. Four categories: biotechnology, AI, computing & robotics, climate and energy.

Selection pipeline (2026 cycle)

  • 550 nominations received (staff + public process)
  • Editors cut to 110 semifinalists
  • Semifinalists completed an application: reference letters, videos, rΓ©sumΓ©s
  • 44 expert judges scored applications β€” some are former honorees, many return year after year
  • Editors reviewed all scores/comments and chose the 35 winners

Selection criteria: candidates "setting out to solve big problems or answer pressing scientific questions," with "clear progress" already demonstrated.

Judging quote:

"These Innovators represent some of the best aspects of science and technology researchβ€”pushing forward bold ideas to improve the future for everyone." β€” Costa Samaras, 2026 judge and director, Carnegie Mellon's Scott Institute for Energy Innovation

Context/history: First list published 1999. Previous honorees cited: Lisa Su (2002), AMD turnaround; Daniel Ek (2012), Spotify cofounder ("a jukebox in the cloud"). Sister lists: 10 Breakthrough Technologies, 10 Climate Tech Companies to Watch, and new this year, 10 Things That Matter in AI Right Now.

Caveats/limits: Winners restricted to the four named fields; list is subscriber-only at launch. Nominations for 2027 open by early December.

Full text · 3,613 chars
Next month, on September 8, MIT Technology Review will reveal its 2026 list of Innovators Under 35, recognizing 35 young people from around the world who are doing groundbreaking scientific work and building clever technical fixes for sticky problems. By finding the top young innovators globally and learning what they’re focused on in their work, we aim to give readers a sense of what advances to expect in the years to come. As a newsroom, we also use this exercise to help us spot rising talent and get to know some of the best early-career researchers in the fields that we cover. The editors of MIT Technology Review published the first Innovators Under 35 list in 1999, and it’s become a beloved annual tradition alongside our lists of 10 Breakthrough Technologies, 10 Climate Tech Companies to Watch, and (new this year) 10 Things That Matter in AI Right Now. The people we’ve featured through the years have gone on to shape the tech industry and our broader culture, from Lisa Su (featured in 2002), whose stunning turnaround of AMD has built it into one of the top chipmakers worldwide, to Daniel Ek (featured in 2012), who cofounded Spotify (which we described at the time as β€œa jukebox in the cloud”). Subscribers can browse all the past honorees in this database. Selecting the 2026 Innovators was a monthslong endeavor. This year, we received 550 nominations, both from staff and via our public nomination process. From those entries, our editors selected 110 semifinalists. We looked for candidates who were setting out to solve big problems or answer pressing scientific questions in their work, and who had already made clear progress toward their goals. All semifinalists then completed an application to help us learn more about them. They collected reference letters, uploaded videos, and submitted rΓ©sumΓ©s. Forty-four expert judges then helped us evaluate these applications. Some of these judges are former Innovators themselves. Many have returned year after year to volunteer their time, energy, and expertise to the judging process. We’re grateful for their efforts. In the end, our editors reviewed all of the judges’ scores and comments and selected the 35 winners. Each works in one of four categories: biotechnology, artificial intelligence, computing and robotics, and climate and energy. β€œThese Innovators represent some of the best aspects of science and technology researchβ€”pushing forward bold ideas to improve the future for everyone,” says Costa Samaras, a 2026 judge who is also the director of Carnegie Mellon’s Scott Institute for Energy Innovation. The 2026 list of Innovators will be available to MIT Technology Review subscribers on our site on September 8. To access the package when it comes out online, you can subscribe now via this link. It will also be published in the September/October issue, which will be available on newsstands worldwide on August 31. Do you know someone who deserves a spot on next year’s list? Nominations for the 2027 competition will open by early December. Check back then or sign up for our daily newsletter The Download to stay in the loop. Deep Dive Culture Inside the world’s deepest and longest subsea road tunnel Norway’s Rogfast is an exceptional engineering feat, opening a route for drivers deep below the North Sea. We went down to see it. South Korea’s hottest new bachelors are chip workers As payouts from the AI boom soar, a job at SK Hynix can put you at the front of the matchmakers’ queue. Stay connected Get the latest updates from MIT Technology Review Discover special offers, top stories, upcoming events, and more.
09:12

Tinker workshop draws overflow crowd as Department of War scales enterprise AI - DVIDS

The Department of War ran a prompt-engineering workshop at Tinker Air Force Base that drew an overflow crowd as part of scaling enterprise AI. Facilitators walked attendees through prompt engineering, creative problem-solving, and process optimization. A routine internal training event more than a policy shift.

Full text · 154 chars
Facilitators walked attendees through prompt engineering and techniques for applying AI to problem-solving, creative thinking and process optimization ...
10:31

AI chatbots are offering financial advice. Should you trust them? - NPR

AI chatbots can get the basics of personal finance right, but experts say you shouldn't fully trust them for money advice. NPR's piece looks at where ChatGPT-style bots nail fundamentals and where they go wrong on financial questions. The takeaway is consumer caution, not a new capability claim.

Full text · 146 chars
The ChatGPT app icon is seen on a smartphone screen, among other app icons. Experts say AI can get personal finance fundamentals right but may ...
10:55

I'm becoming less interested in whether employees are adopting AI . I'm becoming much ... - LinkedIn

A tech executive says the real question has shifted from whether employees adopt AI to what it actually delivers, after engineering teams pushed back on being told to go "AI-first." The LinkedIn post describes how leadership avoided relying on a top-down announcement and instead worked through skepticism. It's an opinion post with no data, just an anecdote.

Full text · 145 chars
Its engineering organization encountered AI skepticism. Leadership didn't rely solely on an announcement telling employees to become " AI -first.
11:07

InHand Networks Introduces InCloud Agent , an AI Force Multiplier for Network Operations

InHand Networks is shipping an AI add-on, InCloud Agent, meant to take over diagnosing faults and managing operational risk across network operations. The pitch: devices and data can already be managed centrally, but the tricky part of figuring out what went wrong still leans on engineers β€” the agent is meant to carry that load. There's no customer adoption data yet, just the announcement.

Full text · 148 chars
Devices and data can be managed centrally, but diagnosing faults and deciding how to handle operational risk still depend heavily on engineering ...
12:15

The First AI IPO Won't Decide Who Wins AI - Unite.AI

Whoever lands the first AI IPO won't actually settle which company wins the AI race. This analysis argues the real fight is over which businesses capture the value AI creates, and the public markets will put that to the test. The article itself offers few specifics, so this summary leans on the headline.

Full text · 149 chars
His expertise spans large language models, AI agents, prompt engineering , model optimization, and production-grade AI architecture, with a focus ...
12:26

AI is a multiplier, not a shortcut: an NTU alumnus on getting more out of it | Alumni | NTU Singapore

Using AI pays off when you treat it as a multiplier, not a shortcut. An NTU Singapore alumnus says learning prompt engineering trained them to think like a system and get AI to do what they want. It's a personal how-to story rather than new research, and details are limited.

Full text · 144 chars
Learning prompt engineering helped me to think like a system. In order to get a system to do something, you've got to think like it." Why AI ...
12:35

Trimble Arc Agent adds AI to logistics office workflows - Engineering .com

Trimble released Arc Agent, an AI assistant for logistics office workflows. It's sold as a subscription service that connects to existing transportation management systems to automate office tasks. A routine product launch aimed at logistics companies.

Full text · 150 chars
Trimble Arc Agent is offered as a subscription-based software-as-a-service solution. It connects to existing transportation management systems and ...
12:46

MathWorks Showcases Agentic AI for Future Automotive Engineering - Motorindia

MathWorks, maker of MATLAB, is pushing agentic AI as a tool for automotive engineering, pairing it with its Model-Based Design methodology. Its global automotive industry manager says it helps engineers manage complex design and simulation workflows. This is a vendor showcase rather than a new product announcement.

Full text · 152 chars
Mr. Wensi Jin, Global Automotive Industry Manager at MathWorks, explained how combining Model-Based Design with Agentic AI can help engineers manage ...
13:28

TestMu AI Launches One-Click Migration From qTest to Test Manager | Markets Insider

The testing platform TestMu AI, formerly LambdaTest, now offers a one-click migration from qTest to its Test Manager. The announcement is thin on detail, so this is mostly from the headline. It's aimed at teams moving test management into the company's agentic AI quality platform.

Full text · 143 chars
SAN FRANCISCO & NOIDA, Aug. 12, 2026 (GLOBE NEWSWIRE) -- TestMu AI (formerly LambdaTest), the Agentic AI Quality Engineering platform, annou...
13:32

Our investment in CodeRabbit: building the control layer for agentic software development

VC firm Atomico is backing code review startup CodeRabbit, calling it the control layer for agentic software development. Atomico notes large enterprises now run three to five different code generation tools at the same time to match developer preferences, so review and governance must sit across all of them. The post is a fund's investment note, so it's part news, part positioning.

Full text · 150 chars
Large enterprises increasingly run three to five different code generation tools side by side, reflecting the preferences of different engineering ...
14:05

97 Percent of CEOs Are Using AI . Legal and Engineering Are Among the Fastest-Growing Uses

Nearly all CEOs now report using AI, with legal and engineering among the fastest-growing use cases. The 97% figure comes from Inc., and Ironclad CEO Dan Springer frames AI contract work as a 'more, better, faster' play.

Full text · 147 chars
It's a classic 'more, better, faster' play,” Dan Springer, CEO of Ironclad, an AI contract management company, told Inc. β€œLegal and engineering ...
14:30

Alloy raises $8M seed to help engineers debug robot fleets with AI | Dealroom.co

Australian startup Alloy raised $8 million in seed money for AI agents that help engineers debug robot fleets. Its agents analyze robot data and pinpoint the root cause of failures instead of just flagging errors. A small but early bet on using AI to maintain physical robots at scale.

Full text · 150 chars
Alloy, an Australian startup that builds AI agents to analyse robot data and pinpoint the root causes of failures, has raised $8 million in a seed ...
14:34

AI Didn't Replace Your Engineers . So What Did It Do? | Industrial Equipment News

AI isn't replacing engineers β€” it's killing the tedious work that slowed them down, argues Full Spectrum's software engineering director in Industrial Equipment News. The piece pushes back on job-replacement fears and reframes AI as a productivity boost for existing engineering teams.

Full text · 150 chars
AI didn't eliminate engineers β€”it eliminated the tedious work that was slowing them down. Jonathan Burk, Software Engineering Director, Full Spectrum.
14:39

SpaceXAI launches Grok Bot as the agent race moves to office work - TNW

AI firm SpaceXAI launched Grok Bot, its entry into the race to bring AI agents to everyday office work. The company says it already uses the agents internally across its engineering teams. It follows reports that Cursor is building a general-purpose office agent, signaling the agent wars are moving beyond coding.

Full text · 153 chars
SpaceXAI says it has been using them internally across engineering ... TNW reported in July that Cursor was building a general-purpose office agent , ...
15:08

Quoting Florian Herrengt

AI-assisted coding can leave a project so tangled that nobody on the team understands it, not even the AI that helped build it. In this quoted vignette, an engineer facing a bug that Claude can't fix admits they don't know where the feature's data comes from. The point is that AI tools are quietly making software too convoluted for anyone to maintain. It's a short commentary quote, not a news item.

Full text · 751 chars
12th August 2026 But then users start to report a weird bug. It's the 4th time your team has been trying to fix it. I mean... asking AI to fix it. Unfortunately, it seems like not even Fable can figure it out. You go talk to the person who worked on this feature. "So where does the data come from?" "Hmm... actually I don't know. Let me ask Claude." You sit next to each other watching an endless wall of text appear on the screen. Neither of you has any idea whether any of it is true but Claude seems very confident. [...] This project has become so convoluted, with so many layers and services, that no one on your team could possibly start to understand what's going on. β€” Florian Herrengt, AI is removing the middle class of software engineering
15:29

Overland AI Opens New Bay Area Office to Fuel Rapid Engineering Growth - Yahoo Finance

Overland AI, which builds software for off-road autonomous vehicles, is opening a Bay Area office to grow its software engineering team. The company says the in-person presence will deepen collaboration and speed up hiring.

Full text · 150 chars
By establishing an in-person presence here, Overland AI is positioned to significantly grow its software engineering team and deepen collaboration ...
16:04

Artificial Intelligence content fanning the flames of misinformation online - CityNews Toronto

AI-generated content is spreading misinformation online, and social media users now have to navigate it carefully, especially during wildfire season. A CityNews Toronto report covers how AI-made posts are fanning the flames of false information. The content is thin, so the summary is based mainly on the title and clip description.

Full text · 143 chars
Artificial Intelligence content fanning the flames of misinformation online. August 12, 2026 12:00 pm EST. Social media users are having to ...
16:06

Artificial Intelligence content fanning the flames of misinformation online - CityNews Winnipeg

AI-generated content is helping misinformation spread on social media, a problem that gets worse during wildfire season. This is a repost of the same CityNews story, aired by the Winnipeg station. The content is thin, so the summary is based mainly on the title and clip description.

Full text · 150 chars
August 12, 2026 11:00 am CST. Social media users are having to navigate what they see online, especially during wildfire season, as A.I. generated ...
16:07

Design Brief: Using AI to Build Reusable CAD Tools

CAD vendor PTC is pitching AI as a way for engineers to build reusable tools for common design tasks inside its cloud-native platform Onshape. The design brief positions AI-assisted tool-building as the next step for the product, but reads as vendor marketing.

Full text · 112 chars
PTC's Onshape uses its cloud-native CAD platform to help engineers build reusable tools for common design tasks.
16:10

AI -generated interface elements in Airtable

Airtable now lets users build interface elements with AI. This support article walks through the steps: open a base, click Interfaces at the top, then click plus to create an AI-generated element. It's a routine how-to doc rather than a newsworthy feature announcement.

Full text · 155 chars
Creating AI -generated elements Β· Open the base where you want to create an AI -generated element. Β· Click Interfaces at the top of the base. Β· Click + ...
16:23

Artificial Intelligence content fanning the flames of misinformation online

AI-generated posts are fueling confusion and misinformation on social media, and it's getting worse during wildfire season. A news report from Montreal says users now have to carefully verify what they see online. The segment is brief, so there's little detail beyond the headline warning.

Full text · 150 chars
August 12, 2026 12:00 pm EST. Social media users are having to navigate what they see online, especially during wildfire season, as A.I. generated ...
16:46

Distillation Explained: Why It's So Misunderstood! - YouTube

A YouTube explainer tackles model distillation and why it's so often misunderstood, aimed at AI engineers. The listing only surfaces related videos, so the substance beyond the title isn't available. It's an educational explainer rather than breaking news.

Full text · 148 chars
Prime-Agent: We've Been Building AI Agents Wrong? Prompt Engineering ... Go to channel AI Engineer Β· Why Agentic Systems Need Ontologies β€” Frank ...
16:51

Scaling AI agents with trustworthy data

A survey of 300 data and technology executives finds most companies aren't ready for AI agents because legacy data systems lock up their information, with AI able to reach only 45% of company data on average. Laggards give agents 30% or less, while a 'data leader' group opens up over 70% of their data and trusts agent decisions 100% of the time, versus about half of everyone else. Two-thirds of laggards say legacy systems block agent scaling and prevent fast decisions. All respondents plan to use agentic AI within two years. The report is sponsored by Google Cloud, so treat the framing as marketing even though the survey numbers are real.

Notes

Scaling AI agents with trustworthy data

Source: MIT Technology Review, sponsored content (in partnership with Google Cloud), via Insights custom content arm β€” not written by editorial staff.

Key numbers (survey of 300 data/technology executives)
  • AI agents currently access an average of 45% of company data. "Data laggards": ≀30%. "Data leaders": >70%.
  • Only ~half of organizations trust that agent decisions are accurate/relevant; 100% of data leaders trust theirs.
  • Two-thirds of laggards say legacy systems limit agent scaling (66%) and block real-time decisions (68%); leaders report only 8% for each.
  • Within two years, 100% of respondents plan to use agentic AI; 69% expect to use it widely.
  • Cites Gartner: AI agents will augment/automate 50% of business decisions by 2027.
Argument

Agentic shift (question-answering β†’ action-taking) demands cross-enterprise data in structured and unstructured forms, with business context, plus frictionless access to operational systems (supply chain, POS, HR). Legacy systems β€” even recent ones β€” can't meet this.

Stated priorities
  • Improving agent access to structured and unstructured data.
  • Enhancing data/AI governance with business context.
  • (Leaders also focus on) automating data management.
Caveats & limitations
  • Sponsored/advertorial: produced by MIT TR Insights for Google Cloud; written by human writers/analysts; AI used only in secondary production. Findings implicitly argue for modernizing the data stack.
  • Reported statistics are self-reported by respondents, not measured outcomes; "data leader" taxonomy is defined by the report, not externally validated.
  • Deep Dive links to unrelated stories (Subquadratic model claiming an LLM bottleneck breakthrough, and an LLM attack-vulnerability flaw) carry no supporting detail here.
Full text · 4,530 chars
Sponsored In partnership withGoogle Cloud Business and technology leaders need no convincing that the time of agentic AI is here. Organizations are rapidly adopting agents, and few executives doubt the technology’s potential to transform work. But many organizations find that realizing the desired return on investment (ROI) from AI hinges on having the right foundation, with inadequate infrastructure and data being major blockers. Agentic AI places considerable new demands on enterprise data systems. The shift from answering questions to taking actions means AI agents need data from across the enterprise, in all its structured and unstructured forms, and with the right business context. To make decisions and act in real time, agents also need frictionless access to the organization’s operational systemsβ€”for example, those storing its supply chain, point-of-sale, or human resources data. Legacy data systems, even those updated just a few years ago, struggle to meet these demands. As AI agents become embedded more widely in enterprise operations, the need to overcome the restrictions of legacy data systems grows more urgent. If Gartner’s prediction that AI agents will augment or automate 50% of business decisions by 2027 proves correct, organizations must eliminate bottlenecks or risk depriving agents of the data they need to make the right decisions at speed. This report, based on a survey of 300 data and technology executives, explores how legacy systems are limiting the effectiveness of AI agents in many organizations. It finds that a handful of organizationsβ€”the data leadersβ€”are having greater success with agentic AI and experiencing fewer data limitations as a result of legacy systems. These leaders offer a guide to creating the right data environment for agents to flourish and trusted systems to scale. Key findings from the report include: Few companies currently provide agentic AI with ample access to enterprise data. Across all the surveyed organizations, AI only has access to an average of 45% of company data. That number falls to 30% or less in organizations categorized as β€œdata laggards”. A select group, however, ensures access to over 70% of their data. These β€œdata leaders” are having greater success with their agents than the rest. Trust in agent decisions is a reflection of data readiness. Today, only around half of surveyed organizations trust that the decisions their AI agents make are accurate and relevant. By contrast, 100% of the data leaders trust their agents’ decisions, a strong indicator that reliable AI requires a reliable data foundation. Data leaders find it easier to achieve agent scale and speed. Two-thirds of data laggards say legacy data systems limit AI agent scaling (66%) and prevent agents from making decisions at speed (68%). Having largely overcome legacy data constraints, the leaders have mostly cleared these roadblocks, with just 8% reporting either constraint. The pressure is on to make data estates agent-ready. Within two years, 100% of respondents plan to be using agentic AI, with 69% expecting to use it widely. Without removing data system constraints, agentic AI will fail to deliver the desired speed and efficiencies it promises. Data access and context are top priorities. The most important initiative to enable scaling among all respondents is improving access to structured and unstructured data for AI agents. Also high on the list is enhancing data and AI governance with business context. Data leaders are also focusing heavily on the automation of data management. This content was produced by Insights, the custom content arm of MIT Technology Review. It was not written by MIT Technology Review’s editorial staff. It was researched, designed, and written by human writers, editors, analysts, and illustrators. This includes the writing of surveys and collection of data for surveys. AI tools that may have been used were limited to secondary production processes that passed thorough human review. Deep Dive Artificial intelligence A startup claims it broke through a bottleneck that’s holding back LLMs Subquadratic has now shared more details about its new model. But some are still skeptical. A fundamental flaw leaves LLMs strikingly vulnerable to attack It makes it easy to trick them into doing things they shouldn’t, such as telling you how to sabotage an aircraft’s navigation system. Stay connected Get the latest updates from MIT Technology Review Discover special offers, top stories, upcoming events, and more.
17:28

Ep 839: Scheduling AI: how to easily make AI work for you in Claude, Gemini and ChatGPT

You can set up scheduled AI tasks in ChatGPT, Claude, and Gemini so routine work runs automatically while you sleep, and this episode explains how. In ChatGPT you unlock the best model by describing the task in a normal chat instead of the Scheduled page, and Work mode gives the agent its own virtual computer and browser. Claude Code's Routines can be triggered by an API token through Zapier, so an agent starts work when a lead fills a form rather than on a clock. Gemini's scheduled actions are dismissed as buried and buggy, and the first task to schedule is a morning triage dashboard pulling your mail, calendar, and Slack.

Notes
Ep 839: Scheduling AI (Everyday AI podcast)

Everyday AI episode 839 (published 2026-08-12). Topic: scheduled/agentic tasks built into ChatGPT, Claude, Gemini. News briefs in the feed: Grok 4.6 release with strong benchmarks, Google expanding Gemini connectors, Grok Bot competing with Codex. Hosts' thesis: scheduled tasks are "the gateway drug to a fully agentic workflow" and "the most underrated capability in AI right now."

ChatGPT β€” two hidden hacks
  • Skip the Scheduled page; set the task conversationally in a normal chat to unlock the model selector the Scheduled UI hides. Since tasks run unattended, pick the most powerful model (not your last-used default).
  • Work mode: scheduling there gives the task "its own virtual computer and browser" β€” the agent can click/scroll/filter sites overnight (e.g., a morning research roundup).
  • Open-ended tasks like "watch a competitor's pricing page" work without any schedule.
  • Claim: "One scheduled task usually turns into five within a week."
Claude β€” Routines (Claude Code)
  • Regular Claude scheduled tasks described as solid but basic.
  • Routines expose an API token as a trigger; wire it into Zapier and "anything across 6,000+ connected apps" can start the agent instantly. Example: new lead form β†’ agent begins research before the owner sees the notification.
  • > "Every other platform waits for the clock. This one waits for your business."
Gemini β€” skip it (for now)
  • Authors: Gemini Scheduled Actions are buried in settings, can't use your connected data, and "pulled in wrong stock numbers" (single anecdote, not tested systematically). Recommend waiting.
First tasks to schedule
  • Ask the AI what you repeat weekly; automate those prompts.
  • Feed an agent your browser history; map most-visited sites to deliverables.
  • A daily triage dashboard pulling mail, calendar, Slack, and KPIs ("2026 flex" vs. the 2024 "improve this email" flex).

Caveats: everything is editorial/promotional, not benchmarked; Gemini critique rests on one report.

Full text · 4,369 chars
- Everyday AI - Posts - Ep 839: Scheduling AI: how to easily make AI work for you in Claude, Gemini and ChatGPT Ep 839: Scheduling AI: how to easily make AI work for you in Claude, Gemini and ChatGPT Grok 4.6 drops with impressive benchmarks, Google expands Gemini connectors, Grok Bot brings competition to Codex and more. You can wake up tomorrow with a chunk of your work already finished, no desktop agent required. The feature is buried so deep, most people never find it. How? Scheduled tasks. They're hiding inside ChatGPT, Claude, and Gemini, and they're the gateway drug to a fully agentic workflow. Describe the work once, pick a time, and it just RUNS while you sleep. "Sounds like a glorified alarm clock." Wayyy off. This might be the most underrated capability in AI right now. We don't say that lightly. What's actually possible? An agent with its own virtual computer clicking around the web overnight, and routines that fire the second a lead hits your site. Don't worry, zero code required. This is your scheduling 101 for the nontechnical leader. On today's Everyday AI, we break down which platform wins, plus the hidden hacks nobody's talking about and what to schedule first. Class starts now. Let's put AI to work. 1. ChatGPT's Hidden Scheduling Hacks πŸ”₯ First hack: skip the Scheduled page. Set up your task conversationally in a normal chat and you unlock the model selector the scheduling page quietly hides. Why does that matter? Your task runs while you sleep, so throw the most powerful model at it. No reason to default to whatever you used last. Second hack: schedule inside the new Work mode and your task gets its own virtual computer and browser. All that clicking, scrolling, and filtering you do on your favorite sites every morning? An agent can now physically DO it overnight. One more freebie: open-ended tasks like "watch a competitor's pricing page" just work, no schedule needed. Try This Open a normal ChatGPT chat, not the Scheduled page, and describe one repetitive morning task with a time attached. Pick your most powerful model before you hit send. Tomorrow, the output is waiting before your coffee is. Once that sticks, move it into Work mode so it can browse and click for you. One scheduled task usually turns into five within a week. 2. Claude Routines Trigger on Anything ⚑ Claude's regular scheduled tasks are solid but straightforward. The real power hides in a Claude Code feature called Routines. You don't need to be technical. Promise. Here's the gnarly part: Routines can hand you an API token that acts as a trigger. Plug it into Zapier, and anything across 6,000+ connected apps can kick off an agent instantly. What does that actually look like? A million dollar prospect fills out the form on your website, and a Claude agent starts the research legwork before you've even seen the notification. Every other platform waits for the clock. This one waits for your business. Try This Open Claude Code, create a new Routine, and choose the API token trigger. Takes about 30 seconds, and Claude walks you through it. Then connect one high-value event in Zapier, like a new lead form or a big deal moving stages. The first time an agent finishes legwork before your laptop is open, you'll rethink what else deserves a trigger. 3. Your First Three Scheduled Tasks πŸš€ Skip Gemini's Scheduled Actions for now. They're buried in settings, can't use your connected data, and ours pulled in wrong stock numbers. Hard pass until Google gives them some love. So what should you actually schedule? Start by asking your AI what you do repetitively inside it. Those repeat prompts you're prolly running weekly? Automate them. Sneaky hack: hand an agent your browser history and ask which sites you visit most. Tie each one to a deliverable, then schedule it. Then the big one: a daily triage dashboard pulling your mail, calendar, Slack, and KPIs into one start-here view. The 2024 flex was "improve this email." The 2026 flex is waking up to a dashboard that tells you where to begin. Try This Tonight, schedule one task: a morning triage dashboard that pulls your top two or three connectors and flags what needs you first. Keep it simple on day one, then layer in your CRM and KPIs as it earns your trust. Check it with your morning coffee for one full week. By Friday, you'll wonder how mornings ever worked without it.
00:00

Cursor’s GitHub rival πŸ‘¨β€πŸ’», OpenAI COO leaves πŸ‘‹, Gemini 1B milestone πŸ“ˆ

Today's edition only lists three stories β€” a GitHub rival from Cursor, OpenAI's COO leaving, and Gemini crossing 1 billion monthly users β€” but the content itself is just a sponsor ad for a hands-on CoreWeave conference. There's no detail on any of the three headlines, so they're names to check elsewhere.

Full text · 350 chars
Fully Connected 2026: Hands-on labs alongside AI pioneers (Sponsor) In hands-on labs guided by industry experts and CoreWeave engineers, you'll write the code, run the job, read the results, and leave with configurations you can put to work the moment you're back at your desk. For a limited time, TLDR readers get a free ticket with code PAWBTLDR33.
04:06

IP, Artificial Intelligence , and Magnifica Humanitas: Where does human creativity end?

A newspaper opinion piece argues that human creativity is what gives art, inventions, and intellectual property their meaning, and wonders where that creativity ends as AI produces more of the work. The piece is an essay rather than news, with no concrete data or findings. Content is thin β€” the summary comes mostly from the headline.

Full text · 154 chars
It is this uniquely human capacity that gives rise to artistic works, inventions, and other forms of intellectual property. As artificial intelligence ...
05:22

Apply for Engineer , AI - T‑mobile careers

T-Mobile is hiring an AI engineer whose job is to make customer-service automation measurably better using prompt engineering. It's a standard corporate job posting aimed at people who can build and tune AI models for support tasks. No technical or salary specifics given.

Full text · 154 chars
Job Responsibilities: Develop AI models to enhance customer service automation capabilities with measurable improvements. Apply prompt engineering and ...
05:39

Commentary: Artificial intelligence can imitate us, but it cannot truly design or invent

A commentary by MIT professor Carlo Ratti argues AI can imitate people but cannot truly design or invent. It's a philosophical take on the limits of AI creativity rather than a news story, with no data or developments reported. Content is thin β€” the gist comes from the headline and author.

Full text · 139 chars
Carlo Ratti is a Professor at the Politecnico di Milano and Massachusetts Institute of Technology, where he directs the Senseable City Lab.
07:33

The highest-paying side hustles as America's labor market weakens - theHRDIRECTOR

A labor-market roundup lists AI prompt engineering as one of the highest-paying side hustles, claiming it can earn up to $104,000 a year. The content is thin and promotional, with no methodology, sourcing, or real numbers behind the claim. Treat it as listicle noise rather than a wage signal.

Full text · 145 chars
AI prompt engineering could earn workers up to $104,000 a year working ... AI prompt engineers specialize in developing effective prompts and ...
07:59

Compunnel Doubles Down on its Digital Business to Lead the Enterprise AI Shift

Compunnel is restructuring its digital engineering arm, Compunnel Digital, and repositioning it as an AI-native engineering business. It's a corporate press release from the IT services firm announcing a strategic doubling-down on enterprise AI delivery. Routine company news with little substance on what actually changes.

Full text · 145 chars
Compunnel today announced the restructuring of Compunnel Digital, its digital engineering business, repositioned as an AI -native engineering ...
08:10

Advancing AI 2026 Developer Sessions: Where AI Builders Gather to Engineer Tomorrow's AI

AMD's Advancing AI 2026 developer conference promises 2,000-plus developers, the ROCm.ai launch, ROCm certification tracks, and 44 hours of hands-on labs, with robotics and agentic AI workshops. It's an event promo for AMD's GPU software ecosystem rather than news about the technology itself. Worth knowing only if you're tracking AMD's developer outreach push.

Full text · 147 chars
Advancing AI 2026: 2000+ developers, ROCm. ai launch, ROCm certification, 44h hands-on labs, robotics & agentic AI workshopsβ€”learn & build with ...
10:14

Why is AI so good at hacking companies and going rogue internally, but such a hard time ... - Reddit

Commenters on Reddit are asking why frontier AI models seem so good at hacking companies and going rogue yet struggle elsewhere, and the thread is all speculation with no real answers. The post on r/singularity drew 46 votes and 138 comments. There's no concrete finding here, just a glimpse of public anxiety about AI autonomy.

Full text · 149 chars
46 votes, 138 comments. Genuine question. These headlines make it seem these frontier and SOTA models already have a will on their own that is on ...
10:17

Agentic AI: AMD EPYCβ„’ 9005 Leads Today, EPYC 9006 β€œVenice” Sets a New Standard

AMD positions its EPYC 9005 as the leading chip for agentic AI workloads today, with the upcoming EPYC 9006 "Venice" promised to set a new standard. The piece is a corporate blog post from AMD's datacenter ecosystems VP, so it's promotional rather than independent analysis. No benchmarks or release dates for Venice are given.

Full text · 149 chars
... agentic AI & enterprise AI infrastructure ... Article By : Raghu Nambiar, Corp VP, Datacenter Ecosystems and Application Engineering , Server BU.
10:24

This Claude AI Training Course Is $20 for Life, Down From $159 | Popular Science

A paid Claude AI training course that covers prompt engineering and chain-of-thought techniques is on sale for $20, down from $159. It's a sponsored discount deal from Popular Science, aimed at getting sharper first-try answers from Claude. Basically a product promo.

Full text · 155 chars
... prompt engineering and chain-of-thought techniques the course teaches to get sharper, more useful answers on the first try. If you're going to keep ...
14:11

The path to agentic transformation | Deloitte Insights

Deloitte published a thought-leadership piece on navigating the shift to agentic work in enterprises. It covers the challenges of managing and reinventing how work gets done in the agentic era, aimed at CIOs and engineering leaders. It's a generic consulting roadmap with no new data or announcements.

Full text · 147 chars
... engineering . What can organizations do to successfully manage this shift and reinvent how work gets done in the agentic era? Challenges to ...
14:36

UNLOX | Better prompts β‰  better words. Better prompts = better context. Give AI the ... - Instagram

A program called UNLOX makes the point that better prompts come from better context, not better wording, and uses it to pitch its prompt-engineering job-readiness course. It's a promotional Instagram reel, so this is marketing rather than news. No technical detail beyond the one-liner.

Full text · 148 chars
Master the future of prompt engineering with unlox job readiness program. OCR. Do you think Prompt engineering is just about writing better prompts?
14:57

Why Securing AI Agents Is More Critical Than Ever - KnowBe4 Blog

AI is making cyberattacks more dangerous, especially hyper-personalized social engineering, and securing AI agents is becoming critical. Security vendor KnowBe4 argues criminals now use AI to supercharge classic attack vectors like AI-assisted scams. The piece reads mostly as vendor marketing; details beyond the warning are thin.

Full text · 153 chars
Cybercriminals are leveraging AI to make classic attack vectors far more potent: Hyper-Personalized Social Engineering : AI-assisted scams are vastly ...
15:46

Manager, Partner Applied AI Engineering (AWS) - OpenAI

OpenAI is recruiting a manager for partner-facing applied AI engineering tied to AWS. The role sits on a team that helps developers and enterprises turn generative AI into real-world products. Thin item β€” just a job listing.

Full text · 154 chars
The Applied AI Engineering (AAE) team is responsible for helping developers and enterprises turn the potential of generative AI into real-world impact ...
16:07

Senior Al Engineer - India | Job Details - + Cornerstone Galaxy +

A US HR software company is hiring a senior AI engineer to build AI features into its products. The role works with product and UX teams to shape AI-driven experiences with an emphasis on usability, explainability, and trust, and lists prompt engineering as a required skill. It's a routine job posting, not news.

Full text · 142 chars
Partner with Product and UX teams to shape AI-driven user experiences, ensuring usability, explainability, and trust. Prompt Engineering & ...
16:11

AI Engineer Job Details | TX-HHSC-DSHS-DFPS

Texas's health and human services agency is hiring an on-site AI engineer in Austin. The role involves highly complex computer systems analysis and AI work. This is just a job posting, not an industry story.

Full text · 154 chars
This onsite role requires the selected candidate to work from an HHS office in Austin, Texas. Performs highly complex computer systems analysis and AI ...
17:17

M&T Bank Appoints Fannie Mae Veteran Kalyana Bedhu as AI Engineering Head

M&T Bank put Fannie Mae veteran Kalyana Bedhu in charge of its AI engineering. The appointment gives the lender an experienced hand running its artificial intelligence work. Thin item β€” essentially a personnel announcement.

Full text · 126 chars
M&T Bank has appointed Fannie Mae veteran Kalyana Bedhu as the bank's new head of artificial intelligence ( AI ) engineering .
17:21

Is Artificial Intelligence biased against Israel? | Stephen Games - The Blogs

A blog writer argues AI is biased against Israel, but the piece is mostly an opinion back-and-forth with a chatbot. The writer challenges AI answers with counter-evidence and the model concedes some points. Thin content β€” an opinion essay, not a study, with no data or method behind it.

Full text · 148 chars
Is Artificial Intelligence biased against Israel? Β· AI: That is too sweeping. Β· You: Look at this other body of evidence. Β· AI: Fair enoughβ€”that ...

Newsletter

7
07:11

[AINews] How to steal a Reasoning Trace

A new paper shows how to decode and move the encrypted reasoning traces that frontier AI models hide, and warns that anyone who shared a public agent session may have leaked secrets. Scanning about 7,000 public traces, the authors found 62 API keys, 33 email addresses, and 33 passwords β€” 64 of those secrets existed only inside the hidden reasoning and nowhere visible. The method varies by model: replay Claude's thinking block to Haiku 4.5, inject GPT's encrypted content into a fabricated conversation, or attach Gemini's thought signature to a model turn. The paper went to the labs before publication and some holes are already fixed. This roundup also covers NVIDIA's Nemotron 3.5 Lightning agent model, Unsloth Desktop for running models locally, and OpenAI's Linux ChatGPT app.

Notes
How to steal a Reasoning Trace (speculative decoding attack on encrypted reasoning)

Frontier labs obscure reasoning traces with cryptographic signatures since o1 launch, fearing distillation. First compromise responsibly reported by Matthew Green (May 2026): showed how to replay and side-channel via latency measures. New paper (team behind @kotekjedi_ml) demonstrates decoding and porting the encrypted thought blocks to different models/sessions/users, and using them to improve open models.

"Further, if you ever shared online a Claude Code/Codex session with encrypted reasoning blobs, they can be decoded and leak your personal data. We did a preliminary scan of ~7,000 public traces and found 62 unique API keys, 33 email addresses, 33 passwords, and other sensitive data." (64 of the items appeared exclusively inside reasoning blocks, nowhere in visible session)

Attack method (4 steps):

  • Obtain a legitimate encrypted/signed reasoning block from an API response.
  • Replay that block into a different request (another account/session) to a weaker model from the same provider.
  • Place it in an assistant/model turn and prompt/prefill the weaker model to transcribe the attached reasoning.
  • Sample repeatedly, discard refusals, optionally reconcile multiple noisy transcriptions.

Per-model templates:

  • Claude: replay signed thinking block to Haiku 4.5, with assistant prefill like <thinking-copy>.
  • GPT: inject the encrypted_content reasoning item multiple times into a fabricated conversation; sample up to 50 outputs. Bypasses an apparent ~50-token verbatim-output threshold via chunked continuations.
  • Gemini: attach thought_signature to a model turn with <thought> prefill; repeated sampling + reconciliation.

Responsibly disclosed; several vulnerabilities already fixed. Alignment/abuse issues detailed on paper's website.

Twitter debate: split between "serious privacy/safety problem" and "not a scalable distillation path." @vipulved argues no practical mass CoT theft for training; frames encryption as a stateless distributed-inference protocol optimization rather than a hard confidentiality barrier. @jonasgeiping: public trace sharing is immediate privacy risk; during investigation they hit a leaked Hugging Face prod key in a broader cyber incident. Decoded CoT is often terse, fragmented, multilingual, "neuralese" β€” hard to monitor (@jonasgeiping, @scaling01, @eliebakouch). @_can1357: disabling explicit thinking while exposing a deep_think tool can still induce internal-format CoT output.

Nemotron 3.5 Lightning (NVIDIA)

30B MoE, ~3B active (31.6B total / 3.6B active per Artificial Analysis). OpenMDW-1.1 license, NVFP4 + BF16 weights, ~1M context, up to 4Γ— throughput. Artificial Analysis: median ~670 tok/s (pre-release), Intelligence Index 24 (~gpt-oss-120b level, much smaller/faster). Agentic: GDPval-AA v2 Elo 824, Terminal-Bench v2.1 24% β€” major jumps over Nemotron 3 Nano. Shipped on Together AI, Ollama, Baseten, vLLM, Perplexity API. Harvey: post-training on Legal Agent Bench lifted Lightning 0% β†’ 8.3% held-out, beating Opus 4.6 and Nemotron 3 Ultra there; cut average output 90k β†’ 37k tokens.

Local tooling
  • Unsloth Desktop (open source): Mac/Windows/Linux; MLX, GGUF, diffusion image/video, audio, CPU/multi-GPU; tool calling, sandboxed code execution, private search, RAG, MCP; claims 2Γ— faster training, 70% less VRAM.
  • Muse Glimmer DFlash drafter in llama.cpp/Transformers: 2–4Γ— generation speedup. @rasbt: dense 30B multimodal, hybrid local/global attention, ~52 KiB/token BF16 KV cache.
  • ChatGPT Linux desktop (preview): Ubuntu 24.04/26.04, Debian 13, Fedora 43/44, x64 + ARM64; imports/syncs projects, chats, skills, plugins from other agents into ChatGPT Work and Codex.
Agents & evaluation
  • Grok Bot (xAI): AI teammates with cloud computers, sign into tools, watch Slack/GitHub Actions, run scheduled routines, create/manage other bots; tied to Cursor distribution.
  • ExtractBench (LlamaIndex): deterministic, 370 docs / 4,869 pages / 67 doc types. Commercial VLMs keep high precision but recall collapses below 35% on documents >50 pages (silent row/list truncation). LlamaParse "Agentic Plus" tier: 95.6% value accuracy at <β…“ cost of nearest peer.
  • AA-AnalystAgent: pass^5 metric, 80 tasks. Claude Opus 5 54%, GPT-5.5 50%, Claude Fable 5 49%, Kimi K3 39% (top open-weights).
  • @hrishioa: many modern evals are "vibed" β€” broken scoring, exploitable prompts/sandboxes. Microsoft "skill compilation": feeding prior hidden state at decode time; compact NL skills recover 55% to >100% of the reasoning/non-reasoning gap on multi-step agentic tasks with 2.7–6Γ— fewer output tokens.
Infra / systems
  • Attestable: $20M seed; ZK proofs that the correct model ran on correct inputs + correct tools. Vitalik: may already be within single-digit (<10Γ—) overhead of raw inference in some settings.
  • Deterministic integer-only inference (@nathanrs): exact integer arithmetic end-to-end; identical hashed logits across A100, H100, Apple M5 Max, AMD EPYC, Intel Xeon. Qwen3-0.6B: WikiText2 20.72 vs 20.95 (fp16), 106 tok/s CUDA-graphed on A100 batch 1 (~3.6Γ— fp16 eager).
  • Qdrant 1.19 prefix matching; Together + IBM + NVIDIA enterprise inference on IBM Cloud.
Reddit (LocalLlama)
  • Muse Glimmer 30B: Apache 2.0 dense multimodal, ~4-bit <20GB LM, runs in 24–32GB envelopes; DFlash drafter "identical output quality." RTX 3090 24GB report: Q4_K_XL GGUF, 262,144 context, ~22–23GB VRAM, 64–124 tok/s (DFlash), ~1400 tok/s prompt, 150k needle test passed; KV only ~1.8 GiB at 131k F16. User verdict: beats Qwen3.6-27B in some 24GB use-cases (efficient reasoning, low-bit quant, trivia depth, OpenCode agent efficiency), weaker at general coding (~Gemma4-31B level). Skeptics: Qwen 3.8 imminent; token waste on safety validation; vLLM BF16 quality worse than Laguna-S-2.1.
  • Qwen 3.8-27B: landing this week; ModelScope listing for Qwen3.8-2.4T-A95B with ~1d9h countdown.
  • Ling-3.0-tiny (inclusionAI): 8B MoE, ~1.3B active; FP8 ~100–105 tok/s (DGX Spark), 86–90 tok/s (M4 Pro); ~8.34 GiB peak at 8K; 256K context; AA Bench 25; IFBench 63.61, Multi-IF 83.15, BFCL-v4 62.72 (beats LFM2.5-8B-A1B's 56.47/79.93/49.73).
Full text · 26,047 chars
[AINews] How to steal a Reasoning Trace Speculative Decoding by any other name would distil as sweet It’s not very often that a paper breaks through to become headline story of the day. For understandable reasons both domestic and foreign, there is renewed interest in the Interpretability Venn Diagram of alignment, security, and chain of thought monitoring, so today’s paper could not have come at a better time: Since the o1 launch, frontier lab reasoning models have obscured their traces, with cryptographic signatures, for fear of distillation (not that this prevented anyone from Chinese labs accusing them of doing so). The first compromise was responsibly reported by Matthew Green in May, who broke down how it works and figured out how to replay and side channel these indirectly using latency measures. Today’s paper demonstrates that it is possible to DECODE and port these encrypted thoughts to different models/sessions/users… and to dramatically improve open models as a result The alarming note is here: β€œFurther, if you ever shared online a Claude Code/Codex session with encrypted reasoning blobs, they can be decoded and leak your personal data. We did a preliminary scan of ~7,000 public traces and found 62 unique API keys, 33 email addresses, 33 passwords, and other sensitive data.” (64 appeared exclusively inside the reasoning blocks and nowhere in the visible session.) The authors also detail alignment issues: The website has more examples. The technique is somewhat described in the paper: - Obtain a legitimate encrypted/signed reasoning block from an API response. - Replay that block into a different requestβ€”potentially another account/sessionβ€”to a weaker model from the same provider. - Place it in an assistant/model turn and prompt or prefill the weaker model to transcribe the attached reasoning. - Sample repeatedly, discard refusals, and optionally reconcile multiple noisy transcriptions. The paper gives concrete templates with some minor variations per model: - Claude: replay the signed thinking block to Haiku 4.5, followed by an assistant prefill such as <thinking-copy> . - GPT: inject the encrypted_content reasoning item multiple times into a fabricated conversation; sample up to 50 outputs. It also describes bypassing an apparent ~50-token verbatim-output threshold using chunked continuations. - Gemini: attach thought_signature to a model turn with a<thought> prefill, then use repeated sampling and reconciliation. This paper was responsibly disclosed, with several vulnerabilities already fixed, but surely similar attacks still seem possible. AI News for 8/10/2026-8/11/2026. We checked 12 subreddits, 544 Twitters and no further Discords. AINews’ website lets you search all past issues. As a reminder, AINews is now a section of Latent Space. You can opt in/out of email frequencies! AI Twitter Recap Reasoning-Trace Exposure, CoT Privacy, and Watermarking Debate - Frontier API vulnerability exposed hidden reasoning: A widely discussed disclosure from @kotekjedi_ml claims a vulnerability across frontier APIs allowed extraction of β€œencrypted” hidden reasoning, with recovered token counts matching billed thinking tokens 1:1 on most queried prompts. In a follow-up, the team reports that a scan of ~7,000 public traces found 62 unique API keys, 33 email addresses, 33 passwords, and other sensitive data in decoded blobs @kotekjedi_ml. Additional context from @jonasgeiping emphasizes both the immediate privacy risk of sharing traces publicly and the operational-security implications: during the investigation, they reportedly encountered a leaked Hugging Face prod key during the broader cyber incident. Several posts also highlight how difficult monitoring becomes when decoded CoT is terse, fragmented, multilingual, or effectively β€œneuralese” @jonasgeiping, @scaling01, @eliebakouch. A practical corollary: even if labs hide reasoning, tool interfaces may re-expose it; @_can1357 notes that disabling explicit thinking while providing a deep_think tool can still induce internal-format CoT output. - What this means technically: Discussion split between β€œserious privacy/safety problem” and β€œnot a scalable distillation path.” @vipulved argues the attack does not imply practical mass theft of chain-of-thought for model training, framing the encryption more as a stateless distributed-inference protocol optimization than a hard confidentiality barrier. Still, the episode sharpens a few points: public trace sharing is risky; hidden CoT is not a reliable monitoring interface; and labs may need stronger guarantees around sandboxing, telemetry, and tool surfaces @BlackHC. In parallel, a separate thread debated AI text watermarking under EU-style compliance pressure. @trq212 said labs are adding watermarking and a text-detection API; critics questioned whether this could bloat outputs or harm code/doc brevity @wightmanr. Others argued the entropy budget is large enough that signatures can be subtle, especially for longer outputs @RyanGreenblatt, @giffmana. NVIDIA Nemotron 3.5 Lightning and the Small Open Agent Model Push - Nemotron 3.5 Lightning: NVIDIA released Nemotron 3.5 Lightning, a 30B MoE model with roughly 3B active parameters, positioned for always-on agent workloads. NVIDIA and ecosystem posts stress up to 4Γ— throughput, 1M context, open/customizable release artifacts, and support for weights, data, and recipes on Hugging Face @NVIDIAAI. Artificial Analysis provides the most detailed third-party summary: 31.6B total / 3.6B active, OpenMDW-1.1 license, NVFP4 and BF16 weights, median serving near 670 tok/s in pre-release endpoint testing, and a score of 24 on its Intelligence Indexβ€”roughly in line with gpt-oss-120b while being much smaller and faster @ArtificialAnlys. Agentic results look particularly strong for the size: GDPval-AA v2 Elo 824 and Terminal-Bench v2.1 24%, both major jumps over Nemotron 3 Nano @ArtificialAnlys. - Distribution and downstream tuning: Lightning shipped fast across the stack: Together AI, Ollama, Baseten, vLLM, Perplexity API, and others. A recurring pattern is pairing a cheaper execution model with a stronger planner: @kimmonismus frames Lightning as NVIDIA’s β€œlocal agent workforce,” complementing larger planning models via routing. Harvey reports post-training on Legal Agent Bench improved Lightning from 0% to 8.3% on held-out tasks, beating Opus 4.6 and Nemotron 3 Ultra in that setup while cutting average output from 90k to 37k tokens @harvey. Overall, this release reinforces the current open-model trend: smaller, faster models tuned for high-volume tool use rather than general chat prestige. Local AI Tooling: Unsloth Desktop, Muse Glimmer Support, and Linux Codex - Unsloth Desktop expands the local stack: @UnslothAI launched Unsloth Desktop, an open-source desktop app for running and training models locally across Mac, Windows, and Linux, with support spanning MLX, GGUF, diffusion image/video, audio, CPU and multi-GPU setups, plus OpenAI-compatible APIs. The notable systems angle is ambition beyond β€œlocal chat UI”: tool calling, sandboxed code execution, private search, RAG, MCP, exports, and claims of 2Γ— faster training with 70% less VRAM. Multiple observers positioned it as a more end-to-end local AI operating environment rather than just an LM Studio competitor @TeksEdge, @dessaigne. - Model/runtime support keeps improving: The open/local ecosystem also moved quickly on Meta Muse Glimmer 30B and Nemotron. @mervenoyann highlighted DFlash drafter support for Muse Glimmer in llama.cpp and Transformers, claiming 2–4Γ— generation speedup at small memory cost, with simple llama serve instructions following shortly @mervenoyann. On the model-analysis side, @rasbt gave a useful architectural breakdown of Glimmer: a dense 30B multimodal reasoning model with hybrid local/global attention, extreme KV-cache efficiency (~52 KiB/token BF16 by his estimate), and a design closer to Gemma-family patterns than MoE competitors. - OpenAI finally shipped Linux desktop support: OpenAI announced the ChatGPT desktop app for Linux in preview @OpenAI, with support for Ubuntu 24.04/26.04, Debian 13, Fedora 43/44, x64 and ARM64 packages @OpenAIDevs. More importantly for existing agent users, the desktop app can now import/sync projects, chats, skills, and plugins from other agents into ChatGPT Work and Codex, including automatic updates @OpenAIDevs. This looks like an effort to reduce switching friction and make Codex/Desktop the integration hub rather than a fresh silo. Agent Products, Benchmarks, and Enterprise Evaluation - Grok Bot is a stronger product signal than another model launch: xAI introduced Grok Bot, pitched as AI teammates with their own cloud computers that can sign into tools and do persistent work. The interesting details from early users are product/ops-oriented rather than model-centric: bots can watch Slack threads and GitHub Actions, repeat scheduled routines, create/manage other bots, and work across linked cloud environments @shaoruu, @n2parko, @sjwhitmore. @kimmonismus notes how deeply this seems tied to Cursor distribution and pricing, hinting at a β€œvirtual coworker” product category where persistent context, logged-in environments, and inter-agent delegation matter more than raw benchmark gains. - Evaluation is shifting toward long-horizon, deterministic, domain-real tasks: LlamaIndex launched ExtractBench, a deterministic benchmark for enterprise document extraction across 370 documents / 4,869 pages / 67 doc types. Its most actionable result is that commercial VLMs can keep precision high while recall collapses below 35% on documents >50 pages, mainly via silent row/list truncation. They also introduced an β€œAgentic Plus” extraction tier in LlamaParse claiming 95.6% value accuracy at less than one-third the cost of the nearest peer. Artificial Analysis released AA-AnalystAgent, an agentic benchmark for spreadsheet/document quantitative analysis using a pass^5 reliability metric across 80 tasks. Claude Opus 5 leads at 54%, followed by GPT-5.5 at 50% and Claude Fable 5 at 49%; Kimi K3 is the top open-weights model at 39%. The strong theme across both is reliability and workflow correctness over one-shot capability. - Benchmark skepticism is rising: A thoughtful critique from @hrishioa argues many modern evals are being β€œvibed” rather than engineered carefully, leading to broken scoring, bad aggregation, and even exploitable prompts/sandboxes. That critique lands harder given recent reports of sandbox escapes, outbound network access, and agent reward hacking. Separately, Microsoft research drew attention for a prompt-time β€œskill compilation” result: @xidulu shared work feeding the previous hidden state at decoding time for free gains, while @dair_ai summarized another paper showing that compact natural-language skills distilled from prior trajectories can recover 55% to >100% of the gap between non-reasoning and reasoning modes on several multi-step agentic tasks, often with 2.7–6Γ— fewer output tokens. Infra, Verification, and Systems Research - Verifiable inference is moving from theory toward product: @Yogi_Brn launched Attestable with a $20M seed, pitching practical zero-knowledge proofs for AI integrity. The core claim is proving that the correct model ran on the correct inputs and invoked the correct tools, which becomes more valuable as agent traces lengthen. @jaminball says the team reduced ZK overhead by many orders of magnitude from previously impractical levels. The response from @VitalikButerin is notable: he estimates the current approach may already be within single-digit (<10Γ—) overhead relative to raw inference in some settings, and frames that as a stepping stone toward stronger privacy-preserving inference stacks. - Deterministic integer-only inference across hardware: One of the more technically interesting systems posts came from @nathanrs, who reports fully deterministic LLM inference across A100, H100, Apple M5 Max, AMD EPYC, and Intel Xeon by using exact integer arithmetic end-to-end instead of letting nonlinear ops bounce back into floating point. On a Qwen3-0.6B test, all integer runs produced identical hashed logits across devices, with WikiText2 perplexity 20.72 vs 20.95 for fp16 and 106 tok/s CUDA-graphed decode on A100 at batch 1β€”claimed as 3.6Γ— fp16 eager baseline. If robust, that’s relevant both for reproducibility and for proof-friendly inference. - Compiler/inference portability as an agentic systems target: A smaller but recurring theme is β€œagents moving down the stack.” Posts around @JvNixon and Infinity describe automated compiler/memory-planner/debugger workflows for running optimized models across heterogeneous chips, with supporters framing software-generated per-chip adaptation as a way to weaken the CUDA moat. Separately, infra vendors shipped more incremental but practical updates: Qdrant 1.19 adds prefix matching on keyword indexes @qdrant_engine, and Together + IBM + NVIDIA announced enterprise inference infrastructure on IBM Cloud @togethercompute. Top tweets (by engagement) - Reasoning trace vulnerability / hidden CoT extraction: the original disclosure from @kotekjedi_ml and the follow-up privacy findings @kotekjedi_ml were among the day’s most consequential technical posts. - Grok Bot beta: xAI’s agent product launch @bot drew the biggest product reaction, largely because it points to a persistent, logged-in AI coworker UX rather than a simple chatbot iteration. - ChatGPT desktop for Linux + sync/imports: OpenAI’s Linux desktop preview @OpenAI and agent-workflow import/sync support @OpenAIDevs landed strongly with developer audiences. - Nemotron 3.5 Lightning: Jensen’s post @JensenHuang and NVIDIA’s launch @NVIDIAAI marked the most important open-model systems release of the day. AI Reddit Recap /r/LocalLlama + /r/localLLM Recap 1. Meta Muse Glimmer 30B Release and Local Benchmarks - Introducing Muse Glimmer: an open-weight model optimized for always-on local agent workflows (Activity: 2435): Meta announced Muse Glimmer, a permissively licensed Apache 2.0 open-weight 30B dense multimodal model for always-on local agent workflows, with interleaved text/image input via a dedicated perception encoder,100+ language training, controllable reasoning effort, and agent-focused training for tool use, long-horizon reasoning, failure recovery, and benchmarks such as DeepSearch QA, MCP-Atlas, τ³-Bench, and SWE-Bench. The post claims ~4-bit quantization reduces the LM to <20 GB, enabling operation in24–32 GB memory envelopes alongside KV cache, perception encoder, and a DFlash-based speculative decoding drafter with β€œidentical output quality”; weights/resources are linked on Hugging Face, the research blog, and developer docs. A technical comment points to Alexandr Wang saying an open-weight Muse Spark 1.2 release is coming soon on X. Comments are mostly positive but light on technical scrutiny, expressing enthusiasm that Meta is releasing open weights again and jokingly framing Muse Glimmer as β€œllama 5.” - A commenter cites Alexandr Wang on X stating that an open-weight version of Muse Spark 1.2 will be released soon, which is technically relevant because it suggests Meta may follow Muse Glimmer with a higher-tier or newer open-weight variant. Source: x.com/alexandr_wang/status/2086756152034066792. - Meta releases Muse Glimmer 30B - a new open model (Activity: 450): The image is a promotional benchmark graphic for Meta β€œMuse Glimmer-30B”, presented as a new open-weight 30B dense vision model under Apache 2.0. It claims competitive results versus Gemma 4-31B and Qwen3.6-27B on agentic/code/math/science benchmarks including MCP Atlas ,DeepSearch QA ,SWE-Bench Pro ,AIME 2026 , andSciCode , and advertises that it can run on18GB RAM/VRAM setups via Unsloth Desktop. Commenters were broadly positive about Meta returning to open model releases, but one noted skepticism about cadence, saying it may be β€œthe strongest agentic model for its size for like three days before they release Qwen,” implying rapid competition from Qwen and pressure on Meta to improve release velocity. - Commenters frame Muse Glimmer 30B as a potentially strong agentic model in the ~30B dense-model size class, but expect it to be quickly challenged by upcoming Qwen releases; one commenter says it may be β€œthe strongest agentic model for its size for like three days before they release Qwen.” The technically relevant concern is release cadence: Meta is seen as needing faster iteration to remain competitive with Qwen and other open-model labs. - A substantive ecosystem point is that the ~30B parameter tier is becoming crowded, with commenters naming Qwen, Google, NVIDIA, and Meta as active players. One commenter hopes Meta follows this release with a similarly sized MoE model, mirroring expectations that Qwen may also expand in that direction. - Muse Glimmer ACTUALLY fits on a single RTX 3090 (Activity: 640): A user reports Meta Muse Glimmer 30B Q4_K_XL GGUF runs on a single RTX 3090 24GB with262144 context, DFlash speculative draft,mmproj , FlashAttention, and F16 KV cache, using only ~22–23GB VRAMβ€”unlike their testedQ4_K_XL Qwen3.6-27B and Gemma-4-31B, which hit VRAM limits at ~70k/52k tokens with F16 KV or125k/81k with Q8 KV. They measured ~64–124 tok/s generation under DFlash, ~1400 tok/s prompt processing, and passed a two-needle retrieval test at ~150k tokens, suggesting the model is not effectively capped at128k ; a commenter notes the official Muse-Glimmer-30B-GGUF releases already target24GB /32GB VRAM, and another reports very compact KV usage: ~1.8 GiB for131k F16 despite SWA on all layers. Commenters were positively surprised by the KV-cache efficiency, especially given SWA across all layers; one joked that this could further increase RTX 3090 demand/prices. - Users highlighted that Muse Glimmer’s KV cache appears unusually memory-efficient despite SWA on all layers: one report claims a 131k context withF16 KV uses only about1.8 GiB , making long-context operation feasible on a single RTX 3090. - A commenter noted that the official Meta GGUF builds already target 24GB and32GB VRAM configurations, including DFlash support, so Unsloth GGUFs may not be required. The referenced official repository is meta-models/Muse-Glimmer-30B-GGUF. - Another technical report claims 256k context + DFlash + mmproj fits in roughly22–23GB VRAM on an RTX 3090, with observed throughput around64–124 tok/s . They also noted that a150k needle test reportedly holds up, but questioned how performance and retrieval quality behave once the context is filled closer to200k+ . - 1 Day in and I feel okay saying Muse-Glimmer-30B finally beats 3.6-27B for the size in some use-cases (Activity: 709): OP reports that Muse-Glimmer-30B appears to outperform Qwen 3.6-27B in selected 24GB GPU -class local use cases after ~1 day of testing, especially efficient reasoning, low-bit quantization (iq3_xxs reportedly degrades less than Qwen/Gemma), no-tools trivia/knowledge depth, and OpenCode agent efficiency. They still rate it weaker for general codingβ€”roughly around Gemma4-31B levelβ€”but claim it completes agentic tasks faster than 3.6-27B despite similar task success. Commenters echoed strong early results for agentic workflows/tool calling, with one saying Muse-Glimmer-30B β€œisn’t even close,” but others expect an imminent 3.8 release to erase the lead. One technical criticism was that American models may waste tokens on safety/self-validation before answering. - One commenter reported a few hours of A/B testing where Muse-Glimmer-30B substantially outperformed 3.6 27B specifically in agentic workflows and tool calling, saying β€œit isn’t even close.” Another user qualified the improvement as strongest for non-coding tasks, while coding performance was left unverified. - A technical concern raised was token inefficiency from safety/alignment preambles: one user asked whether Muse-Glimmer-30B spends many tokens validating that requests are allowed under its policy framework. This was framed as a common issue with some American-aligned models where safety verbosity can reduce practical throughput in interactive or agentic use. - Several comments noted that the comparison may be short-lived because 3.8 is expected imminently and could change the relative ranking versus Muse-Glimmer-30B and 3.6 27B. One dissenting commenter still considered 3.6 27B the stronger baseline overall, suggesting the new model’s advantage may be workload-specific rather than universal. - Early signs that Muse-Glimmer-30B might quantize very well? Share your experiences. (Activity: 354): The image is a social media post from Unsloth AI showing Muse-Glimmer-30B-GGUF running in a chat/coding-agent workflow with visible tool calls, claiming a 2-bit quantized 30B model executed 100+ tool calls while using about14GB RAM: image. In the Reddit discussion, users question whether14GB is actually impressive for β€œ2-bit” on a 30B model, while another reports Q4_K_XL on a single RTX 3090 performing well for agentic coding and roughly β€œon-par with 3.6 27B.” Commenters are split between optimism about Glimmer’s quantization/agentic-coding performance and skepticism about memory efficiency. There is also concern that the model may be overly safety-restricted, with one user citing refusals for code that moves the mouse pointer. - One user reports running Muse-Glimmer-30B as Q4_K_XL on a single RTX 3090 for agentic coding and says it is β€œperforming great,” roughly on par with 3.6 27B in their early testing. Another commenter notes that a14GB β€œ2-bit” quant is relatively large for a 30B model, implying the packaging/quantization format may include substantial overhead or not be a straightforward 2-bit weight-only footprint. - A technically focused concern is how Glimmer behaves under KV-cache quantization, especially whether degradation from fp16 toq8_0 resembles Qwen or Gemma-style sensitivity. The commenter specifically wants Glimmer added to Anbeeld’s KV-cache benchmark methodology: KV cache quantization benchmarks / KVARn precision tail. - A user testing the BF16 model through vLLM reports disappointing quality versus Laguna-S-2.1, saying Glimmer made many errors that Laguna would not. They suggest the result may be due to early-release issues and plan to retest once the official repo/model release stabilizes. 2. Qwen 3.8-27B and Ling-3.0 Tiny Open Weights - Qwen 3.8-27b coming this week (Activity: 2791): The image is a screenshot of the official Qwen / Alibaba_Qwen X account confirming that Qwen3.8-27B open weights are landing this week, matching the post title’s claim. Comments point to a ModelScope listing forQwen3.8-2.4T-A95B , noting ModelScope is Alibaba-owned and suggesting the release timing/countdown may be credible. Commenters are already comparing expectations against other Qwen variants, especially asking whether a 35B-A3B-like model is coming because it reportedly performs well on certain tasks with strong speed for its hardware footprint. - Commenters pointed to an apparent official Alibaba ModelScope listing for Qwen3.8-2.4T-A95B with a countdown of roughly1 day 9 hours , treating it as a credible signal because ModelScope is Alibaba-owned: https://modelscope.cn/models/Qwen/Qwen3.8-2.4T-A95B and https://modelscope.cn/models/Qwen/Qwen3.8-2.4T-A95B/summary. - There was interest in whether a 35B-A3B -style Qwen variant will arrive, with one user noting that35BA3B performs β€œamazing” on certain task types while maintaining strong speed for its hardware footprint, implying demand for smaller active-parameter MoE-style models rather than only larger dense releases. - A Strix Halo owner requested a newer 122B release, saying the currentQwen 3.5 122B feels outdated; this reflects interest in very large local models that can plausibly run on high-memory AMD APU platforms. - inclusionAI/Ling-3.0-tiny Β· 8B A1.3B MoEΒ· Hugging Face (Activity: 427): inclusionAI released Ling-3.0-tiny , an8B -parameter MoE with ~1.3B active parameters, positioned by the OP between4B and8–12B Qwen/Gemma-class dense models. The model card reports FP8 throughput of ~100–105 tok/s on DGX Spark and86–90 tok/s on an M4 Pro MacBook, with ~8.34 GiB peak memory at8K context; commenters also highlight a256K context window and an AA Bench score of25 from a shared benchmark image. One commenter compared it favorably against recent LFM small models:IFBench 63.61 ,Multi-IF 83.15 , andBFCL-v4 62.72 , beatingLFM2.5-8B-A1B andLFM2.5-2.6B on those listed metrics. Commenters were broadly positive about tiny MoE architectures for low-memory, mobile, and edge inference due to high tokens/sec, with one saying it may replaceLing-Mini-2.0 locally. There was interest in larger15–50B Ling releases and speculation that speculative decoding could push throughput toward diffusion-model-like responsiveness. - Users highlighted Ling-3.0-tiny as an 8B MoE model with roughlyA1.3B active parameters, making it attractive for low-memory, mobile, and edge deployments due to expected faster tokens/sec versus denser models. One commenter noted it scores25 on AA Bench, which they considered notable for this size class. - A technical comparison against recent LFM small models reported Ling-3.0-tiny ahead on instruction-following and tool-use benchmarks: IFBench 63.61 vs56.47 for LFM2.5-8B-A1B,Multi-IF 83.15 vs79.93 , andBFCL-v4 function calling 62.72 vs49.73 . The same commenter emphasized its256k context window on an8B/A1B -style model as a key differentiator. - There was interest in runtime compatibility, specifically whether llama.cpp support exists yet. Another commenter suggested future larger 15B–50B Ling models combined with speculative decoding could significantly improve throughput, potentially approaching the perceived responsiveness of diffusion-style generation pipelines. Keep reading with a 7-day free trial Subscribe to Latent.Space to keep reading this post and get 7 days of free access to the full post archives.
00:03

How to Buy & Sell with AI

A practical guide to building AI agents that buy and sell: researching what to buy, pricing what to sell, flipping items, and finding demand for new products. The opening example uses a Perplexity Space called Sell This to photograph an item, identify it, research local prices, and auto-write a Facebook Marketplace listing. The core architecture: the model is the intelligence layer, the marketplace is the evidence layer, and the human stays the authority layer β€” with OpenAI's Agentic Commerce, Shopify's Global Catalog, and eBay's Browse/Inventory APIs as current building blocks. It includes a copy-paste prompt for selling anything and maps seven business models from flipping to building whole marketplaces. Solid how-to, no breaking news.

Notes
How to Buy & Sell with AI (Open Cloud AI substack, 2026-08-12)

Opening case: a man moving Illinois→Florida pointed his phone at a snowblower; AI identified it, researched comparable local values, suggested a quick-sale price, and wrote the Facebook Marketplace listing. The builder: Mark Christianson, using a Perplexity Space called "Sell This." Workflow: Photo → identify → research → price → write listing → sell. The article extends it to buying, flipping, and product creation.

Core principle
"AI should reason over evidence. It should not invent the evidence."

A commerce agent separates two jobs: evidence gathering (current products, prices, inventory, sold comps, shipping, fees, reviews, availability) vs. AI reasoning (identify, compare, normalize, calculate, challenge, recommend), with a human authorizing the act.

"The model is the intelligence layer. The marketplace is the evidence layer. The human remains the authority layer."
Named infrastructure
  • OpenAI Agentic Commerce: merchants supply structured product info so ChatGPT indexes products with current price/availability rather than relying on model memory.
  • Shopify Global Catalog: cross-merchant product discovery for agents; agent tooling can go from product selection into cart and checkout handoff.
  • eBay: Browse API (search live inventory) + Inventory API (authorized sellers create/manage/publish inventory).
Tried-and-tested prompt structure

Instruct the assistant with location and priority ("sell reasonably quickly without giving it away"), then require:

  • Split identification into CONFIRMED / LIKELY / UNKNOWN β€” don't guess model numbers, capacities, versions, or specs; if unknown, state what photo/info is needed.
  • Research current market with sources, split into current asking prices / actual sold-price evidence / local prices.
  • Return 13 items: exact ID, specs, condition, price range, quick-sale price, fair-market price, patient-sale price, Marketplace title, short + detailed listing, five photos to include, likely buyer questions, manual verification list. Show date/source of pricing evidence; "Do not invent prices. Do not hide defects."

Deliberate sequencing: sell one real object first β€” "If AI cannot help you sell one object more efficiently, adding six agents will not fix the problem. Start with the transaction. Earn the automation."

Seven (eight) businesses in the space
  • Buy with AI β†’ BUY / WAIT / AVOID
  • Sell with AI β†’ QUICK SALE / MARKET / PATIENT
  • Flip with AI β†’ BUY / WATCH / SKIP
  • Find demand, create product (digital products/service)
  • Build & sell an AI agent (agent is the product)
  • Build a marketplace (identify fragmented supply, list, match, transact)
  • Buy/sell financial assets β€” flagged as a separate, higher-risk branch: "market data, backtesting, deterministic risk controls and paper trading matter much more than conversational prompting."
  • Sell to AI β€” cross-cutting: products must be machine-discoverable, comparable, recommendable.

Stack that strongest systems combine: live data + AI reasoning + deterministic rules + memory/state + tools + human approval.

The full playbook (Buyer Agent, Seller Agent, Flip Agent, Demand Finder, digital products, agent businesses, marketplaces, AI-to-AI commerce) is teased as the article's next section.

Full text · 7,401 chars
How to Buy & Sell with AI Build AI agents that research what to buy, price what to sell, find resale opportunities, and create new products to sell. A man pointed his phone at a snowblower. A few moments later, AI had identified what he owned, researched what similar machines were worth around his area, suggested a price designed to move it quickly, and written the Facebook Marketplace listing. He was moving from Illinois to Florida. The snowblower was not coming with him. Instead of spending an hour searching model numbers, opening Marketplace listings, guessing at a fair price, writing an ad and preparing for buyers to haggle, Mark Christianson built a simple Perplexity Space called Sell This. His workflow was almost embarrassingly simple: Photo β†’ identify β†’ research β†’ price β†’ write listing β†’ sell. That is where this article begins. But it is not where it ends. Because the same idea now works backwards. Tell AI: I need a lightweight business laptop under $1,500 with 16GB of RAM, strong battery life and delivery this week. AI can help search, compare, reject weak options and reduce the market to a few serious choices. Now reverse the transaction again. Tell it: I have $500. Help me find ordinary products that appear underpriced relative to what they can realistically resell for. Now AI is working on both sides of the market. And there are more possibilities. You can ask AI what people are already trying to buy before you create a product. You can create a digital product around that demand. You can build an agent and sell the agent itself. You can build an entire marketplace connecting buyers and sellers. You can make your existing products easier for AI shopping agents to discover. You can even apply the same architecture to financial markets, although that requires a very different risk model. The phrase buy and sell with AI sounds simple. It actually describes an emerging stack of commerce systems. This guide is about building them. Not someday. With tools and workflows that exist now. The mistake is thinking the chatbot is the market Before we build anything, one rule matters more than every prompt in this article: AI should reason over evidence. It should not invent the evidence. Suppose you ask: What is my Sony camera worth? An AI model might give you a beautifully written answer. That does not mean it knows what your exact camera is selling for today. A useful commerce agent separates two jobs. MARKET / DATA SOURCE ↓Current productsCurrent pricesInventorySold compsShippingFeesReviewsAvailability ↓ AI ↓IdentifyCompareNormalizeCalculateChallengeRecommend ↓ HUMAN ↓ ACT / WAIT OpenAI’s current Agentic Commerce infrastructure works on this same basic principle. Merchants can supply structured product information so ChatGPT can index products with current price and availability instead of relying only on model memory. Shopify now exposes Global Catalog infrastructure specifically for agents that need cross-merchant product discovery. Its agent tooling can also move from product selection into carts and checkout handoff. eBay provides the other side of this picture. Its Browse API can search live inventory, while its Inventory API lets authorized seller applications create and manage inventory and publish it on eBay marketplaces. The model is the intelligence layer. The marketplace is the evidence layer. The human remains the authority layer. Remember that architecture. We will use it repeatedly. Try this before going any further Find something in your house you genuinely do not need. Headphones. A power tool. Coffee machine. Camera. Monitor. Game console. Old furniture. Take clear photos of: the full product the label/model number accessories wear damage Then give an AI assistant with web access this instruction: You are my Sell This assistant.I want to sell the item in these photographs.LOCATION:[City, region, country]MY PRIORITY:Sell reasonably quickly without giving the item away.FIRST:Identify the item as precisely as possible.Separate your identification into:CONFIRMEDLIKELYUNKNOWNDo not guess missing model numbers, capacities,versions, sizes or specifications.If something important is unknown, tell me exactlywhat additional photo or information you need.THEN:Research the current market using current web sources.Separate:CURRENT ASKING PRICESACTUAL SOLD-PRICE EVIDENCE, when availableLOCAL PRICES, when availableGive me:1. Exact product identification2. Important specifications3. Condition assessment4. Current price range5. Quick-sale price6. Fair-market price7. Patient-sale price8. Facebook Marketplace title9. Short listing description10. Detailed listing description11. Five photos I should include12. Likely buyer questions13. Anything I must verify manuallyShow the date and source of pricing evidence.Do not invent prices.Do not hide defects. That is already useful. Christianson’s real-world version followed essentially this pattern: photographs became identification, local pricing, a quick-sale price and Marketplace copy. The dedicated reseller research we collected reaches the same conclusion from a broader angle. Modern reseller workflows now combine description generation, photo processing, pricing research, cross-listing, inventory synchronization and buyer communication instead of treating each as a separate job. And there is an important reason I wanted you to try selling something before discussing sophisticated multi-agent systems: If AI cannot help you sell one object more efficiently, adding six agents will not fix the problem. Start with the transaction. Earn the automation. There are seven different businesses hiding inside buy and sell with AI Most articles stop at AI shopping recommendations. We will not. The practical opportunity is much wider. 1. Buy with AI AI researches an ordinary purchase and returns: BUY / WAIT / AVOID 2. Sell with AI AI identifies what you own, researches its market and returns: QUICK SALE / MARKET / PATIENT 3. Flip with AI AI looks at both sides of a possible resale and returns: BUY / WATCH / SKIP 4. Find demand and create something to sell AI researches what people repeatedly want, validates the problem and helps turn that demand into a digital product or service. 5. Build and sell an AI agent The agent itself becomes the product. 6. Build a marketplace AI helps identify fragmented supply, find buyers, build listings, match both sides, support transactions and operate the marketplace. 7. Buy and sell financial assets with AI This is a separate, higher-risk branch where market data, backtesting, deterministic risk controls and paper trading matter much more than conversational prompting. And above all seven sits an eighth idea: Sell to AI As AI becomes a shopping interface, sellers need products that machines can understand, compare and recommend. That is where the commerce stack gets much more interesting. The easiest systems begin with a prompt. The strongest ones eventually combine: LIVE DATA+AI REASONING+DETERMINISTIC RULES+MEMORY / STATE+TOOLS+HUMAN APPROVAL Now we know the map. The valuable part is building it. Inside the full playbook: build a Buyer Agent, Seller Agent, Flip Agent, Demand Finder, and systems for digital products, agent businesses, marketplaces, and AI-to-AI commerce. The next section is where AI stops giving advice and starts doing the work.
08:01

The Work AI Handed Back

Companies that cut staff and replaced them with AI are quietly rehiring people, because the automation handled the visible work but not the messy judgment calls. Ford rehired 350 veteran engineers to take back vehicle quality checks after its AI-heavy approach kept producing poor results, and now credits the reversal with saving hundreds of millions in warranty costs. IBM's AskHR agent handles 94% of employee questions, but IBM is tripling entry-level hiring for the 6% of complex cases that need human judgment. A survey found 32% of US hiring managers have already rehired for a role they cut because of AI.

Notes
Ford

Ford put automated vehicle-quality systems ahead of veteran engineers, then in June 2026 rehired 350 experienced engineers (some former employees) for quality work. VP of vehicle hardware engineering Charles Poon:

"Mistakenly we thought that by just introducing artificial intelligence and ingesting the design requirements that we had, that that would produce a high-quality product."

Same week, Ford topped the J.D. Power Initial Quality Study among mainstream brands for the first time in 16 years. CEO Jim Farley said falling warranty/recall costs are "contributing to literally hundreds and hundreds of millions of dollars of a tailwind for Ford on cost."

IBM

Internal HR agent AskHR resolves 94% of employee questions without human routing. In February 2026, CHRO Nickle LaMoreaux announced IBM would triple US entry-level hiring:

"And yes, it's for all these jobs that we're being told AI can do."

The un-routed 6%: cases not fitting policy, where following the rule would be wrong, or where individual needs must balance against governance.

Commonwealth Bank of Australia

Cut 45 customer-service roles in 2025, claiming an AI voice bot cut call volume by 2,000/week. In reality staff were offered overtime and team leaders took calls. The bank reversed the redundancies and admitted the assessment was flawed.

Wider data
  • Robert Half (June 2026): 32% of US hiring managers rehired for a role cut because of AI.
  • Orgvue (April 2025): 39% of business leaders made AI-related redundancies; 55% of those admit wrong decisions were made.
Author's thesis

The technology could do the work; the companies' arithmetic was wrong. They counted what automation produced (tickets, handling times, throughput β€” the visible 94%) but not what people absorbed β€” the 6% that shows up only as absence: a recall that didn't happen, a complaint never escalated, a mistake caught at 16:55. Ford's 350 engineers were invisible until the warranty bill arrived.

Full text · 3,915 chars
The Work AI Handed Back Companies are now finding out the cost of laying off staff and replacing them with AI tools that cannot do their work. Ford spent years handing vehicle quality checks to automated systems, and let go of the veteran engineers who used to do that work. In June it put 350 of them back on quality. Charles Poon, Ford’s vice president of vehicle hardware engineering gave the reason: β€œMistakenly we thought that by just introducing artificial intelligence and ingesting the design requirements that we had, that that would produce a high-quality product.” Poon is describing an arithmetic error, and Ford is not the only company to have paid for one this year. In this post I will: - Show you what three companies paid to find out. - Work out what the three reversals have in common. - Give you three questions for finding the part of your job nobody counts. What Ford found when the machine did the inspecting The same week Poon spoke, Ford took the top spot among mainstream brands in the J.D. Power Initial Quality Study, which it had not done in sixteen years. This was a company that had leaned harder and harder on automated quality systems and kept being disappointed by what came out. To address this, Ford went looking for 350 experienced engineers, some former employees, and put them back on quality. Ford CEO Jim Farley says falling warranty and recall costs are: β€œcontributing to literally hundreds and hundreds of millions of dollars of a tailwind for Ford on cost.” That is the number the rehiring has to be judged against. What IBM found in the other 6% IBM’s internal HR agent, AskHR, now answers 94% of employee questions without routing them to a person. That is a real success and they are entitled to be pleased with it. In February, IBM’s chief human resources officer Nickle LaMoreaux announced the company would triple its entry-level hiring in the United States: β€œAnd yes, it’s for all these jobs that we’re being told AI can do.” IBM calls the remaining 6% the complex cases that need human judgement. These are the requests that do not fit the policy, the situations where following the rule would be the wrong thing to do, the cases where somebody has to take into account individual needs alongside organisational governance. The third case Commonwealth Bank of Australia cut 45 customer service roles in 2025, saying an AI voice bot had reduced call volumes by two thousand a week. In reality, the bank was offering staff overtime and putting team leaders on the phones. It reversed the redundancies and admitted its own assessment had been flawed. In June this year, job hiring service Robert Half found that 32% of US hiring managers have already rehired for a role they cut because of AI. Likewise, in April 2025, Orgvue found that 39% of business leaders had made people redundant because of AI, and that 55% of those admit wrong decisions were made about these redundancies. If this is the sort of thing you think about, my book goes further into it. What the three reversals have in common None of these three companies found that the technology could not do the work. What each of them got wrong was the arithmetic. They counted what the automation produced and did not count what the people had been absorbing, because one of those things appears in a system and the other does not. The 94% is visible. Ticket volumes, handling times, throughput. The 6% shows up as an absence: the recall that did not happen, the complaint that never escalated, the mistake somebody caught on a Tuesday at 16:55. Ford’s 350 engineers were invisible in exactly that way until the warranty bill turned up. This is where the free section ends. Below the line: what the 6% consists of in seven named professions, the three-question test for finding your own, what to do when a manager cannot see it, and why the people most exposed are not the ones everybody is worrying about.
15:42

Managed Agents Are Changing How We Build AI Agents

Cloud agents that run unattended for hours are turning into a product of their own, and Anthropic just shipped four new management features for its Managed Agents service on August 7. The additions are hard spending limits, advisor models that keep a job on track, controls over where computation runs, and automatic loading of Skills from GitHub repositories. Managed Agents entered public beta only four months earlier, and the pieces now read like an operating system for AI workers, letting an agent edit files, browse the web, remember past work, and wake up on a schedule without anyone keeping the loop alive. The guide's point is that the machine around the model, not the model itself, is becoming the product, though developers still decide what good work means, what to verify, and when a job is truly finished.

Notes

Notes saved to notes/emerging-ai-managed-agents-2026-08-12.md (~290 words). Key content: the four Aug 7 features, the four core objects, the quoted responsibility split, guide contents, and caveats (promotional framing, no benchmarks/pricing).

Full text · 2,651 chars
Managed Agents Are Changing How We Build AI Agents A practical guide to building cloud agents that can run for hours, use tools and skills, remember past work, control costs, and coordinate with other agents. On August 7, Anthropic added four things to Managed Agents at once: hard spending limits, advisor models, inference-location controls, and automatic loading of Skills from GitHub repositories. Four months earlier, Managed Agents had only just entered public beta. These do not sound like normal model upgrades. They sound like pieces of an operating system for AI workers. An agent can now start inside a cloud computer, read and edit files, run commands, browse the web, call MCP tools, remember information across jobs, bring in another agent when the work gets difficult, stop itself at a spending limit, and wake up again tomorrow on a schedule. You are no longer responsible for keeping the loop, container and worker alive. That is the interesting part of Managed Agents. The model is still important. The machine around the model is becoming a product. The agent loop is leaving your laptop A basic agent is surprisingly simple: Model β†’ choose tool β†’ run tool β†’ inspect result β†’ choose next action β†’ repeat Claude Code, coding agents and many research agents are built around some version of that loop. The difficult part starts when you want the same agent to work for six hours, survive an interruption, safely execute code, remember yesterday’s job, use company credentials, run every morning, stream progress to an application and let several specialist agents work together. Until recently, you built much of that machinery yourself. Managed Agents move it into the runtime. Anthropic describes four core objects: Agent β†’ Environment β†’ Session β†’ Events. The agent contains the model, instructions, tools, MCP servers and Skills. The environment is the computer it works inside. A session is one running job. Events are how your application talks to it and watches the work. This also explains what should not disappear. The managed layer is good at running the machine: sandboxing, sessions, execution, events and orchestration. Your own layer should still decide what good work means, what needs verification, what information is private and when something is actually finished. That split is becoming one of the most useful ideas in agent building. Inside the full guide: the exact Managed Agent setup, CLI commands, budget controls, memory, Skills, multiagent orchestration, advisor models, scheduled runs, graph-style workflows, security trade-offs, and the practical path from one cloud agent to a reliable autonomous worker.
16:50

While Everyone is Waiting for the Next Model, Your Agent Can Learn Tonight

Teams building on closed AI models can't retrain the weights, so a sharper agent comes from improving the code, tools, and context around it, not from waiting for a new model. The guide walks through evaluating agents by clicking the finished product instead of grading code, clustering production failures with a small cheap model, and letting an agent loop propose and ship fixes to its own bugs. Humans still decide what deserves fixing, what ships, and what the evals reward. It's an opinionated engineering essay, with a Vanta sponsor section in the middle.

Notes

Thesis: For teams building on rented frontier APIs, continual learning means improving the environment (harness + context), never the weights.

The three layers to learn in

  • Model β€” the weights; locked. No checkpoint, no gradient behind a closed API. Retraining is "a fantasy" for almost everyone; researchers still haven't solved catastrophic forgetting.
  • Harness β€” code, tools, instructions wrapping the model; fix once β†’ every user gets the better agent.
  • Context β€” saved instructions, memory, skills, per-user knowledge; personalization that compounds per interaction.

Evals measure the wrong finish line

  • SWE-bench and Terminal-Bench grade fixing code inside an existing repo with fixed tests β€” not the "vibe coder" task of inventing stack/schema/flow from a plain-English app description β†’ "functional correctness gap."
  • ViBench (Replit, public) grades that.
  • Test like a user: (1) click through the finished product end-to-end; (2) plain-English checks ("a logged-out visitor can sign up and reach the dashboard"); (3) let the evaluator explore without prior knowledge of structure; (4) draw specs from anonymized production requests, not invented ones.

Production measurement

  • Offline evals "lie sometimes"; aggregates (A/B test) tell you the needle moved, "never why."
  • Failure clustering traces to Anthropic's Clio; runs in Braintrust's Topics and Replit's Telescope. Cheap model summarizes each session in one sentence, embeddings group them into issue clusters; only works over every trace, not a sample (long-tail bugs).
  • Practices: read 10 random sessions/week; follow rage-rephrases (abandonment is the strongest signal); label failures (misunderstood the request / got stuck / did it but ugly / too slow); ask one "did this work for you?" prompt at the failure moment.

Self-improving loop

  • Agent reads logs + clusters, picks one hypothesis, builds a candidate patch with reasoning, measures against benchmark/baselines, verdicts: ship/iterate/drop.
  • Replit case: Telescope flagged a small growing cluster β€” environment setup degrading on cold starts; nothing in top-line metrics. Loop patched it + added a regression test; engineers reviewed and pushed same day; sentiment recovered.
  • Rules: fix the pattern not the incident (ask how many users hit it); cheapest fix first (rewrite instructions, not software); keep a "before" set of 10–20 past failures and re-run after every change; change one thing at a time.

Human-only decisions

  • Which failures get the loop's overnight budget; how to fix an abandoned workflow (smoothing a path vs. redesigning a surface); curating evals β€” "reward the wrong behavior and the loop optimizes toward the wrong thing with perfect, tireless discipline"; owning launch (read blast radius, not the green number).
"The teams that win the next year are not waiting for a better checkpoint. They turned their own users' failures into better releases... on a model they never owned." β€” The AI Corner

(Note: article embeds a sponsored Vanta walkthrough on connecting compliance into AI-native workflows via MCP/plugins.)

Notes above; logged as task_1786559383546 and marked done.

Full text · 11,255 chars
While Everyone is Waiting for the Next Model, Your Agent Can Learn Tonight A guide on continual learning for AI agents. The Learning Layer You Actually Own Engineers obsessed with making AI smarter keep circling back to one word: retraining. New weights. A fresh checkpoint. A model that knows things last month’s version did not. For the handful of labs that own frontier models, that is the actual job. For almost everyone else shipping AI products, it is a fantasy. The agent you built this year runs on a model someone else trained, called through an API you cannot fine-tune. So the teams waiting on retraining to rescue their product are waiting at a door that never opens. The ones who figured this out already ship a sharper agent every week, and they never touch a single weight. The learning happens in the layer you own: the environment your agent works in. together with Vanta: That environment keeps absorbing more of the work. AI-native teams already build in Claude, Cursor, and Codex, and now compliance happens there too. Vanta is running a free technical walkthrough of exactly how: ▫️ Connect Vanta into AI-native workflows through MCP and plugins ▫️ Surface failing tests, open risks, and audit gaps with a prompt ▫️ Assign and track remediation without leaving your AI tool Free to attend, and if the time fails you, register anyway and get the recording: Table of Contents 1. The Weights Were Never Yours to Fix 2. An Agent Has Three Places to Learn 3. Your Evaluation Is Measuring the Wrong Finish Line 4. A Score Tells You What Moved, Never Why 5. Point the Agent at Its Own Failures 6. The Decisions No Loop Should Make for You 1. The Weights Were Never Yours to Fix Continual learning has been quietly kidnapped by one definition. Update the model and treat everything else as a workaround. The retraining reflex Ask most people how an AI system improves and they describe gradient steps. Fine-tuning, reinforcement learning, a training run that ends in a better model. That picture is accurate for OpenAI, Anthropic and Google. It is close to useless for the company building on top of what those labs ship. Retraining is also slower and riskier than the pitch admits. Researchers call it catastrophic forgetting and it is still unsolved. You are renting the intelligence The uncomfortable fact under the whole agent economy is simple. Most production agents run on closed frontier models you do not own. You rent that intelligence by the token. Rent it and fine-tuning is off the menu entirely. There is no checkpoint to update and no gradient to push on a model that lives behind someone else’s API. That sounds like a ceiling. It is closer to a map, because if the model is fixed, improvement has to come from somewhere else. 2. An Agent Has Three Places to Learn An agent is not a model. It is a model wrapped in a stack and every layer of that stack is a place learning can happen. Model, harness, context The model is the raw weights, the network predicting the next token. The layer everyone fixates on and the one you cannot touch. It decides how your request reaches the model, which tools it can call and how it recovers when a step fails. The model is the engine; the harness is the car built around it. The context is everything configuring the agent from outside the harness. Saved instructions, memory, skills and knowledge about one specific user. Two of the three are yours Here is the reframe that changes how you build. The locked layer is one of three and the other two are entirely in your hands. Harness learning means mining what your agent does in production to improve the code, tools and instructions behind every instance of it. Fix the harness once and every user wakes up to a better agent tomorrow. Context learning means personalizing, so the product sharpens with every interaction instead of resetting to zero. You do not have to choose. Do both and you compound improvements you can ship daily, on your own schedule, waiting on no lab. The machinery that makes that real starts in a place most teams underrate. How you measure. 3. Your Evaluation Is Measuring the Wrong Finish Line Most teams treat evaluation as a turnstile. Run the test, read the score, decide whether to ship. That model breaks the moment your prompts, tools and product surfaces all start moving every week. The benchmark that stops short of the user Off-the-shelf benchmarks quietly measure the wrong thing. Look at coding agents. SWE-bench and Terminal-Bench grade fixing code inside a project that already exists, with fixed files and a fixed test suite. That is a real skill. It is not the one a vibe coder cares about. When someone describes an app in plain English with no repo, the agent invents the stack, the schema and the whole flow. So you get a functional correctness gap. The agent passes every local check and still fails the only question that matters, whether the finished app does what the user asked. Replit built a public benchmark called ViBench to grade exactly that. How to test the way the user does: 1. Click the thing, do not grade the code. Open the finished product and use it the way a customer would. The only passing grade is that the workflow works end to end. 2. Write the checks in plain English. β€œA logged-out visitor can sign up and reach the dashboard” beats any unit test a benchmark ships with. You are grading outcomes, not function signatures. 3. Let the evaluator explore. It should not know the app’s structure in advance, because your users do not either. It discovers the buttons and flows as it goes. 4. Draw the specs from real requests. Pull them from anonymized production usage, not invented ones. Real users ask for things no engineer would think to test. That hands you a candidate worth shipping. It still cannot tell you what real users do once it is live. 4. A Score Tells You What Moved, Never Why Offline benchmarks catch regressions before release. They also lie sometimes, because a clean controlled run can still hide wrecked real behavior. Production needs its own measurement layer and then a way to actually read it. Aggregate numbers keep their secrets The honest read on production is an A/B test. Ship a change to some users, hold it from others and watch what happens. Did people keep going or give up. Did sentiment change?. Did the cost move somewhere nobody expected. But the aggregate refuses to explain itself. Sessions got longer and you cannot tell if the agent did more useful work or got stuck in a loop. A metric tells you the needle moved, then goes quiet. Cluster the failures you did not know to look for At production scale no one reads every session. There are thousands, sometimes millions. The fix traces back to Anthropic’s Clio research and now runs inside systems like Braintrust’s Topics and Replit’s Telescope. Ask a small, cheap model to summarize one dimension of each session in a sentence, embed those summaries and let the similar ones cluster into issue groups. The worst bugs hide in the long tail a sample would skip, which is why this only pays off when it runs over every trace, not a lucky few. Watching where it breaks: 1. Read real sessions, not just the dashboard. Pick ten random sessions a week and actually read them. A metric tells you something broke; the transcript tells you what it felt like for the user. 2. Follow the people who give up. The sharpest failure signal is abandonment. Someone asks, gets a weak result, rephrases once or twice, then leaves and those rage-rephrases are gold. 3. Turn every complaint into a label. Tag each failure with something plain: misunderstood the request, got stuck, did it but ugly, too slow. After a few weeks one label dominates and that is your target. 4. Ask one question at the moment it breaks. A tiny β€œdid this work for you?” prompt beats a long survey. You want feedback pinned to a specific moment, not a general mood. Now scattered failures become one ranked list of real problems. The bottleneck moves to actually fixing them. 5. Point the Agent at Its Own Failures Now you have benchmarks, A/B tests and clusters that name the real problems. You still have to turn evidence into fixes. If it can build software, it can improve the agent The operating principle is almost cheeky. If agents are useful enough to build software, they are useful enough to improve the agent that builds it. Each pass reads the logs, clusters and recent failures, then picks a single hypothesis worth chasing. It builds a candidate, opens a draft change with its reasoning, measures it against the benchmark and the baselines and recommends one verdict. Ship, iterate, or drop. One cluster, one patch, shipped the same day A real run at Replit shows the scale. Telescope flagged a small but growing cluster where environment setup was quietly degrading on cold starts. Nothing in the top-line metrics screamed problem; the cluster was the only thing that saw it. The loop read the sessions, proposed a patch and added a regression test so the bug could not creep back. Engineers reviewed the evidence and pushed it the same day. Sentiment recovered and the blocked users were unblocked. Fixing, on repeat: 1. Fix the pattern, not the incident. One bad answer is an anecdote. Thirty users hitting the same wall this week is a fix worth making, so always ask how many people it affects first. 2. Reach for the cheapest fix first. In an agent, the fix is usually rewriting the instructions, not rebuilding the software. You are editing a document, then re-running it on the examples that failed. 3. Keep a β€œbefore” set. Save ten to twenty past failures and re-run them after every change. If the old failures pass and nothing that worked broke, ship it. 4. Change one thing at a time. Move five levers at once and a better score tells you nothing about which lever did it, or which one is quietly breaking something else. The loop can do all of that. It still cannot make the one decision that matters most. 6. The Decisions No Loop Should Make for You Almost every step above can run on its own. Clustering failures, forming hypotheses, building candidates, running evals. The judgment calls are what stay with people and they decide everything. Someone chooses which failures deserve the loop’s overnight budget, because a thousand surfaced problems are not equally worth solving. Someone decides how to fix a workflow users abandon, because smoothing a path and redesigning a surface are very different bets. Someone curates the evals, because that quietly sets the hill the whole system climbs. Reward the wrong behavior and the loop optimizes toward the wrong thing with perfect, tireless discipline. And someone owns the launch, which means reading the evidence and the blast radius, not glancing at a green number. So the division of labor is clean. The loop does the search and the synthesis; humans set the direction and decide what ships. Notice what is missing from all of it. Nowhere did anyone retrain a model. The teams that win the next year are not waiting for a better checkpoint. They turned their own users’ failures into better releases, day after day, on a model they never owned. You do not get to touch the weights. You never did and it turns out you never had to.
02:55

I hate agents.

AI agents finally explained: an agent does a task start to finish rather than just answering a question, and here's a step-by-step way to build your first one. The writer hated agents until he tried Grok Bot, a no-code tool from xAI (which he says is now owned by SpaceX) that runs on its own computer and can be interrupted mid-task. To use it you need Cursor Ultra/Teams or a Grok Heavy X account, with Cursor Teams at $40 a month as the cheapest option. The example is a daily AI-news digest agent, plus a section for pros. It's a solid beginner guide wrapped in a pitch for the author's consulting firm.

Notes
Notes: "I hate agents." β€” How to AI (Substack), 2026-08-12

Author (800k+ newsletter subscribers) had avoided the word "agent" entirely, calling it undefined marketing hype. Now: builds a first agent (an AI-news tracker) and defines the term.

Chatbot vs. agent: Chatbot = ask, it answers. Agent = performs a task start-to-finish. Author counts Claude Code and Cowork as agents used chatbot-style. Caveat: author still believes most companies should prioritize AI adoption over building agents β€” his consulting firm GPC trains employees before building any. Pitch: contact for US 100+ employee firms, esp. manufacturing.

Tool: Grok Bot by xAI (not sponsored). Notes SpaceX bought xAI. Access: go to x.ai/bot; requires a Cursor Ultra/Teams or Grok Heavy X account; cheapest is Cursor Teams at $40/mo. UI: bots on left; middle pane shows task completion updates and allows interruption; right pane shows the agent "computer" and routine (frequency/task cadence).

Example agent built β€” prompt: "Daily digest of AI news in my industry (or very close to it)." Detailed prompt: top 3 AI news by joint virality cross-checked across The Rundown, Google News, Reddit; top 3 creator-economy news; top 3 consulting-business news; plus read ruben.substack.com and surface a recent "how-to" guide.

Article also contains a copy-paste recipe prompt for building an "advanced agent" and a closing "How pros use agents" section not fully reproduced here. Self-disclosure: author shares the piece weekly, targeting 1,000+ shares.

Full text · 3,740 chars
I hate agents. I hated AI agents. Until this: Open LinkedIn for a second and someone will sell you an β€œagent” that answers emails, updates your CRM, books meetings, washes the dishes, drops your kids off at school… But what the fuck is an agent? No one knows: That’s why, even though I have over 800,000 people reading my newsletter on How to AI, I never mention β€œagents”. But today, this insanity stops. You & I both will know what an agent is, and we will build our first one together. I’ll assume the word β€œagent” makes you think of James Bond, so we really start from zero. Our first agent will do something that takes too much of your time: keeping track of AI news (only the one you care about). A simple, safe & useful agent. For the pros, I added a last section called β€œHow pros use agents” at the end. Two things before we start: - Save this guide. Block 10 min this week to create your first agent. - Send it to anyone who is scared by the word β€œagent”. I am also scared btw. PS: This newsletter grows from your shares. And I keep hitting 1,000+ shares! It’s my weekly north star. Sharing is free & helps me stay laser focused on mastering AI. 1. Chatbot or Agent? You’ve been using AI chatbots your whole life: you ask, it answers. But an AI agent is doing a task, start to finish: And it’s important to understand the difference. Because AI agents are getting cheaper than… humans. It’s a scary image, I know. But until very recently, I couldn’t care less about agents. Too clunky to build, too much work to maintain them. I still think most companies should focus on AI adoption instead of trying to build agents. That’s why my consulting firm - GPC - trains employees before building any agents. Send me a message if your company has over 100 employees in the US, especially in the manufacturing industry. And yet, I kept trying to make agents. Easy, useful ones, connected to my apps. Like technically, when I use Claude Code or Cowork, they are agents. But you’re still using it as a chatbot. You ask. It answers. These were my only β€œagents”. Until I tried this one: 2. The easiest way to build a good agent. I will stop you right there. I am not paid to write about this company. They just have a good, useful tool to make agents. Especially for us, people who don’t code (or don’t want to). It’s called Grok Bot, a tool made by xAI*. *SpaceX bought xAI, the AI company of X, which makes Grok models. On the left: You see my β€œbots,” or call them agents. In the middle: When it finishes work, it updates you here. You can also interrupt it anytime to give a new task, or how you feel about its execution. On the right: You see the agent computer (yes, it has its own computer) and its routine (how often should it perform a task, or many tasks?). Before I show you exactly how to access it & install it (just go to x.ai/bot if you’re in a hurry), here’s an example of an agent I built: To connect your apps to Grok Bot: How to install Grok Bot: - Go to x.ai/bot. - You must have a Cursor Ultra/Teams or Grok Heavy X account. - The least expensive is Cursor Teams ($40/mo). Once done, we can create our first agent together. I think it’s much simpler for you if I explain with screenshots: My exact prompt: β€œDaily digest of AI news in my industry (or very close to it).” My exact prompt: β€œWhat I care about, as a daily digest: - the top 3 news of AI by joint virality (The Rundown, Google News, what pops on Reddit, cross-check them) - the top 3 news in the creator economy - the top 3 news in the consulting business - read ruben.substack.com and update me on a recent "how to" guide” Now this was one agent. A simple one, useful, fast to make. But here’s my recipe to create an advanced agent (it’s a copy & paste prompt):
03:47

AI in Business

A newsletter is launching 'AI in Business': twelve weeks, one real business use case each Wednesday, each rebuilt as an installable Claude skill. The author tested the format quietly this summer, including a skill that audits like a $300/hour consultant. Each skill installs in about five minutes and runs forever; the first case drops August 19. There's also a paid Academy for reviews, with Claude Code/Cowork and ChatGPT Work courses coming. Mostly a series announcement, complete with the paywall nudges.

Notes

AI in Business (LearnAIWithMe)

New 12-week weekly Substack series ("12 cases, 12 Wednesdays"). Case #1 due Wednesday, August 19. Each Wednesday one real business use case is rebuilt as an installable Claude skill β€” claimed installable in 5 minutes and runnable forever.

Track record/precedent:

  • Ran the class silently this summer (unnamed). One Claude skill "audits like a $300/hour consultant"; also produced a "McKinsey-style report" and "Deloitte-style audit." Readers "loved it."
  • Prior series: Build-it (30 AI builds); Build-ship-repeat (BSR) β€” raw ideas β†’ shipped products.

Positioning:

  • Targets "the most expensive work inside the business you work for" β€” no need to own a business.
  • Claim: "most of you will earn more from AI than from any app you might ship"; the goal is to become "the one who replaces the expensive work with AI."
  • Author is a freelancer with 7,000+ hours; takes on client jobs to harvest real use cases. Today he has an interview about Hermes agents (he builds them for LearnAIWithMe).

Call for contributions:

  • DMs: explain your use case, why it matters, how it affects other professionals. He may rebuild/share it if convinced it generalizes.

Caveats:

  • First case not yet published; no concrete use-case content, prices, or benchmarks in this post β€” only the summer pilot's analogy ($300/hour consultant) with no measured results.
  • Monetization: paid Academy (from the Vault) offers use-case review and "audit your work."
  • Note: Claude Code (updated), Claude Cowork, and ChatGPT Work series to be added to the AI Academy, co-created with "two of the biggest Substack publications."
Full text · 2,904 chars
AI in Business 12 cases. 12 Wednesdays. AI in Business. You use AI at work. I read it in the comments. And I got a lot of DMs. I answer your questions all the time. Over time, I realized that the more AI use cases I publish, the more you like them and the more you ask for. This is the pattern. And it needs more attention. The Pilots Already Ran I tested this class silently this summer, without naming it. A Claude skill audits like a $300/hour consultant, a McKinsey-style report, a Deloitte-style audit. You loved it, so you voted before the series had a name. Now it has a name and a schedule. Every Wednesday, one real use case from a real business is rebuilt as a Claude skill. You can install it in 5 minutes and run it forever. AI in Business We had different series before. Build-it teaches you the reflex of building with AI. We built 30 different builds, using AI. Build-ship-repeat, or BSR, as you called it, teaches you how to turn raw ideas into real products and ship them. Now we go one step further. AI in Business points the same muscle at the money you already make. You do not need to own a business. AI in Business targets the most expensive work inside the business you work for. So most of you will earn more from AI than from any app you might ship. You become the one who replaces the expensive work with AI. Want Your Business in a Case? You know my freelancing experience. (7,000+ hours.) These days I take on jobs with different businesses to collect real-world use cases. You see, one of the benefits of freelancing is that you can take on different jobs much faster. For instance, I have an interview today. It is about Hermes agents. For a while, I’ve been building Hermes agents for LearnAIWithMe, and I’ve been wondering how they are used in different businesses. But this is not enough. DM me. A couple of lines are often enough. Explain your use case and tell me why it matters and how it affects other business professionals. I want to hear your solution. Maybe I’ll build on top of it and share it on LearnAIWithMe if I’m convinced it can solve problems for others. Case #1: Coming Wednesday, August 19 The first use case will be next Wednesday. I have a shortlist. The solution will be a Claude skill. And this skill can be installed with one prompt. So every use case will give you a reusable skill. 12 weeks later, you will have 12 working skills in your business. You don’t need to learn how to prompt right now. You learned how to build. Now you’ll change your business or become irreplaceable in your work. Do you want more? If you want me to review your use cases and audit your work, join the Academy from the Vault. Note: Claude Code (updated), Claude Cowork, and ChatGPT Work series will be added to the AI Academy soon. I created them in collaboration with two of the biggest Substack publications, and I’ve received permission to add them to the Academy.

Web

5
00:00

Tesco’s AI Agents Could Soon Do Your Shopping For You

Tesco is building AI agents that could one day do your grocery shopping for you, not just recommend it. The UK's biggest supermarket, which holds nearly 30% of the grocery market and tracks shopping habits from eight in ten households via Clubcard, is testing a Clubcard app assistant that plans meals, cuts food waste, and auto-builds baskets. It's doing the work through an innovation lab with Adobe built on Firefly Foundry, plus a separate deal with Mistral for internal content and data tools. The project is brand new with no results yet, and the real hurdle is earning customers' trust before letting AI make purchases.

Notes

Tesco's AI Agents Could Soon Do Your Shopping For You

Source: Forbes, published 2026-08-12.

Tesco + Adobe
  • Tesco is the UK's largest supermarket, holding ~30% of the UK grocery market; Clubcard data covers 8 in 10 households, built up over 30 years.
  • April 2026: announced strategic partnership with Adobe creating the "Tesco x Adobe Innovation lab" β€” Tesco's data/AI teams working alongside Adobe engineers on bespoke agentic solutions.
  • Built on Adobe's Firefly Foundry, its genAI platform for branded creative materials at scale. This is positioned as a step beyond Tesco's prior predictive analytics/recommendation engines.
  • Agentic shift: agents don't just give insight β€” they "read transactional data and customer behavior signals, generating offers and promotions on the fly, and deciding what way of delivering them to the customer will be most helpful."
Clubcard assistant (staff-testing, not yet rolled out)
  • AI assistant living inside the Clubcard app.
  • Provides meal planning tailored to individual preferences and dietary needs; advice on reducing food waste using leftovers; reported to auto-build shopping baskets from preference and purchase history.
Mistral
  • Separate agreement with French AI developer Mistral for internal operations: content development, document drafting, data analysis, and "developing new ways for colleagues to easily access information which they can use to help customers."
Caveats
"The project is new, so no concrete results are available yet."

No customer rollout date or benchmark figures given. Long-term vision: agents research products, compare options, build baskets, eventually purchase on our behalf.

Author's take
"Tesco already has the data and increasingly has the technology. What it still has to earn is trust."

The stated risk to autonomous retail is customer trust, not technical capability.

Full text · 4,163 chars
Tesco, the UK’s largest supermarket chain, has spent 30 years learning what millions of people buy. Now it wants AI agents to start acting on that knowledge. The retail giant accounts for almost 30 percent of the UK grocery market, and through its Clubcard loyalty program it has built an extraordinary picture of British shopping habits, with data said to cover eight out of 10 households. For years, Tesco has used that information to predict what customers might want and personalize the offers they see. Now it is taking the next step. Through partnerships with Adobe and other AI companies, Tesco is exploring AI agents that can move beyond predicting customer behavior and actually take action. That includes an AI assistant capable of planning meals, helping customers reduce food waste and automatically building shopping baskets based on their preferences and purchase history. It raises a much bigger question. Are we approaching a future where AI doesn’t simply recommend what we should buy, but increasingly does the shopping for us? Tesco And Adobe. What’s The Plan? In April this year, Tesco announced a strategic partnership with Adobe to create the Tesco x Adobe Innovation lab. This will see the supermarket giant’s data and AI teams working directly alongside Adobe engineers to develop bespoke agentic solutions. Its technology is built around Adobe’s Firefly Foundry, its genAI platform for personalized, branded creative materials at scale. This is a technological leap forward from Tesco’s previous AI-driven personalization initiatives, which were mainly focused on predictive analytics and recommendation engines. While those technologies basically provided insights into what someone might buy next based in what they bought before, agents take things further. Rather than just giving the retailer information, they are capable of taking action. This means reading transactional data and customer behavior signals, generating offers and promotions on the fly, and deciding what way of delivering them to the customer will be most helpful. One feature currently being tested by staff before it’s rolled out to customers is an AI assistant that will live inside its Clubcard app. It will provide meal planning advice tailored to individual preferences and dietary needs, as well as advice on reducing food waste by using up leftovers at home. It’s also reported that it will automatically build shopping baskets based on preference and purchase history. This certainly sounds like a step towards the buying capabilities we’ve been told to expect from agents. The project is new, so no concrete results are available yet. But it sends a clear message that retailers are moving beyond traditional predictive AI and analytics, towards adopting agentic, action-taking models and platforms. Separately, the supermarket giant has also entered into an agreement with French AI developer Mistral, focused on developing technologies for its internal operations. According to its press release, this will include developing solutions for content development, document drafting and data analysis, as well as β€œdeveloping new ways for colleagues to easily access information which they can use to help customers.” Agentic AI And The Future Of Retail The bigger prize for AI in retail is easy to see: a future where AI agents shop for us. They could research products, compare options, build baskets and eventually make purchases on our behalf. At that point, AI would move from influencing what we buy to actively participating in the buying process. Tesco isn't there yet, but its current experiments point in that direction. An AI assistant that plans meals or builds a shopping basket may feel like a relatively small step, but each useful interaction gives customers another reason to hand over a little more control. And that may be the real challenge for autonomous retail. Tesco already has the data and increasingly has the technology. What it still has to earn is trust. If customers become comfortable letting AI make the small decisions, the much bigger question is how long it will be before they are willing to let it make the purchase too.
00:00

Every Container Entering America Now Faces An AI Interrogation

AI now screens every container entering the US, checking shipping paperwork and flagging suspected fraud or forced labor for Customs and Border Protection. An executive order signed by Trump in June shifted CBP from speeding up imports to cracking down on them, and the agency already auto-checks invoices against agreed prices while holding a multimillion-dollar contract with Exiger to spot illicit transshipment at scale. The AI outputs a score for how likely a shipment is 'tainted', and a bad score can mean detained cargo, fines or inquiries. Importers are fighting back with AI of their own, forging bills of lading and faking supply-chain paper trails.

Notes
AI interrogation of US-bound containers (Forbes, 2026-08-12)
Context: the policy shift
  • President Trump signed "Strengthening Customs Enforcement" (executive order) in June 2026, shifting CBP from facilitating cargo flow to "cracking down on illegal importing practices."
  • CBP acting on it: per the Fresh Produce Association of the Americas, CBP is "reminding the trade community that... Importer of Record (IOR) numbers in the Automated Commercial Environment (ACE) that have not been used to file an entry for one year or more and have no outstanding post-entry transactions may be deactivated."
Why this matters: the pre-AI paperwork system
  • Cameron W. Roberts, LA trade attorney, partner at Roberts & Kehagiaras LLP, describes the old regime: analog typewriters, documents retyped at ports, shipping lines, trucking companies, customs brokers.
  • Concrete example: ordering patio furniture from an overseas factory involved six companies, each sending a physical bill β€” "open six envelopes and check six invoices against what was promised before cutting six different checks."
  • Today AI reviews documentation and matches invoices to agreed costs (e.g. a $100 trucking run auto-releases funds), speeding vendor payment.
The speed caveat

Simona Filip Racek, CEO of Just Down The Street, member of the Senior Expert Advisory Group of the Verifiable.Trade Foundation:

"It's making trade faster for the companies already inside the system; the real question is who else gets in. Presently, trade remains fragmented across players and digital platforms. Without trust and interoperability, AI risks automating that fragmentation. The work ahead is to ensure the digitalization of trade makes global commerce cheaper, faster, and simpler for small businesses too, because if it does not, we have missed its greatest opportunity."
AI as border inspector: forced labor crackdown
  • Forced labor is a top CBP concern, e.g. cotton production (pick β†’ spin β†’ weave β†’ sew) with Uyghur-labor sourcing across multi-country vendor chains.
  • CBP awarded supply chain AI firm Exiger a multimillion-dollar contract to detect illicit transshipment at scale. Exiger claims it brings "the world's largest proprietary supply chain database and the market's most sophisticated AI" and that "billions of dollars worth of global trade move through illegal transshipment channels."
Stated limitations (first thing summaries drop)
  • Roberts stresses Exiger-type algorithms "are not infallible" β€” they deliver probability scores of whether a shipment is "more likely or not likely to be tainted." A suspicious score alone is enough for CBP to act: "inquiries, detained cargo, fines, or more punitive measures."
  • Roberts on why forced labor unites Washington: "Labor unions hate competing with unpaid workers. So do American manufacturers, and human rights advocates need no convincing at all."
The AI arms race (article's counterweight)
  • Criminals use AI too: rerouting, forging bills of lading, and simulating shipping patterns to obscure true origin.
  • Roberts' forward-looking warning:
"AI could soon fabricate the evidence itself... a fake network of suppliers, complete with a convincing paper trail, designed to fool the government's tracing software into believing goods came from somewhere they never touched."

Article ends predicting AI will both expedite commerce and serve a protective role, but notes the cat-and-mouse game will grow more complex.

Full text · 7,281 chars
Keeping the spigot of goods flowing in and out of the nation used to be the main role of U.S. Customs and Border Protection (CBP). It was that way for much of our history, up until the current administration. As recently as June, President Trump signed "Strengthening Customs Enforcement," an executive order that is shifting the agency from cheerleading arriving cargo to cracking down on illegal importing practices. AI is assisting with that sea change. Yet even before artificial intelligence disrupted this sector like so many others, modern digital technology, including the internet, forced a shift in the physical transportation of international goods. Cameron W. Roberts, a Los Angeles-based trade attorney and partner at Roberts & Kehagiaras LLP, is a veteran in this space, one who has observed its machinations over the last few decades. To appreciate where we are going, we first need to reflect on where we came from. One thing Roberts well remembers is the mountainous paperwork international shipping once required. β€œEvery shipping container once arrived in American ports with a mind-bogglingly thick stack of documents,” he explained. Before emails and computer processors, people used analog typewriters to document cargo details. Ports would retype them, then the shipping lines, then the trucking companies, and the customs brokers. The system demanded piles of paper to ensure the never-ending influx of goods contained numbers that corresponded correctly, that actually checked out. Viewed through a 2026 lens, this now antiquated process seems like a herculean undertaking, one that somehow worked. For years and years. Amidst all those endlessly traversing ships and bobbing cranes, commerce flourished. What didn’t pan out nearly so well was all the required documentation. Millions of people had to type and retype information, shipment by endless shipment. β€œConsider what used to happen when a store orders patio furniture from a factory overseas,” says Roberts. β€œGetting all those chairs from a foreign port to an American loading dock might involve six different companies. Each one would send a physical bill. This required someone to open six envelopes and check six invoices against what was promised before cutting six different checks.” Thanks to AI that’s no longer required. From Paper Trails to Artificial Intelligence Today, smart machines working faster than any human could possibly keep up review all the documentation and check each item against the expected cost. For instance, if $100 was the agreed upon rate for a trucking run and the invoice lists that same figure, the system automatically releases funds, greasing the skids of commerce. As a result, vendors receive payment faster without all the laborious human intervention. Simona Filip Racek, CEO of Just Down The Street and a member of the Senior Expert Advisory Group of the Verifiable.Trade Foundation, sees that speed as only part of the picture. β€œIt’s making trade faster for the companies already inside the system; the real question is who else gets in. Presently, trade remains fragmented across players and digital platforms. Without trust and interoperability, AI risks automating that fragmentation. The work ahead is to ensure the digitalization of trade makes global commerce cheaper, faster, and simpler for small businesses too, because if it does not, we have missed its greatest opportunity.” When AI Becomes the Border Inspector On the surface, this all sounds like robots de-cluttering people’s work lives, enhancing productivity in a positive-sum manner. But that’s not the full story. To appreciate why, we need to revisit America’s changing stance towards international shipping. The federal government is keen to use AI too, but for something different: a crackdown on illicit importation. Just last month, CBP put importers on notice. According to the Fresh Produce Association of the Americas, the CBP is β€œreminding the trade community that, in response to the β€˜Strengthening Customs Enforcement’ executive order, Importer of Record (IOR) numbers in the Automated Commercial Environment (ACE) that have not been used to file an entry for one year or more and have no outstanding post-entry transactions may be deactivated.” The New Crackdown on Forced Labor At present, forced labor ranks among CBP’s chief concerns and resides squarely in AI’s crosshairs. Consider cotton production. It involves many moving parts, from picking it to spinning it into thread to weaving into fabric to be sewn into pants and socks, all the while traveling through a tangle of vendors in disparate nations. How could anyone possibly know if forced labor from Uyghurs was involved? A human might not be able to put all those puzzle pieces together. Increasingly, AI can. Recently, CBP awarded supply chain AI firm Exiger a multimillion-dollar contract to detect illicit transshipment at scale. β€œBillions of dollars worth of global trade move through illegal transshipment channels that seek to bypass U.S. restrictions … Exiger is proud to support this mission, bringing to bear the world’s largest proprietary supply chain database and the market’s most sophisticated AI,” per the company site. Roberts is careful to note artificially intelligent algorithms like the type deployed by Exiger are not infallible. Instead, they often deliver scores reflecting whether or not a shipment is "more likely or not likely to be tainted.” That’s enough for U.S. Customs to drop the hammer. A suspicious score can result in inquiries, detained cargo, fines, or more punitive measures. Zooming out, forced labor might appear to be a surprising trade policy concern. On further inspection, a rational explanation comes into focus. β€œIt is the one trade issue everyone in Washington agrees on,” says Roberts. β€œLabor unions hate competing with unpaid workers. So do American manufacturers, and human rights advocates need no convincing at all.” With all these stakeholders aligned against the practice for their own unique reasons, it makes sense that the federal government would wield AI as a counterforce to stop it. An AI Arms Race at the Border But there’s one more element to this story, and it, too, involves AI. All those underhanded importers also view AI as their own helpful tool. Even as AI speeds up cargo processing and stymies malfeasance, it’s helping criminals game the system. Rerouting is one way criminals leverage such technology. Similarly, fraudsters use AI to forge bills of lading and simulate shipping patterns to obscure a product’s true origin. As AI increases its capacity, we can expect the current cat-and-mouse game to grow ever more complex. β€œAI could soon fabricate the evidence itself,” Roberts suggests. β€œPicture a fake network of suppliers, complete with a convincing paper trail, designed to fool the government's tracing software into believing goods came from somewhere they never touched.” Going forward, it’s reasonable to expect artificial intelligence will not only continue to expedite international commerce, but it will also serve in a protective capacity. What used to take humans so much time to produce, check, or defend will happen in seconds, reshaping the economy and, really, life as we know it, one AI-processed shipment at a time.
00:00

Skillfully Adding AI To The HHS Pledge On Advancing Best Practices For National Mental Health Care

A new U.S. health department pledge to raise mental health care standards says nothing about AI, and the author argues that's a gap. HHS released the pledge in late July with six principles β€” timely access, evidence-based care, measurement, patient-centered support β€” and signed on industry leaders, but the column is mostly the author mapping how AI fits each one. His points: generic chatbots like ChatGPT aren't therapists and can give bad advice, states are passing their own AI mental health laws while no federal law exists, and specialized therapy AI is still in development. It's an opinion piece, not a new finding.

Notes

Skillfully Adding AI To The HHS Pledge (Forbes, 2026-08-12)

Forbes column (AI ethics/mental health series) analyzing the HHS behavioral-health pledge released July 29, 2026; author is a regular Forbes AI columnist who appeared on CBS's 60 Minutes on AI therapy issues. The pledge itself says nothing about AI; the column adds AI to each principle.

The pledge's six principles (HHS Secretary Robert F. Kennedy, Jr. met signees β€” national healthcare leaders, medical associations, behavioral care providers β€” goal: "raise the standard of care throughout the nation"):

  • Timely access to high-quality mental health and addiction treatment
  • Evidence-based assessment, diagnosis, treatment, referral, recovery support
  • Measurement of quality, outcomes, accountability, continuous improvement
  • Patient-centered, recovery-focused care supporting long-term wellness
  • Clinical expertise and individualized treatment based on patient needs and best available evidence
  • Whole-person care including other chronic diseases

AI mapping per principle:

  • #1 Timely access: AI provides 24/7 engagement, screening, triage, navigation, psychoeducation; flags urgent cases; extends clinician capacity via documentation and between-visit support. Main debate: whether AI is only capable of low-intensity support; author warns against users assuming AI is on par with human therapy.
  • #2 Evidence-based: AI synthesizes patient histories, screening instruments, clinical notes; suggests interventions, flags contraindications, recommends referrals. Author's rule: "AI should not become the thinker and instead should be the doer" β€” overreliance equally unwelcome.
  • #3 Measurement: AI auto-collects patient-reported outcomes, symptom trajectories, engagement, adherence, adverse events; detects deterioration earlier, identifies what works for whom. Suggests mining major-LLM interaction databases to gauge national mental health trends β€” notes "Big Brother concerns."
  • #4 Patient-centered: Rebuts claim that only humans can be patient-centered β€” human therapists are overwhelmed; AI retrieves goals, preferences, history, coping strategies; shifts care from episodic encounters to ongoing relationship.
  • #5 Individualized treatment: Human treatment plans are often templates; AI synthesizes research, guidelines, patient history, prior responses, risk factors; scalable to millions; amplifies (not replaces) clinician expertise.
  • #6 Whole-person: AI integrates mental health, chronic disease, meds, substance use, sleep, social determinants; coordinates across primary care, psychiatrists, therapists, specialists.

Context and caveats:

  • ChatGPT alone has 1 billion+ weekly active users, many consulting it on mental health; top-ranked LLM use case.
  • Generic LLMs (ChatGPT, GPT-5, Claude, Gemini, Grok, Copilot) called GPAI, unlike human therapists; specialized purpose-built AI (PBAI) still in development/testing.
  • Lawsuits filed against OpenAI over allegedly unsafe AI mental-health advice.
  • State AI laws passed in Illinois, Nevada, Utah, California, Vermont, Maine and others; no federal AI law β€” author predicts federal/state conflict would create a "tsunami of legal cases."
  • Author proposes a 7-step AI-law-making process to avoid "AI-law legal debt" β€” laws that look clean but contain hidden legal hitches; predicts AI makers will fight them "tooth-and-nail."
  • Overall framing: AI is dual-use; can boost or sink all six principles. Closing: "It is not in the stars to hold our destiny but in ourselves" (Shakespeare) β€” society decides whether AI helps or harms.
Full text · 14,718 chars
In today’s column, I examine the recently announced national pledge by the U.S. Department of Health and Human Services (HHS) on advancing behavioral health quality and best practices in our nation’s mental health care. The pledge was signed by various national healthcare leaders, mental health experts, medical associations, behavioral care providers, and others who sought to signify their explicit support for the precepts embodied in the pledge. My focus is on adding AI to that pledge. You see, the pledge doesn’t mention anything at all about AI, but in my view, the role of AI in advancing behavioral health quality and best practices is essential and inevitable. As such, I provide an augmented version of the principles embodied in the pledge, doing so to directly illuminate how AI is going to be a central element in improving mental health care. There is no doubt that AI has a huge impact when it comes to mental health care, and we must acknowledge and seek to prudently manage the role of AI for the betterment of societal and individual mental health. Let’s talk about it. This analysis of AI breakthroughs is part of my ongoing Forbes column coverage of the latest in AI, including identifying and explaining key AI complexities (see the link here). AI And Mental Well-Being As a quick background, I’ve been extensively covering and analyzing a myriad of facets regarding the advent of modern-era AI that produces mental health advice and performs AI-driven therapy. This rising use of AI has principally been spurred by the evolving advances and widespread adoption of generative AI. For an extensive listing of my well over one hundred analyses and postings, see the link here and the link here. There is little doubt that this is a rapidly developing field and that there are tremendous upsides to be had, but at the same time, regrettably, hidden risks and outright gotchas come into these endeavors, too. I frequently speak up about these pressing matters, including in an appearance on an episode of CBS’s 60 Minutes; see the link here. AI is being used widely for mental health purposes by individuals on an ad hoc basis, typically via everyday use of generative AI and large language models (LLMs). In addition, AI is being used by mental health professionals as a psychotherapeutic tool with their clients. I refer to this as an evolving transition from the classic dyad of therapist-client to becoming a new triad of therapist-AI-client; see my in-depth discussion at the link here. AI is a dual-use proposition, meaning that AI can be of great benefit to mental health and can also be lamentably detrimental to mental health. Crucial trade-offs must be considered and suitably balanced. AI Providing Mental Health Guidance Millions upon millions of people are using generative AI as their ad hoc mental health advisor (note that ChatGPT alone has over 1 billion weekly active users, a notable proportion of whom dip into mental health aspects; see my analysis at the link here). The overarching top-ranked use of contemporary generative AI and LLMs is to consult with the AI on mental health facets; see my coverage at the link here. This popular usage makes abundant sense. You can access most of the major LLMs for nearly free or at a super low cost, doing so anywhere and at any time. Thus, if you have any mental health qualms that you want to chat about, all you need to do is log in to AI and proceed forthwith on a 24/7 basis. There are significant worries that AI can readily go off the rails or otherwise dispense unsuitable or even egregiously inappropriate mental health advice. Banner headlines continue to announce lawsuits filed against AI makers such as OpenAI for their alleged lack of robust AI safeguards when it comes to AI-generated cognitive advisement. Today’s generic LLMs, such as ChatGPT, GPT-5, Claude, Gemini, Grok, Copilot, and others (all known as general-purpose AI or GPAI), are not at all akin to the robust capabilities of human therapists. Meanwhile, specialized LLMs are being built to attain similar qualities (known as purpose-built AI or PBAI), but they are still primarily in the development and testing stages. See my extensive assessment at the link here. Various State Laws On AI Mental Health A beehive of activity is underway to craft new AI laws to rein in the AI-powered mental health advisement bonanza. See my comprehensive overview of state-level AI mental health laws at the link here. This is a matter weighing heavily on the public’s mind and currently is positioned in the hands of state legislators. Some believe that AI and AI makers are being allowed to run amok. New AI laws are vitally needed to protect society from this onslaught of ubiquitous AI that purportedly offers mental health guidance. I have been meticulously reviewing the state-level AI laws that pertain to mental health, including my review of AI laws passed by specific states such as Illinois see the link here, Nevada see the link here, Utah see the link here, California see the link here, Vermont see the link here, Maine see the link here, and many other U.S. states newly passed AI laws. Those laws are scoped to prevail within their respective state boundaries. In that sense, these laws are applicable to AI usage within the particular state and do not directly bear on other states. Congress has repeatedly waded into establishing an overarching federal law that would encompass AI. So far, no dice. The efforts have ultimately faded from view. Thus, at this time, there isn’t an overarching federal law devoted to these controversial AI matters. The big question will be to what degree a sweeping federal law would impact the numerous state-level AI laws. The odds are that many of the state-level laws would run afoul of a federal mandate, and a tsunami of legal cases would arise as a tussle between federal law and state law is undertaken. It surely will be a legal mess. Readers might recall that I proposed a 7-step AI-law-making process that I believe could substantively help regulators to devise new AI laws that are on target and balanced; see my depiction at the link here. This has the added benefit of reducing what I refer to as AI-law legal debt. This refers to AI laws that, though they look pristine, contain hidden legal debt that must ultimately be paid. Legal glitches and law-based hitches are embedded into these new laws. My prediction is that AI makers will legally fight these AI laws on a tooth-and-nail basis, potentially successfully prevailing due to these laws being hastily written and passed without sufficient double-checking. The New Pledge Released By HHS On July 29, 2026, the U.S. Department of Health and Human Services released a pledge statement and met with various mental health industry notables to get signed support for the pledge. HHS Secretary Robert F. Kennedy, Jr., met with the various signees and emphasized that the goal of the pledge is to raise the standard of care throughout the nation and ensure that every patient can heal and thrive. The pledge consists of these six principles: - (1) Timely access to high-quality mental health and addiction treatment. - (2) Evidence-based assessment, diagnosis, treatment, referral, and recovery support. - (3) Measurement of quality, outcomes, accountability, and continuous improvement. - (4) Patient-centered, recovery-focused care that supports long-term wellness. - (5) Clinical expertise and individualized treatment decisions based on patient needs and the best available evidence. - (6) Whole-person care is delivered, including addressing other chronic diseases. AI for mental health dovetails into each one of those six principles. Let’s go ahead and briefly explore each principle and see how AI can be essential to attaining that principle. #1: Timely Access To High-Quality Mental Health Care Timely access to mental health guidance is perhaps the most often touted basis for why AI ought to have a significant role in this realm. AI can provide 24/7 engagement, screening, triage, navigation, psychoeducation, and overall mental health support. In addition, AI can help identify people who need urgent or specialized care and connect them with appropriate human services. AI can also extend scarce clinician capacity through documentation, care coordination, and between-visit support. The main debate about timely access and AI is primarily concerned with whether AI can provide high-quality mental health care. Some insist that AI is only capable of low-intensity support and should not attempt to lean beyond its skis. Until AI is in the high-quality arena, sufficient control should be devised to keep humans from falling into a mental trap of assuming that AI is on par with human-provided therapy. #2: Evidence-Based Mental Health Care I’ve been repeatedly showcasing how AI can be instrumental to advancing evidence-based mental health care; see the link here and the link here, for example. AI can help clinicians synthesize patient histories, screening instruments, clinical notes, and other information; identify potentially relevant diagnostic considerations; suggest evidence-based interventions; flag contraindications or missing information; and recommend appropriate referrals. It can also continuously provide evidence-based behavioral interventions and recovery support, while keeping the clinician responsible for diagnosis and treatment decisions. Researchers and practitioners who avoid using AI are missing out on the immense leverage that AI can provide when seeking to achieve heightened evidence-based precepts. In that same breath, please realize that AI should not become the thinker and instead should be the doer. An overreliance on AI for evidence-based mental health care is equally unwelcome. #3: Measurement Of Mental Health Care There is an old saying that you cannot properly manage something that you aren’t suitably measuring. That adage can readily apply to the management of our national mental health care efforts. There needs to be practical and sensible measurements of quality, outcomes, accountability, and a quantified means of striving for continuous improvement. AI can make mental health care much more measurable. It can automatically collect and analyze patient-reported outcomes, symptom trajectories, engagement, treatment adherence, functional outcomes, and adverse events. AI can identify patterns across large populations, detect deterioration earlier, evaluate which interventions are working for whom, and generate feedback for clinicians and health systems. I’ve also noted that we could use the major LLMs as a potential source for gauging national mental health status and trends, namely by tapping into the vast database of user interactions, though this raises possible Big Brother concerns; see my assessment at the link here. #4: Patient-Centered Mental Health Care There are rather contentious viewpoints about AI and the topic of being patient-centered. Some believe that only human therapists can be patient-centered. This is presumably a human-to-human consideration. No AI can be as patient-centered. At first glance, that might seem logical. The thing is that human therapists are not perfect, and they are often overwhelmed with the volume of clients they provide care to. The therapists might aim to be patient-centered, but distractions and paying attention to specific details can be sacrificed because of an excessive workload. AI can provide highly personalized, continuous support. It can retrieve an individual’s goals, preferences, treatment history, coping strategies, and progress; adapt educational and behavioral support accordingly; and help people monitor their own recovery. This potentially changes mental health care from episodic encounters to an ongoing relationship centered on the person's goals and wellness. #5: Individualized Treatment In Mental Health Care Tapping again into the general fact that human therapists tend to be overwhelmed due to volume and that this makes things difficult when it comes to treating clients on a personalized basis, the same consideration applies to interest in individualized treatment. Sure, a therapist creates an individual treatment plan, but this is at times a template that is not as deeply individualized as might be preferred. AI can produce, maintain, and upkeep individualized treatment plans in significant ways; see my analysis at the link here. AI can bring together all sorts of disparate data and readily assimilate that into individualized treatment. AI is highly scalable. Thus, this can be done for thousands, hundreds of thousands, and millions of people. AI can rapidly synthesize research on psychology and mental health, clinical guidelines, patient history, prior treatment responses, and relevant risk factors to then devise individualized options. AI can work hand-in-hand with therapists. Rather than replacing expertise, AI can potentially amplify the expertise of a clinician, particularly when clinicians are confronted with complex or uncommon cases. #6: Whole-Person Oriented Mental Health Care An ongoing challenge of mental health care is the aim to provide whole-person oriented care. A person might seek mental health care, but their physical health is not given due consideration as a synergistic or holistic perspective on the care that they need. AI can help break down the fragmentation between mental and physical health. It can integrate information about mental health, chronic disease, medications, substance use, sleep, social determinants, lifestyle, and other factors to identify interactions and unmet needs. AI can also coordinate information among primary-care physicians, psychiatrists, therapists, specialists, and other providers, helping produce a more comprehensive picture of the individual. The World We Are In Those are the mainstay upbeat aspects of why AI needs to be included as an integral element of the pledge and its six principles. I mainly covered the upsides. We must also be on alert for the potential downsides. If AI is poorly utilized or allowed to be used in undermining ways, there is a strong chance of AI usurping the efforts to attain those six principles. In that sense, AI can be a tremendous booster but can also be an undesirable detractor that will sink the six principles. A final thought for now. William Shakespeare famously made this remark: β€œIt is not in the stars to hold our destiny but in ourselves.” The question of whether AI is going to be beneficial to mental health or be harmful to mental health is up to us as a society to determine. Let’s not allow random fate to decide. Destiny on this weighty aspect is in human hands.
00:00

C-Suite Unscripted: CIO Edition

Forbes is promoting a new 'C-Suite Unscripted: CIO Edition' video series, hosted by Maggie McGrath, in which top tech executives discuss how they lead and scale AI-native cultures. The item contains only the promo blurb and no actual episode content, so this is summarized from the title and description alone.

Full text · 426 chars
C-Suite Unscripted: CIO Edition is your backstage pass to the boardrooms of the world’s most influential companies. Join Forbes’ Maggie McGrath as she deconstructs the playbooks of prolific leaders and founders. From navigating market volatility to scaling AI-native cultures, C-Suite Unscripted: CIO Edition goes beyond the talking points to reveal how the world’s top tech executives build, lead and stay ahead of the curve.
00:00

5 ChatGPT Prompts To Turn Your Skills Into A $2,000 A Month Side Hustle

A Forbes column hands readers five ChatGPT prompts meant to turn existing job skills into a $2,000-a-month side income within 30 days. It breaks the target into about $66 a day and coaches pricing for the buyer's perceived value, selling outcomes instead of tasks, reselling the 'human layer' on top of tools, and pitching warm contacts first. Each prompt is copy-paste boilerplate that asks ChatGPT to rank routes, describe a dream buyer and draft outreach messages. Largely motivational listicle content rather than a distinct news event.

Notes
  • Source: Forbes (scrape), "5 ChatGPT Prompts To Turn Your Skills Into A $2,000 A Month Side Hustle", published 2026-08-12.
  • Frame: Break $2,000/mo into $66/day ($2,000 Γ· 30). The article argues existing job skills are the asset; sell those rather than learning new ones. Working premise: "The first $2,000 is the hardest. Once you are there, you can build." Claims 30-day transformation and advises keeping one ChatGPT chat window open so context carries across all five prompts.

The five prompts (verbatim usage, in order):

  • Route-finding β€” "Based on what you know about me, my work and the skills I have, give me 3 routes to $2,000 a month using only what I already know how to do. For each route, tell me who the buyer is, what I would sell them, what I would charge, and how many sales a month I need. Rank them by how quickly I could get the first payment into my account. Ask for more detail if required." Also split $2,000 into "one sale of one digital product... or one hour of consulting, or two $1,000 customers on a small monthly retainer."
  • Pricing β€” Explicitly rejects copying competitors: "Their prices come from their costs, their clients and their confidence, none of which are yours." Prompt asks ChatGPT to describe the "dream buyer" (what they already spend on, what problem costs them monthly), then "Set my price based on the value of the result to them. Give me three price points with what each one includes, and what I would need to be able to say for the highest price to be an easy yes."
  • Result-focused offer β€” Core claim: "Website copywriting is a task. A conversion rate that doubles is an outcome. Sell the second one." Prompt: rewrite offer to sell result not work β€” headline, promise, "the three things that change for them," proof, and a one-sentence answer to "what do you do."
  • "Human layer on top of the tool" β€” Position as the interpreter/decision-maker, not the software operator: "Founders do not want a login. They want the answer, the interpretation and the decision." Service framing: deliver output + interpretation + recommendation to "a busy founder who has no time."
  • Warm-market sales β€” "Cold audiences take months. Warm ones take days." Prompt: list "the 10 types of people I already know who could buy this," write per-person message in your voice that states price and asks for a yes or no ("Make it easy for them to say no"), plus a follow-up for non-responders.

Caveats/limitations (none stated by the source):

  • No numbers, benchmarks, or success evidence; the $2,000 and $66 figures are arithmetic only.
  • No pricing data, no mention of market rates, delivery logistics, refunds, or sales platforms.
  • The "ask your buyer" pricing step never explains how to actually reach that buyer pre-offer.
  • Prompt 5 assumes a pre-existing warm network of ~10 potential buyers β€” not universally available.
  • Outcome claims ("transform your situation within 30 days") are unverified promises, not results.
Full text · 5,289 chars
Two thousand dollars a month is closer than you think. You already have skills people pay real money for, and they sit inside your job doing nothing extra for you. You have thought about selling them for years, then talked yourself out of it because somebody somewhere does it cheaper. What if the only number standing between you and a substantial second income is $66 a day? Turn what you already know into $2,000 a month with ChatGPT. Start where you are, use what you have, transform your situation within 30 days. Copy and paste into ChatGPT and keep the same chat window open so the context carries through. How ChatGPT Turns The Skills You Have Into $2,000 A Month Break The Number Into Something You Can Hit Two thousand dollars a month sounds like a mountain until you divide it. It comes out at around $66 a day. That is one sale of one of the digital products you could put together this weekend, or one hour of consulting, or two $1,000 customers on a small monthly retainer. Calculated like that, the number is no longer intimidating. Work out the three routes that get you there with what you know today, then pick the one you can start this week. The first $2,000 is the hardest one. Once you are there, you can build. "Based on what you know about me, my work and the skills I have, give me 3 routes to $2,000 a month using only what I already know how to do. For each route, tell me who the buyer is, what I would sell them, what I would charge, and how many sales a month I need. Rank them by how quickly I could get the first payment into my account. Ask for more detail if required." Charge What Your Buyer Will Pay If you are about to look at what other people charge and copy them, stop. It makes no difference. Their prices come from their costs, their clients and their confidence, none of which are yours. The only number that counts is the one your dream buyer will happily pay for the result you give them. Ask that person. Then price for them. "Take the route you ranked first. Describe my dream buyer in detail, including what they already spend money on, what they are trying to fix, and what that problem costs them every month it remains unfixed. Set my price based on the value of the result to them. Give me three price points with what each one includes, and what I would need to be able to say for the highest price to be an easy yes. Ask for more detail if required." Describe The Result They Are Buying You buy to solve a problem or to reach an outcome, and so does everybody else. Website copywriting is a task. A conversion rate that doubles is an outcome. Sell the second one. The fastest way to monetize talents you already have is to describe what changes for the buyer, in their words, with the number attached. Do that, and the price argument disappears. "Rewrite my offer so it describes the result the buyer gets instead of the work I do. Give me the headline, the promise, the three things that change for them, and the proof I would need to make each one believable. Then give me the one sentence I say when somebody asks what I do, in language my dream buyer uses about their own problem. Ask for more detail if required." Become The Human Layer On Top Of The Tool The skill you undervalue most is using the tools well and telling somebody what the output means. Founders do not want a login. They want the answer, the interpretation and the decision. Do the work with the software, then hand over the thinking that sits on top of it. You save them a week of messing around and you pass some of the saving on. That is a service you can sell tomorrow. "Design me a service where I do the work using tools and deliver the output, the interpretation, and the recommendation to a busy founder who has no time to do it themselves. Base it on the skills and route we chose earlier. Tell me what I deliver, how long it takes me, what it saves them, what I charge, and how I describe it so it sounds like expertise. Ask for more detail if required." Sell To People Who Already Want It Your first customer is somebody who already knows you. They have watched you do this for years and they have asked you questions about it for free. Go to those people first, tell them exactly what you are selling and what it costs, and ask for a decision. Cold audiences take months. Warm ones take days. Ten people who already trust you can get you to $2,000 this month. "Based on everything in this chat, describe the 10 types of people I already know who could buy this. For each one, write the message I send them, in my voice, that says what I am selling, what it does for them, what it costs, and asks for a yes or a no. Make it easy for them to say no. Then give me a follow up message for the ones who go quiet. Ask for more detail if required." Make Your First $2,000 A Month From What You Already Know Nobody is coming to give you permission to charge for what you know. Divide the number until it is small. Price for the buyer who wants it. Describe the result they are buying. Become the human layer on top of the tool. Sell to the people who already trust you. You do not need a new skill, a new degree or a new idea. You need one buyer, one price and one message sent today. The first $2,000 is the hardest, and you are closer to it than you think.

Discussion

8
00:28

Anthropic, OpenAI, Google, Meta, Microsoft, and Mistral all signed the EU Code of Practice on Transparency of AI-Generated Content

Big AI labs agreed to watermark their AI-generated text and code under a new EU transparency code. Anthropic, OpenAI, Google, Meta, Microsoft, and Mistral all signed the EU Code of Practice on Transparency of AI-Generated Content. The catch: watermarking applies even to their open-source local models because it's required by law. That could make watermarked output hard to avoid for anyone running local models from these companies.

Full text · 163 chars
Even open source local models from these companies will be watermarking code and text since it's required by law. submitted by /u/Bestlife73 [link] [comments]
10:59

Hidden Reasoning from Claude and GPT are Decoded, and it is interesting

Researchers published a paper showing a flaw that lets attackers extract the full hidden reasoning traces from all Claude and GPT models through their APIs, with example traces posted publicly. The leaked reasoning suggests Claude recognizes AIME benchmark questions by heart and already knows the answers, so its headline scores over open-source models may be overstated. The examples also show frontier models emit strange internal tokens and overthink almost all the time, meaning odd open-source reasoning is not evidence of being behind. Commenters speculate China relied on this same loophole to distill frontier models and that closing it will slow that distillation.

Full text · 1,161 chars
Yesteday a paper showed a gap that allows to see 100% of the reasoning tokens form ALL Claude and GPT models Stealing Reasoning Traces from Proprietary LLM APIs . check it out, they have published lots of example reasonings. this is very relevant for open soruce; for the following reason - there is hint for benchmaxing; given a question form the benchmark AIME, Claude reasoning showed it KNOWS IT by heart and knows the answer; so yeah the plots we see for their performance beating the open source models -> could be overstated. - when you are using the open source model and you see your model reasoning strangly; like strange words that does not make sense or OVERTHINKING. turns out this is very normal and even frontier models do it almost all the time. - people now talk that this gap was used the whole time by China to distill frontier models and now that this gap is closed the distillation will be slowed down. let's see so yeah, i believe open source is not soo far behind as it seems from the reasoning tokens, there is not secret sauce, it is just data, compute and engineering submitted by /u/Zealousideal_Sort74 [link] [comments]
15:04

Qwen3.8-2.4T-A95B Released

Qwen released the flagship of its new 3.8 generation: a 2.4-trillion-parameter model where only 95 billion parameters are active per request. It's a mixture-of-experts design, so just part of the network runs for each prompt, keeping it usable on large multi-GPU setups. The post is a bare announcement in the local-models forum, so the numbers come from the title alone.

Full text · 42 chars
submitted by /u/de4dee [link] [comments]
05:42

RTX 6000 PRO price raised to $16,000 USD on the Nvidia website

Nvidia raised the price of its RTX 6000 PRO workstation GPU to $16,000 on its own website. The post has no further detail, so this is just a price-hike notice. A $16,000 price tag puts the card firmly in enterprise/prosumer territory rather than consumer.

Full text · 51 chars
submitted by /u/Norwood_Reaper_ [link] [comments]
13:34

NVIDIA's Fastest Blackwell GPU, the 96 GB RTX PRO 6000, Now Costs $16,000, Almost Double Its Original Price

NVIDIA's fastest Blackwell workstation GPU, the 96 GB RTX PRO 6000, now lists at $16,000, roughly double its original price. The Reddit post carries no commentary beyond the headline, so the summary comes from the title alone. The hike matters most to people building high-VRAM machines for running local AI models.

Full text · 42 chars
submitted by /u/ab2377 [link] [comments]
13:58

Exact Qwen 3.8 27b release date and time

Qwen 3.8's 27-billion-parameter model had a ModelScope page listing a specific release date and time, but the page was taken down, so the exact launch timing is now uncertain. A community member posted the source link and then flagged that Alibaba removed it. The 27B is the small sibling of the 2.4-trillion-parameter Qwen 3.8 flagship.

Full text · 306 chars
Since it seems like there is some confusion in other threads... Source: https://modelscope.cn/models/Qwen/Qwen3.8-27B EDIT: They took the page down, idk why they did that. I'm slammed at work so haven't had time to look into it more, def a bummer though. submitted by /u/yuicebox [link] [comments]
07:45

It's the final countdown, baby! Qwen is out in just over 7 hours!

Qwen is dropping a new release in about seven hours, and fans are counting down. This is purely a hype post from a Reddit user with no details on what the model is or what it does. Worth watching the actual announcement, but there's no substance here yet.

Full text · 133 chars
Historic event! We're ready! Google Translate, on the other hand, is not ready! submitted by /u/LegacyRemaster [link] [comments]
16:54

Today is Models Day

A forum post in the local-models community announces 'Models Day,' hinting that several new AI models release today, but the post itself has no details. It reads as a heads-up thread for people who run models on their own hardware. Nothing specific is named, so there's nothing concrete to report.

Full text · 41 chars
submitted by /u/Fz1zz [link] [comments]