dM Assistant
π
Convert speech to AI reply audio
Mvemba Dieu Merci
dieumercimvemba
AI & ML interests
None yet
Recent Activity
updated a Space 3 days ago
dieumercimvemba/dmassistant published a Space 3 days ago
dieumercimvemba/dmassistant updated a Space 26 days ago
dieumercimvemba/creaOrganizations
updated a
Space 3 days ago
published a
Space 3 days ago
updated a
Space 26 days ago
published a
Space 26 days ago
published a
bucket 26 days ago
updated a
Space about 1 month ago
published a
Space about 1 month ago
updated a
Space about 1 month ago
liked a
Space about 1 month ago
published a
Space 2 months ago
updated a
Space 4 months ago
published a
Space 4 months ago
updated a
Space 5 months ago
Waouh intereste
reacted to abidlabs's post with π₯ 6 months ago
Post
11218
Why I think local, open-source models will eventually win.
The most useful AI applications are moving toward multi-turn agentic behavior: systems that take hundreds or even thousands of iterative steps to complete a task, e.g. Claude Code, computer-control agents that click, type, and test repeatedly.
In these cases, the power of the model is not how smart it is per token, but in how quickly it can interact with its environment and tools across many steps. In that regime, model quality becomes secondary to latency.
An open-source model that can call tools quickly, check that the right thing was clicked, or verify that a code change actually passes tests can easily outperform a slightly βsmarterβ closed model that has to make remote API calls for every move.
Eventually, the balance tips: it becomes impractical for an agent to rely on remote inference for every micro-action. Just as no one would tolerate a keyboard that required a network request per keystroke, users wonβt accept agent workflows bottlenecked by latency. All devices will ship with local, open-source models that are βgood enoughβ and the expectation will shift toward everything running locally. Itβll happen sooner than most people think.
The most useful AI applications are moving toward multi-turn agentic behavior: systems that take hundreds or even thousands of iterative steps to complete a task, e.g. Claude Code, computer-control agents that click, type, and test repeatedly.
In these cases, the power of the model is not how smart it is per token, but in how quickly it can interact with its environment and tools across many steps. In that regime, model quality becomes secondary to latency.
An open-source model that can call tools quickly, check that the right thing was clicked, or verify that a code change actually passes tests can easily outperform a slightly βsmarterβ closed model that has to make remote API calls for every move.
Eventually, the balance tips: it becomes impractical for an agent to rely on remote inference for every micro-action. Just as no one would tolerate a keyboard that required a network request per keystroke, users wonβt accept agent workflows bottlenecked by latency. All devices will ship with local, open-source models that are βgood enoughβ and the expectation will shift toward everything running locally. Itβll happen sooner than most people think.
- 8 replies
exactlyπ
published a
Space 6 months ago
liked a
Space 6 months ago