142
Dots Demo
💻
Engage in conversational AI to get plans and writing assistance
Durgaram R
Durgaram
AI & ML interests
ai development
Recent Activity
liked
a Space
22 days ago
rednote-hilab/dots-demo
new activity
22 days ago
rednote-hilab/dots.ocr:not supported in Turing GPU Architecture ?
Organizations
None yet
liked
a
Space
22 days ago
reacted to
mitkox's
post with 🚀
22 days ago
Post
2561
We’ve reached a point where on device AI coding that is free, offline, and capable isn’t just a theoretical possibility; it’s sitting on my lap, barely warming my thighs.
My local MacBook Air setup includes a Qwen3 Coder Flash with a 1M context, Cline in a VSCode IDE. No internet, no cloud, no ID verification- this is the forbidden tech.
Current stats:
All agentic tools work great local, sandboxed, and MCP
OK model output precision
17 tokens/sec. Not great, not terrible
65K tokens context, the model can do 1M, but let’s be real, my MacBook Air would probably achieve fusion before hitting that smoothly
Standard backend and cache off for the test
All inference and function calling happen locally, offline, untethered. The cloud didn’t even get a memo.
My local MacBook Air setup includes a Qwen3 Coder Flash with a 1M context, Cline in a VSCode IDE. No internet, no cloud, no ID verification- this is the forbidden tech.
Current stats:
All agentic tools work great local, sandboxed, and MCP
OK model output precision
17 tokens/sec. Not great, not terrible
65K tokens context, the model can do 1M, but let’s be real, my MacBook Air would probably achieve fusion before hitting that smoothly
Standard backend and cache off for the test
All inference and function calling happen locally, offline, untethered. The cloud didn’t even get a memo.
- 3 replies
not supported in Turing GPU Architecture ?
#3 opened 22 days ago
by
Durgaram
published
a
model
22 days ago
liked
a
model
23 days ago
liked
a
model
24 days ago
