AI 资讯
Making a fleet of self-hosted LLM agents trustworthy
Originally published at llmkube.com/blog/making-self-hosted-llm-agents-trustworthy . Cross-posted here for the dev.to audience. Running a single local LLM node is a solved problem. You write an InferenceService, the operator schedules it, llama.cpp or MLX serves it, and you get an OpenAI-compatible endpoint. We have been doing that for months. Running a fleet of them is where it stops being easy. My fleet is heterogeneous on purpose: CUDA pods in the cluster, and Apple Silicon Macs sitting off-cluster on the homelab network, each one running two separate agents (one for inference, one for the agentic coding harness). The day I shipped 0.8.4 to that fleet, I learned exactly how it does not scale. I updated each Mac by hand. The control plane had no idea what version any agent was running. And the launchd reload I used to restart an agent was a silent no-op on an already-loaded service, so the old binary kept running while I believed I had updated it. I found that out by hand-inspecting a process tree. Three machines made it annoying. Thirty would make it impossible, and the whole pitch for sovereign, on-prem AI is that you run a lot more than three. So the last stretch of work on LLMKube was not about a faster runtime or a bigger model. It was about making the fleet trustworthy : able to update itself safely, and unable to lie to the control plane about its own state. Here is what that took. Helm and brew for the edge The fix is a new cluster-scoped CRD, AgentRelease , and a self-update path in the agents themselves. You describe the release you want once, the operator rolls it out, and the agents pull and apply it. The design borrows directly from prior art that already solved this for Kubernetes nodes: Rancher's system-upgrade-controller, k0s autopilot's per-platform SHA-256 staging, and Teleport's outbound-only poll model. The properties that make it safe to leave running: Declarative and approved. An AgentRelease names the agent, the version, and the per-platform
AI 资讯
Why I Built a New Memory Plugin for Hermes Agent
Hermes Agent already has memory, and that matters. It keeps local context, it improves over time, and it works without forcing you into a cloud service. It also supports several external memory providers. I still built hermes-mempalace , because none of the existing options fit my setup quite right. I wanted something: local-first isolated by Hermes profile verbatim, not just extracted facts easy to inspect on disk simple enough to trust over time That last part is the important one. I did not want a memory layer that turns conversations into an opaque pile of embeddings or summaries you cannot really audit. I wanted actual transcripts, mined into a readable structure, with no hidden server in the middle. Why the existing options were not enough Hermes already gives you a few paths: built-in memory and session context external providers for different use cases enough flexibility to adapt, if you are willing to bend your workflow around them And to be clear, some of those options are good. But ... I run Hermes on a headless machine at home. And I use separate profiles for different contexts. And I do not want conversation content depending on a cloud API or a separate service unless there is a very good reason. So, the best fit had to check a few boxes: [x] no API key [x] no external server [x] no extra runtime I did not already want/install [x] storage isolated by HERMES_HOME [x] memory we can actually read later That let to MemPalace , or https://mempalaceofficial.com/ (hopefully, that's the right one!) What hermes-mempalace does hermes-mempalace wires MemPalace into the Hermes memory provider interface. It follows the same lifecycle as the rest of Hermes memory providers: system_prompt_block() adds a short memory reminder to the prompt. prefetch() can run a MemPalace search before the first model call. sync_turn() buffers completed turns without slowing the chat loop. on_session_end() writes buffered turns to markdown and mines them into the palace. shutdown() flu
开源项目
🔥 leptos-rs / leptos - Build fast web applications with Rust.
GitHub热门项目 | Build fast web applications with Rust. | Stars: 20,899 | 6 stars today | 语言: Rust
开源项目
🔥 fabro-sh / fabro - ⚒️ The open source dark software factory for expert engineer
GitHub热门项目 | ⚒️ The open source dark software factory for expert engineers. | Stars: 1,189 | 54 stars today | 语言: Rust
开源项目
🔥 sindresorhus / type-fest - A collection of essential TypeScript types
GitHub热门项目 | A collection of essential TypeScript types | Stars: 17,197 | 4 stars today | 语言: TypeScript
开源项目
🔥 hydralauncher / hydra - Hydra Launcher is an open-source gaming platform created to
GitHub热门项目 | Hydra Launcher is an open-source gaming platform created to be the single tool that you need | Stars: 15,930 | 32 stars today | 语言: TypeScript
开源项目
🔥 ghostfolio / ghostfolio - Open Source Wealth Management Software. Angular + NestJS + P
GitHub热门项目 | Open Source Wealth Management Software. Angular + NestJS + Prisma + Nx + TypeScript 🤍 | Stars: 8,698 | 21 stars today | 语言: TypeScript
开源项目
🔥 puppeteer / puppeteer - JavaScript API for Chrome and Firefox
GitHub热门项目 | JavaScript API for Chrome and Firefox | Stars: 94,572 | 13 stars today | 语言: TypeScript
开源项目
🔥 gorhill / uBlock - uBlock Origin - An efficient blocker for Chromium and Firefo
GitHub热门项目 | uBlock Origin - An efficient blocker for Chromium and Firefox. Fast and lean. | Stars: 65,471 | 32 stars today | 语言: JavaScript
开源项目
🔥 technomancer702 / nodecast-tv - A self-hosted web application that lets you stream Live TV,
GitHub热门项目 | A self-hosted web application that lets you stream Live TV, Movies, and Series from your Xtream Codes or M3U provider directly in your browser. It's built with performance in mind and handles large libraries smoothly. | Stars: 1,333 | 49 stars today | 语言: JavaScript
开源项目
🔥 sigalor / whatsapp-web-reveng - Reverse engineering WhatsApp Web.
GitHub热门项目 | Reverse engineering WhatsApp Web. | Stars: 6,475 | 22 stars today | 语言: JavaScript
开源项目
🔥 home-assistant / core - 🏡 Open source home automation that puts local control and pr
GitHub热门项目 | 🏡 Open source home automation that puts local control and privacy first. | Stars: 87,712 | 32 stars today | 语言: Python
开源项目
🔥 skypilot-org / skypilot - Run, manage, and scale AI workloads on any AI infrastructure
GitHub热门项目 | Run, manage, and scale AI workloads on any AI infrastructure. Use one system to access & manage all AI compute (Kubernetes, Slurm, 20+ clouds, on-prem). | Stars: 10,141 | 46 stars today | 语言: Python
开源项目
🔥 openinterpreter / openinterpreter - A lightweight coding agent for open models like Deepseek, Ki
GitHub热门项目 | A lightweight coding agent for open models like Deepseek, Kimi, and Qwen | Stars: 63,947 | 45 stars today | 语言: Python
开源项目
🔥 Introduction-to-Autonomous-Robots / Introduction-to-Autonomous-Robots - Introduction to Autonomous Robots
GitHub热门项目 | Introduction to Autonomous Robots | Stars: 2,478 | 276 stars today | 语言: TeX
开源项目
🔥 GorvGoyl / Clone-Wars - 100+ open-source clones of popular sites like Airbnb, Amazon
GitHub热门项目 | 100+ open-source clones of popular sites like Airbnb, Amazon, Instagram, Netflix, Tiktok, Spotify, Whatsapp, Youtube etc. See source code, demo links, tech stack, github stars. | Stars: 35,103 | 337 stars today | 语言:
开源项目
🔥 meshery / meshery - Meshery, the cloud native manager
GitHub热门项目 | Meshery, the cloud native manager | Stars: 10,299 | 3 stars today | 语言: TypeScript
开源项目
🔥 pytest-dev / pytest - The pytest framework makes it easy to write small tests, yet
GitHub热门项目 | The pytest framework makes it easy to write small tests, yet scales to support complex functional testing | Stars: 13,942 | 8 stars today | 语言: Python
AI 资讯
The Only Productivity Hack That Actually Worked for Me
The Only Productivity Hack That Actually Worked for Me I've tried every website blocker in existence. They all have the same flaw: one click and they're off. That settings toggle might as well not exist when the urge to procrastinate hits. I needed something I couldn't override. So I built the opposite. The Problem Every blocker follows the same pattern: it blocks, you unblock, you procrastinate. The issue isn't discipline — it's that your future self and your present self want different things. And that future self will happily undo anything you set up. What I needed was a system where both selves agreed on the rules upfront and then neither could break them. The Solution kblocker is a Linux kernel module that hooks into netfilter and drops TCP connections to whatever sites I configure. The key feature isn't the blocking — it's how you turn it off. When blocking is enabled, kblocker generates a 128-bit key. With PGP mode, it automatically encrypts that key to people I trust and then erases it from kernel memory. The raw key no longer exists anywhere on my system. To disable the blocker, one of those people has to decrypt it and send it back to me. I outsourced my willpower. When I want to focus, I run: sudo kblockerctl enable 120 Two hours of blocked distractions. If I feel the urge to procrastinate, I can't — I'd have to text a friend, explain why, wait for them to decrypt it, and paste the result. By then the urge is gone. The Result I've gone from losing entire afternoons to YouTube to actually finishing things. The blocker has caught me mid-reflex to type youtube.com more times than I can count. It's free if anyone wants it: github.com/Dan-J-D/kblocker If you keep breaking your own focus tools, this is for you.
开发者
I Built a 4-Sided Plot Area Calculator with 2D & 3D Visualization
I Built a 4-Sided Plot Area Calculator with 2D & 3D Visualization Most online plot calculators only work for simple rectangular plots. However, many real-world properties have four sides with different measurements, making area estimation much more difficult. That's why I built a 4-Sided Plot Area Calculator that allows users to enter the North, South, East, and West dimensions and instantly calculate the approximate plot area. 🔗 https://www.premiumconverters.com/plot-area-calculator Features 📐 Supports irregular 4-sided plots 🏠 Calculates area in Marla, Kanal, Acres, and more 🖼️ Interactive 2D top-down visualization 🏗️ Isometric 3D plot rendering 📏 Feet & inches input support 📱 Mobile-friendly experience Why I Built It In many countries, especially in South Asia, property dimensions are often recorded as side measurements rather than perfect geometric shapes. Existing tools rarely address this use case properly. I wanted to create a simple solution that homeowners, buyers, real estate professionals, and developers could use without needing complex surveying software. The Result The calculator transforms four side lengths into a practical estimate while providing visual feedback that helps users better understand their property's shape. Building tools that solve real-world problems is one of the most rewarding parts of software engineering. Have you ever built a niche tool that unexpectedly helped thousands of users?