Fixing OpenClaw's Blind Spots: Building a Sitemap to Fetch All Anthropic Blogs
A reader noticed that OpenClaw's summary of Anthropic's tech blogs was missing some posts — specifically one from April 8th. The root cause: Anthropic hosts their blogs at multiple distinct URLs, and OpenClaw's browser tool doesn't crawl all of them. The fix involved generating a sitemap by having the agent click every link to build a complete list, then feeding that sitemap into the summarization pipeline. The solution is packaged as a skill for easy reuse, though it does cost extra tokens to generate the sitemap due to the link-clicking process.
Key Takeaway
- Anthropic's blog URLs are not unified — they spread content across different hostnames, making naive scraping incomplete.
- OpenClaw's browser tool for RSS/blog aggregation doesn't auto-discover all pages; it needs a complete URL list upfront.
- Manually generating a sitemap by traversing all links works, but it consumes tokens proportional to the site's size.
This is a pragmatic workaround rather than a deep fix, but it's a useful pattern for any site with fragmented content. If you need reliable coverage of multiple-blog-host setups, pre-seeding with a sitemap is the simplest approach.
📖 Read the full source: r/openclaw
👀 See Also
Contextium: Open-Source Persistent Context Framework for Claude Code
Contextium is a structured git repo framework that provides persistent context for Claude Code sessions, using a CLAUDE.md file as a context router to lazy-load relevant markdown files. The open-source version includes a template with 6 sample apps and 27 integration docs.
JetBrains Introduces Plugin for Modern Go Code with AI Agents Junie and Claude Code
JetBrains has released a plugin for AI agents Junie and Claude Code, enhancing their ability to generate modern Go code by adhering to the latest Go features and best practices.
Open-source local hook automatically switches Claude models to cut AI costs
A developer created a local hook for Cursor and Claude Code that analyzes prompts and automatically selects the appropriate Claude model (Haiku, Sonnet, or Opus) before sending requests. The tool uses keyword rules to classify tasks and block overpaying scenarios, with retroactive analysis showing 50-70% cost reduction.
NaNMesh MCP checks GitHub issues before Claude recommends libraries
NaNMesh MCP is an open-source Model Context Protocol server that crawls GitHub Issues, Stack Overflow, and Reddit for known bugs in development tools. When Claude recommends a library, it can check for real problems before integration.