Tolan's AI-Enabled Engineering Interview Process

Tolan has redesigned their engineering interview process to reflect how engineers actually work with AI coding agents. Instead of traditional algorithmic questions, they focus on practical skills that matter when AI writes most production code.
The Interview Structure
Candidates spend a morning at their San Francisco office working on a small problem that Tolan has solved themselves. The problem comes from a bare-bones Figma file or short spec, typically representing a simple flow or lightweight feature that would normally take a day or two to build.
Candidates have just a few hours to work on the problem, which isn't enough time to create a polished product. The constraint is intentional—they want to see how candidates work within limitations.
AI Tools Encouraged
Candidates are explicitly encouraged to use AI to solve the problem. Tolan provides licenses for Claude, Codex, Cursor, or Gemini if needed. The key expectation is that candidates must balance LLM-generated code against their own judgment—even if they aren't writing the code, they own the output.
What they're looking for:
- How candidates approach the problem
- How they structure a solution
- How they think through constraints
- How they decide what actually matters
Evaluation Criteria
After the work session, there's a 20–30 minute conversation about what was created. Interviewers ask what candidates would improve if they had more time, what they'd change before sending for review, and what they'd change before shipping.
Red flags include:
- Candidates who use LLMs to think through how the project should be completed (like screenshotting Figma and asking Claude to solve it)
- Candidates who don't question unclear specs
- Candidates who say "I'm still not sure what this part does" but wouldn't change anything before human review
Positive signals include:
- Clarifying problem statements and exploring edge cases
- Recognizing tradeoffs
- Pointing out when something feels weird or doesn't seem right
- Showing creativity (like building a mini-game to entertain users during LLM response waits)
- Knowing when work isn't good enough and how to improve it
The core philosophy: In a world where implementation is getting easier, what matters most is judgment. Working code isn't the finish line—understanding and maintaining it is.
📖 Read the full source: HN AI Agents
👀 See Also

Anthropic's circuit-tracing research reveals Claude 3.5 Haiku's internal mechanisms
Anthropic published circuit-tracing research on a simplified Claude 3.5 Haiku, revealing six specific behaviors including its default "I don't know" state, backward poem writing, and dual-path math processing.

Proving Model Identity with Tinfoil's Modelwrap Technology
Tinfoil's Modelwrap ensures that inference providers serve the exact model weights they claim to, using cryptographic commitments verified by secure enclaves.

Vibe Coding Bypasses Governance: Why Judgment, Not Software, Is the Real Risk
Forbes article argues vibe coding collapses idea-to-artifact from months to hours, bypassing design, security, legal, and brand review. Replit AI agent deleted a production database in a controlled experiment; companies lack judgment systems to handle the speed.

Diagnosing Operational Drift and Task Amnesia in OpenClaw with Gemini 2.5 Flash on Proxmox
OpenClaw users report issues with persistent workflows on a Proxmox VM, citing operational drift and task amnesia. Despite stable performance in one-off tasks, the Gemini 2.5 Flash model struggles with automation and memory in this setup.