Using Claude Code to Automate AI Research Experiments for 12 Hours

✍️ OpenClawRadar📅 Published: February 26, 2026🔗 Source
Using Claude Code to Automate AI Research Experiments for 12 Hours
Ad

Automated AI Research with Claude Code

A developer documented using Claude Code to automate AI research experiments for 12 hours straight. The project focused on CLaaS, a real-time continual learning framework that moves context into weights using self-distillation.

Experimental Setup

The goal was to tune self-distillation training runs to maximize a model's compliance to different preference verifiers, such as concise responses and no emojis. Experiments ran locally on an RTX 5090 overnight.

System Architecture

The repository was built to be highly configurable:

  • Every tunable parameter exposed via CLI using Hydra config management
  • HTML dashboards for every training step and evaluation run
  • Metrics, inputs, and outputs made observable through dashboards
  • Claude Code could query dashboards via curl requests to check progress
Ad

Experiment Management

The workflow was controlled by a local EXPERIMENTS.md file with specific rules:

  • Each experiment could change at most one variable or make one code change
  • Between experiments, the model had to either accept or revert the previous change based on results
  • Any new code changes had to be exposed via config for later tuning
  • The model recorded all progress, hypotheses, and outcomes in the file as a running journal
  • Used a "Ralph Wiggum loop" with the goal of maximizing preference compliance

Results

Over 12 hours, the system ran 9 experiments:

  • Found and fixed a model collapse bug on the first run
  • Tuned gradient steps per batch to 4
  • Tuned learning rate to 3e-5
  • Compliance improved from 0.000 to 1.000
  • Token usage was surprisingly low because most time was spent waiting for training runs between experiments

The same task was also run with Codex for 2 hours using a plain prompt, and it independently converged on the same hyperparameters.

Project repository: https://github.com/kfallah/CLaaS

📖 Read the full source: r/ClaudeAI

Ad

👀 See Also

Building a Voice Assistant with OpenClaw, Alexa, and Local LLM
Use Cases

Building a Voice Assistant with OpenClaw, Alexa, and Local LLM

A developer built a voice-first assistant using OpenClaw as the AI agent backbone, Alexa for voice input, and a local LLM (Ollama with Qwen 2.5 3B) to handle general knowledge queries with sub-second response times and reduced API costs.

OpenClawRadar
Developer Builds Card Combat Game in 72 Hours Using Claude AI
Use Cases

Developer Builds Card Combat Game in 72 Hours Using Claude AI

A developer used Claude AI to build a complete browser-based card combat game called SNAPDOWN in 72 hours. The game includes a 6-stage story, 4 playable classes with unique mechanics, AI opponents, animations, and a tutorial system—all in a single HTML file with no framework or build step.

OpenClawRadar
Claude Code in Research Workflow: Practical Results from Paper Writing
Use Cases

Claude Code in Research Workflow: Practical Results from Paper Writing

A researcher used Claude Code for auxiliary tasks while writing a paper, finding it effective for generating publication-ready figures from vague instructions, migrating a search environment between codebases in under an hour, and formatting 12+ pages of math proofs in LaTeX, where it caught a missed incomplete bound condition. It struggled with debugging a concurrency issue that was actually a CPU allocation problem not evident in code or logs.

OpenClawRadar
Reddit user shares system for using Claude as a work operating system
Use Cases

Reddit user shares system for using Claude as a work operating system

A Reddit user describes moving beyond using Claude like a search engine to implementing a 10-step system with specific folder structures, file types, and interaction methods that treat Claude as a primary work operating system.

OpenClawRadar