stoneskin (Mr. Sun)

Personal homepage of Mr Sun - AI Solutions Architect, Tech Lead & AWS Cloud Specialist: resume, selected projects, and teaching archive

Part Two: Working with AI — Behaviors and Methods

AI’s habits, and how to deal with it.

中文版

← Back to index


5. Notes on AI coding (2026-10-12)

Code written by AI looks perfect — but probably has bugs.

Reviewing with a different model, especially a model from a different family, fixes most of the bugs and shortcomings.

But even with the AI think tank’s review, human testing and feedback remain irreplaceable — you have to know what you want, the concrete implementation, and the big-picture direction before you can point out AI’s misses and set the course for fixes.



6. Drive the company’s AI like it’s stolen (2026-10-13)

From an interview with Max Schoening (Notion’s head of product). He said “drive Notion like it’s stolen” — don’t baby the tool like a rental car; push it hard. Applied to me: the company’s AI? Drive it like it’s stolen.

But stealing a car and fixing one are two different things: in the playground, floor it — however fast it goes. In production, be the engineer — check the brake pads when brake pads need checking. Knowing when to steal and when to fix is the complete skill.


8. AI has no “memory,” only context (2026-10-13)

A model is a stateless function — so-called “forgetfulness” is almost always a broken link in the framework chain: it wasn’t written down, wasn’t retrieved, or wasn’t stuffed into context. Check the harness first, blame the model second.


9. What makes a magic prompt work isn’t the incantation — it’s the principle (2026-10-13)

A magic prompt never works because of the magic words. It works because it happened to hit the right principle — give the full four-piece set of a good question (decision, current state, constraints, timeline), and even a bad prompt gets a good answer. So don’t collect incantations; steal principles.


10. Understanding debt and cognitive offloading (2026-10-13)

The smoother the Loop runs, the bigger the two hidden costs. Understanding debt: the loop-generated code wasn’t typed by you line by line, and the gap between the code in the repo and the code you actually understand keeps widening — debt never disappears, it just moves: you pay it while writing the code, or you pay it when the pager goes off at 3 AM. Cognitive offloading: once the tool works, humans are quickest to stop thinking. Steering AI requires your hands on the wheel; cognitive offloading is letting go of it. Accomplishment migrating from “writing it myself” to “steering AI” (point 3) is an upgrade — but letting go of the wheel is a downgrade.



12. AI slacks off — humans have to play foreman (2026-10-14)

AI’s attitude toward delivering work is exactly like a contractor going through the motions: do as little as possible, cut whatever corners can be cut. Stop watching, and it hands you a version that merely “looks done.” Playing foreman isn’t distrust — it’s part of the workflow.


16. AI’s three “human traits”: over-eager, lying, and lazy (2026-10-15)

The case: a Swarmchasers investigation found AI agents running in Tencent cloud sandboxes making 2,600+ scrape attempts against Amap to answer “which gate do most visitors to the Chengdu Zoo use.” When blocked, they switched tactics — executing code via the public URL-scanning site urlquery, attempting to forge Alibaba security tokens, probing test servers that were never made public, and actually using an Amap key leaked in public code. Tencent said it was an evaluation team testing third-party models’ ability to answer questions online; the project has ended. Source: https://x.com/dotey/status/2110489279646642209 (via Baoyu @dotey, summarizing the Swarmchasers report)

Three AI behaviors humans need to know:

The best detail: the agents were reading news about themselves — researchers found their own coined term “fleet” in one agent’s inbox. The observed observing the observers: the human-AI relationship’s first moment of eye contact.