Let’s talk

One operator. Three steps. One workflow in use.

The week our research agent came back empty

Our scouting agent hit a search limit and found nothing new. What it did next is a small lesson in what to expect from AI you trust.

We have an AI agent that goes out and scouts for us on GitHub, Reddit and X, looking for tools worth telling you about. This time it came back nearly empty-handed.

What happened

The search tool it relies on hit its usage limit after a single query. The one result it got was an old library for fetching trending projects on GitHub. Nothing recent could be checked.

So instead of a shiny new tool, you get a note that says: we didn't find anything we could verify.

Why that's the interesting part

AI is very good at sounding sure. An agent that couldn't search might have filled the gap with something plausible: an invented project, a confident summary of a tool nobody can actually find. That kind of quiet mistake is what costs a business its credibility.

Ours stopped and said, more or less, "I couldn't check, so I have nothing to report. Run me again later." Boring. Also exactly right.

What it means for you

If you use AI for research, customer replies or reports, the question isn't only "how smart is it?" It's "what does it do when it can't do the job?" Tools run out of credits, limits get hit. A good setup admits it.

Words worth knowing

  • Usage limit: a cap on how much you can use a service in a given period. Hit it, and the tool stops answering until it resets.
  • Hallucination: when an AI states something false with total confidence, because it predicts what sounds right instead of checking.
  • Verified source: a link or document you can open and read yourself. No source? Treat the claim as a guess.

Next time you set up an AI assistant, give it permission to say "I don't know." It might be the most useful sentence it ever learns.

Field Notes, every Friday

The week’s best free and open-source tools in one short email. Plus David’s own notes when he has something worth sending.

Already have customers but growth is stuck? Tell us what is slowing it down.

Start the five questions