Cunshi Wang and colleagues report StarWhisper Telescope system, an AI agent to control amateur telescope array to make astronomical observations of cosmic transients. The agent is a blueprint for control systems of future telescope arrays where AI-based autonomy will be critical.