Apr 2026 - May 2026
ShadowBot
AI-Powered QA Verification Tool
A native macOS AI verification agent that reads the screen in real time and turns LLM output into automated UI interactions.
- Swift
- SwiftUI
- AppKit
- ScreenCaptureKit
- Anthropic API
What I built
- Engineered a native macOS AI verification agent using Swift, SwiftUI, and ScreenCaptureKit for real-time visual context extraction and multi-modal QA automation.
- Architected an AI action parsing and execution engine that translates raw LLM outputs into automated UI interactions, achieving an 84% task completion rate across 50 multi-step test workflows.
- Designed stateful UI validation pipelines that evaluate dynamic visual states and complex multi-step workflows beyond traditional, static assertion testing.
- Implemented Server-Sent Events (SSE) streaming for instant model response rendering, maintaining low-latency interactions (3-5 second execution loops).