#aws-architecture

Articles tagged with #aws-architecture

The 15-Millisecond AI: Building "Pre-Cognitive" Edge Caching on AWS
If you want to watch a product manager's soul leave their body, sit in on a live demo of a Generative AI feature where the model takes 12 seconds to generate a response. Typing... typing... typing...
Mar 29, 20265 min read1
The $50,000 Chat History Problem: Building Event-Driven AI Memory on AWS
It was 11:00 PM on a Tuesday when my friend startup's CTO dropped a screenshot of their monthly cloud bill into the engineering Slack channel. The AWS infrastructure costs were flat. But their LLM inf
Mar 27, 20265 min read2