Every dollar that you spend on model inference buys you a position on a graph of latency and throughput. On this plot is a curve of optimal configurations, where you’ve squeezed the maximum possible performance from your hardware. That curve, borrowed from portfolio theory in finance, is the efficient frontier. With the assumption that you […]
Five techniques to reach the efficient frontier of LLM inference Read More »
Ryan is joined by Nancy Wang, CTO of 1Password, to discuss the security challenges local agents present, how enterprises can create robust governance of credentials through zero-knowledge architecture, and the implications of agent intent and misuse in a world where AI agents are becoming more and more integrated into everyday applications.
Prevent agentic identity theft Read More »
If you’re architecting cloud systems for AI development on AWS, you’ve likely discovered that traditional architectures create friction for AI agents. Many cloud teams are experimenting with AI coding assistants but quickly discover a gap between what these tools promise and what their architectures allow. When an AI agent generates code, it often takes minutes—or
Architecting for agentic AI development on AWS Read More »
AI has made it easier than ever for student developers to work efficiently, tackle harder problems, and pursue ambitious projects. But for students earning technical degrees, these new capabilities also create genuine tensions around learning. How much should I use AI? What should I use it for? As 90% of technology professionals now use AI
The new AI literacy: Insights from student developers Read More »
The traveling salesman problem asks a deceptively simple question: What’s the shortest route that visits every point exactly once? It’s one of the hardest problems in computer science, and mathematicians have been working on it for nearly a century. It’s also what FM Logistic‘s warehouse operators face every day in Poland. The facility spans eight
Organizations running on-premises workloads often face a difficult choice when moving to the cloud: how to modernize without losing the architectural consistency their business depends on. If you use Red Hat OpenShift, you have a way to bridge these environments without the risk of a forced re-platforming. Google Cloud provides a secure, reliable, and high-performance
New ways to migrate and scale Red Hat OpenShift on Google Cloud Read More »
Editor’s note: Manhattan Associates, a global leader in supply chain and omnichannel commerce solutions, modernized its Manhattan Active SaaS platform by moving from legacy Oracle and DB2 systems to Google Cloud databases. With Cloud SQL and BigQuery, the company now processes over a billion API calls per day with average response times under 150 milliseconds,
Manhattan Associates powers over a billion daily API calls with Google Cloud databases Read More »
Organizations running on-premises workloads often face a difficult choice when moving to the cloud: how to modernize without losing the architectural consistency their business depends on. If you use Red Hat OpenShift, you have a way to bridge these environments without the risk of a forced re-platforming. Google Cloud provides a secure, reliable, and high-performance
New ways to migrate and scale Red Hat OpenShift on Google Cloud Read More »
Coding guidelines and standards for agents need to be a little different—more explicit, demonstrative of patterns, and obvious.
Building shared coding guidelines for AI (and people too) Read More »
The explosion of large language models (LLMs) has increased demand for high-performance accelerators like GPUs and TPUs. As organizations scale their AI capabilities, the scarcity of compute resources is sometimes the primary bottleneck. Efficiently managing every GPU and TPU cycle is no longer just a recommendation — it’s an operational necessity. Kubernetes is becoming the
DRA: A new era of Kubernetes device management with Dynamic Resource Allocation Read More »
