EI-301d · Module 2

Hybrid Build-Buy Architecture

3 min read

In practice, most AI architectures are hybrids — some components built, some bought. The hybrid architecture decision is about drawing the boundary: which layers of your technology stack should be internal, which should be vendor-provided, and how should the layers interface? The VANGUARD layered model provides guidance: the data layer (your proprietary data, fine-tuning datasets, evaluation benchmarks) should almost always be internal. The model layer (foundation model inference) should usually be bought unless AI is your core product. The application layer (the logic that connects models to business processes) should be built because it embodies your domain expertise.

  1. Define the Architecture Layers Map your AI capability stack into layers: data, model, orchestration, application, and user interface. For each layer, evaluate build-vs-buy independently. A layer that contains proprietary business logic or proprietary data leans toward build. A layer that contains commoditized capability leans toward buy. A layer in rapid evolution leans toward buy (let the vendor track the evolution).
  2. Design Clean Interfaces The boundary between build and buy layers should be a clean, well-defined interface — typically an API contract. Clean interfaces minimize switching cost for bought layers and maximize flexibility. If the model provider changes, you swap the provider behind the interface without modifying your application layer. If your application logic evolves, it can evolve without touching the model layer.
  3. Plan Layer Migration Paths For each bought layer, maintain an awareness of build alternatives and switching options. For each built layer, maintain an awareness of vendor alternatives that could replace it if the maintenance burden exceeds the strategic value. The hybrid architecture should be dynamically optimized as the ecosystem evolves, not locked in at the initial design.