Amazon Bedrock Knowledge Bases (managed RAG)
Fastest path to grounded chat over enterprise documents. Bedrock owns embeddings, chunking defaults, and retrieval APIs so your team ships the product layer.
- Compare: Bedrock vs SageMaker
GenAI decision tree
Which AWS GenAI Approach Should I Use?
Pick Amazon Bedrock, SageMaker, Agents, or a RAG stack by data sensitivity, customization needs, and team capacity — in 5 questions, with the comparison guide that goes deeper.
- Questions
- 5
- Outcomes
- 9
Last updated: · FactualMinds AWS Architects · Reviewed by AWS Solutions Architect — Professional certified
Step 1/Choose to begin
What are you trying to ship first?
Start from the product outcome. Model choice follows the workload shape.
How to use this tree
This tree mirrors how we scope GenAI engagements: start from the product outcome (RAG, agents, generation, training), then decide how much infrastructure you want to own. The goal is a defensible default in under a minute — not an exhaustive catalog of every Bedrock model ID.
If two leaves feel close, walk both and read the comparison guides. The most common healthy starting shape is Bedrock foundation models + Knowledge Bases for RAG, with AgentCore only when tool use is required. Net-new workforce assistants start on Quick Suite, not Q Business.
All possible recommendations in this tree
Reference list of every endpoint in this decision tree — useful when you want to skim before answering questions, or when JavaScript is disabled.
Custom RAG (OpenSearch / Aurora pgvector / S3 Vectors) + Bedrock
You own the retrieval plane; Bedrock (or SageMaker endpoints) owns generation. Right when chunking, hybrid search, or eval harnesses need to be first-class.
- Compare: Bedrock vs SageMaker
Amazon Quick Suite (net-new) / Q Business (existing)
Enterprise assistant path for employee knowledge work without building a custom agent runtime. Net-new buyers after July 30, 2026 should start on Quick Suite; keep existing Q Business deployments running. Not for productized customer-facing agents.
Amazon Bedrock AgentCore (Harness or Runtime)
Managed agent platform for tool use, memory, identity, and multi-step reasoning. Use Harness for config-driven loops; Runtime for Strands, LangGraph, or custom containers. Agents Classic is not the net-new path after July 30, 2026.
- Compare: Bedrock Agents vs Step Functions
Step Functions + Bedrock (deterministic agentic workflows)
When the workflow is the product — retries, human approval, audit trails — put Step Functions in charge and call Bedrock as a step.
- Compare: Bedrock Agents vs Step Functions
Amazon Bedrock foundation models (prompt-first)
Invoke Claude, Llama, Titan, and other FMs via Bedrock APIs. Start here for summarization, classification, and generation before you fine-tune.
- Compare: Bedrock vs SageMaker
Amazon Bedrock fine-tuning / continued pre-training
Customize a Bedrock-supported model on your labeled corpus without owning training clusters. Raise the eval bar before production.
- Compare: Bedrock vs SageMaker
Amazon SageMaker (training & custom serving)
Full ML platform control — training jobs, pipelines, endpoints, and experiment tracking. Choose when Bedrock abstractions are the bottleneck.
- Compare: Bedrock vs SageMaker
SageMaker + custom agent runtime
When agent behavior is tightly coupled to models you train and serve yourself. Higher ops cost; justified only with an ML platform team.
Frequently Asked Questions
Should every GenAI app start on Bedrock?
Most product teams should. Bedrock removes GPU capacity management and gives multi-model choice behind one API. Move to SageMaker when you hit hard limits on customization, training control, or existing MLOps investment — not because SageMaker sounds more “serious.”
When is RAG better than fine-tuning?
RAG wins when answers must cite changing enterprise documents. Fine-tuning wins when you need style, format, or domain language that prompting cannot stabilize. Many production systems use both: RAG for facts, light fine-tuning or strong system prompts for behavior.
Where do Bedrock AgentCore and Agents Classic fit vs Step Functions?
Use Bedrock AgentCore (Harness or Runtime) when the model must choose tools dynamically in a conversation. Agents Classic is in maintenance for new customers after July 30, 2026. Use Step Functions when the workflow graph is mostly known, long-running, and must be auditable. See the Bedrock Agents Classic vs Step Functions comparison for the deterministic breakpoint.
Want a deeper review than the tree?
Send us your workload requirements and we'll write back with a one-page architecture recommendation — usually within two business days.