Foundation Model Integration, Data Management, and Compliance
Learning goals
- Choose FMs, integration patterns and deployment methods from business requirements and constraints, build PoCs on Bedrock, and align designs with the Well-Architected Generative AI Lens
- Select FMs through benchmarks and evaluation, and design configurations that switch models or providers without code changes (AppConfig, Lambda, API Gateway) plus resilience with cross-Region inference and circuit breakers
- Build validation and processing for data passed to FMs (Glue Data Quality, multimodal, conversation formats), and design vector stores (OpenSearch, Aurora pgvector, S3 Vectors, Bedrock knowledge bases) with metadata and update mechanisms
- Design retrieval with chunking, embeddings, hybrid search, reranking and query expansion, and govern prompts with Prompt Management, templates, guardrails and prompt flows
Key points
- Design approach: decide requirements first (quality, latency, cost, data location, regulation), evaluate multiple Bedrock models in a small PoC, then move to production design. Standardize shared components (prompt templates, guardrails, logging).
- Switching models: do not hard-code model IDs or parameters; manage them in configuration such as AWS AppConfig. The Converse API lets you call different models with a common format.
- Resilience: prepare for Regional capacity shortages and throttling with cross-Region inference, and design graceful degradation such as Step Functions retries and circuit breakers and falling back to a smaller model.
- Customization: start with prompts and RAG. If that is not enough, use fine-tuning (parameter-efficient methods such as LoRA) or distillation. Version custom models so you can roll back on failure.
- Data processing: validate quality before passing data to FMs (Glue Data Quality, Lambda), and process images, audio and tables (Transcribe, Bedrock Data Automation, multimodal models). Pass conversations in role format (user, assistant).
- Vector stores: OpenSearch for hybrid search or large scale, pgvector on Aurora or RDS for existing PostgreSQL, S3 Vectors for storing large volumes cheaply. Narrow retrieval with metadata (date, author, classification). Reflect document changes with incremental sync.
- Retrieval design: chunking (fixed, hierarchical, semantic, custom Lambda), embedding model and dimensions, hybrid search, reranking, query rewriting and decomposition.
- Prompts: set role and constraints in the system prompt, manage templates and versions with Bedrock Prompt Management, and apply approval and auditing. Split complex tasks into steps and wire order and branches with Prompt Flows.
Workplace uses
- SalesFor a proposal assistant, the team wants to compare and switch models monthly. Model IDs are managed in AppConfig and called via the Converse API, so new models can be adopted without code changes.
- General AffairsIn an internal policy RAG, old pre-revision policies appear in answers. Add effective-date metadata to documents to filter retrieval, and run knowledge base sync automatically when S3 changes.
- AccountingBefore an FM reads invoice images and tables, Lambda validates amount and date formats, and invoices with missing fields are routed to staff for review.
Exam objectives (from the exam guide)
- 1.1 要件を分析し、GenAI ソリューションを設計する。
- 1.2 FM を選定して設定する。
- 1.3 FM 消費のためのデータ検証と処理パイプラインを実装する。
- 1.4 ベクトルストアソリューションを設計して実装する。
- 1.5 FM 拡張のための検索メカニズムを設計する。
- 1.6 FM インタラクションのためのプロンプトエンジニアリング戦略とガバナンスを実施する。
Learning resources
- What is Amazon Bedrock (official) ↗
- Converse API (official) ↗
- Cross-Region inference (official) ↗
- Bedrock knowledge bases (official) ↗
- Knowledge base chunking (official) ↗
- Bedrock Prompt Management (official) ↗
- Amazon S3 Vectors (official) ↗
- Well-Architected Generative AI Lens (official) ↗
- AIP-C01 exam guide / study guide ↗