Plan and manage an Azure AI solution
Learning goals
- Choose LLMs, small language models, multimodal models and Foundry Tools to fit the task
- Configure security with managed identities, private networking, keyless authentication and RBAC
- Manage quotas, rate limits and cost, and monitor quality and safety
- Implement responsible AI with guardrails, evaluation, tracing and approval flows
Key points
- Model choice balances quality, latency and cost: small language models for high-volume routine classification, large models for complex reasoning, multimodal when images are involved.
- Keyless authentication is the rule: assign a managed identity to the app and grant only the minimum roles with RBAC. Never put API keys in code or repositories.
- Isolate the network with private endpoints and similar, and narrow public exposure.
- Handle 429 (rate limit) with quota checks, retries with exponential backoff and capacity planning. Cost is driven by token volume and deployment type.
- Monitor not only model performance but also grounding quality, safety events and the health of search indexes.
- Responsible AI: design content filters and guardrails, evaluation, tracing and provenance metadata, approval workflows and tool access control as a set.
Workplace uses
- SalesKeep costs down by splitting models by use: a large model for proposal drafts and a small model for inquiry classification.
- General affairsBuild the internal policy Q&A app with a managed identity and a private network, removing API key management and leak risk.
- FinancePayment tools are never run directly by the agent but go through an approval workflow. Tracing records who approved what, on what grounds.
Exam objectives (from the exam guide)
- Choose the appropriate Foundry services for generative AI and agents
- Set up AI solutions in Foundry
- Manage, monitor, and secure AI systems
- Implement responsible AI across generative AI and agentic systems