Home / artificial-intelligence-machine-learning / Microsoft Certified: Azure AI Cloud Developer Associate (AI-200) / Cheat Sheet
Microsoft Certified: Azure AI Cloud Developer Associate (AI-200)

AI-200 Cheat Sheet

AI-200 Tests Whether You Can Build Containerized, Data-Driven AI Apps on Azure

The Microsoft AI-200 exam, the successor to the retired AZ-204, rewards developer judgment: choosing container hosts, using Cosmos DB, PostgreSQL and Redis for vector and AI workloads, wiring services with messaging and Functions, and securing and monitoring the result.

Check Your Readiness →
Among the harder certs
Avg: Not published by Microsoft
Pass: 750 / 1000
Most candidates understand Microsoft Certified: Azure AI Cloud Developer Associate (AI-200) concepts — and still fail. This exam tests how you apply knowledge under pressure.

AI-200 Decision Framework

AI data services (about 25-30%) is the largest domain, and containers, service integration and security and monitoring each carry about 20-25%. Most items ask you to pick the right host, data service or messaging pattern for a stated requirement, then secure it without secrets in code.

  1. 01
    Read the Requirement — Note scale, latency, event patterns, data shape and how much infrastructure the team can run.
  2. 02
    Pick the Host — Choose App Service, Container Apps with KEDA or AKS for containers, or Azure Functions for event-driven code.
  3. 03
    Pick the Data Service — Match Cosmos DB for NoSQL, PostgreSQL with pgvector or Azure Managed Redis to the query, vector search and caching need.
  4. 04
    Connect the Services — Use Service Bus for reliable messaging, Event Grid for reactive events and Functions bindings to integrate them.
  5. 05
    Secure and Observe — Authenticate with managed identities, keep secrets in Key Vault and config in App Configuration, and trace with OpenTelemetry and KQL.

Wrong instinct vs correct approach

Messages repeatedly fail processing
✕ Wrong instinct

Increase the retry loop in the consumer so it keeps trying the same message until it succeeds.

✓ Correct approach

Let Service Bus move messages that exceed the maximum delivery count (10 by default) to the dead-letter queue, then inspect and reprocess or discard them. Endless retries block the queue and hide poison messages.

Containerized API that must scale to zero on queue load
✕ Wrong instinct

Deploy to an AKS cluster and configure the cluster autoscaler.

✓ Correct approach

Use Azure Container Apps with a KEDA scale rule on the queue length, which scales replicas out with load and down to zero when idle, without managing a Kubernetes cluster. Choose AKS only when full Kubernetes control is required.

Repeated LLM prompts are slow and costly
✕ Wrong instinct

Scale up the model deployment so every request is answered faster.

✓ Correct approach

Add semantic caching in Azure Managed Redis: store embeddings of previous prompts with their responses and return a cached answer when a new prompt is similar enough. It cuts latency and model cost for repeated questions.

Know these cold

  • ▸ Service Bus for commands and queues; Event Grid for event notifications.
  • ▸ Cosmos DB default consistency is session.
  • ▸ Choose the partition key for even spread and your main query.
  • ▸ Change feed misses deletes — oft-delete with TTL.
  • ▸ Managed identity first; Key Vault for unavoidable secrets.
  • ▸ Container Apps + KEDA to scale to zero; AKS for full control.
  • ▸ 700 of 1000 passes, and the scaled score is not a percentage.

Can you answer these without checking your notes?

In this scenario: "Messages repeatedly fail processing" — what should you do first?
Let Service Bus move messages that exceed the maximum delivery count (10 by default) to the dead-letter queue, then inspect and reprocess or discard them. Endless retries block the queue and hide poison messages.
In this scenario: "Containerized API that must scale to zero on queue load" — what should you do first?
Use Azure Container Apps with a KEDA scale rule on the queue length, which scales replicas out with load and down to zero when idle, without managing a Kubernetes cluster. Choose AKS only when full Kubernetes control is required.
In this scenario: "Repeated LLM prompts are slow and costly" — what should you do first?
Add semantic caching in Azure Managed Redis: store embeddings of previous prompts with their responses and return a cached answer when a new prompt is similar enough. It cuts latency and model cost for repeated questions.

Common Exam Mistakes — What candidates get wrong

Confusing Service Bus and Event Grid

Service Bus is a message broker for reliable, ordered (with sessions) and transactional delivery of commands and work items, with dead-letter queues. Event Grid routes lightweight event notifications to subscribers using push delivery with filters and retries, so it fits reactive scenarios rather than work queues.

Picking the wrong Cosmos DB consistency level

Cosmos DB offers five levels: strong, bounded staleness, session, consistent prefix and eventual, with session as the default. Stronger levels cost more RUs and latency, and strong consistency is not available with multi-region writes.

Expecting the change feed to capture deletes

In the default latest-version mode, the Cosmos DB change feed records inserts and updates but not deletes. A common pattern is a soft-delete flag with a TTL so downstream processors see the change before the item expires.

Using connection strings instead of managed identities

Embedding keys or connection strings in code or app settings creates secrets that leak and need rotation. Assign a managed identity, grant it RBAC roles on the target service and use Key Vault references for secrets that cannot be avoided.

Building a pgvector IVFFlat index on an empty table

IVFFlat builds its clusters from existing rows, so it should be created after the table holds representative data. HNSW gives better speed-recall trade-offs and can be built at any time, but it uses more memory and builds more slowly.

Resources to help you pass Azure AI Cloud Developer AI-200 on your first attempt

Find out which AI-200 skills area, from AI data services to containers, is costing you the most points.