Azure AI & ML Studio
Microsoft Azure is the enterprise choice for AI, powered by a $13B investment in OpenAI. Through Azure OpenAI Service, enterprises get exclusive access to GPT-4, DALL-E, and Whisper with data privacy guarantees and enterprise SLAs.
Azure AI Service Landscape
End-to-end ML platform with visual designer, AutoML, and Python SDK
Enterprise GPT-4, DALL-E, Whisper with data privacy and RBAC
Pre-built AI: vision, speech, language, decision — REST APIs
New unified platform for building AI apps with model catalogue and RAG
Integrated data + ML platform for large-scale data engineering
Fairness, explainability, error analysis tools built into ML Studio
Azure OpenAI Service
Azure OpenAI gives enterprise customers exclusive access to OpenAI models with: data processed only in your Azure tenant, no data used to train OpenAI models, RBAC access control, and 99.9% uptime SLA.
from openai import AzureOpenAI
client = AzureOpenAI(
azure_endpoint="https://YOUR-RESOURCE.openai.azure.com/",
api_key="YOUR-KEY",
api_version="2024-02-01"
)
response = client.chat.completions.create(
model="gpt-4o", # Your deployment name
messages=[
{"role": "system", "content": "You are a helpful AI assistant."},
{"role": "user", "content": "Explain transformer architecture."}
],
max_tokens=512
)
print(response.choices[0].message.content) Azure ML Studio: Custom Training
from azure.ai.ml import MLClient, command
from azure.ai.ml.entities import Environment, AmlCompute
from azure.identity import DefaultAzureCredential
ml_client = MLClient(DefaultAzureCredential(), subscription_id, rg, workspace)
# Define training job
job = command(
code="./src", # Local code directory
command="python train.py --epochs 50",
environment="AzureML-pytorch-1.13-ubuntu20.04-py38-cuda11-gpu@latest",
compute="gpu-cluster", # Your compute cluster name
experiment_name="my-experiment",
display_name="training-run-1"
)
returned_job = ml_client.jobs.create_or_update(job)
ml_client.jobs.stream(returned_job.name) # Stream logs Azure AI Foundry — The New AI Hub
Azure AI Foundry (formerly Azure AI Studio) is Microsoft's answer to Hugging Face Spaces — a hub for discovering, testing, and deploying AI models and building production AI apps.
1,600+ models: OpenAI, Meta Llama, Mistral, Phi (Microsoft's small models)
Visual tool to build, test, and deploy LLM-powered workflows with RAG
Built-in content filtering and safety evaluation for responsible AI deployment
Automated evaluation of AI app quality: groundedness, coherence, relevance
MLflow Integration
Azure ML natively supports MLflow for experiment tracking — no extra setup needed:
import mlflow
# Azure ML auto-configures MLflow tracking — just log!
with mlflow.start_run():
mlflow.log_param("learning_rate", 0.001)
mlflow.log_param("epochs", 50)
for epoch in range(50):
train_loss = train_one_epoch()
val_accuracy = evaluate()
mlflow.log_metric("train_loss", train_loss, step=epoch)
mlflow.log_metric("val_accuracy", val_accuracy, step=epoch)
# Save model
mlflow.pytorch.log_model(model, "model") Cognitive Services — Pre-Built AI APIs
Frequently Asked Questions
Is Azure OpenAI data private?
Yes. Azure OpenAI does not use your inputs or outputs to train or improve OpenAI models. Data stays within your Azure tenant. This is the primary reason enterprises choose Azure OpenAI over the direct OpenAI API — compliance, HIPAA BAA, GDPR, and data residency requirements.
What is Microsoft Phi and why is it interesting?
Phi (Phi-3, Phi-3.5) is Microsoft's family of small language models. Phi-3 Mini (3.8B params) is optimised for edge inference and matches GPT-3.5-turbo on selected reasoning, coding and math benchmarks while being roughly 100× smaller. Designed for edge deployment and cost-sensitive applications. Available for free on Hugging Face and deployable via Azure AI Foundry.
Frequently Asked Questions
What will I learn here?
This page covers the core concepts and techniques you need to understand the topic and progress confidently to the next lesson.
How should I use this page?
Start with the overview, then follow the section links to deepen your understanding. Use the table of contents on the right to jump to specific sections.
What should I read next?
Use the navigation below to continue to the next lesson or explore related topics.