Azure AI & ML Studio

Microsoft Azure is the enterprise choice for AI, powered by a $13B investment in OpenAI. Through Azure OpenAI Service, enterprises get exclusive access to GPT-4, DALL-E, and Whisper with data privacy guarantees and enterprise SLAs.

📖 Covers: Azure ML Studio · Azure OpenAI · Cognitive Services · AI Foundry · Responsible AI · MLflow

Azure AI Service Landscape

🏗️
Azure ML Studio

End-to-end ML platform with visual designer, AutoML, and Python SDK

🤖
Azure OpenAI Service

Enterprise GPT-4, DALL-E, Whisper with data privacy and RBAC

🧩
Cognitive Services

Pre-built AI: vision, speech, language, decision — REST APIs

🔬
AI Foundry

New unified platform for building AI apps with model catalogue and RAG

📊
Synapse Analytics

Integrated data + ML platform for large-scale data engineering

⚖️
Responsible AI

Fairness, explainability, error analysis tools built into ML Studio

Azure OpenAI Service

Azure OpenAI gives enterprise customers exclusive access to OpenAI models with: data processed only in your Azure tenant, no data used to train OpenAI models, RBAC access control, and 99.9% uptime SLA.

Python · Azure OpenAI API
from openai import AzureOpenAI

client = AzureOpenAI(
    azure_endpoint="https://YOUR-RESOURCE.openai.azure.com/",
    api_key="YOUR-KEY",
    api_version="2024-02-01"
)

response = client.chat.completions.create(
    model="gpt-4o",          # Your deployment name
    messages=[
        {"role": "system", "content": "You are a helpful AI assistant."},
        {"role": "user", "content": "Explain transformer architecture."}
    ],
    max_tokens=512
)
print(response.choices[0].message.content)

Azure ML Studio: Custom Training

Python · Azure ML SDK v2 — Submit Training Job
from azure.ai.ml import MLClient, command
from azure.ai.ml.entities import Environment, AmlCompute
from azure.identity import DefaultAzureCredential

ml_client = MLClient(DefaultAzureCredential(), subscription_id, rg, workspace)

# Define training job
job = command(
    code="./src",                    # Local code directory
    command="python train.py --epochs 50",
    environment="AzureML-pytorch-1.13-ubuntu20.04-py38-cuda11-gpu@latest",
    compute="gpu-cluster",           # Your compute cluster name
    experiment_name="my-experiment",
    display_name="training-run-1"
)

returned_job = ml_client.jobs.create_or_update(job)
ml_client.jobs.stream(returned_job.name)  # Stream logs

Azure AI Foundry — The New AI Hub

Azure AI Foundry (formerly Azure AI Studio) is Microsoft's answer to Hugging Face Spaces — a hub for discovering, testing, and deploying AI models and building production AI apps.

🛒Model Catalogue

1,600+ models: OpenAI, Meta Llama, Mistral, Phi (Microsoft's small models)

💬Prompt Flow

Visual tool to build, test, and deploy LLM-powered workflows with RAG

🔒Content Safety

Built-in content filtering and safety evaluation for responsible AI deployment

📈Evaluation

Automated evaluation of AI app quality: groundedness, coherence, relevance

MLflow Integration

Azure ML natively supports MLflow for experiment tracking — no extra setup needed:

Python · MLflow in Azure ML Training Script
import mlflow

# Azure ML auto-configures MLflow tracking — just log!
with mlflow.start_run():
    mlflow.log_param("learning_rate", 0.001)
    mlflow.log_param("epochs", 50)

    for epoch in range(50):
        train_loss = train_one_epoch()
        val_accuracy = evaluate()

        mlflow.log_metric("train_loss", train_loss, step=epoch)
        mlflow.log_metric("val_accuracy", val_accuracy, step=epoch)

    # Save model
    mlflow.pytorch.log_model(model, "model")

Cognitive Services — Pre-Built AI APIs

CategoryServicesExample Use Case
VisionComputer Vision, Custom Vision, FaceDetect objects in images, verify identity
LanguageText Analytics, Translator, CLUSentiment analysis, translation, intent recognition
SpeechSpeech-to-Text, Text-to-SpeechMeeting transcription, IVR systems
DecisionAnomaly Detector, PersonalizerFraud detection, content recommendations

Frequently Asked Questions

Is Azure OpenAI data private?

Yes. Azure OpenAI does not use your inputs or outputs to train or improve OpenAI models. Data stays within your Azure tenant. This is the primary reason enterprises choose Azure OpenAI over the direct OpenAI API — compliance, HIPAA BAA, GDPR, and data residency requirements.

What is Microsoft Phi and why is it interesting?

Phi (Phi-3, Phi-3.5) is Microsoft's family of small language models. Phi-3 Mini (3.8B params) is optimised for edge inference and matches GPT-3.5-turbo on selected reasoning, coding and math benchmarks while being roughly 100× smaller. Designed for edge deployment and cost-sensitive applications. Available for free on Hugging Face and deployable via Azure AI Foundry.

Frequently Asked Questions

What will I learn here?

This page covers the core concepts and techniques you need to understand the topic and progress confidently to the next lesson.

How should I use this page?

Start with the overview, then follow the section links to deepen your understanding. Use the table of contents on the right to jump to specific sections.

What should I read next?

Use the navigation below to continue to the next lesson or explore related topics.