AI & Data
Databricks Data Engineer Professional: Production Data Pipelines
Production data pipelines are judged by repeatability, recovery, observability, security, and cost—not by whether a notebook succeeded once with sample…
Explore / Technology subjects
AI & Data
Data engineering, analytics, databases, machine learning, artificial intelligence and AI systems.
The reading room
All insights
Latest in AI & Data
139 published articles in this category.
AI & Data
Databricks Data Engineer Professional: Reliable Data Observability
Data observability answers a different question from infrastructure monitoring. Instead of asking only whether compute is running, it asks whether…
AI & Data
Databricks Data Engineer Professional: Spark Performance Tuning
Large Spark workloads become slow for many different reasons: unnecessary data scans, poor join strategy, skew, shuffle, small files, oversized…
AI & Data
Databricks Data Engineer Professional: Structured Streaming Pipelines
Apache Spark Structured Streaming brings incremental processing into the DataFrame model, allowing engineers to express many streaming transformations with familiar…
AI & Data
Microsoft DP-600: Semantic Model Design for Power BI
A Power BI semantic model is the layer that turns stored data into consistent business meaning. It defines relationships, measures,…
AI & Data
Google Cloud GenAI Leader: Generative AI Strategy
A generative AI strategy is not a list of models to buy. It is a business plan for choosing valuable…
AI & Data
Microsoft AI-300: Prompt Versioning and Release Management
A prompt is production logic when changing it can change what an AI application says or does. That makes prompt…
AI & Data
Microsoft AI-300: Responsible AI in Production
Responsible AI becomes concrete only when a system is exposed to real users, real data, and real consequences. Principles such…
AI & Data
Microsoft AB-100: AI Agent Governance in Regulated Industries
AI agents create a governance problem that is different from ordinary chatbots. A chatbot primarily produces information. An agent can…
AI & Data
Microsoft AB-100: AI Agent Orchestration for Business Workflows
Agentic AI becomes genuinely useful when it can participate in a business process rather than merely answer a question. That…
AI & Data
Microsoft AB-100: Enterprise AI Agents with Microsoft Foundry
Building an enterprise AI agent is less about finding a clever prompt and more about assembling a governed runtime around…
AI & Data
Microsoft AB-100: Evaluating AI Agents Pre-Production
An AI agent can produce impressive demonstrations and still be unsafe to release. The difference is that production exposes the…
AI & Data
Microsoft AB-100: Human-in-the-Loop Governance for AI Agents
Human-in-the-loop governance is often described as adding an approval button to an AI workflow. That is too narrow. The real…
AI & Data
Microsoft AB-100: Securing Tool Access for Agentic AI
An AI agent becomes materially more powerful when it can call tools. Search, databases, email, ticketing systems, code execution, APIs,…
AI & Data
Microsoft DP-600: Fabric Data Pipelines and Dataflows Gen2
Microsoft Fabric Data Factory offers several ways to move and transform data, but two components are frequently confused: pipelines and…