Note
Access to this page requires authorization. You can try signing in or changing directories.
Access to this page requires authorization. You can try changing directories.
This article explains the process to prepare your organization for AI adoption. It describes how to select the right AI solutions, prepare your data, and ground your approach in responsible AI principles. A well-planned AI strategy aligns with your business objectives and ensures that AI projects contribute to overall success.
Identify AI use cases
AI improves individual efficiency and enhances business processes. Generative AI increases productivity and improves customer experiences. Nongenerative AI, such as machine learning, analyzes structured data and automates repetitive tasks. Use this understanding to identify areas across your business where AI adds value.
Identify automation opportunities. Focus on processes suitable for automation to improve efficiency and reduce operational costs. Target repetitive tasks, data-heavy operations, or areas with high error rates where AI can have a significant impact.
Gather customer feedback. Use customer feedback to uncover use cases that improve customer satisfaction when automated with AI. This feedback helps prioritize impactful AI initiatives.
Conduct an internal assessment. Collect input from various departments to identify challenges and inefficiencies that AI can address. Document workflows and gather stakeholder input to uncover opportunities for automation, insight generation, or improved decision-making.
Research industry use cases. Investigate how similar organizations or industries use AI to solve problems or enhance operations. Use tools like the AI architectures in the Azure Architecture Center for inspiration and to evaluate suitable approaches.
Define AI targets. For each identified use case, define the goal (general purpose), objective (desired outcome), and success metric (quantifiable measure). These benchmarks guide your AI adoption and measure success. For more information, see example AI strategy.
Define an AI technology strategy
Technology strategy determines the right approach for your organization's capabilities, data assets, and budget requirements. This strategy prepares your organization for agent-based architectures that enable multiple AI systems to collaborate on complex tasks. You must evaluate technology options across three service models to select the most suitable approach for your needs.
Understand AI agents. AI agents are autonomous systems that use AI models to complete tasks without constant human oversight. These systems represent a shift from traditional automation to intelligent decision-making that adapts to changing conditions. You must plan for agent integration to support complex workflows and multi-system collaboration. Review What are agents? to understand agent capabilities and prepare your organization for agent-based solutions.
Adopt standard mechanisms for AI interoperability. Standard protocols enable AI systems to communicate across different platforms and reduce custom implementations. These protocols support data sharing and system integration while maintaining flexibility for future technology changes. You should understand protocols like Model Context Protocol for cross-system data ingestion to ensure your AI systems support interoperability requirements. Evaluate tools like NLWeb to prepare your content for the AI web. For example, see Model Context Protocol in Microsoft Copilot Studio and Exposing REST APIs as MCP servers.
Select the appropriate AI service model. Microsoft offers three service models with varying levels of customization and shared responsibility: Software as a Service (SaaS), Platform as a Service (PaaS), and Infrastructure as a Service (IaaS). Each model requires different technical skills and provides different degrees of control over AI implementation. You must match your team's capabilities, data requirements, and customization needs with the appropriate service model. Use the AI decision tree below to guide your selection process.
Buy AI with software services (SaaS)
Microsoft provides SaaS generative AI solutions, known as Copilots, to enhance productivity with minimal technical expertise. Refer to the table below for details.
Microsoft Copilots | Description | User | Data needed | Skills required | Main cost factors |
---|---|---|---|---|---|
Microsoft 365 Copilot | Microsoft 365 Copilot provides web-based (internet) and work-based (Microsoft Graph) chat and in-app AI for Microsoft 365 apps. | Business | Yes. Categorize your data with sensitivity labels and securely interact with your data in Microsoft Graph. | General IT and data management | License |
Role-based Copilots | Agents that enhance efficiency for specific roles in Security, Sales, Service, and Finance. | Business | Yes. Data-connection and plug-in options are available. | General IT and data management | Licenses or Security Compute Units (Copilot for Security) |
In-product Copilots | AI within products like GitHub, Power Apps, Power BI, Dynamics 365, Power Automate, Microsoft Fabric, and Azure. | Business and individual | Yes. Most require minimal data preparation. | None | Free or subscription |
Microsoft Copilot or Microsoft Copilot Pro | Microsoft Copilot is a free web-grounded chat application. Copilot Pro provides better performance, capacity, and access to Copilot in certain Microsoft 365 apps. | Individual | No | None | Microsoft Copilot is free. Microsoft Copilot Pro requires a subscription |
Extensibility tools for Microsoft 365 Copilot | Customize Microsoft 365 Copilot with more data or capabilities via declarative agents. Use tools like Copilot Studio, agent builder, Teams toolkit, and SharePoint. | Business and individual | Use Microsoft Graph connectors to add data. | Data management, general IT, or developer skills | Microsoft 365 Copilot license |
Copilot Studio | Use Copilot Studio to build, test, and deploy agents in a SaaS authoring environment. | Developer | Automates much of the data work to create custom copilots. | Platform to connect data sources, map prompts, and deploy copilots | License |
Build AI workloads with Azure platforms (PaaS)
Azure provides multiple PaaS options tailored to your AI goals, skill set, and data needs. These platforms cater to various levels of technical expertise. Review the pricing pages for each Azure service, and use the Azure pricing calculator to develop cost estimates.
AI goal | Microsoft solution | Data needed | Skills required | Main cost factors |
---|---|---|---|---|
Build agents | Azure AI Foundry Agent Service | Yes | Environment setup, model selection, tooling, grounding data storage, data isolation, agent triggering, connect agents, content filtering, private networking, agent monitoring, service monitoring | Consuming model tokens, storage, features, compute, grounding connections |
Build RAG applications | Azure AI Foundry | Yes | Select models, orchestrating dataflow, chunking data, enriching chunks, choosing indexing, understanding query types (full-text, vector, hybrid), understanding filters and facets, performing reranking, prompt engineering, deploying endpoints, and consuming endpoints in apps | Compute, number of tokens in and out, AI services consumed, storage, and data transfer |
Fine-tune GenAI models | Azure AI Foundry | Yes | Preprocessing data, splitting data into training and validation data, validating models, configuring other parameters, improving models, deploying models, and consuming endpoints in apps | Compute, number of tokens in and out, AI services consumed, storage, and data transfer |
Train and inference models | Azure Machine Learning or Microsoft Fabric |
Yes | Preprocessing data, training models by using code or automation, improving models, deploying machine learning models, and consuming endpoints in apps | Compute, storage, and data transfer |
Consume prebuilt AI models and services | Azure AI services and/or Azure OpenAI |
Yes | Select AI models, securing endpoints, consuming endpoints in apps, and fine-tuning as needed | Use of model endpoints consumed, storage, data transfer, compute (if you train custom models) |
Isolate AI apps | Azure Container Apps | Yes | Select AI models, orchestrating dataflow, chunking data, enriching chunks, choosing indexing, understanding query types (full-text, vector, hybrid), understanding filters and facets, performing reranking, prompt engineering, deploying endpoints, and consuming endpoints in apps | Compute, number of tokens in and out, AI services consumed, storage, and data transfer |
Bring AI models with infrastructure services (IaaS)
For greater customization and control, use Azure's IaaS solutions such as Azure Virtual Machines through CycleCloud and Azure Kubernetes Service. These solutions enable training and deployment of custom AI models. Refer to the relevant pricing pages and the Azure pricing calculator.
AI goal | Microsoft solution | Data needed | Skills required | Main cost factors |
---|---|---|---|---|
Train and inference your own AI models. Bring your own models to Azure. | Azure Virtual Machines or Azure Kubernetes Service |
Yes | Infrastructure management, IT, program installation, model training, model benchmarking, orchestration, deploying endpoints, securing endpoints, and consuming endpoints in apps | Compute, compute node orchestrator, managed disks (optional), storage services, Azure Bastion, and other Azure services used |
Develop an AI data strategy
Data strategy defines how you collect, manage, and use data for AI initiatives. This strategy ensures data assets support your AI use cases while maintaining security and compliance. You must establish governance frameworks, assess scalability needs, design lifecycle management, and implement responsible data practices.
Establish data governance frameworks for AI workloads. Data governance provides secure and compliant AI data usage through access controls and responsible use policies. Governance frameworks define requirements for different AI use cases and establish ongoing data management processes. You must define data classification schemes based on sensitivity and exposure levels. Use data security and compliance protections for generative AI apps in Microsoft Purview.
Assess scalability requirements for AI data needs. Scalability assessment ensures your data infrastructure handles current and future AI workload demands without performance issues or cost overruns. This assessment identifies volume, velocity, and variety requirements that guide technology selection. You must document current data volumes, processing frequencies, and data types for each AI use case.
Design data lifecycle management for AI assets. Lifecycle management keeps data accessible, secure, and cost-effective from collection to disposal while supporting AI requirements. This approach addresses collection strategies, storage optimization, and quality assurance processes. You must plan systematic data collection from databases, APIs, IoT devices, and third-party providers. Design storage strategies with appropriate tiers based on access patterns and retention needs. Establish ETL/ELT pipelines for data quality and use the Responsible AI Dashboard to identify and mitigate dataset bias.
Implement responsible data practices for AI development. Responsible practices ensure AI systems use data ethically and maintain regulatory compliance. These practices guide data collection, usage, and retention decisions throughout the AI lifecycle. You must implement data lineage tracking using Microsoft Fabric or Microsoft Purview for transparency. Establish data quality standards, bias detection, and fairness considerations in training datasets. Define retention and disposal policies that balance AI performance with privacy and compliance requirements.
Develop a responsible AI strategy
Responsible AI strategy ensures AI solutions remain trustworthy and ethical. This strategy establishes frameworks for ethical AI development that align with business objectives. You must establish accountability, define principles, select tools, and assess compliance to create a responsible AI strategy.
Assign AI accountability to designated teams. Accountability structures provide ownership for AI governance decisions and ensure responsive management of regulatory requirements. These structures define roles and decision-making authority for AI initiatives. You must assign individuals or teams to monitor AI technology changes and regulatory requirements. Create an AI cloud center of excellence to centralize responsibilities and establish escalation procedures.
Adopt responsible AI principles as business objectives. Responsible AI principles provide the framework for ethical AI development that guides decision-making and aligns with industry standards. These principles become business objectives that shape AI project selection and development. You must adopt Microsoft's six responsible AI principles, which align with the NIST AI Risk Management Framework (RMF). Integrate these principles into project planning, development processes, and success metrics.
Select responsible AI tools for your AI portfolio. Tool selection ensures appropriate mechanisms for ethical AI principles and maintains consistent application of responsible AI standards. Tool selection addresses integration approaches and operational processes. You must assess and select appropriate Responsible AI tools and processes that align with your AI use cases and risk profiles. Integrate these tools within development workflows to ensure consistent application.
Identify compliance requirements for AI regulations. Compliance assessment protects the organization from legal risks and ensures AI initiatives align with applicable laws and industry standards. Compliance requirements vary by industry, geography, and AI application. You must identify relevant local and international AI regulations that apply to your operations and AI use cases. Monitor regulatory changes and update compliance strategies to ensure ongoing alignment throughout your AI adoption journey.
Example AI strategy
This example AI strategy is based on a fictional company, Contoso. Contoso operates a customer-facing e-commerce platform and employs sales representatives who need tools to forecast business data. The company also manages product development and inventory for production. Its sales channels include both private companies and highly regulated public sector agencies.
AI use case | Goals | Objectives | Success metrics | AI approach | Microsoft solution | Data needs | Skill needs | Cost factors | AI data strategy | Responsible AI strategy |
---|---|---|---|---|---|---|---|---|---|---|
E-commerce web application chat feature | Automate business process | Improve customer satisfaction | Increased customer retention rate | PaaS, generative AI, RAG | Azure AI Foundry | Item descriptions and pairings | RAG and cloud app development | Usage | Establish data governance for customer data and implement AI fairness controls. | Assign AI accountability to AI CoE and align with Responsible AI principles. |
Internal app document-processing workflow | Automate business process | Reduce costs | Increased completion rate | Analytical AI, fine-tuning | Azure AI services - Document Intelligence | Standard documents | App development | Estimated usage | Define data governance for internal documents and plan data lifecycle policies. | Assign AI accountability and ensure compliance with data handling policies. |
Inventory management and product purchasing | Automate business process | Reduce costs | Shorter shelf life of inventory | Machine learning, training models | Azure Machine Learning | Historical inventory and sales data | Machine learning and app development | Estimated usage | Establish governance for sales data and detect and address biases in data. | Assign AI accountability and comply with financial regulations. |
Daily work across company | Enhance individual productivity | Improve employee experience | Increased employee satisfaction | SaaS generative AI | Microsoft 365 Copilot | OneDrive data | General IT | Subscription costs | Implement data governance for employee data and ensure data privacy. | Assign AI accountability and utilize built-in responsible AI features. |
E-commerce app for regulated industry chat feature | Automate business process | Increase sales | Increased sales | IaaS generative AI model training | Azure Virtual Machines | Domain-specific training data | Cloud infrastructure and app development | Infrastructure and software | Define governance for regulated data and plan lifecycle with compliance measures. | Assign AI accountability and adhere to industry regulations. |