LINQ to HPC and the Distributed Storage Catalog (DSC) help developers write programs that use cluster-based computing to manipulate and analyze very large data sets. LINQ to HPC and the DSC include services that run on a Windows® High Performance Computing (HPC) cluster or in a Windows Azure Scheduler deployment in Windows Azure, as well as client-side features that are invoked by applications.


This will be the final preview of LINQ to HPC and we do not plan to move forward with a production release. In line with our announcement in October at the PASS conference, we will focus our effort on bringing Apache Hadoop to both Windows Server and Windows Azure. For more information, see Microsoft to develop Hadoop distributions for Windows Server and Azure and Microsoft Expands Data Platform to Help Customers Manage the ‘New Currency of the Cloud’.

LINQ to HPC, and the DSC support data-intensive computing for many types of applications, such as data mining, image processing, and scientific computing. Where possible, LINQ to HPC co-locates a subset of the data, and the computational logic that processes that data, on the same computer. This proximity is known as data locality. With data locality, you can scale up data-intensive applications by adding more computers to the cluster. With a large enough cluster, you can use LINQ to HPC to store petabytes of data and execute queries across terabyte-sized data sets.

In This Section

Topic Description

Overview of LINQ to HPC and the Distributed Storage Catalog (Beta 2)

Discusses the components that make up the LINQ to HPC system, and gives an overview of how a LINQ to HPC query executes

Setting Up a Development Environment for LINQ to HPC

Includes the requirements and resources to help you set up your development environment and the steps to add nodes to the DSC.

Trying the LINQ to HPC SDK Sample Code

Describes how to use the code samples that are included in the SDK download.

LINQ TO HPC Programmer's Guide (Beta 2)

Focuses on the client-side components that developers use to create LINQ to HPC applications

Microsoft.Hpc.Linq Namespace

LINQ to HPC, Dryad, and DSC DevLabs Forum