Azure Data Lake & Azure HDInsight Blog
The official blog for the Azure Data Lake services - Azure Data Lake Analytics, Azure Data Lake Store and Azure HDInsight
Introducing U-SQL database projects – U-SQL database development and deployment made easy (public preview)
Today we are pleased to introduce the U-SQL database project, a new project type in Azure Data Lake...
Date: 07/31/2018
Build hybrid cloud analytics solutions with ADLA Task in SSIS
Today, we are pleased to announce new support for the Azure Data Lake Analytics Task (ADLA Task) in...
Date: 07/23/2018
Easier Azure Data Lake Store management: alerts for folders and files.
The massive scale and capabilities of Azure Data Lake Store are regularly used by companies for big...
Date: 06/19/2018
Process more files than ever and use Parquet with Azure Data Lake Analytics
In a recent release, Azure Data Lake Analytics (ADLA) takes the capability to process large amounts...
Date: 06/11/2018
Azure Data Lake Analytics and U-SQL Spring 2018 Updates: Parquet support, small files, dynamic output, fast file sets, and much more!
Hello Azure Data Lake and U-SQL fans and followers. It is high time for the release notes for all...
Date: 06/11/2018
Get started with U-SQL: It’s easy!
Azure Data Lake Analytics combines declarative and imperative concepts in the form of a new language...
Date: 05/26/2018
Keeping Data Lake Costs Under Control: Creating Alerts for AUs Usage Thresholds.
Have you ever been surprised by a larger-than-expected monthly Azure Data Lake Analytics bill?...
Date: 04/23/2018
Simple Trick to Stay on top of your Azure Data Lake: Create Alerts using Log Analytics
If you manage one or more Azure Data Lake accounts, do you ever find it hard to stay on top of...
Date: 04/10/2018
Using the first job run to optimize subsequent runs with Azure Data Lake job AU analyzer
Customers have been telling us it's hard to find the right balance between Analytics Units (AUs) and...
Date: 03/30/2018
Delivering Consistency and Accuracy: Improvements for Azure Data Lake Store Reporting
Have you ever uploaded a 70GB file from Windows into your Azure Data Lake Store and noticed that the...
Date: 03/05/2018
Struggling to get insights for your Azure Data Lake Store? Azure Log Analytics can help!
Customers love to use Azure Data Lake across their organizations by enabling their Data Lake...
Date: 02/06/2018
From unstructured data to dashboard with Azure Data Factory and Azure Data Lake
When I joined the Big Data team at Microsoft, sifting through all the technologies and products left...
Date: 01/25/2018
Debugging Azure Data Lake Job Failures Made Easy (part 2) - Efficiently troubleshoot anomalies in recurring jobs
Azure Data Lake Analytics recently announced advanced job tracking and management features that make...
Date: 01/16/2018
How to Save Money and Control Costs with Azure Data Lake Analytics
Where there is great power there is great responsibility -Winston Churchill Azure Data Lake...
Date: 01/08/2018
Debugging Azure Data Lake Job Failures Made Easy (part 1) - Debug U-SQL job failure of C# custom code
Working with large datasets is hard -- when developers build big data applications, it is impossible...
Date: 12/08/2017
Ad-hoc query support in Azure Data Lake Tools for Visual Studio
Developers using Azure Data Lake Tools for Visual Studio can now create single U-SQL scripts without...
Date: 11/29/2017
Run your PySpark Interactive Query and batch Job in Visual Studio Code
We are excited to introduce the integration of HDInsight PySpark into Visual Studio Code (VSCode),...
Date: 11/22/2017
Getting new insights into your usage of Data Lake Analytics
Users of Azure Data Lake Analytics consistently ask for more insights about their usage for both...
Date: 11/18/2017
Find your U-SQL jobs in Azure Data Lake Analytics with one click.
If your Data Lake Analytics account is heavily used, you might have to scroll through a long list of...
Date: 11/14/2017
Organize your pipeline and recurring jobs easily with Data Lake Analytics (part 2)
Identify performance problems and reduce failed jobs with pipeline and recurring job information In...
Date: 11/01/2017
Continuous integration made easy with MSBuild support for U-SQL (preview)
Azure Data Lake provides enterprise ready big data as a service on Azure. A key requirement of...
Date: 10/24/2017
Simple database copies with the Azure Data Lake Database Export Wizard
Azure Data Lake Tools for Visual Studio now provides the ability to export all or part of a database...
Date: 10/20/2017
Organize your pipeline and recurring jobs easily with Data Lake Analytics (part 1)
Tagging and exploring pipeline and recurring jobs with metadata In a previous blog post, we...
Date: 10/19/2017
Azure Data Lake Tools for Visual Studio Code (VSCode) October Updates
If you are a data scientist looking for a lightweight code editor for U-SQL, try ADL Tools for...
Date: 10/19/2017
Azure Data Lake Analytics and U-SQL Summer 2017 Updates: Introducing GZip on OUTPUT, Catalog Views, Major updates to Cognitive Libraries, Tool support to create your EXTRACT statement and much more!
Hello Azure Data Lake and U-SQL fans and followers. It has been a while since we release the release...
Date: 10/05/2017
Managing Pipeline & Recurring Jobs in Azure Data Lake Analytics Made Easy
Azure Data Lake Analytics (ADLA) is a big data job service that enables you to develop and run data...
Date: 09/19/2017
Directly store streaming data into Azure Data Lake with Azure Event Hubs Capture Provider
Azure Data Lake (ADL) customers use Azure Event Hubs extensively for ingesting streaming data - but...
Date: 08/28/2017
U-SQL Tip: Generating ranges of numbers and dates
Many common scenarios for U-SQL developers require constructing a RowSet made up of a...
Date: 08/18/2017
Running XGBoost on Azure HDInsight
XGBoost is a popular open-source distributed gradient boosting library used by many companies in...
Date: 08/18/2017
Create U-SQL EXTRACT Script Automatically
In this blog, you will learn how to create U-SQL EXTRACT script automatically using the latest...
Date: 08/08/2017
Analyze data in Azure Data Lake Store using familiar-and-powerful Excel 2016
We are excited to announce that as part of the June 2017 updates of Excel 2016, Azure Data Lake...
Date: 07/19/2017
Azure Data Lake Tools for Visual Studio Code (VSCode) July updates
We are pleased to announce the July updates of Azure Data Lake Tools for VSCode. This is a quality...
Date: 07/14/2017
Solving the problem of "Problem with the SSL CA cert (path? access rights?)" for R server on HDInsight
R Server on HDInsight is an ideal platform for performing big data analysis using R interface. If...
Date: 07/07/2017
Webinar with Talena: Migrate open source big data applications to HDInsight, add backup & restore to your existing apps running on Apache Hadoop & Spark
“Are you building Big data applications using open source platforms such as Apache Hadoop or Spark,...
Date: 06/28/2017
Run H2O.ai in R on Azure HDInsight
This blog post is authored by Daisy Deng, Abhinav Mithal in Cloud AI group at Microsoft In our...
Date: 06/26/2017
Microsoft R Server 9.1 on HDInsight is available!
Today, we are excited to announce that Microsoft R Server 9.1 on Azure HDInsight is generally...
Date: 06/19/2017
Managing Your Azure Data Lake Analytics Compute Resources (Job-level Policy)
In Managing Your Azure Data Lake Analytics Compute Resources (Overview) and Account Level Policy, we...
Date: 06/08/2017
Managing Your Azure Data Lake Analytics Compute Resources (Account-level Policy)
In Managing Your Azure Data Lake Analytics Compute Resources (Overview), we introduced why customers...
Date: 06/08/2017
Managing Your Azure Data Lake Analytics Compute Resources (Overview)
Azure Data Lake Analytics (ADLA) is a powerful job service that allows organizations to run small or...
Date: 06/08/2017
Announcing Microsoft Machine Learning Library for Apache Spark
This post is authored by Roope Astala, Senior Program Manager, and Sudarshan Raghunathan, Principal...
Date: 06/08/2017
HDInsight tools for IntelliJ May updates
The primary focus for our May updates is to make the Spark development work easier for you in...
Date: 06/01/2017
HDInsight : BUILD Hive Lab is available now
Got some time to learn Big Data Technologies? How about starting with Hive which is considered...
Date: 05/31/2017
Azure HDInsight: How to run Presto in one simple step and query across data sources such as Cosmos DB, SQL DB & Hive
I have seen in past few months many inquiries on how to run Presto in HDInsight. In this post we...
Date: 05/18/2017
Webinar with Datameer: Modern Data Preparation, Analytics and Insights - Key ingredients for an ML- and AI-ready organization
“Excited about using Big Data to build intelligent applications, but unsure of how to proceed?” Join...
Date: 05/17/2017