The Channel logo


By | Gavin Clarke 28th September 2015 16:02

Microsoft preps Azure data lake flood gates for readiness

And yes, it’ll feature analytics as a service

Microsoft will later this year release its open-source friendly lake for big-data analytics in the cloud.

Azure Data Lake Store – announced at Build in April – will be released as a preview, Microsoft said Monday. The store will be built on Apache YARN for developers and data scientists, to analyse information, and will use Azure HDInsight – a managed service for Hadoop, Spark, Storm and Hbase.

HDInsight was developed by Microsoft working with Ubuntu-shop Canonical and Hadoop spinner Hortonworks, Microsoft and Canonical said. In preparation for the preview Microsoft Monday threw the doors open on managed Linux clusters.

Microsoft’s Visual Studio Tools, meanwhile, have been updated to build, debug and tune for Hive queries and Storm topologies running in HDInsight.

YARN is the HDFS-compatible Apache project that makes MapReduce more flexible because it decouples resource management and scheduling from data processing.

The idea is you can support a broader variety of applications.

Microsoft’s data lake – a phrase now with huge currency among the big-data analytics and infrastructure providers – will feature analytics as a service.

Data Lake Analytics will use Microsoft’s U-SQL language it claims “unifies the benefits of SQL with the express power of user code". You’ll use U-SQL to analyse data in Azure, Azure SQL Database, and Azure SQL Datawarehouse.

The firm billed Azure Data Lake Store as HDRS for the cloud, capable of chomping petabyte files and that would be “enterprise ready". ®

comment icon Be the first to post a comment! alert Send corrections


Frank Jennings

What do you do? Use manual typwriters or live in a Scottish croft? Our man advises
A rusty petrol pump at an abandoned gas station. Pic by Silvia B. Jakiello via shutterstock

Trevor Pott

Among other things, Active Directory needs an overhaul
Baby looks taken aback/shocked/affronted. Photo by Shutterstock

Kat Hall

Plans for 2 million FTTP connections in next four years 'not enough'
Microsoft CEO Satya Nadella


League of gentlemen poster - Tubbs and Edward at the local shop. Copyright BBC
One reselling man tells his tale of woe