HDInsight Big Data Talks from #SQLPASS
SQL PASS Summit 2013 was another great data geek week! I chatted with many of you about Big Data, Hadoop, HDInsight, architecting solutions, SQL Server, data, BI, analytics, and general geekiness - great fun! This time around I delivered two talks on Hadoop and HDInsight - the slides from both are attached.
Zero to 60 with HDInsight takes you from an overview of Big Data and why it matters (zero) all the way through an end to end solution (60). We discussed how to create an HDInsight cluster with the Azure portal or PowerShell and talked through the architecture of the data and analysis behind the release of Halo 4. We talked about how you could use the same architectural pattern for many projects and walked through Hive and Pig script examples. We finished up with how to use Power Map (codename GeoFlow) over that data to gain new insights and improve the game experience for the end user.
The next session I co-presented with HDInsight PM Dipti Sangani: CAT: From Question to Insight with HDInsight and BI. We went deeper this time. Not only did we present an end to end story with how our own internal Windows Azure SQL Database team uses telemetry to improve your experience with SQL Server in Azure PaaS but we also went deeper with demos of Hive, Pig, and Oozie. We also gave another archetypical design scenario that will apply to many of your own scenarios and talked about how HDInsight fits with SQL Server and your other existing infrastructure. The deck covers your cloud and on-premises options for Hadoop on Windows including HDInsight Service, Hortonworks HDP for Windows, OneBox, and PDW with Polybase.
Please let me know if you have any questions from the talks or just general HDInsight questions!
Comments
- Anonymous
October 24, 2013
I attended your session from #SQLPASS. Great Session.I noticed on HDInsight demos there is a book as an example. How do you change the book to something else of your choice? Say like a large text file instead or a different book?ThanksAndy - Anonymous
October 30, 2013
Are you referring to the DaVinci WordCount sample? If you want to use additional files you can add them to the directory used in the sample code, or you can change the directory the sample points to. See www.windowsazure.com/.../howto-run-samples for more information.