<?xml version="1.0" encoding="utf-8"?>
<rss xmlns:atom="https://www.w3.org/2005/Atom" xmlns:sy="https://purl.org/rss/1.0/modules/syndication/" xmlns:dc="https://purl.org/dc/elements/1.1/" xmlns:content="https://purl.org/rss/1.0/modules/content/" xmlns:wfw="https://wellformedweb.org/CommentAPI/" xmlns:slash="https://purl.org/rss/1.0/modules/slash/"
  version="2.0">
  <channel>
    <title>Microsoft "Data Explorer" Preview for Excel</title>
    <atom:link
      href="https://docs.microsoft.com/archive/blogs/dataexplorer/feed.xml"
      rel="self"
      type="application/rss+xml" />
    <link>https://docs.microsoft.com/archive/blogs/dataexplorer/feed.xml</link>
    <description />
    <lastBuildDate>Wed, 17 Apr 2019 03:20:41 GMT</lastBuildDate>
    <language>en-US</language>
    <sy:updatePeriod>hourly</sy:updatePeriod>
    <sy:updateFrequency>1</sy:updateFrequency>
    <item>
      <title>"Data Explorer" is now Microsoft Power Query for Excel</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/data-explorer-is-now-microsoft-power-query-for-excel</link>
      <pubDate>Sat, 06 Jul 2013 11:23:00 GMT</pubDate>
      <dc:creator><![CDATA[Faisal Mohamood [MSFT]]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/07/06/data-explorer-is-now-microsoft-power-query-for-excel/</guid>
      <description><![CDATA[Along with the Power BI related announcements at the Worldwide Partner Conference on July 8 2013, we...]]></description>
      <content:encoded><![CDATA[<p><span style="font-family: 'Calibri','sans-serif'; font-size: 11pt; mso-fareast-font-family: Calibri; mso-fareast-theme-font: minor-latin; mso-bidi-font-family: 'Times New Roman'; mso-ansi-language: EN-US; mso-fareast-language: EN-US; mso-bidi-language: AR-SA;">Along with the Power BI related announcements at the <a href="https://www.digitalwpc.com">Worldwide Partner Conference</a> on July 8 2013, we are pleased to announce that Microsoft Power Query for Excel (previously known as codename &ldquo;Data Explorer&rdquo;) has reached General Availability and <a href="https://go.microsoft.com/fwlink/?LinkID=313430">is now available for download</a>. Please follow the Power BI blog for future updates and how-to articles on Power Query. We also announced the upcoming preview of Power BI for Office 365, to learn more visit us at <a href="https://office.com/powerbi">office.com/powerbi</a></span></p>]]></content:encoded>
    </item>
    <item>
      <title>Watch the Data Explorer session at TechEd North America 2013</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/watch-the-data-explorer-session-at-teched-north-america-2013</link>
      <pubDate>Mon, 17 Jun 2013 09:01:05 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/06/17/watch-the-data-explorer-session-at-teched-north-america-2013/</guid>
      <description><![CDATA[As many of you may know, TechEd North America happened a couple of weeks ago in New Orleans (LA)....]]></description>
      <content:encoded><![CDATA[<p>As many of you may know, TechEd North America happened a couple of weeks ago in New Orleans (LA). During the event, there were quite a few sessions showcasing Data Explorer (including the <a href="https://channel9.msdn.com/Events/TechEd/NorthAmerica/2013/Key01#fbid=uPa6uPaH_w6">Day 1 Keynote</a>), but we wanted to specifically call out <a href="https://channel9.msdn.com/Events/Speakers/faisal-mohamood"><strong>Faisal Mohamood</strong></a>’s session: <a href="https://channel9.msdn.com/Events/TechEd/NorthAmerica/2013/DBI-B225#fbid=uPa6uPaH_w6"><strong>Microsoft “Data Explorer” for Excel – Discover, Combine and Refine your data</strong></a>.</p>  <p>During the session, Faisal introduced the value proposition for Data Explorer as well as described some of the most common challenges in data acquisition and transformation for self-service BI. He also spent a big portion of the session showing demos with “real world data” so we definitely recommend you take a look!</p>  <p>You can watch it online or <a href="https://channel9.msdn.com/Events/TechEd/NorthAmerica/2013/DBI-B225#fbid=uPa6uPaH_w6"><strong>download it from Channel 9</strong></a> to watch it later.</p>  <p>&#160;</p>  <p align="center"><video style="width: 648px; height: 388px;" controls="controls" poster="https://video.ch9.ms/sessions/teched/na/2013/DBI-B225-LG.jpg"><source type="video/mp4" src="https://media.ch9.ms/ch9/8ef3/d4a857ee-e03d-4500-92a2-30a687f78ef3/DBI-B225_mid.mp4"></source><source type="video/webm" src="https://media.ch9.ms/ch9/8ef3/d4a857ee-e03d-4500-92a2-30a687f78ef3/DBI-B225.webm"></source></video></p>  <p>&#160;</p>  <p>Enjoy!</p>]]></content:encoded>
    </item>
    <item>
      <title>Using Data Explorer and Geoflow to decide where to go for dinner!</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/using-data-explorer-and-geoflow-to-decide-where-to-go-for-dinner</link>
      <pubDate>Fri, 14 Jun 2013 08:57:00 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/06/14/using-data-explorer-and-geoflow-to-decide-where-to-go-for-dinner/</guid>
      <description><![CDATA[Data Explorer and Geoflow are the new additions to the Self-Service BI tools in Excel. But as you...]]></description>
      <content:encoded><![CDATA[<p>Data Explorer and Geoflow are the new additions to the Self-Service BI tools in Excel. But as you will see in this post, Self-Service BI can become truly personal depending on the nature of the questions that you are trying to answer&hellip;</p>
<p>This got demonstrated yesterday in a blog post on the Microsoft BI blog: <a href="https://blogs.msdn.com/b/microsoft_business_intelligence1/archive/2013/06/13/surfing-restaurant-inspections-with-microsoft-data-explorer-and-geoflow.aspx">Surfing Restaurant Inspections with Microsoft Data Explorer and Geoflow</a></p>
<p>==========================================================================================</p>
<p>&nbsp;</p>
<p>Father&rsquo;s Day is approaching and you might be thinking about a good place to have a nice lunch with your Dad&hellip; We would like to show you how <a href="https://office.microsoft.com/en-us/excel/download-data-explorer-for-excel-FX104018616.aspx?WT.mc_id=Blog_BI_Demo_DataExplorer">Data Explorer</a> and <a href="https://office.microsoft.com/en-us/download-geoflow-for-excel-FX104036784.aspx?WT.mc_id=Blog_BI_Demo_DataExplorer">Geoflow</a> can help you gather some insights to make a good decision.</p>
<p>In order to achieve this, we will look at publicly available data about Food Establishment Inspections for the past 7 years and we will also leverage the Yelp API to bring ratings and reviews for restaurants. For the purpose of this post, we will focus on the King County area (WA) but you can try to find local data about Food Establishment inspections for your area too.</p>
<p>What you will need:</p>
<ul>
<li><a href="https://www.microsoft.com/en-us/download/details.aspx?id=36803">Data Explorer</a>.</li>
<li><a href="https://www.microsoft.com/en-us/download/details.aspx?id=38395">Geoflow</a>.
<ul>
<li>Access to the following data:</li>
<li>Food Establishment Inspections data from datakc.org (<a href="https://www.datakc.org/dataset/Food-Establishment-Inspection-Data/f29f-zza5">more details</a>):</li>
</ul>
<ul>
<ul>
<li>We will link to this URL (which points to the CSV file version of the data) using Data Explorer: <a href="https://www.datakc.org/api/views/pph9-v8tz/rows.csv?accessType=DOWNLOAD">https://www.datakc.org/api/views/pph9-v8tz/rows.csv?accessType=DOWNLOAD</a></li>
</ul>
</ul>
<ul>
<li>Yelp API (<a href="https://www.yelp.com/developers">more details</a>):</li>
</ul>
<ul>
<ul>
<li>You will need to sign up for an API key before being able to connect. Please also make sure to read the Yelp API Terms of Use before using this API.</li>
</ul>
</ul>
</li>
</ul>
<p>What you will learn in this post:</p>
<ul>
<li>Import data from the Yelp Web API (JSON) using Data Explorer.</li>
<li>Import public data about Food Establishment Inspections from a CSV file.</li>
<li>Reshape the data in your queries.</li>
<li>Parameterize the Yelp query by turning it into a function, using the Data Explorer formula language, so you can reuse it to retrieve information about different types of restaurants as well as different geographical locations.</li>
<li>Invoke a function given a set of user-defined inputs in an Excel table.</li>
<li>Combine (Merge) two queries.</li>
<li>Load the final query into the Data Model.</li>
<li>Visualize the results in Geoflow.</li>
</ul>
<p>That sounds like too much for a single blog post, but let&rsquo;s get started and you&rsquo;ll see how it is easier than you might think.</p>
<p><span style="text-decoration: underline;">Import data from Yelp API</span></p>
<p>The first thing that we will have to do is click the &ldquo;From Web&rdquo; button in the Data Explorer ribbon tab. Data Explorer supports importing data from different kinds of Web sources, including scrapping tables from HTML pages, as well as importing data from Web APIs. Data Explorer supports XML, JSON and OData formats.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/6663.Import-Data-From-Yelp-API_5403EB74.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/6663.Import_2D00_Data_2D00_From_2D00_Yelp_2D00_API_5F00_5403EB74.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Import Data From Yelp API" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7774.Import-Data-From-Yelp-API_thumb_01850B38.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7774.Import_2D00_Data_2D00_From_2D00_Yelp_2D00_API_5F00_thumb_5F00_01850B38.png" alt="Import Data From Yelp API" width="552" height="367" border="0" /></a></p>
<p>Taking a look at the Yelp API documentation, you will find that they offer a Search API which accepts multiple GET parameters to customize your query, including a search term (i.e. restaurants, sushi, seafood, etc.), a location (i.e. &ldquo;Seattle&rdquo;, &ldquo;98052&rdquo;, lat/long information) and a few others. Finally we also need to provide the API Key that we will receive after registering for this API (wsid parameter).</p>
<p>With that in mind, let&rsquo;s paste in Data Explorer the following URL which will return Seafood restaurants in Redmond (note that you will have to replace the wsid value with your own key).</p>
<p>https://api.yelp.com/business_review_search?term=seafood&amp;location=Redmond &amp;ywsid=XXXXXX</p>
<p>We will get a result that looks like a single column table with one row, containing text data which, in fact, is structured as JSON. We can interpret this text as JSON by right-clicking in the column header and selecting &ldquo;Transform -&gt; JSON&rdquo;.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/1325.Results-structured-as-JSON_75EF4DF8.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/1325.Results_2D00_structured_2D00_as_2D00_JSON_5F00_75EF4DF8.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Results structured as JSON" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/5141.Results-structured-as-JSON_thumb_5F30066F.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/5141.Results_2D00_structured_2D00_as_2D00_JSON_5F00_thumb_5F00_5F30066F.png" alt="Results structured as JSON" width="521" height="329" border="0" /></a></p>
<p>Now as a result we get a record which we can expand and select which fields to include in the output. Having used the Yelp API before, we know that the &ldquo;businesses&rdquo; field is the one that contains the list of restaurants that we are looking for, so we can just expand that one by unselecting &ldquo;message&rdquo; in the Expand menu and clicking &ldquo;OK&rdquo;.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/5164.Query_17DAB07D.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/5164.Query_5F00_17DAB07D.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Query" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7711.Query_thumb_539A4930.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7711.Query_5F00_thumb_5F00_539A4930.png" alt="Query" width="453" height="309" border="0" /></a></p>
<p>This will return a single cell containing a list, which we can expand using the same mechanism again and turn it into a bunch of records, one per restaurant. Now we can decide which columns to expand, containing different information about each restaurant such as Name, Lat/Long information, Rating, etc. We will expand the following columns: city, review_count, latitude, address1, name, avg_rating and longitude.</p>
<p>Now we have the list of Seafood restaurants into a tabular shape, and after applying some column renames and reordering the columns, we can get to the following shape.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/6165.Seafood-restaurants-in-Redmond_7A685F70.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/6165.Seafood_2D00_restaurants_2D00_in_2D00_Redmond_5F00_7A685F70.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Seafood restaurants in Redmond" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/3438.Seafood-restaurants-in-Redmond_thumb_633CE4F2.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/3438.Seafood_2D00_restaurants_2D00_in_2D00_Redmond_5F00_thumb_5F00_633CE4F2.png" alt="Seafood restaurants in Redmond" width="587" height="370" border="0" /></a></p>
<p>That was actually easy&hellip; At the end, all we&rsquo;ve done is define a set of data acquisition and transformation steps, which get recorded in the Steps pane on the right side of the Query Editor dialog. This Query Editor dialog is an easy-to-use interface for defining these steps, which get translated into the corresponding set of Data Explorer formulas (you can access them by clicking the script icon to the right end of the formula bar).</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/1200.Seafood-restaurants-in-Redmond---Edit-Query_30D91173.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/1200.Seafood_2D00_restaurants_2D00_in_2D00_Redmond_2D002D002D00_Edit_2D00_Query_5F00_30D91173.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Seafood restaurants in Redmond - Edit Query" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/2804.Seafood-restaurants-in-Redmond---Edit-Query_thumb_12FA8D72.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/2804.Seafood_2D00_restaurants_2D00_in_2D00_Redmond_2D002D002D00_Edit_2D00_Query_5F00_thumb_5F00_12FA8D72.png" alt="Seafood restaurants in Redmond - Edit Query" width="585" height="370" border="0" /></a></p>
<p>&nbsp;</p>
<p><strong><span style="text-decoration: underline;">Parameterizing our Yelp API query</span></strong></p>
<p>As we saw in the previous section, we can customize our Yelp Search by modifying the GET parameters in the URL. We can also make our Data Explorer query parameterized by turning it into a function, which can take input parameters and use them within the function body. In order to do this, we just need to add the following first line to our query script and use the parameters in the first step (Source). Finally, we can also rename our query to GetRestaurants.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7041.GetRestaurants_52584102.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7041.GetRestaurants_5F00_52584102.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="GetRestaurants" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/6557.GetRestaurants_thumb_6D909A03.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/6557.GetRestaurants_5F00_thumb_5F00_6D909A03.png" alt="GetRestaurants" width="575" height="291" border="0" /></a></p>
<p>This was very straightforward, but if you want to learn more about Data Explorer functions you can take a look at the Language and Library Specifications. There&rsquo;s more cool stuff waiting for you there!</p>
<p>&nbsp;</p>
<p><strong><span style="text-decoration: underline;">Invoking the GetRestaurants function</span></strong></p>
<p>Now that we have a function, it would be a good thing to learn how to invoke it&hellip; There&rsquo;re basically three ways in which you can invoke a function:</p>
<ul>
<li><strong>Invoking the function &ldquo;inline&rdquo;</strong>: Simply open the query editor for your function query and click Invoke. You will get asked for parameters as needed. This is a very quick way of invoking the function, however it defeats the purpose of reusability since at this point the function will no longer be available from outside this query (given that the result is a table).</li>
</ul>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/6562.Invoking-the-function-inline_69F74388.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/6562.Invoking_2D00_the_2D00_function_2D00_inline_5F00_69F74388.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Invoking the function inline" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/0726.Invoking-the-function-inline_thumb_57AE7CC6.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/0726.Invoking_2D00_the_2D00_function_2D00_inline_5F00_thumb_5F00_57AE7CC6.png" alt="Invoking the function inline" width="328" height="185" border="0" /></a></p>
<ul>
<li><strong>Referencing the function</strong>: You can use the Reference option in the Query ribbon tab to create a new query in the workbook that references the current query. In this case, we could do this and be able to invoke our function from a new query.</li>
<li><strong>Invoking the function over a table</strong>: We can also use the &ldquo;Insert Custom Column&rdquo; option from a different query in order to invoke a function across all rows in the table. We can also make the function parameters be based on other columns from the table.</li>
</ul>
<p>The third method is the one that we will use in this example, so for instance we could create a table with different cities in the King County area and invoke the GetRestaurants function for each row, so that we can get restaurants for each of the cities in the list.</p>
<p>First, we will create a table in the Excel sheet containing a list of cities, such as Redmond, Bellevue, Seattle, Kirkland, Issaquah and Sammamish.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/3252.Create-a-table-with-a-list-of-cities_169B3900.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/3252.Create_2D00_a_2D00_table_2D00_with_2D00_a_2D00_list_2D00_of_2D00_cities_5F00_169B3900.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Create a table with a list of cities" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/1614.Create-a-table-with-a-list-of-cities_thumb_364A12C8.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/1614.Create_2D00_a_2D00_table_2D00_with_2D00_a_2D00_list_2D00_of_2D00_cities_5F00_thumb_5F00_364A12C8.png" alt="Create a table with a list of cities" width="563" height="374" border="0" /></a></p>
<p>Now we can go to the Data Explorer tab and click the &ldquo;From Table&rdquo; option. This will create a new query that references the sheet table. We can insert a custom column into this table by clicking on the table icon on the top-left corner of the table and selecting &ldquo;Insert -&gt; Custom&hellip;&rdquo;</p>
<p>In the &ldquo;Insert Custom Column&rdquo; dialog, we can type in any custom formula using the Data Explorer formula language. In this case, we will simply invoke the GetRestaurants function using the following formula:</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/0636.Insert-Custom-Column_068EFAFA.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/0636.Insert_2D00_Custom_2D00_Column_5F00_068EFAFA.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Insert Custom Column" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/4834.Insert-Custom-Column_thumb_186B8EC7.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/4834.Insert_2D00_Custom_2D00_Column_5F00_thumb_5F00_186B8EC7.png" alt="Insert Custom Column" width="484" height="246" border="0" /></a></p>
<p>At this point, we will be asked for information about the privacy level of my workbook data. This is done so that users don&rsquo;t accidentally leak data from a private or organizational source and inadvertently send it to a public source (like the Yelp API in this case). We will select &ldquo;Public&rdquo; in this case. You can learn more about Privacy Levels in Data Explorer in our Online Help pages.</p>
<p>After providing this information, the new column will be added to the table. Note that we have a new column with nested tables on each row (containing the restaurants for each of the cities) and we can expand these columns similarly to how we did earlier with the JSON records. We can also remove the &ldquo;Cities&rdquo; column since we don&rsquo;t need it anymore.</p>
<p>Once we have expanded all columns, you may find that there are some duplicated rows. This is due to the fact that the Yelp API may return restaurants within a radius up to 25 miles (which can also be customized in the Yelp API parameters) so a given restaurant in Seattle might be returned when searching within Seattle and Bellevue, for instance. We can get rid of duplicated rows by selecting &ldquo;Remove Duplicates&rdquo; in the table menu (top-left corner of the table). This will leave us with approximately 60 candidate seafood restaurants, with their ratings and total number of reviews, as well as location information (Address, City, Lat and Long). We can select the Ratings, Review_Count, Latitude and Longitude columns and make sure they are formatted as Number by right-clicking the column headers and selecting &ldquo;Change Type -&gt; Number&rdquo;. Finally, let&rsquo;s also rename the query to &ldquo;Seafood restaurants in King County&rdquo;.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3632.image_47C9D8F2.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3632.image_5F00_47C9D8F2.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="image" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1768.image_thumb_6A4619C0.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1768.image_5F00_thumb_5F00_6A4619C0.png" alt="image" width="569" height="362" border="0" /></a></p>
<p>With this, we have the list of restaurants in the desired shape&hellip; We could just pick the highest rated restaurant in the list and make a reservation for Father&rsquo;s Day, but of course we want to know first what the King County Food Establishment Inspections records have to say about each of these restaurants&hellip;</p>
<p>&nbsp;</p>
<p><strong><span style="text-decoration: underline;">Import public data about Food Establishment Inspections from a CSV file</span></strong></p>
<p>The next step in our scenario is to bring in public data from datakc.org (King County&rsquo;s public data web site). We found <a href="https://www.datakc.org/dataset/Food-Establishment-Inspection-Data/f29f-zza5">this dataset</a> which seems suitable for our needs, since it contains information about food inspections for the past 7 years, as well as the Name, Address and City for these restaurants (which we also have in our Seafood Restaurants query).</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/8877.Import-public-data-about-food-establishment-inspections-from-a-CSV-file_73705EFE.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/8877.Import_2D00_public_2D00_data_2D00_about_2D00_food_2D00_establishment_2D00_inspections_2D00_from_2D00_a_2D00_CSV_2D00_file_5F00_73705EFE.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Import public data about food establishment inspections from a CSV file" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/0572.Import-public-data-about-food-establishment-inspections-from-a-CSV-file_thumb_29E11101.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/0572.Import_2D00_public_2D00_data_2D00_about_2D00_food_2D00_establishment_2D00_inspections_2D00_from_2D00_a_2D00_CSV_2D00_file_5F00_thumb_5F00_29E11101.png" alt="Import public data about food establishment inspections from a CSV file" width="564" height="356" border="0" /></a></p>
<p>We can get to the CSV version of this dataset by clicking the Export option in the top-right corner of the page and we will get this URL for CSV: <a href="https://www.datakc.org/api/views/pph9-v8tz/rows.csv?accessType=DOWNLOAD">https://www.datakc.org/api/views/pph9-v8tz/rows.csv?accessType=DOWNLOAD</a></p>
<p>This link can be used directly in Data Explorer, either using &ldquo;From Web&rdquo; or &ldquo;From File -&gt; CSV&rdquo;&hellip;</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/3034.Link-can-be-used-directly_7E304704.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/3034.Link_2D00_can_2D00_be_2D00_used_2D00_directly_5F00_7E304704.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Link can be used directly" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7220.Link-can-be-used-directly_thumb_5E153A47.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7220.Link_2D00_can_2D00_be_2D00_used_2D00_directly_5F00_thumb_5F00_5E153A47.png" alt="Link can be used directly" width="538" height="196" border="0" /></a></p>
<p>Once we have the inspections data loaded as a table, we can reshape it a little bit as we did earlier. The experience in the Query Editor is consistent regardless of what the underlying data sources look like on each case. We&rsquo;ll do the following:</p>
<ul>
<li>Remove all columns except the following ones: Name, Address, City, Inspection Type, Inspection Result and Violation Description.</li>
<li>We would like to focus only on the Unsatisfactory reviews, so we can filter the Inspection Result to only include those values.</li>
</ul>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/1423.Reshape-after-inspections-data-is-loaded-as-a-table_1DDF20CD.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/1423.Reshape_2D00_after_2D00_inspections_2D00_data_2D00_is_2D00_loaded_2D00_as_2D00_a_2D00_table_5F00_1DDF20CD.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Reshape after inspections data is loaded as a table" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/4478.Reshape-after-inspections-data-is-loaded-as-a-table_thumb_2FBE454B.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/4478.Reshape_2D00_after_2D00_inspections_2D00_data_2D00_is_2D00_loaded_2D00_as_2D00_a_2D00_table_5F00_thumb_5F00_2FBE454B.png" alt="Reshape after inspections data is loaded as a table" width="570" height="360" border="0" /></a></p>
<ul>
<li>You will also notice that the Name and City columns contain values on uppercase and lowercase&hellip; This is something that we need to &ldquo;normalize&rdquo; so that when we combine this query with the Yelp Restaurants list we get matching rows. Let&rsquo;s select the Name and City columns and use the &ldquo;Transform -&gt; Uppercase&rdquo; option in the column menu (right-click in column header).</li>
<li>Finally, let&rsquo;s rename this query to Inspections and we will end up with a table similar to this one:</li>
</ul>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/6014.Inspections_1FB20745.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/6014.Inspections_5F00_1FB20745.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Inspections" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/0741.Inspections_thumb_77A1E8D6.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/0741.Inspections_5F00_thumb_5F00_77A1E8D6.png" alt="Inspections" width="602" height="380" border="0" /></a></p>
<p>The next thing we need to do is go back to the Seafood Restaurants query and also turn the Name and City columns into Uppercase, as a preparation for being able to merge the two queries based on these columns.</p>
<p>&nbsp;</p>
<p><strong><span style="text-decoration: underline;">Combining Yelp Restaurants list with Food Inspections data</span></strong></p>
<p>Once we&rsquo;ve normalized Name and City columns in both queries, we can go ahead and merge the two queries by using the Merge option in the Data Explorer ribbon tab. Before doing that, let&rsquo;s enable Fast Combine for this workbook. This will turn off the Privacy Levels check for queries being combined in this workbook and we know that, since we already marked both as Public, this is OK. After enabling Fast Combine, we can click Merge.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/1667.Combining-Yelp-restaurants-with-food-inspection-data_39A85818.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/1667.Combining_2D00_Yelp_2D00_restaurants_2D00_with_2D00_food_2D00_inspection_2D00_data_5F00_39A85818.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Combining Yelp restaurants with food inspection data" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/3731.Combining-Yelp-restaurants-with-food-inspection-data_thumb_1C36070C.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/3731.Combining_2D00_Yelp_2D00_restaurants_2D00_with_2D00_food_2D00_inspection_2D00_data_5F00_thumb_5F00_1C36070C.png" alt="Combining Yelp restaurants with food inspection data" width="690" height="121" border="0" /></a></p>
<p>This will launch the Merge dialog where we can select the two queries to merge as well as the columns to match. We will pick the Seafood Restaurants query as the left query, so that we augment this table with inspections data for those restaurants where the information is available in the Inspections table. We will multi-select (CTRL+Click) the Name and City columns in both queries to specify that both columns have to match.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7534.Merge-dialog_54E0B119.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7534.Merge_2D00_dialog_5F00_54E0B119.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Merge dialog" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/4331.Merge-dialog_thumb_14AA979F.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/4331.Merge_2D00_dialog_5F00_thumb_5F00_14AA979F.png" alt="Merge dialog" width="578" height="487" border="0" /></a></p>
<p>The text at the bottom of this dialog will tell us that we got some matches, so some of the recommended restaurants in Yelp actually are not as recommendable as they would seem, according to the inspections results&hellip; We can click OK at any time and look at the newly created column as result of the Merge.</p>
<p>In this case, instead of expanding the nested columns we will perform an aggregate operation, which can be found also on the same dropdown menu in this column.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/3730.Count-of-Inspection-Result-values_5959C291.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/3730.Count_2D00_of_2D00_Inspection_2D00_Result_2D00_values_5F00_5959C291.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Count of Inspection Result values" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7360.Count-of-Inspection-Result-values_thumb_43FE9DDA.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7360.Count_2D00_of_2D00_Inspection_2D00_Result_2D00_values_5F00_thumb_5F00_43FE9DDA.png" alt="Count of Inspection Result values" width="614" height="388" border="0" /></a></p>
<p>We are interested in the Count of Inspection Result values, which basically gives us the number of Unsatisfactory Inspections for each of these restaurants.</p>
<p>With that, we will get a new column like the one in the screenshot below.</p>
<p>Now we can use this information to decide which restaurant we should go to. Interestingly, restaurants with an average rating of 3 or lower are the ones which also got a higher number of unsatisfactory inspections&hellip; There are also some surprises with restaurants rated as 3.5-4 and getting a significant number of negative inspection results, so be aware of that the next time you check Yelp if you don&rsquo;t want to take any risks!</p>
<p>&nbsp;</p>
<p><strong><span style="text-decoration: underline;">Visualize restaurant locations, reviews and inspections results in Geoflow</span></strong></p>
<p>To finish this post, we will put the resulting query into a nice Geoflow map. First, we need to load the final query into the Excel Data Model, which you can do by clicking the &ldquo;Load to data model&rdquo; option in the Query Settings pane. Once done, it will switch to a confirmation message as displayed below.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/4111.Visualize-results-in-GeoFlow_13D75317.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/4111.Visualize_2D00_results_2D00_in_2D00_GeoFlow_5F00_13D75317.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Visualize results in GeoFlow" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/4544.Visualize-results-in-GeoFlow_thumb_39CF941E.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/4544.Visualize_2D00_results_2D00_in_2D00_GeoFlow_5F00_thumb_5F00_39CF941E.png" alt="Visualize results in GeoFlow" width="615" height="368" border="0" /></a></p>
<p>Now you can go to the Insert tab in the Excel ribbon and select &ldquo;Map&rdquo;. This will launch Geoflow where we can create a new tour with multiple layers to visualize our data.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/4162.Launch-GeoFlow_626E0025.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/4162.Launch_2D00_GeoFlow_5F00_626E0025.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Launch GeoFlow" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/6131.Launch-GeoFlow_thumb_16A2296C.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/6131.Launch_2D00_GeoFlow_5F00_thumb_5F00_16A2296C.png" alt="Launch GeoFlow" width="602" height="119" border="0" /></a></p>
<p>Let&rsquo;s create two different visualization layers, one for the food inspections, which we can represent as a heatmap and use the Inspections column for the value field, and another layer for the Yelp ratings, which we can represent as a Column chart and use the Review_Count as column height and the Restaurant Name as categories.</p>
<p>In order to add each of the layers, we will need to pick the Final Report table and select the Latitude and Longitude columns first and tell Geoflow to &ldquo;Map It&rdquo; based on these fields.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/8640.Map-on-GeoFlow_643E55EC.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/8640.Map_2D00_on_2D00_GeoFlow_5F00_643E55EC.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Map on GeoFlow" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/3806.Map-on-GeoFlow_thumb_6EFE3DF2.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/3806.Map_2D00_on_2D00_GeoFlow_5F00_thumb_5F00_6EFE3DF2.png" alt="Map on GeoFlow" width="619" height="438" border="0" /></a></p>
<p>Then we can pick the Review_Count field and select Column type chart, using the Review_Count as the Height and the Name as Category.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/8037.Review_Count_2C8E2C6D.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/8037.Review_5F00_Count_5F00_2C8E2C6D.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Review_Count" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7206.Review_Count_thumb_5D46557A.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7206.Review_5F00_Count_5F00_thumb_5F00_5D46557A.png" alt="Review_Count" width="618" height="460" border="0" /></a></p>
<p>Then, we can add another layer to incorporate the Inspections Count as a heatmap and add the Inspections Count as the Value field. This will give us the final map as displayed below.</p>
<p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7167.Heatmap_165FC32E.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7167.Heatmap_5F00_165FC32E.png"><img style="margin-right: auto; margin-left: auto; float: none; display: block;" title="Heatmap" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/43/09/metablogapi/7127.Heatmap_thumb_76D594BA.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-43-09-metablogapi/7127.Heatmap_5F00_thumb_5F00_76D594BA.png" alt="Heatmap" width="631" height="469" border="0" /></a></p>
<p>Finally, we will get a map similar to this one. The taller columns represent popular restaurants and we should avoid the areas with red in the heatmap (which mean higher number of unsatisfactory reviews).</p>
<p>Hope you liked this blog post and the only thing left for us is to wish you and your family a happy Father&rsquo;s Day!!</p>]]></content:encoded>
    </item>
    <item>
      <title>Announcing the Data Explorer June Update</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/announcing-the-data-explorer-june-update</link>
      <pubDate>Mon, 10 Jun 2013 14:36:00 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/06/10/announcing-the-data-explorer-june-update/</guid>
      <description><![CDATA[It&rsquo;s a warm and sunny Monday afternoon in Redmond and that means a couple of things: mid-June...]]></description>
      <content:encoded><![CDATA[<p>It&rsquo;s a warm and sunny Monday afternoon in Redmond and that means a couple of things: mid-June Summer weather is here and it is about time to announce the <strong><a href="https://www.microsoft.com/downloads/details.aspx?FamilyID=0a4c5a22-021b-498e-b5b6-6e11b8ce2837">Data Explorer June update</a></strong>.</p>
<p>This update contains several quality improvements and bug fixes, including the fix for the interaction issues between Data Explorer and the VBA Editor. If you have hit this issue in the past, <strong><a href="https://www.microsoft.com/downloads/details.aspx?FamilyID=0a4c5a22-021b-498e-b5b6-6e11b8ce2837">install our latest bits</a></strong> and enjoy. If you haven&rsquo;t, you don&rsquo;t really want to know about it&hellip; but please install our bits anyways!</p>
<p>As always, we hope that you enjoy the latest and greatest Data Explorer bits and please send us a smile or frown if you have any feedback. We&rsquo;ll be more than happy to hear from you!</p>
<p>Data Explorer Team</p>]]></content:encoded>
    </item>
    <item>
      <title>From Data to Insight &amp; Impact using Data Explorer, Power View and GeoFlow</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/from-data-to-insight-impact-using-data-explorer-power-view-and-geoflow</link>
      <pubDate>Wed, 15 May 2013 09:59:24 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/05/15/from-data-to-insight-impact-using-data-explorer-power-view-and-geoflow/</guid>
      <description><![CDATA[Earlier this week, a great video was published to the Microsoft BI blog demonstrating how to...]]></description>
      <content:encoded><![CDATA[<p>Earlier this week, a great video was published to the <a href="https://blogs.msdn.com/b/microsoft_business_intelligence1/archive/2013/05/14/from-data-to-insight-amp-impact-getting-public-data-with-data-explorer-and-building-an-excel-power-view-amp-geoflow.aspx" target="_blank"><strong>Microsoft BI blog</strong></a> demonstrating how to discover interesting public data using <a href="https://office.microsoft.com/en-us/excel-help/microsoft-data-explorer-preview-for-excel-help-HA104003813.aspx?WT.mc_id=Blog_BI_DataInsightImpact_DataExplorerData" target="_blank">Data Explorer</a>, import and shape it to empower amazing 2D and 3D visualizations in <a href="https://www.microsoft.com/en-us/bi/Products/PowerView.aspx?WT.mc_id=Blog_BI_DataInsightImpact_PowerView" target="_blank"><strong>Power View</strong></a> and <a href="https://office.microsoft.com/en-us/download-geoflow-for-excel-FX104036784.aspx?WT.mc_id=Blog_BI_DataInsightImpact_GeoFlow" target="_blank"><strong>GeoFlow</strong></a>.</p>  <p>Using Microsoft’s Self-Service BI tools, Marc Reguera (Microsoft Finance Director) was able to get insights about Crime Rates on cities throughout United States, finding out which cities have the highest &amp; lowest robbery rates per capita with just a few minutes of work…</p>  <p align="center"><iframe height="360" src="https://www.youtube.com/embed/-9fwaaS_swQ" frameborder="0" width="640" allowfullscreen="allowfullscreen"></iframe></p>  <p>&#160;</p>  <p>Have you been able to leverage our tools to gain new insights? We would love to hear about your scenarios!</p>]]></content:encoded>
    </item>
    <item>
      <title>Data Explorer May update is available now!</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/data-explorer-may-update-is-available-now</link>
      <pubDate>Mon, 13 May 2013 08:45:47 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/05/13/data-explorer-may-update-is-available-now/</guid>
      <description><![CDATA[As some of you may have already noticed, we released a new Data Explorer update on Friday. You can...]]></description>
      <content:encoded><![CDATA[<p>As some of you may have already noticed, we released a new Data Explorer update on Friday. You can get it from <a href="https://www.microsoft.com/downloads/details.aspx?FamilyID=0a4c5a22-021b-498e-b5b6-6e11b8ce2837" target="_blank"><strong>our download page</strong></a> or by clicking the Update button in the Data Explorer ribbon tab.</p>  <p>This update includes lots of bug fixes and quality improvements, as well as a couple of new features that we believe are going to be very valuable to you, based on your feedback over the past few months. These new features include:</p>  <p>&#160;</p>  <p><strong><u>Support for locale during imports and transformations</u></strong>&#160;</p>  <p>We’ve added support for importing and visualizing data according to your regional/locale settings. You will notice a new dropdown menu in the Data Explorer ribbon to control the locale setting for your workbook (by default, it maps to your Operating System locale, at the time when the workbook was created). This will be the default locale used to interpret numbers, dates and times when importing data from text sources.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0755.image_6BC53067.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0755.image_5F00_6BC53067.png"><img title="image" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="image" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6153.image_thumb_2784C91B.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6153.image_5F00_thumb_5F00_2784C91B.png" width="699" height="242" /></a></p>  <p>&#160;</p>  <p>In addition, you can specify a different locale whenever you want to perform any “Change Type” operation.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8780.image_727839EA.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8780.image_5F00_727839EA.png"><img title="image" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="image" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5141.image_thumb_1946502B.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5141.image_5F00_thumb_5F00_1946502B.png" width="705" height="474" /></a></p>  <p>&#160;</p>  <p>Finally, you can also specify the File Origin for any text file that you import in Data Explorer by going into the “Edit Settings” dialog for the Source step in your query (clicking on the gear icon next to Source).</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5164.image_6E01B923.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5164.image_5F00_6E01B923.png"><img title="image" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="image" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1362.image_thumb_66E27CAB.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1362.image_5F00_thumb_5F00_66E27CAB.png" width="698" height="490" /></a></p>  <p>&#160;</p>  <p>You can find more details in our <a href="https://office.microsoft.com/en-us/excel-help/internationalization-HA104061425.aspx" target="_blank"><strong>Internationalization Help page</strong></a>.</p>  <p>&#160;</p>  <p><u><strong>Connection encryption for database sources</strong> </u></p>  <p>This new feature provides the ability to turn on/off the encryption of data and credentials sent when connecting to database data sources (such as SQL Server, Windows Azure SQL database, IBM DB2, etc.). You will find this option in the Credentials dialog when connecting to a new data source.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8228.image_22A2155F.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8228.image_5F00_22A2155F.png"><img title="image" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="image" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0880.image_thumb_5499B5E9.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0880.image_5F00_thumb_5F00_5499B5E9.png" width="632" height="274" /></a></p>  <p>&#160;</p>  <p><strong><u>New ribbon layout and icons</u></strong> </p>  <p>If you have already used Data Explorer, you’ll notice that we have moved some things around in the ribbon in order to make them more discoverable and better organized. We’ve also been busy replacing most of our icons to give Data Explorer a nicer look.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8712.image_626BFBE4.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8712.image_5F00_626BFBE4.png"><img title="image" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="image" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5078.image_thumb_5B4CBF6C.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5078.image_5F00_thumb_5F00_5B4CBF6C.png" width="698" height="409" /></a></p>  <p>&#160;</p>  <p><strong><u></u></strong></p>  <p><strong><u>Automatic column type detection</u></strong> </p>  <p>We’ve improved our column type detection logic, in order to give you better column types (other than Text) when importing data from text data sources such as Web, Text or CSV.</p>  <p>&#160;</p>  <p>As always, we look forward to your feedback about these new features as well as any others in Data Explorer. If you have any questions, issues or suggestions don’t hesitate to reach out to us via <a href="https://social.msdn.microsoft.com/Forums/en-US/dataexplorer/" target="_blank"><strong>our forum</strong></a> or send us a smile/frown from the Data Explorer ribbon tab.</p>  <p>Enjoy!</p>]]></content:encoded>
    </item>
    <item>
      <title>Download the latest Data Explorer update: Unpivot feature and search experience improvements</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/download-the-latest-data-explorer-update-unpivot-feature-and-search-experience-improvements</link>
      <pubDate>Fri, 12 Apr 2013 07:25:40 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/04/12/download-the-latest-data-explorer-update-unpivot-feature-and-search-experience-improvements/</guid>
      <description><![CDATA[Hi there!  We’d like to let you know that there is an updated build for Data Explorer available. You...]]></description>
      <content:encoded><![CDATA[<p>Hi there!</p>  <p>We’d like to let you know that there is an updated build for Data Explorer available. You should see “Auto Update” on your ribbon light up soon. Alternatively, you can go <a href="https://www.microsoft.com/en-us/download/details.aspx?id=36803">here</a> to download. </p>  <p>In this build, we are introducing a built-in formula for unpivoting columns to rows. Over the past few weeks, many of you have expressed feedback indicating that the ability to unpivot data would be very useful for cleaning up and consuming data for everyday needs. We are happy to provide this as a simple, consistent and intuitive experience.</p>  <p>As an example, consider the <a href="https://data.london.gov.uk/datastore/package/historic-census-population">following</a> historical population data obtained from the London Datastore.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1108.clip_image001_1DCDADF9.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1108.clip_5F00_image001_5F00_1DCDADF9.png"><img title="clip_image001" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image001" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0121.clip_image001_thumb_449BC439.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0121.clip_5F00_image001_5F00_thumb_5F00_449BC439.png" width="606" height="162" /></a></p>  <p>While this format works well as a report showing population details by year and area, it is not particularly well suited for consumption in analytic/BI scenarios&#160; – especially if you were thinking about aggregating or summarizing the data along different dimensions. </p>  <p>Data Explorer now provides the ability to select the columns you would like to unpivot, and accomplish the task in a single click. Here’s the Unpivot menu option you can apply over a selection of columns:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1682.clip_image002_2480B77C.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1682.clip_5F00_image002_5F00_2480B77C.png"><img title="clip_image002" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image002" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4338.clip_image002_thumb_6040502F.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4338.clip_5F00_image002_5F00_thumb_5F00_6040502F.png" width="586" height="283" /></a></p>  <p>The result of unpivoting yields the following table:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8561.clip_image003_592113B7.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8561.clip_5F00_image003_5F00_592113B7.png"><img title="clip_image003" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image003" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3755.clip_image003_thumb_4DF7896D.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3755.clip_5F00_image003_5F00_thumb_5F00_4DF7896D.png" width="436" height="317" /></a></p>  <p>And a few more Data Explorer transformations gives you a nice cleaned up table that can be used for summarizing, or for consumption in PowerPivot or Power View.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1602.clip_image004_46D84CF5.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1602.clip_5F00_image004_5F00_46D84CF5.png"><img title="clip_image004" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image004" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0624.clip_image004_thumb_3BAEC2AB.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0624.clip_5F00_image004_5F00_thumb_5F00_3BAEC2AB.png" width="440" height="365" /></a></p>  <p>This update of Data Explorer also includes a better experience for browsing and using search results. You no longer have to click on the tiny “Use” link in the search results pane – instead you can click on the search result itself. This was a point of confusion for many users, and we hope this improves the general experience.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8228.clip_image005_348F8633.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8228.clip_5F00_image005_5F00_348F8633.png"><img title="clip_image005" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image005" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4747.clip_image005_thumb_668726BD.png" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4747.clip_5F00_image005_5F00_thumb_5F00_668726BD.png" width="305" height="390" /></a></p>  <p>As always, there are dozens of bug fixes in the update as well.</p>  <p>We hope you enjoy this latest build. Let us know what you think!</p>  <p>Data Explorer Team</p>]]></content:encoded>
    </item>
    <item>
      <title>Data Explorer Online Search Overview</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/data-explorer-online-search-overview</link>
      <pubDate>Wed, 27 Mar 2013 13:02:15 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/03/27/data-explorer-online-search-overview/</guid>
      <description><![CDATA[Working with data to gain new insights not only involves dealing with the data that you already have...]]></description>
      <content:encoded><![CDATA[<p>Working with data to gain new insights not only involves dealing with the data that you already have but also being able to find additional data to complement your analysis. In many cases, this additional data is publicly available to everyone but it has been traditionally difficult to find and to leverage in your analysis.</p>  <p>Because Public Data is essential in a variety of Self-Service BI scenarios, we added an “Online Search” feature in Data Explorer. This button is your first step to find data and import it right into your spreadsheet, without having to switch context.</p>  <p>This data can be used in a couple of different ways: </p>  <ol>   <li>To acquire and understand public data (e.g. find the list of most populated cities, the list of companies in S&amp;P 500, etc.). </li>    <li>To augment or correlate your (corporate) data with some publicly available data (e.g. find the name for an Airline code, or country name given an country code; compare your sales by country to the GDP by country, etc.).</li> </ol>  <p>Data Explorer makes it easy to search and bring the data directly in Excel without any need of copy/paste and reformatting. And once you create your queries, you can save them and refresh them later when the data is updated without effort.</p>  <p>In the current Data Explorer Preview, this feature allows you to search and seamlessly import tables from Wikipedia (approximately 1.5 million tables); and going forward we will extend the scope of the search and allow query over a variety of other sources. </p>  <p>With millions of tables we are sure you will find a good use of public data. We are listening to your feedback, so let us know what you think of this feature and what kind of data sources you are using in your own scenarios!</p>  <h4>Step-by-step example</h4>  <p>Let’s go thru a simple example step by step. In this example, Michael, a business analyst working in a company owning several luxury retail stores in the USA, is investigating for a location for their next store. Starting with a current list of stores, he wants to visualize potential counties where he could open new stores based on their median income. The whole scenario takes him less than 5 minutes.</p>  <p><b>Step 1. Michael starts by a spreadsheet containing a list of current stores. </b></p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1121.clip_image002_293A3F1D.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1121.clip_5F00_image002_5F00_293A3F1D.jpg"><img title="clip_image002" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image002" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8715.clip_image002_thumb_690425A2.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8715.clip_5F00_image002_5F00_thumb_5F00_690425A2.jpg" width="644" height="407" /></a></p>  <p align="center">Figure 1. Initial spreadsheet, with the list of current stores (Step 1)<b></b></p>  <p><b>Step 2. Michael adds the list of current stores as a first Data Explorer query. </b></p>  <p>For that, he clicks on the “From Table” button in Data explorer and validates the next form. The table is added as a new query in a new sheet.</p>  <p><b>Step 3</b>. <b>He initiates the search, </b>by clicking on<b> </b>the “Online Search” button in Data Explorer tab.</p>  <p><b>Step 4</b>. <b>Search for the highest income counties in United States:</b> </p>  <p>Michael types “highest income counties USA” in the Online Search pane. He can see the search results, and have a preview of the data while moving the mouse over each result.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3000.clip_image004_0FD23BE3.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3000.clip_5F00_image004_5F00_0FD23BE3.jpg"><img title="clip_image004" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image004" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4670.clip_image004_thumb_4B91D496.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4670.clip_5F00_image004_5F00_thumb_5F00_4B91D496.jpg" width="645" height="407" /></a></p>  <p align="center">Figure 2. Search pane and preview (Step 4)</p>  <p><b>Step 5. Use the data:</b> </p>  <p>When he finds the result he was looking for (here the second one), he clicks on “Use”. The data is then automatically imported into Excel as a new query. At this point the data is in Excel and he can use all Excel features (sort, filter, charts, etc.). He can also choose to merge this query with another query, or to reshape it using Data Explorer.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1440.clip_image006_725FEAD6.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1440.clip_5F00_image006_5F00_725FEAD6.jpg"><img title="clip_image006" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image006" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4276.clip_image006_thumb_1D384EE9.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4276.clip_5F00_image006_5F00_thumb_5F00_1D384EE9.jpg" width="653" height="412" /></a></p>  <p align="center">Figure 3. Data imported into Excel (Step 5)</p>  <p><b>Step 6</b>.<b> Merge initial data and public data. </b></p>  <p>Clicking on the “Merge” button, Michael can merge the two queries created so far, based on the <i>County</i> column. </p>  <p>For that, he selects the Wikipedia table as primary table, and the list of current stores as second table, then clicks on the <i>County</i> column in both table, and then clicks on <i>apply</i>.<i></i></p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0474.clip_image008_58F7E79C.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0474.clip_5F00_image008_5F00_58F7E79C.jpg"><img title="clip_image008" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image008" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4760.clip_image008_thumb_752AC12B.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4760.clip_5F00_image008_5F00_thumb_5F00_752AC12B.jpg" width="575" height="484" /></a></p>  <p align="center">Figure 4. Merging the two queries (Step 6) based on County</p>  <p align="center">&#160;</p>  <p><b>Step 7.</b> <b>Michael adds some additional columns</b>. </p>  <p>In order to know the number of stores in each country, he right clicks on the column header, and then clicks on “NewColumn”, choose <i>aggregate</i> and then <i>Count</i>/<i>Excluding blanks</i> (see following picture). This will simply add a column with the number of existing stores in each county. </p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1067.clip_image010_02FD0727.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1067.clip_5F00_image010_5F00_02FD0727.jpg"><img title="clip_image010" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image010" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/2548.clip_image010_thumb_7BDDCAAE.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/2548.clip_5F00_image010_5F00_thumb_5F00_7BDDCAAE.jpg" width="601" height="328" /></a></p>  <p align="center">Figure 5. Add an aggregate column (Step 7)</p>  <p>Michael also adds a column to aggregate the County and State together (this is to disambiguate the map visualization in next step). For that, Michael right-clicks on a column header again and choose “Insert Column” then “Custom” and add the following formula:</p>  <p>= [County] &amp; &quot;, &quot; &amp; [State]</p>  <p>After validating the form, Michael sees the following table in Excel.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6266.clip_image012_09B010AA.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6266.clip_5F00_image012_5F00_09B010AA.jpg"><img title="clip_image012" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image012" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1452.clip_image012_thumb_0290D432.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1452.clip_5F00_image012_5F00_thumb_5F00_0290D432.jpg" width="631" height="398" /></a></p>  <p align="center">Figure 6. End of step 7 with new columns</p>  <p align="center">&#160;</p>  <p><b>Step 8</b>. <b>Visualize the data</b> <b>with PowerView. </b></p>  <p>Michael goes<b> </b>to the “Insert” tab in Excel, and then clicks on “PowerView”. </p>  <p>He then clicks on the <i>Map</i> button and configures the view as follows:</p>  <p>- <u>Sum Size</u>: Rank</p>  <p>- <u>Location</u>: County, State (our second new column)</p>  <p>- <u>Color</u>: Store count (our new aggregate column)</p>  <p>- (no other field is used)</p>  <p>And finally, Michael gets the following map showing the highest income counties, with the color indicating the number of existing stores for Michael’s company.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1464.clip_image014_3E506CE5.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1464.clip_5F00_image014_5F00_3E506CE5.jpg"><img title="clip_image014" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image014" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/2045.clip_image014_thumb_3731306D.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/2045.clip_5F00_image014_5F00_thumb_5F00_3731306D.jpg" width="626" height="395" /></a></p>  <p>&#160;</p>  <p>We believe this scenario demonstrates the value of Data Explorer in helping users discover data, filter and shape the data easily and combine with other data. Finally, users can analyze the data or build visualizations on top.</p>  <p>Please let us know what you think about Online Search, and Data Explorer in general!</p>]]></content:encoded>
    </item>
    <item>
      <title>Mashups and visualizations over Big Data and Azure HDInsight using Data Explorer</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/mashups-and-visualizations-over-big-data-and-azure-hdinsight-using-data-explorer</link>
      <pubDate>Mon, 18 Mar 2013 15:43:39 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/03/18/mashups-and-visualizations-over-big-data-and-azure-hdinsight-using-data-explorer/</guid>
      <description><![CDATA[With the recent announcement about Azure HDInsight, now is a good time to look at how one might use...]]></description>
      <content:encoded><![CDATA[<p>With the recent <a href="https://blogs.technet.com/b/dataplatforminsider/archive/2013/03/18/gartner-bi-summit-2013-bringing-hadoop-to-the-enterprise.aspx" target="_blank">announcement</a> about Azure HDInsight, now is a good time to look at how one might use Data Explorer to connect to data sitting in Windows Azure HDInsight.</p>  <p>As you might be aware, HDInsight is Microsoft’s own offering of Hadoop as a service. In this example, we are going to look at how data can be consumed from HDInsight. We will be using a dataset in HDInsight that contains historical stock prices for all stocks traded on the NYSE between 1970 and 2010. While this dataset is not too big compared to “Big Data” standards, it does represent many of the challenges posed by big data as far as end user consumption goes. In case you are interested in trying this yourself, the source of this data is <a href="https://www.infochimps.com/datasets/nyse-daily-1970-2010-open-close-high-low-and-volume">Infochimps</a>. You will need to get the data into an Azure Blob Storage account that is associated with your HDInsight cluster.</p>  <p>The goal of this post is to show you how to use this data to build a report of those stocks that are traded on the NYSE and are part of the S&amp;P 500 index. This dataset by alone isn’t enough, because all it provides is price and volume information by stock symbol and date. So we will need to ultimately find company name/sector information from another dataset. More on that later.</p>  <p>Here’s a view of the report we are attempting to build:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1385.clip_image002_03C6A1AE.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1385.clip_5F00_image002_5F00_03C6A1AE.jpg"><img title="clip_image002" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image002" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1768.clip_image002_thumb_5EC8E134.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1768.clip_5F00_image002_5F00_thumb_5F00_5EC8E134.jpg" width="520" height="294" /></a></p>  <p>The steps below show you how to build this interactive report.</p>  <p>&#160;</p>  <p><b>Step 1: Connect to HDInsight and shape the data</b></p>  <p>The first step is to connect to HDInsight and get the data in the right shape. HDInsight is a supported data source in the Data Explorer ribbon. </p>  <p>If you are following along and don’t see HDInsight in the <b>Other Sources</b> dropdown, you need to get the latest <a href="https://www.microsoft.com/en-us/download/details.aspx?id=36803">update</a> for Data Explorer.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/2330.clip_image004_1A8879E8.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/2330.clip_5F00_image004_5F00_1A8879E8.jpg"><img title="clip_image004" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image004" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0285.clip_image004_thumb_4C801A72.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0285.clip_5F00_image004_5F00_thumb_5F00_4C801A72.jpg" width="329" height="477" /></a></p>  <p>Once the account details are provided, we will eventually be connected up to the HDFS filesystem view:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/7142.clip_image006_5A52606D.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/7142.clip_5F00_image006_5F00_5A52606D.jpg"><img title="clip_image006" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image006" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6560.clip_image006_thumb_6824A668.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6560.clip_5F00_image006_5F00_thumb_5F00_6824A668.jpg" width="539" height="287" /></a></p>  <p>At this point, you will likely notice the first challenge. The data that we want to consume is scattered across dozens of files – and we absolutely need the data from all of these files. However, this is an easy problem for Data Explorer.</p>  <p>As a first step, we need to use Data Explorer to subset the files based on a condition, so that all unnecessary files are filtered out. We can use a condition that filters down to the list of files that contain “daily_price” in the filename.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3426.clip_image008_27EE8CEE.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3426.clip_5F00_image008_5F00_27EE8CEE.jpg"><img title="clip_image008" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image008" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4186.clip_image008_thumb_07D38031.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4186.clip_5F00_image008_5F00_thumb_5F00_07D38031.jpg" width="539" height="289" /></a></p>  <p>After this step, we have just the files needed. Now for the magic.</p>  <p>Data Explorer has a really cool feature that lets you create a logical table out of multiple text files. You can “combine” multiple files in a filesystem view by simply clicking on the Combine icon in the <b>Content </b>column header.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5657.clip_image010_15A5C62C.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5657.clip_5F00_image010_5F00_15A5C62C.jpg"><img title="clip_image010" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image010" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3513.clip_image010_thumb_758AB96E.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3513.clip_5F00_image010_5F00_thumb_5F00_758AB96E.jpg" width="540" height="290" /></a></p>  <p>Clicking on that icon produces this:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8712.clip_image012_035CFF6A.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8712.clip_5F00_image012_5F00_035CFF6A.jpg"><img title="clip_image012" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image012" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/7536.clip_image012_thumb_6341F2AC.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/7536.clip_5F00_image012_5F00_thumb_5F00_6341F2AC.jpg" width="535" height="287" /></a></p>  <p>At this point, one of the top rows can be promoted as header using the feature Data Explorer provides for creating a header row. The rest of the header rows can be filtered out also using the filter capabilities.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1263.clip_image014_5C22B634.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1263.clip_5F00_image014_5F00_5C22B634.jpg"><img title="clip_image014" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image014" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4405.clip_image014_thumb_69F4FC2F.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4405.clip_5F00_image014_5F00_thumb_5F00_69F4FC2F.jpg" width="528" height="284" /></a></p>  <p>A few more operations to hide unwanted columns will produce our final view:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5076.clip_image016_49D9EF72.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5076.clip_5F00_image016_5F00_49D9EF72.jpg"><img title="clip_image016" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image016" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0218.clip_image016_thumb_29BEE2B5.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0218.clip_5F00_image016_5F00_thumb_5F00_29BEE2B5.jpg" width="536" height="288" /></a></p>  <p>Clicking on <b>Done</b> will start to run the query and stream the data down into Excel.</p>  <p>&#160;</p>  <p><b>Step 2: Find the S&amp;P 500 list of companies along with company information</b></p>  <p>At this point, the data should be streaming down into Excel. There is quite a bit of data that will find its way down into Excel. However, since we are not done with data shaping, we need to toggle a setting that will disable evaluation/download of the results for this particular query. </p>  <p>Clicking on <b>Enable Download </b>stops the download:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3426.clip_image018_09A3D5F8.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3426.clip_5F00_image018_5F00_09A3D5F8.jpg"><img title="clip_image018" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image018" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3438.clip_image018_thumb_3E443233.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3438.clip_5F00_image018_5F00_thumb_5F00_3E443233.jpg" width="537" height="369" /></a></p>  <p>In order to fully build out the report, the next thing we need is the list of companies that are part of the S&amp;P 500 index. We can try to find this in Data Explorer’s <b>Online Search</b>.</p>  <p>Searching for S&amp;P 500 yields a few results:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6175.clip_image020_7A03CAE6.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6175.clip_5F00_image020_5F00_7A03CAE6.jpg"><img title="clip_image020" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image020" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0207.clip_image020_thumb_72E48E6E.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0207.clip_5F00_image020_5F00_thumb_5F00_72E48E6E.jpg" width="523" height="359" /></a></p>  <p>The first one looks pretty close to the data we need. So we can import that into Excel by clicking <b>Use</b>:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5483.clip_image022_4BAA4539.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5483.clip_5F00_image022_5F00_4BAA4539.jpg"><img title="clip_image022" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image022" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4405.clip_image022_thumb_597C8B34.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4405.clip_5F00_image022_5F00_thumb_5F00_597C8B34.jpg" width="526" height="361" /></a></p>  <p><b></b></p>  <p><strong></strong></p>  <p><b>Step 3: Merging the two tables, and subsetting to the S&amp;P 500 price data</b></p>  <p>The last step in our scenario is to combine the two tables using Data Explorer. We can do this by clicking on the <b>Merge</b> button in the Data Explorer ribbon:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/2352.clip_image024_153C23E8.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/2352.clip_5F00_image024_5F00_153C23E8.jpg"><img title="clip_image024" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image024" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0218.clip_image024_thumb_7521172A.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0218.clip_5F00_image024_5F00_thumb_5F00_7521172A.jpg" width="514" height="434" /></a></p>  <p>The Merge dialog lets us pick the tables we’d like to merge, along with the common columns between the two tables so that Data Explorer can do a join. Note that a left outer join is used when merging is done this way.</p>  <p>Clicking on <b>Apply</b> completes the merge, and we are presented with a resulting table:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/7635.clip_image026_6E01DAB2.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/7635.clip_5F00_image026_5F00_6E01DAB2.jpg"><img title="clip_image026" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image026" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5582.clip_image026_thumb_42BD43AB.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5582.clip_5F00_image026_5F00_thumb_5F00_42BD43AB.jpg" width="510" height="274" /></a></p>  <p>Columns from the second table can be added by expanding and looking up columns from the <b>NewColumn</b> column:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6253.clip_image028_22A236EE.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6253.clip_5F00_image028_5F00_22A236EE.jpg"><img title="clip_image028" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image028" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4118.clip_image028_thumb_30747CE9.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4118.clip_5F00_image028_5F00_thumb_5F00_30747CE9.jpg" width="511" height="275" /></a></p>  <p>The result of selecting the columns we’d like to add to the table produces this: </p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5670.clip_image030_1059702C.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5670.clip_5F00_image030_5F00_1059702C.jpg"><img title="clip_image030" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image030" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8132.clip_image030_thumb_093A33B4.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8132.clip_5F00_image030_5F00_thumb_5F00_093A33B4.jpg" width="509" height="273" /></a></p>  <p>Note that there are many columns that have <b>null </b>values for the new columns. This is expected as we have more companies in the left table (the one we pulled from HDInsight). </p>  <p>A simple filtering out of nulls fixes the problem, and leaves us with what we need:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/3326.clip_image032_691F26F6.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/3326.clip_5F00_image032_5F00_691F26F6.jpg"><img title="clip_image032" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image032" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1263.clip_image032_thumb_76F16CF1.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1263.clip_5F00_image032_5F00_thumb_5F00_76F16CF1.jpg" width="519" height="278" /></a></p>  <p>We are now left with the historical end of day figures for all companies in the S&amp;P 500. Clicking on <b>Done</b> will now bring the data into Excel.</p>  <p>&#160;</p>  <p><b>Step 4: Fix up a few types in PowerPivot and visualize in Power View</b></p>  <p>Once the data is downloaded, adding it to Excel’s data model (xVelocity) is easy. Clicking on the <b>Load to data model</b> link puts the data into the model in one click:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6562.clip_image034_56D66034.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6562.clip_5F00_image034_5F00_56D66034.jpg"><img title="clip_image034" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image034" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/1856.clip_image034_thumb_4FB723BC.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/1856.clip_5F00_image034_5F00_thumb_5F00_4FB723BC.jpg" width="515" height="351" /></a></p>  <p>Once the data is in the data model, it can easily be modeled using Excel’s PowerPivot functionality.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4503.clip_image036_5D8969B7.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4503.clip_5F00_image036_5F00_5D8969B7.jpg"><img title="clip_image036" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image036" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5164.clip_image036_thumb_04577FF8.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5164.clip_5F00_image036_5F00_thumb_5F00_04577FF8.jpg" width="508" height="279" /></a></p>  <p>In order for the visualization to work correctly, we need to adjust the types of the following columns in PowerPivot:</p>  <ul>   <li><i>date</i> – this column needs to be converted to <b>Date </b>type</li>    <li><i>stock_price_close</i> – this column needs to be converted to <b>Decimal</b> type</li> </ul>  <p>Once this is done, adding the visualization via Power View is easy.</p>  <ul>   <li>We can insert a Power View from the <b>Insert</b> ribbon/tab in Excel.</li>    <li>Delete any default visualizations. From the table named <b>Query </b>in the Power View fields list, select the following columns:</li>    <ul>     <li>date</li>      <li>stock_price_close</li>      <li>NewColumn.Company</li>   </ul>    <li>Change the visualization to a Line chart.</li> </ul>  <p>This will produce a visualization that shows all the companies on a single chart. We can then customize the chart and see just the companies we are interested in.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4186.clip_image037_1229C5F3.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4186.clip_5F00_image037_5F00_1229C5F3.jpg"><img title="clip_image037" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image037" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5657.clip_image037_thumb_0B0A897B.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5657.clip_5F00_image037_5F00_thumb_5F00_0B0A897B.jpg" width="507" height="287" /></a></p>  <p>That’s all it takes to get all that data from HDInsight, and to combine that data with some publicly available information. Data Explorer’s Online Search is a good source for public data. </p>  <p>We hope this gives you an idea for how Data Explorer enables richer connectivity, discovery and data shaping scenarios while enhancing your Self Service BI experience in Excel. An interesting thought exercise will be to consider how you might accomplish this scenario without using Data Explorer.</p>  <p>Let us know what you think!</p>  <p>Data Explorer Team</p>]]></content:encoded>
    </item>
    <item>
      <title>A new build of “Data Explorer”, and an Auto Update feature</title>
      <link>https://docs.microsoft.com/archive/blogs/dataexplorer/a-new-build-of-data-explorer-and-an-auto-update-feature</link>
      <pubDate>Tue, 12 Mar 2013 11:01:13 GMT</pubDate>
      <dc:creator><![CDATA[Data Explorer Team]]></dc:creator>
      <guid
        isPermaLink="false">https://blogs.msdn.microsoft.com/dataexplorer/2013/03/12/a-new-build-of-data-explorer-and-an-auto-update-feature/</guid>
      <description><![CDATA[Hi everyone!  We hope you have been enjoying Microsoft “Data Explorer” Preview for Excel.&#160; We...]]></description>
      <content:encoded><![CDATA[<p>Hi everyone!</p>  <p>We hope you have been enjoying Microsoft “Data Explorer” Preview for Excel.&#160; We certainly have been having a fun time looking at the overall response and going through all the feedback you have been sending along. We would like to thank you for taking the time to send us feedback.</p>  <p>We would like to let you know that we just published an update that includes quite a few bug fixes and a handful of additional features that we think you will enjoy. </p>  <p>Now that it has been a few weeks since we initially released the preview, it is a good time to talk about how we plan on delivering updates to you while we are in this preview phase.</p>  <p>In the Data Explorer ribbon, you may have noticed an “Update” button.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6114.clip_image002_0B12D0B4.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6114.clip_5F00_image002_5F00_0B12D0B4.jpg"><img title="clip_image002" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image002" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6136.clip_image002_thumb_58AEFD34.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6136.clip_5F00_image002_5F00_thumb_5F00_58AEFD34.jpg" width="484" height="78" /></a></p>  <p>Usually, this button is grayed out. When we do publish updates, you will notice that this button turns on and you can click on it to get details about the update. This is just a small convenience feature to help you get to the right update without much trouble.</p>  <p>To update your Data Explorer preview bits, you can just wait for this to light up. Of course, you can always go to the <a href="https://www.microsoft.com/en-us/download/details.aspx?id=36803">Data Explorer page</a> on Microsoft Download Center to find the latest bits if you are still waiting for the update button to light up.</p>  <p>This update includes additional data sources – namely:</p>  <ul>   <li>Windows Azure HDInsight</li>    <li>Teradata</li>    <li>PostgreSQL</li> </ul>  <p>We also have improved the query editing functionality. If you go into the Settings dialog, you will find an option to “Enable Advanced Query Editing”</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/7607.clip_image003_3893F077.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/7607.clip_5F00_image003_5F00_3893F077.jpg"><img title="clip_image003" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image003" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/8267.clip_image003_thumb_7453892A.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/8267.clip_5F00_image003_5F00_thumb_5F00_7453892A.jpg" width="474" height="355" /></a></p>  <p>Once you do this, you will be able to edit an entire query by clicking on the new icon that appears in the formula bar.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/5444.clip_image004_54387C6D.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/5444.clip_5F00_image004_5F00_54387C6D.jpg"><img title="clip_image004" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image004" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/2313.clip_image004_thumb_1F2BED3D.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/2313.clip_5F00_image004_5F00_thumb_5F00_1F2BED3D.jpg" width="494" height="341" /></a></p>  <p>Here’s what the query editing experience looks like:</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/6507.clip_image005_68BDCBEB.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/6507.clip_5F00_image005_5F00_68BDCBEB.jpg"><img title="clip_image005" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image005" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/4454.clip_image005_thumb_33B13CBB.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/4454.clip_5F00_image005_5F00_thumb_5F00_33B13CBB.jpg" width="499" height="375" /></a></p>  <p>Enabling “Advanced Query Editing” also allows you to write a query from scratch instead of using one of the pre-defined data sources.</p>  <p><a href="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/0257.clip_image006_418382B6.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/0257.clip_5F00_image006_5F00_418382B6.jpg"><img title="clip_image006" style="margin-right: auto; margin-left: auto; float: none; display: block;" border="0" alt="clip_image006" src="https://msdnshared.blob.core.windows.net/media/MSDNBlogsFS/prod.evol.blogs.msdn.com/CommunityServer.Blogs.Components.WeblogFiles/00/00/01/48/46/metablogapi/2804.clip_image006_thumb_014D693C.jpg" original-url="https://blogs.msdn.com/cfs-file.ashx/__key/communityserver-blogs-components-weblogfiles/00-00-01-48-46-metablogapi/2804.clip_5F00_image006_5F00_thumb_5F00_014D693C.jpg" width="291" height="470" /></a></p>  <p>&#160;</p>  <p>There are a lot of bug fixes as well as I already mentioned. Give this build of Data Explorer a spin and let us know how you like it. Reach us via the <a href="https://social.msdn.microsoft.com/Forums/en-US/dataexplorer/" target="_blank">Data Explorer forum</a>.</p>  <p>&#160;</p>  <p><strong>Faisal Mohamood</strong></p>  <p>Program Manager | Data Explorer</p>]]></content:encoded>
    </item>
  </channel>
</rss>