{"id":1868,"date":"2013-10-08T10:40:52","date_gmt":"2013-10-08T10:40:52","guid":{"rendered":"http:\/\/www.tsls.co.uk\/?p=1868"},"modified":"2013-10-08T10:40:52","modified_gmt":"2013-10-08T10:40:52","slug":"using-windows-azure-hd-insights-for-processing-big-data","status":"publish","type":"post","link":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/","title":{"rendered":"Using Windows Azure HD insights for processing Big Data"},"content":{"rendered":"<h3>Analyze and gain insights from Big Data using the power of Apache Hadoop<\/h3>\n<p>Analyze unstructured data with Windows Azure HDInsight, a Big Data solution powered by Apache Hadoop. Build clusters in minutes optimized for speed or cost. Post-process output in Excel with PowerPivot, Power View, and Hive queries.<\/p>\n<p><!--more--><\/p>\n<p>Watch a demo here:<\/p>\n<p><iframe loading=\"lazy\" style=\"width: 640px; height: 480px;\" src=\"http:\/\/channel9.msdn.com\/Series\/Getting-started-with-Windows-Azure-HDInsight-Service\/Creating-your-first-HDInsight-cluster-and-run-samples\/player?w=640&amp;h=480\" frameborder=\"0\" scrolling=\"no\" width=\"640\" height=\"480\"><\/iframe><\/p>\n<p>Sample Code here:<br \/>\n<code><br \/>\nfs.put()<br \/>\nDownload: <a href=\"http:\/\/www.tsls.co.uk\/wp-content\/uploads\/2013\/10\/davinci.txt\">http:\/\/www.tsls.co.uk\/wp-content\/uploads\/2013\/10\/davinci.txt<\/a><br \/>\nfs.put()<br \/>\nDownload: <a href=\"http:\/\/www.tsls.co.uk\/wp-content\/uploads\/2013\/10\/WordCount.js\">http:\/\/www.tsls.co.uk\/wp-content\/uploads\/2013\/10\/WordCount.js<\/a><br \/>\npig.from(\"\/user\/hdpinternaluser\/davinci.txt\").mapReduce(\"\/user\/hdpinternaluser\/WordCount.js\", \"word, count:long\").orderBy(\"count DESC\").take(10).to(\"DaVinciTop10Words\")<br \/>\n#ls<br \/>\nfile = fs.read(\"DaVinciTop10Words\")<br \/>\ndata = parse(file.data, \"word, count:long\")<br \/>\ngraph.bar(data)<br \/>\n<\/code><br \/>\nMore information here: <a href=\"https:\/\/www.windowsazure.com\/en-us\/manage\/services\/hdinsight\/interactive-javascript-and-hive-consoles\/\">https:\/\/www.windowsazure.com\/en-us\/manage\/services\/hdinsight\/interactive-javascript-and-hive-consoles\/<\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>Analyze and gain insights from Big Data using the power of Apache Hadoop Analyze unstructured data with Windows Azure HDInsight, a Big Data solution powered by Apache Hadoop. Build clusters in minutes optimized for speed<\/p>\n","protected":false},"author":11,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"jetpack_post_was_ever_published":false,"_jetpack_newsletter_access":"","_jetpack_newsletter_tier_id":0,"footnotes":"","jetpack_publicize_message":"","jetpack_is_tweetstorm":false,"jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":false,"jetpack_social_options":{"image_generator_settings":{"template":"highway","enabled":false}}},"categories":[21],"tags":[351,521],"class_list":["post-1868","post","type-post","status-publish","format-standard","hentry","category-microsoft","tag-azure","tag-cloud"],"jetpack_publicize_connections":[],"yoast_head":"<!-- This site is optimized with the Yoast SEO plugin v21.9.1 - https:\/\/yoast.com\/wordpress\/plugins\/seo\/ -->\r\n<title>Using Windows Azure HD insights for processing Big Data - TSLS - Luke Smith<\/title>\r\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\r\n<link rel=\"canonical\" href=\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/\" \/>\r\n<meta property=\"og:locale\" content=\"en_GB\" \/>\r\n<meta property=\"og:type\" content=\"article\" \/>\r\n<meta property=\"og:title\" content=\"Using Windows Azure HD insights for processing Big Data - TSLS - Luke Smith\" \/>\r\n<meta property=\"og:description\" content=\"Analyze and gain insights from Big Data using the power of Apache Hadoop Analyze unstructured data with Windows Azure HDInsight, a Big Data solution powered by Apache Hadoop. Build clusters in minutes optimized for speed\" \/>\r\n<meta property=\"og:url\" content=\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/\" \/>\r\n<meta property=\"og:site_name\" content=\"TSLS - Luke Smith\" \/>\r\n<meta property=\"article:published_time\" content=\"2013-10-08T10:40:52+00:00\" \/>\r\n<meta name=\"author\" content=\"Luke Smith\" \/>\r\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"Luke Smith\" \/>\n\t<meta name=\"twitter:label2\" content=\"Estimated reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"1 minute\" \/>\r\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\/\/schema.org\",\"@graph\":[{\"@type\":\"WebPage\",\"@id\":\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/\",\"url\":\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/\",\"name\":\"Using Windows Azure HD insights for processing Big Data - TSLS - Luke Smith\",\"isPartOf\":{\"@id\":\"https:\/\/www.tsls.co.uk\/#website\"},\"datePublished\":\"2013-10-08T10:40:52+00:00\",\"dateModified\":\"2013-10-08T10:40:52+00:00\",\"author\":{\"@id\":\"https:\/\/www.tsls.co.uk\/#\/schema\/person\/e4d7dac4fe1b3f8df31f3857bb3ebda7\"},\"breadcrumb\":{\"@id\":\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/#breadcrumb\"},\"inLanguage\":\"en-GB\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/\"]}]},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\/\/www.tsls.co.uk\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"Using Windows Azure HD insights for processing Big Data\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\/\/www.tsls.co.uk\/#website\",\"url\":\"https:\/\/www.tsls.co.uk\/\",\"name\":\"TSLS - Luke Smith\",\"description\":\"- Knowledge - Thoughts - Microsoft -\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\/\/www.tsls.co.uk\/?s={search_term_string}\"},\"query-input\":\"required name=search_term_string\"}],\"inLanguage\":\"en-GB\"},{\"@type\":\"Person\",\"@id\":\"https:\/\/www.tsls.co.uk\/#\/schema\/person\/e4d7dac4fe1b3f8df31f3857bb3ebda7\",\"name\":\"Luke Smith\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-GB\",\"@id\":\"https:\/\/www.tsls.co.uk\/#\/schema\/person\/image\/\",\"url\":\"https:\/\/secure.gravatar.com\/avatar\/29abc50f07a4ebe68cb4f31981884f89b2157d7e4ed63b09631d40c0717faa94?s=96&d=mm&r=g\",\"contentUrl\":\"https:\/\/secure.gravatar.com\/avatar\/29abc50f07a4ebe68cb4f31981884f89b2157d7e4ed63b09631d40c0717faa94?s=96&d=mm&r=g\",\"caption\":\"Luke Smith\"},\"description\":\"I\u2019ve been working with Microsoft Technologies for over 20 years, my main focus now being Microsoft Online Services. I manage the Cloud Services at ElysianIT Limited and as a P-SELLER at Microsoft. I have worked with many organisations from SMC to Enterprise. I\u2019ve been working with Microsoft Technologies since DOS 5.0, to date I have been working on Microsoft\u2019s latest cloud technology Windows Azure, Windows 10 Office 365 and Microsoft SharePoint\",\"sameAs\":[\"http:\/\/www.tsls.co.uk\"],\"url\":\"https:\/\/www.tsls.co.uk\/index.php\/author\/luke\/\"}]}<\/script>\r\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"Using Windows Azure HD insights for processing Big Data - TSLS - Luke Smith","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/","og_locale":"en_GB","og_type":"article","og_title":"Using Windows Azure HD insights for processing Big Data - TSLS - Luke Smith","og_description":"Analyze and gain insights from Big Data using the power of Apache Hadoop Analyze unstructured data with Windows Azure HDInsight, a Big Data solution powered by Apache Hadoop. Build clusters in minutes optimized for speed","og_url":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/","og_site_name":"TSLS - Luke Smith","article_published_time":"2013-10-08T10:40:52+00:00","author":"Luke Smith","twitter_misc":{"Written by":"Luke Smith","Estimated reading time":"1 minute"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"WebPage","@id":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/","url":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/","name":"Using Windows Azure HD insights for processing Big Data - TSLS - Luke Smith","isPartOf":{"@id":"https:\/\/www.tsls.co.uk\/#website"},"datePublished":"2013-10-08T10:40:52+00:00","dateModified":"2013-10-08T10:40:52+00:00","author":{"@id":"https:\/\/www.tsls.co.uk\/#\/schema\/person\/e4d7dac4fe1b3f8df31f3857bb3ebda7"},"breadcrumb":{"@id":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/#breadcrumb"},"inLanguage":"en-GB","potentialAction":[{"@type":"ReadAction","target":["https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/"]}]},{"@type":"BreadcrumbList","@id":"https:\/\/www.tsls.co.uk\/index.php\/2013\/10\/08\/using-windows-azure-hd-insights-for-processing-big-data\/#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/www.tsls.co.uk\/"},{"@type":"ListItem","position":2,"name":"Using Windows Azure HD insights for processing Big Data"}]},{"@type":"WebSite","@id":"https:\/\/www.tsls.co.uk\/#website","url":"https:\/\/www.tsls.co.uk\/","name":"TSLS - Luke Smith","description":"- Knowledge - Thoughts - Microsoft -","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/www.tsls.co.uk\/?s={search_term_string}"},"query-input":"required name=search_term_string"}],"inLanguage":"en-GB"},{"@type":"Person","@id":"https:\/\/www.tsls.co.uk\/#\/schema\/person\/e4d7dac4fe1b3f8df31f3857bb3ebda7","name":"Luke Smith","image":{"@type":"ImageObject","inLanguage":"en-GB","@id":"https:\/\/www.tsls.co.uk\/#\/schema\/person\/image\/","url":"https:\/\/secure.gravatar.com\/avatar\/29abc50f07a4ebe68cb4f31981884f89b2157d7e4ed63b09631d40c0717faa94?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/29abc50f07a4ebe68cb4f31981884f89b2157d7e4ed63b09631d40c0717faa94?s=96&d=mm&r=g","caption":"Luke Smith"},"description":"I\u2019ve been working with Microsoft Technologies for over 20 years, my main focus now being Microsoft Online Services. I manage the Cloud Services at ElysianIT Limited and as a P-SELLER at Microsoft. I have worked with many organisations from SMC to Enterprise. I\u2019ve been working with Microsoft Technologies since DOS 5.0, to date I have been working on Microsoft\u2019s latest cloud technology Windows Azure, Windows 10 Office 365 and Microsoft SharePoint","sameAs":["http:\/\/www.tsls.co.uk"],"url":"https:\/\/www.tsls.co.uk\/index.php\/author\/luke\/"}]}},"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"jetpack_shortlink":"https:\/\/wp.me\/p2gf1k-u8","_links":{"self":[{"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/posts\/1868","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/users\/11"}],"replies":[{"embeddable":true,"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/comments?post=1868"}],"version-history":[{"count":0,"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/posts\/1868\/revisions"}],"wp:attachment":[{"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/media?parent=1868"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/categories?post=1868"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.tsls.co.uk\/index.php\/wp-json\/wp\/v2\/tags?post=1868"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}