Big Data with Hadoop with Jeremiah Peschka
Carl and Richard talk to Jeremiah Peschka about implementing Hadoop in the .NET world. Jeremiah starts out the discussion pointing to a blog post he's done on the Basics of Hadoop (check the links) and how the focus of Hadoop is on the cloud - pre-configured Hadoop solutions in the cloud make life easier, but you have to get the data there. Jeremiah digs into the diversity of tools available to work with Hadoop - you can use SQL-like commands, or build your own controlling code in C#. And what about data mining? Big Data is here to stay! Don't forget to activate your MSDN Azure account and be automatically entered to win an Aston Martin V8 Vantage!
Guests:
Jeremiah Peschka
Jeremiah Peschka helps developers, DBAs, and engineers build faster, robust, and scalable solutions; Microsoft SQL Server is frequently a part of that solution, but other databases are also. He has worked as a database and emerging technology expert at Quest Software researching new trends and technologies around data storage. Before that Jeremiah worked across many industries as a system administrator, developer, and DBA, and has been involved in all aspects of application development and deployment.
Links:
- Using Hadoop with C# and Azure http://www.amazedsaint.com/2012/06/analyzing-some-big-data-using-c-azure.html
- Spatial Aggregates in SQL Server 2012 http://blog.sqlauthority.com/2013/02/27/sql-server-beginning-sql-2012-spatial-unions-and-collections-abstract-from-joes-2-pros-volume-3/
- MSDN Azure Sweepstakes http://aka.ms/azurerocks
- Hive http://hive.apache.org/
- Hadoop on Azure https://www.hadooponazure.com/
- HortonWorks http://hortonworks.com/
- Hadoop on AWS http://aws.amazon.com/big-data/
- Apache Flume http://flume.apache.org/
- Bad Apache http://www.youtube.com/watch?v=yo4glASbEh4
- Apache Mahout http://mahout.apache.org/
- Scalding https://github.com/twitter/scalding
- Jeremiah's Blog Post on Hadoop http://facility9.com/2010/10/hadoop-world-follow-up/