Tech Review Big Data: Thursday, September 6, 2012

Big data

http://en.wikipedia.org/wiki/Big_data

• a collection of data sets so large and complex that it becomes awkward to work with using on-hand database management tools.
• Difficulties
• capture
• storage
• search
• sharing
• analysis
• visualization
• What is considered "big data" varies depending on the capabilities of the organization managing the data set.
• Big data sizes are a constantly moving target
• few dozen terabytes
• many petabytes
• new platform of "big data" tools 
• Apache Hadoop
• MIKE2.0
• http://en.wikipedia.org/wiki/MIKE2.0_Methodology
• Method for an Integrated Knowledge Environment
• Open source
• delivery methodology for Enterprise information management
• Doug Laney
• data growth challenges and opportunities are three-dimensional
• increasing volume (amount of data)
• velocity (speed of data in and out)
• variety (range of data types and sources)
• Big players in big data
• Oracle
• IBM
• Microsoft
• SAP
• HP

10 Steps for Testing and Choosing a Big Data Appliance

http://www.dbta.com/Articles/Editorial/Trends-and-Applications/10-Steps-for-Testing-and-Choosing-a-Big-Data-Appliance-84234.aspx

Marko Grobelnik

http://ailab.ijs.si/marko_grobelnik/

IBM:  What is big data?

http://www-01.ibm.com/software/data/bigdata/

• Spans four dimension
• Volume
• Velocity
• Variety
• Veracity
• big data is more than simply a matter of size

IBM big data platform

http://www-01.ibm.com/software/data/bigdata/enterprise.html

Do a search on "ibm what is big data?" for some more reading.

O'Reilly:  What is big data?

http://strata.oreilly.com/2012/01/what-is-big-data.html

• data that exceeds the processing capacity of conventional db systems.
• too big
• too fast
• doesn't fit structures of db architectures

Google BigQuery

http://cloud.google.com/products/big-query.html?utm_source=google&utm_medium=cpc&utm_campaign=bigquery-search

Stanford University:  Data Mining Certificates Online

http://scpd.stanford.edu/ppc/massive-datasets-courses.jsp?_vsrefdom=Adwords-Other&_s_ref=znK6APw3S&kw=training%20for%20data%20mining&creative=13076848341&gclid=CLvOieHhobICFYOb7QodAhoAGw

• concepts not tools
• doesn't seem to be hands on

Texas A&M:  Data Mining Certificate

http://www.stat.tamu.edu/dist/content_link.php?page=Certificates&gclid=COnzhpniobICFcuP7QoduHUAXg

• SAS classes
• heavily statistic based

Who are the top influencers in Big Data, Analytics, Data Mining?

http://www.kdnuggets.com/2012/02/top-influencers-big-data-analytics-data-mining.html

Big Data on Campus

http://www.nytimes.com/2012/07/22/education/edlife/colleges-awakening-to-the-opportunities-of-data-mining.html?pagewanted=all&_moc.semityn.www

• should be called big data in education

Online Education in Analytics, Data Mining and Data Science

http://www.kdnuggets.com/education/online.html

Big Data University

http://www.bigdatauniversity.com/

http://bigdatauniversity.com/courses/course/view.php?id=504&justenroled=1

Web Intelligence and Big Data

https://www.coursera.org/course/bigdata

Army: Manning Snuck 'Data-Mining' Software Onto Secret Network

http://www.wired.com/threatlevel/2011/04/manning-data-mining/