Common data science project flow
Under
November 05, 2014
As working across multiple data science projects, I observed a similar pattern across a group of strategic data science projects where a com...
Showing posts with label data mining. Show all posts
Showing posts with label data mining. Show all posts
Wednesday, November 5, 2014
Sunday, July 27, 2014
Incorporate domain knowledge into predictive model
Under
July 27, 2014
As a data scientist / consultant, in many cases we are being called in to work with domain experts who has in-depth business knowledge of in...
Saturday, November 9, 2013
Diverse recommender
Under
November 09, 2013
This is a continuation of my previous blog in recommendation systems , which describes some basic algorithm for building recommendation syst...
Saturday, September 7, 2013
Exploration and Exploitation
Under
September 07, 2013
"Cold Start" is a common problem happens quite frequent in recommendation system. When a new item enters, there is no prior histo...
Saturday, August 17, 2013
Six steps in data science
Under
August 17, 2013
"Data science" and "Big data" has become a very hot term in last 2 years. Since the data storage price dropped signific...
Monday, July 29, 2013
OLAP operation in R
Under
July 29, 2013
OLAP (Online Analytical Processing) is a very common way to analyze raw transaction data by aggregating along different combinations of dime...
Friday, February 15, 2013
Text Processing (part 1) : Entity Recognition
Under
February 15, 2013
Entity recognition is commonly used to parse unstructured text document and extract useful entity information (like location, person, brand)...
Monday, January 14, 2013
Optimization in R
Under
January 14, 2013
Optimization is a very common problem in data analytics. Given a set of variables (which one has control), how to pick the right value such...
Thursday, October 4, 2012
Machine Learning in Gradient Descent
Under
October 04, 2012
In Machine Learning, gradient descent is a very popular learning mechanism that is based on a greedy, hill-climbing approach. Gradient Desce...
Sunday, September 23, 2012
Location Sensitive Hashing in Map Reduce
Under
September 23, 2012
Inspired by Dr. Gautam Shroff who teaches the class: Web Intelligence and Big data in coursera.org, there are many scenarios where we want t...
Monday, August 13, 2012
BIG Data Analytics Pipeline
Under
August 13, 2012
" Big Data Analytics " has recently been one of the hottest buzzwords. It is a combination of "Big Data" and "Deep...
Wednesday, August 8, 2012
Measuring similarity and distance function
Under
August 08, 2012
Measuring similarity or distance between two data points is very fundamental to many Machine Learning algorithms such as K-Nearest-Neighbor,...
