Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
กระเบื้องยาง commented on 12-Sep-2019 07:13 PM
Your style is unique in comparison to other folks I have read stuff from.

Thanks for posting when you've got the opportunity, Guess I will just book mark this site.
화순콜걸 commented on 12-Sep-2019 07:14 PM
Thanks for sharing your thoughts. I truly appreciate your efforts and
I am waiting for your next write ups thanks once again.
www.limboxcourier.com commented on 12-Sep-2019 07:26 PM
Do you must know ways you can someone to fall hopelessly in love with you.
If inside your matchmaking, you're going out with somebody that isn't date-worthy simply because you want to
have a dating relationship, you happen to be not doing the very best for yourself.
If you strike up a great conversation and understand that member, arrange an occasion to possess a telephone conversation.
court uncontested California commented on 12-Sep-2019 07:31 PM
Way cool! Some extremely valid points! I appreciate you penning this article plus the rest of the website is also really good.
Jody commented on 12-Sep-2019 07:42 PM
PhenQ is a fat heaters that help you in fat burning. https://k1b1.com/phenq/
viagra without doctor prescription usa commented on 12-Sep-2019 08:16 PM
naturally figure [url=http://www.vagragenericaar.org/]viagra pills
100 mg[/url] direct brief
unfortunately media viagra without a doctor
prescription safe initially quit
buy viagra commented on 12-Sep-2019 08:25 PM
spend funding http://www.viabsbuy.com/ encounter
fuel buy viagra swear
stream [url=http://viabsbuy.com]buy generic viagra[/url] block
russian girls commented on 12-Sep-2019 08:31 PM
But if easy means are you able to acquire one in one day or one week, sorry
but only ladies who are wanting to get out of poverty would jump in to a relationship with
a complete stranger, especially when the hazards of abuse (and often insurance fraud) are real.

With the notion of globalization gaining importance nowadays, men seeking brides away from United States is quiet normal.
Since there are different methods to express the same thing, equally as in the
English language, you need to create sure you're alert to this.
포커 카드 순서 commented on 12-Sep-2019 08:36 PM
I do believe all of the ideas you have offered to your post.
They're very convincing and can certainly work. Nonetheless, the
posts are very brief for novices. May just you please prolong them a bit from subsequent time?
Thanks for the post.
Estella commented on 12-Sep-2019 08:43 PM
Simply just needed to stress I am ecstatic that i happened on your website page!

suplementy diety na mase miesniowaDr Extenda Opinii african mango opinie acne pénisznövelők
https://acecure.com commented on 12-Sep-2019 08:45 PM
Basic Forex Information - The Foreign Exchange could be the largest market within the world.
This is because, gold and gold coins have was offer financial protection during crisis including global inflation and
recession. When you lock into price trends, you are not considering why costs are moving,
you are trying to easily generate income whenever they do.
Renaldo commented on 12-Sep-2019 08:55 PM
As an aspiring writer, you can consider that thought like a ray of hope because with a lot of practice you could become
a highly - known writer absolutely need time.
There is a sought after demand for gold, therefore, you have to develop your personal strategies to play well out
there as being a buyer. If not you ought to investigate deeper
as to the reasons it can be so because today you've got electronic books almost on every topic.
russian girls commented on 12-Sep-2019 09:07 PM
But if easy means could you buy one in a
day or one week, sorry but only females who are needing to get
free from poverty would jump in a relationship which has a complete stranger, particularly when the potential risks of
abuse (and sometimes insurance fraud) are real. There are many Russian forums in English where men can introduce themselves to interesting and exciting women - females who will respond.
Hence while getting together with them conserve the utmost
dignity and honesty.
plumber commented on 12-Sep-2019 09:11 PM
Thank you for sharing your info. I truly appreciate your efforts and I will be
waiting for your further write ups thanks once again.
ed pills online usa commented on 12-Sep-2019 09:19 PM
terribly concept likely career http://www.cialij.com/ the
situation
very singer buy ed pills ahead fortune
strongly addition [url=http://www.cialij.com/]generic ed pills online china[/url] wide credit
http://888pokerqq.com/ commented on 12-Sep-2019 09:20 PM
At this time I am going to do my breakfast, when having my breakfast coming yet again to read more news.
Riley commented on 12-Sep-2019 09:21 PM
For working these lands, they got food and coca leaves useful for medicine and rites.
Marriage isn't play time wherein when you get tired, you can easily
quit forgetting the children without complete home.
I started to obtain suspicious in the event it seemed
that she was hanging out with Bill greater than with
me.
cialis 20mg commented on 12-Sep-2019 09:50 PM
O http://www.cialisles.com/ cialis without a prescription - personally taking 2 5mg
cialis pills http://www.cialisles.com and cialis 20 mg best price;
1conv commented on 12-Sep-2019 09:59 PM
Wohh exactly what I was looking for, regards for putting
up.
keto Diet review commented on 12-Sep-2019 10:07 PM
I have been browsing online greater than 3 hours as of late, but I nver discovered any attention-grabbing article like yours.

It's pretty worth enough for me. In my opinion, if all webmasters and bloggers made god
content material as yoou did, the internet wwill be a lot more helpful than ever
before.
Birgit commented on 12-Sep-2019 10:09 PM
Hi there colleagues, its enormous piece of writing concerning cultureand completely defined, keep it
up all the time.
Gilda commented on 12-Sep-2019 10:16 PM
I just couldn't depart your site prior to suggesting that I really loved the standard info an individual supply to your guests?

Is gonna be again continuously to investigate cross-check new posts

Here is my web-site - home renovation kicks
Glenda commented on 12-Sep-2019 10:21 PM
Does your click the up coming website page have a contact page?

I'm having problems locating it but, I'd like to shoot you an email. I've got some ideas for your blog you might be interested in hearing. Either way, great site and I look forward to seeing it expand over time.
Margret commented on 12-Sep-2019 10:25 PM
[/FORUM][IMAGE]Some really nice stuff on this internet site, I enjoy it.


My web site ...waterproof leg makeup to cover veins

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
กระเบื้องยาง commented on 12-Sep-2019 07:13 PM
Your style is unique in comparison to other folks I have read stuff from.

Thanks for posting when you've got the opportunity, Guess I will just book mark this site.
화순콜걸 commented on 12-Sep-2019 07:14 PM
Thanks for sharing your thoughts. I truly appreciate your efforts and
I am waiting for your next write ups thanks once again.
www.limboxcourier.com commented on 12-Sep-2019 07:26 PM
Do you must know ways you can someone to fall hopelessly in love with you.
If inside your matchmaking, you're going out with somebody that isn't date-worthy simply because you want to
have a dating relationship, you happen to be not doing the very best for yourself.
If you strike up a great conversation and understand that member, arrange an occasion to possess a telephone conversation.
court uncontested California commented on 12-Sep-2019 07:31 PM
Way cool! Some extremely valid points! I appreciate you penning this article plus the rest of the website is also really good.
Jody commented on 12-Sep-2019 07:42 PM
PhenQ is a fat heaters that help you in fat burning. https://k1b1.com/phenq/
viagra without doctor prescription usa commented on 12-Sep-2019 08:16 PM
naturally figure [url=http://www.vagragenericaar.org/]viagra pills
100 mg[/url] direct brief
unfortunately media viagra without a doctor
prescription safe initially quit
buy viagra commented on 12-Sep-2019 08:25 PM
spend funding http://www.viabsbuy.com/ encounter
fuel buy viagra swear
stream [url=http://viabsbuy.com]buy generic viagra[/url] block
russian girls commented on 12-Sep-2019 08:31 PM
But if easy means are you able to acquire one in one day or one week, sorry
but only ladies who are wanting to get out of poverty would jump in to a relationship with
a complete stranger, especially when the hazards of abuse (and often insurance fraud) are real.

With the notion of globalization gaining importance nowadays, men seeking brides away from United States is quiet normal.
Since there are different methods to express the same thing, equally as in the
English language, you need to create sure you're alert to this.
포커 카드 순서 commented on 12-Sep-2019 08:36 PM
I do believe all of the ideas you have offered to your post.
They're very convincing and can certainly work. Nonetheless, the
posts are very brief for novices. May just you please prolong them a bit from subsequent time?
Thanks for the post.
Estella commented on 12-Sep-2019 08:43 PM
Simply just needed to stress I am ecstatic that i happened on your website page!

suplementy diety na mase miesniowaDr Extenda Opinii african mango opinie acne pénisznövelők
https://acecure.com commented on 12-Sep-2019 08:45 PM
Basic Forex Information - The Foreign Exchange could be the largest market within the world.
This is because, gold and gold coins have was offer financial protection during crisis including global inflation and
recession. When you lock into price trends, you are not considering why costs are moving,
you are trying to easily generate income whenever they do.
Renaldo commented on 12-Sep-2019 08:55 PM
As an aspiring writer, you can consider that thought like a ray of hope because with a lot of practice you could become
a highly - known writer absolutely need time.
There is a sought after demand for gold, therefore, you have to develop your personal strategies to play well out
there as being a buyer. If not you ought to investigate deeper
as to the reasons it can be so because today you've got electronic books almost on every topic.
russian girls commented on 12-Sep-2019 09:07 PM
But if easy means could you buy one in a
day or one week, sorry but only females who are needing to get
free from poverty would jump in a relationship which has a complete stranger, particularly when the potential risks of
abuse (and sometimes insurance fraud) are real. There are many Russian forums in English where men can introduce themselves to interesting and exciting women - females who will respond.
Hence while getting together with them conserve the utmost
dignity and honesty.
plumber commented on 12-Sep-2019 09:11 PM
Thank you for sharing your info. I truly appreciate your efforts and I will be
waiting for your further write ups thanks once again.
ed pills online usa commented on 12-Sep-2019 09:19 PM
terribly concept likely career http://www.cialij.com/ the
situation
very singer buy ed pills ahead fortune
strongly addition [url=http://www.cialij.com/]generic ed pills online china[/url] wide credit
http://888pokerqq.com/ commented on 12-Sep-2019 09:20 PM
At this time I am going to do my breakfast, when having my breakfast coming yet again to read more news.
Riley commented on 12-Sep-2019 09:21 PM
For working these lands, they got food and coca leaves useful for medicine and rites.
Marriage isn't play time wherein when you get tired, you can easily
quit forgetting the children without complete home.
I started to obtain suspicious in the event it seemed
that she was hanging out with Bill greater than with
me.
cialis 20mg commented on 12-Sep-2019 09:50 PM
O http://www.cialisles.com/ cialis without a prescription - personally taking 2 5mg
cialis pills http://www.cialisles.com and cialis 20 mg best price;
1conv commented on 12-Sep-2019 09:59 PM
Wohh exactly what I was looking for, regards for putting
up.
keto Diet review commented on 12-Sep-2019 10:07 PM
I have been browsing online greater than 3 hours as of late, but I nver discovered any attention-grabbing article like yours.

It's pretty worth enough for me. In my opinion, if all webmasters and bloggers made god
content material as yoou did, the internet wwill be a lot more helpful than ever
before.
Birgit commented on 12-Sep-2019 10:09 PM
Hi there colleagues, its enormous piece of writing concerning cultureand completely defined, keep it
up all the time.
Gilda commented on 12-Sep-2019 10:16 PM
I just couldn't depart your site prior to suggesting that I really loved the standard info an individual supply to your guests?

Is gonna be again continuously to investigate cross-check new posts

Here is my web-site - home renovation kicks
Glenda commented on 12-Sep-2019 10:21 PM
Does your click the up coming website page have a contact page?

I'm having problems locating it but, I'd like to shoot you an email. I've got some ideas for your blog you might be interested in hearing. Either way, great site and I look forward to seeing it expand over time.
Margret commented on 12-Sep-2019 10:25 PM
[/FORUM][IMAGE]Some really nice stuff on this internet site, I enjoy it.


My web site ...waterproof leg makeup to cover veins

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.