Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Deb commented on 15-Aug-2019 06:46 AM
The Play - Station 3 comes in 20 GB, 60 GB, 80 GB, 40 GB, and 160 GB which is the current model.
Residual income - Residual income is income that comes to you personally for work that you have completed in the past. Channel Management Software - There are many benefits to using channel management software.

Here is my blog post -Fortnite CHEAT Free Downloa
Refugia commented on 15-Aug-2019 06:47 AM
I am glad to be a visitor of this arrant website, appreciate it for this rare information!

my blog post ::career builder
Casino Online Free Spins commented on 15-Aug-2019 06:51 AM
Wonderful items from you, man. I have consider your stuff prior to and you're simply
extremely fantastic. I actually like what you've acquired here, certainly like what you're stating and the
way in which through which you are saying it. You're making it
enjoyable and you still care for to keep it sensible. I can not wait to learn far more from you.
That is actually a great web site.
garage doors commented on 15-Aug-2019 06:57 AM
If some one desires to be updated with latest technologies therefore he must be pay a
quick visit this website and be up to date all the time.
Agen Togel commented on 15-Aug-2019 07:01 AM
Its like you read my mind! You appear to know a lot about this,
like you wrote the book in it or something.
I think that you could do with some pics to drive the message home a bit, but other than that, this is fantastic
blog. A great read. I'll definitely be back.
pieczatki commented on 15-Aug-2019 07:03 AM
naturally like your web-site however you need
to check the spelling on quite a few of your posts. Several of
them are rife with spelling problems and I in finding it very troublesome to tell the reality on the other hand I'll surely come
back again.
fishing hat commented on 15-Aug-2019 07:08 AM
Any decent lure can work when saltwater night fishing.
Taruhan bola commented on 15-Aug-2019 07:12 AM
Hi to all, the contents present at this web site are in fact remarkable for people knowledge,
well, keep up the good work fellows.
Desmond commented on 15-Aug-2019 07:23 AM
One from the best advantage of this card is perhaps you can easily enjoy movies, hear your chosen mp3 and other music selections, view pictures, read e-books and also can cause mini-library.
Residual income - Residual income is income that comes to you for work that you've done in the past. Take things slowly in support of cope with several dozen link exchanges on a daily basis .

Also visit my homepageFortnite Wallhack
Mt-Ryan.com commented on 15-Aug-2019 07:27 AM
If you want to take much from this article then you have
to apply these strategies to your won blog.
casino online usa player No deposit commented on 15-Aug-2019 07:39 AM
We absolutely love your blog and find almost all of your post's to be what
precisely I'm looking for. Would you offer guest writers to write content for you?
I wouldn't mind creating a post or elaborating on most of the subjects you write with regards to here.
Again, awesome site!
www.reorganizational.org commented on 15-Aug-2019 07:48 AM
Wonderful article! That is the type of info that are
supposed to be shared across the internet.
Shame on the seek engines for now not positioning
this publish higher! Come on over and visit my web site .
Thanks =)
Winfred commented on 15-Aug-2019 07:48 AM
Does your website have a contact page? I'm having problems locating it but, I'd like to shoot you an email.
I've got some recommendations for your blog you might be interested in hearing. Either way, great site and I look forward to seeing it expand over time.

Also visit my web blog ... healthy food
Situs Poker Terpercaya 2019 commented on 15-Aug-2019 07:50 AM
When some one searches for his required thing, therefore he/she needs to be available
that in detail, thus that thing is maintained over here.
http://vivy.us/northvalleycbd746439 commented on 15-Aug-2019 07:51 AM
There is clearly a bunch to identify about this. I assume you made some nice points
in features also.
bulbs compare commented on 15-Aug-2019 07:53 AM
What a information of un-ambiguity and preserveness of
valuable knowledge regarding unexpected emotions.
How sugar babies sites in usa commented on 15-Aug-2019 07:55 AM
Thank you for sharing with us, I conceive this website truly stands out :D.
free online casino slots commented on 15-Aug-2019 07:55 AM
Hey! I know this is kinda off topic but I was wondering
if you knew where I could locate a captcha plugin for my comment form?
I'm using the same blog platform as yours and I'm having trouble finding one?
Thanks a lot!
bandar ceme online indonesia commented on 15-Aug-2019 08:11 AM
very glad me can come to this site to see your wonderful post.
really grateful to leave a footprint here.
This is nicely said. . i will always comeback
here to follow your next article http://www.postbits.net/p/ceme-online/
Walter commented on 15-Aug-2019 08:27 AM
Thank you a lot for providing individuals with an extremely marvellous chance to check tips from this web site.
It can be so cool and as well , stuffed with amusement for me personally and my office colleagues to search your site no less than thrice in one week to find out the new secrets you have got. Of course, I'm so usually happy concerning the eye-popping techniques you serve.
Some 3 facts in this article are without a doubt the very best I have ever had.

Feel free to surf to my site: cruise control investing
Play Resorts Casino Online commented on 15-Aug-2019 08:34 AM
Thanks for sharing your thoughts on 현금 바둑이. Regards
http://ketogarciniadiet.com/ commented on 15-Aug-2019 08:44 AM
Hi there, just became alert to your blog through Google,
and found that it's truly informative. I am going to
watch out for brussels. I will be grateful if you continue this in future.
Numerous people will be benefited from your writing.
Cheers!
Bandar Poker commented on 15-Aug-2019 08:54 AM
Quality posts is the key to invite the viewers to pay a visit the website,
that's what this web page is providing.
솔레어카지노 commented on 15-Aug-2019 08:56 AM
Good article. I will be going through some of
these issues as well..
web commented on 15-Aug-2019 09:18 AM
It's really very complex in this full of activity life to listen news
on Television, therefore I just use internet for that purpose, and obtain the latest information.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
Deb commented on 15-Aug-2019 06:46 AM
The Play - Station 3 comes in 20 GB, 60 GB, 80 GB, 40 GB, and 160 GB which is the current model.
Residual income - Residual income is income that comes to you personally for work that you have completed in the past. Channel Management Software - There are many benefits to using channel management software.

Here is my blog post -Fortnite CHEAT Free Downloa
Refugia commented on 15-Aug-2019 06:47 AM
I am glad to be a visitor of this arrant website, appreciate it for this rare information!

my blog post ::career builder
Casino Online Free Spins commented on 15-Aug-2019 06:51 AM
Wonderful items from you, man. I have consider your stuff prior to and you're simply
extremely fantastic. I actually like what you've acquired here, certainly like what you're stating and the
way in which through which you are saying it. You're making it
enjoyable and you still care for to keep it sensible. I can not wait to learn far more from you.
That is actually a great web site.
garage doors commented on 15-Aug-2019 06:57 AM
If some one desires to be updated with latest technologies therefore he must be pay a
quick visit this website and be up to date all the time.
Agen Togel commented on 15-Aug-2019 07:01 AM
Its like you read my mind! You appear to know a lot about this,
like you wrote the book in it or something.
I think that you could do with some pics to drive the message home a bit, but other than that, this is fantastic
blog. A great read. I'll definitely be back.
pieczatki commented on 15-Aug-2019 07:03 AM
naturally like your web-site however you need
to check the spelling on quite a few of your posts. Several of
them are rife with spelling problems and I in finding it very troublesome to tell the reality on the other hand I'll surely come
back again.
fishing hat commented on 15-Aug-2019 07:08 AM
Any decent lure can work when saltwater night fishing.
Taruhan bola commented on 15-Aug-2019 07:12 AM
Hi to all, the contents present at this web site are in fact remarkable for people knowledge,
well, keep up the good work fellows.
Desmond commented on 15-Aug-2019 07:23 AM
One from the best advantage of this card is perhaps you can easily enjoy movies, hear your chosen mp3 and other music selections, view pictures, read e-books and also can cause mini-library.
Residual income - Residual income is income that comes to you for work that you've done in the past. Take things slowly in support of cope with several dozen link exchanges on a daily basis .

Also visit my homepageFortnite Wallhack
Mt-Ryan.com commented on 15-Aug-2019 07:27 AM
If you want to take much from this article then you have
to apply these strategies to your won blog.
casino online usa player No deposit commented on 15-Aug-2019 07:39 AM
We absolutely love your blog and find almost all of your post's to be what
precisely I'm looking for. Would you offer guest writers to write content for you?
I wouldn't mind creating a post or elaborating on most of the subjects you write with regards to here.
Again, awesome site!
www.reorganizational.org commented on 15-Aug-2019 07:48 AM
Wonderful article! That is the type of info that are
supposed to be shared across the internet.
Shame on the seek engines for now not positioning
this publish higher! Come on over and visit my web site .
Thanks =)
Winfred commented on 15-Aug-2019 07:48 AM
Does your website have a contact page? I'm having problems locating it but, I'd like to shoot you an email.
I've got some recommendations for your blog you might be interested in hearing. Either way, great site and I look forward to seeing it expand over time.

Also visit my web blog ... healthy food
Situs Poker Terpercaya 2019 commented on 15-Aug-2019 07:50 AM
When some one searches for his required thing, therefore he/she needs to be available
that in detail, thus that thing is maintained over here.
http://vivy.us/northvalleycbd746439 commented on 15-Aug-2019 07:51 AM
There is clearly a bunch to identify about this. I assume you made some nice points
in features also.
bulbs compare commented on 15-Aug-2019 07:53 AM
What a information of un-ambiguity and preserveness of
valuable knowledge regarding unexpected emotions.
How sugar babies sites in usa commented on 15-Aug-2019 07:55 AM
Thank you for sharing with us, I conceive this website truly stands out :D.
free online casino slots commented on 15-Aug-2019 07:55 AM
Hey! I know this is kinda off topic but I was wondering
if you knew where I could locate a captcha plugin for my comment form?
I'm using the same blog platform as yours and I'm having trouble finding one?
Thanks a lot!
bandar ceme online indonesia commented on 15-Aug-2019 08:11 AM
very glad me can come to this site to see your wonderful post.
really grateful to leave a footprint here.
This is nicely said. . i will always comeback
here to follow your next article http://www.postbits.net/p/ceme-online/
Walter commented on 15-Aug-2019 08:27 AM
Thank you a lot for providing individuals with an extremely marvellous chance to check tips from this web site.
It can be so cool and as well , stuffed with amusement for me personally and my office colleagues to search your site no less than thrice in one week to find out the new secrets you have got. Of course, I'm so usually happy concerning the eye-popping techniques you serve.
Some 3 facts in this article are without a doubt the very best I have ever had.

Feel free to surf to my site: cruise control investing
Play Resorts Casino Online commented on 15-Aug-2019 08:34 AM
Thanks for sharing your thoughts on 현금 바둑이. Regards
http://ketogarciniadiet.com/ commented on 15-Aug-2019 08:44 AM
Hi there, just became alert to your blog through Google,
and found that it's truly informative. I am going to
watch out for brussels. I will be grateful if you continue this in future.
Numerous people will be benefited from your writing.
Cheers!
Bandar Poker commented on 15-Aug-2019 08:54 AM
Quality posts is the key to invite the viewers to pay a visit the website,
that's what this web page is providing.
솔레어카지노 commented on 15-Aug-2019 08:56 AM
Good article. I will be going through some of
these issues as well..
web commented on 15-Aug-2019 09:18 AM
It's really very complex in this full of activity life to listen news
on Television, therefore I just use internet for that purpose, and obtain the latest information.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.