Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
1888Bets.Com commented on 13-Jan-2019 07:36 AM
Thanks for any other informative blog. Where else may just I am
getting that type of info written in such a perfect method?
I have a project that I am simply now working on, and I've
been at the glance out for such information.
cupin net Lottery 4d singapore commented on 13-Jan-2019 07:39 AM
Hey! I could have sworn I've been to this blog before but after
browsing through some of the post I realized it's new
to me. Nonetheless, I'm definitely delighted I found it and I'll be book-marking and checking back often!
Tabel Angka Main 2D commented on 13-Jan-2019 07:41 AM
Thanks very nice blog!
Best Websites 2018 To visit commented on 13-Jan-2019 07:56 AM
I like the helpful information you provide in your articles.
I'll bookmark your blog and check again here regularly.
I am quite certain I will learn a lot of new stuff right here!
Good luck for the next!
pdf passwort commented on 13-Jan-2019 07:59 AM
The the next occasion I just read a blog, Hopefully that this doesnt disappoint me up to this. I am talking about, It was my method to read, but I really thought youd have something interesting to express. All I hear can be a number of whining about something that you could fix should you werent too busy looking for attention.
Situs Bandar commented on 13-Jan-2019 08:10 AM
When someone writes an piece of writing he/she retains the image of a user in his/her brain that how a user
can know it. Therefore that's why this article is amazing.
Thanks!
Kendra commented on 13-Jan-2019 08:38 AM
Amazing blog! Is your theme custom made or did you download it from somewhere?

A design like yours with a few simple adjustements would really make my blog jump out. Please let me know where you got your theme. With thanks

my web-site :: Lawyers Along
gbwhatsapp commented on 13-Jan-2019 08:42 AM
Greetings! This is my first visit to your blog!
We are a group of volunteers and starting a new initiative in a community in the same niche.
Your blog provided us valuable information to work on. You have done a wonderful job!
gbwhatsapp commented on 13-Jan-2019 08:42 AM
I do not even know how I ended up here, but I thought this post was good.
I do not know who you are but certainly you're going to a famous blogger if you aren't already ;) Cheers!
Lorenza commented on 13-Jan-2019 09:17 AM
Du hast eine Frage zu deine bevorstehende Umzugsreinigung?
Schreibe uns einfach hier! Unverbindlich und kostenlos ;)
Rosemary commented on 13-Jan-2019 09:17 AM
Outstanding article over again. Thank you.

Here is my web pageDivorce court 2017 full episodes Today
viagra 100mg commented on 13-Jan-2019 09:47 AM
I visited various blogs but the audio feature for audio songs current at this web site
is actually superb. viagra 100mg
Rochelle commented on 13-Jan-2019 10:16 AM
My brother recommended I might like this blog. He used to be totally right.
This submit actually made my day. You can not believe just how much time I had spent for this information! Thanks!

Here is my page -Malacandra.org
Lee commented on 13-Jan-2019 10:28 AM
Regards for all your efforts that you have put in this.
Very interesting info.

my web pageuncontested divorce in Illinois
washer fluid reservoir commented on 13-Jan-2019 11:10 AM
It's actually very difficult in this active life to listen news on TV,
thus I only use the web for that purpose, and obtain the hottest information.
Tamela commented on 13-Jan-2019 11:22 AM
Only wanna remark on few general things, The website style and design is perfect, the content material is real superb :D.


Feel free to visit my website ::Casino bonus Blog
Korpolitics.com commented on 13-Jan-2019 12:49 PM
Hi, i think that i noticed you visited my site thus i came to
go back the choose?.I am attempting to to find things to improve my website!I suppose its ok to
use a few of your ideas!!
orlando locksmith commented on 13-Jan-2019 12:58 PM
Can I just say what a comfort to discover
somebody who really knows what they are talking about on the net.
You definitely realize how to bring a problem to light and make it important.

More and more people should look at this and understand this
side of the story. I can't believe you are not more popular because you surely have the gift.
best products To get Rid of cellulite commented on 13-Jan-2019 01:32 PM
Heya i'm for the first time here. I found this board and I find It really useful & it helped me
out a lot. I hope to give something back and help others like
you helped me.
Jefferson commented on 13-Jan-2019 01:43 PM
Useful information. Fortunate me I discovered your web site accidentally, and I am stunned why this
accident did not happened earlier! I bookmarked it.
toi den nhat ban commented on 13-Jan-2019 01:59 PM
I do agree with all of the ideas you've introduced in your post.
They're really convincing and will definitely work.
Still, the posts are too quick for newbies. Could you please prolong them a bit from subsequent
time? Thanks for the post.
카지노쿠폰 commented on 13-Jan-2019 03:10 PM
On this video and this text , I do exactly that.
http://circleguru.com/places/super-locksmith commented on 13-Jan-2019 03:36 PM
Super Locksmith
10833 Sakonnet River Dr, Tampa, FL 33615
(813) 285-7477
Nickolas commented on 13-Jan-2019 03:57 PM
I was honored to receive a call from a friend immediately he identified the important tips shared on the site.
Going through your blog posting is a real great experience. Many thanks for thinking of readers just like me, and I wish you the best of success as a professional in this field.

Here is my web-site ::Www.Jenna-Bailey.Com
geschütztes pdf drucken commented on 13-Jan-2019 04:40 PM
There are certainly many details like this to take into consideration. It really is a excellent specify bring up. I provide the thoughts above as general inspiration but clearly there are actually questions just like the one you bring up where the most important factor might be doing work in honest good faith. I don?t know if best practices have emerged around items like that, but I know that the job is clearly referred to as a good game. Both boys and girls notice the impact of just a moment’s pleasure, throughout their lives.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
1888Bets.Com commented on 13-Jan-2019 07:36 AM
Thanks for any other informative blog. Where else may just I am
getting that type of info written in such a perfect method?
I have a project that I am simply now working on, and I've
been at the glance out for such information.
cupin net Lottery 4d singapore commented on 13-Jan-2019 07:39 AM
Hey! I could have sworn I've been to this blog before but after
browsing through some of the post I realized it's new
to me. Nonetheless, I'm definitely delighted I found it and I'll be book-marking and checking back often!
Tabel Angka Main 2D commented on 13-Jan-2019 07:41 AM
Thanks very nice blog!
Best Websites 2018 To visit commented on 13-Jan-2019 07:56 AM
I like the helpful information you provide in your articles.
I'll bookmark your blog and check again here regularly.
I am quite certain I will learn a lot of new stuff right here!
Good luck for the next!
pdf passwort commented on 13-Jan-2019 07:59 AM
The the next occasion I just read a blog, Hopefully that this doesnt disappoint me up to this. I am talking about, It was my method to read, but I really thought youd have something interesting to express. All I hear can be a number of whining about something that you could fix should you werent too busy looking for attention.
Situs Bandar commented on 13-Jan-2019 08:10 AM
When someone writes an piece of writing he/she retains the image of a user in his/her brain that how a user
can know it. Therefore that's why this article is amazing.
Thanks!
Kendra commented on 13-Jan-2019 08:38 AM
Amazing blog! Is your theme custom made or did you download it from somewhere?

A design like yours with a few simple adjustements would really make my blog jump out. Please let me know where you got your theme. With thanks

my web-site :: Lawyers Along
gbwhatsapp commented on 13-Jan-2019 08:42 AM
Greetings! This is my first visit to your blog!
We are a group of volunteers and starting a new initiative in a community in the same niche.
Your blog provided us valuable information to work on. You have done a wonderful job!
gbwhatsapp commented on 13-Jan-2019 08:42 AM
I do not even know how I ended up here, but I thought this post was good.
I do not know who you are but certainly you're going to a famous blogger if you aren't already ;) Cheers!
Lorenza commented on 13-Jan-2019 09:17 AM
Du hast eine Frage zu deine bevorstehende Umzugsreinigung?
Schreibe uns einfach hier! Unverbindlich und kostenlos ;)
Rosemary commented on 13-Jan-2019 09:17 AM
Outstanding article over again. Thank you.

Here is my web pageDivorce court 2017 full episodes Today
viagra 100mg commented on 13-Jan-2019 09:47 AM
I visited various blogs but the audio feature for audio songs current at this web site
is actually superb. viagra 100mg
Rochelle commented on 13-Jan-2019 10:16 AM
My brother recommended I might like this blog. He used to be totally right.
This submit actually made my day. You can not believe just how much time I had spent for this information! Thanks!

Here is my page -Malacandra.org
Lee commented on 13-Jan-2019 10:28 AM
Regards for all your efforts that you have put in this.
Very interesting info.

my web pageuncontested divorce in Illinois
washer fluid reservoir commented on 13-Jan-2019 11:10 AM
It's actually very difficult in this active life to listen news on TV,
thus I only use the web for that purpose, and obtain the hottest information.
Tamela commented on 13-Jan-2019 11:22 AM
Only wanna remark on few general things, The website style and design is perfect, the content material is real superb :D.


Feel free to visit my website ::Casino bonus Blog
Korpolitics.com commented on 13-Jan-2019 12:49 PM
Hi, i think that i noticed you visited my site thus i came to
go back the choose?.I am attempting to to find things to improve my website!I suppose its ok to
use a few of your ideas!!
orlando locksmith commented on 13-Jan-2019 12:58 PM
Can I just say what a comfort to discover
somebody who really knows what they are talking about on the net.
You definitely realize how to bring a problem to light and make it important.

More and more people should look at this and understand this
side of the story. I can't believe you are not more popular because you surely have the gift.
best products To get Rid of cellulite commented on 13-Jan-2019 01:32 PM
Heya i'm for the first time here. I found this board and I find It really useful & it helped me
out a lot. I hope to give something back and help others like
you helped me.
Jefferson commented on 13-Jan-2019 01:43 PM
Useful information. Fortunate me I discovered your web site accidentally, and I am stunned why this
accident did not happened earlier! I bookmarked it.
toi den nhat ban commented on 13-Jan-2019 01:59 PM
I do agree with all of the ideas you've introduced in your post.
They're really convincing and will definitely work.
Still, the posts are too quick for newbies. Could you please prolong them a bit from subsequent
time? Thanks for the post.
카지노쿠폰 commented on 13-Jan-2019 03:10 PM
On this video and this text , I do exactly that.
http://circleguru.com/places/super-locksmith commented on 13-Jan-2019 03:36 PM
Super Locksmith
10833 Sakonnet River Dr, Tampa, FL 33615
(813) 285-7477
Nickolas commented on 13-Jan-2019 03:57 PM
I was honored to receive a call from a friend immediately he identified the important tips shared on the site.
Going through your blog posting is a real great experience. Many thanks for thinking of readers just like me, and I wish you the best of success as a professional in this field.

Here is my web-site ::Www.Jenna-Bailey.Com
geschütztes pdf drucken commented on 13-Jan-2019 04:40 PM
There are certainly many details like this to take into consideration. It really is a excellent specify bring up. I provide the thoughts above as general inspiration but clearly there are actually questions just like the one you bring up where the most important factor might be doing work in honest good faith. I don?t know if best practices have emerged around items like that, but I know that the job is clearly referred to as a good game. Both boys and girls notice the impact of just a moment’s pleasure, throughout their lives.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.