Trending Topics

  1. Real VS pretentious data scientists Troy Sadkowsky 01-Mar-2017

Latest News from DS

From Bhutan 19-Feb-2017

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
chineseforum.sg commented on 20-Jun-2019 03:05 AM
Hi there, this weekend is nice in support of
me, because this point in time i am reading this fantastic informative piece
of writing here at my home.
auto Ic tester commented on 20-Jun-2019 03:09 AM
If you want to take much from this post then you have to apply such techniques to your won website.
YooSlim Reviews commented on 20-Jun-2019 03:12 AM
Appreciate the recommendation. Will try it out.
Kirsten Fawkner commented on 20-Jun-2019 03:21 AM
Hello there, I found your blog by the use of Google while searching for a related subject, your
website came up, it seems to be great. I have bookmarked it
in my google bookmarks.
web page commented on 20-Jun-2019 03:21 AM
I am now not certain the place you're getting your info, but good topic.
I needs to spend some time studying more or working out more.
Thanks for excellent info I was in search of this info for my mission.
Nadine commented on 20-Jun-2019 03:23 AM
Excellent blog right here! Also your website a lot up very fast!
What web host are you the use of? Can I get your affiliate hyperlink for your host? I desire my web site loaded up as fast as yours lol.

My web page;https://Qaqeeonline.com/
Auto Ecu Fix commented on 20-Jun-2019 03:36 AM
I drop a comment when I appreciate a post on a website or if I have something to add to the discussion. It is caused by the fire displayed in the article I browsed.
And on this article How Can Thick Data Improve the Way We Use
Big Data?. I was actually excited enough to drop a comment ;-) I
actually do have a few questions for you if you do not mind.
Is it just me or does it look like like some of these comments come across as
if they are coming from brain dead people? :-P And, if you are writing at
other online sites, I would like to keep up with anything fresh you have to
post. Could you list the complete urls of all
your shared pages like your twitter feed, Facebook page or
linkedin profile?
situs poker bri online 24 jam commented on 20-Jun-2019 03:43 AM
I could not resist commenting. Exceptionally well written!
Newcamelot.Co.Uk commented on 20-Jun-2019 03:43 AM
Why visitors still use to read news papers when in this technological world everything
is existing on web?
http://ultrajosh.net commented on 20-Jun-2019 04:02 AM
The very next time I read a blog, Hopefully it does not disappoint me just as much as this one.
After all, Yes, it was my choice to read through, but I genuinely thought you'd have something useful to say.
All I hear is a bunch of moaning about something that you can fix
if you were not too busy looking for attention.
zee5 free subscription trick commented on 20-Jun-2019 04:27 AM
I must express appreciation to you just for bailing me out of this type of predicament. As a result of surfing through the online world and meeting notions that were not powerful, I figured my life was gone. Being alive without the strategies to the difficulties you have sorted out all through your entire blog post is a crucial case, as well as ones that could have adversely damaged my entire career if I hadn't come across your website. The ability and kindness in dealing with all the details was crucial. I'm not sure what I would've done if I had not discovered such a step like this. I am able to at this point relish my future. Thanks for your time so much for the reliable and results-oriented help. I will not hesitate to suggest the website to any person who would like direction on this subject.
smutstone cheats commented on 20-Jun-2019 04:28 AM
Fantastic goods from you, man. I've understand your stuff prior to and you're just extremely excellent. I really like what you have received here, certainly like what you are saying and the best way during which you assert it. You are making it entertaining and you continue to take care of to stay it sensible. I can't wait to read far more from you. This is actually a wonderful web site.
black squad hack commented on 20-Jun-2019 04:29 AM
I loved as much as you will receive carried out right here. The sketch is attractive, your authored subject matter stylish. nonetheless, you command get got an shakiness over that you wish be delivering the following. unwell unquestionably come more formerly again since exactly the same nearly very often inside case you shield this increase.
vionna01.amoblog.Com commented on 20-Jun-2019 04:54 AM
If you are going for most excellent contents like
I do, simply pay a quick visit this site every day because it offers feature contents,
thanks
Automotive Electronics Repair commented on 20-Jun-2019 04:57 AM
We're a group of volunteers and opening a new scheme in our community.
Your site offered us with valuable info to work on. You have done a formidable job and
our entire community will be thankful to you.
Johnathan commented on 20-Jun-2019 05:07 AM
Very quickly this site will be famous amid all blog people, due to it's good posts

Also visit my web site;현금섯다
Poker Online commented on 20-Jun-2019 05:11 AM
Marvelous, what a website it is! This webpage gives
helpful information to us, keep it up.
best male sex toys commented on 20-Jun-2019 05:16 AM
I always spent my half an hour to read this webpage's articles daily along with a
mug of coffee.
Savannah commented on 20-Jun-2019 05:18 AM
For instance, if you required publicizing a website inclined toward World Wide Web marketing strategies, you'll have to incorporate this keyword simply because division of your respective search term.
Building links marketing strategies depend on a voting system, the harder websites connect to you, the more often popular you seem inside eyes of search engines like yahoo, they reward website pages which are judged weight loss beneficial by other sites ( after they place one of the links for any web-site).
In order to get resolved, link building professionals usually prefer opting for the hundreds of forums and blogs available out there.

Feel free to surf to my web page ...Fortnite Cheat
Pauline commented on 20-Jun-2019 05:26 AM
It's a pity you don't have a donate button! I'd without a doubt donate to this outstanding blog!
I suppose for now i'll settle for bookmarking and adding your RSS feed to my Google account. I look forward to new updates and will share this website with my Facebook group. Talk soon!

Here is my homepage ::사이다쿨
วิเคราะห์บาส commented on 20-Jun-2019 05:41 AM
It's remarkable to pay a visit this web page and reading the views of
all friends about this article, while I am also eager of getting familiarity.
плейбой рунетки commented on 20-Jun-2019 06:05 AM
Найти бесплатный видеочат в онлайн.
Hey I know this is off topic but I was wondering if you knew of
any widgets I could add to my blog that automatically tweet my
newest twitter updates. I've been looking for a plug-in like this for quite
some time and was hoping maybe you would have some experience with something like
this. Please let me know if you run into anything. I truly
enjoy reading your blog and I look forward to your new updates.
Not working? commented on 20-Jun-2019 06:33 AM
I'm not sure where you're getting your information, however great topic.
I needs to spend some time finding out more or understanding
more. Thanks for fantastic information I was on the lookout for this info for my mission.
buy cialis online commented on 20-Jun-2019 06:54 AM
long term effects of tadalafil http://cialisle.com/ buy cialis.
benefits of tadalafil.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.

How Can Thick Data Improve the Way We Use Big Data?

Troy Sadkowsky - Friday, June 30, 2017

 

April 16, 2017

TedTalk: https://www.youtube.com/watch?v=WaOUJa9fjXU

Medium: https://medium.com/ethnography-matters/why-big-data-needs-thick-data-b4b3e75e3d7

Big data can help us solve problems, optimize services, predict the future and learn more about ourselves and human behavior. But when big data cannot answer a question, or makes an incorrect prediction, what if it is because data is not telling us the whole story?

In a Ted Talk and an article on Medium, Tricia Wang, a technology ethnographer, implores us to realize that, even in the age of data-driven decision making, big data can have some serious blind spots, and often suffers from a loss of context through valuable variables and trends that defy quantification.

Insights on contained systems, such as electricity grids or delivery logistics, have established big data’s reputation for success. Although this reputation has attracted investment from a huge array of companies, Wang claims, 73% of big data projects are not profitable, because big data projects frequently do not produce the insights that they seem to promise. For dynamic systems, especially those that depend on human emotions, behavior, and how people are impacted and interact with their environment, certain variables are difficult to measure and model.

She describes how opportunities can be gained and losses diminished by using big data in conjugation with “thick data”, observations that use qualitative methods to understand human emotions, behaviors and interactions with context. For example, the realization by ethnographer Graham McCracken that Netflix users actually enjoy binge-watching, led Netflix to redesign their user experience, improve their business and transform the way we consume media. Through qualitative research and collecting stories about how users interact with their product, Netflix was able to go to their data science team, validate these findings, and act on this competitive insight.

Wang summarizes that while “Thick Data loses scale…Big Data loses resolution.” While big data analytics can have a huge sample size, recognize large-scale patterns, and benefit from the strengths of machine learning, thick data uses small samples sizes, but understands subjects at a much greater depth, and benefits from aspects of human intelligence and pattern recognition that still elude computer programs. As data scientists, the more we understand the limitations of our methods and pay attention to thick data, the more we can recognize the factors and variables our data is missing. With a more holistic perspective, data analysis is better poised to uncover more truthful and powerful insights.

 

Comments
chineseforum.sg commented on 20-Jun-2019 03:05 AM
Hi there, this weekend is nice in support of
me, because this point in time i am reading this fantastic informative piece
of writing here at my home.
auto Ic tester commented on 20-Jun-2019 03:09 AM
If you want to take much from this post then you have to apply such techniques to your won website.
YooSlim Reviews commented on 20-Jun-2019 03:12 AM
Appreciate the recommendation. Will try it out.
Kirsten Fawkner commented on 20-Jun-2019 03:21 AM
Hello there, I found your blog by the use of Google while searching for a related subject, your
website came up, it seems to be great. I have bookmarked it
in my google bookmarks.
web page commented on 20-Jun-2019 03:21 AM
I am now not certain the place you're getting your info, but good topic.
I needs to spend some time studying more or working out more.
Thanks for excellent info I was in search of this info for my mission.
Nadine commented on 20-Jun-2019 03:23 AM
Excellent blog right here! Also your website a lot up very fast!
What web host are you the use of? Can I get your affiliate hyperlink for your host? I desire my web site loaded up as fast as yours lol.

My web page;https://Qaqeeonline.com/
Auto Ecu Fix commented on 20-Jun-2019 03:36 AM
I drop a comment when I appreciate a post on a website or if I have something to add to the discussion. It is caused by the fire displayed in the article I browsed.
And on this article How Can Thick Data Improve the Way We Use
Big Data?. I was actually excited enough to drop a comment ;-) I
actually do have a few questions for you if you do not mind.
Is it just me or does it look like like some of these comments come across as
if they are coming from brain dead people? :-P And, if you are writing at
other online sites, I would like to keep up with anything fresh you have to
post. Could you list the complete urls of all
your shared pages like your twitter feed, Facebook page or
linkedin profile?
situs poker bri online 24 jam commented on 20-Jun-2019 03:43 AM
I could not resist commenting. Exceptionally well written!
Newcamelot.Co.Uk commented on 20-Jun-2019 03:43 AM
Why visitors still use to read news papers when in this technological world everything
is existing on web?
http://ultrajosh.net commented on 20-Jun-2019 04:02 AM
The very next time I read a blog, Hopefully it does not disappoint me just as much as this one.
After all, Yes, it was my choice to read through, but I genuinely thought you'd have something useful to say.
All I hear is a bunch of moaning about something that you can fix
if you were not too busy looking for attention.
zee5 free subscription trick commented on 20-Jun-2019 04:27 AM
I must express appreciation to you just for bailing me out of this type of predicament. As a result of surfing through the online world and meeting notions that were not powerful, I figured my life was gone. Being alive without the strategies to the difficulties you have sorted out all through your entire blog post is a crucial case, as well as ones that could have adversely damaged my entire career if I hadn't come across your website. The ability and kindness in dealing with all the details was crucial. I'm not sure what I would've done if I had not discovered such a step like this. I am able to at this point relish my future. Thanks for your time so much for the reliable and results-oriented help. I will not hesitate to suggest the website to any person who would like direction on this subject.
smutstone cheats commented on 20-Jun-2019 04:28 AM
Fantastic goods from you, man. I've understand your stuff prior to and you're just extremely excellent. I really like what you have received here, certainly like what you are saying and the best way during which you assert it. You are making it entertaining and you continue to take care of to stay it sensible. I can't wait to read far more from you. This is actually a wonderful web site.
black squad hack commented on 20-Jun-2019 04:29 AM
I loved as much as you will receive carried out right here. The sketch is attractive, your authored subject matter stylish. nonetheless, you command get got an shakiness over that you wish be delivering the following. unwell unquestionably come more formerly again since exactly the same nearly very often inside case you shield this increase.
vionna01.amoblog.Com commented on 20-Jun-2019 04:54 AM
If you are going for most excellent contents like
I do, simply pay a quick visit this site every day because it offers feature contents,
thanks
Automotive Electronics Repair commented on 20-Jun-2019 04:57 AM
We're a group of volunteers and opening a new scheme in our community.
Your site offered us with valuable info to work on. You have done a formidable job and
our entire community will be thankful to you.
Johnathan commented on 20-Jun-2019 05:07 AM
Very quickly this site will be famous amid all blog people, due to it's good posts

Also visit my web site;현금섯다
Poker Online commented on 20-Jun-2019 05:11 AM
Marvelous, what a website it is! This webpage gives
helpful information to us, keep it up.
best male sex toys commented on 20-Jun-2019 05:16 AM
I always spent my half an hour to read this webpage's articles daily along with a
mug of coffee.
Savannah commented on 20-Jun-2019 05:18 AM
For instance, if you required publicizing a website inclined toward World Wide Web marketing strategies, you'll have to incorporate this keyword simply because division of your respective search term.
Building links marketing strategies depend on a voting system, the harder websites connect to you, the more often popular you seem inside eyes of search engines like yahoo, they reward website pages which are judged weight loss beneficial by other sites ( after they place one of the links for any web-site).
In order to get resolved, link building professionals usually prefer opting for the hundreds of forums and blogs available out there.

Feel free to surf to my web page ...Fortnite Cheat
Pauline commented on 20-Jun-2019 05:26 AM
It's a pity you don't have a donate button! I'd without a doubt donate to this outstanding blog!
I suppose for now i'll settle for bookmarking and adding your RSS feed to my Google account. I look forward to new updates and will share this website with my Facebook group. Talk soon!

Here is my homepage ::사이다쿨
วิเคราะห์บาส commented on 20-Jun-2019 05:41 AM
It's remarkable to pay a visit this web page and reading the views of
all friends about this article, while I am also eager of getting familiarity.
плейбой рунетки commented on 20-Jun-2019 06:05 AM
Найти бесплатный видеочат в онлайн.
Hey I know this is off topic but I was wondering if you knew of
any widgets I could add to my blog that automatically tweet my
newest twitter updates. I've been looking for a plug-in like this for quite
some time and was hoping maybe you would have some experience with something like
this. Please let me know if you run into anything. I truly
enjoy reading your blog and I look forward to your new updates.
Not working? commented on 20-Jun-2019 06:33 AM
I'm not sure where you're getting your information, however great topic.
I needs to spend some time finding out more or understanding
more. Thanks for fantastic information I was on the lookout for this info for my mission.
buy cialis online commented on 20-Jun-2019 06:54 AM
long term effects of tadalafil http://cialisle.com/ buy cialis.
benefits of tadalafil.

Post a Comment




Captcha Image

Trackback Link
http://www.datascientists.com/BlogRetrieve.aspx?BlogID=10882&PostID=712403&A=Trackback
Trackbacks
Post has no trackbacks.