Gaining Consumer Insights - DefinedCrowd®...realm as a strategic goldmine, opening the door to...
1
accuracy 95-98% faster than competition 5-10x languages and dialects 70+ Quality Superior Speed Unmatched Scale Global Smart companies see the pile of unstructured text floating through the digital realm as a strategic goldmine, opening the door to sophisticated consumer insights in real time. However, quantifying something as subjective as sentiment is no easy task. One person’s “positive” doesn’t always match their neighbor’s, and even short phrases sometimes require interpretation (“I love this stupid little office,” for example). That’s why when a Fortune 500 tech company came to DefinedCrowd seeking sentiment annotation data in Korean, they needed a data partner capable of both collecting and annotating 10,000 input phrases and accounting for the subjectivity inherent to sentiment judgments. The Challenge Our workflows, global Neevo community, and automated systems have been expressly designed to handle text sentiment annotation quickly and objectively. First, we collected more than 10,000 domain-specific text selections. The Solution Next, we passed them all on to our Korean-language contributors and had each phrase annotated by three separate crowd members, making for a total of 30,000 annotations in all. Step 1 Text Collection Step 2 Sentiment Annotation Step 3 Repeat w/ more data domain-specific text collected 10,000 phrases collected & annotated 3,000 Sentiment analysis truly is a marketer’s goldmine. Models can produce both macro-level analysis (sifting through social media postings and online reviews) and micro-level insights (keeping tabs on individual customer interactions) that companies can leverage to inform PR and Marketing campaign strategies, and use to disseminate those campaigns to specific geographical locales and individual customers. However, the smartest companies understand that if their sentiment analysis models are built on anything but the highest quality training data— in every language they’re used for— they’ll deliver nothing more than fool’s gold. By partnering with DefinedCrowd, our client received training data with: The Results High-quality data today means high-performing models tomorrow. Looking for more on how DefinedCrowd fuels AI initiatives to sustained success? SEATTLE LISBON PORTO TOKYO [email protected] Follow us www.definedcrowd.ai Contact us Visit us We delivered the entire set, plus inter-annotator agreement calculations to the client. They found tremendous value therein and requested a second round of collection and annotation. We ran 3,000 phrases through the exact same process and delivered the results just a few weeks later. sentiment anotations collected 30,000 Gaining Consumer Insights How mining unstructured text gets this Fortune 500 closer to its customers
Transcript of Gaining Consumer Insights - DefinedCrowd®...realm as a strategic goldmine, opening the door to...
accuracy95-98%
faster than competition5-10x
languages and dialects70+
QualitySuperior
SpeedUnmatched
ScaleGlobal
Smart companies see the pile of unstructured text floating through the digital realm as a strategic goldmine, opening the door to sophisticated consumer insights in real time. However, quantifying something as subjective as sentiment is no easy task. One person’s “positive” doesn’t always match their neighbor’s, and even short phrases sometimes require interpretation (“I love this stupid little office,” for example).
That’s why when a Fortune 500 tech company came to DefinedCrowd seeking sentiment annotation data in Korean, they needed a data partner capable of both collecting and annotating 10,000 input phrases and accounting for the subjectivity inherent to sentiment judgments.
The Challenge
Our workflows, global Neevo community, and automated systems have been expressly designed to handle text sentiment annotation quickly and objectively. First, we collected more than 10,000 domain-specific text selections.
The Solution
Next, we passed them all on to our Korean-language contributors and had each phrase annotated by three separate crowd members, making for a total of 30,000 annotations in all.
Step 1Text Collection
Step 2Sentiment Annotation
Step 3Repeat w/ more data
domain-specific textcollected
10,000phrases
collected & annotated
3,000
Sentiment analysis truly is a marketer’s goldmine. Models can produceboth macro-level analysis (sifting through social media postings and onlinereviews) and micro-level insights (keeping tabs on individual customerinteractions) that companies can leverage to inform PR and Marketingcampaign strategies, and use to disseminate those campaigns to specificgeographical locales and individual customers. However, the smartestcompanies understand that if their sentiment analysis models are builton anything but the highest quality training data— in every language they’reused for— they’ll deliver nothing more than fool’s gold. By partnering withDefinedCrowd, our client received training data with:
The Results
High-quality data today means high-performing models tomorrow.
Looking for more on how DefinedCrowd fuels AI initiatives to sustained success?
S E A T T L E L I S B O N P O R T O T O K Y O
Follow us
www.definedcrowd.ai
Contact us Visit us
We delivered the entire set, plus inter-annotator agreement calculations to the client. They found tremendous value therein and requested a second round of collection and annotation. We ran 3,000 phrases through the exact same process and delivered the results just a few weeks later.
sentiment anotationscollected
30,000
Gaining ConsumerInsights How mining unstructured text gets thisFortune 500 closer to its customers
