Gaining Consumer Insights - DefinedCrowd®...realm as a strategic goldmine, opening the door to...

1
accuracy 95-98% faster than competition 5-10x languages and dialects 70+ Quality Superior Speed Unmatched Scale Global Smart companies see the pile of unstructured text floating through the digital realm as a strategic goldmine, opening the door to sophisticated consumer insights in real time. However, quantifying something as subjective as sentiment is no easy task. One person’s “positive” doesn’t always match their neighbor’s, and even short phrases sometimes require interpretation (“I love this stupid little office,” for example). That’s why when a Fortune 500 tech company came to DefinedCrowd seeking sentiment annotation data in Korean, they needed a data partner capable of both collecting and annotating 10,000 input phrases and accounting for the subjectivity inherent to sentiment judgments. The Challenge Our workflows, global Neevo community, and automated systems have been expressly designed to handle text sentiment annotation quickly and objectively. First, we collected more than 10,000 domain-specific text selections. The Solution Next, we passed them all on to our Korean-language contributors and had each phrase annotated by three separate crowd members, making for a total of 30,000 annotations in all. Step 1 Text Collection Step 2 Sentiment Annotation Step 3 Repeat w/ more data domain-specific text collected 10,000 phrases collected & annotated 3,000 Sentiment analysis truly is a marketer’s goldmine. Models can produce both macro-level analysis (sifting through social media postings and online reviews) and micro-level insights (keeping tabs on individual customer interactions) that companies can leverage to inform PR and Marketing campaign strategies, and use to disseminate those campaigns to specific geographical locales and individual customers. However, the smartest companies understand that if their sentiment analysis models are built on anything but the highest quality training data— in every language they’re used for— they’ll deliver nothing more than fool’s gold. By partnering with DefinedCrowd, our client received training data with: The Results High-quality data today means high-performing models tomorrow. Looking for more on how DefinedCrowd fuels AI initiatives to sustained success? SEATTLE LISBON PORTO TOKYO [email protected] Follow us www.definedcrowd.ai Contact us Visit us We delivered the entire set, plus inter-annotator agreement calculations to the client. They found tremendous value therein and requested a second round of collection and annotation. We ran 3,000 phrases through the exact same process and delivered the results just a few weeks later. sentiment anotations collected 30,000 Gaining Consumer Insights How mining unstructured text gets this Fortune 500 closer to its customers

Transcript of Gaining Consumer Insights - DefinedCrowd®...realm as a strategic goldmine, opening the door to...

Page 1: Gaining Consumer Insights - DefinedCrowd®...realm as a strategic goldmine, opening the door to sophisticated consumer insights in real time. However, quantifying something as subjective

accuracy95-98%

faster than competition5-10x

languages and dialects70+

QualitySuperior

SpeedUnmatched

ScaleGlobal

Smart companies see the pile of unstructured text floating through the digital realm as a strategic goldmine, opening the door to sophisticated consumer insights in real time. However, quantifying something as subjective as sentiment is no easy task. One person’s “positive” doesn’t always match their neighbor’s, and even short phrases sometimes require interpretation (“I love this stupid little office,” for example).

That’s why when a Fortune 500 tech company came to DefinedCrowd seeking sentiment annotation data in Korean, they needed a data partner capable of both collecting and annotating 10,000 input phrases and accounting for the subjectivity inherent to sentiment judgments.

The Challenge

Our workflows, global Neevo community, and automated systems have been expressly designed to handle text sentiment annotation quickly and objectively. First, we collected more than 10,000 domain-specific text selections.

The Solution

Next, we passed them all on to our Korean-language contributors and had each phrase annotated by three separate crowd members, making for a total of 30,000 annotations in all.

Step 1Text Collection

Step 2Sentiment Annotation

Step 3Repeat w/ more data

domain-specific textcollected

10,000phrases

collected & annotated

3,000

Sentiment analysis truly is a marketer’s goldmine. Models can produceboth macro-level analysis (sifting through social media postings and onlinereviews) and micro-level insights (keeping tabs on individual customerinteractions) that companies can leverage to inform PR and Marketingcampaign strategies, and use to disseminate those campaigns to specificgeographical locales and individual customers. However, the smartestcompanies understand that if their sentiment analysis models are builton anything but the highest quality training data— in every language they’reused for— they’ll deliver nothing more than fool’s gold. By partnering withDefinedCrowd, our client received training data with:

The Results

High-quality data today means high-performing models tomorrow.

Looking for more on how DefinedCrowd fuels AI initiatives to sustained success?

S E A T T L E L I S B O N P O R T O T O K Y O

[email protected]

Follow us

www.definedcrowd.ai

Contact us Visit us

We delivered the entire set, plus inter-annotator agreement calculations to the client. They found tremendous value therein and requested a second round of collection and annotation. We ran 3,000 phrases through the exact same process and delivered the results just a few weeks later.

sentiment anotationscollected

30,000

Gaining ConsumerInsights How mining unstructured text gets thisFortune 500 closer to its customers