Mining Cross-Domain Rating Datasets from Structured Data on Twitter

@sidoomsSimon Dooms

Rating Datasets

What are ratings? Explicit user preference information

Why ratings? Recommender systems

ConclusionCross-DomainResultsSocial SharingIntro

Apr. 08, 2014 Simon Dooms - Ghent University - MSM 2014 2

Rating Datasets

What are ratings? Explicit user preference information

Why ratings? Recommender systems

Apr. 08, 2014 3

Ratings Scarcity in Research

Ratings = private data Public datasets to the rescue?– MovieLens 100K (1998)– MovieLens 1M (2000)– MovieLens 10M (2008)– More on recsyswiki.com

Old, Synthetic Datasets

Social Sharing = Ratings Goldmine

Previous research: MovieTweetings

Social Sharing = Ratings Goldmine

Previous research: MovieTweetings– Movie Rating dataset from IMDb – Twitter– https://github.com/sidooms/MovieTweetings

What about other domains? Websites?

Well, let’s try it out!

Target Websites - GoodreadsConclusionCross-DomainResultsSocial SharingIntro

Twitter user - Rating - Book titleBook author - Goodreads URL - Time

Target Websites - PandoraConclusionCross-DomainResultsSocial SharingIntro

Twitter user - SongPandora URL - Time

Target Websites - YouTubeConclusionCross-DomainResultsSocial SharingIntro

Twitter user - (Video uploader)YouTube URL - Time

Mining Experiment

But words are wind…– 2 Weeks experiment– 4 Online platforms

Python code + Task Scheduler = Dataset fileshttps://github.com/sidooms/Twitter-ratings

The Numbers

One more thing …

Cross-Domain Rating DatasetConclusionCross-DomainResultsSocial SharingIntro

Applications

Collect ratings for recsys research / input Cross-domain recsys research Trend detection, analytics, ... Applicable for all social sharing webs

Conclusions

Ratings scarcity in research Public dataset are old and synthetic Social sharing = ratings goldmine 2 week experiment, 4 major websites Python code & datasets on Github True cross-domain ratings dataset

@sidoomsSimon Dooms

Mining Cross-Domain Rating Datasets from Structured Data on Twitter

Mining Cross-Domain Rating Datasets from Structured Data on Twitter

Science

Transcript of Mining Cross-Domain Rating Datasets from Structured Data on Twitter

Twitter : ketab n...Twitter : ketab_n. Twitter : ketab_n. Twitter : ketab_n

Nigeria’s ‘fake news’ eco-system - CDD | Home€¦ · Our research found many other suspect online newspapers in the Facebook and Twitter datasets including biafrafacts.blogspot.com,

Analysis of Multiview Legislative Networks with Structured ... · Motivation Twitter platform Twitter allows accounts tobroadcast short messages, referred to as \tweets" I A tweet

Session 1: Core Pharmaceutical Datasets Retail and Non … · Session 1: Core Pharmaceutical Datasets ... Learn about core pharmaceutical datasets ‐retail and ... – Restricted

Large-scale Complex Analytics on Semi-structured Datasets ...asterix.ics.uci.edu/pub/AsterixDBandSpark.pdf · Spark applications can be written in any of four programming languages:

Rumor Detection on Twitter with Tree-structured Recursive Neural … · 2018-10-10 · Jing Ma (CUHK) 2018/7/15 1 Rumor Detection on Twitter with Tree-structured Recursive Neural

Lesson 6 - Topics Reading SAS datasets Subsetting SAS datasets Merging SAS datasets.

ALEXANDRIA Temporal Retrieval, Exploration and Analytics ... · Voluminous, (semi-)structured datasets. DBPedia 3.4: 36,5 million triples and 2,1 million entities BTC09: 1,15 billion

STRUCTURED STREAMING AND DATASETS - Home ... Spark Refresher • RDD • DataFrame • Streaming • What’s New in 2.0 • Datasets • Structured Streaming AGENDA @SVDataScience

MFC Datasets: Large-Scale Benchmark Datasets for Media ...

Twitter: @ketab n egtema3.pdf · Twitter: @ketab_n. Twitter: @ketab_n. Twitter: @ketab_n

Modeling Information Cascades with Self-exciting Processes ... · large Twitter diffusion datasets, we show that the HawkesN model with different kernels demonstrates diverse modeling

Sharp power in social media: Patterns from datasets across ...Sharp power and political campaigns in social media Social network platforms, especially Facebook and Twitter have become

7/2/2015EECS 584, Fall 20111 Bigtable: A Distributed Storage System for Structured Data Jing Zhang Reference: Handling Large Datasets at Google: Current.

Annotating Research Datasets

Processing and Securing Healthcare Datasets Through Hadoop ... · processing the large datasets which are usually of petabyte or larger in size. The data can be structured, unstructured

MER Structured Dataset Release Notes for Data Entry Close ... · 8/15/2019 · MER Structured Datasets (MSDs) on PEPFAR Panorama. These datasets will be available with the Panorama

Large-scale Complex Analytics on Semi-structured Datasets ...predictiontechnology.ucla.edu/wp-content/uploads/2016/12/AsterixDBand... · Large-scale Complex Analytics on Semi-structured

Large-scale Complex Analytics on Semi-structured Datasets using ...

Principia Data - STOIC · Principia Data is a unified typology of statistical variables. Its purpose is to facilitate the collection and analysis of structured datasets by typing