The Relationship between Entrepreneurship and Innovation ...
Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes...
Transcript of Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes...
![Page 1: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/1.jpg)
Autor:
Grupo de Sistemas InteligentesUniversidad Politécnica de Madrid
Idea Relationship Analysis in Open Innovation CrowdSourcing
systems
Adam Westerski, Carlos A. Iglesias and Javier EspinosaGrupo de Sistemas InteligentesUniversidad Politécnica de Madridhttp://www.gsi.dit.upm.es
![Page 2: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/2.jpg)
Outline
Idea Management Systems The problem
too many similar ideas
Our solution idea relationship hierarchy
Evaluation Ubuntu brainstorm
Conclusions
![Page 3: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/3.jpg)
Idea Management Systems
Evolution of suggestion boxes...
for open innovation purposes Collect ideas, suggestions, from customers,
employees, ...
![Page 4: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/4.jpg)
Innovation through Idea Management Systems
Idea Generation
Idea Improvement
Idea Selection
Idea Implementation
Idea Deployment
![Page 5: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/5.jpg)
![Page 6: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/6.jpg)
![Page 7: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/7.jpg)
![Page 8: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/8.jpg)
Goal: improve how ideas are automatically filtered
![Page 9: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/9.jpg)
Our research so far
Define Gi2MO ontology for formalising and interlinking idea management systems (IMS)
Connect ideas with Enterprise systems following the Linked Data model
Integrating Opinion Mining techniques with IMS
Idea Classification, filtering and analysis of idea similarities independent of idea topic (this talk!)
![Page 10: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/10.jpg)
Our research so far...
Software released as open source, everything available at http://www.gi2mo.org
![Page 11: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/11.jpg)
The problem
Too many ideas to be analysed Many ideas are similar
![Page 12: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/12.jpg)
Is it easy to define what is 'similar'?
Similar ≠ Equal
![Page 13: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/13.jpg)
Some examples...
SIMILAR = DUPLICATE
![Page 14: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/14.jpg)
… examples
Same topic, CD, but different ideas (disjoint)
![Page 15: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/15.jpg)
Proposal: similarity relationships
![Page 16: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/16.jpg)
Proposal Similarity Relationships
![Page 17: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/17.jpg)
Evaluation methodology
Semantic scrapper, available at http://www.gsi.dit.upm.es/index.php/en/software/details/1/2/software-scrappy.html
![Page 18: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/18.jpg)
Manual annotation
![Page 19: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/19.jpg)
Experiment I
Goal: determine if all the relationships are useful, apart from duplicate relationship
We compare our manual annotation with the annotation of duplicate available in Ubuntu Brainstorm
![Page 20: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/20.jpg)
Results Experiment I
76.7% new relationships compared with the original IMS
![Page 21: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/21.jpg)
Experiment II
Goal: new relationships help to identify duplicates and reduce the data set
We compare Detected duplicates in Ubuntu Detected duplicates in our dataset based on
the new relationships 200 ideas with 5 manual annotations suggested
by Lucene Same as before but taking into account the
hierarchy
![Page 22: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/22.jpg)
Results II
Ubuntu: 1.13% of duplicate ideas of entire dataset
Data set with relationships: 0.5% Data set with relationships + hierarchy: 1.95%
→ increase in 95%!
![Page 23: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/23.jpg)
Experiment III
558 out of 1000 ideas are not related each other (so, they are not similar)
Analyse similarity based on other annotations: Trigger type Innovation type Proposal type Object type
![Page 24: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/24.jpg)
Gi2MO Types
![Page 25: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/25.jpg)
Results Experiment III
Calculated similarity S between two related ideas (i
A, i
B) for 50 ideas for Metric M
x
![Page 26: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/26.jpg)
Analysis
Same correlation in similar and disjoint idea subsets with the analysed metrics
![Page 27: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/27.jpg)
Conclusions
Semantic relationship can improve the detection of similar ideas
Relationship hierarchy and transitivity improve similarity detection
Other annotations (Gi2MO types) and associated metrics do not help for detecting similar ideas
![Page 28: Idea Relationship Analysis in Open Innovation ...€¦ · Autor: Grupo de Sistemas Inteligentes Universidad Politécnica de Madrid Idea Relationship Analysis in Open Innovation CrowdSourcing](https://reader036.fdocuments.us/reader036/viewer/2022062605/5fca76816b5c01203912b521/html5/thumbnails/28.jpg)
Questions?