Contents
description
Transcript of Contents
![Page 1: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/1.jpg)
JISCrte Meeting, May 25,2011
Dr. Yu QianSchool of Engineering Information Sciences,
Middlesex [email protected]
Repository @ http://image.mdx.ac.uk/vin/demo.php
![Page 2: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/2.jpg)
Contents• System demonstration http://image.mdx.ac.uk/vin/demo.php
• Introduction of MIRAGE project– MIRAGE Phase 1 (2009-2010)– MIRAGE 2011, Phase 2 (2011)
• Project communication• Dissemination • Obstacles and issues• Lessons learned so far• Summary
![Page 3: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/3.jpg)
MIRAGE(Middlesex medical Image Repository with a CBIR ArchivinG Environment)
Phase 1: MIRAGE- from Creation to Archiving • Strand : Start-up Repository funded by JISC• Between Apr. 2009- Sep. 2010.• Aim: To develop a repository of medical images benefiting MSc and research students in
the immediate term and serve a wider community in the long term in providing a rich supply of medical images for data mining, to complement MU current online e-learning system OASIS+.
Phase 2: MIRAGE 2011 – from Archiving to Creation• Strand : Take-up and Embedding funded by JISC• Between Feb. 2011- Oct. 2011.• Aim: To enrich the current repository MIRAGE with two necessities of ‘3D Viewer’ and
‘Uploading’ to meet users’ needs, leading to a sustainable, usable and flexible model of data management.
![Page 4: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/4.jpg)
Framework for MRIAGE
![Page 5: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/5.jpg)
Phase 1: MIRAGE --from Creation to Archiving
![Page 6: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/6.jpg)
Phase 1: MIRAGE -- GIFT(GNU Image Finding Tool)
GIFT is open framework for content-based image retrieval and is developed by University of Geneva.
Query by example and multiple query Relevance Feedback Distributed architecture (Client - Server) MRML---C-S communication protocol
![Page 7: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/7.jpg)
Phase 1: MIRAGE – Online system(1)
• Server side: Image collection: Accommodating 100,000 2D images and 100 3D
images Visual feature extraction: Pre-processing off-line using C++ and Perl. Indexing file creation
• Client side: Interface based on PHP generate dynamic web pages.
• Client – Server communication protocol: MRML: a XML based protocol
![Page 8: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/8.jpg)
Phase 1: MIRAGE – Online system(2)Repository connection
![Page 9: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/9.jpg)
Phase 1: MIRAGE – Online system(3)Interface
![Page 10: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/10.jpg)
Phase 1: MIRAGE – Online system(4)Query and retrieval results
![Page 11: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/11.jpg)
Phase 1: MIRAGE – Online system(5)Link to OASIS+
![Page 12: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/12.jpg)
Phase 1: MIRAGE – Online system(6)On-line survey
Survey report show all respondents 'agreed' or 'strongly agreed‘The retrieved results meets users’ expectationsFast and easy to useUseful for teaching and learning
![Page 13: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/13.jpg)
Phase 1: MIRAGE –Limitations (1)1. At Repository interface
Montage
![Page 15: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/15.jpg)
Phase 2: MIRAGE2011---- From Archiving to Creation
Aim:
• To enrich the current repository MIRAGE with two necessities to meet users’ needs, leading to a sustainable, usable and flexible model of data management.
![Page 16: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/16.jpg)
Phase 2: MIRAGE2011---3D CBIR Proposed Framework for 3D Image Retrieval
![Page 17: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/17.jpg)
Phase 2: MIRAGE2011---3D CBIR 3D texture feature extraction
1) 3D Grey Level Co-occurrence Matrices (3D GLCM)2) 3D Wavelet Transform (3D WT)3) 3D Gabor Transform (3D GT)4) 3D Local Binary Pattern (3D LBP)
Publications:
1) Qian Y., Gao X. etc, Content-based Retrieval of 3D Medical Images, eTELEMED 2011, February, 2011. (Best paper award )
2) Gao X., Qian Y. etc, Texture-based 3D image retrieval for medical applications, IADIS e-Health2010,, July 2010.
![Page 18: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/18.jpg)
Phase 2: MIRAGE2011---3D CBIR
3D Brain Visualization(1)
![Page 19: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/19.jpg)
Phase 2: MIRAGE2011---3D CBIR 3D Brain Visualization(2)
![Page 20: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/20.jpg)
Phase 2: MIRAGE2011---3D CBIR On-line system(1):
• Server side: 100 3D brain images(DICOM format to JPG format) 3D visual feature extraction(4 methods): Off-line pre-
processing using Matlab. 3D visualization: using Matlab
• Client side: Interface based on PHP generate dynamic web pages.
![Page 21: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/21.jpg)
Phase 2: MIRAGE2011---3D CBIR Online system(2): Embedding to MIRAGE
![Page 22: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/22.jpg)
Phase 2: MIRAGE2011---3D CBIR Online system(3):
Interface for 3D images retrieval and visualization
![Page 23: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/23.jpg)
Phase 2: MIRAGE2011---Uploading
Development of a plug-in for uploading queries
• Will integrate various types of textual metadata and ontology in addition to image data.
![Page 24: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/24.jpg)
Phase 2: MIRAGE2011---UploadingImage Annotation(1)
![Page 25: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/25.jpg)
Phase 2: MIRAGE2011---UploadingImage annotation(2)
•Framework for image annotation
![Page 26: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/26.jpg)
Phase 2: MIRAGE2011---UploadingImage annotation(3)
Classified Dataset
![Page 27: Contents](https://reader036.fdocuments.us/reader036/viewer/2022081515/568149db550346895db70107/html5/thumbnails/27.jpg)
Phase 2: MIRAGE2011---Uploading Image(Future work)
Two problems need to be solved:
SecurityOnline query time