1 the big picture
Transcript of 1 the big picture
![Page 1: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/1.jpg)
BEXIS Tech Talk Series
#1: The Big Picture
Javad ChamanaraDecember 2015
![Page 2: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/2.jpg)
BEXIS Tech Talk #1: The Big Picture 2
BExIS++ Project
BEXIS 2 SOFTWARE DEVELOPMENT
SUSTAINABILITYOUTREACH
SUPPORT
TRAINING
![Page 3: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/3.jpg)
BEXIS Tech Talk #1: The Big Picture 4
Software Development
Data Management Platform• (large) research projects • tabular data, but not limited to• data integration and re-use
![Page 4: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/4.jpg)
BEXIS Tech Talk #1: The Big Picture 5
Community
GRK 1666
GRK 1086
BEXIS 2
BExIS 1
BExIS 2Biodiversity
Exploratories
JenaExperiment
MPI-BGCResearchDatabase
Kilimanjaro
EFForTS
GFBio
AquaDiva
BEFmate
iDiv
UFZ Halle
TerraSensE
![Page 5: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/5.jpg)
BEXIS Tech Talk #1: The Big Picture 6
Project Partners
![Page 6: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/6.jpg)
BEXIS Tech Talk #1: The Big Picture 7
Tech Talk Series
• A Series of talks on– Various parts of the software– Software development
• In order to:– Promote knowledge sharing– Encourage external contribution
This is the first one!
![Page 7: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/7.jpg)
BEXIS Tech Talk #1: The Big Picture 8
Requirements
• Data Lifecycle Management• Generic• Extensible• Portable• Scalable
![Page 8: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/8.jpg)
BEXIS Tech Talk #1: The Big Picture 9
Requirements -> DLM
• Flexible Data Structures• Data Submission• Validation• Preserving• Metadata Management• Versioning
![Page 9: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/9.jpg)
BEXIS Tech Talk #1: The Big Picture 10
Requirements -> Generic
• Modular• Workflow based
![Page 10: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/10.jpg)
BEXIS Tech Talk #1: The Big Picture 11
Requirements -> Extensible
• Built-in Modules– DLM related modules
• Third Party Modules– BExIS 1 modules– AquaDiva modules– iDiv modules– Open modules
• Interaction with external systems– Geographic Information Systems– Persistent Identifier Providers– Authentication Providers– Annotation Providers
![Page 11: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/11.jpg)
BEXIS Tech Talk #1: The Big Picture 12
Requirements -> Portable
• Multi DBMS support– IBM DB2– PostgreSQL– MS SQL Server
• Various Installation Scenarios– Dedicated hosting– Shared hosting– Portable hosting– Multi-tier Deployment– Secure Access
![Page 12: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/12.jpg)
BEXIS Tech Talk #1: The Big Picture 13
Requirements -> Scalable
• To be used in large projects with– Multitude of Users– Big Datasets– Frequent Access
![Page 13: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/13.jpg)
BEXIS Tech Talk #1: The Big Picture 14
Out of Scope
• Sophisticated Data Analysis Tool• Long Term Public Repository
![Page 14: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/14.jpg)
BEXIS Tech Talk #1: The Big Picture 15
Questions?
• Short break• Feedback…
![Page 15: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/15.jpg)
BEXIS Tech Talk #1: The Big Picture 16
Conceptual Overview
DataMetadata
Data StructureMetadata Structure Semantics Geo
Administration Security
«use»
«use»
«use» «use»
«use»
![Page 16: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/16.jpg)
BEXIS Tech Talk #1: The Big Picture 17
Conceptual->Data
• Dataset– Tabular– Matrix
• Dataset Version• Data Tuple• Customization
![Page 17: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/17.jpg)
BEXIS Tech Talk #1: The Big Picture 18
Conceptual->Data Structure
• Data Structure• Data Attribute
– Unit of measurement– Constraints– Value Validation
• Reuse promotion
![Page 18: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/18.jpg)
BEXIS Tech Talk #1: The Big Picture 19
Conceptual->Metadata
• Metadata• Various metadata standards• Metadata mapping
![Page 19: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/19.jpg)
BEXIS Tech Talk #1: The Big Picture 20
Conceptual->Metadata Structure
• Metadata Structure• Metadata Attribute
– Simple Types: Name, email– Compound types: Geographical extent, Author
• Reuse promotion– Schema matching– Semantic comparison
![Page 20: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/20.jpg)
BEXIS Tech Talk #1: The Big Picture 21
Conceptual->Administration
• Project• Organization• People• Location• Relationship among them
![Page 21: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/21.jpg)
BEXIS Tech Talk #1: The Big Picture 22
Design Overview
• Data• Functionality• Architecture
![Page 22: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/22.jpg)
BEXIS Tech Talk #1: The Big Picture 23
Design Overview -> Data
• Relational• XML• Files
– CSV, Excel, Images, etc.• Configuration• Seed• Geographical
![Page 23: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/23.jpg)
BEXIS Tech Talk #1: The Big Picture 24
Design Overview -> Functionality
• Core Functionality– Data Lifecycle Management
• Dataset/ Data Structure• Metadata/ Structure• Versioning
– AAA• Authentication• Authorization• Auditing
![Page 24: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/24.jpg)
BEXIS Tech Talk #1: The Big Picture 25
Design Overview -> Architecture
Components• DLM• AAA• Transformation
– XML <-> XML– CSV <-> Excel– …
![Page 25: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/25.jpg)
BEXIS Tech Talk #1: The Big Picture 26
Design Overview -> Architecture
Modules• A set of user oriented/facing functions• Crossing multiple layers, including the UI• Examples:
– DCM: Data Collection Module– DDM: Data Discovery Module– DIM: Data Integration Module
![Page 26: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/26.jpg)
BEXIS Tech Talk #1: The Big Picture 27
Design Overview -> Architecture
External Dependencies• Geo Server• Services
– Terminology– PID– Authentication
![Page 27: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/27.jpg)
BEXIS Tech Talk #1: The Big Picture 28
Design Overview -> Architecture
Public Services (APIs)• Public REST Services
– Download a dataset– Metadata Harvesting
• R Interface
![Page 28: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/28.jpg)
BEXIS Tech Talk #1: The Big Picture 29
Questions?
• Short break…
![Page 29: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/29.jpg)
BEXIS Tech Talk #1: The Big Picture 30
Development Environment
Tools• Visual Studio• Team Foundation Server (task & source
management)• Github (Public Releases)
![Page 30: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/30.jpg)
BEXIS Tech Talk #1: The Big Picture 31
Development Environment
Basics– .NET ecosystem– C#– MVC– ORM– jQuery
![Page 31: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/31.jpg)
BEXIS Tech Talk #1: The Big Picture 32
Development Environment
DBMS• IBM DB2 version 9.x and upper• PostgreSQL version 8.x and upper• MS SQL Server 2008 and upper
![Page 32: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/32.jpg)
BEXIS Tech Talk #1: The Big Picture 33
Deployment
• MS IIS• Dedicated Hosting• Virtual Machine Hosting• Portable Hosting• Multi-tier Deployment
![Page 33: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/33.jpg)
BEXIS Tech Talk #1: The Big Picture 34
Outlook
Whats next in the talk series?
• The Conceptual Model in more detail• The database design
![Page 34: 1 the big picture](https://reader035.fdocuments.us/reader035/viewer/2022070523/58ed1d521a28ab226b8b4691/html5/thumbnails/34.jpg)
BEXIS Tech Talk #1: The Big Picture 3535
Thanks!Questions?
Contact:[email protected]://fusion.cs.uni-jena.de/bexis
Acknowledgment