Introduction to Information Systems SSC, Semester 6
-
Upload
alden-pearson -
Category
Documents
-
view
24 -
download
6
description
Transcript of Introduction to Information Systems SSC, Semester 6
![Page 1: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/1.jpg)
1
Introduction to Information Systems
SSC, Semester 6
Lecture 01
![Page 2: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/2.jpg)
2
Staff• Instructor: Karl Aberer
– PSE, Room 1.31, [email protected]– Office hours: by appointment
• TAs:– Magdalena Punceva– Anwitaman Datta– Gleb Sklobetskyn– Roman Schmidt
![Page 3: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/3.jpg)
3
Communications• Web page: lsirww.epfl.ch
– Lectures will be available here– Homeworks and solutions will be posted here– The project description and resources will be here
• Mailing list:
– please subscribe (see instructions on the Web page)
![Page 4: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/4.jpg)
4
Textbook
Main textbook:
• Databases and Transaction Processing, An application-oriented approachPhilip M. Lewis, Arthur Bernstein, Michael Kifer, Addison-Wesley 2002.
![Page 5: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/5.jpg)
5
Other Texts
Many classic textbooks (each of them will do it)• Database Systems: The Complete Book, Hector Garcia-Molina,
Jeffrey Ullman, Jennifer Widom• Database Management Systems, Ramakrishnan• Fundamentals of Database Systems, Elmasri, Navathe• Database Systems, Date (7. edition)• Modern Database Management, Hoffer, (4. edition)• Database Systems Concepts, Silverschatz, (4. edition)
![Page 6: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/6.jpg)
6
Material on the Web
SQL Intro
• SQL for Web Nerds, by Philip Greenspun, http://philip.greenspun.com/sql/
Java Technology
• java.sun.com
WWW Technology
• www.w3c.org
![Page 7: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/7.jpg)
7
Outline for Today’s Lecture
• Overview of database systems
• Course Outline
• First Steps in SQL
![Page 8: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/8.jpg)
8
What is behind this Web Site?
• http://immo.search.ch/
• Search on a large database
• Specify search conditions
• Many users
• Updates
• Access through a web interface
![Page 9: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/9.jpg)
9
Database Management Systems
Database Management System = DBMS
• A collection of files that store the data
• A big C program written by someone else that accesses and updates those files for you
Relational DBMS = RDBMS
• Data files are structured as relations (tables)
![Page 10: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/10.jpg)
10
Where are RDBMS used ?
• Backend for traditional “database” applications– EFPL administration
• Backend for large Websites– Immosearch
• Backend for Web services– Amazon
![Page 11: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/11.jpg)
11
Example of a Traditional Database Application
Suppose we are building a system
to store the information about:
• students
• courses
• professors
• who takes what, who teaches what
![Page 12: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/12.jpg)
12
Can we do it without a DBMS ?
Sure we can! Start by storing the data in files:
students.txt courses.txt professors.txt
Now write C or Java programs to implement specific tasks
![Page 13: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/13.jpg)
13
Doing it without a DBMS...
• Enroll “Mary Johnson” in “CSE444”:
Read ‘students.txt’Read ‘courses.txt’Find&update the record “Mary Johnson”Find&update the record “CSE444”Write “students.txt”Write “courses.txt”
Read ‘students.txt’Read ‘courses.txt’Find&update the record “Mary Johnson”Find&update the record “CSE444”Write “students.txt”Write “courses.txt”
Write a C/Java program to do the following:
![Page 14: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/14.jpg)
14
Problems without an DBMS...
• System crashes:
– What is the problem ?
• Large data sets (say 50GB)– Why is this a problem ?
• Simultaneous access by many users– Lock students.txt – what is the problem ?
Read ‘students.txt’Read ‘courses.txt’Find&update the record “Mary Johnson”Find&update the record “CSE444”Write “students.txt”Write “courses.txt”
Read ‘students.txt’Read ‘courses.txt’Find&update the record “Mary Johnson”Find&update the record “CSE444”Write “students.txt”Write “courses.txt”
CRASH !
![Page 15: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/15.jpg)
15
Enters a DMBS
Data files
Database server(someone else’s
C program) Applications
connection
(ODBC, JDBC)
“Two tier system” or “client-server”
![Page 16: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/16.jpg)
16
Functionality of a DBMS
The programmer sees SQL, which has two components:• Data Definition Language - DDL• Data Manipulation Language - DML
– query language
Behind the scenes the DBMS has:• Query engine• Query optimizer• Storage management• Transaction Management (concurrency, recovery)
![Page 17: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/17.jpg)
17
How the Programmer Sees the DBMS
• Start with DDL to create tables:
• Continue with DML to populate tables:
CREATE TABLE Students (Name CHAR(30)SSN CHAR(9) PRIMARY KEY NOT NULL,Category CHAR(20)
) . . .
CREATE TABLE Students (Name CHAR(30)SSN CHAR(9) PRIMARY KEY NOT NULL,Category CHAR(20)
) . . .
INSERT INTO StudentsVALUES(‘Charles’, ‘123456789’, ‘undergraduate’). . . .
INSERT INTO StudentsVALUES(‘Charles’, ‘123456789’, ‘undergraduate’). . . .
![Page 18: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/18.jpg)
18
How the Programmer Sees the DBMS
• Tables:
• Still implemented as files, but behind the scenes can be quite complex
SSN Name Category 123-45-6789 Charles undergrad 234-56-7890 Dan grad … …
SSN CID 123-45-6789 CSE444 123-45-6789 CSE444 234-56-7890 CSE142 …
Students: Takes:
CID Name Quarter CSE444 Databases fall CSE541 Operating systems winter
Courses:
“data independence” = separate logical view from physical implementation
![Page 19: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/19.jpg)
19
Transactions
• Enroll “Mary Johnson” in “CSE444”:BEGIN TRANSACTION;
INSERT INTO Takes SELECT Students.SSN, Courses.CID FROM Students, Courses WHERE Students.name = ‘Mary Johnson’ and Courses.name = ‘CSE444’
-- More updates here....
IF everything-went-OK THEN COMMIT;ELSE ROLLBACK
BEGIN TRANSACTION;
INSERT INTO Takes SELECT Students.SSN, Courses.CID FROM Students, Courses WHERE Students.name = ‘Mary Johnson’ and Courses.name = ‘CSE444’
-- More updates here....
IF everything-went-OK THEN COMMIT;ELSE ROLLBACK
If system crashes, the transaction is still either committed or aborted
![Page 20: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/20.jpg)
20
Transactions
• A transaction = sequence of statements that either all succeed, or all fail
• Transactions have the ACID properties:A = atomicity
C = consistency
I = isolation
D = durability
![Page 21: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/21.jpg)
21
Queries
• Find all courses that “Mary” takes
• What happens behind the scene ?– Query processor figures out how to answer the
query efficiently.
SELECT C.nameFROM Students S, Takes T, Courses CWHERE S.name=“Mary” and S.ssn = T.ssn and T.cid = C.cid
SELECT C.nameFROM Students S, Takes T, Courses CWHERE S.name=“Mary” and S.ssn = T.ssn and T.cid = C.cid
![Page 22: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/22.jpg)
22
Queries, behind the scene
Imperative query execution plan:
SELECT C.nameFROM Students S, Takes T, Courses CWHERE S.name=“Mary” and S.ssn = T.ssn and T.cid = C.cid
SELECT C.nameFROM Students S, Takes T, Courses CWHERE S.name=“Mary” and S.ssn = T.ssn and T.cid = C.cid
Declarative SQL query
Students Takes
sid=sid
sname
name=“Mary”
cid=cid
Courses
The optimizer chooses the best execution plan for a query
![Page 23: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/23.jpg)
23
Database Systems
• The big commercial database vendors:– Oracle– IBM (with DB2)– Microsoft (SQL Server)– Sybase
• Some free database systems (Unix) :– Postgres– MySQL– Predator
• In CSE444 we use SQL Server. You can also choose MySQL, but less support
![Page 24: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/24.jpg)
24
Databases and the Web
• Accessing databases through web interfaces– Java programming interface (JDBC)– Embedding into HTML pages (JSP)– Access through http protocol (Web Services)
• Using Web document formats for data definition and manipulation– XML, Xquery, Xpath– XML databases and messaging systems
![Page 25: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/25.jpg)
25
Database Integration
• Combining data from different databases– collection of data (wrapping)– combination of data and generation of new
views on the data (mediation)
• Problem: heterogeneity– access, representation, content
• Example revisited (Demo)– http://immo.search.ch/
![Page 26: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/26.jpg)
26
Other Trends in Databases
• Industrial– Object-relational databases– Main memory database systems– Data warehousing and mining
• Research– Peer-to-peer data management– Stream data management– Mobile data management
![Page 27: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/27.jpg)
27
The Course
• Goal: Teaching RDBMS (standard) with a strong emphasis on the Web
• Fortunately others already did it– Alon Halevy, Dan Suciu, Univ. of Washington– http://www.cs.washington.edu/education/
courses/cse444/ – http://www.acm.org/sigmod/record/issues/
0309/4.AlonLevy.pdf
![Page 28: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/28.jpg)
28
Acknowledgement
• Build on UoW course– many slides– many exercise– ideas for the project
• Main difference– less theory– will use real Web data in the project
![Page 29: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/29.jpg)
29
Course Outline (Details on the Web)
Part I• SQL (Chapter 6)• The relational data model (Chapter 3)• Database design (Chapters 2, 3, 7)• XML, XPath, XQueryPart II• Indexes (Chapter 13)• Transactions and Recovery (Chapter 17 - 18)Exam
![Page 30: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/30.jpg)
30
Structure
• Prerequisites: – Programming courses
– Data structures
• Work & Grading:– Homeworks (4): 0%
– Exam (like homeworks): 50%
– Project: 50% (see next) – each phase graded separately
![Page 31: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/31.jpg)
31
The Project
• Models the real data management needs of a Web company– Phase 1: Modelling and Data Acquisition– Phase 2: Data integration and Applications– Phase 3: Services
• "One can only start to appreciate database systems by actually trying to use one" (Halevy)
• Any SW/IT company will love you for these skills
![Page 32: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/32.jpg)
32
The Project – Side Effects
• Trains your soft skills– team work– deal with bugs, poor documentation, …– produce with limited time resources– project management and reporting
• Results useful for you personally– Demo:
• Project should be fun
![Page 33: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/33.jpg)
33
Practical Concerns
• New course, expect some hickups
• Important to keep time schedule
• Communication through Web
• News Group
• Student committee for regular feedback (2 volunteers)
![Page 34: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/34.jpg)
34
Week Date Lecture Exercise Project Start Return
1 12.03.2004 Introduction, Basic SQL Ex. 1: SQL
2 19.03.2004 Advanced SQL
3 26.03.2004 Conceputal Modelling Ex. 1 due 1.1: Database Schema
4 02.04.2004 Database Programming 1.2: Database Population 1.1
09.04.2004 Easter
16.04.2004 Easter
5 23.04.2004 Functional Dependencies Ex. 2: FD and RA 2.1: Database Integration 1.2
6 30.04.2004 Relational Algebra
7 07.05.2004 Introduction to XML Ex. 2 due / Ex. 3: XML 2.2: Web Database Access 2.1
8 14.05.2004 XML Query
9 21.05.2004 Web Services Ex. 3 due 3.1: Web Service Interface 2.2
10 28.05.2004 Concurrency Ex. 4: Transactions
11 04.06.2004 Recovery 3.2: Web Service Usage 3.1
12 11.06.2004 Database Heterogeneity Ex. 4 due
13 18.06.2004 Indexing 3.2
![Page 35: Introduction to Information Systems SSC, Semester 6](https://reader030.fdocuments.us/reader030/viewer/2022020200/56813039550346895d95cf8d/html5/thumbnails/35.jpg)
35
So what is this course about, really ?
A bit of everything !• Languages: SQL, XPath, XQuery• Data modeling• Theory ! (Functional dependencies, normal
forms)• Algorithms and data structures (in the second half)• Lots of implementation and hacking for the
project• Most importantly: how to meet Real World needs