Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette....
Transcript of Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette....
![Page 1: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/1.jpg)
Modeling Freshmen Outcomesusing
SAS Enterprise Miner
Nora Galambos, PhDOffice of Institutional Research, Planning & Effectiveness
NEAIR Annual ConferenceNewport, RI 2013
![Page 2: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/2.jpg)
Data Mining
• Knowledge discovery by extracting information from large amounts of data
• Uses analytic tools for data-driven decision making
• Uses modeling techniques to apply results to future data
• Incorporates statistics, pattern recognition, and mathematics
![Page 3: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/3.jpg)
Enterprise Miner Interface
Project Panel
Properties Panel
Diagram Workspace
SEMMA Tools Palette
SampleExploreModifyModelAssess
![Page 4: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/4.jpg)
Project Flow Workspace
Data Nodes
Merge Node SAS Code Node
![Page 5: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/5.jpg)
Variable Selection View
![Page 6: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/6.jpg)
Merge Node View
Select the merge “by” variables
![Page 7: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/7.jpg)
Merge Variable Specification
Order the “by” variables
![Page 8: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/8.jpg)
SAS Code Node
![Page 9: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/9.jpg)
SAS Code Output
![Page 10: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/10.jpg)
Filter and Data Partition Nodes
![Page 11: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/11.jpg)
Data Node Variable Selection/Configuration
Use dropdowns to configure variables
![Page 12: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/12.jpg)
Filter Node Properties Panel
• Filter rare values• Choose whether to
keep missing values• Create cutoffs
![Page 13: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/13.jpg)
Filter Node Variable Selection
Set to automatically reject variables with too many categories—user specifies the maximum number of categories
![Page 14: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/14.jpg)
Interactive Categorical Filter
![Page 15: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/15.jpg)
Filtering Class Categories
![Page 16: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/16.jpg)
Interactive Interval Filter
![Page 17: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/17.jpg)
Training, Validation, and Test Partitions Find the correct level of modelcomplexity. A model that is notcomplex enough may lack theflexibility to represent the data,underfitting. When the model is toocomplex it can be influenced byrandom noise, overfitting.
Partitioning is used to avoid over- orunderfitting. The training partition isused to build the model. Thevalidation partition is set aside andis used to test the accuracy and finetune the model. The test partition isused for evaluating how the modelwill work on new data.
![Page 18: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/18.jpg)
Cluster Analysis and Segment Profile Nodes
Similarities in the input variables in the training data are used to group the data into a few clusters.
![Page 19: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/19.jpg)
Cluster Analysis Results
![Page 20: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/20.jpg)
Segment Profile
![Page 21: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/21.jpg)
Segment Profile Detail
![Page 22: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/22.jpg)
Segment Profile Graphic Comparisons
![Page 23: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/23.jpg)
Full Enterprise Miner Model
![Page 24: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/24.jpg)
Decision Tree Configuration
![Page 25: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/25.jpg)
Interactive Decision Tree Building:Categorical Outcome
First Semester Freshmen GPA above/below 2.00
![Page 26: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/26.jpg)
Adding Tree Branches and Leaves
![Page 27: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/27.jpg)
Evaluating a Decision Treewith a Categorical Outcome
![Page 28: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/28.jpg)
Receiver Operator Curvesand Cumulative Lift
![Page 29: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/29.jpg)
Decision Tree with Interval Outcome
![Page 30: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/30.jpg)
Using Decision Tree to PredictFirst Semester Freshmen GPA
![Page 31: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/31.jpg)
Decision Tree View
![Page 32: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/32.jpg)
Linear Regression Model
![Page 33: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/33.jpg)
Dmine Regression Model
Dmine regression groups levels of categorical inputs and bins interval inputs. The associations between the binned interval inputs and the target can be non-linear.
![Page 34: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/34.jpg)
Neural Network Model
![Page 35: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/35.jpg)
Dmneural Model
![Page 36: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/36.jpg)
Partial Least Squares Regression Model
![Page 37: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/37.jpg)
Ensemble Node Model
![Page 38: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/38.jpg)
Model Comparison
![Page 39: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/39.jpg)
Model Comparison Graphs 1
![Page 40: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/40.jpg)
Model Comparison Graphs 2
![Page 41: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/41.jpg)
Model Comparison Graphs 3
![Page 42: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/42.jpg)
Score Node Output for Partial Least Squares Model
![Page 43: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/43.jpg)
SAS Codeto Run Partial Least Squares Model on New Data
![Page 44: Modeling Freshmen Outcomes using SAS Enterprise Miner · Diagram Workspace. SEMMA Tools Palette. Sample. Explore. Modify. Model. Assess. Project Flow Workspace Data Nodes ... Cluster](https://reader030.fdocuments.us/reader030/viewer/2022040610/5ed1b0538885c9544e6bc9d0/html5/thumbnails/44.jpg)
Model Package