The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.
-
Upload
domenic-doyle -
Category
Documents
-
view
214 -
download
1
Transcript of The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.
![Page 1: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/1.jpg)
The Random Sampling/Tracking Tool: A Response to Over-
Surveying
Steve GravesIntel Corporation
![Page 2: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/2.jpg)
Overview Problem Statement Recommended Solution Features User Interface Demo Benefits Concerns Next Steps Possible tool enhancements Beyond Intel Summary
![Page 3: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/3.jpg)
Problem Statement
Perception that too many surveys are deployed to end users from IT – Source: Annual Partnership Excellence Survey with top Intel Execs
Likely causes identified (based on experience as a survey consultant)– Groups tended to survey entire population of interest
instead of a sample (e. g. survey of habits of frequent travelers -- 26,000 people)
– When criteria for a population is only partially available a screening survey is necessary – results in more people surveyed
– Simple random sampling will tend to hit a small percentage of people multiple times
![Page 4: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/4.jpg)
Same Participant
General Population
Study A
Study B
![Page 5: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/5.jpg)
Problem Statement
Effective and efficient process to stop over-surveying does not exist– Previous process relied on incomplete information and
“Guardians” – go between groups– No mechanism to track who has received surveys
– Guardians may be overly cautious
– Meetings used to determine what to do – time consuming and inefficient
– Process is not followed universally
![Page 6: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/6.jpg)
Recommended Solution
Sampling tool containing a repository of Intel employee data– Utilizes data from employee database (non-
confidential)
– Generates random samples of target audience
– Tracks who has been sampled over a given time period – currently 5 months
– Sampled individuals will not be selected again for during this period
![Page 7: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/7.jpg)
Recommended SolutionDatabase perspective
Employee Database Retrieval Database Sampling Database
Sampling DatabaseStorage Database
Tracking Table
Randomly Selected Employees
![Page 8: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/8.jpg)
Recommended SolutionDatabase perspective – previously sampled individuals
removed before Sample is generated
Tracking Table
Generated table based on CriteriaTable that meets criteria and contains no excluded individuals
![Page 9: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/9.jpg)
Recommended Solution
Incorporate into an overall process where researchers are required to utilize the tool and consult with sampling advisors– Advisors can advise researchers on appropriate sampling
techniques – so researchers to survey an entire population (e.g. 3,000 instead of 26,000)
Currently implemented using RAD database programming language
– Tool has been in use for almost 2 years
– Tool is performing reliably and customers are satisfied
– Usage is only through word of mouth
– Approximately 60 samples generated last year
![Page 10: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/10.jpg)
Sampling Tool Features
Current features– Tracking and recording mechanism
– Recording of samples generated by others
– Random Sampling of entire Intel population
– Random sample from group that uses criteria not part of employee database (for example: Employees who use PDAs)
– Random sampling of Sub-Groups (For example: Employees in Folsom California)
– Stratified sampling
![Page 11: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/11.jpg)
User Interface
![Page 12: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/12.jpg)
Demo (Double Click to Start)
![Page 13: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/13.jpg)
Benefits Saves researchers time
–Reduces the need for screening surveys
–No need to re-invent the wheel
–Saves time compared to previous process
![Page 14: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/14.jpg)
Benefits Improvement in sampling process
–Reduce or eliminate “over-sampling”– Delay surveys when target population is not
available– Researchers receive consultation on using
appropriate sample sizes–Distribute sampling more evenly across groups
![Page 15: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/15.jpg)
Concerns May cause sampling bias in some situations
![Page 16: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/16.jpg)
Next Steps Need to develop more sophisticated business rules
around sampling process Currently working to make this an IT wide process
– Early results are promising
Looking at making it an Intel wide process Port to SQL server and have a web based solution
– Current access is through Remote Desktop Connection
Develop strategies to mitigate sampling bias
![Page 17: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/17.jpg)
Possible Future Tool Enhancements
Complex samples through UI – currently requires custom query
Linking to Other database that contains product usage information
![Page 18: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/18.jpg)
Beyond Intel Similar tools could be used in similar situations in other companies or institutions
![Page 19: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/19.jpg)
Summary Problem: Over-surveying by our IT organization
Response: Random Sampling/Tracking Tool in conjunction with business rules to manage survey sampling process
Benefits: Saves researchers time, reduces over-surveying, improves sampling process
Working to make this an IT wide official process and eventually Intel wide
![Page 20: The Random Sampling/Tracking Tool: A Response to Over- Surveying Steve Graves Intel Corporation.](https://reader036.fdocuments.us/reader036/viewer/2022062720/56649f015503460f94c16e63/html5/thumbnails/20.jpg)
Summary Next steps:
–Link to other databases – Improve business rules –More robust software platform–Strategies to mitigate sampling bias
Similar tools/business rules could be used in other institutions