DTC Quantitative Research Methods Descriptive Statistics Thursday 16 th October 2014.
Official Statistics New Producers’ Seminar Thursday 24 th February 2011.
-
Upload
kara-borrowman -
Category
Documents
-
view
213 -
download
0
Transcript of Official Statistics New Producers’ Seminar Thursday 24 th February 2011.
SEMINAR AGENDA• Seminar introduction - aims & key roles Julie Wilson, Deputy Chief Statistician • Welcome from the Chief Statistician Rob Wishart, Chief Statistician• The Code of Practice for Official Statistics Janette Purbrick, Office of the Chief Statistician • Pre-release Access to Official Statistics Rob Wishart and Janette Purbrick • Statistical Support for Public Bodies Chris Newson, Office of the Chief Statistician • Introduction to how Official Statistics become National Statistics Janette Purbrick• The Role of the UK Statistics Authority Neil Jackson, head of the Edinburgh branch of the Authority
Seminar introduction - aims & key roles
Julie Wilson Deputy Chief Statistician
Office of the Chief Statistician
Thursday 24th February 2011
Seminar delegates today
• Crown bodies – Official Statistics producers because of the Act
• Non-Crown bodies – Official Statistics producers because of Parliamentary Order
• Scottish Government statistical and policy staff
Today’s Aims
• Background
• Legislation
• Practicalities
• Other services
• Understanding key roles
• Broader Context
Background – key legislation • 2007 - Statistics and Registration Services Act
– Defined ‘Official Statistics’ and stated who produces themThe S&RS Act 2007 defined Official Statistics as those statistics
produced by the Scottish Administration and Crown bodies (primary legislation)…..
….. and other bodies that Scottish Ministers agree to by parliamentary order (secondary legislation)
– Created UK Statistics Authority– Created ‘Code of Practice for Official Statistics’– Assessment and Designation for National Statistics status
• 2008 - Pre-release access to Official Statistics (Scotland) Order• 2008 - Official Statistics (Scotland) Order• 2010 - Official Statistics (Scotland) Amended Order
Key roles
• Lead official within the producer body responsible for the production of statistical outputs
within their organisation ie operational matters, and for compliance with the Code of Practice and pre-release arrangements.
• Sponsoring ASD and SG to provide statistical advice, on code compliance etc.
• Chief Statistician to provide statistical advice on breaches and other
issues (like Chief Statistician’s current role for GROS & ISD)
Communication channel
Producer Body
Ministers Scottish Government - ASD
Scottish Government - Chief Statistician
Welcome from the Chief Welcome from the Chief StatisticianStatistician
Rob Wishart Rob Wishart
Thursday 24Thursday 24thth February 2011 February 2011
Why are statistics differentWhy are statistics different
What’s special about statisticsWhat’s special about statistics inform governmentinform government inform the public about governmentinform the public about government
International standardsInternational standards Issues in BritainIssues in Britain
Developments in UKDevelopments in UK
First Official Statistics CodeFirst Official Statistics Code 1997 elections and development of 1997 elections and development of
“National Statistics”“National Statistics” Run up to Statistics & Registration Service Run up to Statistics & Registration Service
Act 2007Act 2007 Scottish Parliament endorsementScottish Parliament endorsement
Scotland and UK - differencesScotland and UK - differences
Fewer issues of perceived interferenceFewer issues of perceived interference So less emphasis on trust and more on So less emphasis on trust and more on
usefulness/relevance to decision makingusefulness/relevance to decision making Very different approach to pre-release accessVery different approach to pre-release access Reminder that statistics are devolvedReminder that statistics are devolved Not the UK “transparency” agendaNot the UK “transparency” agenda Our own Framework – comments welcome:Our own Framework – comments welcome:http://www.scotland.gov.uk/Topics/Statistics/About/scottishfrhttp://www.scotland.gov.uk/Topics/Statistics/About/scottishframework/frameworkcon#topamework/frameworkcon#top
Differences for new producersDifferences for new producers
Should not diminish the degree of Should not diminish the degree of autonomy from Ministersautonomy from Ministers
Key role of Ministers in setting frameworkKey role of Ministers in setting framework Importance of meeting key standards nowImportance of meeting key standards now Staged approach to other standardsStaged approach to other standards Resource issuesResource issues Role of Responsible personRole of Responsible person
Role of Chief Statistician and Role of Chief Statistician and Heads of Profession Heads of Profession
The “responsible statistician”The “responsible statistician” Susan Burney covers NHS – National Susan Burney covers NHS – National
Services ScotlandServices Scotland Chief Statistician covers everything else Chief Statistician covers everything else
except GROSexcept GROS Roles set out in FrameworkRoles set out in Framework But some differences for new producers – But some differences for new producers –
to be explained laterto be explained later
Role of National StatisticianRole of National Statistician
Indirect role in ScotlandIndirect role in Scotland Use of National Statistician’s guidanceUse of National Statistician’s guidance When should National Statistician be When should National Statistician be
involvedinvolved
ConclusionsConclusions
Crucial role of statistics in informing Crucial role of statistics in informing government and publicgovernment and public
Impact of NPF/SOA – importance of Impact of NPF/SOA – importance of quality statisticsquality statistics
Code of Practice for Official Code of Practice for Official StatisticsStatistics
& & GuidanceGuidance
Janette PurbrickJanette Purbrick
Office of the Chief StatisticianOffice of the Chief Statistician 24 February 201124 February 2011
Statistics and Registration Act Statistics and Registration Act 20072007
Overall objective:Overall objective:
To promote and safeguard the quality To promote and safeguard the quality of official statistics that serve the of official statistics that serve the public good. public good.
Created UK Statistics Authority:Created UK Statistics Authority:
Prepare, adopt and publish a code of Prepare, adopt and publish a code of practice.practice.
Code of Practice for Official Code of Practice for Official StatisticsStatistics
Replaced the Replaced the National Statistics Code of National Statistics Code of Practice (the old code)Practice (the old code)
Draws on Draws on international guidelinesinternational guidelines Extensive Extensive public consultationpublic consultation (published) (published)
88 Principles with Principles with 53 53 practicespractices
3 3 Protocols with further Protocols with further 2121 practices practices
Principle 1: Meeting user needsPrinciple 1: Meeting user needs Principle 2: Impartiality and objectivityPrinciple 2: Impartiality and objectivity Principle 3: IntegrityPrinciple 3: Integrity Principle 4: Sound methods and assured Principle 4: Sound methods and assured
qualityquality Principle 5: ConfidentialityPrinciple 5: Confidentiality Principle 6: Proportionate burdenPrinciple 6: Proportionate burden Principle 7: ResourcesPrinciple 7: Resources Principle 8: Frankness and accessibilityPrinciple 8: Frankness and accessibility Protocol 1: User engagementProtocol 1: User engagement Protocol 2: Release practicesProtocol 2: Release practices Protocol 3: The use of administrative sources Protocol 3: The use of administrative sources
for for statistical purposesstatistical purposes
Where Where notnot to interpret the to interpret the code too literally:code too literally:
– Where there is a reference to the National Where there is a reference to the National Statistician this should be read as the Statistician this should be read as the Chief Statistician (3.5, 5.5, Procolol 2.8) Chief Statistician (3.5, 5.5, Procolol 2.8)
– The point in Procotol 2.3 is organised The point in Procotol 2.3 is organised centrally in Scotland – the UK Hub links to centrally in Scotland – the UK Hub links to our statistics topic pages rather than our statistics topic pages rather than individual publications. You should think individual publications. You should think about how you plan to promote your about how you plan to promote your outputs through the Hub. It is important outputs through the Hub. It is important that users go to your website as the prime that users go to your website as the prime place to go for your statistics rather than place to go for your statistics rather than the UK Hub.the UK Hub.
Worth noting 1Worth noting 1 Best practice guide for Official Statistics Best practice guide for Official Statistics Code has been framed to support Code has been framed to support
assessment of complianceassessment of compliance National Statistics = Code Certified National Statistics = Code Certified
Exceptions/Exemptions – UKSA decide if OKExceptions/Exemptions – UKSA decide if OK Does Does notnot cover Pre-release Access (except cover Pre-release Access (except
early access for Quality Assurance)early access for Quality Assurance) Breadth of Official statistics Breadth of Official statistics UK Statistics Authority considers Official UK Statistics Authority considers Official
Statistics to be National Statistics Statistics to be National Statistics in waitingin waiting
Worth noting 2Worth noting 2
USER engagement has stronger USER engagement has stronger focus than everfocus than ever
Admin sources and MI recognised as Admin sources and MI recognised as increasingly important issuesincreasingly important issues
Focus on what’s relevant today?Focus on what’s relevant today? Code will be reviewed and updatedCode will be reviewed and updated
Code is IMPERATIVE & Code is IMPERATIVE & DYNAMIC….DYNAMIC….
Code vocabulary….Code vocabulary….
ENGAGEENGAGE DOCUMENTDOCUMENT PUBLISHPUBLISH
PRESENT ANNOUNCEPRESENT ANNOUNCE
RELEASE ISSUE INFORMRELEASE ISSUE INFORM
PROMOTE PRODUCEPROMOTE PRODUCE
PREPARE REPORT CONSULTPREPARE REPORT CONSULT
DISSEMINATE PUBLICISEDISSEMINATE PUBLICISE
IDENTIFYIDENTIFY
Why DYNAMIC?Why DYNAMIC?
From Thesaurus ‘dynamic’ means….From Thesaurus ‘dynamic’ means….
activating changing compellingactivating changing compelling
driving effective driving effective
influential potent powerfulinfluential potent powerful
forceful/forcibleforceful/forcible
productive progressiveproductive progressive
How do we use the How do we use the Code?Code?
Refer, assess, interpretRefer, assess, interpret Satisfy yourself that you are Satisfy yourself that you are
complyingcomplying Refer to your sponsor ASD if in Refer to your sponsor ASD if in
doubtdoubt Note any weakness (and Note any weakness (and
strengths) strengths) – build into your – build into your improvement plansimprovement plans
Code is top tier of the guidanceCode is top tier of the guidance
GuidanceGuidance
TIER 1TIER 1 – UK Statistics Authority Code of – UK Statistics Authority Code of PracticePractice
TIER 2TIER 2 – National Statistician’s guidance – National Statistician’s guidance bookletsbooklets
TIER 3TIER 3 – Scottish Government guidance – Scottish Government guidance
TIER 4TIER 4 – Your own guidance? – Your own guidance?
National Statistician’s National Statistician’s guidance bookletsguidance booklets
Quality & MethodologyQuality & Methodology Publication & PresentationPublication & Presentation ConfidentialityConfidentiality Use of Administrative or Use of Administrative or
Management SourcesManagement Sources
Scottish Government Scottish Government guidance guidance
On SG IntranetOn SG Intranet Detailed and procedural – always evolvingDetailed and procedural – always evolving Useful to staff as sets out what to doUseful to staff as sets out what to do Encompass SG/ Devolved Administration Encompass SG/ Devolved Administration
considerationsconsiderations
NEW!!NEW!! Concise and consolidated version for New Concise and consolidated version for New
Producers with focus on Official Statistics. Producers with focus on Official Statistics. On internet for bodies to access:On internet for bodies to access:http://www.scotland.gov.uk/Topics/Statistics/About/NatStatshttp://www.scotland.gov.uk/Topics/Statistics/About/NatStats
SG guidance - Corporate SG guidance - Corporate Policy StatementsPolicy Statements
As per the Code of Practice, you will find the As per the Code of Practice, you will find the following on the Statistics pages on SG website:following on the Statistics pages on SG website:
SG Revisions PolicySG Revisions Policy SG Confidentiality PolicySG Confidentiality Policy SG Quality Assurance guidanceSG Quality Assurance guidance SG Statement of Administrative SourcesSG Statement of Administrative Sources
New Producers should think about their own version New Producers should think about their own version of these and publish them on their website. Your of these and publish them on their website. Your statistical staff should comply with these policies.statistical staff should comply with these policies.
SG guidance for New SG guidance for New ProducersProducers
1.1. Pre-AnnouncementPre-Announcement 2.2. Release practicesRelease practices 3.3. Unbiased commentary and presentationUnbiased commentary and presentation 4.4. Quality AssuranceQuality Assurance 5.5. Consultation/engaging with usersConsultation/engaging with users 6.6. Management informationManagement information 7.7. Other requirementsOther requirements 8.8. Scrutiny by the UK Statistics AuthorityScrutiny by the UK Statistics Authority 9.9. Pre-release Access orderPre-release Access order
Your own GuidanceYour own Guidance
Inevitable that you will develop this Inevitable that you will develop this as your experience of producing as your experience of producing Official Statistics growsOfficial Statistics grows
Tailor it to suit your Organisational Tailor it to suit your Organisational needs and particluar data needsneeds and particluar data needs
You could develop your own You could develop your own Example Example BankBank to sit with your guidance……. to sit with your guidance…….
…………think about what you do when think about what you do when youyou apply the code to apply the code to youryour work…. work….
Collection of Collection of REALREAL instances of applying instances of applying Code……CASE LAW?Code……CASE LAW?
Particularly helpful for those Particularly helpful for those grey areasgrey areas Helps you Helps you shareshare best practicebest practice Helps you Helps you understandunderstand best practice best practice Lets you Lets you demonstratedemonstrate best practice best practice Helps you Helps you drive up standardsdrive up standards Efficient!Efficient!
BreachesBreaches Alert your own ‘HoP’ and your ASD contact Alert your own ‘HoP’ and your ASD contact
who will alert the SG ASD Senior Statistician who will alert the SG ASD Senior Statistician & Chief Statistician& Chief Statistician
Investigation needed then report breach (if a Investigation needed then report breach (if a major breach). Keep records of minor major breach). Keep records of minor breaches.breaches.
National Statistician involvementNational Statistician involvement Public acknowledgment on your website and Public acknowledgment on your website and
on UKSA siteon UKSA site NB - Learn from mistakes. Improve NB - Learn from mistakes. Improve
procedures.procedures. UK Statistics Authority publicly praised us for UK Statistics Authority publicly praised us for
our timely updates to breaches part of our our timely updates to breaches part of our website – helps with integrity and public website – helps with integrity and public perception of the statisticsperception of the statistics
Considerations….Considerations….
Official statisticsOfficial statistics– comply with key parts of Codecomply with key parts of Code
National StatisticsNational Statistics– future programme of work for bodiesfuture programme of work for bodies– can you demonstrate Code compliance?can you demonstrate Code compliance?
BreachesBreaches – minimise and learn from – minimise and learn from
PRE-RELEASE PRE-RELEASE ACCESS TO ACCESS TO OFFICIAL OFFICIAL
STATISTICSSTATISTICSThursday 24Thursday 24thth February 2011 February 2011
To coverTo cover Legislation – background, scope & purposeLegislation – background, scope & purpose Arrangements across the UKArrangements across the UK When should you give pre-release access?When should you give pre-release access? What should you be doing?What should you be doing? Responsibilities of those receiving pre-release Responsibilities of those receiving pre-release
accessaccess How the UK Government rules affect you How the UK Government rules affect you
Experience to date and issues that have Experience to date and issues that have
arisenarisen ConsiderationsConsiderations Where to go for help Where to go for help
Legislation - BackgroundLegislation - Background New Code of Practice applies to whole of UK New Code of Practice applies to whole of UK
but separate pre-release access but separate pre-release access arrangements in each administrationarrangements in each administration
Pre-Release Access to Official Statistics Pre-Release Access to Official Statistics (Scotland) Order 2008 came into force on 1 (Scotland) Order 2008 came into force on 1 December 2008December 2008
Applies to early access given to Ministers and Applies to early access given to Ministers and others to official statistics in their others to official statistics in their final formfinal form prior to publication.prior to publication.
Timing remains at 5 working days (1 day for Timing remains at 5 working days (1 day for market sensitive statistics)market sensitive statistics)
Procedures and compliance are now stricterProcedures and compliance are now stricter Compliance (for National Statistics) will be Compliance (for National Statistics) will be
assessed by UK Statistics Authorityassessed by UK Statistics Authority
Legislation - scopeLegislation - scope Order applies to all official statisticsOrder applies to all official statistics Order Order does notdoes not apply to early access to apply to early access to
statistics for QA purposes – this is covered statistics for QA purposes – this is covered by the Code of Practiceby the Code of Practice
QA access timing is at the discretion of QA access timing is at the discretion of the responsible statisticianthe responsible statistician
You must be able to evidence that value is You must be able to evidence that value is added by involving colleagues in QAadded by involving colleagues in QA
The QA period The QA period must notmust not be used for be used for preparing ministerial briefing preparing ministerial briefing
Legislation - purposeLegislation - purpose
To increase public trust in official To increase public trust in official statistics through greater clarity and statistics through greater clarity and transparencytransparency
Internationally recognised principle of Internationally recognised principle of equality of access to National Statisticsequality of access to National Statistics
Pre-release access on a “need to know” Pre-release access on a “need to know” basisbasis
Ensures that those who need to Ensures that those who need to comment at the time of release can be comment at the time of release can be properly informed properly informed
Arrangements across the Arrangements across the UKUK
Different arrangements for each Different arrangements for each administrationadministration
UK Government & Northern Ireland – 24 UK Government & Northern Ireland – 24 hours for all official statisticshours for all official statistics
Wales – similar to Scotland – 5 working Wales – similar to Scotland – 5 working daysdays
And now onto the practicalities….And now onto the practicalities….
When should you give pre-release When should you give pre-release access?access?
To ensure Ministers and key officials can To ensure Ministers and key officials can comment on the statistics on an informed basis comment on the statistics on an informed basis at the time of releaseat the time of release
To enable public bodies whose functions are To enable public bodies whose functions are described by the statistics to comment on an described by the statistics to comment on an informed basis informed basis
To allow Communications staff to comment on To allow Communications staff to comment on the statistical news releasethe statistical news release
To ensure related publications or other To ensure related publications or other material being prepared for release at some material being prepared for release at some time (or shortly after) are properly informed by time (or shortly after) are properly informed by the correct figuresthe correct figures
In other exceptional cases where this would In other exceptional cases where this would not damage public trustnot damage public trust
What should you be What should you be doing?doing?
Ensuring key policy and communications contacts Ensuring key policy and communications contacts are aware of new rules are aware of new rules
Ensuring recipients are told why they are given Ensuring recipients are told why they are given access and that they must only use the statistics for access and that they must only use the statistics for this purposethis purpose
Ensuring recipients are aware of their Ensuring recipients are aware of their responsibilities under the pre-release order responsibilities under the pre-release order
Marking all files relating to pre-release statistics as Marking all files relating to pre-release statistics as “ restricted”“ restricted” until the date of release until the date of release
Only sending pre-release statistics to named Only sending pre-release statistics to named individuals, not generic mailboxes. We have some individuals, not generic mailboxes. We have some exceptions in SG:exceptions in SG: Cabinet Secretaries and MinistersCabinet Secretaries and Ministers Directors GeneralDirectors General OCS Forthcoming publicationsOCS Forthcoming publications
What should you be doing? What should you be doing? – cont.– cont.
Ensuring we can justify why access is being Ensuring we can justify why access is being given and keeping a record of all recipients and given and keeping a record of all recipients and reason for accessreason for access
Reporting any wrongful disclosure to your Reporting any wrongful disclosure to your statistical Head of Profession (Breaches)statistical Head of Profession (Breaches)
The UK Statistics Authority may investigate The UK Statistics Authority may investigate possible breachespossible breaches
Responsibilities of those Responsibilities of those receiving pre-release accessreceiving pre-release access Must only use pre-release statistics for the Must only use pre-release statistics for the
purpose for which access grantedpurpose for which access granted Must not use the access for personal or Must not use the access for personal or
political gainpolitical gain Must not pass pre-release statistics on to Must not pass pre-release statistics on to
others or disclose any indication of the content others or disclose any indication of the content Must not use early access for quality Must not use early access for quality
assurance purposes as time to prepare assurance purposes as time to prepare ministerial briefingministerial briefing
Must not save to a shared area Must not save to a shared area
Responsibilities of those Responsibilities of those receiving pre-release access receiving pre-release access
– cont.– cont. Ministerial statements and policy Ministerial statements and policy
briefing on the statistics must retain briefing on the statistics must retain marking marking ““Restricted StatisticsRestricted Statistics” ” until until the time of publicationthe time of publication
Embargoed early access can no longer Embargoed early access can no longer be given to journalistsbe given to journalists
Any accidental or wrongful release must Any accidental or wrongful release must be reported to the responsible be reported to the responsible statisticianstatistician
Non-disclosure agreements (NDA) usefulNon-disclosure agreements (NDA) useful
How UK Government rules How UK Government rules affect usaffect us
Where UK Depts publish devolved statistics it is Where UK Depts publish devolved statistics it is not always clear which pre-release access rules not always clear which pre-release access rules applyapply
Depends on the type of publication. E.g.Depends on the type of publication. E.g. Joint publicationJoint publication - where we publish - where we publish
devolved statistics at the same time as UK Gov devolved statistics at the same time as UK Gov Dept publishes UK-wide statistics - e.g. Dept publishes UK-wide statistics - e.g. Income inequality and poverty statisticsIncome inequality and poverty statistics
Government CompendiaGovernment Compendia – publishing – publishing comparisons across the UK – e.g. General comparisons across the UK – e.g. General Household report on smoking and drinkingHousehold report on smoking and drinking
Where UK Government or a UK-wide body Where UK Government or a UK-wide body publishes a separate country publication publishes a separate country publication on a devolved matteron a devolved matter
Experience to date Experience to date
Some issues that have arisen:Some issues that have arisen: Pre-release access to representative Pre-release access to representative
bodiesbodies Senior Management Team (SMT) Senior Management Team (SMT)
Access to draft pages on your internet Access to draft pages on your internet
editoreditor Issues around access to management Issues around access to management
information information
ConsiderationsConsiderations
SG Pre-release access review in SG Pre-release access review in 2010 concluded that rules were 2010 concluded that rules were working well.working well.
UK Statistics Authority constantly UK Statistics Authority constantly campaign for PRA to be minimised.campaign for PRA to be minimised.
Your duty to uphold rules – minimise Your duty to uphold rules – minimise leaks leaks
For help….For help….
Guidance is available Guidance is available Please continue to contact Please continue to contact
your sponsor ASD for advice. your sponsor ASD for advice. They will pass ‘grey area’ They will pass ‘grey area’ queries to OCS. queries to OCS.
Statistical Statistical Support for Support for
Public BodiesPublic BodiesChris NewsonChris Newson
Office of the Chief Office of the Chief StatisticianStatistician
Scottish GovernmentScottish Government
Presentation OutlinePresentation Outline
Today I will talk to you about:Today I will talk to you about: The role of ASD Support Teams;The role of ASD Support Teams; The ScotStat Public Sector Analysts The ScotStat Public Sector Analysts
Network;Network; Online resources that may be of use; andOnline resources that may be of use; and The support the Office of the Chief The support the Office of the Chief
Statistician can provide.Statistician can provide.
Time at the end for any questionsTime at the end for any questions
ASD Support TeamsASD Support Teams
It is the role of analytical staff in teams It is the role of analytical staff in teams sponsoring the public body to provide sponsoring the public body to provide support and advice on compliance with support and advice on compliance with the Code of Practice for Official the Code of Practice for Official Statistics, this may cover:Statistics, this may cover: Pre Release AccessPre Release Access Preparing for product assessmentPreparing for product assessment The principals and protocols within the The principals and protocols within the
CodeCode Ministerial correspondenceMinisterial correspondence
ScotStat Public Sector ScotStat Public Sector Analysts NetworkAnalysts Network
Open to anyone from Local Government or Open to anyone from Local Government or other public bodies as well as academicsother public bodies as well as academics
No need to be an analyst by professionNo need to be an analyst by profession About sharing analytical knowledge and About sharing analytical knowledge and
experienceexperience For more information or to join please visitFor more information or to join please visit
www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork Or contact me at:Or contact me at:
[email protected]@Scotland.gsi.gov.uk 0300 244 10150300 244 1015
Network PurposeNetwork Purpose Develop mutual understanding of statistical needs and Develop mutual understanding of statistical needs and
opportunities between local authorities, public bodies and opportunities between local authorities, public bodies and Scottish Government;Scottish Government;
Consider the best means for Scottish Government to share Consider the best means for Scottish Government to share its analytical resources with other public bodies to build its analytical resources with other public bodies to build analytical capacity more widely; analytical capacity more widely;
Consider issues across public bodies in data collection in Consider issues across public bodies in data collection in order to take a strategic approach to harmonisation and order to take a strategic approach to harmonisation and efficient use of resources; efficient use of resources;
Discuss how Scottish Government statistics are used by Discuss how Scottish Government statistics are used by public bodies and how they might be improved to be of public bodies and how they might be improved to be of more benefit; more benefit;
Increase knowledge and understanding of functional issues Increase knowledge and understanding of functional issues (e.g. Scottish Neighbourhood Statistics, Sample Surveys, (e.g. Scottish Neighbourhood Statistics, Sample Surveys, Official Statistics), cross cutting themes (e.g. equality Official Statistics), cross cutting themes (e.g. equality statistics, geographical statistics) and methodological statistics, geographical statistics) and methodological issues (e.g. measuring change, reporting on targets).issues (e.g. measuring change, reporting on targets).
What the Network doesWhat the Network does The Network’s aims are met through demand-The Network’s aims are met through demand-
led local workshops and short lived working led local workshops and short lived working groups.groups.
Decisions of working groups and workshops are Decisions of working groups and workshops are made by Network members.made by Network members.
Network members contribute to arrangement Network members contribute to arrangement for workshops with support from Scottish for workshops with support from Scottish GovernmentGovernment
Workshops can be tailored to specific needsWorkshops can be tailored to specific needs The Network also aims to keep members The Network also aims to keep members
informed of related work that may be of interest, informed of related work that may be of interest, such as the Local Outcome Indicators Project.such as the Local Outcome Indicators Project.
Analysts Network Analysts Network WorkshopsWorkshops
Can cover any methodological or cross-cutting Can cover any methodological or cross-cutting issue, such as:issue, such as: Presenting dataPresenting data Using administrative sourcesUsing administrative sources Understanding the Scottish Index of Multiple Understanding the Scottish Index of Multiple
Deprivation (SIMD)Deprivation (SIMD) Using Scottish Neighbourhood Statistics (Using Scottish Neighbourhood Statistics (
www.sns.gov.ukwww.sns.gov.uk)) Or many other issues…Or many other issues…
Free to attendFree to attend Held in a variety of locations, decided by Held in a variety of locations, decided by
membersmembers Tend to have 15 to 20 attendees so they can be Tend to have 15 to 20 attendees so they can be
interactive and tailored to specific needs or issuesinteractive and tailored to specific needs or issues
Analysts Network Analysts Network WorkshopsWorkshops
All details of past workshops including All details of past workshops including materials and feedback received are materials and feedback received are available on the network website: available on the network website: www.scotland.gov.uk/analsystnetwork/Newww.scotland.gov.uk/analsystnetwork/NetworkWorkshopstworkWorkshops
Most past workshops can be re-run if Most past workshops can be re-run if there is sufficient demand from Network there is sufficient demand from Network members.members.
Currently putting together a programme Currently putting together a programme of workshops to be delivered throughout of workshops to be delivered throughout 2011.2011.
Some of the Past Some of the Past Network WorkshopsNetwork Workshops
Understanding Economic Statistics, EdinburghUnderstanding Economic Statistics, Edinburgh Contribution Analysis, AyrContribution Analysis, Ayr Interpreting the Scottish Index of Multiple Deprivation, Interpreting the Scottish Index of Multiple Deprivation,
Glasgow Caledonian UniversityGlasgow Caledonian University Forecasting and Projections, AberdeenForecasting and Projections, Aberdeen Data Access, Data Sharing and the Data Protection Act, Data Access, Data Sharing and the Data Protection Act,
KirkcaldyKirkcaldy Measuring Change and Monitoring Targets, KirkcaldyMeasuring Change and Monitoring Targets, Kirkcaldy Statistics, OrkneyStatistics, Orkney An Introduction to Understanding Data and Setting An Introduction to Understanding Data and Setting
Targets, EdinburghTargets, Edinburgh Survey Design and Analysis, Edinburgh City CouncilSurvey Design and Analysis, Edinburgh City Council Surveys, FalkirkSurveys, Falkirk Equalities Data Workshop, EdinburghEqualities Data Workshop, Edinburgh Scottish Neighbourhood Statistics, InvernessScottish Neighbourhood Statistics, Inverness
Analysts Network Analysts Network Contact DetailsContact Details
Website:Website:www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork
Email:Email:[email protected]@Scotland.gsi.gov.ukk
Phone:Phone:0300 244 10150300 244 1015
Analytical Guidance Analytical Guidance LibraryLibrary
Created by a short-lived working group of Created by a short-lived working group of the Analysts Networkthe Analysts Network
Electronic library of analytical guidance Electronic library of analytical guidance material material
Covers a magnitude of topic areas:Covers a magnitude of topic areas: Confidence intervalsConfidence intervals EthicsEthics ModellingModelling Statistical Process ControlStatistical Process Control
www.scotland.gov.uk/Topics/Statistics/scotwww.scotland.gov.uk/Topics/Statistics/scotstat/analystsnetwork/AnalyticalGuidanceLstat/analystsnetwork/AnalyticalGuidanceLibraryibrary
Methodology GlossaryMethodology Glossary Quick reference materials for specific Quick reference materials for specific
analytical techniquesanalytical techniques No previous understanding required, No previous understanding required,
covers different levels (Tiers 1, 2 and 3?)covers different levels (Tiers 1, 2 and 3?) Will be further developed soon to include Will be further developed soon to include
a “How Do I…” section linking all papers a “How Do I…” section linking all papers related to a specific technique.related to a specific technique.
Will be adding a glossary of key statistical Will be adding a glossary of key statistical termsterms
www.scotland.gov.uk/Topics/Statistics/Abowww.scotland.gov.uk/Topics/Statistics/About/Methodology/Glossaryut/Methodology/Glossary
One-to-one and Hands-One-to-one and Hands-on Analytical Supporton Analytical Support
Available from the Office of Available from the Office of the Chief Statisticianthe Chief Statistician
What other support can What other support can we offer?we offer?
Statistical Support for Public Bodies Statistical Support for Public Bodies Branch in the Office of the Chief Branch in the Office of the Chief StatisticianStatistician Methodological QuestionsMethodological Questions Advice or ‘sounding board’ for analytical Advice or ‘sounding board’ for analytical
projectsprojects May be able to be involved in Local projectsMay be able to be involved in Local projects
[email protected]@Scotland.gsi.gov.uk [email protected]@Scotland.gsi.gov.uk 0300 244 10150300 244 1015
Example IExample I Involvement in a working group looking at data Involvement in a working group looking at data
availability within a Community Planning availability within a Community Planning Partnership (CPP) areaPartnership (CPP) area
Offering critical friend and challenge roleOffering critical friend and challenge role Information on data suitability and availabilityInformation on data suitability and availability Liaise with colleagues in SG on specific topicsLiaise with colleagues in SG on specific topics Helped in the production of a report setting out Helped in the production of a report setting out
the current state of play in the CPP to assist in the current state of play in the CPP to assist in identifying priority areas of concern for the identifying priority areas of concern for the futurefuture
This developed the relationship we have with This developed the relationship we have with the CPP which is beneficial for both partiesthe CPP which is beneficial for both parties
Example IIExample II Methodological advice and assistance on hypothesis Methodological advice and assistance on hypothesis
testingtesting A colleague in Local Government was interested in A colleague in Local Government was interested in
analysing survey results by equalities characteristics and analysing survey results by equalities characteristics and wanted to test for association between variableswanted to test for association between variables
We provided advice on most appropriate test to use for We provided advice on most appropriate test to use for this casethis case
Developed a detailed how to guide that became part of Developed a detailed how to guide that became part of the methodology glossarythe methodology glossary
Provided further assistance to review the approach taken.Provided further assistance to review the approach taken. In the end because of the sample size it was difficult to In the end because of the sample size it was difficult to
use this technique however, we were still able to provide use this technique however, we were still able to provide advice on the analysis and interpretation of the survey advice on the analysis and interpretation of the survey resultsresults
Any Questions?Any Questions?
Check out the Network website:Check out the Network website:www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork
If you think of anything later, feel free to If you think of anything later, feel free to contact us:contact us:
[email protected]@Scotland.gsi.gov.uk0300 244 10150300 244 1015
Introduction to Official Statistics
becoming National Statistics
Janette Purbrick Office of the Chief Statistician
Thursday 24th February 2011
Some common labels:
• Data being developed (aka experimental statistics) – published output but not ‘fit for purpose’. Useful way to
shape an output by getting user views/feedback
• Official Statistics – Minister has agreed Scope. Deemed ‘fit for purpose’
• National Statistics– Subset of ‘Official Statistics’ certified as Code compliant by
UK Statistics Authority
• Provisional results– published OS or NS with pending planned revisions to make
final results
Assessment and Designation
Two routes
• Section 12 of Act – Producer body requests that an output is assessed
• Section 16 of Act – The Authority invokes the assessment of an output
Process of Assessment
Four main stages
• Written Evidence for Assessment
• Assessment Report
• Reporting Back
• Designation as a National Statistic
Our experience
• Authority very fair throughout the process
• Brings the Code of Practice and PRA Order to life
• Driving up statistical standards
• Independent scrutiny adds value to the statistics – impetus for change
Reflections from SG assessees
• Clear that documentation is key to demonstrating good practice
• Time consuming process but not difficult• Overall process was really helpful• A valuable way of self-assessing your products• Makes it easier for us to form an action plan for
improvement to strengthen product• Pre-release Access Order • Know more about our products than before -
specifically aware of products strengths/weaknesses against the Code of Practice
What you can do to get ready..
NOW…..look at output WEFA for your products• Can you answer all the questions in the WEFA?• For each question are you:
– confident– partially confident– not confident ….of meeting the Code?
• What documentation do we have/need?• Ensure you have relevant documentation
(stakeholder lists/individuals with pre-release access/stakeholder consultation material/changes to methodology etc).
• Publish where applicable• Start now…save time later!
The role of the UK Statistics Authority
Neil Jackson
Official Statistics - New Producers’ Seminar
24 February 2011
Coverage of presentation
• Background to establishing the Authority
• The Monitoring Function
• Assessment function
• The Impact of Assessment
ONS Omnibus, 2007
Figures are generally accurate
Figures are produced
without political
interference
Government uses
figures honestly
% % %
Agree 36 20 16 Neither agree
nor disagree 31 23 26
Disagree 33 57 58
Base = 100% 1112 1112 1112
Views about official statistics in general
UK Statistics Authority
• Authority established by the Statistics and Registration Service Act, 2007
• to promote and safeguard the production and publication of official statistics that serve the public good
• A non-ministerial Department – overseen by Parliament, not a Government Minister
• Authority’s responsibilities extend to the whole of the UK - England, Wales, Scotland and Northern Ireland
Monitoring and Assessment Functions
• The Board is to monitor the production and publication of official statistics
• The Board is to prepare, adopt and publish a Code of Practice for Official Statistics
• Assess and determine whether the Code of Practice has been complied with
What the Authority is aiming to achieve
• Right statistics – the statistics produced are of greatest relevance and importance
• Right standards – in line with a formal Code of Practice
• Right explanation – well communicated and explained, including strengths and weaknesses – to support decision-making
Monitoring Briefs
• Volatility of the Retail Sales Index
• Knife Crime Statistics
• Release on UK Born and non-UK Born Employment
• Gender Pay Gap
• Discussion of Trends in Violent Crime
• Scotland's Major Population Surveys
• Communicating Inflation
• Improving the reporting of road casualties
Aims of Assessment
• to help the producers of official statistics to enhance the quality of the statistical service over a period of time
• to communicate to Parliament and the public the extent of compliance with the Code
Designation
Statistics…
• Meet identified user needs
• Are produced, managed and disseminated to high standards
• Are well explained.
Published Assessment Reports
Scottish Government 14
Information Services Division 5
Northern Ireland 8
Welsh Assembly Government 8
UK Government Departments 33
Office for National Statistics 19
Other 9
Total 96
Distribution of Requirements by Principle
0 20 40 60 80 100 120 140 160 180 200
Frankness & accessiblity
Meeting user needs
Sound methods
Release practices
Impartiality and Objectivity
Use of admin sources
Confidentiality
Resources
Proportionate burden
Integrity
Typical Requirements
• Take steps to develop a greater understanding of the use made of the statistics and publish the relevant information
• Provide more information about the quality of the statistics, including relevance and accuracy
• Provide additional commentary and analysis that aid interpretation; and provide factual information about the policy and wider context of these statistics
Emerging Findings
• Need for more systematic engagement with users• Needs a clearer understanding of the uses made of
official statistics • Better documentation of strengths and weaknesses
of statistics in relation to their uses• Scope to enhance the presentation of the statistics
and the accompanying commentary
ISD User Engagement
• An enhanced user / customer survey
• A revamped website that will allow users to provide feedback on individual statistical releases
• Seek feedback from users who have recently requested information and publish a summary of the results (currently being piloted).
• Publish web links to the minutes of steering / reference group meetings, or make these minutes available on request.
NHS Information Centre Mental Health Statistics
‘It is not clear why there has been a decrease in formal admissions to independent sector hospitals. It could be due to the NHS commissioners sending fewer patients to independent sector hospitals to reduce costs. Other possible explanations could be that there are more NHS beds available due to admitting fewer informal patients’
Impact of assessment
• Enhancing producers’ understanding of the use made of their statistics;
• Improving producers’ engagement with users of statistics outside their own organisations; and
• Improving the quality and accessibility of statistical releases – the ‘shop window’ of the statistical service
A statistical system that is more demonstrably trustworthy
• the Authority’s various public interventions have reminded Parliament and the public that the statistical service is independently regulated;
• the position of statistics professionals working in departments has been strengthened, in response to this regulatory environment.