Official Statistics New Producers’ Seminar Thursday 24 th February 2011.

95
Official Statistics New Producers’ Seminar Thursday 24 th February 2011

Transcript of Official Statistics New Producers’ Seminar Thursday 24 th February 2011.

Official StatisticsNew Producers’ Seminar

Thursday 24th February 2011

SEMINAR AGENDA• Seminar introduction - aims & key roles Julie Wilson, Deputy Chief Statistician • Welcome from the Chief Statistician Rob Wishart, Chief Statistician• The Code of Practice for Official Statistics Janette Purbrick, Office of the Chief Statistician • Pre-release Access to Official Statistics Rob Wishart and Janette Purbrick • Statistical Support for Public Bodies Chris Newson, Office of the Chief Statistician • Introduction to how Official Statistics become National Statistics Janette Purbrick• The Role of the UK Statistics Authority Neil Jackson, head of the Edinburgh branch of the Authority

Seminar introduction - aims & key roles

Julie Wilson Deputy Chief Statistician

Office of the Chief Statistician

Thursday 24th February 2011

Seminar delegates today

• Crown bodies – Official Statistics producers because of the Act

• Non-Crown bodies – Official Statistics producers because of Parliamentary Order

• Scottish Government statistical and policy staff

Today’s Aims

• Background

• Legislation

• Practicalities

• Other services

• Understanding key roles

• Broader Context

Background – key legislation • 2007 - Statistics and Registration Services Act

– Defined ‘Official Statistics’ and stated who produces themThe S&RS Act 2007 defined Official Statistics as those statistics

produced by the Scottish Administration and Crown bodies (primary legislation)…..

….. and other bodies that Scottish Ministers agree to by parliamentary order (secondary legislation)

– Created UK Statistics Authority– Created ‘Code of Practice for Official Statistics’– Assessment and Designation for National Statistics status

• 2008 - Pre-release access to Official Statistics (Scotland) Order• 2008 - Official Statistics (Scotland) Order• 2010 - Official Statistics (Scotland) Amended Order

Key roles

• Lead official within the producer body responsible for the production of statistical outputs

within their organisation ie operational matters, and for compliance with the Code of Practice and pre-release arrangements.

• Sponsoring ASD and SG to provide statistical advice, on code compliance etc.

• Chief Statistician to provide statistical advice on breaches and other

issues (like Chief Statistician’s current role for GROS & ISD)

Communication channel

Producer Body

Ministers Scottish Government - ASD

Scottish Government - Chief Statistician

Welcome from the Chief Welcome from the Chief StatisticianStatistician

Rob Wishart Rob Wishart

Thursday 24Thursday 24thth February 2011 February 2011

Why are statistics differentWhy are statistics different

What’s special about statisticsWhat’s special about statistics inform governmentinform government inform the public about governmentinform the public about government

International standardsInternational standards Issues in BritainIssues in Britain

Developments in UKDevelopments in UK

First Official Statistics CodeFirst Official Statistics Code 1997 elections and development of 1997 elections and development of

“National Statistics”“National Statistics” Run up to Statistics & Registration Service Run up to Statistics & Registration Service

Act 2007Act 2007 Scottish Parliament endorsementScottish Parliament endorsement

Scotland and UK - differencesScotland and UK - differences

Fewer issues of perceived interferenceFewer issues of perceived interference So less emphasis on trust and more on So less emphasis on trust and more on

usefulness/relevance to decision makingusefulness/relevance to decision making Very different approach to pre-release accessVery different approach to pre-release access Reminder that statistics are devolvedReminder that statistics are devolved Not the UK “transparency” agendaNot the UK “transparency” agenda Our own Framework – comments welcome:Our own Framework – comments welcome:http://www.scotland.gov.uk/Topics/Statistics/About/scottishfrhttp://www.scotland.gov.uk/Topics/Statistics/About/scottishframework/frameworkcon#topamework/frameworkcon#top

Differences for new producersDifferences for new producers

Should not diminish the degree of Should not diminish the degree of autonomy from Ministersautonomy from Ministers

Key role of Ministers in setting frameworkKey role of Ministers in setting framework Importance of meeting key standards nowImportance of meeting key standards now Staged approach to other standardsStaged approach to other standards Resource issuesResource issues Role of Responsible personRole of Responsible person

Role of Chief Statistician and Role of Chief Statistician and Heads of Profession Heads of Profession

The “responsible statistician”The “responsible statistician” Susan Burney covers NHS – National Susan Burney covers NHS – National

Services ScotlandServices Scotland Chief Statistician covers everything else Chief Statistician covers everything else

except GROSexcept GROS Roles set out in FrameworkRoles set out in Framework But some differences for new producers – But some differences for new producers –

to be explained laterto be explained later

Role of National StatisticianRole of National Statistician

Indirect role in ScotlandIndirect role in Scotland Use of National Statistician’s guidanceUse of National Statistician’s guidance When should National Statistician be When should National Statistician be

involvedinvolved

ConclusionsConclusions

Crucial role of statistics in informing Crucial role of statistics in informing government and publicgovernment and public

Impact of NPF/SOA – importance of Impact of NPF/SOA – importance of quality statisticsquality statistics

Code of Practice for Official Code of Practice for Official StatisticsStatistics

& & GuidanceGuidance

Janette PurbrickJanette Purbrick

Office of the Chief StatisticianOffice of the Chief Statistician 24 February 201124 February 2011

Today’s aims….Today’s aims….

CodeCode Guidance Guidance Breaches Breaches

Statistics and Registration Act Statistics and Registration Act 20072007

Overall objective:Overall objective:

To promote and safeguard the quality To promote and safeguard the quality of official statistics that serve the of official statistics that serve the public good. public good.

Created UK Statistics Authority:Created UK Statistics Authority:

Prepare, adopt and publish a code of Prepare, adopt and publish a code of practice.practice.

Code of Practice for Official Code of Practice for Official StatisticsStatistics

Replaced the Replaced the National Statistics Code of National Statistics Code of Practice (the old code)Practice (the old code)

Draws on Draws on international guidelinesinternational guidelines Extensive Extensive public consultationpublic consultation (published) (published)

88 Principles with Principles with 53 53 practicespractices

3 3 Protocols with further Protocols with further 2121 practices practices

Principle 1: Meeting user needsPrinciple 1: Meeting user needs Principle 2: Impartiality and objectivityPrinciple 2: Impartiality and objectivity Principle 3: IntegrityPrinciple 3: Integrity Principle 4: Sound methods and assured Principle 4: Sound methods and assured

qualityquality Principle 5: ConfidentialityPrinciple 5: Confidentiality Principle 6: Proportionate burdenPrinciple 6: Proportionate burden Principle 7: ResourcesPrinciple 7: Resources Principle 8: Frankness and accessibilityPrinciple 8: Frankness and accessibility Protocol 1: User engagementProtocol 1: User engagement Protocol 2: Release practicesProtocol 2: Release practices Protocol 3: The use of administrative sources Protocol 3: The use of administrative sources

for for statistical purposesstatistical purposes

Where Where notnot to interpret the to interpret the code too literally:code too literally:

– Where there is a reference to the National Where there is a reference to the National Statistician this should be read as the Statistician this should be read as the Chief Statistician (3.5, 5.5, Procolol 2.8) Chief Statistician (3.5, 5.5, Procolol 2.8)

– The point in Procotol 2.3 is organised The point in Procotol 2.3 is organised centrally in Scotland – the UK Hub links to centrally in Scotland – the UK Hub links to our statistics topic pages rather than our statistics topic pages rather than individual publications. You should think individual publications. You should think about how you plan to promote your about how you plan to promote your outputs through the Hub. It is important outputs through the Hub. It is important that users go to your website as the prime that users go to your website as the prime place to go for your statistics rather than place to go for your statistics rather than the UK Hub.the UK Hub.

Worth noting 1Worth noting 1 Best practice guide for Official Statistics Best practice guide for Official Statistics Code has been framed to support Code has been framed to support

assessment of complianceassessment of compliance National Statistics = Code Certified National Statistics = Code Certified

Exceptions/Exemptions – UKSA decide if OKExceptions/Exemptions – UKSA decide if OK Does Does notnot cover Pre-release Access (except cover Pre-release Access (except

early access for Quality Assurance)early access for Quality Assurance) Breadth of Official statistics Breadth of Official statistics UK Statistics Authority considers Official UK Statistics Authority considers Official

Statistics to be National Statistics Statistics to be National Statistics in waitingin waiting

Worth noting 2Worth noting 2

USER engagement has stronger USER engagement has stronger focus than everfocus than ever

Admin sources and MI recognised as Admin sources and MI recognised as increasingly important issuesincreasingly important issues

Focus on what’s relevant today?Focus on what’s relevant today? Code will be reviewed and updatedCode will be reviewed and updated

Code is IMPERATIVE & Code is IMPERATIVE & DYNAMIC….DYNAMIC….

Code vocabulary….Code vocabulary….

ENGAGEENGAGE DOCUMENTDOCUMENT PUBLISHPUBLISH

PRESENT ANNOUNCEPRESENT ANNOUNCE

RELEASE ISSUE INFORMRELEASE ISSUE INFORM

PROMOTE PRODUCEPROMOTE PRODUCE

PREPARE REPORT CONSULTPREPARE REPORT CONSULT

DISSEMINATE PUBLICISEDISSEMINATE PUBLICISE

IDENTIFYIDENTIFY

Why DYNAMIC?Why DYNAMIC?

From Thesaurus ‘dynamic’ means….From Thesaurus ‘dynamic’ means….

activating changing compellingactivating changing compelling

driving effective driving effective

influential potent powerfulinfluential potent powerful

forceful/forcibleforceful/forcible

productive progressiveproductive progressive

How do we use the How do we use the Code?Code?

Refer, assess, interpretRefer, assess, interpret Satisfy yourself that you are Satisfy yourself that you are

complyingcomplying Refer to your sponsor ASD if in Refer to your sponsor ASD if in

doubtdoubt Note any weakness (and Note any weakness (and

strengths) strengths) – build into your – build into your improvement plansimprovement plans

Code is top tier of the guidanceCode is top tier of the guidance

GuidanceGuidance

TIER 1TIER 1 – UK Statistics Authority Code of – UK Statistics Authority Code of PracticePractice

TIER 2TIER 2 – National Statistician’s guidance – National Statistician’s guidance bookletsbooklets

TIER 3TIER 3 – Scottish Government guidance – Scottish Government guidance

TIER 4TIER 4 – Your own guidance? – Your own guidance?

National Statistician’s National Statistician’s guidance bookletsguidance booklets

Quality & MethodologyQuality & Methodology Publication & PresentationPublication & Presentation ConfidentialityConfidentiality Use of Administrative or Use of Administrative or

Management SourcesManagement Sources

Scottish Government Scottish Government guidance guidance

On SG IntranetOn SG Intranet Detailed and procedural – always evolvingDetailed and procedural – always evolving Useful to staff as sets out what to doUseful to staff as sets out what to do Encompass SG/ Devolved Administration Encompass SG/ Devolved Administration

considerationsconsiderations

NEW!!NEW!! Concise and consolidated version for New Concise and consolidated version for New

Producers with focus on Official Statistics. Producers with focus on Official Statistics. On internet for bodies to access:On internet for bodies to access:http://www.scotland.gov.uk/Topics/Statistics/About/NatStatshttp://www.scotland.gov.uk/Topics/Statistics/About/NatStats

SG guidance - Corporate SG guidance - Corporate Policy StatementsPolicy Statements

As per the Code of Practice, you will find the As per the Code of Practice, you will find the following on the Statistics pages on SG website:following on the Statistics pages on SG website:

SG Revisions PolicySG Revisions Policy SG Confidentiality PolicySG Confidentiality Policy SG Quality Assurance guidanceSG Quality Assurance guidance SG Statement of Administrative SourcesSG Statement of Administrative Sources

New Producers should think about their own version New Producers should think about their own version of these and publish them on their website. Your of these and publish them on their website. Your statistical staff should comply with these policies.statistical staff should comply with these policies.

SG guidance for New SG guidance for New ProducersProducers

1.1. Pre-AnnouncementPre-Announcement 2.2. Release practicesRelease practices 3.3. Unbiased commentary and presentationUnbiased commentary and presentation 4.4. Quality AssuranceQuality Assurance 5.5. Consultation/engaging with usersConsultation/engaging with users 6.6. Management informationManagement information 7.7. Other requirementsOther requirements 8.8. Scrutiny by the UK Statistics AuthorityScrutiny by the UK Statistics Authority 9.9. Pre-release Access orderPre-release Access order

Your own GuidanceYour own Guidance

Inevitable that you will develop this Inevitable that you will develop this as your experience of producing as your experience of producing Official Statistics growsOfficial Statistics grows

Tailor it to suit your Organisational Tailor it to suit your Organisational needs and particluar data needsneeds and particluar data needs

You could develop your own You could develop your own Example Example BankBank to sit with your guidance……. to sit with your guidance…….

…………think about what you do when think about what you do when youyou apply the code to apply the code to youryour work…. work….

Collection of Collection of REALREAL instances of applying instances of applying Code……CASE LAW?Code……CASE LAW?

Particularly helpful for those Particularly helpful for those grey areasgrey areas Helps you Helps you shareshare best practicebest practice Helps you Helps you understandunderstand best practice best practice Lets you Lets you demonstratedemonstrate best practice best practice Helps you Helps you drive up standardsdrive up standards Efficient!Efficient!

BreachesBreaches Alert your own ‘HoP’ and your ASD contact Alert your own ‘HoP’ and your ASD contact

who will alert the SG ASD Senior Statistician who will alert the SG ASD Senior Statistician & Chief Statistician& Chief Statistician

Investigation needed then report breach (if a Investigation needed then report breach (if a major breach). Keep records of minor major breach). Keep records of minor breaches.breaches.

National Statistician involvementNational Statistician involvement Public acknowledgment on your website and Public acknowledgment on your website and

on UKSA siteon UKSA site NB - Learn from mistakes. Improve NB - Learn from mistakes. Improve

procedures.procedures. UK Statistics Authority publicly praised us for UK Statistics Authority publicly praised us for

our timely updates to breaches part of our our timely updates to breaches part of our website – helps with integrity and public website – helps with integrity and public perception of the statisticsperception of the statistics

Considerations….Considerations….

Official statisticsOfficial statistics– comply with key parts of Codecomply with key parts of Code

National StatisticsNational Statistics– future programme of work for bodiesfuture programme of work for bodies– can you demonstrate Code compliance?can you demonstrate Code compliance?

BreachesBreaches – minimise and learn from – minimise and learn from

PRE-RELEASE PRE-RELEASE ACCESS TO ACCESS TO OFFICIAL OFFICIAL

STATISTICSSTATISTICSThursday 24Thursday 24thth February 2011 February 2011

To coverTo cover Legislation – background, scope & purposeLegislation – background, scope & purpose Arrangements across the UKArrangements across the UK When should you give pre-release access?When should you give pre-release access? What should you be doing?What should you be doing? Responsibilities of those receiving pre-release Responsibilities of those receiving pre-release

accessaccess How the UK Government rules affect you How the UK Government rules affect you

Experience to date and issues that have Experience to date and issues that have

arisenarisen ConsiderationsConsiderations Where to go for help Where to go for help

Legislation - BackgroundLegislation - Background New Code of Practice applies to whole of UK New Code of Practice applies to whole of UK

but separate pre-release access but separate pre-release access arrangements in each administrationarrangements in each administration

Pre-Release Access to Official Statistics Pre-Release Access to Official Statistics (Scotland) Order 2008 came into force on 1 (Scotland) Order 2008 came into force on 1 December 2008December 2008

Applies to early access given to Ministers and Applies to early access given to Ministers and others to official statistics in their others to official statistics in their final formfinal form prior to publication.prior to publication.

Timing remains at 5 working days (1 day for Timing remains at 5 working days (1 day for market sensitive statistics)market sensitive statistics)

Procedures and compliance are now stricterProcedures and compliance are now stricter Compliance (for National Statistics) will be Compliance (for National Statistics) will be

assessed by UK Statistics Authorityassessed by UK Statistics Authority

Legislation - scopeLegislation - scope Order applies to all official statisticsOrder applies to all official statistics Order Order does notdoes not apply to early access to apply to early access to

statistics for QA purposes – this is covered statistics for QA purposes – this is covered by the Code of Practiceby the Code of Practice

QA access timing is at the discretion of QA access timing is at the discretion of the responsible statisticianthe responsible statistician

You must be able to evidence that value is You must be able to evidence that value is added by involving colleagues in QAadded by involving colleagues in QA

The QA period The QA period must notmust not be used for be used for preparing ministerial briefing preparing ministerial briefing

Legislation - purposeLegislation - purpose

To increase public trust in official To increase public trust in official statistics through greater clarity and statistics through greater clarity and transparencytransparency

Internationally recognised principle of Internationally recognised principle of equality of access to National Statisticsequality of access to National Statistics

Pre-release access on a “need to know” Pre-release access on a “need to know” basisbasis

Ensures that those who need to Ensures that those who need to comment at the time of release can be comment at the time of release can be properly informed properly informed

Arrangements across the Arrangements across the UKUK

Different arrangements for each Different arrangements for each administrationadministration

UK Government & Northern Ireland – 24 UK Government & Northern Ireland – 24 hours for all official statisticshours for all official statistics

Wales – similar to Scotland – 5 working Wales – similar to Scotland – 5 working daysdays

And now onto the practicalities….And now onto the practicalities….

When should you give pre-release When should you give pre-release access?access?

To ensure Ministers and key officials can To ensure Ministers and key officials can comment on the statistics on an informed basis comment on the statistics on an informed basis at the time of releaseat the time of release

To enable public bodies whose functions are To enable public bodies whose functions are described by the statistics to comment on an described by the statistics to comment on an informed basis informed basis

To allow Communications staff to comment on To allow Communications staff to comment on the statistical news releasethe statistical news release

To ensure related publications or other To ensure related publications or other material being prepared for release at some material being prepared for release at some time (or shortly after) are properly informed by time (or shortly after) are properly informed by the correct figuresthe correct figures

In other exceptional cases where this would In other exceptional cases where this would not damage public trustnot damage public trust

What should you be What should you be doing?doing?

Ensuring key policy and communications contacts Ensuring key policy and communications contacts are aware of new rules are aware of new rules

Ensuring recipients are told why they are given Ensuring recipients are told why they are given access and that they must only use the statistics for access and that they must only use the statistics for this purposethis purpose

Ensuring recipients are aware of their Ensuring recipients are aware of their responsibilities under the pre-release order responsibilities under the pre-release order

Marking all files relating to pre-release statistics as Marking all files relating to pre-release statistics as “ restricted”“ restricted” until the date of release until the date of release

Only sending pre-release statistics to named Only sending pre-release statistics to named individuals, not generic mailboxes. We have some individuals, not generic mailboxes. We have some exceptions in SG:exceptions in SG: Cabinet Secretaries and MinistersCabinet Secretaries and Ministers Directors GeneralDirectors General OCS Forthcoming publicationsOCS Forthcoming publications

What should you be doing? What should you be doing? – cont.– cont.

Ensuring we can justify why access is being Ensuring we can justify why access is being given and keeping a record of all recipients and given and keeping a record of all recipients and reason for accessreason for access

Reporting any wrongful disclosure to your Reporting any wrongful disclosure to your statistical Head of Profession (Breaches)statistical Head of Profession (Breaches)

The UK Statistics Authority may investigate The UK Statistics Authority may investigate possible breachespossible breaches

Responsibilities of those Responsibilities of those receiving pre-release accessreceiving pre-release access Must only use pre-release statistics for the Must only use pre-release statistics for the

purpose for which access grantedpurpose for which access granted Must not use the access for personal or Must not use the access for personal or

political gainpolitical gain Must not pass pre-release statistics on to Must not pass pre-release statistics on to

others or disclose any indication of the content others or disclose any indication of the content Must not use early access for quality Must not use early access for quality

assurance purposes as time to prepare assurance purposes as time to prepare ministerial briefingministerial briefing

Must not save to a shared area Must not save to a shared area

Responsibilities of those Responsibilities of those receiving pre-release access receiving pre-release access

– cont.– cont. Ministerial statements and policy Ministerial statements and policy

briefing on the statistics must retain briefing on the statistics must retain marking marking ““Restricted StatisticsRestricted Statistics” ” until until the time of publicationthe time of publication

Embargoed early access can no longer Embargoed early access can no longer be given to journalistsbe given to journalists

Any accidental or wrongful release must Any accidental or wrongful release must be reported to the responsible be reported to the responsible statisticianstatistician

Non-disclosure agreements (NDA) usefulNon-disclosure agreements (NDA) useful

How UK Government rules How UK Government rules affect usaffect us

Where UK Depts publish devolved statistics it is Where UK Depts publish devolved statistics it is not always clear which pre-release access rules not always clear which pre-release access rules applyapply

Depends on the type of publication. E.g.Depends on the type of publication. E.g. Joint publicationJoint publication - where we publish - where we publish

devolved statistics at the same time as UK Gov devolved statistics at the same time as UK Gov Dept publishes UK-wide statistics - e.g. Dept publishes UK-wide statistics - e.g. Income inequality and poverty statisticsIncome inequality and poverty statistics

Government CompendiaGovernment Compendia – publishing – publishing comparisons across the UK – e.g. General comparisons across the UK – e.g. General Household report on smoking and drinkingHousehold report on smoking and drinking

Where UK Government or a UK-wide body Where UK Government or a UK-wide body publishes a separate country publication publishes a separate country publication on a devolved matteron a devolved matter

Experience to date Experience to date

Some issues that have arisen:Some issues that have arisen: Pre-release access to representative Pre-release access to representative

bodiesbodies Senior Management Team (SMT) Senior Management Team (SMT)

Access to draft pages on your internet Access to draft pages on your internet

editoreditor Issues around access to management Issues around access to management

information information

ConsiderationsConsiderations

SG Pre-release access review in SG Pre-release access review in 2010 concluded that rules were 2010 concluded that rules were working well.working well.

UK Statistics Authority constantly UK Statistics Authority constantly campaign for PRA to be minimised.campaign for PRA to be minimised.

Your duty to uphold rules – minimise Your duty to uphold rules – minimise leaks leaks

For help….For help….

Guidance is available Guidance is available Please continue to contact Please continue to contact

your sponsor ASD for advice. your sponsor ASD for advice. They will pass ‘grey area’ They will pass ‘grey area’ queries to OCS. queries to OCS.

Statistical Statistical Support for Support for

Public BodiesPublic BodiesChris NewsonChris Newson

Office of the Chief Office of the Chief StatisticianStatistician

Scottish GovernmentScottish Government

Presentation OutlinePresentation Outline

Today I will talk to you about:Today I will talk to you about: The role of ASD Support Teams;The role of ASD Support Teams; The ScotStat Public Sector Analysts The ScotStat Public Sector Analysts

Network;Network; Online resources that may be of use; andOnline resources that may be of use; and The support the Office of the Chief The support the Office of the Chief

Statistician can provide.Statistician can provide.

Time at the end for any questionsTime at the end for any questions

ASD Support TeamsASD Support Teams

It is the role of analytical staff in teams It is the role of analytical staff in teams sponsoring the public body to provide sponsoring the public body to provide support and advice on compliance with support and advice on compliance with the Code of Practice for Official the Code of Practice for Official Statistics, this may cover:Statistics, this may cover: Pre Release AccessPre Release Access Preparing for product assessmentPreparing for product assessment The principals and protocols within the The principals and protocols within the

CodeCode Ministerial correspondenceMinisterial correspondence

ScotStat Public Sector ScotStat Public Sector Analysts NetworkAnalysts Network

Open to anyone from Local Government or Open to anyone from Local Government or other public bodies as well as academicsother public bodies as well as academics

No need to be an analyst by professionNo need to be an analyst by profession About sharing analytical knowledge and About sharing analytical knowledge and

experienceexperience For more information or to join please visitFor more information or to join please visit

www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork Or contact me at:Or contact me at:

[email protected]@Scotland.gsi.gov.uk 0300 244 10150300 244 1015

Network PurposeNetwork Purpose Develop mutual understanding of statistical needs and Develop mutual understanding of statistical needs and

opportunities between local authorities, public bodies and opportunities between local authorities, public bodies and Scottish Government;Scottish Government;

Consider the best means for Scottish Government to share Consider the best means for Scottish Government to share its analytical resources with other public bodies to build its analytical resources with other public bodies to build analytical capacity more widely; analytical capacity more widely;

Consider issues across public bodies in data collection in Consider issues across public bodies in data collection in order to take a strategic approach to harmonisation and order to take a strategic approach to harmonisation and efficient use of resources; efficient use of resources;

Discuss how Scottish Government statistics are used by Discuss how Scottish Government statistics are used by public bodies and how they might be improved to be of public bodies and how they might be improved to be of more benefit; more benefit;

Increase knowledge and understanding of functional issues Increase knowledge and understanding of functional issues (e.g. Scottish Neighbourhood Statistics, Sample Surveys, (e.g. Scottish Neighbourhood Statistics, Sample Surveys, Official Statistics), cross cutting themes (e.g. equality Official Statistics), cross cutting themes (e.g. equality statistics, geographical statistics) and methodological statistics, geographical statistics) and methodological issues (e.g. measuring change, reporting on targets).issues (e.g. measuring change, reporting on targets).

What the Network doesWhat the Network does The Network’s aims are met through demand-The Network’s aims are met through demand-

led local workshops and short lived working led local workshops and short lived working groups.groups.

Decisions of working groups and workshops are Decisions of working groups and workshops are made by Network members.made by Network members.

Network members contribute to arrangement Network members contribute to arrangement for workshops with support from Scottish for workshops with support from Scottish GovernmentGovernment

Workshops can be tailored to specific needsWorkshops can be tailored to specific needs The Network also aims to keep members The Network also aims to keep members

informed of related work that may be of interest, informed of related work that may be of interest, such as the Local Outcome Indicators Project.such as the Local Outcome Indicators Project.

Analysts Network Analysts Network WorkshopsWorkshops

Can cover any methodological or cross-cutting Can cover any methodological or cross-cutting issue, such as:issue, such as: Presenting dataPresenting data Using administrative sourcesUsing administrative sources Understanding the Scottish Index of Multiple Understanding the Scottish Index of Multiple

Deprivation (SIMD)Deprivation (SIMD) Using Scottish Neighbourhood Statistics (Using Scottish Neighbourhood Statistics (

www.sns.gov.ukwww.sns.gov.uk)) Or many other issues…Or many other issues…

Free to attendFree to attend Held in a variety of locations, decided by Held in a variety of locations, decided by

membersmembers Tend to have 15 to 20 attendees so they can be Tend to have 15 to 20 attendees so they can be

interactive and tailored to specific needs or issuesinteractive and tailored to specific needs or issues

Analysts Network Analysts Network WorkshopsWorkshops

All details of past workshops including All details of past workshops including materials and feedback received are materials and feedback received are available on the network website: available on the network website: www.scotland.gov.uk/analsystnetwork/Newww.scotland.gov.uk/analsystnetwork/NetworkWorkshopstworkWorkshops

Most past workshops can be re-run if Most past workshops can be re-run if there is sufficient demand from Network there is sufficient demand from Network members.members.

Currently putting together a programme Currently putting together a programme of workshops to be delivered throughout of workshops to be delivered throughout 2011.2011.

Some of the Past Some of the Past Network WorkshopsNetwork Workshops

Understanding Economic Statistics, EdinburghUnderstanding Economic Statistics, Edinburgh Contribution Analysis, AyrContribution Analysis, Ayr Interpreting the Scottish Index of Multiple Deprivation, Interpreting the Scottish Index of Multiple Deprivation,

Glasgow Caledonian UniversityGlasgow Caledonian University Forecasting and Projections, AberdeenForecasting and Projections, Aberdeen Data Access, Data Sharing and the Data Protection Act, Data Access, Data Sharing and the Data Protection Act,

KirkcaldyKirkcaldy Measuring Change and Monitoring Targets, KirkcaldyMeasuring Change and Monitoring Targets, Kirkcaldy Statistics, OrkneyStatistics, Orkney An Introduction to Understanding Data and Setting An Introduction to Understanding Data and Setting

Targets, EdinburghTargets, Edinburgh Survey Design and Analysis, Edinburgh City CouncilSurvey Design and Analysis, Edinburgh City Council Surveys, FalkirkSurveys, Falkirk Equalities Data Workshop, EdinburghEqualities Data Workshop, Edinburgh Scottish Neighbourhood Statistics, InvernessScottish Neighbourhood Statistics, Inverness

Analysts Network Analysts Network Contact DetailsContact Details

Website:Website:www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork

Email:Email:[email protected]@Scotland.gsi.gov.ukk

Phone:Phone:0300 244 10150300 244 1015

Analytical Guidance Analytical Guidance LibraryLibrary

Created by a short-lived working group of Created by a short-lived working group of the Analysts Networkthe Analysts Network

Electronic library of analytical guidance Electronic library of analytical guidance material material

Covers a magnitude of topic areas:Covers a magnitude of topic areas: Confidence intervalsConfidence intervals EthicsEthics ModellingModelling Statistical Process ControlStatistical Process Control

www.scotland.gov.uk/Topics/Statistics/scotwww.scotland.gov.uk/Topics/Statistics/scotstat/analystsnetwork/AnalyticalGuidanceLstat/analystsnetwork/AnalyticalGuidanceLibraryibrary

Methodology GlossaryMethodology Glossary Quick reference materials for specific Quick reference materials for specific

analytical techniquesanalytical techniques No previous understanding required, No previous understanding required,

covers different levels (Tiers 1, 2 and 3?)covers different levels (Tiers 1, 2 and 3?) Will be further developed soon to include Will be further developed soon to include

a “How Do I…” section linking all papers a “How Do I…” section linking all papers related to a specific technique.related to a specific technique.

Will be adding a glossary of key statistical Will be adding a glossary of key statistical termsterms

www.scotland.gov.uk/Topics/Statistics/Abowww.scotland.gov.uk/Topics/Statistics/About/Methodology/Glossaryut/Methodology/Glossary

One-to-one and Hands-One-to-one and Hands-on Analytical Supporton Analytical Support

Available from the Office of Available from the Office of the Chief Statisticianthe Chief Statistician

What other support can What other support can we offer?we offer?

Statistical Support for Public Bodies Statistical Support for Public Bodies Branch in the Office of the Chief Branch in the Office of the Chief StatisticianStatistician Methodological QuestionsMethodological Questions Advice or ‘sounding board’ for analytical Advice or ‘sounding board’ for analytical

projectsprojects May be able to be involved in Local projectsMay be able to be involved in Local projects

[email protected]@Scotland.gsi.gov.uk [email protected]@Scotland.gsi.gov.uk 0300 244 10150300 244 1015

Example IExample I Involvement in a working group looking at data Involvement in a working group looking at data

availability within a Community Planning availability within a Community Planning Partnership (CPP) areaPartnership (CPP) area

Offering critical friend and challenge roleOffering critical friend and challenge role Information on data suitability and availabilityInformation on data suitability and availability Liaise with colleagues in SG on specific topicsLiaise with colleagues in SG on specific topics Helped in the production of a report setting out Helped in the production of a report setting out

the current state of play in the CPP to assist in the current state of play in the CPP to assist in identifying priority areas of concern for the identifying priority areas of concern for the futurefuture

This developed the relationship we have with This developed the relationship we have with the CPP which is beneficial for both partiesthe CPP which is beneficial for both parties

Example IIExample II Methodological advice and assistance on hypothesis Methodological advice and assistance on hypothesis

testingtesting A colleague in Local Government was interested in A colleague in Local Government was interested in

analysing survey results by equalities characteristics and analysing survey results by equalities characteristics and wanted to test for association between variableswanted to test for association between variables

We provided advice on most appropriate test to use for We provided advice on most appropriate test to use for this casethis case

Developed a detailed how to guide that became part of Developed a detailed how to guide that became part of the methodology glossarythe methodology glossary

Provided further assistance to review the approach taken.Provided further assistance to review the approach taken. In the end because of the sample size it was difficult to In the end because of the sample size it was difficult to

use this technique however, we were still able to provide use this technique however, we were still able to provide advice on the analysis and interpretation of the survey advice on the analysis and interpretation of the survey resultsresults

Any Questions?Any Questions?

Check out the Network website:Check out the Network website:www.scotland.gov.uk/analystsnetworkwww.scotland.gov.uk/analystsnetwork

If you think of anything later, feel free to If you think of anything later, feel free to contact us:contact us:

[email protected]@Scotland.gsi.gov.uk0300 244 10150300 244 1015

Introduction to Official Statistics

becoming National Statistics

Janette Purbrick Office of the Chief Statistician

Thursday 24th February 2011

Some common labels:

• Data being developed (aka experimental statistics) – published output but not ‘fit for purpose’. Useful way to

shape an output by getting user views/feedback

• Official Statistics – Minister has agreed Scope. Deemed ‘fit for purpose’

• National Statistics– Subset of ‘Official Statistics’ certified as Code compliant by

UK Statistics Authority

• Provisional results– published OS or NS with pending planned revisions to make

final results

Assessment and Designation

Two routes

• Section 12 of Act – Producer body requests that an output is assessed

• Section 16 of Act – The Authority invokes the assessment of an output

Process of Assessment

Four main stages

• Written Evidence for Assessment

• Assessment Report

• Reporting Back

• Designation as a National Statistic

Our experience

• Authority very fair throughout the process

• Brings the Code of Practice and PRA Order to life

• Driving up statistical standards

• Independent scrutiny adds value to the statistics – impetus for change

Reflections from SG assessees

• Clear that documentation is key to demonstrating good practice

• Time consuming process but not difficult• Overall process was really helpful• A valuable way of self-assessing your products• Makes it easier for us to form an action plan for

improvement to strengthen product• Pre-release Access Order • Know more about our products than before -

specifically aware of products strengths/weaknesses against the Code of Practice

What you can do to get ready..

NOW…..look at output WEFA for your products• Can you answer all the questions in the WEFA?• For each question are you:

– confident– partially confident– not confident ….of meeting the Code?

• What documentation do we have/need?• Ensure you have relevant documentation

(stakeholder lists/individuals with pre-release access/stakeholder consultation material/changes to methodology etc).

• Publish where applicable• Start now…save time later!

The role of the UK Statistics Authority

Neil Jackson

Official Statistics - New Producers’ Seminar

24 February 2011

Coverage of presentation

• Background to establishing the Authority

• The Monitoring Function

• Assessment function

• The Impact of Assessment

ONS Omnibus, 2007

 

Figures are generally accurate

Figures are produced

without political

interference

Government uses

figures honestly

% % %

Agree 36 20 16 Neither agree

nor disagree 31 23 26

Disagree 33 57 58

Base = 100% 1112 1112 1112

Views about official statistics in general

EU Eurobarometer 2007

Do you trust official statistics?

Tend to Trust Tend not to trust DK

UK Statistics Authority

• Authority established by the Statistics and Registration Service Act, 2007

• to promote and safeguard the production and publication of official statistics that serve the public good

• A non-ministerial Department – overseen by Parliament, not a Government Minister

• Authority’s responsibilities extend to the whole of the UK - England, Wales, Scotland and Northern Ireland

Monitoring and Assessment Functions

• The Board is to monitor the production and publication of official statistics

• The Board is to prepare, adopt and publish a Code of Practice for Official Statistics

• Assess and determine whether the Code of Practice has been complied with

What the Authority is aiming to achieve

• Right statistics – the statistics produced are of greatest relevance and importance

• Right standards – in line with a formal Code of Practice

• Right explanation – well communicated and explained, including strengths and weaknesses – to support decision-making

Monitoring Function

• Issues Log

• Correspondence

• Monitoring Reports

• Monitoring Briefs

Monitoring Briefs

• Volatility of the Retail Sales Index

• Knife Crime Statistics

• Release on UK Born and non-UK Born Employment

• Gender Pay Gap

• Discussion of Trends in Violent Crime

• Scotland's Major Population Surveys

• Communicating Inflation

• Improving the reporting of road casualties

Aims of Assessment

• to help the producers of official statistics to enhance the quality of the statistical service over a period of time

• to communicate to Parliament and the public the extent of compliance with the Code

Designation

Statistics…

• Meet identified user needs

• Are produced, managed and disseminated to high standards

• Are well explained.

Published Assessment Reports

Scottish Government 14

Information Services Division 5

Northern Ireland 8

Welsh Assembly Government 8

UK Government Departments 33

Office for National Statistics 19

Other 9

Total 96

Distribution of Requirements by Principle

0 20 40 60 80 100 120 140 160 180 200

Frankness & accessiblity

Meeting user needs

Sound methods

Release practices

Impartiality and Objectivity

Use of admin sources

Confidentiality

Resources

Proportionate burden

Integrity

Typical Requirements

• Take steps to develop a greater understanding of the use made of the statistics and publish the relevant information

• Provide more information about the quality of the statistics, including relevance and accuracy

• Provide additional commentary and analysis that aid interpretation; and provide factual information about the policy and wider context of these statistics

Emerging Findings

• Need for more systematic engagement with users• Needs a clearer understanding of the uses made of

official statistics • Better documentation of strengths and weaknesses

of statistics in relation to their uses• Scope to enhance the presentation of the statistics

and the accompanying commentary

ISD User Engagement

• An enhanced user / customer survey

• A revamped website that will allow users to provide feedback on individual statistical releases

• Seek feedback from users who have recently requested information and publish a summary of the results (currently being piloted).

• Publish web links to the minutes of steering / reference group meetings, or make these minutes available on request.

NHS Information Centre Mental Health Statistics

‘It is not clear why there has been a decrease in formal admissions to independent sector hospitals. It could be due to the NHS commissioners sending fewer patients to independent sector hospitals to reduce costs. Other possible explanations could be that there are more NHS beds available due to admitting fewer informal patients’

Impact of assessment

• Enhancing producers’ understanding of the use made of their statistics;

• Improving producers’ engagement with users of statistics outside their own organisations; and

• Improving the quality and accessibility of statistical releases – the ‘shop window’ of the statistical service

A statistical system that is more demonstrably trustworthy

• the Authority’s various public interventions have reminded Parliament and the public that the statistical service is independently regulated;

• the position of statistics professionals working in departments has been strengthened, in response to this regulatory environment.