ICEGOV2016,Montevideo,Uruguay

OpenBudgetFormat:IssuesonDevelopmentofSpecificationandConverterImplementation

OlgaParkhimovich,VitalyVlasov

1

Outline• OpenFinanceDatainRussia• Reasons• BudgetprocessinRussia• Projectscope• Approach1.UsingOpenSpending• Approach2.OpenBudgetFormat• ConverterandBudgetDataValidator• Usecase:Othercountries• Usecase:MunicipalbudgetsofSt.Petersburg,Russia• Futurework

2

WhatisOpenFinanceDatainRussia?

3

Budgets datasets

Contracts

Financial Reports

3 budget levels

4 budget stages

> than 23 000 local authorities

at least 4 versions

> 92 000 datasets per year

> 17 000 000 from 2011 year

2 budget levels

Monthly, Quarterly, Annually

> 1 100 datasets per year

WhatisWrongwithBudgetData?

4

St. Petersburg (Russia) Milton Keynes (UK)

meta-data without data data without meta-data

not machine-readable format

complex and frequently changing classifiers no codes

errors and misspelling

WhatisWrongwithBudgetData?

5

Name Target costs Type of costs

Section, subsection Amount

1 Total 76 591 596,0

2 State Program «Public Health» 51 0 0000 13 388 576,1

3 Subprogram «Primary health care» 51 1 0000 601 242,0

4 Costs for the operation of state-owned public institutions 51 1 0016 169 453,3

5 Wage fund of state-owned institutions and contributions for compulsory social insurance 51 1 0016 111 135 922,3

6 Ambulatory care 51 1 0016 111 0902 135 922,3 budg

et it

em

CurrentStructureofBudgetFile

6

Code of the chief

administrator of budget

funds

Section code

Subsection code

Code of the target articleType of

costs code

Government Operations

codeProgram

code

Subprogram code

Spending priorities code

1 2 3 4 5 6 7 8 9 10 11 12 13 14 15 16 17 18 19 20

Budgetclassificationcode

Reasons

• Highinterestamongauthoritiesinmakingbudgetmoretransparentandreusable

• Currentbudgetprocessisinefficient• Problemsofusingcurrentformat• Citizensneedtoknowhowtheirtaxesarespent• Civilsocietyshouldengageinallstageinthebudgetprocess

7

ProjectScope

8

•Goal:tomakebudgetdatasimpleandusefulfordevelopersandcitizens

•Tasks:•analyseexistingapproaches• implementationofinternationalmethodsfortheRussiandata

•developinitialstandardandspecificationofOpenBudgetFormat(OBF)version1.0

•measurebudgetdataqualityandcheckonlocalevel

Approach1.UsingOpenSpending

9

• Popularplatformforpublicationoffinancialinformation:https://openspending.org/

• Budgetitemsarepresentedasrowswithvaluesofdifferent«dimensions».Dimensionscouldbeorganizedingroupsandfacetsforbettervisualization

• OpenRefinetoolhasbeenusedtopreparedataforOpenSpending.

https://openspending.org/russianbudgets/

DimensionsUsingofOpenRefine

Problems with OpenSpending:

• Current budget format could not be imported directly (without preparation)

• Specific requirements for Open Spending

Solution:

• Automation of preparing budget file with Open Refine tool.

Implementation

Pros: • System is ready to use • Visualization tool • Budget items are interlinked

Cons: • This is proprietary format. Open Spending is

just one of systems and like «Microsoft» in the world of financial data (like XLS vs. CVS).

• Government is not ready to put data into third-party services.

• This data format could not be used for interoperability for government needs.

We suggest another way: • Our approach is not software but proposal of Data

Format which could be applicable for different systems.

• Government can use this format as they want and integrate in their own systems.

• Easy to use for exchange information and building new services (official government services or citizen apps)

Budget item page

Program

Name

Code

SubProgram

Code

Name

……

See example of "budget item" page in Open Spending

Budget Code

betaversionofLeningrad’sbudgetforcitizenswebsite:lenobl2014.ru

• Include best practices of the existing standards (e.g. SDDS

1 of IMF

2, Open

Contracting 3, Open Spending)

• Compatible with Data Packages4.

• Based on text formats (JSON, CSV, XML)

Approach2.OpenBudgetFormat

11

JSON CSV XML

Data package4

SDDS1

OCDS3

XLS5

Compatibility

Versioning

Versality

Scalable

Current budget formats

Text formats

Key characteristics

1 SDDS - Special Data Dissemination Standard

(http://dsbb.imf.org/Pages/SDDS/home.aspx) 2 IMF - International Monetary Fund

3 OCDS - Open contracting Data Standards by

Web Foundation (http://ocds.opencontracting.org/standard/r/0__3__2/.html) 4 http://dataprotocols.org/data-packages/

5 XLS - current Russian standard of budget

Versality Simple, general and universal, represent the budgets on different levels.

Good for automation Convenient for automatic processing and clear, if necessary for editing (converting) it by user.

Scalable Ability to use to represent any budgets in other countries too.

Versions support It is necessary to be able to specify different versions of the budget.

Integrated. Compatible with other budget formats

Easy for integrating with other existing formats such as Open Spending, Open Contracting Data Standard and Budget Data Package.

Friendly and intuitiveIn connection with trend of publishing «budgets for citizens» and «open budget» by governments it is necessary to have such version of OBF (readable both for machines and people).

Approach2.OpenBudgetFormat.KeyCharacteristics

12

BasicDatamodel

13

Budget Item

id amount

Admin

name

code

Classification

name

code

code version

period

region

date

type

stage

level

attribute object

Budget item is a peace of budget information which must be identified by time (financial year or other period), one amount, government organization and purposed

Name Avaliable types Mandatory Description

itemId string required Unique ID of item in current data set. May include numbers, etters, special symbols

version string required Version of budget doc, see details below. Could be «final» or Number

docVersion number required Last version of document

level enum required "national" (N), "regional" (R), "municipal" (M)

country string required Code of Country (RU, US, etc)subject string required Name of City, Region or Country, depends on level

dateCreation date-time required Date when current budgetItem has been createddateChanged date-time required Date when current budgetItem has been changed

tag enum required "expenditures", "income"

stage enum required"Proposal", «approval", "adjustment", «execution", "amendment". Any additional comments could be included in comments section.

lang string required Current language of documentcomment string optional For example reference to law

Implementation.MetaDataFieldsinOBF

14

Name Avaliable types Mandatory Description

budgetItemCode string required National budget classification or code system (in Russia Code of Budget Classification)

budgetItemName string required Name of budget item

adminName string required Name of organization that carries out operations with current budget item

adminCode string required Code of organization

amount number required Amount of budget item

currency string required Currency of country or operation

RequiredDataFieldsinOBF

15

Extended data model

Country-specificdatamodel(Russia)

16

Basic modelAdmin Classification

attributes

GRBS Program

SubProgram

Section

GovOper

SubSection

SpendingType

Article

Anycountrycanextendbasicmodelandbuildownspecific.

Versioning

17

•Mechanismofupdatingcurrentfile(«U»,update)

•Eachversionhasownfile(«F»,files)

• Infoaboutstagesofbudget(«S»,stages)

U-,US-,F-,FS-versions

CSVversionofOBFv1.0

18

•Alldataispresentedasrows•Firstrowsshouldcontainnamesoffield•Allareasoffieldsshouldbepresentedforeachrow

•U,US,F,FS-versionscouldbeimplemented

{ “budgetItem” : { “itemId” : “121299”, “version” : “final”, “docVersion” : “1”, “level” : “R”, “country” : “RU”, “subject” : “Leningrad Region”, “dateCreation” : “16-09-2014 13:14:13”, “dateChanged” : null, “tag” : “income”, “stage” : “execution”, “lang” : “ru” } }

<metadata>

<level>R<level> <country>RU</country> <subject>Leningrad Region</subject> <lang>ru</lang> </metadata> <items>

<budgetItem>

<itemId>121299</itemId> <version>final</version> <docVersion>1</docVersion> <dateCreation>16-09-2014 13:14:13 </dateCreation> <tag>income</tag> <stage>execution<stage> </budgetItem> </items>

{ "type": "budgetItem", "properties": { "itemId": { "type": "string" }, "version": { "type": "string" }, "docVersion": { "type": "number" } "level": { "type": "string", "enum": ["N", "R", "M"] } ... },

JSON Schema

A piece of data

Example of XML data

JSONview&XMLview

19

ConverterandBudgetDataValidator

20

•WecreatedalgorithmthatcancleanandextractonlyvaluabledatafromRussianbudgets.

•Validatorcanbuilddatamodelandfindmistakesinfile.http://validator.citizenbudget.ru/

Just upload file (XLS / XLSX)

See report about data and errors.

Usecase:Othercountries

21

• BasedonBOOSTWorldBankprojectdataforArmenia

"BudgetItem" : {"NationalId":"4111-010101-1","Period":"2006","Amount":335071800.00,"Level":"N","Admin_Name":"Staff of President of RA","Admin_Code":"101001","Classification_Econ1Name":"Running expenses","Classification_Econ1Code":"4000","Classification_Econ2Name":"Payment for labor","Classification_Econ2Code":"4100","Classification_Econ3Name":"Salaries and additional

payments paid in drams","Classification_Econ3Code":"4110","Classification_Econ4Name":"Salaries and additional

payments of employees","Classification_Econ4Code":"4111","Classification_Func1Name":"General public services","Classification_Func1Code":"01","Classification_Func2Name":"Legislative","Classification_Func2Code":"0101","Classification_Func3Name":"Legislative and

executive bodies, public administration","Classification_Func4Code":"010101","Classification_ExpTypeName":"Personnel","Classification_ExpTypeCode":"1",

}

Sourcedata(XLS)

ExportedinOBF

Structureofbudget(BOOST)

Admin

Classifications

Usecase:MunicipalbudgetsofSt.Petersburg,Russia

22

Wecollecteddatafrom111municipalitiesofSt.Petersburg.Analyzethem,structureandmapbyqualityofdatainformation.Onlywell-structuredbudgetsarevaluable.

RatingofOpennessandQualityofBudgets

Rate 2014 2015AAA OBF, CSV, RDF OBF, CSV, RDFAA xls xlsA other/XLS XLS/other

BBB doc docBB other/doc doc/otherB pdf/html pdf/html

CCC -/pdf pdf/-CC image imageC no no

Youcanfindmoreonposterexhibition.

Conclusions&FutureWork

23

•WecanconvertandvisualizetheRussianbudgetforlessthanthreehours,andexplainthisprocesstotheordinarycitizenorofficial

•WehavethefirstversionofOpenBudgetFormat•WiththeOpenUniversity(UK)wearedevelopingOpenFinanceOntologytomodelfinancelinkeddata

•Futurework:•comparisonofbudgetsandgovernmentcontracts•moreusefulvisualizations

• Projectweb-site:http://openfinances.org/

Contacts

OlgaParkhimovich,olya.parkhimovich@gmail.com,

@OpenDataRu

VitalyVlasov,inxaoc@gmail.com, @inxaoc

24

KEEPCALMANDTRYTORESEARCHBUDGETDATA

ICEGOV2016,Montevideo,Uruguay