Smart Grid Data Hub -
9
1 Smart Grid Data Hub Instructions for Data Submission Manual Upload Overview This document describes how projects funded under the Smart Grid Investment Grant (SGIG) and Smart Grid Demonstration Projects (SGDP) programs can manually submit their metrics and benefits data. Login ID and Password As a user of the system you will be given an account and system credentials once your Metrics and Benefits Reporting Plan (MBRP) is approved. Your credentials are comprised of a login ID and a password. • IDs will be assigned and sent via e‐mail to the prime project contact upon completion of the MBRP. • The prime contact can request that others be added to the approved list. • IDs will be given to these additional people via e‐mail. • Users can create their own passwords once IDs are provided. Your account is associated with one or more projects. You will only be able to upload and view data associated with your projects. If you are the prime contact for your project and do not have your system credentials, you may request an ID and password by sending an email to project‐[email protected] . Data Submission Process Overview The general process for data submission is: 1. The data are collected and recorded in the data submission form downloaded from the appropriate submission record in the Data Hub via the Action button. (Note: The Action button is a recently implemented enhancement to the Data Hub and replaces the links used previously.) 2. The data are uploaded to the Data Hub using the Action button for the appropriate submission record. As the data are uploaded they are checked for basic form errors such as missing required data, letters in number only fields, etc. Submissions that do not pass the check are not accepted. 3. Once the data are received by the Data Hub, they are in a “Submitted” state. A reviewer will screen the data to ensure that it is reasonable. For example if your project only has 10,000 households but your data show that you installed 100,000 meters, the reviewer would flag it as a potential error and ask for clarification.
Transcript of Smart Grid Data Hub -
1
SmartGridDataHubInstructionsforDataSubmission
ManualUpload
OverviewThisdocumentdescribeshowprojectsfundedundertheSmartGridInvestmentGrant(SGIG)andSmartGridDemonstrationProjects(SGDP)programscanmanuallysubmittheirmetricsandbenefitsdata.
LoginIDandPasswordAsauserofthesystemyouwillbegivenanaccountandsystemcredentialsonceyourMetricsandBenefitsReportingPlan(MBRP)isapproved.YourcredentialsarecomprisedofaloginIDandapassword.
• IDswillbeassignedandsentviae‐mailtotheprimeprojectcontactuponcompletionoftheMBRP.
• Theprimecontactcanrequestthatothersbeaddedtotheapprovedlist.• IDswillbegiventotheseadditionalpeopleviae‐mail.• UserscancreatetheirownpasswordsonceIDsareprovided.
Youraccountisassociatedwithoneormoreprojects.Youwillonlybeabletouploadandviewdataassociatedwithyourprojects.Ifyouaretheprimecontactforyourprojectanddonothaveyoursystemcredentials,youmayrequestanIDandpasswordbysendinganemailtoproject‐admin@smartgrid.gov.DataSubmissionProcessOverviewThegeneralprocessfordatasubmissionis:
1. ThedataarecollectedandrecordedinthedatasubmissionformdownloadedfromtheappropriatesubmissionrecordintheDataHubviatheActionbutton.(Note:TheActionbuttonisarecentlyimplementedenhancementtotheDataHubandreplacesthelinksusedpreviously.)
2. ThedataareuploadedtotheDataHubusingtheActionbuttonfortheappropriatesubmissionrecord.Asthedataareuploadedtheyarecheckedforbasicformerrorssuchasmissingrequireddata,lettersinnumberonlyfields,etc.Submissionsthatdonotpassthecheckarenotaccepted.
3. OncethedataarereceivedbytheDataHub,theyareina“Submitted”state.Areviewerwillscreenthedatatoensurethatitisreasonable.Forexampleifyourprojectonlyhas10,000householdsbutyourdatashowthatyouinstalled100,000meters,thereviewerwouldflagitasapotentialerrorandaskforclarification.
2
4. Thereviewereitheracceptsthedataorreturnsthesubmissiontotheuserforclarificationorcorrection.Ifthedataisreturnedtotheuserina“reviewed”state,theusermustmakethecorrectionanduploadthedataagain(Step2).
5. OncethereviewerhasacceptedthedataitbecomesavailableintheDataHubreportingstructure.Inmostcasestheprocessstopshereandnofurtheractionisrequiredbytheuserforthegivensubmission.
6. Ifsomeoneonyourprojectteamfindserrorsinthereporteddata,contactthereviewerandrequestthatthesubmissiontobeplacedinthe“Reviewed”status(seeStep4).Movingasubmissiontothe“Reviewed”statusenablesyoutore‐submitthecorrecteddataforagivensubmission.
PossibleSubmissionStatesAsubmissionisinoneoffivepossiblestatesdependingonwhereitisintheprocess:
• PendingSubmission–Therehasbeennodatasubmitted.• Submitted‐‐Datahavebeensubmitted,havepassedanautomaticcheckforerrorsand
omissions,andisreadytobereviewed.• Reviewed‐‐Thereviewerhascheckedthedataforinternalconsistencyandhasreturnedthe
datatotheuserforclarificationorcorrection.• PartiallyAccepted–Thereviewerhascheckedthedataforinternalconsistency,anddecidedto
acceptsomeofthedatametricsforanalysis.Othermetricsinthesubmissionarenotreadyforacceptanceyet.Thisstateonlyappliestoimpact_semiannuallysubmissions.
• Accepted‐‐Thereviewerhascheckedthedataforinternalconsistencyandreviewerquestionshavebeensatisfactorilyaddressedbytheprojectteam.Thedataisreleasedforanalysis.
Note:Ausermayonlysubmitdataifthesubmissionisinthe“PendingSubmission”or“Reviewed”state.Thedatamaynotbemodifiediftheyareclassifiedas“Submitted”or“Accepted.”
InitialSetupWhenyoufirstreceiveyoursystemcredentials,youmustlogintothesystemandchangeyourpassword.
1. Openyourbrowser.2. Gotohttps://projects.smartgrid.gov/.Theloginpagewillbedisplayed.
Figure1:Loginscreen.
3
3. Enteryourcredentialsandclickthe“Submit”button.Thescreenwillthenrefreshanddisplaytheuserconsole.
Figure2:UserConsoledisplay.
4. Clickthe“Settings”linkintheupperrightcornerunderneaththeSmartgrid.govlogo.5. Enteryourinformationandupdatethe“CurrentPassword”,“NewPassword”and“Confirm
Password”fieldsandclick“Submit”.
Figure3:“UserSettings”dialogboxwithsampleinformation.
6. Ifthechangewassuccessful,youwillseea“SettingsSaved”message.7. Iftherewasanerror,amessagewillbedisplayed.Correcttheerrorandclick“Submit”again.
Whenyouhavecompletedthepasswordchange,yourinitialsetupiscompleted.
4
SubmittingMetricsandBenefitsDataThefollowingsectionsdescribethevariousroutesthroughthesubmissionprocess.
GatheringPreliminaryInformationBeforeyoubegin,makesureyouknowthefollowingdetails:
• The“ProjectID”foreachprojectonwhichyouarereporting:ProjectIDswillbeprovidedwithyourloginIDandpassword.IfyoudonotknowyourprojectID,pleasecontacttheprogramadministratoratproject‐[email protected].
• The“DataType”forthedatayouaresubmitting.DatatypesarelistintheprojectMBRP.Buildandimpactaretwoexamplesofdatatype.
• The“PeriodEnd”dateforthesubmission.PeriodenddatesarespecifiedintheMBRP.OneexampleistheJanuary‐March2012quarter.
LogIn1.Openyourbrowser.2.Gotohttps://projects.smartgrid.gov/.Theloginpagewillbedisplayed.3.Enteryourcredentialsandclick"Submit"Theuserconsolewillbedisplayed.4.Locatethesubmissionthatyouwanttofile.
LocatetheSubmissionTheuserconsolewilldisplayalistofthesubmissionsfortheproject(s)youareassociatedwithsimilartothelistshowninFigure4.
Figure4:Submissiontableintheuserconsole.Locatethesubmissionyouwanttofile.VerifythatithasthecorrectTitle,DocumentType,andPeriodEnddate.Verifythatitisin"PendingSubmission"or"Reviewed"status.Ifthesubmissionisnotin"PendingSubmission"or"Reviewed"status,youwillnotbeabletouploadyourdata.
5
Columnsinthesubmissiontablecanbefilteredandsortedtohelptheuserfindthesubmissionofinterest.InFigure4,therecordsinthesubmissiontablehavebeensortedindescendingorderby“SubmittedOn”date(columnheadinghighlightedinblue),andfilteredtoshowonlybuildsubmissions(“DocumentType”fieldhasbeenpopulatedwiththeword“build”.)Itisimportanttonoteherethatfilterargumentsarecasesensitive.Onceyouhavelocatedthesubmissionrecordofinterestfromthelistpresentedinthesubmissiontable,youcanchoosetoeithersubmityourdatainaPDFformoranXMLdocument.
PDFSubmissionThePDFoptionpresentsyouwithadownloadableformtofilloutandsubmit.YouwilldownloadaPDFfile,fillitout,andsubmitittothesystem.ThePDFoptionrequirestheAdobeAcrobatReader(orasimilartool)beinstalledonyourcomputer.TheAdobeAcrobatReadermaybedownloadedathttp://get.adobe.com/reader/.OnceyouhavelocatedthesubmissionthatyouwanttofileandverifiedtheStatusandPeriodEnddate:
1. ClickontheActionsbuttonforthesubmissionyouareworkingon,andselectthe“DownloadData”actionfromthedropdownmenuthatappearsundertheActionsbutton.
Figure5:SelectingDownloadDataactionviatheActionbutton.
2. OpenthePDFwiththeAdobeAcrobatReader.3. FilloutalltherequiredfieldsinthePDFdocument4. SaveandclosethePDFdocument.
Youmaysaveandclosethedocumentasoftenasyouwish.Youmaypassthedocumentontoothermembersofyourteamtocompleteifyoudonothaveallthenecessarydata.Onceallthedatahasbeenenteredyoucanuploadthedataeitherbyusingtheembedded"Submit"buttoninthePDF,orbyusingtheUploadActionintheDataHub.
6
SubmittingthePDFUsingtheEmbeddedSubmitButtonTosubmitthedatafromanopenPDFdocument,usethe"Submit"buttonembeddedinthePDFdocument:
1. OpenthePDFusingAdobeAcrobatReader.2. Scrolldowntothelastpage.Youmaywanttoverifythatthedatainthedocumentarecorrect.3. Clickthe"Submit"buttonatthebottomofthelastpage.4. ThePDFdocumentwillcheckformissingdataandothererrors.Ifanyerrorsarereported,fix
theminthedocumentandrepeatstep5. Iftherearenoerrorsyouwillbeaskedforyourusernameandpassword.6. ThePDFwillbesubmittedtotheDataHub.TheDataHubwillthenverifythatthesubmission
needstobefiledandthatthesubmitteddataareofthecorrectform(e.g.;numbersarelistedinnumberfields,datesarelistedindatefields,etc.)
7. Ifthereareerrors,AdobeAcrobatReaderwilldisplayanewPDFdocumentdescribingwhattheerrorsare.SwitchbacktothesubmissionPDF,correctthedataerrorsandclickontheSubmit”buttonatthebottomoftheform(Step4).
8. Iftherearenoerrors,AdobeAcrobatReaderwilldisplayanewPDFdocumentthatreads"CreatedSubmission:"followedbyanumber.
9. Thestatusofthesubmissionwillautomaticallychangeto"Submitted"intheDataHub.Atthispointyouhavesuccessfullysubmittedthedataandmaylogoutorsubmitmoredataforyourproject(s).YoumaysaveandclosethesubmissionPDF.SubmittingthePDFUsingtheUploadActionintheDataHubTouploaddatafromasavedPDFfileonyoursystem:
1. LogintotheSmartGridDataHub.2. Locatethesubmissionrecordforwhichyouwanttofile.3. ClickontheActionsbuttonforthesubmissionrecordyouarereadytofile.Selectthe“Upload”
optionfromthedropdownmenuthatappearsundertheActionsbutton.
Figure6:UserconsoledisplaywithUploadactionindicated.
7
4. TheDataHubwillpresentadialogboxsimilartotheoneshowninFigure7.Clickonthe“Select
Submission”buttoninthedialogbox.YoursystembrowserwillopenawindowandallowyoutoselectthePDFfilefromyoursystem.Forimpactsubmissions,theuserwillalsobeaskedifthedatainthesubmissionneedstobemarkedcommerciallyvaluable.ThisnewaspectofthedialogboxisaDepartmentofEnergyrequirementthatwillbeusedtoclassifyimpactmetricdataintheeventofaFreedomofInformationAct(FOIA)requestfordatageneratedbytheSGIGandSGDPprojects.
Figure7:SelectingthePDFfiletoupload.
5. OnceaPDFfilehasbeenselectedforsubmission,thenameofthefilewillappearinthedialogboxnextto“SelectedSubmission:”andtheSubmitbuttonwillbecomeactivefortheuser.
6. ClicktheSubmitbuttoninthedialogbox.AprogressbarwillindicatetheprogressoftheuploadprocesstotheDataHub.Itisimporttonotethatlargefilesmaytakeseveralminutestoupload,dependingonyourinternetconnectionspeed.
7. Ifthereareerrors,youwillseeanerrordialogboxthatdescribestheerrors.Tocorrecttheerrors:
a. OpenthePDFdocumentwiththeAdobeAcrobatReader.
8
b. Correctthedatainerror.c. Savethedocument.d. Returntostep3tosubmittheupdatedPDFfile.
8. Iftherearenoerrorsyouwillseeadialogboxthatsays"SubmissionSuccessful".9. Thestatusofthesubmissionwillautomaticallychangeto"Submitted"intheDataHub.
Atthispointyouhavesuccessfullysubmittedthedataandmaylogoutoruploadmoredataforyourproject(s).
XMLSubmissionTheXMLsubmissionprocessisintendedforuserswhohaveastrongunderstandingofXMLdocumentcreationandvalidation.ThisdocumentdoesnotcoverthespecificsofcreatingandvalidatingXMLdocuments.StartbydownloadingtheXMLSchemaDocument(XSD).TheXSDisusedtovalidatetheXMLdocument.Inaddition,itisusedbysometoolstoassistinthecreationoftheXMLdocument.
1. ClickontheActionsbuttonforthesubmissionyouareworkingon,andselectthe“DownloadValidation”actionfromthedropdownmenuthatappearsundertheActionsbutton.ThiswilldownloadtheXSDfiletoyoursystem.
Figure8:Userconsoledisplaywith“DownloadValidation”actionindicated.AtthispointyouwilllikelylogoutoftheSmartGridDataHubwhileyoucreateyourXMLdocumentusingtheXSDfileandyourXMLeditingprogram.(Theprocesstocreateandvalidatesuchadocumentisbeyondthescopeofthisdocument.)OnceyourXMLfileiscreatedandsaved,contactproject‐[email protected].
CorrectingErrorsOccasionallyasubmissionwillbereturnedbyareviewerforfurtherclarificationorcorrection.Areviewermayreturnasubmissionforanynumberofreasonsrelatedtodataqualityand
9
reasonableness.Whenthereviewerreturnsthesubmission,heorshewillexplainwhythesubmissionwasreturned.Returnedsubmissionshaveastatusof"Reviewed."Tolocatesubmissionswithissues:
1. LogintotheSmartGridDataHub.2. IntheentryfieldatthetopoftheStatuscolumnintheSubmissionstable,keyintheword
“Reviewed”.ThesubmissionswillbefilteredtoshowonlythesubmissionsintheReviewedstatus.Itisimportanttonoteherethatfilterargumentsarecasesensitive.
Figure9:Userconsoledisplayfilteredtoshowsubmissionswitha“Reviewed”status.
3. The"Notes"columnandcorrespondencefromthereviewerwillspecifytheissueswiththesubmission.
4. ClickontheActionsbuttonforthesubmissionyouareworkingon,andselectthe“DownloadData”actionfromthedropdownmenuthatappearsundertheActionsbutton.OpenthePDFwithAdobeAcrobatReader.
5. Correctthefieldsthathaveissues.6. Re‐submitthePDFusingoneofthePDFsubmissionmethodsdetailedabove.
