Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the...

17
Nov 18 2013 Nov 18 2013 Enhancing HST Spectral Products Alessandra Aloisi & “HST Spectroscopic Legacy Working Group”

Transcript of Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the...

Page 1: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

EnhancingHSTSpectralProducts

AlessandraAloisi

&

“HSTSpectroscopicLegacyWorkingGroup”

Page 2: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

Introducingthe“HSTSpectroscopicLegacyWorkingGroup”

•  TheHSLWGwasformedtostudytherecommendaBonsstemmingfromthe“EnhancingtheLegacyofHSTSpectroscopy”WorkshopheldatSTScIonNov15‐16,2012.

•  PrimaryGoalsoftheHSLWG:-  OpBmizeHST'simpactoncurrentandfuturespectroscopicresearch

(bothnewandarchival)byidenBfyingthemostproducBveandfeasible(inbothatechnicalandresources‐requiredsense)archivalimprovementsfromthesuggesBonsgeneratedbytheWorkshop,fordevelopmentandimplementaBonwithina2yearhorizon.

-  EnsureintheprocessthattheHSTfinalarchivewillhavethequality,content,andtoolstosupportneedsofthesciencecommunityunBlnextUV/opBcalspectroscopicmissionislaunched,adecadeormoreinthefuture.

11/18/13 2

Page 3: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

OverviewoftheProcess

•  Membershipofthegroupisasfollows:AlessandraAloisi(chair)JerryKrissAzaleeBostroemCris8naOliveiraKenCarpenterRachelOstenStefanoCasertano(co‐chair)LouStrolgerScoCFlemingJeffValen8AndrewFoxRickWhite

•  TheHSLWGfirstidenBfiedthemainthreadsfromWorkshopwithaneyetowardfindingthemostusefulandfeasibleonesfromamongthelargenumberofrecommendaBonsproducedbytheparBcipants.

•  5majorareasofdiscussionweresingledoutandexplored:a.  Combiningspectrab.  Spectraltoolsthatarealreadyavailablebutpeoplearenotawareofc.  (ExtracBngmulB‐objectspectraautomaBcally)d.  ExtracBnginformaBonfromspectrae.  TargetinformaBonandclassificaBon

•  FinalrecommendaBonswerepresentedtotheHSTMissionOfficeinJuly2013.

11/18/13 3

Page 4: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

RecommendaBons–Part1

IdenBfiedfollowingtasksasprioriBesfornext~2years(orderedfromhighesttolowest

priority):

1.  Makecombined1Dspectralproductsavailableandcreatethepipelinetodoit(developtheequivalentofASTRODRIZZLEforspectroscopy)•  Shouldbedoneincrementallybyincreasingthedifficulty/complexityof

the1DspectroscopicdatathatarehandledbythecombinaBonprocess.

•  Severalpipelinesalreadyexist(developedbyindividualsorscienceteams)andcanbeusedtofacilitatedesignandrequirementsforamoregenericpipeline.

2.  VisualizaBontoolsforspectra•  ManytoolswithdifferentfuncBonsalreadyexistspreadthroughout

MAST,HLA,andVO.•  PurposeofthisacBvityistoconsolidateexisBngtoolsintotheArchive

Portal.•  Toolswillallowforaquicklookandbasicmeasurementsofthe

spectroscopicdatainthearchive.11/18/13 4

Page 5: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

RecommendaBons–Part2

3.  SearchtooltoselectsourcesbasedontheirclassificaBon•  ShouldbedynamicandintegratedintotheArchivePortal.

•  ClassificaBoncouldbedonestarBngfromHSTprogramID,PIkeywordsandabstractandevolvingintosomethingmoresophisBcated(e.g.,catalog‐basedclassificaBon,crowdsourcing,etc.).

4.  ToolforfeatureidenBficaBonandmeasurement(developtheequivalentofasourceextractorforspectra)•  ReliesonclassificaBonofspectroscopicsourcesforcomplete

implementaBon.•  MayrequiremulBpleopBonstohandledifferenttypesofdata(emission/

absorpBon,bands,forests;highS/Nvs.lowS/N;highzvs.lowz,conBnuumstructure).

•  ShouldbefullyintegratedintotheArchivePortal.

11/18/13 5

Page 6: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

RequestedFeedback

•  Wouldyouusethetoolsandthehigh‐levelspectralproductsthatweareproposingtodevelop?Ifso,how?

•  Doyouagreewiththeprioritylist?•  Issomethingmajormissingfromourlist?•  Anythingelsethatweshouldtakeintoaccount?

Page 7: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

Back‐upSlides

11/18/13 7

Page 8: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

1)MakeCombined1DSpectralProductsAvailableandcreatethePipelinetodoit–

Part1•  UlBmatepurposeofthisacBvityistocombine1Dspectroscopicdata

together.Inordertodosoaspectroscopicpipelineisrequired.•  AnexampleoftheadvantageofcombiningspectratakenwithdifferentCOS

selngsisillustratedbelow.CombinedHST/COSspectrumoftheSeyfert1galaxyMrk509fromKrissetal.(2011,A&A,534,41).TheblackcurveshowsthesinglespectrumofonewavelengthseZngproducedbytheCOSpipeline.TheredcurveshowsthecombinedspectrumusingallfourcentralwavelengthseZngs(thisisnotcurrentlydonebyCALCOS).Thethinnercurvesshowtherespec8vesignal‐to‐noisera8osofthesinglespectrumandthecombinedspectrum.

11/18/13 8

Page 9: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

1)MakeCombined1DSpectralProductsAvailableandcreatethePipelinetodoit–

Part2

11/18/13 9

•  Highpriority,butwillrequire~2years•  Taskshouldbedoneincrementallybyincreasingthe

difficulty/complexityofthe1DspectroscopicdatathatarehandledbythecombinaBonprocess.

•  Severalpipelinesalreadyexist(developedbyindividualsorscienceteams)andcanbeusedtofacilitatedesignandrequirements.–  TypicallyexisBngpipelinesaretailoredtospecificsciencegoals.–  Amoregeneraldesignisrequired.–  ThewriBngofthepipelineshouldbedoneinsteps:

•  Thetoolcanstartasanoff‐linetoolmanuallytriggeredtocreatenewhigh‐levelproductsforourownHSTdataintotheHLA.Thiswillallowustogetsomethingquicklyandwithhighvisibility.

•  ItcouldevolveintopartoftheDMSprocessing.•  UlBmatelyitcouldbecomeastand‐alonetoolofferedtothe

community,similarlytoanASTRODRIZZLEforspectroscopy.

Page 10: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

1)MakeCombined1DSpectralProductsAvailableandcreatethePipelinetodoit–

Part3

11/18/13 10

•  ForcombinaBonof1Dhomogeneousdata(HSTsimilarinstrumentandresoluBon):–  Phase1(6months,FY2014‐Q3,Q4):designandrequirements

–  Phase2(18months,throughFY2016‐Q2):developmentandtesBng

–  Phase3(parBallyoverlappingwithPhase2,conBnuingeffort):implementaBon,dataprocessingandingesBon

•  ForcombinaBonofheterogeneousdata,add50%ormore–  couldbepartlydoneinparallel

•  Forextendedsources,theseconddimensionneedstobeadded(2Dspectroscopy).

Page 11: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

2)VisualizaBonToolsforSpectra–Part1•  PurposeofthisacBvityistoconsolidatetheexisBngvisualizaBontoolsfor

spectraintotheArchivePortal.•  AlotoftoolswithdifferentfuncBonsalreadyexistspreadthroughoutMAST,

HLA,andVO(seefiguresbelow):–  ExisBngtoolsareOKforaquicklookandsomebasicmeasurements.–  ExisBngtoolsneedimprovementstobecomemoreuserfriendlyandformoreindepthanalysis.–  EverythingshouldbeconsolidatedintothePortal.–  TimeframeisdrivenbyintegraBonintothePortal.

1739.52 , 2.918646e-14

Central Line: 1 Coadd(totalcolumns):

1 Xmin: 1443.87 X

max: 1739.87 Reset Zoom

X Axis Units: WCS Units Smooth(width in 1 Y 2.926729e-16 Y 3.380351e-14 Y %

Z0I60109T GHRS G140L (exposure) FAIRALL9MAST preview

ExamplesofExis8ngVisualiza8onSo_ware.HSTspectraofQSOFairall9areshownwiththreeexis8ngonlinetools.Toolsandfunc8onalityneedtobeintegratedintotheArchivePortalandadver8sed.

VOSpectool(ESA)downloadandmanipulatespectraldatafromVOarchives

HLASpectrumViewermeasureabsorpBonandemissionlines

MASTSpectralPlotcomparedatafrommulBplespectrographsonsameaxes(quicklook)

11/18/13 11

Page 12: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

2)VisualizaBonToolsforSpectra–Part2

•  Medium‐highpriority,mostlybasedonadaptaBonofexisBngtools.

•  Weenvisionallthesetoolsasweb‐based.•  Thetoolswillallowforaquicklookandbasicmeasurementsofthespectroscopicdataavailableinthearchive.

11/18/13 12

Page 13: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

3)SearchTooltoselectSourcesbasedontheirClassificaBon–Part1

•  MainfocusofthiseffortiscreaBonofadynamicsearchtoolintegratedintothePortalthatwillselecttargetsbasedonsomekindofclassificaBonofthesources.–  applicabletoallHST

data(imagingandspectroscopy).

–  basedonVOlexicon.•  Mediumpriority,may

bringsomeresultsinlessthanayear. KeywordsusedtodescribethetargetsinthePhase

IIoftheHSTapprovedspectroscopicprograms(COS,STIS,FOS,GHRS).

11/18/13 13

Page 14: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

3)SearchTooltoselectSourcesbasedontheirClassificaBon–Part2

•  ClassificaBonofsourcescouldbeapproachedinanincrementalway:–  HSTprogramIDs(aswellasPIkeywordsandproposal

abstracts)alreadyassociatedtoliterature.•  Keywordscouldbeeasilyextractedforeachsourceintheprogram,evenifthisprocessisnotquiterigorousandwillresultinsomefalseposiBves.

–  HSTdatasets(inaddiBontoprogramIDs,PIkeywords,andabstractproposals)arecurrentlybeingassociatedtoliterature.•  Thisisanongoingeffortstartedacoupleofyearsago.•  Largeback‐log(~11,000papers)needstobecleared.•  HigherprioritycouldbegiventoHST(COS,STIS,FOS,GHRS)spectroscopy(~3,100papers).

–  Futuredevelopmentscouldincludecatalog‐basedclassificaBon,crowdsourcingoftheclassificaBon,bererdefiniBonofthetargetkeywordsinthePhaseII.

11/18/13 14

Page 15: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

4)ToolforFeatureIdenBficaBonandMeasurement(DeveloptheEquivalentofSourceExtractorforSpectra)

Part1

•  PurposeofthisacBvityistodeveloptoolsthatallowforfeatureidenBficaBonandmeasurementsonspectra.–  ToolswouldbeintegratedintotheArchivePortal.

•  Mediumpriority,partlybasedonadaptaBonofexisBngtools.•  Similarlytowhatalreadydone,e.g.,forabsorpBonlinesinquasarsof

theSDSS(seefigurebelow).

AutomatedfiZngofquasarspectrumwithautomateddetec8onofabsorp8onlinesillustratedinFig.1fromZhu&Menard(2013,ApJ,770,130).Thetoppanelshowsthebestfitnonnega8vematrixfactoriza8on(NMF)quasarmodelfromSDSSDR7ploCedontheobservedspectrum.Dividingthisoutleavesanormalizedspectrumwithbroadresidualstructures(2ndpanel).MedianfilteringthisspectrumproducestheboCompanel,whichisthensearchedautoma8callyforabsorp8onlines.

11/18/13 15

Page 16: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

4)ToolforFeatureIdenBficaBonandMeasurement(DeveloptheEquivalentofSourceExtractorforSpectra)

Part2

11/18/13 16

•  MayrequiremulBpleopBonstohandledifferenttypesofdata(emission/absorpBon,bands,forests;highS/Nvs.lowS/N;highzvs.lowz,conBnuumstructure).–  taskcanbestartedanyBme,butreliesonclassificaBonofthespectroscopicsourcesforcompleteimplementaBon.

•  Usefultoolmaybeobtainedin~1year.•  Effortcurrentlybudgetedinsecondyear.

Page 17: Enhancing HST Spectral Products · 1) Make Combined 1D Spectral Products Available and create the Pipeline to do it – Part 1 • Ulmate purpose of this acvity is to combine 1D spectroscopic

Nov 18 2013

Nov 18 2013

OtherAreasofPossibleInterest

•  MulB‐ObjectSpectralExtracBonandCharacterizaBon(e.g.,Grisms).–  Notchampionedwithinworkinggroup.–  Maybebestledbyinstrumentteams(e.g.,WFC3+JWSTinstrumentteams).

•  ToolstovisualizeandanalyzeBmedependence.–  Commonframeworkyettobeestablished.

•  HSTdatainmeta‐catalogs.–  E.g.,NEDdoesnotshowHSTdataconsistently.

11/18/13 17


1D-FEL Without Approximations motivation, capabilities 1D theory 1D-solver for waves implementation (without and with Lorentz transformation) excitation.

1D-FEL Without Approximations motivation, capabilities 1D theory 1D-solver for waves implementation (without and with Lorentz transformation) excitation.

1d. rounding

1d. rounding

1D Jeopardy

1D Jeopardy

Chapter 1d

Chapter 1d

NETWORK SIMPLIFICATION 1D/1D dual-drainage simulation.

NETWORK SIMPLIFICATION 1D/1D dual-drainage simulation.

8-1 Lesson 8 Objectives Recap and iteration practice Recap and iteration practice Reduction of B.E. to 1D Reduction of B.E. to 1D 1D Quadratures 1D Quadratures.

8-1 Lesson 8 Objectives Recap and iteration practice Recap and iteration practice Reduction of B.E. to 1D Reduction of B.E. to 1D 1D Quadratures 1D Quadratures.

HEC-RAS: 1D VS 2D - northcarolina.apwa.netnorthcarolina.apwa.net/Content/Chapters... · HEC-RAS Today. 1D Model Calculations How Does It Work –1D Models. One Dimension (1D) Discharge

HEC-RAS: 1D VS 2D - northcarolina.apwa.netnorthcarolina.apwa.net/Content/Chapters... · HEC-RAS Today. 1D Model Calculations How Does It Work –1D Models. One Dimension (1D) Discharge

NMRPipe · NMRPipe: Spectral Processing as a UNIX Pipeline . 1D-4D FT, LP, MEM, ML, PCA . Parallel Processing . 1D-4D Peak Detection and Quantification . Spectral Graphics ...

NMRPipe · NMRPipe: Spectral Processing as a UNIX Pipeline . 1D-4D FT, LP, MEM, ML, PCA . Parallel Processing . 1D-4D Peak Detection and Quantification . Spectral Graphics ...

Annexure 1D

Annexure 1D

CorelDRAW X5 in 0757 0104 - AutomationDirect · 2019-09-06 · RW17 RW27 RW67 RW117-1D RW67-2D RW67-1D RW27-1D RW67-1D RW67-2D RW117-1D BF27D BF67-1D BF67-2D BF117D Montar em local

CorelDRAW X5 in 0757 0104 - AutomationDirect · 2019-09-06 · RW17 RW27 RW67 RW117-1D RW67-2D RW67-1D RW27-1D RW67-1D RW67-2D RW117-1D BF27D BF67-1D BF67-2D BF117D Montar em local

1D Measurements

1D Measurements

1D Plotting

1D Plotting

EPA's Web Archive - West Lake OU-1 Waste Disposal Area ......S-5 D-3 1D-2S 1D-3S 1D-5S 1D-7S 1D-9A 1D-17S 1D-15S 1D-20S 1D-9S 1D-6S 1D-11S 1D-8S 1D-13S 1D-19S 1D-12S OU-1 WASTE DISPOSAL

EPA's Web Archive - West Lake OU-1 Waste Disposal Area ......S-5 D-3 1D-2S 1D-3S 1D-5S 1D-7S 1D-9A 1D-17S 1D-15S 1D-20S 1D-9S 1D-6S 1D-11S 1D-8S 1D-13S 1D-19S 1D-12S OU-1 WASTE DISPOSAL

Sessions 1d

Sessions 1d

Outils de gestion des compétitions - ALL JUDO · 1d steffanutto lucas asu bordeaux st----- ----- 1d gadon adrien asu grenoble (u 1d prudhomme guillaume $ 6 81,9(56,7e 1d saignac

Outils de gestion des compétitions - ALL JUDO · 1d steffanutto lucas asu bordeaux st----- ----- 1d gadon adrien asu grenoble (u 1d prudhomme guillaume $ 6 81,9(56,7e 1d saignac

Usable Lenses Mounting and dismounting the Extender ...yongnuoebay.com/gw/sm/1.4xy.pdf · EOS-1D Mark IV、EOS-1D Mark III、EOS-1D Mark II N、EOS-1D Mark II、EOS-1D、EOS-1V/HS、EOS

Usable Lenses Mounting and dismounting the Extender ...yongnuoebay.com/gw/sm/1.4xy.pdf · EOS-1D Mark IV、EOS-1D Mark III、EOS-1D Mark II N、EOS-1D Mark II、EOS-1D、EOS-1V/HS、EOS

Pin Information for the Arria 10 AX 10AX027 Device · 2021. 1. 15. · l22 1d: refclk_gxbl1d_chtn l21: 1d gxbl1d_tx_ch5n: c25 1d: gxbl1d_tx_ch5p c26: 1d gxbl1d_rx_ch5n,gxbl1d_refclk5n:

Pin Information for the Arria 10 AX 10AX027 Device · 2021. 1. 15. · l22 1d: refclk_gxbl1d_chtn l21: 1d gxbl1d_tx_ch5n: c25 1d: gxbl1d_tx_ch5p c26: 1d gxbl1d_rx_ch5n,gxbl1d_refclk5n:

Bayesian Estimation of the Multifractality Parameter for ... · ML and Bayesian estimation. Examples of ML and Bayesian estimators for 1D fBm formulated in the spectral or wavelet

Bayesian Estimation of the Multifractality Parameter for ... · ML and Bayesian estimation. Examples of ML and Bayesian estimators for 1D fBm formulated in the spectral or wavelet

Sale kit download - Blue Sky Groupblueskydevelopment.co.th/salekit/ESPANA-Sale-Kit.pdf · a promise of pleasure . project ... roof top garden with boxing ... ulmate sophisticated

Sale kit download - Blue Sky Groupblueskydevelopment.co.th/salekit/ESPANA-Sale-Kit.pdf · a promise of pleasure . project ... roof top garden with boxing ... ulmate sophisticated

The Ulmate Retail Management IT Soluon

The Ulmate Retail Management IT Soluon