From andre.schaaff at astro.unistra.fr Fri Jul 1 06:30:50 2011 From: andre.schaaff at astro.unistra.fr (Andre Schaaff) Date: Fri, 01 Jul 2011 15:30:50 +0200 Subject: Announcement about Workflow future plans Message-ID: <4E0DCC0A.3040901@astro.unistra.fr> Dear all, As you know we will soon be facing a new generation of facilities and archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, LOFAR, SKA pathfinders,..) where scientific Workflows will play an important role in the working methodology of astronomers. A detailed analysis about the state of the art of workflows in the frame of the VO involves languages, design tools, execution engines, use cases, etc. A major topic is also the preservation of the workflows and the capability to replay a workflow several years after its design and implementation. Several talks concerning these issues have been presented during the past IVOA Interop meetings (see references below). In order to undertake this task within our community we think that as a first step a Note should be written. Participation is welcome, in particular, we would like to collect experiences (including use cases, tools, etc.), references, remarks, etc. We plan the Note to be published around September and discussed at the Pune Interop meeting. We should then decide on starting a working draft describing those aspects and possibly in a new Interest Group on Workflows. Best regards, Andr? Schaaff and Jose Enrique Ruiz References (not exhaustive) Some presentations in the VO Naples DCP session, http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf Nara DCP session, http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf Garching GWS session, http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf Baltimore Application session, http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf Trieste GWS session, http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf Some projects with a link to the VO http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm http://www.wf4ever-project.org/web/guest/home Euro-VO DCA Theory and Grid Workshops http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf ADASS ADASS London, http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J -------------- next part -------------- A non-text attachment was scrubbed... Name: andre_schaaff.vcf Type: text/x-vcard Size: 321 bytes Desc: not available URL: From msdemlei at ari.uni-heidelberg.de Mon Jul 4 01:49:14 2011 From: msdemlei at ari.uni-heidelberg.de (Markus Demleitner) Date: Mon, 4 Jul 2011 10:49:14 +0200 Subject: Position with GAVO in Heidelberg (Germany) Message-ID: <20110704084914.GA20269@ari.uni-heidelberg.de> Dear Colleagues, GAVO has a vacancy for a position in Heidelberg (Germany) -- please apply, post or distribute as appropriate. There's also a PDF version at http://docs.g-vo.org/GAVO-2011vacancy.pdf Thanks, Markus ----------------------------------- The German Astrophysical Virtual Observatory GAVO (http://www.g-vo.org) seeks an Astrophysicist or a Computer Scientist for a position at Zentrum f?r Astronomie der Universit?t Heidelberg (ZAH), Germany. Duties: Publication of astronomical data within our data center and support of scientists to publish their data to the Virtual Observatory; development of VO client software, software packaging; international cooperation with other projects involved in VO development, including participation in the IVOA standards process; VO advocacy within the scientific community. Qualifications: * at least a Master's degree or equivalent in either physics, astrophysics, or computer science * solid skills in software development, including experience in writing and deploying software in either Python or Java * preferably solid knowledge of at least one field of astronomy, ideally related to spectroscopy * proficiency in English and preferably German Administrativa: The position is for a fixed term until June 2014. The compensation is governed by the German Tarifvertrag der L?nder on level E11/E13, depending on qualification (between 2700 and 3700 Euro per month gross). Please send your applications to Markus Demleitner, gavo at ari.uni-heidelberg.de, M?nchhofstr. 12-14, 69120 Heidelberg. Applications in electronic from are highly preferred. Please include (links to) samples of code you have written. For further information, send mail to the address above or call +49 (0)6221 54 1837. The application deadline is August 1st, 2011. From longo at na.infn.it Mon Jul 4 03:29:28 2011 From: longo at na.infn.it (Giuseppe Longo) Date: Mon, 4 Jul 2011 12:29:28 +0200 Subject: R: Announcement about Workflow future plans In-Reply-To: <4E0DCC0A.3040901@astro.unistra.fr> References: <4E0DCC0A.3040901@astro.unistra.fr> Message-ID: <00b701cc3a35$41198150$c34c83f0$@na.infn.it> Dear Andr? I believe this is a great and timely idea. I am very interested in contributing (and I also volunteer Massimo Brescia who has a strong Interest in it) in several aspects of the task. How do you intend to proceed? Peppe -----Messaggio originale----- Da: interop-bounces at ivoa.net [mailto:interop-bounces at ivoa.net] Per conto di Andre Schaaff Inviato: venerd? 1 luglio 2011 15:31 A: interop at ivoa.net Oggetto: Announcement about Workflow future plans Dear all, As you know we will soon be facing a new generation of facilities and archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, LOFAR, SKA pathfinders,..) where scientific Workflows will play an important role in the working methodology of astronomers. A detailed analysis about the state of the art of workflows in the frame of the VO involves languages, design tools, execution engines, use cases, etc. A major topic is also the preservation of the workflows and the capability to replay a workflow several years after its design and implementation. Several talks concerning these issues have been presented during the past IVOA Interop meetings (see references below). In order to undertake this task within our community we think that as a first step a Note should be written. Participation is welcome, in particular, we would like to collect experiences (including use cases, tools, etc.), references, remarks, etc. We plan the Note to be published around September and discussed at the Pune Interop meeting. We should then decide on starting a working draft describing those aspects and possibly in a new Interest Group on Workflows. Best regards, Andr? Schaaff and Jose Enrique Ruiz References (not exhaustive) Some presentations in the VO Naples DCP session, http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf Nara DCP session, http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf Garching GWS session, http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf Baltimore Application session, http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-3010 08.pdf Trieste GWS session, http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Chara c-Workflow-20May08.pdf Some projects with a link to the VO http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm http://www.wf4ever-project.org/web/guest/home Euro-VO DCA Theory and Grid Workshops http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf ADASS ADASS London, http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-s chaaff-final.pdf ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J From jean.schneider at obspm.fr Mon Jul 4 04:50:51 2011 From: jean.schneider at obspm.fr (Schneider Jean) Date: Mon, 4 Jul 2011 13:50:51 +0200 (CEST) Subject: Announcement about Workflow future plans In-Reply-To: <4E0DCC0A.3040901@astro.unistra.fr> References: <4E0DCC0A.3040901@astro.unistra.fr> Message-ID: <301a8de7e268c6b268e8612b38f73fc1.squirrel@webmail.obspm.fr> Interested people could meet at the ADASS Meeting next November in Paris: http://www.eso.org/sci/meetings/2011/adass2011.html Jean Schneider > > Dear all, > > As you know we will soon be facing a new generation of facilities and > archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, > LOFAR, SKA pathfinders,..) where scientific Workflows will play an > important role in the working methodology of astronomers. A detailed > analysis about the state of the art of workflows in the frame of the VO > involves languages, design tools, execution engines, use cases, etc. A > major topic is also the preservation of the workflows and the capability > to replay a workflow several years after its design and implementation. > Several talks concerning these issues have been presented during the > past IVOA Interop meetings (see references below). > > In order to undertake this task within our community we think that as a > first step a Note should be written. Participation is welcome, in > particular, we would like to collect experiences (including use cases, > tools, etc.), references, remarks, etc. We plan the Note to be published > around September and discussed at the Pune Interop meeting. We should > then decide on starting a working draft describing those aspects and > possibly in a new Interest Group on Workflows. > > Best regards, > > > Andr? Schaaff and Jose Enrique Ruiz > > > References (not exhaustive) > > Some presentations in the VO > > Naples DCP session, > http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf > Nara DCP session, > http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf > Garching GWS session, > http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf > Baltimore Application session, > http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf > Trieste GWS session, > http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf > > Some projects with a link to the VO > > http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow > http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm > http://www.wf4ever-project.org/web/guest/home > > Euro-VO DCA Theory and Grid Workshops > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf > > ADASS > > ADASS London, > http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf > ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J > > From andre.schaaff at astro.unistra.fr Tue Jul 5 02:22:39 2011 From: andre.schaaff at astro.unistra.fr (Andre Schaaff) Date: Tue, 05 Jul 2011 11:22:39 +0200 Subject: R: Announcement about Workflow future plans In-Reply-To: <00b701cc3a35$41198150$c34c83f0$@na.infn.it> References: <4E0DCC0A.3040901@astro.unistra.fr> <00b701cc3a35$41198150$c34c83f0$@na.infn.it> Message-ID: <4E12D7DF.3050106@astro.unistra.fr> Hello Peppe, On 04/07/11 12:29, Giuseppe Longo wrote: > Dear Andr? > > I believe this is a great and timely idea. I am very interested in > contributing (and I also volunteer Massimo Brescia who has a strong > Interest in it) in several aspects of the task. > How do you intend to proceed? We are waiting the end of this week to let people reply to the announce and then we will start a discussion with all the interested people. As a Note can be exhautive and has not to focus on a particular point we think that it should be nice to have a panel (as large as possible) of the Worklow domain for the Pune interop. This Note should present the links with the IVOA stantards and perhaps the lack of standards. And as said in the announce and depending on the real needs (and the priorities) of the VO community we should then decide in which WG/IG we could continue this work. It could be dispatched in the existing WG/IG (almost all the WG/IG are potentially concerned) or, why not (and depending on the Exec agreement) done in a dedicated Interest Group. regards Andr? > Peppe > -------------- next part -------------- A non-text attachment was scrubbed... Name: andre_schaaff.vcf Type: text/x-vcard Size: 321 bytes Desc: not available URL: From pepi at cfa.harvard.edu Tue Jul 5 06:53:41 2011 From: pepi at cfa.harvard.edu (Pepi Fabbiano) Date: Tue, 05 Jul 2011 09:53:41 -0400 Subject: R: Announcement about Workflow future plans In-Reply-To: <00b701cc3a35$41198150$c34c83f0$@na.infn.it> References: <4E0DCC0A.3040901@astro.unistra.fr> <00b701cc3a35$41198150$c34c83f0$@na.infn.it> Message-ID: <4E131765.6060804@cfa.harvard.edu> Dear Peppe and Andre', There is a considerable experience in workflows (we call them pipelines) at the CXC, although we realize that the model will have to change somewhat to adapt to the increasing data rates. It would be good to include Janet Evans and Ian Evans in the debate. I'll cc them. Cheers. -pepi Giuseppe Longo wrote: > Dear Andr? > > I believe this is a great and timely idea. I am very interested in > contributing (and I also volunteer Massimo Brescia who has a strong > Interest in it) in several aspects of the task. > How do you intend to proceed? > Peppe > > -----Messaggio originale----- > Da: interop-bounces at ivoa.net [mailto:interop-bounces at ivoa.net] Per conto di > Andre Schaaff > Inviato: venerd? 1 luglio 2011 15:31 > A: interop at ivoa.net > Oggetto: Announcement about Workflow future plans > > > Dear all, > > As you know we will soon be facing a new generation of facilities and > archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, LOFAR, > SKA pathfinders,..) where scientific Workflows will play an important role > in the working methodology of astronomers. A detailed analysis about the > state of the art of workflows in the frame of the VO involves languages, > design tools, execution engines, use cases, etc. A major topic is also the > preservation of the workflows and the capability to replay a workflow > several years after its design and implementation. > Several talks concerning these issues have been presented during the past > IVOA Interop meetings (see references below). > > In order to undertake this task within our community we think that as a > first step a Note should be written. Participation is welcome, in > particular, we would like to collect experiences (including use cases, > tools, etc.), references, remarks, etc. We plan the Note to be published > around September and discussed at the Pune Interop meeting. We should then > decide on starting a working draft describing those aspects and possibly in > a new Interest Group on Workflows. > > Best regards, > > > Andr? Schaaff and Jose Enrique Ruiz > > > References (not exhaustive) > > Some presentations in the VO > > Naples DCP session, > http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf > Nara DCP session, > http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf > Garching GWS session, > http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf > Baltimore Application session, > http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-3010 > 08.pdf > Trieste GWS session, > http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Chara > c-Workflow-20May08.pdf > > Some projects with a link to the VO > > http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow > http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm > http://www.wf4ever-project.org/web/guest/home > > Euro-VO DCA Theory and Grid Workshops > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf > > ADASS > > ADASS London, > http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-s > chaaff-final.pdf > ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J > > > -------------- next part -------------- A non-text attachment was scrubbed... Name: pepi.vcf Type: text/x-vcard Size: 361 bytes Desc: not available URL: From dtody at nrao.edu Tue Jul 5 10:47:35 2011 From: dtody at nrao.edu (Douglas Tody) Date: Tue, 5 Jul 2011 11:47:35 -0600 (MDT) Subject: R: Announcement about Workflow future plans In-Reply-To: <4E131765.6060804@cfa.harvard.edu> References: <4E0DCC0A.3040901@astro.unistra.fr> <00b701cc3a35$41198150$c34c83f0$@na.infn.it> <4E131765.6060804@cfa.harvard.edu> Message-ID: Hi Andr? Jose, all - As Pepi mentions a lot of us already have data processing pipelines, which are a type of workflow. This raises the question, what is the expected scope of the proposed VO workflow initiative? It seems to me there are at least several distinct areas this might address: o Distributed data analysis workflows. In this case the user or a client defines and executes a distributed workflow which invokes services on multiple remote sites via the VO infrastructure. In this case the workflow would be entirely in VO-space, driving simpler services at the individual sites. o Driving data processing pipelines and reprocessing from VO. In this case we have a traditional data processing pipeline and the remote user or client software invokes a job to do some pipeline reprocessing, e.g., to custom reprocess an instrumental dataset to produce a new image, cube, etc. The "workflow" in this case runs at a single site, and VO is used to drive the job remotely (SSO, UWS) and manage the results (VOSpace, VO data services). o Traditional data processing pipelines, e.g., instrumental or survey data processing pipelines which produce higher level data products. At present there are many variants of these and they have little or no direct connection to VO, aside from possibly producing VO-compliant data or being optionally driven from VO. The first of these is the first thing that comes to mind (to me at least) when one mentions "workflow" in connection with VO. The second integrates the traditional data processing pipelines we already have with VO to allow VO users to do on-the-fly reprocessing to generate data products which can be analyzed with VO (we are very interested in this use case for custom reprocessing of observatory data for example). The third currently has little connection with VO and it is not clear how much we need VO mechanisms at this level, although there are some things which come to mind (VO compliant data and metadata, modeling provenance, etc.). So my question is thus which of these areas would a VO workflow initiative want to address? What are the relevant priorities? Do we still have a fairly clear distinction between instrument-specific data processing and (possibly distributed/multi-wavelength) data analysis, where workflows are concerned? More pragmatically, do we want to try to get the folks at our respective institutions currently responsible for conventional data processing pipelines involved, or is this expected to be a higher level more VO-specific workflow mechanism? - Doug On Tue, 5 Jul 2011, Pepi Fabbiano wrote: > Dear Peppe and Andre', > > There is a considerable experience in workflows (we call them pipelines) at > the CXC, although we realize that the model will have to change somewhat to > adapt to the increasing data rates. It would be good to include Janet Evans > and Ian Evans in the debate. I'll cc them. > > Cheers. -pepi > > > > Giuseppe Longo wrote: >> Dear Andr? >> I believe this is a great and timely idea. I am very interested in >> contributing (and I also volunteer Massimo Brescia who has a strong >> Interest in it) in several aspects of the task. How do you intend to >> proceed? >> Peppe >> >> -----Messaggio originale----- >> Da: interop-bounces at ivoa.net [mailto:interop-bounces at ivoa.net] Per conto di >> Andre Schaaff >> Inviato: venerd? 1 luglio 2011 15:31 >> A: interop at ivoa.net >> Oggetto: Announcement about Workflow future plans >> >> >> Dear all, >> >> As you know we will soon be facing a new generation of facilities and >> archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, LOFAR, >> SKA pathfinders,..) where scientific Workflows will play an important role >> in the working methodology of astronomers. A detailed analysis about the >> state of the art of workflows in the frame of the VO involves languages, >> design tools, execution engines, use cases, etc. A major topic is also the >> preservation of the workflows and the capability to replay a workflow >> several years after its design and implementation. Several talks concerning >> these issues have been presented during the past >> IVOA Interop meetings (see references below). >> >> In order to undertake this task within our community we think that as a >> first step a Note should be written. Participation is welcome, in >> particular, we would like to collect experiences (including use cases, >> tools, etc.), references, remarks, etc. We plan the Note to be published >> around September and discussed at the Pune Interop meeting. We should then >> decide on starting a working draft describing those aspects and possibly in >> a new Interest Group on Workflows. >> >> Best regards, >> >> >> Andr? Schaaff and Jose Enrique Ruiz >> >> >> References (not exhaustive) >> >> Some presentations in the VO >> >> Naples DCP session, >> http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf >> Nara DCP session, >> http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf >> Garching GWS session, >> http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf >> Baltimore Application session, >> http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-3010 >> 08.pdf >> Trieste GWS session, >> http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Chara >> c-Workflow-20May08.pdf >> >> Some projects with a link to the VO >> >> http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow >> http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm >> http://www.wf4ever-project.org/web/guest/home >> >> Euro-VO DCA Theory and Grid Workshops >> >> http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf >> http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf >> http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf >> >> ADASS >> >> ADASS London, >> http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-s >> chaaff-final.pdf >> ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J >> >> >> > > From gbb at ipac.caltech.edu Wed Jul 6 10:12:14 2011 From: gbb at ipac.caltech.edu (Bruce Berriman) Date: Wed, 6 Jul 2011 10:12:14 -0700 Subject: Announcement about Workflow future plans Message-ID: Andre: Ewa Deelman (ISI, USC) and myself have, with our collaborators, investigated workflows and management of their provenance for a number of years, and would like to contribute. Please let us know what you need and when. Cheers =Bruce -----Messaggio originale----- Da: interop-bounces at ivoa.net [mailto:interop-bounces at ivoa.net] Per conto di Andre Schaaff Inviato: venerd? 1 luglio 2011 15:31 A: interop at ivoa.net Oggetto: Announcement about Workflow future plans Dear all, As you know we will soon be facing a new generation of facilities and archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, LOFAR, SKA pathfinders,..) where scientific Workflows will play an important role in the working methodology of astronomers. A detailed analysis about the state of the art of workflows in the frame of the VO involves languages, design tools, execution engines, use cases, etc. A major topic is also the preservation of the workflows and the capability to replay a workflow several years after its design and implementation. Several talks concerning these issues have been presented during the past IVOA Interop meetings (see references below). In order to undertake this task within our community we think that as a first step a Note should be written. Participation is welcome, in particular, we would like to collect experiences (including use cases, tools, etc.), references, remarks, etc. We plan the Note to be published around September and discussed at the Pune Interop meeting. We should then decide on starting a working draft describing those aspects and possibly in a new Interest Group on Workflows. Best regards, Andr? Schaaff and Jose Enrique Ruiz References (not exhaustive) Some presentations in the VO Naples DCP session, http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf Nara DCP session, http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf Garching GWS session, http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf Baltimore Application session, http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-3010 08.pdf Trieste GWS session, http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Chara c-Workflow-20May08.pdf Some projects with a link to the VO http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm http://www.wf4ever-project.org/web/guest/home Euro-VO DCA Theory and Grid Workshops http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf ADASS ADASS London, http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-s chaaff-final.pdf ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J -------------- next part -------------- An HTML attachment was scrubbed... URL: From wilde at mcs.anl.gov Wed Jul 6 11:45:55 2011 From: wilde at mcs.anl.gov (Michael Wilde) Date: Wed, 6 Jul 2011 13:45:55 -0500 (CDT) Subject: Announcement about Workflow future plans In-Reply-To: <4E0DCC0A.3040901@astro.unistra.fr> Message-ID: <2029485122.73702.1309977955595.JavaMail.root@zimbra.anl.gov> Dear Andr?, All, Swift (http://www.ci.uchicago.edu/swift) is a parallel scripting language for many-task applications, a computing model that encompasses most astronomy pipelines and workflows. Swift was developed at UChicago and Argonne National Laboratory by many collaborators over the last five years. It performs efficient automatic parallel execution of many-task applications on desktops, clusters, supercomputers, clouds, and grids. Dan Katz, Jon Monette and I have developed a Swift version of Montage as a demonstration of how Swift can contribute to astronomy. We are interested in learning how we can best contribute to the IVOA workflow effort. Regards, Michael Wilde and Dan Katz ----- Original Message ----- > Dear all, > > As you know we will soon be facing a new generation of facilities and > archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, > LOFAR, SKA pathfinders,..) where scientific Workflows will play an > important role in the working methodology of astronomers. A detailed > analysis about the state of the art of workflows in the frame of the > VO > involves languages, design tools, execution engines, use cases, etc. A > major topic is also the preservation of the workflows and the > capability > to replay a workflow several years after its design and > implementation. > Several talks concerning these issues have been presented during the > past IVOA Interop meetings (see references below). > > In order to undertake this task within our community we think that as > a > first step a Note should be written. Participation is welcome, in > particular, we would like to collect experiences (including use cases, > tools, etc.), references, remarks, etc. We plan the Note to be > published > around September and discussed at the Pune Interop meeting. We should > then decide on starting a working draft describing those aspects and > possibly in a new Interest Group on Workflows. > > Best regards, > > > Andr? Schaaff and Jose Enrique Ruiz > > > References (not exhaustive) > > Some presentations in the VO > > Naples DCP session, > http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf > Nara DCP session, > http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf > Garching GWS session, > http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf > Baltimore Application session, > http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf > Trieste GWS session, > http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf > > Some projects with a link to the VO > > http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow > http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm > http://www.wf4ever-project.org/web/guest/home > > Euro-VO DCA Theory and Grid Workshops > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf > > ADASS > > ADASS London, > http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf > ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J -- Michael Wilde Computation Institute, University of Chicago Mathematics and Computer Science Division Argonne National Laboratory From anai_gomez at mat.ucm.es Thu Jul 7 02:31:53 2011 From: anai_gomez at mat.ucm.es (ANA INES GOMEZ DE CASTRO) Date: Thu, 07 Jul 2011 11:31:53 +0200 Subject: Announcement about Workflow future plans In-Reply-To: <2029485122.73702.1309977955595.JavaMail.root@zimbra.anl.gov> References: <4E0DCC0A.3040901@astro.unistra.fr> <2029485122.73702.1309977955595.JavaMail.root@zimbra.anl.gov> Message-ID: Dear Michael and Dan, the link you've provided does not work (it's not found in the server). Is it temporarily down? could you provide additional information? Cheers, Ana Prof. Ana I. G?mez de Castro Fac. de Ciencias Matem?ticas Universidad Complutense de Madrid ----- Mensaje original ----- De: Michael Wilde Fecha: Mi?rcoles, Julio 6, 2011 20:56 Asunto: Re: Announcement about Workflow future plans A: andre schaaff CC: "Daniel S. Katz" , interop at ivoa.net > Dear Andr?, All, > > Swift (http://www.ci.uchicago.edu/swift) is a parallel scripting > language for many-task applications, a computing model that > encompasses most astronomy pipelines and workflows. Swift was > developed at UChicago and Argonne National Laboratory by many > collaborators over the last five years. It performs efficient > automatic parallel execution of many-task applications on > desktops, clusters, supercomputers, clouds, and grids. > > Dan Katz, Jon Monette and I have developed a Swift version of > Montage as a demonstration of how Swift can contribute to > astronomy.? We are interested in learning how we can best > contribute to the IVOA workflow effort. > > Regards, > > Michael Wilde and Dan Katz > > > ----- Original Message ----- > > Dear all, > > > > As you know we will soon be facing a new generation of > facilities and > > archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, > > LOFAR, SKA pathfinders,..) where scientific Workflows will > play an > > important role in the working methodology of astronomers. A detailed > > analysis about the state of the art of workflows in the frame > of the > > VO > > involves languages, design tools, execution engines, use > cases, etc. A > > major topic is also the preservation of the workflows and the > > capability > > to replay a workflow several years after its design and > > implementation. > > Several talks concerning these issues have been presented > during the > > past IVOA Interop meetings (see references below). > > > > In order to undertake this task within our community we think > that as > > a > > first step a Note should be written. Participation is welcome, in > > particular, we would like to collect experiences (including > use cases, > > tools, etc.), references, remarks, etc. We plan the Note to be > > published > > around September and discussed at the Pune Interop meeting. We > should> then decide on starting a working draft describing those > aspects and > > possibly in a new Interest Group on Workflows. > > > > Best regards, > > > > > > Andr? Schaaff and Jose Enrique Ruiz > > > > > > References (not exhaustive) > > > > Some presentations in the VO > > > > Naples DCP session, > > > http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf> Nara DCP session, > > http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf > > Garching GWS session, > > http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching- > GWSWorkflow.pdf> Baltimore Application session, > > > http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf > > Trieste GWS session, > > > http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf > > > > Some projects with a link to the VO > > > > http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow > > http://amiga.iaa.es/p/212-web-services-based-scientific- > workflows.htm> http://www.wf4ever-project.org/web/guest/home > > > > Euro-VO DCA Theory and Grid Workshops > > > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf > > > > ADASS > > > > ADASS London, > > > http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf > > ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J > > -- > Michael Wilde > Computation Institute, University of Chicago > Mathematics and Computer Science Division > Argonne National Laboratory > > -------------- next part -------------- An HTML attachment was scrubbed... URL: From anai_gomez at mat.ucm.es Thu Jul 7 05:29:48 2011 From: anai_gomez at mat.ucm.es (ANA INES GOMEZ DE CASTRO) Date: Thu, 07 Jul 2011 14:29:48 +0200 Subject: Announcement about Workflow future plans In-Reply-To: References: <4E0DCC0A.3040901@astro.unistra.fr> <2029485122.73702.1309977955595.JavaMail.root@zimbra.anl.gov> Message-ID: Thanks Dan, it was just a problem with the "end bracket", it was included in the link address. I've just realized. Cheers, Ana ----- Mensaje original ----- De: "Daniel S. Katz" Fecha: Jueves, Julio 7, 2011 14:21 Asunto: Re: Announcement about Workflow future plans A: ANA INES GOMEZ DE CASTRO CC: Michael Wilde , andre schaaff , interop at ivoa.net > I cannot post to the list, but it does work for me - perhaps it > was a transient error? > > It redirects to http://www.ci.uchicago.edu/swift/main/ > > both URLs currently work for me. > > Dan > > On Jul 7, 2011, at 4:31 AM, ANA INES GOMEZ DE CASTRO wrote: > > > Dear Michael and Dan, > > > > the link you've provided does not work (it's not found in the > server).> Is it temporarily down? could you provide additional > information?> Cheers, Ana > > > > Prof. Ana I. G?mez de Castro > > Fac. de Ciencias Matem?ticas > > Universidad Complutense de Madrid > > > > > > ----- Mensaje original ----- > > De: Michael Wilde > > Fecha: Mi?rcoles, Julio 6, 2011 20:56 > > Asunto: Re: Announcement about Workflow future plans > > A: andre schaaff > > CC: "Daniel S. Katz" , interop at ivoa.net > > > > > Dear Andr?, All, > > > > > > Swift (http://www.ci.uchicago.edu/swift) is a parallel > scripting > > > language for many-task applications, a computing model that > > > encompasses most astronomy pipelines and workflows. Swift > was > > > developed at UChicago and Argonne National Laboratory by > many > > > collaborators over the last five years. It performs > efficient > > > automatic parallel execution of many-task applications on > > > desktops, clusters, supercomputers, clouds, and grids. > > > > > > Dan Katz, Jon Monette and I have developed a Swift version > of > > > Montage as a demonstration of how Swift can contribute to > > > astronomy.? We are interested in learning how we can > best > > > contribute to the IVOA workflow effort. > > > > > > Regards, > > > > > > Michael Wilde and Dan Katz > > > > > > > > > ----- Original Message ----- > > > > Dear all, > > > > > > > > As you know we will soon be facing a new generation of > > > facilities and > > > > archives dealing with huge amounts of data (ALMA, LSST, > panSTARRS,> > > LOFAR, SKA pathfinders,..) where scientific > Workflows will > > > play an > > > > important role in the working methodology of astronomers. > A detailed > > > > analysis about the state of the art of workflows in the > frame > > > of the > > > > VO > > > > involves languages, design tools, execution engines, use > > > cases, etc. A > > > > major topic is also the preservation of the workflows and the > > > > capability > > > > to replay a workflow several years after its design and > > > > implementation. > > > > Several talks concerning these issues have been presented > > > during the > > > > past IVOA Interop meetings (see references below). > > > > > > > > In order to undertake this task within our community we > think > > > that as > > > > a > > > > first step a Note should be written. Participation is > welcome, in > > > > particular, we would like to collect experiences > (including > > > use cases, > > > > tools, etc.), references, remarks, etc. We plan the Note > to be > > > > published > > > > around September and discussed at the Pune Interop > meeting. We > > > should> then decide on starting a working draft describing > those > > > aspects and > > > > possibly in a new Interest Group on Workflows. > > > > > > > > Best regards, > > > > > > > > > > > > Andr? Schaaff and Jose Enrique Ruiz > > > > > > > > > > > > References (not exhaustive) > > > > > > > > Some presentations in the VO > > > > > > > > Naples DCP session, > > > > > > > > http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf> Nara DCP session, > > > > http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf > > > > Garching GWS session, > > > > > http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching- > > > GWSWorkflow.pdf> Baltimore Application session, > > > > > > > > http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf > > > > Trieste GWS session, > > > > > > > > http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf > > > > > > > > Some projects with a link to the VO > > > > > > > > http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow > > > > http://amiga.iaa.es/p/212-web-services-based-scientific- > > > workflows.htm> http://www.wf4ever-project.org/web/guest/home > > > > > > > > Euro-VO DCA Theory and Grid Workshops > > > > > > > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf > > > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf > > > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf > > > > > > > > ADASS > > > > > > > > ADASS London, > > > > > > > > http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf > > > > ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J > > > > > > -- > > > Michael Wilde > > > Computation Institute, University of Chicago > > > Mathematics and Computer Science Division > > > Argonne National Laboratory > > > > > > > > > > > > > > -- > Daniel S. Katz > University of Chicago > (773) 834-7186 (voice) > (773) 834-6818 (fax) > d.katz at ieee.org or dsk at ci.uchicago.edu > http://www.ci.uchicago.edu/~dsk/ > > > > > Prof. Ana I. G?mez de Castro Fac. de Ciencias Matem?ticas Universidad Complutense de Madrid -------------- next part -------------- An HTML attachment was scrubbed... URL: From Christophe.Arviset at esa.int Thu Jul 14 01:39:09 2011 From: Christophe.Arviset at esa.int (Christophe Arviset) Date: Thu, 14 Jul 2011 10:39:09 +0200 Subject: Announcement about Workflow future plans In-Reply-To: <4E0DCC0A.3040901@astro.unistra.fr> References: <4E0DCC0A.3040901@astro.unistra.fr> Message-ID: <2464_1310632723_4E1EAB13_2464_54713_2_4E1EAB2D.4060801@esa.int> Andre Carlos Gabriel and Aitor Ibarra from the XMM-Newton SAS team would be happy to collaborate, so you can count with them. Cheers Christophe On 01/07/2011 15:30, Andre Schaaff wrote: > > Dear all, > > As you know we will soon be facing a new generation of facilities and > archives dealing with huge amounts of data (ALMA, LSST, panSTARRS, > LOFAR, SKA pathfinders,..) where scientific Workflows will play an > important role in the working methodology of astronomers. A detailed > analysis about the state of the art of workflows in the frame of the > VO involves languages, design tools, execution engines, use cases, > etc. A major topic is also the preservation of the workflows and the > capability to replay a workflow several years after its design and > implementation. Several talks concerning these issues have been > presented during the past IVOA Interop meetings (see references below). > > In order to undertake this task within our community we think that as > a first step a Note should be written. Participation is welcome, in > particular, we would like to collect experiences (including use cases, > tools, etc.), references, remarks, etc. We plan the Note to be > published around September and discussed at the Pune Interop meeting. > We should then decide on starting a working draft describing those > aspects and possibly in a new Interest Group on Workflows. > > Best regards, > > > Andr? Schaaff and Jose Enrique Ruiz > > > References (not exhaustive) > > Some presentations in the VO > > Naples DCP session, > http://www.ivoa.net/internal/IVOA/InteropMay2011DCP/Wf4EverNaples.pdf > Nara DCP session, > http://www.ivoa.net/internal/IVOA/InterOpDec2010DCP/Wf4Ever.pdf > Garching GWS session, > http://www.ivoa.net/internal/IVOA/InterOpNov2009GWS/Garching-GWSWorkflow.pdf > Baltimore Application session, > http://www.ivoa.net/internal/IVOA/InterOpOct2008Applications/GWS-DM-REG-301008.pdf > Trieste GWS session, > http://www.ivoa.net/internal/IVOA/InterOpMay2008GridAndWebServices/GWS-Charac-Workflow-20May08.pdf > > Some projects with a link to the VO > > http://www.france-ov.org/twiki/bin/view/GROUPEStravail/Workflow > http://amiga.iaa.es/p/212-web-services-based-scientific-workflows.htm > http://www.wf4ever-project.org/web/guest/home > > Euro-VO DCA Theory and Grid Workshops > > http://sait.oat.ts.astro.it/MSAIt800209/PDF/559.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/574.pdf > http://sait.oat.ts.astro.it/MSAIt800209/PDF/578.pdf > > ADASS > > ADASS London, > http://www.adass.org:8080/Conferences/2007/Venue/talks/session4a/adass2007-schaaff-final.pdf > ADASS London, http://adsabs.harvard.edu/abs/2008ASPC..394..273J > -- Thanks in advance Cheers Christophe ------------------------------------------------------------------- Christophe ARVISET Christophe.Arviset at esa.int Head of the Science Archives and Computer Support Engineering Unit Science Operations Department European Space Astronomy Centre (ESAC) European Space Agency (ESA) P.O. Box 78 28691 Villanueva de la Canada Tel: +34 91 813 12 78 Madrid - SPAIN Fax: +34 91 813 13 08 ------------------------------------------------------------------- ================================================================================================ This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. ================================================================================================= From Jesus.Salgado at sciops.esa.int Thu Jul 21 02:57:10 2011 From: Jesus.Salgado at sciops.esa.int (Jesus Salgado) Date: Thu, 21 Jul 2011 11:57:10 +0200 Subject: ObsCore enters into the TCG review phase Message-ID: <2468_1311242225_4E27F7F1_2468_743309_1_1311242230.28932.256.camel@satl11.net4.lan> Dear all, After latest updated version uploaded by Mireille some days ago and a verification that this version covers the main issues found during the working group review on the DM side, ObsCore enters officially into TCG review phase. RFC page can be found here http://www.ivoa.net/cgi-bin/twiki/bin/view/IVOA/ObsCoreRFC As this RFC period will overlap the holidays period, the period will be longer than 4 weeks: 21-July/15-September I would like to congratulate Mireille here for all the effort done in all this process. Best Regards, -- Jesus J. SALGADO Jesus.Salgado at sciops.esa.int ESAC Science Archives Team European Space Astronomy Centre (ESAC) European Space Agency (ESA) European Space Agency/European Space Astronomy Centre P.O. Box 78 28691 Villanueva de la Canada Tel: +34 91 813 12 71 Madrid - SPAIN Fax: +34 91 813 13 08 ------------------------------------------------------------------- ================================================================================================ This message and any attachments are intended for the use of the addressee or addressees only. The unauthorised disclosure, use, dissemination or copying (either in whole or in part) of its content is not permitted. If you received this message in error, please notify the sender and delete it from your system. Emails can be altered and their integrity cannot be guaranteed by the sender. Please consider the environment before printing this email. =================================================================================================