Linear Collider Forum



Home » ILCDirac » Productions » access CALICE data from DIRAC?
access CALICE data from DIRAC? [message #2287] Fri, 22 November 2013 01:03 Go to next message
jeans
Messages: 22
Registered: November 2012
Dear all,

I would like to run some Marlin reconstruction jobs over CALICE data using the DIRAC framework.

The relevant input files are on the grid, registered in the lcg-lfc. I believe the dirac has its own lfc? Would I need to re-register files in the dirac catalogue? or is there some other way?

Thanks for your suggestions (or corrections),
Daniel.

as an example:
Quote:

[jeans]$ lcg-lr lfn:/grid/calice/jeans/tb-fnal/rec/rec_caliceSoft_v04-04/tes t/data/Run630065_rec.000.slcio
srm://dcache-se-desy.desy.de/pnfs/desy.de/calice/generated/2 011-10-04/file885bf7d6-f911-4169-8124-097379c42c0f


when I try to specify this input file to my DIRAC job:
Quote:

ma.setInputFile(" LFN:/grid/calice/jeans/tb-fnal/rec/rec_caliceSoft_v04-04/tes t/data/Run630065_rec.000.slcio ")


I get the message
Quote:

Failed to find replicas for the following files /grid/calice/jeans/tb-fnal/rec/rec_caliceSoft_v04-04/test/da ta/Run630065_rec.000.slcio
Pre-submission checks failed for job with message: "Failed to find replicas"
Re: access CALICE data from DIRAC? [message #2288 is a reply to message #2287] Sun, 24 November 2013 23:27 Go to previous messageGo to next message
jeans
Messages: 22
Registered: November 2012
I managed to do this by specifying the SRM explicitly:

Quote:

.
.
.
from ILCDIRAC.Interfaces.API.NewInterface.Applications import GetSRMFile
srm = GetSRMFile()
fdict={"file" : " srm://dcache-se-desy.desy.de/pnfs/desy.de/calice/generated/2 011-10-04/file885bf7d6-f911-4169-8124-097379c42c0f", "site" : "DESY-SRM"}
srm.setFiles(fdict)
srm.setDebug(True)
res = job.append(srm)
if not res['OK']:
print res['Message']
exit()
.
.
.



then later in script:

Quote:

ma.setInputFile("file885bf7d6-f911-4169-8124-097379c42c0f")
Re: access CALICE data from DIRAC? [message #2289 is a reply to message #2288] Mon, 25 November 2013 02:13 Go to previous message
sailer
Messages: 34
Registered: February 2009
I wasn't sure how the GetSRMFile works, thank you for trying and figuring it out. I added your example to the ILCDIRAC twiki/documentation
https://twiki.cern.ch/twiki/bin/view/CLIC/DiracForUsers#GetS RMFile
Goto Forum:
  

[ PDF ]

Current Time: Wed Sep 19 23:26:54 Pacific Daylight Time 2018
.:: Contact :: Home ::.

Powered by: FUDforum 3.0.1.
Copyright ©2001-2010 FUDforum Bulletin Board Software