Monitoring of the jobs
submitted to CREAM CE
Timur Sadykov
MND Section meeting
August 13rd, 2009
Internet
Services
CERN IT Department
CH-1211 Genève 23
Switzerland
www.cern.ch/it
CERN,
Geneva, Switzerland
Monitoring daemon
dashboard
server
Subscribe request
CEMon
service
CEMon client API
CREAM
CEs
parser
Notifications
ActiveMQ-CPP API
ActiveMQ-CPP
client for accessing
message broker
Apache ActiveMQ
message broker
MSG
topics
• CEMon
– consumer {port}
– subscribe --cert {path} --key {path} --topic CREAM_JOBS
--consumer-url {url}:{port} https://ce201.cern.ch:8443/cemonitor/services/CEMonitor
–
–
–
–
–
–
–
–
unsubscribe
pause
resume
subinfo
subupdate
getinfo
gettopics
getevent
output from CEMon:
MSG fields:
JOBID
Event #0 – Message #1
[
CREAM_JOB_ID = “CREAM619560843”;
CREAM_URL = “https://ce201.cern.ch:8443/cecream/services/CREAM2”;
JOB_STATUS = “DONE-OK”;
TIMESTAMP = “1242207964000”;
EXIT_CODE = 0;
WORKER_NODE = “lxbrb1909.cern.ch
]
OWNDERDN
VONAME
BKHOST
NETWORKHOST
STATESTARTTIME
LASTUPDATETIME
STATENAME
CONDORID
DESTSITE
EXITCODE
DONECODE
STATUSREASON
• Finish the first (simple) version development
• Second version will include (?)
– Certificate (to have rights to monitor all the jobs)
– Options
 list of CEs to monitor
 pause, resume, getinfo, etc
 etc
– Data storage (if unable to publish to MSG)
– etc