Physics and Data Quality Monitoring Infrastructure

Links to other DQM pages: "Glue" Navigator Page

Version V00-05-11: based upon `CMSSW_1_7_4`

(Last revised: December 20, 2007 - Andreas Meyer)

General Description
Code Versions
Instructions to run an example
Code Development
Older versions of this page

General description

The Physics and Data Quality Monitoring infrastructure (DQM) aims at providing a homogeneous monitoring environment across various applications at the CMS experiment:

Online DQM with histograms created and filled in the High-Level-Trigger Filter Farm
Online DQM off the Storagemanager event server
The local DAQ of the various subdetector groups
Offline DQM

The DQM provides a set of tools, such as:

Tree-like directories with histograms, profiles, scalars, strings.
Quality tests that can produce warnings, errors, alarms.
Visualization tools
Transfer of monitoring information to remote nodes.

For a description of the DQM architecture and status we refer to the following web-page and documents:

the DQM page on the CMS Twiki
a write-up of a workshop on online DQM (27 Aug 07)
a paper on DQM presented at CHEP2006 (February 15, 2006)

Code Versions

Release notes: [Version V00-04-73 (CMSSW_1_6_0)] | [Version V00-05-11 (based upon CMSSW_1_7_4)] | [Release notes for 18x]
(Release notes of older versions are linked to older versions of this page.

Instructions to run an example

To run a test DQM job on the SM Eventserver (with histograms filled with numbers from a random-number generator), perform the following steps:

     scramv1 project CMSSW CMSSW_1_7_4
     cd CMSSW_1_7_4/src
     eval `scramv1 runtime -csh`
     cmscvsroot CMSSW
     cvs co DQMServices/Examples
     cd DQMServices/Examples/test
     cmsRun dqmStandaloneExample.cfg

This is the source-client process:

At job start it creates histograms (monitoring elements).
On each event, it requests events from the SM event server (playback), and fills histograms (with random numbers).
On luminosity section boundaries it performs client actions.

The example contains 3 modules:

a "source" module (operating on each event) DQMSourceExample.cc,
a quality test module (operating on luminosity section boundaries) QualityTester.cc
and a "client" (operating on luminosity section boundaries) DQMClientExample.cc.

You'll need to modify the addresses in Example/test/dqm_monitorDaemon.cfi in case the collector is not on the same node as the source.

Visualization:
- A DQM GUI webserver is running on played-back events (from November GR) at http://cmsmon.cern.ch/dqm/online-playback
- Test platform: from the cms-cluster you can try to send ME to a collector operated on srv-c2d05-16 Use the webserver GUI to look at the histograms http://cmsmon.cern.ch/dqm/online-test. You can also try to install and operate the GUI Webserver yourself, following the instructions on the Webserver installation instructions page.

Code development

Please contact Andreas Meyer in case you would like to start developing code for DQM online or offline.
Look at the latest Release Notes (for 1_7_X) here.
Detailed instructions about code development to appear here.
In the mean time

you can read the description of the quality tests and how to use them.
You can also read the documentation on configuring your DQM client with XML files.

Older versions of this document

DQM in CMSSW: [V00-03-66] | [V00-03-30] | [V00-03-20] | [V00-03-00] | [V00-02-80] | [V00-02-70] | [V00-02-54] | V00-02-50 | [V00-02-40] | [V00-02-30] | [V00-02-23] | [V00-02-20] | [V00-02-00] | [V00-01-20] | [V00-01-10] | [V00-01-02] | [V00-01-00] | [V00-00-95] | [V00-00-90] | [V00-00-80] | [V00-00-70] | [v0.0.60] | [v0.0.50] | [v0.0.40] | [v0.0.30] | [v0.0.30] | [v0.0.20] | [v0.0.10]

For comments, corrections and suggestions: please email Emilio Meschi, Christos Leonidopoulos, Andreas Meyer