Difference between revisions of "Run Group M"

From clas12-run
Jump to navigation Jump to search
Line 233: Line 233:
  
 
* Do a '''RICH recovery''' (press the RICH Recovery button on the GUI) once daily during day shift, between runs. Please log in shift summary.
 
* Do a '''RICH recovery''' (press the RICH Recovery button on the GUI) once daily during day shift, between runs. Please log in shift summary.
** Restart the DAQ (reset, ...)
+
** Note the automated "RICH Recovery" sequence already confirms RICH4 is up and accepting ssh connections before claiming success. And it also prints out that you have to "Cancel->Reset->Configure->Download->Prestart" before starting the next run.
  
 
* '''[https://bta.acc.jlab.org Fill out BTA]''' hourly.  Click "Load from EPICS" to automatically fill the left side then correct as needed.
 
* '''[https://bta.acc.jlab.org Fill out BTA]''' hourly.  Click "Load from EPICS" to automatically fill the left side then correct as needed.

Revision as of 15:15, 1 February 2022

[edit]

If calling local numbers (with area code prefix 757) from the counting room dial 9+[last 7 digits]. To call other area codes dial 91+[ten digit number]

Role Phone Number
Hall B Run Coordinator (757) 575-7540 (cell)
Hall B Physics Division Liaison (757) 876-1789 (cell)
MCC 7048
Crew Chief 7045
Crew Chief (757) 876-3367 (cell)
Program Deputy (757) 876-7997 (cell)
RadCon (757) 876-1743 (cell)
Gate House Guard 5822
Location Phone Number
Hall B Floor 5165
Hall B Space Frame 5170 and 5171
Hall B Forward Carriage 5371
Hall B Gas Shed 7115
Hall B Counting House 5244 (Shift Expert)
Hall B Counting House (757) 329-4846 (Shift Expert cell)
Hall B Counting House 5245 or 5126 (Shift Worker)
Hall A Counting House 5501
Hall C Counting House 6000
Hall D Counting House 5504
Hall B System Phone Number On-Call Person
Engineering (757) 748-5048 (cell)
(757) 897-9060 (cell)
Engineering On-Call (primary)
Denny Insley (secondary)
Slow Controls (757) 748-6922 (cell) Nathan Baltzell
Beamline (757) 303-3996 (cell) Eugene Pasyuk
DC (757) 218-4372 (cell)
(757) 748-5048 (cell)
Florian Hauenstein (primary)
Engineering On-Call (secondary)
SVT/MVT/MM (757) 541-7539 (cell)
(757) 753-7769 (cell)
Yuri Gotra (primary)
Rafo Paremuzyan (secondary)
ECAL (757) 810-1489 (cell) Cole Smith
FTOF/CTOF/CND (757) 344-7204 (cell) Daniel Carman
ALERT (757) 329-4844 (cell) Raphael Dupré
HTCC/LTCC (757) 344-7174 (cell) Youri Sharabian
FT (757) 344-1848 (cell) Raffaella De Vita
BAND (757) 310-7198 (cell) Florian Hauenstein
RICH (757) 344-3235 (cell)
(757) 748-6922 (cell)
Christopher Dilks (primary)
Nathan Baltzell (secondary)
DAQ (757) 232-6221 (cell) Sergey Boiarinov
HYDRA (317) 550-9226 (cell) Torri Jeske
Authorized Hall B Solenoid/Torus Operators
Hall B Denny Insley, Morgan Cook, Eugene Pasyuk
Magnet Group Probir Ghosha, Renuka Rajput-Ghoshal
Detector Support Group Brian Eng, Pablo Campero, Tyler Lemon
DC Power Onish Kumar, Sarin Philip
  • Note, all non-JLab numbers must be dialed with an area code. When calling from a counting-house landline, dial "9" first.
  • To call JLab phones from outside the lab, all 4-digit numbers must be preceded by 757-269
  • Click Here to edit Phone Numbers. Note, you then also have to edit the current page to force a refresh.

Click Here to edit Phone Numbers. Note, you then also have to edit the current page to force a refresh.


CLAS12 Run Group M, Fall 2021

Beam energies: 2.1, 4.0, 6.0 GeV (1.96 GeV/pass)

RC: Susan Schadmand and Sebastian Kuhn

PDL: Valery Kubarovsky

Run Plan: Jan 31, 2022

Production runs use PROD67_noVTPread and the trigger rgm_6GeV_inb_v1_0.trg .
Run duration 100M events or 4 hours, whichever comes first.

  • status: 6GeV beam, LAr target is full, Beam blocker is OUT
  • Note to self: Presently, the alarm limit for the beam_stopper_alarm is raised for running without beam blocker .
    • Needs to be restored to 'normal' value for the solid targets where we need to run with the beam blocker IN.
  • running: 25nA LAr for 2 days
  • next:
    • single tin foil for 2 days, beam blocker IN
    • Ca48 target, beam blocker IN


DAQ configuration

PROD67_noVTPread , production trigger rgm_6GeV_inb_v1_0.trg .

NOTE: UNLESS a RICH problem crashes the DAQ, do NOT interrupt an otherwise smooth run to do a RICH recovery - instead do this in between runs.

NOTE: BOTH the shift expert AND the shift worker MUST check monitoring histograms at least once every 30-60 minutes to make sure there are no major detector problems.

At the end of each run, follow the STANDARD DAQ RESTART SEQUENCE

  • "end run", if the run ended correctly then: "prestart", "go"

  • if the run did not end correctly or if any ROCs had to be rebooted:
  • "cancel", "reset"
    • "configure", "download", "prestart", "go"
  • After each step, make sure it is completed in the Run Control message window. If a ROC has crashed, find which one it is, issue a roc_reboot command ON JUST THAT ROC and try again. Contact the DAQ expert if there are any questions.

References and Standards

(last update 01/18/2022- 23:30)

Nominal Beam Positions

  • 2H01, X: -0.6 mm, Y: 0.8 mm
  • 2C24, X: -2.0 mm, Y: +0.6 mm

FSD Thresholds

  • Upstream: 2000 Hz
  • Midstream: 2000 Hz
  • Downstream: 500000 Hz
  • BOM: 10000
  • 5 ms dwell time

Reference Harp Scans for Beam on Faraday Cup: 2H01 [1]

Reference Harp Scans for Beam on Tagger dump: 2C21 [2], tagger harp [3]

Reference Monitoring Histograms (6 nA, production C) [4] Old reference Monitoring Histograms (50 nA, production LD2) [5]

Counter rates

  • Upstream counters integrated rates: 0-15 Hz (acceptable up to 100 Hz are acceptable) @50 nA.
  • Midstream counters: 10-20 Hz (acceptable up to 50 Hz) @50 nA.
  • Counting rates of ~ hundreds of Hz may indicate bad beam tune or bleed-through from other Halls.

Beamline vacuum: should be not higher than 5e-5.

NOTE: BOTH the shift expert AND the shift worker MUST check monitoring histograms (mon12) at least once every 30-60 minutes to make sure there are no major detector problems.

Notes

  1. Some plots in mon12 have a choice of histogram sets per sector, select buttons at the bottom of the plot. Only the currently selected set ends up in the logbook entry.
    • that means you have to look at all sectors for these histograms
  2. LTCC is NOT used in this experiment. HV should be kept OFF.
  3. FMT only using 3 FMT layers, not 6.
  4. If we do a RICH recovery, we have to restart the DAQ. This is not a problem it is a fact, https://logbooks.jlab.org/entry/3980363
  5. The main lights in the Hall (dome lights) and the Forward Carriage lights are being kept off because of light leaks affecting some of the detectors. If these lights are switched on during access, they should be switched off when leaving the Hall. Refer to these photos:
    • ON: [6]
    • OFF: [7]
    • Note that the dome lights when switched off cannot be turned back on immediately because they require 10-15 min to cool down.
  6. Be very mindful of the background rates in the halo counters, rates in the detectors, and currents in the SVT for all settings to ensure that they are at safe levels.
    • The integrated rates on the upstream counters have to be in the range 0-15 Hz (rates up to 100 Hz are acceptable) and the rates on the midstream counters have to be in the range 10-20 Hz (acceptable up to 50 Hz) @50 nA. Counting rates in the range of hundreds of Hz may indicate a bad beam tune or bleed-through from other Halls.
  7. When the beam is being delivered to the Faraday Cup:
    • the Fast Shut Down elements: Upstream, Midstream, Downstream, BOM, and Solenoid should always be in the state UNMASKED
    • No changes to the FSD threshold should be made without RC or beamline expert approval
  8. Do not run more than 30 minutes with >150 W beam to Faraday cup without the beam blocker, eg https://logbooks.jlab.org/entry/3979277
  9. Any request for a special run or change of configuration has to be approved by the RC & documented
  10. Do not turn OFF FTOF HVs, even during the beam tune with CW beam (turn off if tuned/pulsed beam in the upstream beamline)
  11. Turn DC HV off only for beam tuning; if no beam is available or when the beam is stable, keep them on even if you are not taking data.
  12. Reset the online monitoring histograms frequently to avoid histogram saturation.
  13. In case of a Torus and/or Solenoid Fast Dump do the following:
    • Notify MCC to request beam OFF and to drop Hall B status to Power Permit
    • Call Engineering on-call
    • Make a separate log entry with copies to HBTORUS and HBSOLENOID logbooks. In the "Notify" field add Probir Goshal, Dave Kashy, and esr-users@jlab.org
    • Notify Run Coordinator
    • Turn off all detectors
  14. If responding to RICH or Trigger alarms please post screens also to RICH or HBTRIGGER logbook, respectively.


Known Issues

  • DAQ when starting a run, it can happen that the live time alarm goes off, can be acknowledged
  • DAQ the trigger alarm goes off when the trigger rate is too small or too high or a sector is not triggering at all. If necessary, the shift expert can "Set All Normalized Rate Limits" at useful rates (not too low)
  • DAQ ROC rate tdcecal4 is double wrt the 5 other sectors, https://logbooks.jlab.org/entry/3979286
  • DAQ The error messages " ERR: event# ..." e.g. for crates tdcband1, tdcecal1 and tdcecal6 are NOT a problem
  • RICH when a tile is missing in the spectra, wait till the end of the run and then do RICH recovery
  • RICH FPGA temperatures can show yellow tiles. Yellow tiles in the RICH temperature map are normal. It is done just to pay attention to the tiles with temp>70 degrees. The alarm is set to 75 degrees https://logbooks.jlab.org/entry/3975547
  • IOCBTARG In case of loss of communication, follow instructions at https://logbooks.jlab.org/entry/3502218
    • Check that no unnecessary beamline-related screens are open. This includes particularly the big beamline overview screen, but also and any motor/harp/collimator screens, and IOC health screens.



NOTE: BOTH the shift expert AND the shift worker MUST check monitoring histograms at least once every 30 - 60 minutes to make sure there are no major detector problems.

  • Follow the [Short Term Schedule] as outlined by RC
    • includes Run Plan, DAQ configuration, and References and Standards
  • Keep shift summary up to date in HBLOG. Record all that happens.
  • Cycle the FMT gas once per shift, in-between runs. Pease log in shift summary.
    • If it is not reset, the interlock may drop and disable the HV.
    • Turning off and on the gas flow without pausing to avoid HV trips.
    • If the HV tripped, make sure that once gas flow is restarted and the flow differential is down to reasonable values, to turn the FMT HV back on and let it ramp all the way up.
    • Remember that this experiment is only using 3 FMT layers, not 6.
  • Do a RICH recovery (press the RICH Recovery button on the GUI) once daily during day shift, between runs. Please log in shift summary.
    • Note the automated "RICH Recovery" sequence already confirms RICH4 is up and accepting ssh connections before claiming success. And it also prints out that you have to "Cancel->Reset->Configure->Download->Prestart" before starting the next run.
  • Fill out BTA hourly. Click "Load from EPICS" to automatically fill the left side then correct as needed.
    • Accelerator beam time:
      • ABU: acceptable beam used (eg harp scans, calibrations, trigger settings, running)
      • BANU: beam acceptable but not used (eg radiator change or our problems)
      • BNA: beam not acceptable (eg tuning, drifting, not focused)
    • Experiment beam time
      • ER: experiment ready
      • PCC: planned configuration change (when beam is masked while radiators are moved, DAQ (roc rebooting, restarting runs)), if more than 5 minutes, put a short comment, eg harp scans or DAQ.
      • UED: unplanned experiment down (hardware failure)


In case of other questions or uncertainties of what to do, call the RC or PDL

(remote) shift worker: see dedicated Remote Shifts tab above.



Tasks

Every Run:

  • WITH BEAM, log screen shots of
    • Beamline Overview, in VNC or Web Browser
    • CLAS12 Trigger rates and DAQ status

Every Shift:

  • Log screen shots of RICH temperature and scaler maps

Regularly:

  • reset & check spectra frequently (every 30 - 60 minutes)
    • Some plots in mon12 have a choice of histogram sets per sector, select buttons at the bottom of the plot. Only the currently selected set ends up in the logbook entry.
    • that means you have to look at all sectors for these histograms
  • Log the strip charts in time intervals according to the x-axis time span, using the liveplot configuration Beamline4Logbook, see https://logbooks.jlab.org/entry/3978837 .
    • in VNC: use CS-Studio, Tools, Strip Charts, livePlot
      • right-click on the livePlot screen and select "Load a Configuration"
      • the configuration "Beamline4Logbook" provides the beam current and position information
      • right-click on the screen and select "Make Elog Entry", make sure to log to HBLOG and not ELOG



Backup shifter contact info
Name Email Cell phone
Justin Estee esteejus@mit.edu
Andrew Denniston awild@mit.edu
Sara Ratliff ratliff_sara@gwmail.gwu.edu
Erin Seroka erinseroka@gwmail.gwu.edu

Webcams

Manuals

Hall Webcams

Epics on the web


Live Monitoring Links



RGM monitoring dec 21 charge.png




Clas12design.png