Difference between revisions of "Run Group F"

From clas12-run
Jump to navigation Jump to search
Line 113: Line 113:
 
   
 
   
 
== RC: Narbe Kalantarians==
 
== RC: Narbe Kalantarians==
* 757-575-7546  (or also 7547 if 7546 is busy)
+
* 757-575-7540
* 9 757-575-7546 from Counting Room.
+
* 9 757-575-7540 from Counting Room.
  
 
* RC meeting held at 10am in 2nd Floor Counting House.  Bluejeans 757 683 5804
 
* RC meeting held at 10am in 2nd Floor Counting House.  Bluejeans 757 683 5804

Revision as of 09:31, 1 August 2020

[edit]

Shift Schedule

Shift Checklist

Hot Checkout

Beam Time Accounting

  • See guidance for BTA in

Beam Time Accounting User Guide.

Manuals

Procedures

JLab Logbooks


RC schedule Weekly form

  • Feb 12 - Feb 18: Mohammad Hattawy
  • Feb 19 - Feb 25: Florian Hauenstein
  • Feb 26 - Mar 3: Eric Christy
  • Mar 4 - Mar 19: Sebastian Kuhn
  • Mar 18 - Mar 23: Carlos Ayerbe

  • 07/31 - 08/04 : Narbe Kalantarian
  • 09/05 - 08/11 : Stephen Bueltmann
  • 08/12 - 08/18 : Carlos Ayerbe Gayoso
  • 08/20 - 08/21 : Mohammad Hattawy
  • 08/22 - 08/25 : Sebastian Kuhn
  • 08/26 - 09/01 : Mohammad Hattawy
  • 09/02 - 09/08 : Sebastian Kuhn
  • 09/09 - 09/23 : Mohammad Hattawy


Daily Run Group F Coordination Meetings Daily at 10:00 a.m. Bluejeans = 757 683 5804

If calling local numbers (with area code prefix 757) from the counting room dial 9+[last 7 digits]. To call other area codes dial 91+[10 digit number]

Role Phone Number
Hall B Run Coordinator (757) 575-7540 (cell)
Hall B Physics Division Liaison (757) 876-1789 (cell)
MCC 7048
Crew Chief 7045
Crew Chief (757) 876-3367 (cell)
Program Deputy (757) 876-7997 (cell)
RadCon (757) 876-1743 (cell)
Gate House Guard 5822
Location Phone Number
Hall B Floor 5165
Hall B Space Frame 5170 and 5171
Hall B Forward Carriage 5371
Hall B Gas Shed 7115
Hall B Counting House 5244 (Shift Expert)
Hall B Counting House (757) 329-4846 (Shift Expert cell)
Hall B Counting House 5245 or 5126 (Shift Worker)
Hall A Counting House 5501
Hall C Counting House 6000
Hall D Counting House 5504
Hall B System Phone Number On-Call Person
Engineering (757) 748-5048 (cell)
(757) 897-9060 (cell)
Engineering On-Call (primary)
Denny Insley (secondary)
Slow Controls (757) 748-6922 (cell) Nathan Baltzell
Beamline (757) 303-3996 (cell) Eugene Pasyuk
DC (757) 218-4372 (cell)
(757) 748-5048 (cell)
Florian Hauenstein (primary)
Engineering On-Call (secondary)
SVT/MVT/MM (757) 541-7539 (cell)
(757) 753-7769 (cell)
Yuri Gotra (primary)
Rafo Paremuzyan (secondary)
ECAL (757) 810-1489 (cell) Cole Smith
FTOF/CTOF/CND (757) 344-7204 (cell) Daniel Carman
ALERT (757) 329-4844 (cell) Raphael Dupré
HTCC/LTCC (757) 344-7174 (cell) Youri Sharabian
FT (757) 344-1848 (cell) Raffaella De Vita
BAND (757) 310-7198 (cell) Florian Hauenstein
RICH (757) 344-3235 (cell)
(757) 748-6922 (cell)
Christopher Dilks (primary)
Nathan Baltzell (secondary)
DAQ (757) 232-6221 (cell) Sergey Boiarinov
HYDRA (317) 550-9226 (cell) Torri Jeske
Authorized Hall B Solenoid/Torus Operators
Hall B Denny Insley, Morgan Cook, Eugene Pasyuk
Magnet Group Probir Ghosha, Renuka Rajput-Ghoshal
Detector Support Group Brian Eng, Pablo Campero, Tyler Lemon
DC Power Onish Kumar, Sarin Philip
  • Note, all non-JLab numbers must be dialed with an area code. When calling from a counting-house landline, dial "9" first.
  • To call JLab phones from outside the lab, all 4-digit numbers must be preceded by 757-269
  • Click Here to edit Phone Numbers. Note, you then also have to edit the current page to force a refresh.

Click Here to edit Phone Numbers. Note, you then also have to edit this page to force a refresh.


In case you need to call in any electronics help, call in the following order

Person Phone Number
Chris Cuevas (757) 865-0461
Mark Taylor (757) 846-7322
Armen Stepayan (757) 814-5622



CLAS12 Run Group F
Part I (Spring 2020): Beam energy 2.18 GeV (1 pass) and10.38 GeV (5 pass)
Part II (Summer 2020): Beam energy 2.18 GeV (1 pass) and10.38 GeV (5 pass)

Important: Document all your work in the logbook! For every run, make comment at run start and run end (including "ignore" if warranted), enter RELEVANT screen shots *), and take about 20-30 min data with good beam, then post monitoring plots (reset if beam is bad and wait another 20-30 min). Also take screenshot of RTPC in CED at least once per run with beam


RC: Narbe Kalantarians

  • 757-575-7540
  • 9 757-575-7540 from Counting Room.
  • RC meeting held at 10am in 2nd Floor Counting House. Bluejeans 757 683 5804

PDL: Stepan Stepanyan / Dan Carman

  • (757) 876-1789
  • 9 876-1789 from Counting Room

NEW SHIFT INFORMATION - PLEASE READ

Due to travel restrictions, only local people will be able to come to Jefferson Lab for their shifts. To deal with this situation, Jefferson Lab leadership has developed a new POLICY that requires only an expert shift taker during Day and Swing shifts (Owl shifts will still be covered by 2 people). There will be remote backup, at least partial presence by the Run Coordinators, and all counting houses have been equipped with a direct camera feed so that shift takers for ANY hall can monitor the counting houses of Hall B and Hall D when only 1 person is present. Shift Experts will carry a cell phone that can be used to call in help. IF YOU ARE ALONE ON SHIFT, you may not go into the Hall - call the relevant experts instead. Shift experts during Day and Swing are expected, in addition to their regular duties, to also check monitoring histograms and CED and log them (as well as standard screen shots) to the logbook, and to respond to any alarms, as well as fill out shift checklists. These new rules take effect on Tuesday, March 24.

Starting immediately, please follow these rules: Keep a distance of 6 ft from all other people AT ALL TIMES. In particular, expert and worker (when both present) should sit 6 feet apart, facing in different directions. In addition, only the RC OR an RTPC expert should be inside the counting house B at any time - a maximum room occupancy of THREE has to be obeyed at all times. The RC, PDL and shift expert have the authority to ask non-essential people to leave if overcrowding occurs. Any work that requires 2 people to work in closer proximity than 6' must be first approved.

Until further notice, we expect the experimental run to continue until September 6, 2020. Obviously, this puts extra burden on many people, and we are grateful especially for those local volunteers who have signed up for shifts. Please also read the relevant information on COVID-19 and MEDCON5 operations at Jefferson Lab: [1]

Run Plan (see also initial run plan)

(Last updated: July 28th, 2020 )

Requests

For every run (~2 hours)

  1. Submit screenshots for the DAQvnc (select "statistics" tab), CLAS12 VTP Trigger GUI, ROC Busies, Beamline overview, beam strip charts, RTPC overview, BONuS HV from clascss. Do this only while beam is on!
  2. Run clas12mon over at most 20-30 min with good beam(!) (reset first) and submit the occupancy plots (at least once per run, early in the run). Compare with previous monitoring plots and make a log entry about any changes you observe. Make sure to reset monitoring plots regularly.
  3. Take at least one screen shot of RTPC CED with beam per run and post in logbook. De-select "Auto-event" and use Cntrl-N to browse for an event with tracks in it.



A. ESTABLISH BEAM

DAQ config: ; Trigger file: rgf_v2.2_150MeV.trg (same for inbending and outbending)

  1. At the beginning of the shift:
    1. Call Eugene (PDL: (757) 3033996) to start energizing the solenoid at full field (1935 A) and start energizing Torus at 1/2 maximum field (-1886.5 A) in out-bending polarity. Once the magnets at the requested fields, please sumbit screenshots to logbook. clascss->Soleoind/Torus->Magnet Power Supply.
    2. In parallel to 1, call RTPC expert to set target to “empty” (= 1 atm H2).
  2. Restore beam to the hall, first to the tagger dump, following the procedures described in [2].
  3. Check beam quality using harp scans 2C21 and 2C24, following the procedures described in [3]
  4. When the beam quality is acceptable, Call MCC and ask for a low-intensity (~5nA) beam to FC, Check the procedures below, complete harp scans (Performing Harp Scans). We require less than 0.3 mm (1σ) beam widths in x and y (As measured by 2H01A harp) and halo below 10^−4 (As measured by 2H01A harp).
  5. Center beam on target, using rates in BOM and downstream beam monitors. Establish range where beam starts directly interacting with target walls and take middle.
  6. Engage orbit locks and ascertain that they are stable.
  7. Set alarms and interlocks.
  8. Call the MCC and tell them that the beam is good and must keep the beam current at 5 nA.
  9. TURN HV ON for all the detectors.


B. CALIBRATION AND COMMISSIONING AT 1 PASS (2.2 GEV)

I. Outbending Configuration, H2 target (about 1 day)

DAQ config: PROD66; Trigger file: rgf_v2.2_150MeV.trg (same for inbending and outbending)

  1. Call the BONuS12-RTPC expert (757-329-4844) to fill the target with H2 gas target (68 psig).
  2. Checking:
    1. Solenoid at full field (1935 A).
    2. Torus at 1/2 maximum field (-1880 A) in out-bending polarity
  3. Call MCC and ask for 5 nA beam.
  4. Start DAQ and start taking data. Look at CED and monitoring plots to check occupancies.
  5. IF trigger rate is much less than 1kHz, we can increase the beam current (observe DC occupancies, BOM, downstream monitors) up to 50 nA in steps of 10 nA.
  6. Check the DAQ trigger rate, it must be less than 2kHz. If it is higher call MCC and reduce the beam current as needed.
  7. Submit the list of screenshots at the beginning and at the end of every run.

II. Electron-Inbending Configuration, H2 targe (about 1 shift)

DAQ config: ; Trigger file:rgf_v2.2_150MeV.trg (same for inbending and outbending)

  1. Call Daniel Carmen (PDL: (757) 876-1789) flip Torus polarity to 1/2 maximum field (+1880 A) in in-bending polarity [4]
  2. Call the BONuS12-RTPC expert (757-329-4844) to purge the target and fill it with H2 gas target (70 psig) .
  3. Call MCC and ask for 50 nA beam.
  4. Start DAQ and start taking data.
  5. Submit the list of screenshots at the beginning and at the end of every run.

III. Electron-Inbending Configuration, D2 target (about 1 shift)

DAQ config: ; Trigger file: rgf_v2.2_150MeV.trg

  1. Call the BONuS12-RTPC expert (757-329-4844) to purge the target and fill it with D2 gas target (max is 68 psig) .
  2. Call MCC and ask for 50 nA beam.
  3. Start DAQ and start taking data.
  4. Check the DAQ trigger rate, it must be less than 2kHz. If it is higher call MCC and reduce the beam current as needed.
  5. Submit the list of screenshots at the beginning and at the end of every run.


Production: Electron-inbending Configuration, D2/H2/4He target @ 10.4 GeV beam

DAQ config:PROD66; Trigger file:rgf_inbending_v3_4.trg

  1. Make sure beam blocker is in front of Faraday Cup
  2. After a longer beam-off period (assuming no major retuning of the accelerator), no harp scans are necessary. However, follow these steps to bring beam back:
    1. Ask for 10 nA. Check that all BPMs are within 0.1 mm of their nominal values.
    2. Ask for 50 nA. Check BMPs again and ask for orbit locks to be activated.
    3. Once orbit locks are running, ask for 240 nA.
  3. Ask MCC for 240 nA beam current (NOTE that 2C21A BPM will show 260nA. This is a known issue.)
  4. Please write the target pressure and comments in the dialogue box when starting/stopping a run
  5. Start a run and check that live time is above 85%. If not decrease current and log it.
  6. Restart a new run every 2h OR 10M events. END A RUN if beam will be off > 10 min, RTPC HV trip, or whenever half-wave plate is changed!
  7. Keep BTA (beam time accounting) up to date, including reasons for any entries with experiment not ready
  8. Submit the list of screenshots at the beginning and at the end of every run.


  1. When checking the ECAL response, make sure to look at the histograms for each sector by using the sector buttons at the bottom of the clas12mon window - if adcecal* or/and adcpcal* ROC crashes, there will be no alarm and the histograms are the way to notice this issue.
  2. For trigger alarms check Note 14 first!


Beam Restoration (last updated Feb 19)

Updated Manual is at [5]

  1. IF YOU GO DIRECTLY TO FARADAY CUP!!!: Quick beam recovery procedure including Harp Scan
    1. All HV are off (including FTOF)
    2. Check that 20 mm collimator is in
    3. Call MCC to unmask U/M/D counters but keep BOM masked or get it masked in case it isn't
    4. Call MCC to put 5nA to the FC.
    5. Compare the 2c21, 2c24, 2H01 positions and beam overview screen to the reference below
    6. Put thresholds on U/M/D as 1M/1M/1M and dwell time 50 ms.
    7. follow the procedures for the harp scans at 2H01 [6] (optionally at 2C21 and 2C24)
    8. Compare the results with the references scans below (be aware to use the correct analysis counter)
    9. if what you get is similar to the references, call MCC and tell them the the beam is acceptable and set FSD thresholds and dwelltimes as written below and continue with production running (see above)
    10. if what you get isn't similar to the references, do the other harp scans. If you are not sure if a tune of the beam is needed, consult beam line expert and/or RC.

At the end of each run, follow the standard DAQ restart sequence
(Note, this might be different from the instructions coming up on RunControl.)

  • "end run", "cancel", "reset"
  • if the run ended correctly:
    • "download", "prestart", "go"
  • if the run did not end correctly or if any ROCs had to be rebooted:
    • "configure", "download", "prestart", "go"

References and Standards:

(last update Mar 21, 2020 @ 9:40 PM.)

Restoration of Beam to Hall B


Default solenoid current and B field 1935 A (~4.0 T)

Nominal Beam Positions

  • 2H01, X: -0.1 mm, Y: -0.4 mm
  • 2C24, X: +0.1 mm, Y: -0.4 mm
  • 2C21, X: +0.1 mm, Y: 0.0 mm
  • the acceptable trajectory for the beam before entering the hall must be established while on the tagger dump. The relation between the 2C24 BPM positrons and the X,Y values measured with the tagger harp are:
    • X_harp=36.68-X_2C24
    • Y_harp=20.97-Y_2C24


FSD Thresholds TEMPORARY UNTIL BOM REPARATIONS

  • Upstream: 2000 Hz
  • Midstream: 2000 Hz
  • Downstream: 20000 Hz
  • BOM: 100000

FSD Dwell time

  • Upstream: 5 ms
  • Midstream: 5 ms
  • Downstream: 5 ms
  • BOM: 5 ms

BONuS HV setting

Reference Harp Scans for Beam on Tagger Dump: 2C21 [7], 2C24 [8]

Reference Harp Scans for Beam on Faraday Cup: 2H01 [9], [10], 2C21 [11], 2C24 [12]

Reference Monitoring Histograms 5 nA production trigger [13]

Reference Scalers and Halo-Counter Rates:

  • Well-tuned CW beam on FC, Full LD2 and 4He target, CLAS12 ON: 5 nA [14], 50 nA [15], 240nA [16]
  • Well-tuned CW beam on FC, Empty Target, CLAS12 OFF: 5 nA [17]
  • Well-tuned beam during Moller run [18]
  • Well-tuned beam on Tagger Dump at 5 nA during harp scans: [19]

General Instructions:

  • The main lights in the Hall (dome lights) and the Forward Carriage lights are being kept off because of light leaks affecting some of the detectors. If these lights are switched on during an access, they should be switched off when leaving the Hall. Note that the dome lights when switched off cannot be turned back on immediately because they require 10-15 min to cooldown.
  • Get familiar with the shift crew responsibilities for the RTPC (see manual [20]). Especially on how to switch on the HV after a trip.
  • Do not run more than 30 minutes above 30 nA with 5-pass beam without the beam blocker in front of Faraday cup. Put beam blocker in for long running at high currents for 5 pass operations.
  • Turn DC HV off only for beam tuning; if no beam is available or when beam is stable, keep them on even if you are not taking data.
  • With any issue contact On-Call Experts or RC - do not spend more than 15-20 min trying to fix the problem.
  • Check for and read any comments to log-book entries made during your shift.
  • During Day shift, check once per day with RC or RTPC expert whether they have purged the target.

Once Per Day (At 13:00):

  • Complete RICH recovery procedure - see Note: 11 below

Every Shift:

  • Follow run plan as outlined by RC
  • If any concern about beam stability, ask MCC if orbit locks are on (they should be).
  • Keep shift summary up to date in HBLOG. Record all that happens.
  • Document any beam condition change and send scaler GUIs to HBLOG
  • Fill out BTA hourly. Click "Load from EPICS" to automatically fill the left side.
  • Upload spectra from clas12mon at beginning of each run and cross-check with reference spectra
    • Reset clas12mon every ~2 hours or after extensive beam down and inspect spectra
  • Fill and submit the shift checklist in the logbook


  • Note 1: FTOF HVs: The goal is to minimize the number of power cycles of the dividers.
    • should be turned off during the initial beam tuning down to the Faraday Cup after CLAS12 has been off for a long shutdown, when doing a Moller run, when doing harp scans, or if there is tuned/pulsed beam in the upstream beamline.
    • should be left on after an initial beam tune has been established and if there are only minor steering adjustments and “tweaks” being made.
    • if shift workers have doubts what to do with the HVs, they can always contact the TOF on-call expert for advice.
  • Note 2: In case of a Torus and/or Solenoid Fast Dump do the following:
    1. Notify MCC to request beam OFF and to drop Hall B status to Power Permit
    2. Call Engineering on-call
    3. Make separate log entry with copies to HBTORUS and HBSOLENOID logbooks. In the "Notify" field add Ruben Fair, Probir Goshal, Dave Kashy and esr-users@jlab.org
    4. Notify Run Coordinator
    5. Turn off all detectors
  • Note 3: When beam is being delivered to the Faraday Cup:
    1. the Fast Shut Down elements: Upstream, Midstream, Downstream, BOM, and Solenoid should always be in the state UNMASKED
    2. No changes to the FSD threshold should be made without RC or beamline expert approval
  • Note 4: Any request for a special run or change of configuration has to be approved by the RC & documented
  • Note 5: Carefully check the BTA every hour and run the script btaGet.py to print for you what HAS TO BE in BTA for this hour. Edit BTA if it is incorrect.
  • Note 6: Reset CLAS12MON frequently to avoid histogram saturation. If CLAS12MON is restarted change MAX scale to 10 (default is 5) for DC normalized occupncy histograms. This would prevent them from saturation. See log entry [21]
  • Note 7: Shift workers must check the occupancies! Use this tool to compare to previous runs: [22]
  • Note 8: Check the vacuum periodically, make sure vacuum is not higher than 5e-5
  • Note 9: Always reset the CFD threshold after all power off/on on the CND CAMAC crate

After the CAMAC crate (camac1) holding the CND CFD boards is switched off for any reason, it is mandatory to reset the associated thresholds typing the following command from any clon machine terminal: $CODA/src/rol/Linux_x86_64/bin/cnd_cfd_thresh -w 0 If this command is failing and the crate is not responding, reboot it as follows: roc_reboot camac1

  • Note 10: Shift workers should anyway check routinely scalers to verify they update correctly and make a logbook entry if anomalies are observed after starting a new run.
  • Note 11:

For RICH recovery procedures, please see Log entry https://logbooks.jlab.org/entry/3562273. This would apply in the cases of 1. DAQ crash: rich4 is not responding or 2. RICH alarms (LV,missing tile, temperature etc). If it does not work or you are uncertain about what to do, contact the RICH expert on call. Please, note that missing tiles typically occur due to lost communication. Keep in mind that the recovery procedure will kill DAQ. If DAQ is running for other purpose, rather than data taking (for which the RICH acceptance would be important) do not initiate the recovery procedure.

  • The most critical parameter for RICH is the temperature of the photosensors. If the temperature rises above limits, an interlock will automatically turn the RICH HV and LV. If this happens, notify the expert on call and keep taking data without RICH.
  • Note 12: If ROCs mvt1 and/or mvt2 are 100% busy: stop the run, power cycle FMT/BONUS FEU LV (accessible from RTPC Overview or FMT Overview, FMT/BONUS - All LV OFF, FMT/BONUS - All LV ON, HV stays ON), then roc_reboot mvt1, roc_reboot mvt2, wait until it reboots ('ssh mvt1' and 'ssh mvt2' to verify), press 'cancel', 'reset', in the run control GUI, proceed with a new run from 'configure'. If the first LV recycle / roc_reboot doesn’t work call RTPC/BONUS expert.
  • Note 13: If ROC mmft1 is 100% busy: power cycle FTT LV (FT->FTT Overview, HV stays ON), roc_reboot mmft1, wait until it reboots (ssh mmft1 to verify). If the first LV recycle/mmft1 reboot doesn’t work call FT expert
  • Note 14: Trigger Troubleshooting: If you get trigger alarms check first if the trigger bit of a sector alarms both, for the DC roads and non DC roads, in the trigger expert screen (DAQ --> CLAS1 Trigger --> Menu --> Table - Expert). If this is the case (i.e. sector 3 and bits 3 and 10), there might be a problem with HTCC, PCAL or ECAL rocs and you should check the rocs in the runcontrol. If the non DC trigger bit is working and only the one with DC alarms, you would need to check the DC trigger rocs (possibly the one from the alarming sector). If you are not sure, call RC or trigger expert.

Webcams

Hall Webcams

(the first time you open any camera in any browser, accept the security exception)

Manuals

Epics on the web

Fall 2018 Run

fall2018_charge.jpg

Moller rg a fall.jpeg

Spring 2018 Run

chart.jpeg

Moller measurement rg-a.jpg

Bluejeans

  • Permanent connection for communication, and screen sharing between remote and local shift workers.
  • https://bluejeans.com/950041022
  • Or, on a clonpc## as user=clasrun, in a terminal run "bluejeans"

WebOPI

Strip Charts

Monitoring Histograms



Clas12design.png