Difference between revisions of "Run Group F"
Line 382: | Line 382: | ||
= Remote Shifts = | = Remote Shifts = | ||
* [https://hallbopi.jlab.org/webopi3.3/w?opi=beamline/clas12-web.opi Beamline Overview] (requires CUE login) | * [https://hallbopi.jlab.org/webopi3.3/w?opi=beamline/clas12-web.opi Beamline Overview] (requires CUE login) | ||
+ | * Strip Charts (requires CUE login) | ||
+ | * [https://epicsweb.jlab.org/wave/?start=2020-07-08+16%3A00%3A17&end=2020-07-08+16%3A05%3A17&myaDeployment=ops&myaLimit=100000&windowMinutes=30&title=Upstream+and+Midstream+Halo+Counters&fullscreen=false&layoutMode=2&viewerMode=2&pv=scaler_cS3b&pv=scaler_cS4b&scaler_cS3blabel=scaler_cS3b&scaler_cS3bcolor=%23a6cee3&scaler_cS3byAxisLabel=Rate++%28Hz%29&scaler_cS3byAxisMin=&scaler_cS3byAxisMax=&scaler_cS3byAxisLog&scaler_cS3bscaler=&pv=scaler_cS5b&pv=scaler_cS6b&pv=scaler_cS7b Upstream/Midstream Halo Counters] | ||
* [https://epicsweb.jlab.org/wave Strip Charts] (requires CUE login) | * [https://epicsweb.jlab.org/wave Strip Charts] (requires CUE login) | ||
* [https://clas12mon.jlab.org/mon12/histograms/?reference=3630375 Occupancy Histograms] (reference needs updating) | * [https://clas12mon.jlab.org/mon12/histograms/?reference=3630375 Occupancy Histograms] (reference needs updating) |
Revision as of 15:08, 8 July 2020
Shift ScheduleShift ChecklistHot CheckoutBeam Time Accounting
|
Manuals |
Procedures |
JLab Logbooks
|
RC schedule Weekly form
|
If calling local numbers (with area code prefix 757) from the counting room dial 9+[last 7 digits]. To call other area codes dial 91+[10 digit number]
|
|
- Note, all non-JLab numbers must be dialed with an area code. When calling from a counting-house landline, dial "9" first.
- To call JLab phones from outside the lab, all 4-digit numbers must be preceded by 757-269
- Click Here to edit Phone Numbers. Note, you then also have to edit the current page to force a refresh.
Click Here to edit Phone Numbers. Note, you then also have to edit this page to force a refresh.
In case you need to call in any electronics help, call in the following order
Person | Phone Number |
---|---|
Chris Cuevas | (757) 865-0461 |
Mark Taylor | (757) 846-7322 |
Armen Stepayan | (757) 814-5622 |
CLAS12 Run Group F, Spring 2020
Beam energy 10.38 GeV (5 pass)
Important: Document all your work in the logbook! For every run, make comment at run start and run end (including "ignore" if warranted), enter RELEVANT screen shots *), and take about 20-30 min data with good beam, then post monitoring plots (reset if beam is bad and wait another 20-30 min). Also take screenshot of RTPC in CED at least once per run with beam
RC: Carlos Ayerbe Gayoso (Full list of RG-F RCs and RTPC experts)
- 757-575-7540
- 9 757-575-7540 from Counting Room.
- RC meeting held at 10am in 2nd Floor Counting House. Bluejeans 757 683 5804
PDL: Stepan Stepanyan / Dan Carman
- (757) 876-1789
- 9 876-1789 from Counting Room
NEW SHIFT INFORMATION - PLEASE READ
Due to travel restrictions, many of the originally assigned shift takers will not be able to come to Jefferson Lab for their shifts. To deal with this situation, Jefferson Lab leadership has developed a new POLICY that requires only an expert shift taker during Day and Swing shifts (Owl shifts will still be covered by 2 people). There will be remote backup, at least partial presence by the Run Coordinators, and all counting houses have been equipped with a direct camera feed so that shift takers for ANY hall can monitor the counting houses of Hall B and Hall D when only 1 person is present. Shift Experts will carry a cell phone that can be used to call in help. IF YOU ARE ALONE ON SHIFT, you may not go into the Hall - call the relevant experts instead. Shift experts during Day and Swing are expected, in addition to their regular duties, to also check monitoring histograms and CED and log them (as well as standard screen shots) to the logbook, and to respond to any alarms, as well as fill out shift checklists. These new rules take effect on Tuesday, March 24.
Starting immediately, please follow these rules: Keep a distance of 6 ft from all other people inside the counting house. In particular, expert and worker (when both present) should sit 6 feet apart, facing in different directions. In addition, only the RC (at the RC-designated station) and an RTPC expert (either all the way in the corner or at the RTPC gas controls "Reserved" computer) should be inside the counting house B at any time. The RC and the shift expert have the authority to ask non-essential people to leave if overcrowding occurs. In situations where 2 or more people MUST work closer to each other than 6 ft, they should wear TYVEK protective suits and face masks (there are some in the CH).
Scheduled shift takers that cannot come to Jefferson Lab will be replaced by local volunteers. Until further notice, we expect the experimental run to continue until May 6, 2020. Obviously, this puts extra burden on many people, and we are grateful especially for those volunteers. Please also read the MEMO by Rolf Ent.
Run Plan (see also initial run plan)
(Last updated: March 15th, 2020 @ 9:00 )
Requests
Short Term Schedule
- Install new RTPC3
- All shifts are canceled until Friday, March 20, Day.
Overall Program:
- Install RTPC3 starting Monday 3/16 Day.
- Hopefully on Friday 3/20 reestablish beam (including harp scans and beam position scan)
- Return to taking production data on D2 (see also below ``Production", trigger file rgf_inbending_v3_4, full D2 target, 240 nA beam).
- Cosmic runs when there is no beam: rfg_cosmic_ctof_pcalecal.cnf (but only if a cosmic run expert is available)
- Target purge once per day to be done by RC or RTPC expert/personal (inform expert first and bypass PT interlocks!). At the same time, check all gas bottles.
Production: Electron-inbending Configuration, D2/H2/4He target @ 10.4 GeV beam
DAQ config:PROD66; Trigger file:rgf_inbending_v3_4.trg
- Make sure beam blocker is in front of Faraday Cup
- After a longer beam-off period (assuming no major retuning of the accelerator), no harp scans are necessary. However, follow these steps to bring beam back:
- Ask for 10 nA. Check that all BPMs are within 0.1 mm of their nominal values.
- Ask for 50 nA. Check BMPs again and ask for orbit locks to be activated.
- Once orbit locks are running, ask for 240 nA.
- Ask MCC for 240 nA beam current (NOTE that 2C21A BPM will show 260nA. This is a known issue.)
- Please write the target pressure and comments in the dialogue box when starting/stopping a run
- Start a run and check that live time is above 85%. If not decrease current and log it.
- Restart a new run every 2h OR 10M events. END A RUN if beam will be off > 10 min, RTPC HV trip, or whenever half-wave plate is changed!
- Keep BTA (beam time accounting) up to date, including reasons for any entries with experiment not ready
- At the beginning of a run (at least every 2h while beam is on)
- *) Submit screenshots for the DAQvnc (select "statistics" tab), CLAS12 VTP Trigger GUI, ROC Busies, Beamline overview, beam strip charts, RTPC overview, BONuS HV from clascss. Do this only while beam is on!
- Run clas12mon over 20-30 min with good beam(!) and submit the occupancy plots (at least once per run). Compare with previous monitoring plots and make a log entry about any changes you observe. Make sure to reset monitoring plots regularly.
- Take at least one screen shot of RTPC CED with beam per run and post in logbook. De-select "Auto-event" and use Cntrl-N to browse for an event with tracks in it.
- When checking the ECAL response, make sure to look at the histograms for each sector by using the sector buttons at the bottom of the clas12mon window - if adcecal* or/and adcpcal* ROC crashes, there will be no alarm and the histograms are the way to notice this issue.
- For trigger alarms check Note 14 first!
Beam Restoration (last updated Feb 19)
Updated Manual is at [1]
- IF YOU GO DIRECTLY TO FARADAY CUP!!!: Quick beam recovery procedure including Harp Scan
- All HV are off (including FTOF)
- Check that 20 mm collimator is in
- Call MCC to unmask U/M/D counters but keep BOM masked or get it masked in case it isn't
- Call MCC to put 5nA to the FC.
- Compare the 2c21, 2c24, 2H01 positions and beam overview screen to the reference below
- Put thresholds on U/M/D as 1M/1M/1M and dwell time 50 ms.
- follow the procedures for the harp scans at 2H01 [2] (optionally at 2C21 and 2C24)
- Compare the results with the references scans below (be aware to use the correct analysis counter)
- if what you get is similar to the references, call MCC and tell them the the beam is acceptable and set FSD thresholds and dwelltimes as written below and continue with production running (see above)
- if what you get isn't similar to the references, do the other harp scans. If you are not sure if a tune of the beam is needed, consult beam line expert and/or RC.
At the end of each run, follow the standard DAQ restart sequence
(Note, this might be different from the instructions coming up on RunControl.)
- "end run", "cancel", "reset"
- if the run ended correctly:
- "download", "prestart", "go"
- if the run did not end correctly or if any ROCs had to be rebooted:
- "configure", "download", "prestart", "go"
References and Standards:
(last update Mar 21, 2020 @ 9:40 PM.)
Restoration of Beam to Hall B
Default solenoid current and B field 1935 A (~4.0 T)
Nominal Beam Positions
- 2H01, X: -0.1 mm, Y: -0.4 mm
- 2C24, X: +0.1 mm, Y: -0.4 mm
- 2C21, X: +0.1 mm, Y: 0.0 mm
- the acceptable trajectory for the beam before entering the hall must be established while on the tagger dump. The relation between the 2C24 BPM positrons and the X,Y values measured with the tagger harp are:
- X_harp=36.68-X_2C24
- Y_harp=20.97-Y_2C24
FSD Thresholds TEMPORARY UNTIL BOM REPARATIONS
- Upstream: 2000 Hz
- Midstream: 2000 Hz
- Downstream: 20000 Hz
- BOM: 100000
FSD Dwell time
- Upstream: 5 ms
- Midstream: 5 ms
- Downstream: 5 ms
- BOM: 5 ms
BONuS HV setting
Reference Harp Scans for Beam on Tagger Dump: 2C21 [3], 2C24 [4]
Reference Harp Scans for Beam on Faraday Cup: 2H01 [5], [6], 2C21 [7], 2C24 [8]
Reference Monitoring Histograms 5 nA production trigger [9]
Reference Scalers and Halo-Counter Rates:
- Well-tuned CW beam on FC, Full LD2 and 4He target, CLAS12 ON: 5 nA [10], 50 nA [11], 240nA [12]
- Well-tuned CW beam on FC, Empty Target, CLAS12 OFF: 5 nA [13]
- Well-tuned beam during Moller run [14]
- Well-tuned beam on Tagger Dump at 5 nA during harp scans: [15]
General Instructions:
- The main lights in the Hall (dome lights) and the Forward Carriage lights are being kept off because of light leaks affecting some of the detectors. If these lights are switched on during an access, they should be switched off when leaving the Hall. Note that the dome lights when switched off cannot be turned back on immediately because they require 10-15 min to cooldown.
- Get familiar with the shift crew responsibilities for the RTPC (see manual [16]). Especially on how to switch on the HV after a trip.
- Do not run more than 30 minutes above 30 nA with 5-pass beam without the beam blocker in front of Faraday cup. Put beam blocker in for long running at high currents for 5 pass operations.
- Turn DC HV off only for beam tuning; if no beam is available or when beam is stable, keep them on even if you are not taking data.
- With any issue contact On-Call Experts or RC - do not spend more than 15-20 min trying to fix the problem.
- Check for and read any comments to log-book entries made during your shift.
- During Day shift, check once per day with RC or RTPC expert whether they have purged the target.
Once Per Day (At 13:00):
- Complete RICH recovery procedure - see Note: 11 below
Every Shift:
- Follow run plan as outlined by RC
- If any concern about beam stability, ask MCC if orbit locks are on (they should be).
- Keep shift summary up to date in HBLOG. Record all that happens.
- Document any beam condition change and send scaler GUIs to HBLOG
- Fill out BTA hourly. Click "Load from EPICS" to automatically fill the left side.
- Upload spectra from clas12mon at beginning of each run and cross-check with reference spectra
- Reset clas12mon every ~2 hours or after extensive beam down and inspect spectra
- Fill and submit the shift checklist in the logbook
- Note 1: FTOF HVs: The goal is to minimize the number of power cycles of the dividers.
- should be turned off during the initial beam tuning down to the Faraday Cup after CLAS12 has been off for a long shutdown, when doing a Moller run, when doing harp scans, or if there is tuned/pulsed beam in the upstream beamline.
- should be left on after an initial beam tune has been established and if there are only minor steering adjustments and “tweaks” being made.
- if shift workers have doubts what to do with the HVs, they can always contact the TOF on-call expert for advice.
- Note 2: In case of a Torus and/or Solenoid Fast Dump do the following:
- Notify MCC to request beam OFF and to drop Hall B status to Power Permit
- Call Engineering on-call
- Make separate log entry with copies to HBTORUS and HBSOLENOID logbooks. In the "Notify" field add Ruben Fair, Probir Goshal, Dave Kashy and esr-users@jlab.org
- Notify Run Coordinator
- Turn off all detectors
- Note 3: When beam is being delivered to the Faraday Cup:
- the Fast Shut Down elements: Upstream, Midstream, Downstream, BOM, and Solenoid should always be in the state UNMASKED
- No changes to the FSD threshold should be made without RC or beamline expert approval
- Note 4: Any request for a special run or change of configuration has to be approved by the RC & documented
- Note 5: Carefully check the BTA every hour and run the script btaGet.py to print for you what HAS TO BE in BTA for this hour. Edit BTA if it is incorrect.
- Note 6: Reset CLAS12MON frequently to avoid histogram saturation. If CLAS12MON is restarted change MAX scale to 10 (default is 5) for DC normalized occupncy histograms. This would prevent them from saturation. See log entry [17]
- Note 7: Shift workers must check the occupancies! Use this tool to compare to previous runs: [18]
- Note 8: Check the vacuum periodically, make sure vacuum is not higher than 5e-5
- Note 9: Always reset the CFD threshold after all power off/on on the CND CAMAC crate
After the CAMAC crate (camac1) holding the CND CFD boards is switched off for any reason, it is mandatory to reset the associated thresholds typing the following command from any clon machine terminal: $CODA/src/rol/Linux_x86_64/bin/cnd_cfd_thresh -w 0 If this command is failing and the crate is not responding, reboot it as follows: roc_reboot camac1
- Note 10: Shift workers should anyway check routinely scalers to verify they update correctly and make a logbook entry if anomalies are observed after starting a new run.
- Note 11:
For RICH recovery procedures, please see Log entry https://logbooks.jlab.org/entry/3562273. This would apply in the cases of 1. DAQ crash: rich4 is not responding or 2. RICH alarms (LV,missing tile, temperature etc). If it does not work or you are uncertain about what to do, contact the RICH expert on call. Please, note that missing tiles typically occur due to lost communication. Keep in mind that the recovery procedure will kill DAQ. If DAQ is running for other purpose, rather than data taking (for which the RICH acceptance would be important) do not initiate the recovery procedure.
- The most critical parameter for RICH is the temperature of the photosensors. If the temperature rises above limits, an interlock will automatically turn the RICH HV and LV. If this happens, notify the expert on call and keep taking data without RICH.
- Note 12: If ROCs mvt1 and/or mvt2 are 100% busy: stop the run, power cycle FMT/BONUS FEU LV (accessible from RTPC Overview or FMT Overview, FMT/BONUS - All LV OFF, FMT/BONUS - All LV ON, HV stays ON), then roc_reboot mvt1, roc_reboot mvt2, wait until it reboots ('ssh mvt1' and 'ssh mvt2' to verify), press 'cancel', 'reset', in the run control GUI, proceed with a new run from 'configure'. If the first LV recycle / roc_reboot doesn’t work call RTPC/BONUS expert.
- Note 13: If ROC mmft1 is 100% busy: power cycle FTT LV (FT->FTT Overview, HV stays ON), roc_reboot mmft1, wait until it reboots (ssh mmft1 to verify). If the first LV recycle/mmft1 reboot doesn’t work call FT expert
- Note 14: Trigger Troubleshooting: If you get trigger alarms check first if the trigger bit of a sector alarms both, for the DC roads and non DC roads, in the trigger expert screen (DAQ --> CLAS1 Trigger --> Menu --> Table - Expert). If this is the case (i.e. sector 3 and bits 3 and 10), there might be a problem with HTCC, PCAL or ECAL rocs and you should check the rocs in the runcontrol. If the non DC trigger bit is working and only the one with DC alarms, you would need to check the DC trigger rocs (possibly the one from the alarming sector). If you are not sure, call RC or trigger expert.
Webcams |
Hall Webcams(the first time you open any camera in any browser, accept the security exception) |
Manuals |
Epics on the web
|
Fall 2018 Run
Spring 2018 Run
Hall-BRun lists |
Accelerator |
Bluejeans meetings
|
- Beamline Overview (requires CUE login)
- Strip Charts (requires CUE login)
- Upstream/Midstream Halo Counters
- Strip Charts (requires CUE login)
- Occupancy Histograms (reference needs updating)
- Bluejeans
- https://bluejeans.com/950041022
- on a clonpc## as user=clasrun, run "bluejeans"