Run Group C

[edit]

• Shift Documentation
• Phone Numbers
• Short Term Schedule
• GENERAL INFORMATION
• Shift Expert
• Worker Shift
• Monitoring
• Useful Links

Shift Schedule Hall B Logbook ESAD, COO, RSAD Note new DOE guidance on beam limits to FC! We should be allowed to run up to 90 nA without beam blocker. Shift Checklist Hot Checkout Beam Time Accounting See guidance at BTA User Guide.

Manuals Polarized Target Manual See also the OSP - scroll down for the target description Raster Operations Manual - see also Raster Monitoring Manual DC FTOF ECAL LTCC HTCC RICH: Expert Shift CTOF CND SVT MVT MVT turn on procedure FT Beamline Torus Power-Up/Down Procedure Solenoid Power-Up/Down Procedure DAQ Slow Controls

Procedures Physics-Quality Beam Performing Møller Runs Performing Harp Scans Tunnel/Hall Access ESAD, COO, RSAD

JLab Logbooks MCC Hall-A Hall-B Hall-C Hall-D

NOTE: All NON-JLab numbers MUST be dialed with (757) area code. When calling from a CH landline, dial "9" first. To call from outside, all 4-digit numbers must be preceded by 757-269

Role Phone Number Hall B Run Coordinator (757) 575-7540 (cell) Hall B Physics Division Liaison (757) 876-1789 (cell) MCC 7048 Crew Chief 7045 Crew Chief (757) 876-3367 (cell) Program Deputy (757) 876-7997 (cell) RadCon (757) 876-1743 (cell) Gate House Guard 5822 Location Phone Number Hall B Floor 5165 Hall B Space Frame 5170 and 5171 Hall B Forward Carriage 5371 Hall B Gas Shed 7115 Hall B Counting House 5244 (Shift Expert) Hall B Counting House (757) 329-4846 (Shift Expert cell) Hall B Counting House 5245 or 5126 (Shift Worker) Hall A Counting House 5501 Hall C Counting House 6000 Hall D Counting House 5504

Hall B System Phone Number On-Call Person Engineering (757) 748-5048 (cell) (757) 897-9060 (cell) Engineering On-Call (primary) Denny Insley (secondary) Slow Controls (757) 748-6922 (cell) Nathan Baltzell Beamline (757) 303-3996 (cell) Eugene Pasyuk DC (757) 218-4372 (cell) (757) 748-5048 (cell) Florian Hauenstein (primary) Engineering On-Call (secondary) SVT/MVT/MM (757) 541-7539 (cell) (757) 753-7769 (cell) Yuri Gotra (primary) Rafo Paremuzyan (secondary) ECAL (757) 810-1489 (cell) Cole Smith FTOF/CTOF/CND (757) 344-7204 (cell) Daniel Carman ALERT (757) 329-4844 (cell) Raphael Dupré HTCC/LTCC (757) 344-7174 (cell) Youri Sharabian FT (757) 344-1848 (cell) Raffaella De Vita BAND (757) 310-7198 (cell) Florian Hauenstein RICH (757) 344-3235 (cell) (757) 748-6922 (cell) Christopher Dilks (primary) Nathan Baltzell (secondary) DAQ (757) 232-6221 (cell) Sergey Boiarinov HYDRA (317) 550-9226 (cell) Torri Jeske Authorized Hall B Solenoid/Torus Operators Hall B Denny Insley, Morgan Cook, Eugene Pasyuk Magnet Group Probir Ghosha, Renuka Rajput-Ghoshal Detector Support Group Brian Eng, Pablo Campero, Tyler Lemon DC Power Onish Kumar, Sarin Philip

• Note, all non-JLab numbers must be dialed with an area code. When calling from a counting-house landline, dial "9" first.
• To call JLab phones from outside the lab, all 4-digit numbers must be preceded by 757-269
• Click Here to edit Phone Numbers. Note, you then also have to edit the current page to force a refresh.

Click Here to edit Phone Numbers. Note, you then also have to edit the current page to force a refresh.

CLAS12 Run Group C

Run Coordinator: Mohammad Hattawy (9-)757 575-7540

PDL: Eugene Pasyuk (9-)757 876-1789 , x6020 office

Run Group Coordinator: Sebastian Kuhn (9-)757 639-6640

Daily RC Meetings at 14:00: CH Room 200C, and on Zoom Zoom information: Link, Meeting ID: 160 867 4253, Passcode: 786506

Run Coordinator and Target Expert Schedule

Longterm Run Plan

Medium-Term Run Plan (FTon Portion Part 2)

IMPORTANT SHIFT NOTES

* In case of medical or fire emergency, call 9-911 from a LANDLINE phone in the Counting House
* If you have symptoms or a positive COVID test, do NOT come to your shift - instead, inform the PDL and the RC and JLab medical services immediately so that replacements can be arranged.
* Remote shift: If needed, worker shifts can be taken from off-site. Inform the PDL and RC. Also, make sure that you follow the instructions under the "Worker Shift" Tab - you need some lead time to set up!

Note to shifts, please:
* read the logbook, be aware of previous 24 hours
* arrive at least 10 minutes early for shift change
* refresh the run wiki pages, look over them every shift:
** follow the expert/worker shift instructions 
** find latest pitfalls and known issues under GENERAL INFORMATION
* communicate with your co-shift person
** the shift expert should know about and refer to logbook entries in their shift summary
** the shift worker should discuss an issue with the shift expert before making extra logbook entries

Short Term Schedule for the Week from Wednesday, March 15th, to Monday March 20th, 2023

• Current: 4 nA

• Run duration: 100M events or 4 hours, whichever comes first.

• Note, BOM is not installed for this experiment, so it does not matter whether it appears masked in FSD or not.

• The Faraday Cup power limit for the continuous operation was lifted up to 1 kW. For the remainder of the RG-C the beam blocker should not be used https://logbooks.jlab.org/entry/4047791

• Conditions for raster operation:
  • IF there is any ammonia sample (NH3 and ND3) in the target, the raster MUST be operating at all times. The Raster FSD must be UNMASKED. Orbit locks MUST be OFF (except for brief moments to restore beam position).
  • For beam tuning or other non-rastered beam, the Raster FSD must be MASKED.
  • If MCC needs to diagnose beam with a harp, we can offer them tagger 2C24 and follow the procedures required for that. 2H01 harp scan should not be done when we have beam raster on.
  • Changing raster offset: ask MCC to NOT correct whatever happens on 2H01. Note new 2H01 values and inform MCC of the new 2H01 x and y values - then they can keep the beam at those positions.

• Experiment setup is "FTon"

• If HWP is changed, start a new run

PLAN for March 15-20, 2023

Note: an hour before changing the HWP, call Bill Henry (from Hall A) at 215-908-2245. He offered his help in optimizing the beam charge asymmetries when changing the HWP. He will stop by the counting house and run his code, which will take a minute. We will do the HWP changes during the day shifts.

• Wednesday, March 15th: Beam study downtime starts at 8:00 AM. Beam is expected to be back by 15:00 PM. If they beam shows up before 22:00 PM, we will need to take a Moller run. Then, start taking data on ND3(+) (torus outbending, 4nA beam current, HWP IN).
• Thursday, March 16th: Data taking on ND3 (+) (torus outbending, 4nA, HWP out)
• Friday, March 17th: anneal the target and flip the polarization to negative. Will take about 3 hours starting around 9AM. Then, take data on ND3 (torus outbending, 4nA, HWP out)
• Saturday, March 18th: Continue taking data on ND3(-) (torus outbending, 4nA, HWP IN)
• Sunday, March 19th: Will change the target to C sometime in the day shift and start taking data. Will go to restricted access and will organize this between RadCon and Target Experts.
• Till Monday, March 20th, 07:00 AM: Continue taking data till the beam goes away.

• When the beam goes away:

1. Turn all HV OFF except SVT and BMT. For FT we turn HV OFF, but keep the chiller and LV ON, Raffaella will do some LED calibrations.
2. Solenoid will remain ON for the target group to do NMR studies.
3. The torus should be ramped down. Morgan or Denny can do it if they are around at that time, or call Eugene and he do it.
4. The hall should go to controlled access awaiting for radcon to come and do a full survey for restricted access.

NOTES: 
* Watch the beam positions (and thus the midstream halo counters) closely and ask MCC to adjust the positions if they are (on average) >=0.1mm off.
* Remember, the hall will only be dropped in controlled mode once someone goes downstairs and enters the hall. You/RadCon should do that right away after calling MCC. 

DAQ configuration

• Configuration is currently PROD66/PROD66_PIN, trigger file rgc_300MeV_v1.4_no_DC.trg
• NOTE: UNLESS a RICH problem crashes the DAQ, do NOT interrupt an otherwise smooth run to do a RICH recovery - instead do this in between runs.
• NOTE: BOTH the shift expert AND the shift worker MUST check and reset monitoring histograms at least once every 30-60 minutes to make sure there are no major detector problems. Sometimes it is the only way to know that a roc needs to be rebooted. Watch the raster pattern!
• At the end of each run, follow the STANDARD DAQ RESTART SEQUENCE:
  • "end run".
  • If the run ended correctly and you will run with the same configuration and trigger file, then: "prestart", "go"
  • If you are changing configuration (between PROD6X and PROD6X_PIN) or trigger file: "cancel", "reset", "configure", "download", "prestart", "go".
  • if the run did not end correctly or if any ROCs had to be rebooted:
    • Quit ALL running instances of mon12 and rastermon
    • "cancel", "reset"
    • "configure", "download", "prestart", "go"
    • restart mon12 and rastermon
• After each step, make sure it is completed in the Run Control message window. If a ROC has crashed, find which one it is, issue a roc_reboot command ON JUST THAT ROC and try again. Contact the DAQ expert if there are any questions.

References and Standards

5-pass (10.55 GeV) Running conditions

• Torus at 100% current, inbending electrons. Setpoint = +3770 A (Readback = +3766 A)
• Solenoid set-point of 2416.4 A results in the read back 2419.23 A and exactly 5.00 T field on center

Raster settings (current as of February 9, 2023)

• x: Vpp = 2.7 V, offset = 0.0
• y: Vpp = 2.05 V, offset = 0.50 V
• Fundamental Period = 2 s
• The correct raster calibration constants should be automatically loaded by rastermon - if not, enter them through "Config" by hand:
• f(x) = 0.0104*x + -25.5
• f(y) = -0.0115*y + 24.4

Nominal Beam Positions (current as of February 9, 2023)

• 2C21A, X = -0.4 mm, Y = +0.6 mm
• 2C24A, X = -2.0 mm, Y = +0.6 mm
• 2H01, X = -1.0 mm, Y = +0.9 mm
• Orbit lock on 2C24 and 2H01 ONLY if raster is OFF, otherwise orbit lock on 2C21 and 2C24 (note: this appears as "stopped" on the beam line GUI).

FSD Thresholds

• Upstream: 2000 Hz
• Midstream: 2000 Hz
• Downstream: 100000 Hz (1e5)
• BOM: 1000000 Hz (BOM not installed for RG-C)
• 5 ms dwell time

Reference plots and histograms

• Harp Scans for Beam on Faraday Cup, 2H01 [1], more recent scan (3 Sept 2022): [2]
• Harp Scans for Beam on 2C21 [3], more recent scan (3 Sept 2022): [4] , even more recent scan (1 Feb 2023): [5]
• Harp Scan on Tagger Dump (3 Sep 2022) [6], more recent scan (1 Feb 2023): [7]
• RasterMon (20 Oct 2022) [8], more recent raster (2 Feb 2023): [9]
• Monitoring Histograms
  • run 17240, DAY Fr, 10/21/2022, ND3 (ECAL good) https://logbooks.jlab.org/entry/4065165
  • run 17348, DAY We, 11/02/2022, CH2 https://logbooks.jlab.org/entry/4075177
  • run 17363, OWL Sa, 11/05/2022, NH3 https://logbooks.jlab.org/entry/4076956
  • run 17492, DAY Th, 02/02/2023, ND3 (post-solenoid hiatus) https://logbooks.jlab.org/entry/4122528
  • run 17542, EVE Th, 02/09/2023, ND3 https://logbooks.jlab.org/entry/4127691
  • run 17547, DAY Sa, 02/11/2023, ND3 https://logbooks.jlab.org/entry/4128938
  • run 17562, DAY Mo, 02/13/2023, ND3 https://logbooks.jlab.org/entry/4130446

Counter rates

• With 6 nA beam, the upstream counters should read zero.
• The Midstream ones should read 0-20 Hz or so.
• Greatly increased rates may indicate bad beam tune or bleed-through from other Halls.

see below for Known Detector Issues

General Information

• To open CS Studio interface, type "clascss" in some terminal.

• Controlled access: after you call MCC, they will drop the hall to controlled access once someone goes down and calls them for entry. Then call when they should go back to beam permit and call again to say you want the beam back and what beam current. Rapid access is controlled access without RadCon.

• If MCC needs to diagnose beam with a harp, we can offer them tagger 2C24 and follow the procedures required for that. 2H01 harp scan should not be done when we have beam raster on.

• BMT:
  • After HV trip: the channel HV should be turned back on as soon as you notice the trip, power cycle by turning HV OFF and ON without waiting for any amount of time.
  • HV frequently tripping: Call expert. Do not change HVs without approval from the expert.

• mon12: It can happen that histograms do not get cleared completely at run start. This is seen eg as an excess of small multiplicities. The remedy is to quit mon12 and open it again. Other than that, small multiplicities come from time intervals with beam down. You might want to look at the multiplicities before uploading the mon12 histograms in the logbook.

• DAQ:
  • rastermon should be using ET on clondaq6
    • this means startup of rastermon via command line: rastermon --et --host clondaq6
  • It should no longer be necessary to quit RasterMon at the end of each run and restart after a successful "Go" for the next run. However, if DAQ crashes, you SHOULD follow these steps, and the same for mon12.

• Magnet trip: call "Engineering on call", if due to cryo, also inform the target expert about the cryogenic issues.

• Holes in CND occupancies: CAMAC CFD crate was turned off/on for some reason. You need to run the script to set the thresholds for CND CFDs. Go on a clondaq machine and type cnd-cfd-thresh -w 0. Or call the CND phone if this doesn't work.

• Hall lights: Before leaving the hall and going to beam permit check that dome lights, forward carriage lights, and pie tower lights are OFF.

• Moller runs: should be taken with 8-10 nA.

• Beam viewer: Please REMOVE the beam viewer unless we are actively tuning the beam or calibrating beam position/raster, to avoid damage to electronics, cameras etc.

• Change of running conditions
  • Check that the trigger alarms (on rate/nA) are set appropriately and RC changes them as needed.
  • Whenever the target type or polarization direction changes, or the half-wave plate status changes, make sure to enter a comment in the BEGIN RUN / END RUN comment box.
  • Do not change running conditions while a run is ongoing. This includes changing target polarization or HWP, etc.

Known Issues

FTT alarms - can be ignored (we do not have the FTT installed)

Fr 11 Nov 2022 ECAL PMT_SEC2_WO8 HV is disabled https://logbooks.jlab.org/entry/4080950

Follow-up Re: RICH tile 21 in sector 1 is dead. Working without one tile out of 276 for a moment https://logbooks.jlab.org/entry/4079453

Run #17396: RICH lost three scalars https://logbooks.jlab.org/entry/4079190

Tuesday, February 7, 2023: BMT Sector 2 Layer 5 is broken (HV set to 200 V)

Shift expert tasks

• Come to your shift in time for the shift change, 10-15 minutes before the start of your shift.
• Follow the Short Term Schedule as outlined by RC
  • Run Plan, DAQ Configuration, and References and Standards
  • also check tab GENERAL INFORMATION
• Keep shift summary up to date in HBLOG. Record all that happens.

• Ensure that all monitoring plots are logged correctly and checked against the reference plots for every single run, see link under https://wiki.jlab.org/clas12-run/index.php/Run_Group_C#Useful_Links
• Both, you and the shift worker should reset & check spectra frequently

• Polarized target:
  • Helicity-Latched Trigger GUI and the Helicity Trigger Asymmetry strip-chart (not accessible remotely) (example https://logbooks.jlab.org/entry/4041939). (ONLY WHILE ACTUALLY RUNNING ON NH3 AND ND3 targets!)
  • In case of any issues, contact the polarized target expert on call.
  • Ice on the run valve
    • See the run valve via camera http://hallbcam04/view/index.shtml, (see also Camera on PT12 -- web link at Lognumber 4002803.) Example of ice on the valve, see https://logbooks.jlab.org/entry/4001225.
  • NMR running (ONLY WHILE ACTUALLY RUNNING ON NH3 AND ND3 targets!)
    • The JLab Polarization Display is seen via a VNC window in the counting room. Here, the NMR Controls' blue bar must be moving, indicating that the NMR is running and the polarization is measured.
    • If the NMR display is frozen or disappears, here are the steps to follow:
      • Open a new terminal window on the bottom right-most screen.
      • Type "ssh clasrun@clonsl1"
      • Type "nmr-vnc”
      • Click "Run" under "NMR Controls" - the window should now be updating (blue bar moving)
    • The NMR frequency needs to be controlled by hand. If you see target polarization (on the red graph) starting to drop, call the expert. They will guide you through the adjustment procedure. This will be in the electronics room by the door to the counting room, in the third crate from the right ("CR-6"). White box which says "EIO Tube" and has a red button at the top right, which says "Move", next to a display for "Position". This will be the one to press, under guidance of the target expert.
  • Alarms from System RG-C Polarized Target (alarm handler).

• Do a RICH recovery (press the RICH Recovery button on the GUI) once daily during day shift, between runs. Please log in shift summary.
  • Note the automated "RICH Recovery" sequence already confirms RICH4 is up and accepting ssh connections before claiming success.
  • You have to "Cancel->Reset->Configure->Download->Prestart" before starting the next run.

• Fill out BTA hourly. Click "Load from EPICS" to automatically fill the left side then correct as needed.
  • Accelerator beam time:
    • ABU: acceptable beam used (eg harp scans, calibrations, trigger settings, running)
      • The info from EPICS is not always correct, e.g. when taking data with low beam current, you should change the ABU to the proper (estimated) time by hand instead of simply accepting "0" if you are actually taking data.
    • BANU: beam acceptable but not used (eg radiator change or our problems)
    • BNA: beam not acceptable (eg tuning, drifting, not focused)
  • Experiment beam time
    • ER: experiment ready
    • PCC: planned configuration change (when beam is masked while radiators are moved, DAQ (stopping/starting runs, tests, ...) are PCC..
    • UED: unplanned experiment down, is used for hardware failure
  • Enter fields at tab "Shift Information"
  • Promptly send "Info for MCC" at 7:00, 15:00, and 23:00
  • Sign, viz log completed 8 hour sheet

In case of other questions or uncertainties of what to do, call the RC or PDL

(remote) shift worker: see dedicated Worker Shift tab above.

Shift Worker Tasks

• Check the information in the Short Term Schedule and GENERAL INFORMATION, for every shift
• Come to your shift in time for the shift change, 10-15 minutes before the start of your shift.
• Use the new HBRUN logbook for automated and run-specific entries and screenshots, see https://logbooks.jlab.org/entry/4048698

Make the following log entries ONCE per run

• Screenshots: submit to logbook only if you capture the information with beam ON
  • Beamline Overview, in VNC or Web Browser
  • CLAS12 Trigger rates and DAQ status
  • RGC Polarized Target GUI - under Beamline on CS-Studio
  • Helicity Asymmetry Strip Charts - see [10] for an example. Also read and follow the instructions below under "Log the Strip Charts".

• Upload monitoring plots to logbook
  • Standard spectra (mon12): inspect all monitoring histograms ' and carefully compare them to the corresponding reference histograms: reference, current, and 5 most recent runs, see link under tab Useful Links
    • You can choose a different reference run if you are confident what you are doing, the reference numbers refer to logbook entries.
  • Raster Monitoring (use "Log Entry" button on RasterMon screen at bottom-right corner).
    • An example of a "decent looking" RasterMon is here: [11]. The x and y distributions should show a smooth dome, without any horns or spikes on it and without the distributions being cut off at the edges.

Once per shift:

• Fill the shift checklist
• Log screen shots of RICH temperature and scaler maps. Log in RICH logbook.

Regularly:

• reset & check spectra frequently (every 30 - 60 minutes)
  • Some plots in the online mon12 have a choice of histogram sets per sector, select buttons at the bottom of the plot. That means you have to look at all sectors for these histograms.
  • The logbook entry shows all histograms.

• Check the life cam of the polarized target run valve for plumes or ice buildup (hallbcam04)
  • Make sure you refresh the web page! Its no longer necessary to put a snapshot into the logbook UNLESS something looks suspicious. In THAT case, immediately inform the target expert(s).

• Log the strip charts in time intervals according to the x-axis time span, via right-click on the screen and selecting "Make Elog Entry". Make sure NOT to submit to ELOG.
  • Beam current and position strip-charts (CS-Studio -> Beamline -> Strip Charts)
  • Helicity Trigger Asymmetry strip-chart (CS-Studio -> DAQ -> Helicity-Latched Trigger GUI Screen -> click on "Menu" -> myaPlot (not accessible remotely) -> Choose "load config time axis: start: -12 hours end: NOW" and click "accept"
    • Example
    • Choose reasonable y / x axis ranges: R-click on the axis -> Modify (axis-name) Axis
    • For the y axis in the bottom panel, choose the NMR polarization and a reasonable range for the y axis (always from 0 to some maximum value), same for the 60-min trigger bit polarization. Those two do NOT have to have the same scale - it is better to try to get the dark blue and red curves to lie on top of each other (more or less).
    • Set the time axis auto-update. ">>" symbol will appear below the time axis when this is activated. (Right-click on X axis ->" [A] Set Auto Time Stepping")

• You can also see beam charts in the Web Browser: Upstream/Midstream Halo Counters, Downstream Halo Counters, Beam Currents, BPM Positions

For REMOTE Shifts (offsite):

• Zoom for 24-7 communication with counting house: https://jlab-org.zoomgov.com/j/1619881100
  • Passcode REQUIRED: 927417
• Remind the expert in the counting house to restart their zoom, if necessary

• Remote VNC connection instructions: https://logbooks.jlab.org/entry/3906039
  • All necessary applications should be avaible from the desktop menu (left/right click on the desktop)
• EPICS GUIs should be accessed ONLY via the desktop menu or by running clascss-remote.
• Remote Demonstration Video (150 MB)

ATTENTION: If you plan to take (a) remote shift(s), you MUST test your setup (including VNC connection) at least 24 hours before your first shift!

Webcams Tagger Beam Dump Viewer Hall Fisheye Faraday Cup beam viewer To reboot it, run beam-viewer-reboot Hall Cameras: Hall A, Hall B, Hall C, Hall D

Manuals CED Manual MON12 Manual RasterMon Manual off-line Manual

Epics on the web Hall B WebOPI (CUE Login) Accelerator Polarization Strip Chart on the web

Live Monitoring Links CLAS12 Monitoring Timelines Live Charge Collected Plots for FTon '23 Charge Collected Plots for FTon '22 Charge Collected Plots for FToff '22 Total Charge on Target Plot Hydra (CUE Login) Google-Chrome ONLY, Not Firefox!

Hall-B Operation Safety Procedures Run Group C Analysis Wiki RCDB All monitoring histograms: reference, current, and 5 most recent runs CLAS12 mon page Run Coordinators and Target Experts Instructions and List

Accelerator Accelerator Whiteboard Program Deputy Shift Plans Run Coordinator Reports Beam Time Accounting Reports PSS Elog

ZOOM meetings 07:45 RC/PD Morning Meeting 08:00 MCC/OPS Morning and Wednesday 1:30 Meeting See also this log entry (Week-)Daily RC Meeting Zoom Link Meeting ID: 160 867 4253 Passcode: 786506 Meeting Schedule and Agendae