Difference between revisions of "The HPS Run Wiki"

Revision as of 15:59, 25 August 2021

COO, ESAD, RSAD Things to read before shift.

Remote worker shift - requirements and responsibilities

HPS 2021 Run discription and beam parameter requirements

Procedures

Procedure for establishing physics quality beam
Commissioning Plans:
- Trigger
- ECal
- SVT
- Hodoscope
Tunnel/Hall Access
Power Failure

Manuals

JLab Logbooks

HPS (E12-11-006) 2019 run, June X to August Y'
Beam energy 4.5 GeV
Important: Document all your work in the logbook!
Bluejeans for Run Meetings on DAY and DAY at 2pm

RC: Stepan Stepanyan

(757) 575-7540
9 575 7540 from Counting Room

PDL: Valery Kubarovsky

(757) 876-1789
9 876-1789 from Counting Room

Important instructions

* Turn OFF beam before target move!

* No access to the alcove if the chicane magnet beacon is ON.

Chicane magnets must be OFF if the hall is in Controlled access and access to the alcove is needed or when the hall is in Restricted access. If Chicane magnets are OFF, they can be energized only when the hall is in Power or Beam Permit, [1].

* TURN OFF the chicane magnet if beam is not available due to a thunderstorm. Loss off power would seriously damage detectors.

* Fill out BTA hourly. Click "Load from EPICS" to fill the left side, then make sure numbers are correct. If needed edit the entry.

NO ABUs or BANU if beam tune is in progress, make it all BNA with ER 100%. At the end of the shift save BTA to the logbook!

* Please close any GUI that is not being used, e.g. close harp scanner after harp scan is done, close chicane, after chicane is ON, etc.

* For orbit lock positions on 2H00(X=-0.5,Y=1.5) and on 2H02(X=-1.55,Y=-0.4). Use the 2.82 mm SVT collimator

am profile check once a day, at 9 am, using 2H02 and SVT wire harps

Run Plan August 27 - 30, 2021

Beam commissioning
ECal and Hodoscope commissioning
SVT commissioning
Setting up Trigger and DAQ

Every Shift:

Follow the run plan as outlined by RC
With any issue contact On-Call Experts or RC
Monitor carefully the SVT bias current (see below for details)
If any concern about beam stability, ask MCC if orbit locks are on (they should be ON).
Keep shift summary up to date in HBLOG. Record all that happens.
- Document any beam condition change and send scaler GUIs to HBLOG
- Fill out BTA hourly. Click "Load from EPICS" to automatically fill the left side then make sure numbers are correct. If needed edit the entry. Note: in the "Sift information" tab choose experiment E12-11-006. . At the end of the shift send BTA to teh logbook.
- Fill and submit the shift checklist in the logbook

Every Run:

After "Go": Check SVT Occupancy
Update the Run Spreadsheet
Log screenshots of:
- main scaler_hps display
- ECAL FADC rate gui
- Trigger rate gui
- SVT and HODOSCOPE and ECAL Monitoring pdfs
Please watch Hybrid sync GUI for correct status (currently three red lights) and the L0-3 and L4-6 occupancy plots for any empty plots beyond the expected three.

SVT Bias Currents:

Shifters must pay attention to the L0 bias currents. This is on both the SVT motor GUI and the main bias GUI. The bias currents will slowly creep up over the course of a run. When the bias current is between 15-20 uA for either L0 sensor, do the following:

Stop the run.
Take the beam away, turn off SVT bias voltages, and wait 10 min.
Turn the bias voltages back on.
Check that the L0 bias currents have gone back down to ~4 uA
Bring back the beam and start a new run.

Do not let the bias current exceed 20 uA. It takes about 4-5 hours for the bias currents to creep up to those values. Call SVT expert if unsure.

Harp Scan Procedure:

During harp scans, SVT must be retracted (motors/SVT Positioners). HVs on SVT, ECal and Hodoscope should be OFF.
Halo counter FSDs (Downstream, HPS Up and HPS Down) are masked, Beam current 100 nA, Orbit locks running.
Perform the HARP scan, log the results.
If the beam looks different, you should call beam-line on-call that will advise on the next steps.
If the beam looks different, perform SVT wire scan, the target needs to be retracted as well for this one.

Important Notes:

When re-establishing beam to Hall B after a >1h long downtime follow "General Guidelines" on the right and the Beamline Procedures and Manual on the shift documentation page. Do not hesitate to call the beamline expert.
Do not run more than 60 minutes above 30 nA without the beam blocker in front of Faraday cup. Put beam blocker in for long running at high currents.
For SVT Operations:
- From the time beam first comes into the hall until it is being delivered to the Faraday cup with orbit locks on for a known good trajectory, the SVT should be completely off. This is especially important during tuning to the tagger dump, when mis-steering of the beam can result in very high hard neutron backgrounds.
- Once stable beam is being delivered to the Faraday cup with orbit locks on for a known good trajectory, and the SVT collimator is in position, the FEBs and hybrids can be powered and operated, but the HV bias for the sensors must remain off.
- In order to turn on the HV, the FSD system must be functioning so a beam excursion that hits the collimator will quickly trip off the beam.

General Instructions

Establishing Physics Quality Beam for HPS:

Make sure SVT is retracted and detectors, SVT, Hodoscope and ECAL are OFF.
If the beam was off for 4 hours or more or in case of troublesome beam tuning, send a beam to the tagger dump:
- Check that beam type is set to "Photon" (HPS_EPICS->Beam->BTA).
- Position "Blank" on the beam for the Hall-B collimator
- Ask MCC to turn ON the tagger magnet and then deliver <10 nA beam to the tagger dump.
- Check the beam position on the tagger viewer, it should be approximately in the center of the screen
- Follow instructions under "Procedures" on the documentation tab for "Beamline"[2]. To tune the beam on tagger dump and perform harp scans beam current should be <10 nA.
- Check profile using 2C21 and tagger (2C24) harp scans and compare the positions and widths with previous scans ([3],[4])
  - Positions on both harps should be within 1mm
  - Width on 2C21 should be <~0.2+/-0.05 mm
  - Width on tagger harp (2C24) <~0.5 +/- 0.1mm
- Background levels on harp scan are comparable to those of previous scans.
Before sending a beam to the Faraday cup
- If HPS chicane must be ON, make sure that chicane GUI says "Chicane Ready"
- Set Hall-B Collimator to 20 mm.
- Check that SVT protection collimator is ON THE BEAM (2.82 mm). If the beam was off for more than 4HPS hours or the configuration has changed, start with 3.94 mm
- HPS target is OUT and Hodoscope and ECAL HVs are OFF
- SVT is OUT (position=0.000 mm on the main HPS scaler GUI) and bias HV is off (all red/green indicators RED in SVT bias GUI)
- If any uncertainty, page the experts
- Pay attention into following corrector values: 2C22H, 2C23V, 2H00H, 2H00V, Compare them to ones that are in [5]. Make sure their values don't differ more than 100%. If there is such difference, tell MCC about this.
Send beam to the Faraday cup
- If the beam optics is correct, then you should immediately see the beam spot on the Downstream Viewer and on the 2H00 and 2H02 BPMS.
- If you don't see it immediately, and rates on halo counters are more than 100 Khz, then ask MCC, to change to pulsed (tune mode) beam, and ask to restore corrector values. At this point don't accept any CW beam, until beam spot is visible on Downstream Viewer.
- If MCC operator is not able to tune the beam more than 15 minutes, then notify RC!
- Follow the instructions under "Procedures" on the documentation tab for "Beamline"[6] to establish beam to the electron dump.

Note: in order to have reliable readings on two important for HPS BPMs, 2H00 and 2H02, beam current should be >30 nA.

- Ask MCC to establish 30 nA beam with HPS orbit locks on (We need HallBHPSOrb not HallBOrb configuration). For orbit lock positions on 2H00(X=1.0,Y=1.5) and on 2H02(X=-1.7,Y=0.3). Use the 2.82 mm SVT collimator. (positions changed 6/25/19 by mg).
- Tune beam profile at HPS using measured widths on 2H01A and 2H02A harps. The required beam profile at 2H02A harp is: X-width <~0.1 mm, Y-width <~ 0.05 mm. Beam profile using 2H01A and 2H02A harps with previous scans ([7],[8]) to compare.
- Check and log the beam spot on chromax viewer
- The halo counter rates before HPS must be very low:
  1. Upstream Left and Right, and the tagger counters few 10's of Hz,
  2. Downstream counters should count <Hz/nA
  3. The halo counter rates on HPS, HPS-L/R/T/SC, depends on the collimator and HPS chicane settings, but should not be more than 50 Hz/nA [9]
- Positions on BPMs must be close to what they were before [10]
- When everything is stable, perform SVT wire scan and compare with the nominal [11]
- Once all the above is achieved, turn ECAL and Hodoscope HV ON to monitor and log ECal rates
- Insert the 20 um W target (turn beam off first).
Before accepting beam, make sure all the previous conditions are met. Always read previous log entries, compare settings of BPMs and correctors with previous settings using scaler_hps GUI.

RC daily meetings at 2 pm in the counting-house 2nd-floor conference room.

BlueJeans Info:

URL: https://bluejeans.com/794825703

Meeting ID: 794825703

Status of the run

Run Coordinator
08/23 - 09/01	Stepan Stepanyan
09/01 - 09/08
09/09 - 09/15	Maurik Holtrop
09/15 - 09/22
09/22 - 09/29	Tim Nelson
09/29 - 10/06	Rafayel Paremuzyan
10/06 - 10/13
10/13 - 10/20	Cameron Bravo

Physics Division Liaison
HPS-2019	Valery Kubarovsky

Beamline
08/23 -	Eugene Pasyuk
-

SlowControls
08/23 -	Nathan Baltzell

ECAL/HODOSCOPE
08/23 -	Nathan Baltzell
-

DAQ
24/7/365	Sergey Boyarinov

SVT
08/23 -	Tim Nelson
-	Cameron Bravo
-	Omar Moreno
-	Matt Solt
-	Vitaliy Fadeyev
-	Matt Solt

Webcams:

Accelerator:

Slow Controls:

Online & Offline:

System/Person	Pager/Phone Number
Run Coordinator	(757) 575-7540 (cell)
Physics Div. Liaison	(757) 876-1789 (cell)
MCC-OPS	7048
Crew Chief	7045
Crew Chief	9-879-3367 (cell)
Program Deputy	9-876-7997 (cell)
Gate House Guard	5822
DAQ/Online	(757) 869-2188 (cell)
SVT	(757) 329-4844 (cell)
ECAL	(757) 810-1489 (cell)
Slow Controls	(757) 748-6922 (cell)
Beamline	(757) 303-3996 (cell)
Engineering	(757) 748-5048
Hall-B Floor	5165
Hall-B Space Frame	5170, 5171
Hall-B Forward Carriage	5371
Hall-B Counting Room	5244(Shift1), 5245(Shift2)
Hall-B Counting Room	5247(Expert), 5502(Target)
Hall-B Counting Room	5246(RC1), 5126(RC2)
Hall-B Gas Shed	7115

Add documentation for remote shifts here!

Bluejeans for 24-7 communication with counting house: https://bluejeans.com/950041022
Remote VNC connection: https://logbooks.jlab.org/entry/3880107
All necessary applications should be avaible from the desktop menu (left/right click on the desktop)
- EPICS GUIs should be accessed ONLY via the desktop menu or by running hps_epics_remote.
- Online Occupancy Monitoring
  - ECAL/HODO
  - SVT
- Online Full Reconstruction
  - jas3 or http://clonfarm11.jlab.org:8080/HPSRecon/
  - Expert

Shift Worker Backup Table

To add your name, edit this wiki page or send email to Maurik or Nathan.

Worker Shift Backup
Date	Day	Swing	Owl
Sun, Aug 22	-	-	-
Mon, Aug 23	-	-	-
Tue, Aug 24	-	-	-
Wed, Aug 25	-	-	-
Thu, Aug 26	Raffaella De Vita	-	-
Fri, Aug 27	Mariangela Bondi	-	-
Sat, Aug 28	Mariangela Bondi	-	-
Sun, Aug 29	Mariangela Bondi	-	-
Mon, Aug 30	-	-	Raffaella De Vita
Tue, Aug 31	-	-	Mariangela Bondi
Wed, Sep 1	-	-	Mariangela Bondi
Thu, Sep 2	-	-	Raffaella De Vita
Fri, Sep 3	-	-	-
Sat, Sep 4	-	-	-
Sun, Sep 5	-	-	-
Mon, Sep 6	-	-	-
Tue, Sep 7	-	-	-
Wed, Sep 8	-	-	-
Thu, Sep 8	-	-	-
Fri, Sep 10	-	-	-
Sat, Sep 11	Raffaella De Vita	-	-
Sun, Sep 12	Andrea Celentano	-	-
Mon, Sep 13	Luca Marsicano	-	-
Tue, Sep 14	Luca Marsicano	-	-
Wed, Sep 15	Raffaella De Vita	-	-
Thu, Sep 16	Luca Marsicano	-	-
Fri, Sep 17	Andrea Celentano	-	-
Sat, Sep 18	Andrea Celentano	-	-
Sun, Sep 19	-	-	-
Mon, Sep 20	-	-	-
Tue, Sep 21	-	-	-
Wed, Sep 22	-	-	-
Thu, Sep 23	-	Andrea Celentano	-
Fri, Sep 24	-	Raffaella De Vita	-
Sat, Sep 25	-	Raffaella De Vita	-
Sun, Sep 26	-	Luca Marsicano	-
Mon, Sep 27	-	-	-
Tue, Sep 28	-	-	-
Wed, Sep 29	-	-	-
Thu, Sep 30	-	-	-
Fri, Oct 1	-	-	Marzio de Napoli
Sat, Oct 2	-	-	Marzio de Napoli
Sun, Oct 3	-	-	Marzio de Napoli
Mon, Oct 4	-	-	Marzio de Napoli
Tue, Oct 5	-	-	-
Wed, Oct 6	-	-	-
Thu, Oct 7	-	-	-
Fri, Oct 8	-	-	-
Sat, Oct 9	-	-	Luca Marsicano
Sun, Oct 10	-	-	Luca Marsicano
Mon, Oct 11	-	-	Andrea Celentano
Tue, Oct 12	-	-	Andrea Celentano
Wed, Oct 13	-	Luca Marsicano	-
Thu, Oct 14	-	Andrea Celentano	-
Fri, Oct 15	-	Mariangela Bondì	-
Sat, Oct 16	-	Mariangela Bondì	-

Backup shifter contact info
Name	Email	Cell phone
Andrea Celentano	andrea.celentano@ge.infn.it	‭+39 340 9831283‬
Luca Marsicano	luca.marsicano@ge.infn.it	+39 333 9893725‬
Mariangela Bondì	mariangela.bondi@ge.infn.it	+39 ‭327 1895733‬
Marzio de Napoli	marzio.denapoli@ct.infn.it	+39-3498834468
Maurik Holtrop	holtrop@jlab.org	+1-603-868-8088
Nathan Baltzell	baltzell@jlab.org	-
Raffaella:	Raffaella.Devita@ge.infn.it	+39 340 8110156

@@ Line 122: / Line 122: @@
 | valign=top width=50% |am profile check once a day, at 9 am, using 2H02 and SVT wire harps
-== Run Plan August 23 - 30, 2021 ==
+== Run Plan August 27 - 30, 2021 ==
 * Beam commissioning
-* ECal and Hof=doscope commissioning
+* ECal and Hodoscope commissioning
 * SVT commissioning
 * Setting up Trigger and DAQ
@@ Line 137: / Line 137: @@
 -->
 ==Every Shift:==
-# Follow run plan as outlined by RC
+# Follow the run plan as outlined by RC
 # '''With any issue contact On-Call Experts or RC'''
 # Monitor carefully the SVT bias current (see below for details)
@@ Line 154: / Line 154: @@
 #* Trigger rate gui
 #* SVT and HODOSCOPE and ECAL Monitoring pdfs
-# Please watch Hybrid sync gui for correct status (currently three red lights) and the L0-3 and L4-6 occupancy plots for any empty plots beyond the expected three.
+# Please watch Hybrid sync GUI for correct status (currently three red lights) and the L0-3 and L4-6 occupancy plots for any empty plots beyond the expected three.
 == SVT Bias Currents: ==