Difference between revisions of "How to setup ejfat nodes"
Jump to navigation
Jump to search
(25 intermediate revisions by the same user not shown) | |||
Line 3: | Line 3: | ||
# Install ZMQ with:<pre>sudo apt install libzmq3-dev</pre> | # Install ZMQ with:<pre>sudo apt install libzmq3-dev</pre> | ||
# For ERSAP install protobuf:<pre>sudo apt install libprotobuf-dev protobuf-compiler</pre> | # For ERSAP install protobuf:<pre>sudo apt install libprotobuf-dev protobuf-compiler</pre> | ||
− | # For increased UDP buffer sizes: | + | # For pip (python installer for python) install:<pre>sudo apt install pip</pre> |
− | ##For the long term write the following lines into the sysctl.conf file:<pre>net.core.rmem_max=25000000</pre><pre>net.core.wmem_max=25000000</pre> | + | # For prometheus: |
− | ##To make it immediately effective, execute:<pre>sudo sysctl -w net.core.rmem_max=25000000</pre><pre>sudo sysctl -w net.core.wmem_max=25000000</pre> | + | ##installation:<pre>sudo apt install prometheus</pre><pre>sudo apt install prometheus-node-exporter</pre> |
+ | ##python client libraries:<pre>pip install prometheus-client</pre><pre>pip install prometheus-api-client</pre> | ||
+ | ##exporter start up:<pre>sudo systemctl start prometheus-node-exporter</pre><pre>sudo systemctl enable prometheus-node-exporter</pre> | ||
+ | # For increased UDP buffer & queue sizes: | ||
+ | ##For the long term write the following lines into the sysctl.conf file:<pre>net.core.rmem_max=25000000</pre><pre>net.core.wmem_max=25000000</pre><pre>net.core.netdev_max_backlog=65536</pre> | ||
+ | ##To make it immediately effective, execute:<pre>sudo sysctl -w net.core.rmem_max=25000000</pre><pre>sudo sysctl -w net.core.wmem_max=25000000</pre><pre>sudo sysctl -w net.core.netdev_max_backlog=65536</pre><pre>ifconfig <ifname> txqueuelen 10000</pre> | ||
# To mount /daqfs: | # To mount /daqfs: | ||
− | ## sudo mkdir /daqfs | + | ##sudo mkdir /daqfs |
− | ## | + | ##edit /etc/fstab to include the line: <pre>dubhe:/raid/daqfs nfs rw,bg 0 0</pre> |
− | ## | + | ##sudo apt-get install nfs-common |
− | ## | + | ##sudo mount /daqfs |
− | # To change one's home directory to /daqfs/home/ | + | # To change one's home directory to /daqfs/home/myUserName: |
− | ##Edit the /etc/passwd file to include a line something like:<pre> | + | ##Edit the /etc/passwd file to include a line something like:<pre>myUserName:x:2101:1208:John Doe,,,:/daqfs/home/myUserName:/bin/bash</pre>where 2101 is user id and 1208 is epsci group. Hint: set your user id and group ids on the ejfat nodes to be the same as it is on the computer center machines or there will be an issue when you access files served by computer center like /daqfs/home or /group/... |
+ | # When sending UDP packets: | ||
+ | :: Take advantage of the ejfat nodes' NICs which have a max MTU of 9978 <pre>sudo ifconfig enp193s0f1np1 mtu 9978</pre> | ||
+ | |||
</font> | </font> |
Latest revision as of 21:04, 15 December 2023
- Install BOOST with:
sudo apt-get install lib boost-all-dev
- Install ZMQ with:
sudo apt install libzmq3-dev
- For ERSAP install protobuf:
sudo apt install libprotobuf-dev protobuf-compiler
- For pip (python installer for python) install:
sudo apt install pip
- For prometheus:
- installation:
sudo apt install prometheus
sudo apt install prometheus-node-exporter
- python client libraries:
pip install prometheus-client
pip install prometheus-api-client
- exporter start up:
sudo systemctl start prometheus-node-exporter
sudo systemctl enable prometheus-node-exporter
- installation:
- For increased UDP buffer & queue sizes:
- For the long term write the following lines into the sysctl.conf file:
net.core.rmem_max=25000000
net.core.wmem_max=25000000
net.core.netdev_max_backlog=65536
- To make it immediately effective, execute:
sudo sysctl -w net.core.rmem_max=25000000
sudo sysctl -w net.core.wmem_max=25000000
sudo sysctl -w net.core.netdev_max_backlog=65536
ifconfig <ifname> txqueuelen 10000
- For the long term write the following lines into the sysctl.conf file:
- To mount /daqfs:
- sudo mkdir /daqfs
- edit /etc/fstab to include the line:
dubhe:/raid/daqfs nfs rw,bg 0 0
- sudo apt-get install nfs-common
- sudo mount /daqfs
- To change one's home directory to /daqfs/home/myUserName:
- Edit the /etc/passwd file to include a line something like:
myUserName:x:2101:1208:John Doe,,,:/daqfs/home/myUserName:/bin/bash
where 2101 is user id and 1208 is epsci group. Hint: set your user id and group ids on the ejfat nodes to be the same as it is on the computer center machines or there will be an issue when you access files served by computer center like /daqfs/home or /group/...
- Edit the /etc/passwd file to include a line something like:
- When sending UDP packets:
- Take advantage of the ejfat nodes' NICs which have a max MTU of 9978
sudo ifconfig enp193s0f1np1 mtu 9978
- Take advantage of the ejfat nodes' NICs which have a max MTU of 9978