Difference between revisions of "Web and file services"

From CebafUsersGroup
Jump to: navigation, search
(Created page with ' == July 29, 2011 == As most of you have experienced, numerous JLab computer services (including web pages, file transfers, remote login etc.) have been seriously affected by th…')
 
 
(19 intermediate revisions by the same user not shown)
Line 1: Line 1:
 +
== Recent Updates ==
  
== July 29, 2011 ==
+
We will keep adding information as we receive it.
  
As most of you have experienced, numerous JLab computer services (including web pages, file transfers, remote login etc.) have been seriously affected by the "cyber event" since the beginning of July. Many services have now been restored. Below we collect some information we are aware of that may help users with their immediate computing needs and also give them some idea of what to expect. Please email your UGBoD representatives (Mark Ito for computing, or Sebastian Kuhn - see [[UGBoD Contact Information]]) if you have suggestions, comments or questions. Please also check out [[Ongoing Polls]]. Please note that public_html will not return in its previous form - see below for more information.
+
=== Update Spring 2012 ===
 +
Here is a write-up on what happened during and after the "Cyber Event" by UGBoD member Mark Ito: [[media:Cyber_event_v2.pdf]]
  
----
+
=== Update January 2012 ===
  
'''Status update by Roy Whitney as of July 29:'''
+
Jefferson Lab has a new system for storing user-generated web content that is accessible from off-site. You can now post directly to your public_html using sFTP - the URL is  username@ftp.jlab.org/userweb/username/public_html. This should work with any sFTP client on your PC/Mac, whether you are "inside" or "outside" the JLab firewall.
  
Most network services have been restored including most web servers, ssh, CVS, EVO, Skype, etc. Go to [https://cc.jlab.org/networkstatus https://cc.jlab.org/networkstatus] to see a complete list. You will need to click on the "login" link at the top right of the page, and then use your Jefferson Lab username/password to login.
+
If you haven't done so, you first must submit a request for such a web presence:
 +
Go to the [https://cc.jlab.org/ cc webpage], then log in (use the login link at top right, and enter your CUE credentials) and read the information under "JLab User Web Pages". You will have to submit a request (online form) that will have to be signed off on by your JLab sponsor and an IT individual (the process is mostly automated, but takes time). Once you have been given space, you will be able to post files in a new directory structure ("userweb/username/public_html") and they will then be visible under "https://userweb.jlab.org/~username". You will have to transfer any content you want to keep from your old CUE directory username/public_html.
 +
While this procedure causes significant extra work, at least it allows you to resurrect an existing web directory structure from your old public_html. Also, any existing links to your web content will automatically be redirected to the new structure. Please send email to Mark Ito or myself (-> see below) to give us feedback, comments etc. for this new scheme. Be careful not to copy doubtful or unneeded files to the new directory!
  
The following services are still in the process of being fully restored:
+
=== Update August 4, 2011 ===
  
Main web services
+
As most of you have experienced, numerous JLab computer services (including web pages, file transfers, remote login etc.) have been seriously affected by the "cyber event" since the beginning of July. Many services have now been restored. Below we collect some information we are aware of that may help users with their immediate computing needs and also give them some idea of what to expect. Please email your UGBoD representatives (Mark Ito for computing, or Sebastian Kuhn - see [[UGBoD Contact Information]]) if you have suggestions, comments or questions. Please also check out [[Ongoing Polls]].
  
    Public Affairs is working with IT to restore access to information on the lab's website. The temporary public-facing website, which provides limited access to the lab, will be replaced with a newly designed and fully functional website. Testing has started on the new website and it could be installed in the next two-three weeks.
+
=== If you have specific issues (missing links, functionality, etc.): ===
  
    The existing website is accessible from onsite, and on Monday, 8/1, the final security review of its content will be complete and a link to many pages will be placed on the temporary public-facing website.  At this time the links to the PAC, DIS, and Hall websites are available using the temporary public website. The experimental schedule can be reached at http://www.jlab.org/div_dept/physics_division/experiments/schedule.html and additional information/resources for users can be found on the temporary public website using the links available at the PAC38 web page: http://www.jlab.org/conferences/pac38.
+
'''Please contact the Help Desk''':  helpdesk@jlab.org, 269 7155. (Don't hold off in the hopes that "surely someone will have noticed and fix this").
 +
If your problem has to do with missing or inappropriate website '''content''', you can also cc Public Affairs (Dean Golembeski, deang (at) jlab.org)
  
public_html
+
----
  
    Currently staff and users are asked to use FTP (see next item) as a temporary workaround for public_html. By August 8, a new capability will be made available with the same functionality as public_html.  The final details of the new system are being worked with the User's IT representative from the UGBOD and representatives from Accelerator, Engineering, FEL and Physics divisions.
+
'''Status update by Roy Whitney as of July 29:'''
  
FTP
+
Roy Whitney sent out a status update in an email to the list "all_jlab_accounts@jlab.org" last Friday which contains a lot of information that might be useful. You can find that email at the usual mailing list archive at https://mailman.jlab.org/pipermail/all_jlab_accounts/ .
  
    Offsite access to FTP is also now available for "getting" files.  "Putting" files requires use of SFTP.  Updated instructions are available at https://cc.jlab.org/filetransfers. BBFTP is expected to become available by August 3.
+
----
  
Controls systems
+
The functionality of "public_html" (where anything put in your CUE directory "username/public_html" would be available on the web under www.jlab.org/~username) will not be restored to the same status as before. For various reasons, the lab wants to make sure that all users scrutinize the existing files in these directories  before making them available to the WWW again. This will be accomplished by setting up a ''new'' directory structure on a server to be named "userweb.jlab.org". All users will have to move their own files to the new structure to make them "visible" again. See '''Update August 31''' above.
  
    Information on remote access to controls systems will be made available as these systems are upgraded. The solutions will be put in place by the time of the end of the 6 month down or sooner as required.
+
----
  
Sensitive information
+
If you encounter problems with "untrusted certificates" and the like, please take a look at
 
+
https://cc.jlab.org/index.php?q=JLabCAs/
    Network access for staff working with sensitive information has a number of new security controls that are specific to each work area and that are different than indicated above. Information on these areas is provided to the specific groups.
+
 
+
Contact the helpdesk for any issues: helpdesk@jlab.org, 7155
+
  
 
----
 
----
Line 44: Line 46:
 
# type "firefox" and go to http://www.jlab.org/
 
# type "firefox" and go to http://www.jlab.org/
  
 +
Some of the functionality of the "old" (pre-cyber event) Jlab website has been restored to a temporary address, wwwold.jlab.org . Many important services are still unavailable from the outside, e.g. MIS searches etc. - see above for a way to do those (you can also use "staff" on any JLab computer to find staff member info).
 
----
 
----
  
Line 50: Line 53:
 
"bbftp is a lot faster that scp since it does not encrypt the data (only the password) and it uses more ports
 
"bbftp is a lot faster that scp since it does not encrypt the data (only the password) and it uses more ports
  
1)Install the client bbftp on your computer. It exists for both mac and linux
+
# Install the client bbftp on your computer. It exists for both mac and linux -> http://doc.in2p3.fr/bbftp/
http://doc.in2p3.fr/bbftp/
+
# Issue the command ''bbftp -m -p 5 -i input.txt -u YourUserName bbftp.jlab.org'' where input.txt contains a list of the files and has the following syntax: ''mget File Destination''
2)Issue the command
+
bbftp -m -p 5 -i input.txt -u YourUserName bbftp.jlab.org  
+
where input.txt contains a list of the files and has the following syntax
+
 
+
mget File Destination
+
 
+
For example my input.txt is:
+
mget /work/clas/disk7/biselli/r59418_0_1.root /home/biselli/data/
+
mget /work/clas/disk7/biselli/r59424_0_11.root /home/biselli/data/
+
mget /work/clas/disk7/biselli/r59425_0_84.root /home/biselli/data/ "
+

Latest revision as of 15:23, 12 April 2012

Recent Updates

We will keep adding information as we receive it.

Update Spring 2012

Here is a write-up on what happened during and after the "Cyber Event" by UGBoD member Mark Ito: media:Cyber_event_v2.pdf

Update January 2012

Jefferson Lab has a new system for storing user-generated web content that is accessible from off-site. You can now post directly to your public_html using sFTP - the URL is username@ftp.jlab.org/userweb/username/public_html. This should work with any sFTP client on your PC/Mac, whether you are "inside" or "outside" the JLab firewall.

If you haven't done so, you first must submit a request for such a web presence: Go to the cc webpage, then log in (use the login link at top right, and enter your CUE credentials) and read the information under "JLab User Web Pages". You will have to submit a request (online form) that will have to be signed off on by your JLab sponsor and an IT individual (the process is mostly automated, but takes time). Once you have been given space, you will be able to post files in a new directory structure ("userweb/username/public_html") and they will then be visible under "https://userweb.jlab.org/~username". You will have to transfer any content you want to keep from your old CUE directory username/public_html. While this procedure causes significant extra work, at least it allows you to resurrect an existing web directory structure from your old public_html. Also, any existing links to your web content will automatically be redirected to the new structure. Please send email to Mark Ito or myself (-> see below) to give us feedback, comments etc. for this new scheme. Be careful not to copy doubtful or unneeded files to the new directory!

Update August 4, 2011

As most of you have experienced, numerous JLab computer services (including web pages, file transfers, remote login etc.) have been seriously affected by the "cyber event" since the beginning of July. Many services have now been restored. Below we collect some information we are aware of that may help users with their immediate computing needs and also give them some idea of what to expect. Please email your UGBoD representatives (Mark Ito for computing, or Sebastian Kuhn - see UGBoD Contact Information) if you have suggestions, comments or questions. Please also check out Ongoing Polls.

If you have specific issues (missing links, functionality, etc.):

Please contact the Help Desk: helpdesk@jlab.org, 269 7155. (Don't hold off in the hopes that "surely someone will have noticed and fix this"). If your problem has to do with missing or inappropriate website content, you can also cc Public Affairs (Dean Golembeski, deang (at) jlab.org)


Status update by Roy Whitney as of July 29:

Roy Whitney sent out a status update in an email to the list "all_jlab_accounts@jlab.org" last Friday which contains a lot of information that might be useful. You can find that email at the usual mailing list archive at https://mailman.jlab.org/pipermail/all_jlab_accounts/ .


The functionality of "public_html" (where anything put in your CUE directory "username/public_html" would be available on the web under www.jlab.org/~username) will not be restored to the same status as before. For various reasons, the lab wants to make sure that all users scrutinize the existing files in these directories before making them available to the WWW again. This will be accomplished by setting up a new directory structure on a server to be named "userweb.jlab.org". All users will have to move their own files to the new structure to make them "visible" again. See Update August 31 above.


If you encounter problems with "untrusted certificates" and the like, please take a look at https://cc.jlab.org/index.php?q=JLabCAs/


Note that you can access all of your favorite JLab websites (including the "old" main page) by doing the following:

  1. ssh to login.jlab.org [need username and password; enable X11 forwarding]
  2. ssh to jlabl1 [need username and password; enable X11 forwarding]
  3. type "firefox" and go to http://www.jlab.org/

Some of the functionality of the "old" (pre-cyber event) Jlab website has been restored to a temporary address, wwwold.jlab.org . Many important services are still unavailable from the outside, e.g. MIS searches etc. - see above for a way to do those (you can also use "staff" on any JLab computer to find staff member info).


Here are some instructions on how to use BBFTP to move files from jlab to your computer - given without guarantee:

"bbftp is a lot faster that scp since it does not encrypt the data (only the password) and it uses more ports

  1. Install the client bbftp on your computer. It exists for both mac and linux -> http://doc.in2p3.fr/bbftp/
  2. Issue the command bbftp -m -p 5 -i input.txt -u YourUserName bbftp.jlab.org where input.txt contains a list of the files and has the following syntax: mget File Destination