[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]
script to create FID -> file size map
- To: gcdev <gcdev@sseos.lbl.gov>
- Subject: script to create FID -> file size map
- From: Henrik Nordberg <HNordberg@lbl.gov>
- Date: Thu, 29 Oct 1998 20:03:56 -0800
- Organization: Lawrence Berkeley Laboratory, Berkeley, California
Hello,
I wrote some scripts that will create a file with two columns: FID's and
file sizes
I checked them into CVS under QE/index/size.
The main script is called get_sizes.csh. This is a sample run:
(rmds03) 22:43 tmp > get_sizes.csh /home/starreco/objy/COS7/fd30025
/disk0/grandch/stardb/fd30025/STAR
Running oodumpcatalog...
Running parse_dump.awk...
Getting file sizes from HPSS...
Parsing the result of the FTP transfers...
Success. Resulting list of FID's and sizes is in fids_sizes.txt
(rmds03) 22:55 tmp > ls -l
total 448
-rw-r--r-- 1 nordberg rhgrandc 40288 Oct 29 22:45 dump.txt
-rw-r--r-- 1 nordberg rhgrandc 17855 Oct 29 22:45 fid_name.txt
-rw-r--r-- 1 nordberg rhgrandc 3237 Oct 29 22:55 fids_sizes.txt
-rwxr-xr-x 1 nordberg rhgrandc 271 Oct 29 22:34 ftp.csh*
-rwxrwxrwx 1 nordberg rhgrandc 661 Oct 29 22:45 get_sizes.csh*
-rw-r--r-- 1 nordberg rhgrandc 128 Oct 29 22:26 parse_dump.awk
-rw-r--r-- 1 nordberg rhgrandc 355 Oct 29 22:26 parse_sizes.awk
-rw-r--r-- 1 nordberg rhgrandc 146632 Oct 29 22:55 sizes.txt
(rmds03) 22:57 tmp > head fids_sizes.txt
2 missing
3 missing
4 missing
5 missing
6 missing
7 missing
9 549535744
10 549535744
11 616136704
12 340852736
(rmds03) 23:02 tmp >
Where it says missing in the second column, the file is either missing
or in another directory (i.e., not in /home/starreco/objy/COS7/fd30025).
It took 10 minutes to run for 250 files. Most of the time was spent
doing FTP.
Regards, Henrik
_________________________________________
Henrik Nordberg <hnordberg@lbl.gov>
Scientific Data Management Research Group
Lawrence Berkeley National Laboratory