[Date Prev][Date Next][Thread Prev][Thread Next][Date Index][Thread Index]

script to create FID -> file size map



Hello,

I wrote some scripts that will create a file with two columns: FID's and
file sizes
I checked them into CVS under QE/index/size.

The main script is called get_sizes.csh. This is a sample run:

(rmds03) 22:43 tmp > get_sizes.csh /home/starreco/objy/COS7/fd30025
/disk0/grandch/stardb/fd30025/STAR
Running oodumpcatalog...
Running parse_dump.awk...
Getting file sizes from HPSS...
Parsing the result of the FTP transfers...
Success. Resulting list of FID's and sizes is in fids_sizes.txt
(rmds03) 22:55 tmp > ls -l 
total 448
-rw-r--r--   1 nordberg rhgrandc   40288 Oct 29 22:45 dump.txt
-rw-r--r--   1 nordberg rhgrandc   17855 Oct 29 22:45 fid_name.txt
-rw-r--r--   1 nordberg rhgrandc    3237 Oct 29 22:55 fids_sizes.txt
-rwxr-xr-x   1 nordberg rhgrandc     271 Oct 29 22:34 ftp.csh*
-rwxrwxrwx   1 nordberg rhgrandc     661 Oct 29 22:45 get_sizes.csh*
-rw-r--r--   1 nordberg rhgrandc     128 Oct 29 22:26 parse_dump.awk
-rw-r--r--   1 nordberg rhgrandc     355 Oct 29 22:26 parse_sizes.awk
-rw-r--r--   1 nordberg rhgrandc  146632 Oct 29 22:55 sizes.txt
(rmds03) 22:57 tmp > head fids_sizes.txt 
2 missing
3 missing
4 missing
5 missing
6 missing
7 missing
9 549535744
10 549535744
11 616136704
12 340852736
(rmds03) 23:02 tmp > 

Where it says missing in the second column, the file is either missing
or in another directory (i.e., not in /home/starreco/objy/COS7/fd30025).
It took 10 minutes to run for 250 files. Most of the time was spent
doing FTP.

Regards, Henrik
_________________________________________
Henrik Nordberg       <hnordberg@lbl.gov>
Scientific Data Management Research Group
Lawrence Berkeley National Laboratory