create and use a service certificate for oasis cron job

Notes

cosg16:marki:marki> openssl x509 -in /etc/grid-security/hostcert.pem -subject -issuer -dates -noout
subject= /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=Services/CN=scosg16.jlab.org
issuer= /DC=org/DC=cilogon/C=US/O=CILogon/CN=CILogon OSG CA 1
notBefore=Mar 21 17:36:19 2017 GMT
notAfter=Apr 20 17:41:19 2018 GMT

 

 

Advertisements

OSG related notes

Running cronjob by hand succeeds where running from cron fails with proxy not generated.

  • GOC stands for Grid Operations Center
  • GOC ticket is a help request to the GOC

To install my personal grid certificate into Firefox 52.3.0:

  • preferences > advanced >view certificates > your certificates > import
  • choose “user_certificate_and_key.U228.p12”
  • enter certificate password

 

ldconfig needed after dropping a shared library into a system directory

 

NAME
       ldconfig - configure dynamic linker run-time bindings

SYNOPSIS
       /sbin/ldconfig  [  -nNvXV ] [ -f conf ] [ -C cache ] [ -r root ] direc-
       tory ...
       /sbin/ldconfig -l [ -v ] library ...
       /sbin/ldconfig -p

DESCRIPTION
       ldconfig creates the necessary links  and  cache  to  the  most  recent
       shared  libraries  found  in  the  directories specified on the command
       line, in the file /etc/ld.so.conf, and in the trusted directories (/lib
       and  /usr/lib).  The cache is used by the run-time linker, ld.so or ld-
       linux.so.  ldconfig checks the header and filenames of the libraries it
       encounters  when  determining  which  versions  should have their links
       updated.

Analysis Meeting, 9/20/17

Thomas, Monitoring

  • number of omegas changed in reconstruction test starting 9/16 .6/1000 to .57/1000 triggers

Alex, processing update

  • started version 21, new bcal clustering for charged particles, 19 last complete reconstruction launch
  • monthly analysis launches at JLab, last working day of the month

calibrations, Sean

  • Matt, FCAL problem big thing
    • use low-rate for high-rate to start
  • improved CDC dEdx calibration is in
  • new TOF calibrations are in
  • see “2017-01 recon ver02 plans” wiki page
  • outstanding questions: TOF matching efficiency new beam hole

mcsmear development branch, Sean

  • mcsmear but fix, FDC plan swap for dead strips, on development branch
  • started looking at trigger simulation
  • production: start with 10% of 2017 data

Normalization studies, Mark D.

  • slides linked from agenda
  • amorphous lower yield per tagged photon
  • step in yield about 10% from low to high intensity

Justin, outliers, amorphous run

  • apparent roll off in yield at very high intensity, rhos

GlueX Physics Meeting, 9/19/17

FCAL recon problem

  • bad timing constants
  • effects gain through clusterizing problems and pi0 peak calibration
  • for DNP, no high-intensity data will be used

Mike D. has polarization generating probram

Simulatoin, plan to generate 10% of Sp17 on OSG[?]

Systematic Cuts Study

  • eta pi+ pi-
  • evaluate effect of cuts
  • cuts relaxed one by one
  • shoulder from 16 rounded off in 17
  • ? what is the factor of two we are going after?

Marouen Ballouc, eta prime Dalitz plot analysis

  • etal in gamma gamma
  • invariant mass fits, low background
    • ?Bernstein function?
    • ?use sPlot ato subtract background
  • Acceptance/Efficiency
    • Dalitz plot correct for efficiency
    • geom, recon 8% efficiency
    • 20% for branch
    • selection: 45%
    • total 3.5%, 9% for branch
  • background
    • ?smoothed using Kernel Density function?
    • 10% background
  • Dalitz plot fit
    • unbinned max. likelyhood
  • Fit validation
    • pull MC study
  • Goodness of fit
    • ?pint-to-point dissimilarity test?
  • Fit results

data-driven likelihood approach to particle id, Yunjie Yang

  • adaBDT classifier
  • go from cuts, to continuous likelihoods to ML-based multivariate scheme

Charged beam asymmetries, Jon Zarling

  • gamm p to pi Delta
    • pi+ p or pi- p, Delta++, Delta0 respectively
  • Fit to JPAC Delta lineshape
  • pulls, pseudo experiments

 

Working with Oasis

logging into the grid submit host

ssh scosg16

check for a proxy, create one, the wrong one first, destroy it, then the right one

scosg16:marki:marki> voms-proxy-info

Couldn't find a valid proxy.

scosg16:marki:marki> voms-proxy-init
Enter GRID pass phrase for this identity:
Your identity: /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104
key values mismatch
Function: X509_check_private_key
Creating proxy ............................................................................................................................ Done

Your proxy is valid until Sat Sep 16 02:41:55 2017
scosg16:marki:marki> voms-proxy-info
subject   : /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104/CN=2073856599
issuer    : /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104
identity  : /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104
type      : RFC compliant proxy
strength  : 1024 bits
path      : /tmp/x509up_u2191
timeleft  : 11:59:50
scosg16:marki:marki> voms-proxy-destroy
scosg16:marki:marki> voms-proxy-info

Couldn't find a valid proxy.

scosg16:marki:marki> voms-proxy-init -voms Gluex
Enter GRID pass phrase for this identity:
Your identity: /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104
key values mismatch
Function: X509_check_private_key
Creating temporary proxy ....................... Done
Contacting  gryphn.phys.uconn.edu:15014 [/DC=org/DC=opensciencegrid/O=Open Science Grid/OU=Services/CN=voms/gryphn.phys.uconn.edu] "Gluex" Done
Creating proxy .................... Done

Your proxy is valid until Sat Sep 16 02:47:14 2017
scosg16:marki:marki> voms-proxy-info
subject   : /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104/CN=4260201169
issuer    : /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104
identity  : /DC=org/DC=opensciencegrid/O=Open Science Grid/OU=People/CN=Mark Ito 1104
type      : RFC compliant proxy
strength  : 1024 bits
path      : /tmp/x509up_u2191
timeleft  : 11:59:52

documentation accessing oasis is here: https://twiki.grid.iu.edu/bin/view/Documentation/Release3/UpdateOasis
gsissh into oasis server

scosg16:marki:marki> gsissh -o GSSAPIDelegateCredentials=yes oasis-login.opensciencegrid.org
Last login: Thu Sep 14 22:26:33 2017 from gluey.phys.uconn.edu
[0] 18:48:42 UTC [ouser.gluex@oasis-login:~]$ pwd
/home/login/ouser.gluex
  • To update the Oasis files:
    go to gluex staging area: /stage/oasis/gluex
    make the mods to the files
    Issue the command: osg-oasis-update
[ouser.gluex@oasis-login gluex]$ osg-oasis-update
Submitting job(s).
1 job(s) submitted to cluster 2536.
You can use condor_q to check on the status of your update
[ouser.gluex@oasis-login gluex]$ condor_q

-- Schedd: oasis-login.grid.iu.edu : <129.79.53.147:24122?...  ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD                2536.0   ouser.gluex     9/15 18:59   0+00:00:11 R  0   0.0  oasis-batch-worker 1 jobs; 0 completed, 0 removed, 0 idle, 1 running, 0 held, 0 suspended 

remote commands can be run:

 scosg16:marki:marki> gsissh -o GSSAPIDelegateCredentials=yes oasis-login.opensciencegrid.org hostname
oasis-login.grid.iu.edu

scp works

scosg16:marki:git_test> gsiscp -o GSSAPIDelegateCredentials=yes a.txt oasis-login.opensciencegrid.org:/stage/oasis/gluex/test/
a.txt                                                                                                      100%  127     0.1KB/s   0.1KB/s   00:00

rsync works

scosg16:marki:marki> rsync -ruvt --delete -e 'gsissh -o GSSAPIDelegateCredentials=yes' /home/marki/git_test/ oasis-login.opensciencegrid.org:/stage/oasis/gluex/test/git_test/
sending incremental file list
created directory /stage/oasis/gluex/test/git_test
./
README.md
a.tt
a.txt
aa.txt
b.txt
c.txt
d.txt
e.txt
j.txt
k.txt
.git/
.git/COMMIT_EDITMSG
.git/COMMIT_EDITMSG~
.git/FETCH_HEAD
...
.git/refs/remotes/origin/idea2
.git/refs/remotes/origin/master
.git/refs/tags/
dir/
dir/l.txt
dir/m.txt

sent 43791 bytes  received 1222 bytes  12860.86 bytes/sec
total size is 39107  speedup is 0.87

and after modifying j.txt

scosg16:marki:marki> rsync -ruvt --delete -e 'gsissh -o GSSAPIDelegateCredentials=yes' /home/marki/git_test/ oasis-login.opensciencegrid.org:/stage/oasis/gluex/test/git_test/
sending incremental file list
./
j.txt

sent 2215 bytes  received 71 bytes  304.80 bytes/sec
total size is 39128  speedup is 17.12