Generating concrete workflow 2021.11.22 23:27:27.777 GMT: [DEBUG] Property Key pegasus.integrity.checking already set to nosymlink. Will not be set to - none 2021.11.22 23:27:27.785 GMT: [DEBUG] Property Key condor.periodic_remove already set to (JobStatus == 5) && ((CurrentTime - EnteredCurrentStatus) > 43200). Will not be set to - (JobStatus == 5) && ((CurrentTime - EnteredCurrentStatus) > 30) 2021.11.22 23:27:27.785 GMT: [INFO] Planner launched in the following directory /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output 2021.11.22 23:27:27.785 GMT: [INFO] Planner invoked with following arguments --conf ./pegasus-properties.conf --output-sites local --sites local,condorpool_shared --staging-site local=local,condorpool_shared=condorpool_shared --cluster label,horizontal --cleanup inplace --relative-dir work -vvv --dir /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc --submit --forward nogrid 3ogc_ringdown.dax 2021.11.22 23:27:27.787 GMT: [CONFIG] Pegasus Properties set by the user 2021.11.22 23:27:27.787 GMT: [CONFIG] pegasus.catalog.replica.cache.asrc=true 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.catalog.replica.dax.asrc=true 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.catalog.workflow.amqp.url=amqp://friend:donatedata@msgs.pegasus.isi.edu:5672/prod/workflows 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.dir.staging.mapper=Flat 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.dir.storage.mapper=Replica 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.dir.storage.mapper.replica=File 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.dir.storage.mapper.replica.file=output.map 2021.11.22 23:27:27.788 GMT: [CONFIG] pegasus.dir.submit.mapper=Named 2021.11.22 23:27:27.789 GMT: [CONFIG] pegasus.file.cleanup.scope=deferred 2021.11.22 23:27:27.789 GMT: [CONFIG] pegasus.home.bindir=/software/tools/pegasus/5.0/bin 2021.11.22 23:27:27.789 GMT: [CONFIG] pegasus.home.schemadir=/software/tools/pegasus/5.0/share/pegasus/schema 2021.11.22 23:27:27.789 GMT: [CONFIG] pegasus.home.sharedstatedir=/software/tools/pegasus/5.0/share/pegasus 2021.11.22 23:27:27.789 GMT: [CONFIG] pegasus.home.sysconfdir=/software/tools/pegasus/5.0/etc 2021.11.22 23:27:27.789 GMT: [CONFIG] pegasus.integrity.checking=nosymlink 2021.11.22 23:27:27.790 GMT: [CONFIG] pegasus.metrics.app=ligo-pycbc 2021.11.22 23:27:27.790 GMT: [CONFIG] pegasus.mode=development 2021.11.22 23:27:27.790 GMT: [CONFIG] pegasus.monitord.encoding=json 2021.11.22 23:27:27.790 GMT: [CONFIG] pegasus.register=False 2021.11.22 23:27:27.790 GMT: [CONFIG] pegasus.selector.replica=Regex 2021.11.22 23:27:27.790 GMT: [CONFIG] pegasus.selector.replica.regex.rank.1=file://(?!.*(cvmfs)).* 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.selector.replica.regex.rank.2=file:///cvmfs/.* 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.selector.replica.regex.rank.3=root://.* 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.selector.replica.regex.rank.4=gsiftp://red-gridftp.unl.edu.* 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.selector.replica.regex.rank.5=gridftp://.* 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.selector.replica.regex.rank.6=.* 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.transfer.bypass.input.staging=true 2021.11.22 23:27:27.791 GMT: [CONFIG] pegasus.transfer.links=true 2021.11.22 23:27:28.168 GMT: [INFO] event.pegasus.add.data-dependencies dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.170 GMT: [INFO] event.pegasus.add.data-dependencies dax.id 3ogc_ringdown.dax-0 (0.001 seconds) - FINISHED 2021.11.22 23:27:28.209 GMT: [DEBUG] Parsed DAX with following metrics {"compute_tasks":0,"dax_tasks":2,"dag_tasks":0,"total_tasks":2,"deleted_tasks":0,"dax_input_files":4,"dax_inter_files":0,"dax_output_files":0,"dax_total_files":4,"compute_jobs":0,"clustered_jobs":0,"si_tx_jobs":0,"so_tx_jobs":0,"inter_tx_jobs":0,"reg_jobs":0,"cleanup_jobs":0,"create_dir_jobs":0,"dax_jobs":2,"dag_jobs":0,"chmod_jobs":0,"total_jobs":2,"mDAXLabel":"3ogc_ringdown.dax"} 2021.11.22 23:27:28.211 GMT: [CONFIG] Loading site catalog file /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/sites.yml 2021.11.22 23:27:28.211 GMT: [DEBUG] All sites will be loaded from the site catalog 2021.11.22 23:27:28.212 GMT: [DEBUG] event.pegasus.parse.site-catalog site-catalog.id /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/sites.yml - STARTED 2021.11.22 23:27:28.314 GMT: [DEBUG] event.pegasus.parse.site-catalog site-catalog.id /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/sites.yml (0.102 seconds) - FINISHED 2021.11.22 23:27:28.314 GMT: [DEBUG] Sites loaded are [osg, condorpool_shared, condorpool_symlink, condorpool_copy, local] 2021.11.22 23:27:28.315 GMT: [CONFIG] Set environment profile for local site PATH=/software/tools/pegasus/5.0/bin/:/work/yifan.wang/virtualenv/4ogc/bin:/work/yifan.wang/lscsoft/opt/accomlal/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games 2021.11.22 23:27:28.315 GMT: [CONFIG] Set environment profile for local site PYTHONPATH=/software/tools/pegasus/5.0/lib/python3.7/dist-packages/:/work/yifan.wang/eccsearch/waveform/ihes-teobresum/Python:/work/yifan.wang/eccsearch/eccwaveform:/work/yifan.wang/1-ecc-waveform-PE/IMRPhenomDecc:/work/yifan.wang/lscsoft/src/TaylorF2e: 2021.11.22 23:27:28.315 GMT: [CONFIG] Constructed default site catalog entry for condorpool site condor 2021.11.22 23:27:28.374 GMT: [DEBUG] Mount Under Scratch Directories [/tmp, /var/tmp] 2021.11.22 23:27:28.374 GMT: [DEBUG] Style detected for site osg is class edu.isi.pegasus.planner.code.generator.condor.style.Condor 2021.11.22 23:27:28.375 GMT: [DEBUG] Style detected for site condorpool_shared is class edu.isi.pegasus.planner.code.generator.condor.style.Condor 2021.11.22 23:27:28.375 GMT: [DEBUG] Style detected for site condorpool is class edu.isi.pegasus.planner.code.generator.condor.style.Condor 2021.11.22 23:27:28.375 GMT: [DEBUG] Style detected for site condorpool_symlink is class edu.isi.pegasus.planner.code.generator.condor.style.Condor 2021.11.22 23:27:28.375 GMT: [DEBUG] Style detected for site condorpool_copy is class edu.isi.pegasus.planner.code.generator.condor.style.Condor 2021.11.22 23:27:28.375 GMT: [DEBUG] Style detected for site local is class edu.isi.pegasus.planner.code.generator.condor.style.Condor 2021.11.22 23:27:28.375 GMT: [DEBUG] Execution sites are [condorpool_shared, local] 2021.11.22 23:27:28.379 GMT: [CONFIG] Transformation Catalog Type used YAML TC 2021.11.22 23:27:28.379 GMT: [DEBUG] Ignoring error encountered while loading Transformation Catalog [1]: Unable to instantiate Transformation Catalog at edu.isi.pegasus.planner.catalog.transformation.TransformationFactory.loadInstance(TransformationFactory.java:164) [2]: edu.isi.pegasus.planner.catalog.transformation.impl.YAML caught java.lang.RuntimeException The File to be used as TC should be defined with the property pegasus.catalog.transformation.file at edu.isi.pegasus.planner.catalog.transformation.impl.YAML.connect(YAML.java:167) 2021.11.22 23:27:28.380 GMT: [DEBUG] Created a temporary transformation catalog backend /tmp/tc.4947082646810460156.txt 2021.11.22 23:27:28.381 GMT: [CONFIG] Transformation Catalog Type used Multiline Textual TC 2021.11.22 23:27:28.381 GMT: [CONFIG] Transformation Catalog File used /tmp/tc.4947082646810460156.txt 2021.11.22 23:27:28.383 GMT: [CONFIG] Data Configuration used for the workflow condorio 2021.11.22 23:27:28.384 GMT: [DEBUG] Directory to be created is /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/yifan.wang/pegasus/3ogc_ringdown.dax/run0001 2021.11.22 23:27:28.385 GMT: [CONFIG] Metrics file will be written out to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.metrics 2021.11.22 23:27:28.385 GMT: [CONFIG] The base submit directory for the workflow /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc 2021.11.22 23:27:28.385 GMT: [CONFIG] The relative submit directory for the workflow work 2021.11.22 23:27:28.386 GMT: [CONFIG] The relative execution directory for the workflow work 2021.11.22 23:27:28.387 GMT: [INFO] event.pegasus.stampede.events dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.391 GMT: [DEBUG] Written out stampede events for the abstract workflow to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.static.bp 2021.11.22 23:27:28.391 GMT: [INFO] event.pegasus.stampede.events dax.id 3ogc_ringdown.dax-0 (0.004 seconds) - FINISHED 2021.11.22 23:27:28.392 GMT: [INFO] event.pegasus.refinement dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.398 GMT: [CONFIG] Proxy used for Replica Catalog is /tmp/x509up_u44039 2021.11.22 23:27:28.400 GMT: [DEBUG] [Replica Factory] Connect properties detected {proxy=/tmp/x509up_u44039, read.only=true, dax.asrc=true, cache.asrc=true} 2021.11.22 23:27:28.401 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor edu.isi.pegasus.planner.catalog.replica.impl.YAML -> {proxy=/tmp/x509up_u44039, read.only=true, dax.asrc=true, cache.asrc=true} 2021.11.22 23:27:28.403 GMT: [DEBUG] Problem while connecting with the Replica Catalog: Unable to connect to replica catalog implementation edu.isi.pegasus.planner.catalog.replica.impl.YAML with props {proxy=/tmp/x509up_u44039, read.only=true, dax.asrc=true, cache.asrc=true} 2021.11.22 23:27:28.403 GMT: [DEBUG] Setting property dagman.registration.maxjobs to 1 to set max jobs for registrations jobs category 2021.11.22 23:27:28.405 GMT: [DEBUG] Copied /tmp/tc.4947082646810460156.txt to directory /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/catalogs 2021.11.22 23:27:28.407 GMT: [DEBUG] Copied /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/sites.yml to directory /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/catalogs 2021.11.22 23:27:28.407 GMT: [DEBUG] Set Default output replica catalog properties to {pegasus.catalog.replica.output.db.driver=sqlite, pegasus.catalog.replica.output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, pegasus.catalog.replica.output=JDBCRC} 2021.11.22 23:27:28.407 GMT: [INFO] event.pegasus.check.cyclic-dependencies dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.407 GMT: [INFO] event.pegasus.check.cyclic-dependencies dax.id 3ogc_ringdown.dax-0 (0.0 seconds) - FINISHED 2021.11.22 23:27:28.408 GMT: [DEBUG] 0 entries found in cache of total 4 2021.11.22 23:27:28.409 GMT: [DEBUG] 0 entries found in previous submit dirs of total 4 2021.11.22 23:27:28.409 GMT: [DEBUG] 0 entries found in input directories of total 4 2021.11.22 23:27:28.409 GMT: [DEBUG] 4 entries found in abstract workflow replica store of total 4 2021.11.22 23:27:28.409 GMT: [DEBUG] 0 entries found in inherited replica store of total 4 2021.11.22 23:27:28.409 GMT: [DEBUG] 0 entries found in input replica catalog of total 4 2021.11.22 23:27:28.409 GMT: [DEBUG] 4 entries found in all replica sources of total 4 2021.11.22 23:27:28.409 GMT: [CONFIG] Data Reuse Scope for the workflow: full 2021.11.22 23:27:28.409 GMT: [DEBUG] Reducing the workflow 2021.11.22 23:27:28.409 GMT: [INFO] event.pegasus.reduce dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.410 GMT: [DEBUG] Jobs whose o/p files already exist 2021.11.22 23:27:28.410 GMT: [DEBUG] Job pegasus-plan_finalization has no o/p files 2021.11.22 23:27:28.410 GMT: [DEBUG] Job pegasus-plan_main has no o/p files 2021.11.22 23:27:28.410 GMT: [DEBUG] Jobs whose o/p files already exist - DONE 2021.11.22 23:27:28.411 GMT: [DEBUG] pegasus-plan_main will not be deleted as not as child pegasus-plan_finalization is not marked for deletion 2021.11.22 23:27:28.411 GMT: [INFO] Nodes/Jobs Deleted from the Workflow during reduction 2021.11.22 23:27:28.411 GMT: [INFO] Nodes/Jobs Deleted from the Workflow during reduction - DONE 2021.11.22 23:27:28.411 GMT: [INFO] event.pegasus.reduce dax.id 3ogc_ringdown.dax-0 (0.002 seconds) - FINISHED 2021.11.22 23:27:28.411 GMT: [INFO] event.pegasus.siteselection dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.414 GMT: [DEBUG] List of executions sites is [condorpool_shared, local] 2021.11.22 23:27:28.417 GMT: [DEBUG] Job pegasus-plan_main will be mapped based on selector|hints profile key execution.site 2021.11.22 23:27:28.417 GMT: [DEBUG] Job pegasus-plan_finalization will be mapped based on selector|hints profile key execution.site 2021.11.22 23:27:28.417 GMT: [DEBUG] Setting up site mapping for job pegasus-plan_finalization 2021.11.22 23:27:28.417 GMT: [DEBUG] Job was mapped to pegasus-plan_finalization to site local 2021.11.22 23:27:28.419 GMT: [DEBUG] Setting up site mapping for job pegasus-plan_main 2021.11.22 23:27:28.419 GMT: [DEBUG] Job was mapped to pegasus-plan_main to site local 2021.11.22 23:27:28.419 GMT: [INFO] event.pegasus.stampede.events dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.420 GMT: [DEBUG] Written out stampede metadata events for the mapped workflow to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.static.bp 2021.11.22 23:27:28.420 GMT: [INFO] event.pegasus.stampede.events dax.id 3ogc_ringdown.dax-0 (0.001 seconds) - FINISHED 2021.11.22 23:27:28.420 GMT: [INFO] event.pegasus.siteselection dax.id 3ogc_ringdown.dax-0 (0.009 seconds) - FINISHED 2021.11.22 23:27:28.423 GMT: [DEBUG] User set mapper is not a stageable mapper. Loading a stageable mapper 2021.11.22 23:27:28.424 GMT: [DEBUG] Deployment of Worker Package needed 2021.11.22 23:27:28.435 GMT: [CONFIG] No Replica Registration Jobs will be created . 2021.11.22 23:27:28.439 GMT: [CONFIG] Transfer Implementation loaded for Stage-In [Python based Transfer Script] 2021.11.22 23:27:28.439 GMT: [CONFIG] Transfer Implementation loaded for symbolic linking Stage-In [Python based Transfer Script] 2021.11.22 23:27:28.439 GMT: [CONFIG] Transfer Implementation loaded for Inter Site [Python based Transfer Script] 2021.11.22 23:27:28.439 GMT: [CONFIG] Transfer Implementation loaded for Stage-Out [Python based Transfer Script] 2021.11.22 23:27:28.440 GMT: [DEBUG] Trying to get TCEntries for pegasus::worker on resource ALL of type STAGEABLE 2021.11.22 23:27:28.440 GMT: [DEBUG] System information for pegasus-worker-5.0.1-x86_64_deb_10.tar.gz is {arch=x86_64 os=linux osrelease=deb osversion=10} 2021.11.22 23:27:28.441 GMT: [DEBUG] Compute site sysinfo local {arch=x86_64 os=linux} 2021.11.22 23:27:28.441 GMT: [DEBUG] Worker Package Entry used for site local Logical Namespace : pegasus Logical Name : worker Version : null Resource Id : local Physical Name : file:///local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus-worker-5.0.1-x86_64_deb_10.tar.gz SysInfo : {arch=x86_64 os=linux} TYPE : STAGEABLE BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.441 GMT: [DEBUG] Trying to get TCEntries for pegasus::worker on resource local of type STAGEABLE 2021.11.22 23:27:28.441 GMT: [DEBUG] Staging site for site local for worker package deployment - local 2021.11.22 23:27:28.441 GMT: [DEBUG] Trying to get TCEntries for pegasus::worker on resource ALL of type STAGEABLE 2021.11.22 23:27:28.442 GMT: [DEBUG] Selected entry Logical Namespace : pegasus Logical Name : worker Version : null Resource Id : local Physical Name : file:///local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus-worker-5.0.1-x86_64_deb_10.tar.gz SysInfo : {arch=x86_64 os=linux} TYPE : STAGEABLE BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.442 GMT: [DEBUG] Creating a default TC entry for pegasus::transfer at site local 2021.11.22 23:27:28.442 GMT: [DEBUG] Remote Path set is pegasus-transfer 2021.11.22 23:27:28.442 GMT: [DEBUG] Trying to get TCEntries for pegasus::transfer on resource local of type INSTALLED 2021.11.22 23:27:28.443 GMT: [DEBUG] Entry constructed Logical Namespace : pegasus Logical Name : transfer Version : null Resource Id : local Physical Name : pegasus-transfer SysInfo : {arch=x86_64 os=linux} TYPE : INSTALLED BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.443 GMT: [DEBUG] Creating a default TC entry for pegasus::kickstart at site local 2021.11.22 23:27:28.443 GMT: [DEBUG] Remote Path set is pegasus-kickstart 2021.11.22 23:27:28.443 GMT: [DEBUG] Trying to get TCEntries for pegasus::kickstart on resource local of type INSTALLED 2021.11.22 23:27:28.443 GMT: [DEBUG] Entry constructed Logical Namespace : pegasus Logical Name : kickstart Version : null Resource Id : local Physical Name : pegasus-kickstart SysInfo : {arch=x86_64 os=linux} TYPE : INSTALLED BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.443 GMT: [DEBUG] Creating a default TC entry for pegasus::cleanup at site local 2021.11.22 23:27:28.443 GMT: [DEBUG] Remote Path set is pegasus-transfer 2021.11.22 23:27:28.443 GMT: [DEBUG] Trying to get TCEntries for pegasus::cleanup on resource local of type INSTALLED 2021.11.22 23:27:28.444 GMT: [DEBUG] Entry constructed Logical Namespace : pegasus Logical Name : cleanup Version : null Resource Id : local Physical Name : pegasus-transfer SysInfo : {arch=x86_64 os=linux} TYPE : INSTALLED BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.444 GMT: [DEBUG] Creating a default TC entry for pegasus::seqexec at site local 2021.11.22 23:27:28.444 GMT: [DEBUG] Remote Path set is pegasus-cluster 2021.11.22 23:27:28.444 GMT: [DEBUG] Trying to get TCEntries for pegasus::seqexec on resource local of type INSTALLED 2021.11.22 23:27:28.444 GMT: [DEBUG] Entry constructed Logical Namespace : pegasus Logical Name : seqexec Version : null Resource Id : local Physical Name : pegasus-cluster SysInfo : {arch=x86_64 os=linux} TYPE : INSTALLED BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.444 GMT: [DEBUG] Creating a default TC entry for pegasus::dirmanager at site local 2021.11.22 23:27:28.444 GMT: [DEBUG] Remote Path set is pegasus-transfer 2021.11.22 23:27:28.444 GMT: [DEBUG] Trying to get TCEntries for pegasus::dirmanager on resource local of type INSTALLED 2021.11.22 23:27:28.444 GMT: [DEBUG] Entry constructed Logical Namespace : pegasus Logical Name : dirmanager Version : null Resource Id : local Physical Name : pegasus-transfer SysInfo : {arch=x86_64 os=linux} TYPE : INSTALLED BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.445 GMT: [DEBUG] Creating a default TC entry for pegasus::keg at site local 2021.11.22 23:27:28.445 GMT: [DEBUG] Remote Path set is pegasus-keg 2021.11.22 23:27:28.445 GMT: [DEBUG] Trying to get TCEntries for pegasus::keg on resource local of type INSTALLED 2021.11.22 23:27:28.445 GMT: [DEBUG] Entry constructed Logical Namespace : pegasus Logical Name : keg Version : null Resource Id : local Physical Name : pegasus-keg SysInfo : {arch=x86_64 os=linux} TYPE : INSTALLED BYPASS : false Notifications: Container : null Compound Tx : null 2021.11.22 23:27:28.445 GMT: [INFO] event.pegasus.cluster dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.447 GMT: [DEBUG] Adding job to graph pegasus-plan_finalization 2021.11.22 23:27:28.447 GMT: [DEBUG] Adding job to graph pegasus-plan_main 2021.11.22 23:27:28.447 GMT: [DEBUG] Adding parents for child finalization 2021.11.22 23:27:28.449 GMT: [CONFIG] Partitioner loaded is Label Based Partitioning 2021.11.22 23:27:28.458 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.459 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.460 GMT: [CONFIG] Clusterer loaded is Topological based Vertical Clustering 2021.11.22 23:27:28.460 GMT: [INFO] Starting Graph Traversal 2021.11.22 23:27:28.461 GMT: [DEBUG] Adding to level 0 dummy 2021.11.22 23:27:28.461 GMT: [DEBUG] Adding to queue main 2021.11.22 23:27:28.461 GMT: [DEBUG] Removed dummy 2021.11.22 23:27:28.461 GMT: [DEBUG] Adding to level 1 main 2021.11.22 23:27:28.461 GMT: [DEBUG] Adding to queue finalization 2021.11.22 23:27:28.461 GMT: [DEBUG] Removed main 2021.11.22 23:27:28.461 GMT: [DEBUG] Adding to level 2 finalization 2021.11.22 23:27:28.461 GMT: [DEBUG] Removed finalization 2021.11.22 23:27:28.461 GMT: [INFO] Starting Graph Traversal - DONE 2021.11.22 23:27:28.461 GMT: [DEBUG] Partition is [finalization] corresponding to label finalization 2021.11.22 23:27:28.462 GMT: [DEBUG] Clustering jobs in partition ID2 [finalization] 2021.11.22 23:27:28.462 GMT: [DEBUG] No clustering for partition ID2 2021.11.22 23:27:28.462 GMT: [DEBUG] Partition is [main] corresponding to label main 2021.11.22 23:27:28.462 GMT: [DEBUG] Clustering jobs in partition ID1 [main] 2021.11.22 23:27:28.462 GMT: [DEBUG] No clustering for partition ID1 2021.11.22 23:27:28.462 GMT: [INFO] Determining relations between partitions 2021.11.22 23:27:28.462 GMT: [INFO] Determining relations between partitions - DONE 2021.11.22 23:27:28.463 GMT: [DEBUG] Adding job to graph pegasus-plan_finalization 2021.11.22 23:27:28.463 GMT: [DEBUG] Adding job to graph pegasus-plan_main 2021.11.22 23:27:28.463 GMT: [DEBUG] Adding parents for child finalization 2021.11.22 23:27:28.463 GMT: [CONFIG] Partitioner loaded is Level Based Partitioning 2021.11.22 23:27:28.465 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.465 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.466 GMT: [CONFIG] Clusterer loaded is Horizontal Clustering 2021.11.22 23:27:28.466 GMT: [DEBUG] Adding to level 0 dummy 2021.11.22 23:27:28.466 GMT: [DEBUG] Adding to queue main 2021.11.22 23:27:28.466 GMT: [DEBUG] Removed dummy 2021.11.22 23:27:28.466 GMT: [DEBUG] Adding to level 1 main 2021.11.22 23:27:28.466 GMT: [DEBUG] Adding to queue finalization 2021.11.22 23:27:28.466 GMT: [DEBUG] Removed main 2021.11.22 23:27:28.466 GMT: [DEBUG] Partition ID1 is :[main] 2021.11.22 23:27:28.466 GMT: [DEBUG] Clustering jobs in partition ID1 [main] 2021.11.22 23:27:28.467 GMT: [DEBUG] Clustering jobs of type pegasus-pegasus-plan-5_0_1 2021.11.22 23:27:28.467 GMT: [DEBUG] No clustering of jobs mapped to execution site local 2021.11.22 23:27:28.467 GMT: [DEBUG] Adding to level 2 finalization 2021.11.22 23:27:28.467 GMT: [DEBUG] Removed finalization 2021.11.22 23:27:28.467 GMT: [DEBUG] Partition ID2 is :[finalization] 2021.11.22 23:27:28.467 GMT: [DEBUG] Clustering jobs in partition ID2 [finalization] 2021.11.22 23:27:28.467 GMT: [DEBUG] Clustering jobs of type pegasus-pegasus-plan-5_0_1 2021.11.22 23:27:28.467 GMT: [DEBUG] No clustering of jobs mapped to execution site local 2021.11.22 23:27:28.468 GMT: [DEBUG] Replacing {pegasus-plan_main [] -> pegasus-plan_finalization [],false} with {pegasus-plan_main [] -> pegasus-plan_finalization [],false}Add to set : true 2021.11.22 23:27:28.468 GMT: [DEBUG] All clustered jobs removed from the workflow 2021.11.22 23:27:28.468 GMT: [INFO] event.pegasus.cluster dax.id 3ogc_ringdown.dax-0 (0.023 seconds) - FINISHED 2021.11.22 23:27:28.468 GMT: [DEBUG] Initialising Replica Catalog for Planner Cache 2021.11.22 23:27:28.469 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor SimpleFile -> {output=JDBCRC, output.db.create=true, file=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.getcache, read.only=true, dax.asrc=true, output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, output.db.driver=sqlite, cache.asrc=true} 2021.11.22 23:27:28.469 GMT: [DEBUG] Initialising Replica Catalog for Planner Cache 2021.11.22 23:27:28.470 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor SimpleFile -> {output=JDBCRC, output.db.create=true, file=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.putcache, read.only=true, dax.asrc=true, output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, output.db.driver=sqlite, cache.asrc=true} 2021.11.22 23:27:28.470 GMT: [INFO] Grafting transfer nodes in the workflow 2021.11.22 23:27:28.470 GMT: [INFO] event.pegasus.generate.transfer-nodes dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.471 GMT: [DEBUG] Date Reuse Engine no longer tracks deleted leaf jobs. Returning empty list 2021.11.22 23:27:28.476 GMT: [CONFIG] No Replica Registration Jobs will be created . 2021.11.22 23:27:28.477 GMT: [DEBUG] Number of transfer jobs for -1 are 0 2021.11.22 23:27:28.477 GMT: [DEBUG] Number of transfer jobs for 0 are 1 2021.11.22 23:27:28.477 GMT: [DEBUG] Number of transfer jobs for 1 are 1 2021.11.22 23:27:28.478 GMT: [CONFIG] Transfer Implementation loaded for Stage-In [Python based Transfer Script] 2021.11.22 23:27:28.479 GMT: [CONFIG] Transfer Implementation loaded for symbolic linking Stage-In [Python based Transfer Script] 2021.11.22 23:27:28.479 GMT: [CONFIG] Transfer Implementation loaded for Inter Site [Python based Transfer Script] 2021.11.22 23:27:28.479 GMT: [CONFIG] Transfer Implementation loaded for Stage-Out [Python based Transfer Script] 2021.11.22 23:27:28.481 GMT: [DEBUG] Rank ( rank => 1 priority => 500 expr => file://(?!.*(cvmfs)).*) 2021.11.22 23:27:28.481 GMT: [DEBUG] Rank ( rank => 2 priority => 400 expr => file:///cvmfs/.*) 2021.11.22 23:27:28.481 GMT: [DEBUG] Rank ( rank => 3 priority => 300 expr => root://.*) 2021.11.22 23:27:28.481 GMT: [DEBUG] Rank ( rank => 4 priority => 200 expr => gsiftp://red-gridftp.unl.edu.*) 2021.11.22 23:27:28.481 GMT: [DEBUG] Rank ( rank => 5 priority => 100 expr => gridftp://.*) 2021.11.22 23:27:28.481 GMT: [DEBUG] Rank ( rank => 6 priority => 0 expr => .*) 2021.11.22 23:27:28.481 GMT: [CONFIG] [RegexReplicaSelector] User Provided Ranked regexes are [( rank => 1 priority => 500 expr => file://(?!.*(cvmfs)).*), ( rank => 2 priority => 400 expr => file:///cvmfs/.*), ( rank => 3 priority => 300 expr => root://.*), ( rank => 4 priority => 200 expr => gsiftp://red-gridftp.unl.edu.*), ( rank => 5 priority => 100 expr => gridftp://.*), ( rank => 6 priority => 0 expr => .*)] 2021.11.22 23:27:28.484 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor File -> {file=output.map, read.only=true} 2021.11.22 23:27:28.485 GMT: [CONFIG] Output Mapper loaded is [Replica Catalog Mapper] 2021.11.22 23:27:28.485 GMT: [DEBUG] Initialising Workflow Cache File in the Submit Directory 2021.11.22 23:27:28.485 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor FlushedCache -> {output=JDBCRC, output.db.create=true, file=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.cache, dax.asrc=true, output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, output.db.driver=sqlite, cache.asrc=true} 2021.11.22 23:27:28.486 GMT: [CONFIG] Transfer Refiner loaded is [Balanced Cluster Transfer Refiner( round robin distribution at file level)] 2021.11.22 23:27:28.486 GMT: [CONFIG] ReplicaSelector loaded is [Regex] 2021.11.22 23:27:28.486 GMT: [CONFIG] Submit Directory Mapper loaded is [Relative Submit Directory Mapper] 2021.11.22 23:27:28.487 GMT: [CONFIG] Staging Mapper loaded is [Flat Directory Staging Mapper] 2021.11.22 23:27:28.488 GMT: [DEBUG] SRM Server map is {} 2021.11.22 23:27:28.489 GMT: [DEBUG] SRM Server map is {} 2021.11.22 23:27:28.489 GMT: [DEBUG] Directory for job pegasus-plan_main is . 2021.11.22 23:27:28.489 GMT: [DEBUG] 2021.11.22 23:27:28.489 GMT: [DEBUG] Job being traversed is pegasus-plan_main 2021.11.22 23:27:28.489 GMT: [DEBUG] To be run at local 2021.11.22 23:27:28.489 GMT: [DEBUG] Parents of job:{} 2021.11.22 23:27:28.489 GMT: [DEBUG] Initialising Workflow Cache File for job pegasus-plan_main 2021.11.22 23:27:28.489 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor FlushedCache -> {output=JDBCRC, output.db.create=true, file=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./pegasus-plan_main.cache, dax.asrc=true, output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, output.db.driver=sqlite, cache.asrc=true} 2021.11.22 23:27:28.490 GMT: [DEBUG] [RegexReplicaSelector] Selecting a pfn for lfn main.dax at site local amongst main.dax regex false -> {(/work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/main.dax,{site=local}),} 2021.11.22 23:27:28.490 GMT: [DEBUG] Job Input files : Removed file main.dax for job pegasus-plan_main 2021.11.22 23:27:28.490 GMT: [DEBUG] Job Search Files : Removed file main.dax for job pegasus-plan_main 2021.11.22 23:27:28.490 GMT: [DEBUG] Set arguments for DAX job pegasus-plan_main to -Dpegasus.dir.storage.mapper.replica.file=main.map --basename main --cluster label,horizontal --output-sites local --staging-site local=local,condorpool_shared=condorpool_shared --cleanup inplace -vvv /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/main.dax 2021.11.22 23:27:28.492 GMT: [DEBUG] Directory for job pegasus-plan_finalization is . 2021.11.22 23:27:28.493 GMT: [DEBUG] 2021.11.22 23:27:28.493 GMT: [DEBUG] Job being traversed is pegasus-plan_finalization 2021.11.22 23:27:28.493 GMT: [DEBUG] To be run at local 2021.11.22 23:27:28.493 GMT: [DEBUG] Parents of job:{pegasus-plan_main,} 2021.11.22 23:27:28.493 GMT: [DEBUG] Initialising Workflow Cache File for job pegasus-plan_finalization 2021.11.22 23:27:28.493 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor FlushedCache -> {output=JDBCRC, output.db.create=true, file=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./pegasus-plan_finalization.cache, dax.asrc=true, output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, output.db.driver=sqlite, cache.asrc=true} 2021.11.22 23:27:28.493 GMT: [DEBUG] [RegexReplicaSelector] Selecting a pfn for lfn finalization.dax at site local amongst finalization.dax regex false -> {(/work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/finalization.dax,{site=local}),} 2021.11.22 23:27:28.494 GMT: [DEBUG] Job Input files : Removed file finalization.dax for job pegasus-plan_finalization 2021.11.22 23:27:28.494 GMT: [DEBUG] Job Search Files : Removed file finalization.dax for job pegasus-plan_finalization 2021.11.22 23:27:28.494 GMT: [DEBUG] Set arguments for DAX job pegasus-plan_finalization to -Dpegasus.dir.storage.mapper.replica.file=finalization.map --basename finalization --cluster label,horizontal --output-sites local --staging-site local=local,condorpool_shared=condorpool_shared --cleanup inplace -vvv /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/finalization.dax 2021.11.22 23:27:28.495 GMT: [INFO] event.pegasus.generate.transfer-nodes dax.id 3ogc_ringdown.dax-0 (0.025 seconds) - FINISHED 2021.11.22 23:27:28.496 GMT: [DEBUG] Adding worker package deployment node for local 2021.11.22 23:27:28.497 GMT: [DEBUG] Skipping stage worker job for site local as worker package already in submit directory file:///local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus-worker-5.0.1-x86_64_deb_10.tar.gz 2021.11.22 23:27:28.497 GMT: [INFO] event.pegasus.generate.workdir-nodes dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.500 GMT: [DEBUG] Trying to get TCEntries for pegasus::dirmanager on resource local of type INSTALLED 2021.11.22 23:27:28.501 GMT: [DEBUG] Creating create dir node create_dir_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.501 GMT: [DEBUG] Need to add edge create_dir_3ogc_ringdown.dax_0_local -> pegasus-plan_main 2021.11.22 23:27:28.501 GMT: [DEBUG] Adding node to the worfklow create_dir_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.502 GMT: [INFO] event.pegasus.generate.workdir-nodes dax.id 3ogc_ringdown.dax-0 (0.004 seconds) - FINISHED 2021.11.22 23:27:28.502 GMT: [INFO] event.pegasus.generate.cleanup-nodes dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.505 GMT: [CONFIG] Setting property dagman.cleanup.maxjobs to 4 to set max jobs for cleanup jobs category 2021.11.22 23:27:28.505 GMT: [DEBUG] Number of sites 1 2021.11.22 23:27:28.505 GMT: [DEBUG] Site local count jobs = 3 2021.11.22 23:27:28.505 GMT: [DEBUG] * create_dir_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.505 GMT: [DEBUG] * pegasus-plan_finalization 2021.11.22 23:27:28.506 GMT: [DEBUG] * pegasus-plan_main 2021.11.22 23:27:28.506 GMT: [DEBUG] local 3 2021.11.22 23:27:28.506 GMT: [DEBUG] Leaf jobs scheduled at site local are create_dir_3ogc_ringdown.dax_0_local,pegasus-plan_finalization,pegasus-plan_main, 2021.11.22 23:27:28.506 GMT: [DEBUG] File finalization.map will not be cleaned up for job pegasus-plan_finalization 2021.11.22 23:27:28.506 GMT: [DEBUG] File main.map will not be cleaned up for job pegasus-plan_main 2021.11.22 23:27:28.506 GMT: [DEBUG] 2021.11.22 23:27:28.506 GMT: [INFO] For site: local number of files cleaned up - 0 2021.11.22 23:27:28.506 GMT: [DEBUG] CLEANUP LIST 2021.11.22 23:27:28.506 GMT: [INFO] event.pegasus.generate.cleanup-nodes dax.id 3ogc_ringdown.dax-0 (0.004 seconds) - FINISHED 2021.11.22 23:27:28.506 GMT: [INFO] Adding Leaf Cleanup Jobs dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.507 GMT: [DEBUG] Directory URL is a file url for site local [file:///work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/local-site-scratch/work] 2021.11.22 23:27:28.508 GMT: [DEBUG] Trying to get TCEntries for pegasus::cleanup on resource local of type INSTALLED 2021.11.22 23:27:28.508 GMT: [DEBUG] Creating remove directory node cleanup_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.508 GMT: [DEBUG] Need to add edge for DAX|DAG job pegasus-plan_finalization -> cleanup_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.508 GMT: [DEBUG] Need to add edge pegasus-plan_finalization -> cleanup_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.508 GMT: [DEBUG] Need to add edge for DAX|DAG job pegasus-plan_main -> cleanup_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.508 GMT: [DEBUG] Adding node to the worklfow cleanup_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.509 GMT: [INFO] Adding Leaf Cleanup Jobs dax.id 3ogc_ringdown.dax-0 (0.003 seconds) - FINISHED 2021.11.22 23:27:28.510 GMT: [INFO] event.pegasus.refinement dax.id 3ogc_ringdown.dax-0 (0.118 seconds) - FINISHED 2021.11.22 23:27:28.538 GMT: [DEBUG] Condor Version as string 8.8.9 2021.11.22 23:27:28.538 GMT: [DEBUG] Condor Version detected is 80809 2021.11.22 23:27:28.538 GMT: [INFO] Generating codes for the executable workflow 2021.11.22 23:27:28.538 GMT: [INFO] event.pegasus.code.generation dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.538 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.538 GMT: [DEBUG] event.pegasus.code.generation dax.id 3ogc_ringdown.dax-0 - STARTED 2021.11.22 23:27:28.563 GMT: [DEBUG] Condor Version as string 8.8.9 2021.11.22 23:27:28.563 GMT: [DEBUG] Condor Version detected is 80809 2021.11.22 23:27:28.564 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.565 GMT: [DEBUG] Applying priority of 800 to create_dir_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.593 GMT: [DEBUG] Mount Under Scratch Directories [/tmp, /var/tmp] 2021.11.22 23:27:28.594 GMT: [DEBUG] Trying to get TCEntries for pegasus::kickstart on resource local of type INSTALLED 2021.11.22 23:27:28.595 GMT: [DEBUG] Postscript constructed is /software/tools/pegasus/5.0/bin/pegasus-exitcode 2021.11.22 23:27:28.596 GMT: [DEBUG] Unquoted arguments are pegasus-kickstart -n pegasus::dirmanager -N null -i - -R local -L 3ogc_ringdown.dax -T 2021-11-22T23:27:24+00:00 pegasus-transfer 2021.11.22 23:27:28.596 GMT: [DEBUG] Quoted arguments are "pegasus-kickstart -n pegasus::dirmanager -N null -i - -R local -L 3ogc_ringdown.dax -T 2021-11-22T23:27:24+00:00 pegasus-transfer " 2021.11.22 23:27:28.597 GMT: [DEBUG] Written Submit file : /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./create_dir_3ogc_ringdown.dax_0_local.sub 2021.11.22 23:27:28.597 GMT: [DEBUG] Applying priority of 10 to pegasus-plan_main 2021.11.22 23:27:28.597 GMT: [DEBUG] Generating code for DAX job pegasus-plan_main 2021.11.22 23:27:28.597 GMT: [DEBUG] Arguments passed to SUBDAX Generator are -Dpegasus.dir.storage.mapper.replica.file=main.map --basename main --cluster label,horizontal --output-sites local --staging-site local=local,condorpool_shared=condorpool_shared --cleanup inplace -vvv /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/main.dax 2021.11.22 23:27:28.600 GMT: [DEBUG] Retrieving Metadata from the DAX file /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/main.dax 2021.11.22 23:27:28.634 GMT: [DEBUG] Submit directory in sub dax specified is ./main.dax_main 2021.11.22 23:27:28.635 GMT: [DEBUG] Base Submit directory for inner workflow set to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc 2021.11.22 23:27:28.635 GMT: [DEBUG] Relative Submit Directory for inner workflow set to work/././main.dax_main 2021.11.22 23:27:28.635 GMT: [DEBUG] Submit directory for inner workflow set to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/././main.dax_main 2021.11.22 23:27:28.635 GMT: [DEBUG] Setting list of execution sites to the same as outer workflow 2021.11.22 23:27:28.635 GMT: [DEBUG] Submit Directory for SUB DAX is /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/././main.dax_main 2021.11.22 23:27:28.635 GMT: [DEBUG] Relative Execution Directory for SUB DAX is work/./main.dax_main 2021.11.22 23:27:28.636 GMT: [DEBUG] Trying to get TCEntries for pegasus::pegasus-plan on resource local of type INSTALLED 2021.11.22 23:27:28.636 GMT: [DEBUG] Constructing the default path to the pegasus-plan 2021.11.22 23:27:28.636 GMT: [DEBUG] pegasus-plan invocation for job pegasus-plan_main determined to be /software/tools/pegasus/5.0/bin/pegasus-plan -Dpegasus.log.*=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus-plan_main.pre.log -Dpegasus.workflow.root.uuid=d75315ad-99a8-4a40-a083-ef639107d4c2 -Dpegasus.dir.storage.mapper.replica.file=main.map --conf /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus.11725428712522239291.properties --dir /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc --relative-dir work/./main.dax_main --relative-submit-dir work/././main.dax_main --basename main --sites condorpool_shared,local --staging-site condorpool_shared=condorpool_shared,local=local, --cache /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./pegasus-plan_main.cache --inherited-rc-files /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replica.store --cluster label,horizontal --output-sites local --cleanup inplace --verbose --verbose --verbose --deferred /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/main.dax 2021.11.22 23:27:28.636 GMT: [DEBUG] Basename prefix for the sub workflow is main 2021.11.22 23:27:28.636 GMT: [DEBUG] Cache File for the sub workflow is /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/././main.dax_main/main.cache 2021.11.22 23:27:28.636 GMT: [DEBUG] Trying to get TCEntries for condor::dagman on resource local of type INSTALLED 2021.11.22 23:27:28.636 GMT: [DEBUG] condor::dagman not catalogued in the Transformation Catalog. Trying to construct from the Site Catalog 2021.11.22 23:27:28.637 GMT: [DEBUG] DAGMan not catalogued in the Transformation Catalog or the Site Catalog. Trying to construct from the environment 2021.11.22 23:27:28.637 GMT: [DEBUG] Constructing path to dagman on basis of env variable CONDOR_LOCATION 2021.11.22 23:27:28.637 GMT: [DEBUG] Number of Resuce retries 999 2021.11.22 23:27:28.637 GMT: [DEBUG] Constructing arguments to dagman in 7.1.0 and later style 2021.11.22 23:27:28.643 GMT: [CONFIG] Kickstart Stating Disabled Completely - false 2021.11.22 23:27:28.648 GMT: [DEBUG] Setting job pegasus-plan_main.pre to run via No container wrapping 2021.11.22 23:27:28.648 GMT: [DEBUG] Trying to get TCEntries for pegasus::kickstart on resource local of type INSTALLED 2021.11.22 23:27:28.648 GMT: [DEBUG] Trying to get TCEntries for pegasus::transfer on resource local of type INSTALLED 2021.11.22 23:27:28.651 GMT: [DEBUG] Unquoted arguments are -p 0 -f -l . -Notification never -Debug 3 -Lockfile main.dag.lock -Dag main.dag -AllowVersionMismatch -AutoRescue 1 -DoRescueFrom 0 -MaxPre 1 2021.11.22 23:27:28.651 GMT: [DEBUG] Quoted arguments are " -p 0 -f -l . -Notification never -Debug 3 -Lockfile main.dag.lock -Dag main.dag -AllowVersionMismatch -AutoRescue 1 -DoRescueFrom 0 -MaxPre 1" 2021.11.22 23:27:28.652 GMT: [DEBUG] Written Submit file : /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./pegasus-plan_main.sub 2021.11.22 23:27:28.652 GMT: [DEBUG] Applying priority of 20 to pegasus-plan_finalization 2021.11.22 23:27:28.652 GMT: [DEBUG] Generating code for DAX job pegasus-plan_finalization 2021.11.22 23:27:28.652 GMT: [DEBUG] Arguments passed to SUBDAX Generator are -Dpegasus.dir.storage.mapper.replica.file=finalization.map --basename finalization --cluster label,horizontal --output-sites local --staging-site local=local,condorpool_shared=condorpool_shared --cleanup inplace -vvv /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/finalization.dax 2021.11.22 23:27:28.653 GMT: [DEBUG] Retrieving Metadata from the DAX file /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/finalization.dax 2021.11.22 23:27:28.657 GMT: [DEBUG] Submit directory in sub dax specified is ./finalization.dax_finalization 2021.11.22 23:27:28.658 GMT: [DEBUG] Base Submit directory for inner workflow set to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc 2021.11.22 23:27:28.658 GMT: [DEBUG] Relative Submit Directory for inner workflow set to work/././finalization.dax_finalization 2021.11.22 23:27:28.658 GMT: [DEBUG] Submit directory for inner workflow set to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/././finalization.dax_finalization 2021.11.22 23:27:28.658 GMT: [DEBUG] Setting list of execution sites to the same as outer workflow 2021.11.22 23:27:28.658 GMT: [DEBUG] Parent DAX Jobs Transient RC's are [null] 2021.11.22 23:27:28.658 GMT: [DEBUG] Submit Directory for SUB DAX is /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/././finalization.dax_finalization 2021.11.22 23:27:28.658 GMT: [DEBUG] Relative Execution Directory for SUB DAX is work/./finalization.dax_finalization 2021.11.22 23:27:28.658 GMT: [DEBUG] Trying to get TCEntries for pegasus::pegasus-plan on resource local of type INSTALLED 2021.11.22 23:27:28.658 GMT: [DEBUG] Constructing the default path to the pegasus-plan 2021.11.22 23:27:28.658 GMT: [DEBUG] pegasus-plan invocation for job pegasus-plan_finalization determined to be /software/tools/pegasus/5.0/bin/pegasus-plan -Dpegasus.log.*=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus-plan_finalization.pre.log -Dpegasus.workflow.root.uuid=d75315ad-99a8-4a40-a083-ef639107d4c2 -Dpegasus.dir.storage.mapper.replica.file=finalization.map --conf /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus.11725428712522239291.properties --dir /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc --relative-dir work/./finalization.dax_finalization --relative-submit-dir work/././finalization.dax_finalization --basename finalization --sites condorpool_shared,local --staging-site condorpool_shared=condorpool_shared,local=local, --cache null,/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./pegasus-plan_finalization.cache --inherited-rc-files /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replica.store --cluster label,horizontal --output-sites local --cleanup inplace --verbose --verbose --verbose --deferred /work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output/finalization.dax 2021.11.22 23:27:28.658 GMT: [DEBUG] Basename prefix for the sub workflow is finalization 2021.11.22 23:27:28.658 GMT: [DEBUG] Cache File for the sub workflow is /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/././finalization.dax_finalization/finalization.cache 2021.11.22 23:27:28.658 GMT: [DEBUG] Trying to get TCEntries for condor::dagman on resource local of type INSTALLED 2021.11.22 23:27:28.658 GMT: [DEBUG] condor::dagman not catalogued in the Transformation Catalog. Trying to construct from the Site Catalog 2021.11.22 23:27:28.658 GMT: [DEBUG] DAGMan not catalogued in the Transformation Catalog or the Site Catalog. Trying to construct from the environment 2021.11.22 23:27:28.658 GMT: [DEBUG] Constructing path to dagman on basis of env variable CONDOR_LOCATION 2021.11.22 23:27:28.658 GMT: [DEBUG] Number of Resuce retries 999 2021.11.22 23:27:28.658 GMT: [DEBUG] Constructing arguments to dagman in 7.1.0 and later style 2021.11.22 23:27:28.659 GMT: [DEBUG] Setting job pegasus-plan_finalization.pre to run via No container wrapping 2021.11.22 23:27:28.659 GMT: [DEBUG] Trying to get TCEntries for pegasus::kickstart on resource local of type INSTALLED 2021.11.22 23:27:28.659 GMT: [DEBUG] Trying to get TCEntries for pegasus::transfer on resource local of type INSTALLED 2021.11.22 23:27:28.660 GMT: [DEBUG] Unquoted arguments are -p 0 -f -l . -Notification never -Debug 3 -Lockfile finalization.dag.lock -Dag finalization.dag -AllowVersionMismatch -AutoRescue 1 -DoRescueFrom 0 -MaxPre 1 2021.11.22 23:27:28.660 GMT: [DEBUG] Quoted arguments are " -p 0 -f -l . -Notification never -Debug 3 -Lockfile finalization.dag.lock -Dag finalization.dag -AllowVersionMismatch -AutoRescue 1 -DoRescueFrom 0 -MaxPre 1" 2021.11.22 23:27:28.660 GMT: [DEBUG] Written Submit file : /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./pegasus-plan_finalization.sub 2021.11.22 23:27:28.660 GMT: [DEBUG] Applying priority of 1000 to cleanup_3ogc_ringdown.dax_0_local 2021.11.22 23:27:28.661 GMT: [DEBUG] Trying to get TCEntries for pegasus::kickstart on resource local of type INSTALLED 2021.11.22 23:27:28.661 GMT: [DEBUG] Postscript constructed is /software/tools/pegasus/5.0/bin/pegasus-exitcode 2021.11.22 23:27:28.661 GMT: [DEBUG] Unquoted arguments are pegasus-kickstart -n pegasus::cleanup -N null -i - -R local -L 3ogc_ringdown.dax -T 2021-11-22T23:27:24+00:00 pegasus-transfer 2021.11.22 23:27:28.661 GMT: [DEBUG] Quoted arguments are "pegasus-kickstart -n pegasus::cleanup -N null -i - -R local -L 3ogc_ringdown.dax -T 2021-11-22T23:27:24+00:00 pegasus-transfer " 2021.11.22 23:27:28.662 GMT: [DEBUG] Written Submit file : /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/./cleanup_3ogc_ringdown.dax_0_local.sub 2021.11.22 23:27:28.662 GMT: [DEBUG] event.pegasus.code.generation dax.id 3ogc_ringdown.dax-0 (0.124 seconds) - FINISHED 2021.11.22 23:27:28.662 GMT: [DEBUG] Written Dag File : 3ogc_ringdown.dax-0.dag.tmp 2021.11.22 23:27:28.662 GMT: [DEBUG] Writing out the DOT file 2021.11.22 23:27:28.670 GMT: [DEBUG] Written out notifications to 3ogc_ringdown.dax-0.notify 2021.11.22 23:27:28.671 GMT: [DEBUG] Writing out the DAX Replica Store to file /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replica.store 2021.11.22 23:27:28.671 GMT: [DEBUG] [Replica Factory] Connect properties detected for implementor SimpleFile -> {output=JDBCRC, output.db.create=true, file=/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replica.store, dax.asrc=true, output.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db, output.db.driver=sqlite, cache.asrc=true} 2021.11.22 23:27:28.672 GMT: [DEBUG] Written out dax replica store to 3ogc_ringdown.dax-0.replica.store 2021.11.22 23:27:28.673 GMT: [DEBUG] Written out stampede events for the executable workflow to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.static.bp 2021.11.22 23:27:28.681 GMT: [DEBUG] Proxy whose DN will be logged in the braindump file /tmp/x509up_u44039 2021.11.22 23:27:28.727 GMT: [DEBUG] Unable to determine GRID DN class org.globus.gsi.gssapi.GlobusGSSException: Defective credential detected [Caused by: proxy not found] 2021.11.22 23:27:28.757 GMT: [DEBUG] Written out braindump to /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/braindump.yml 2021.11.22 23:27:28.758 GMT: [DEBUG] Renamed temporary dag file to : /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.dag 2021.11.22 23:27:28.759 GMT: [DEBUG] Executing /usr/bin/condor_submit_dag -append executable=/software/tools/pegasus/5.0/bin/pegasus-dagman -no_submit -MaxPre 1 -MaxPost 20 -append +pegasus_wf_uuid="d75315ad-99a8-4a40-a083-ef639107d4c2" -append +pegasus_root_wf_uuid="d75315ad-99a8-4a40-a083-ef639107d4c2" -append +pegasus_wf_name="3ogc_ringdown.dax-0" -append +pegasus_wf_time="20211122T232727+0000" -append +pegasus_version="5.0.1" -append +pegasus_job_class=11 -append +pegasus_cluster_size=1 -append +pegasus_site="local" -append +pegasus_execution_sites="condorpool_shared,local" -append +pegasus_wf_xformation="pegasus::dagman" 3ogc_ringdown.dax-0.dag with environment = PATH=/software/tools/pegasus/5.0/bin/:/work/yifan.wang/virtualenv/4ogc/bin:/work/yifan.wang/lscsoft/opt/accomlal/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/games:/usr/games;PKG_CONFIG_PATH=/work/yifan.wang/lscsoft/opt/accomlal/lib/pkgconfig:;LAL_DATA_PATH=/atlas/recent/cbc/ROM_data/;TZ=:/etc/localtime;MODULEPATH=/etc/environment-modules/modules:/usr/share/modules/versions:/usr/share/modules/$MODULE_VERSION/modulefiles:/usr/share/modules/modulefiles;PEGASUS_PERL_DIR=/software/tools/pegasus/5.0/lib/pegasus/perl;DBUS_SESSION_BUS_ADDRESS=unix:path=/run/user/44039/bus;MAIL=/var/mail/yifan.wang;LD_LIBRARY_PATH=/work/yifan.wang/eccsearch/C:/work/yifan.wang/1-ecc-waveform-PE/IMRPhenomDecc:/work/yifan.wang/lscsoft/opt/accomlal/lib/:/work/yifan.wang/lscsoft/MultiNest/lib:;LOGNAME=yifan.wang;PWD=/work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221/3ogc_ringdown_output;PYTHONPATH=/software/tools/pegasus/5.0/lib/python3.7/dist-packages/:/work/yifan.wang/eccsearch/waveform/ihes-teobresum/Python:/work/yifan.wang/eccsearch/eccwaveform:/work/yifan.wang/1-ecc-waveform-PE/IMRPhenomDecc:/work/yifan.wang/lscsoft/src/TaylorF2e:;SHELL=/bin/bash;BASH_ENV=/usr/share/modules/init/bash;LM_LICENSE_FILE=/opt/matlab/default/etc/license.dat;OLDPWD=/work/yifan.wang/ringdown/t7-3ogc_fixpsd/220_221;TMPDIR=/local/user/yifan.wang;VIRTUAL_ENV=/work/yifan.wang/virtualenv/4ogc;MODULEPATH_modshare=/etc/environment-modules/modules:1:/usr/share/modules/$MODULE_VERSION/modulefiles:1:/usr/share/modules/modulefiles:1:/usr/share/modules/versions:1;LC_ALL=C;PEGASUS_PYTHON_DIR=/software/tools/pegasus/5.0/lib/python3.7/dist-packages;LC_CTYPE=en_US.UTF-8;SHLVL=3;SLACK_BOT_TOKEN=xoxp-1889174914644-1876230893430-1893291262468-e9d8766407c79a32862f209441631a1f;CONDOR_LOCATION=/usr;LOADEDMODULES=;SCRATCH=/local/user/yifan.wang;PEGASUS_SCHEMA_DIR=/software/tools/pegasus/5.0/share/pegasus/schema;JAVA_HOME=/usr/lib/jvm/default-java;TERM=xterm-256color;ENV=/usr/share/modules/init/profile.sh;LANG=en_US.UTF-8;XDG_SESSION_ID=93270;XDG_SESSION_TYPE=tty;PEGASUS_PYTHON_EXTERNALS_DIR=/software/tools/pegasus/5.0/lib/pegasus/externals/python;XDG_SESSION_CLASS=user;_=/software/tools/pegasus/5.0/bin/pegasus-plan;PEGASUS_JAVA_DIR=/software/tools/pegasus/5.0/share/pegasus/java;SSH_TTY=/dev/pts/35;SSH_CLIENT=130.75.117.49 53964 22;USER=yifan.wang;CLASSPATH=/software/tools/pegasus/5.0/share/pegasus/java/accessors.jar:/software/tools/pegasus/5.0/share/pegasus/java/bcprov-jdk15on-150.jar:/software/tools/pegasus/5.0/share/pegasus/java/btf-1.2.jar:/software/tools/pegasus/5.0/share/pegasus/java/commons-lang3-3.4.jar:/software/tools/pegasus/5.0/share/pegasus/java/commons-logging.jar:/software/tools/pegasus/5.0/share/pegasus/java/commons-pool.jar:/software/tools/pegasus/5.0/share/pegasus/java/exist-optional.jar:/software/tools/pegasus/5.0/share/pegasus/java/exist.jar:/software/tools/pegasus/5.0/share/pegasus/java/gram-2.1.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/gridftp-2.1.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/gson-2.2.2.jar:/software/tools/pegasus/5.0/share/pegasus/java/gss-2.1.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/guava-16.0.1.jar:/software/tools/pegasus/5.0/share/pegasus/java/hamcrest-core-1.3.jar:/software/tools/pegasus/5.0/share/pegasus/java/io-2.1.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/jackson-annotations-2.9.10.jar:/software/tools/pegasus/5.0/share/pegasus/java/jackson-core-2.9.10.jar:/software/tools/pegasus/5.0/share/pegasus/java/jackson-coreutils-1.8.jar:/software/tools/pegasus/5.0/share/pegasus/java/jackson-databind-2.9.10.jar:/software/tools/pegasus/5.0/share/pegasus/java/jackson-dataformat-yaml-2.9.10.jar:/software/tools/pegasus/5.0/share/pegasus/java/jakarta-oro.jar:/software/tools/pegasus/5.0/share/pegasus/java/java-getopt-1.0.9.jar:/software/tools/pegasus/5.0/share/pegasus/java/javax.json-1.0.4.jar:/software/tools/pegasus/5.0/share/pegasus/java/jcodings-1.0.46.jar:/software/tools/pegasus/5.0/share/pegasus/java/joda-time-2.3.jar:/software/tools/pegasus/5.0/share/pegasus/java/joni-2.1.31.jar:/software/tools/pegasus/5.0/share/pegasus/java/json-schema-validator-1.0.41.jar:/software/tools/pegasus/5.0/share/pegasus/java/jsse-2.1.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/libphonenumber-6.2.jar:/software/tools/pegasus/5.0/share/pegasus/java/log4j-1.2.17.jar:/software/tools/pegasus/5.0/share/pegasus/java/mailapi-1.4.3.jar:/software/tools/pegasus/5.0/share/pegasus/java/msg-simple-1.1.jar:/software/tools/pegasus/5.0/share/pegasus/java/myproxy-2.1.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/mysql-connector-java-5.1.47.jar:/software/tools/pegasus/5.0/share/pegasus/java/pegasus-aws-batch.jar:/software/tools/pegasus/5.0/share/pegasus/java/pegasus.jar:/software/tools/pegasus/5.0/share/pegasus/java/postgresql-8.1dev-400.jdbc3.jar:/software/tools/pegasus/5.0/share/pegasus/java/resolver.jar:/software/tools/pegasus/5.0/share/pegasus/java/rhino-1.7R4.jar:/software/tools/pegasus/5.0/share/pegasus/java/snakeyaml-1.25.jar:/software/tools/pegasus/5.0/share/pegasus/java/sqlite-jdbc-3.8.11.2.jar:/software/tools/pegasus/5.0/share/pegasus/java/ssl-proxies-2.1.0-patched.jar:/software/tools/pegasus/5.0/share/pegasus/java/super-csv-2.4.0.jar:/software/tools/pegasus/5.0/share/pegasus/java/uri-template-0.9.jar:/software/tools/pegasus/5.0/share/pegasus/java/vdl.jar:/software/tools/pegasus/5.0/share/pegasus/java/xercesImpl.jar:/software/tools/pegasus/5.0/share/pegasus/java/xml-apis-1.4.01.jar:/software/tools/pegasus/5.0/share/pegasus/java/xmlParserAPIs.jar:/software/tools/pegasus/5.0/share/pegasus/java/xmldb.jar:/software/tools/pegasus/5.0/share/pegasus/java/xmlrpc.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/apache-client-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/batch-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/commons-logging-api-1.1.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/core-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/http-client-spi-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/httpclient-4.5.2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/httpcore-4.4.4.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/jackson-annotations-2.8.8.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/jackson-databind-2.8.8.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/jackson-jr-objects-2.9.0.pr4.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/joda-time-2.8.1.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/jopt-simple-5.0.4.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/logs-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/metrics-spi-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/netty-nio-client-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/s3-2.0.0-preview-2.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/slf4j-api-1.7.25.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/slf4j-log4j12-1.7.25.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/thirdparty-logging.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/thirdparty.jar:/software/tools/pegasus/5.0/share/pegasus/java/aws/utils-2.0.0-preview-2.jar;C_INCLUDE_PATH=/work/yifan.wang/lscsoft/opt/accomlal/include:;PEGASUS_BIN_DIR=/software/tools/pegasus/5.0/bin;SSH_CONNECTION=130.75.117.49 53964 130.75.116.19 22;MODULESHOME=/usr/share/modules;PEGASUS_CONF_DIR=/software/tools/pegasus/5.0/etc;TMP=/local/user/yifan.wang;PYCBC_WAVEFORM=taylorf2e;PEGASUS_ORIG_CLASSPATH=;MODULES_CMD=/usr/lib/x86_64-linux-gnu/modulecmd.tcl;LIGO_DATAFIND_SERVER=ldr.atlas.local:80;GW_DATAFIND_SERVER=;XDG_RUNTIME_DIR=/run/user/44039;PEGASUS_SHARE_DIR=/software/tools/pegasus/5.0/share/pegasus;HOME=/work/yifan.wang; 2021.11.22 23:27:28.784 GMT: 2021.11.22 23:27:28.789 GMT: ----------------------------------------------------------------------- 2021.11.22 23:27:28.795 GMT: File for submitting this DAG to HTCondor : 3ogc_ringdown.dax-0.dag.condor.sub 2021.11.22 23:27:28.800 GMT: Log of DAGMan debugging messages : 3ogc_ringdown.dax-0.dag.dagman.out 2021.11.22 23:27:28.805 GMT: Log of HTCondor library output : 3ogc_ringdown.dax-0.dag.lib.out 2021.11.22 23:27:28.810 GMT: Log of HTCondor library error messages : 3ogc_ringdown.dax-0.dag.lib.err 2021.11.22 23:27:28.815 GMT: Log of the life of condor_dagman itself : 3ogc_ringdown.dax-0.dag.dagman.log 2021.11.22 23:27:28.820 GMT: 2021.11.22 23:27:28.825 GMT: -no_submit given, not submitting DAG to HTCondor. You can do this with: 2021.11.22 23:27:28.835 GMT: ----------------------------------------------------------------------- 2021.11.22 23:27:28.841 GMT: [DEBUG] condor_submit_dag exited with status 0 2021.11.22 23:27:28.847 GMT: [DEBUG] Updated environment for dagman is environment = _CONDOR_SCHEDD_ADDRESS_FILE=/local/condor/spool/.schedd_address;_CONDOR_MAX_DAGMAN_LOG=0;_CONDOR_SCHEDD_DAEMON_AD_FILE=/local/condor/spool/.schedd_classad;_CONDOR_DAGMAN_LOG=3ogc_ringdown.dax-0.dag.dagman.out;PEGASUS_METRICS=true; 2021.11.22 23:27:28.847 GMT: [INFO] event.pegasus.code.generation dax.id 3ogc_ringdown.dax-0 (0.309 seconds) - FINISHED 2021.11.22 23:27:28.848 GMT: [DEBUG] Executing /software/tools/pegasus/5.0/bin/pegasus-db-admin update -t master -c /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus.11725428712522239291.properties 2021.11.22 23:27:30.008 GMT: Database version: '5.0.1' (sqlite:////work/yifan.wang/.pegasus/workflow.db) 2021.11.22 23:27:30.064 GMT: [DEBUG] pegasus-db-admin exited with status 0 2021.11.22 23:27:30.066 GMT: [DEBUG] Executing /software/tools/pegasus/5.0/bin/pegasus-db-admin create -Dpegasus.catalog.replica.db.url=jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db -Dpegasus.catalog.replica=JDBCRC -Dpegasus.catalog.replica.db.driver=sqlite -t jdbcrc -c /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/pegasus.11725428712522239291.properties 2021.11.22 23:27:32.209 GMT: Pegasus database was successfully created. 2021.11.22 23:27:32.215 GMT: Database version: '5.0.1' (sqlite:////local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db) 2021.11.22 23:27:32.285 GMT: [DEBUG] pegasus-db-admin exited with status 0 2021.11.22 23:27:32.285 GMT: Output replica catalog set to jdbc:sqlite:/local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work/3ogc_ringdown.dax-0.replicas.db 2021.11.22 23:27:32.286 GMT: [DEBUG] Executing /software/tools/pegasus/5.0/bin/pegasus-run --nogrid /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work 2021.11.22 23:27:32.621 GMT: Submitting to condor 3ogc_ringdown.dax-0.dag.condor.sub 2021.11.22 23:27:32.675 GMT: 2021.11.22 23:27:32.680 GMT: Your workflow has been started and is running in the base directory: 2021.11.22 23:27:32.685 GMT: 2021.11.22 23:27:32.690 GMT: /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work 2021.11.22 23:27:32.695 GMT: 2021.11.22 23:27:32.700 GMT: *** To monitor the workflow you can run *** 2021.11.22 23:27:32.705 GMT: 2021.11.22 23:27:32.711 GMT: pegasus-status -l /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work 2021.11.22 23:27:32.716 GMT: 2021.11.22 23:27:32.721 GMT: *** To remove your workflow run *** 2021.11.22 23:27:32.726 GMT: 2021.11.22 23:27:32.731 GMT: pegasus-remove /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work 2021.11.22 23:27:32.736 GMT: [DEBUG] Submission of workflow exited with status 0 2021.11.22 23:27:32.740 GMT: [DEBUG] Sending Planner Metrics to [1 of 1] http://metrics.pegasus.isi.edu/metrics 2021.11.22 23:27:33.139 GMT: [DEBUG] Metrics succesfully sent to the server 2021.11.22 23:27:33.140 GMT: Time taken to execute is 5.121 seconds 2021.11.22 23:27:33.140 GMT: [INFO] event.pegasus.planner planner.version 5.0.1 (5.377 seconds) - FINISHED Querying Pegasus database for workflow stored in /local/user/yifan.wang/pycbc-tmp.9eE6wYucNc/work This may take up to 120 seconds. Please wait......... Done. Workflow submission completed successfully. The Pegasus dashboard URL for this workflow is: https://condor4.atlas.local/pegasus/u/yifan.wang/r/42/w?wf_uuid=d75315ad-99a8-4a40-a083-ef639107d4c2 Note that it make take a while for the dashboard entry to appear while the workflow is parsed by the dashboard. The delay can be on the order of one hour for very large workflows. Internal error!