1. Use 5 submitter processes, each managing 4 job slots, submitting 60 second sleep jobs, using a single delegation, until 1000 jobs are submitted. # /opt/cream_stress_test/bin/cream_stress_test.py -d single -n 1000 -c 5 -s 4 -e cert-08.pd.infn.it:8443/cream-slurm-creamtest -t submit --jdl sleep --sleep 60 Will create sleep jdl (60 seconds) Will create single delegation Delegation command: /usr/bin/glite-ce-delegate-proxy -e cert-08.pd.infn.it:8443 DJsdCEeczJidUNm Temporary directory is: /tmp/tmpdJ3gD5.cream_stress_testing/ I am printing 1000 Starting at: Mon Aug 18 11:57:51 2014 Dovrebbe essere il numero di thread di sottomissione args.concSubm = 5 submitter process pid 3639 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:51,077 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:51,112 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:51,113 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:51,113 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115751.log]\n', '2014-08-18 11:57:51,126 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:52,228 DEBUG - Will invoke JobStart for JobID [CREAM210740270]\n', 'https://cert-08.pd.infn.it:8443/CREAM210740270\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM210740270 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM210740270 2014-08-18 11:57:52.478207 Submit https://cert-08.pd.infn.it:8443/CREAM210740270 Left: 998 (at submission time:998) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM210740270 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:52,492 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:52,515 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:52,515 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:52,515 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115752.log]\n', '2014-08-18 11:57:52,518 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:53,526 DEBUG - Will invoke JobStart for JobID [CREAM173698016]\n', 'https://cert-08.pd.infn.it:8443/CREAM173698016\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM173698016 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM173698016 2014-08-18 11:57:53.926547 Submit https://cert-08.pd.infn.it:8443/CREAM173698016 Left: 994 (at submission time:994) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM173698016 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:53,948 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:53,970 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:53,971 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:53,971 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115753.log]\n', '2014-08-18 11:57:53,974 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] -submitter process pid 3640 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:51,081 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:51,141 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:51,141 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:51,141 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115751.log]\n', '2014-08-18 11:57:51,145 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:52,225 DEBUG - Will invoke JobStart for JobID [CREAM499661068]\n', 'https://cert-08.pd.infn.it:8443/CREAM499661068\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM499661068 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM499661068 2014-08-18 11:57:52.577851 Submit https://cert-08.pd.infn.it:8443/CREAM499661068 Left: 999 (at submission time:999) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM499661068 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:52,591 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:52,629 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:52,630 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:52,630 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115752.log]\n', '2014-08-18 11:57:52,633 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:53,695 DEBUG - Will invoke JobStart for JobID [CREAM813729575]\n', 'https://cert-08.pd.infn.it:8443/CREAM813729575\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM813729575 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM813729575 2014-08-18 11:57:54.229606 Submit https://cert-08.pd.infn.it:8443/CREAM813729575 Left: 993 (at submission time:993) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM813729575 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:54,242 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:54,272 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:54,272 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:54,272 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115754.log]\n', '2014-08-18 11:57:54,275 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] -submitter process pid 3642 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:51,099 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:51,147 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:51,148 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:51,148 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115751.log]\n', '2014-08-18 11:57:51,152 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:52,394 DEBUG - Will invoke JobStart for JobID [CREAM724830226]\n', 'https://cert-08.pd.infn.it:8443/CREAM724830226\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM724830226 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM724830226 2014-08-18 11:57:52.762185 Submit https://cert-08.pd.infn.it:8443/CREAM724830226 Left: 995 (at submission time:995) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM724830226 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:52,776 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:52,800 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:52,800 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:52,800 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115752.log]\n', '2014-08-18 11:57:52,803 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:53,843 DEBUG - Will invoke JobStart for JobID [CREAM393885965]\n', 'https://cert-08.pd.infn.it:8443/CREAM393885965\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM393885965 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM393885965 2014-08-18 11:57:54.269626 Submit https://cert-08.pd.infn.it:8443/CREAM393885965 Left: 990 (at submission time:990) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM393885965 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:54,293 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:54,350 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:54,350 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:54,350 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115754.log]\n', '2014-08-18 11:57:54,354 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] -submitter process pid 3644 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:51,082 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:51,121 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:51,121 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:51,121 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115751.log]\n', '2014-08-18 11:57:51,134 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:52,333 DEBUG - Will invoke JobStart for JobID [CREAM931018489]\n', 'https://cert-08.pd.infn.it:8443/CREAM931018489\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM931018489 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM931018489 2014-08-18 11:57:52.604640 Submit https://cert-08.pd.infn.it:8443/CREAM931018489 Left: 996 (at submission time:996) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM931018489 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:52,621 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:52,648 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:52,649 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:52,649 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115752.log]\n', '2014-08-18 11:57:52,657 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:53,694 DEBUG - Will invoke JobStart for JobID [CREAM310998887]\n', 'https://cert-08.pd.infn.it:8443/CREAM310998887\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM310998887 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM310998887 2014-08-18 11:57:54.270396 Submit https://cert-08.pd.infn.it:8443/CREAM310998887 Left: 992 (at submission time:992) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM310998887 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:54,286 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:54,318 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:54,318 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:54,318 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115754.log]\n', '2014-08-18 11:57:54,322 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] -submitter process pid 3641 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:51,091 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:51,143 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:51,143 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:51,143 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115751.log]\n', '2014-08-18 11:57:51,149 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:52,324 DEBUG - Will invoke JobStart for JobID [CREAM248968919]\n', 'https://cert-08.pd.infn.it:8443/CREAM248968919\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM248968919 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM248968919 2014-08-18 11:57:52.642056 Submit https://cert-08.pd.infn.it:8443/CREAM248968919 Left: 997 (at submission time:997) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM248968919 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:52,655 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:52,683 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:52,683 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:52,683 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115752.log]\n', '2014-08-18 11:57:52,686 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:53,842 DEBUG - Will invoke JobStart for JobID [CREAM425639248]\n', 'https://cert-08.pd.infn.it:8443/CREAM425639248\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM425639248 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM425639248 2014-08-18 11:57:54.301663 Submit https://cert-08.pd.infn.it:8443/CREAM425639248 Left: 991 (at submission time:991) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM425639248 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:54,329 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:54,361 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:54,362 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:54,362 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115754.log]\n', '2014-08-18 11:57:54,365 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] -2014-08-18 11:57:52.481508 Submitted: 1 Running: 1 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:52.579799 Submitted: 2 Running: 2 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:52.607489 Submitted: 3 Running: 3 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:52.643337 Submitted: 4 Running: 4 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:52.764355 Submitted: 5 Running: 5 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:53.927921 Submitted: 6 Running: 6 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:54.230373 Submitted: 7 Running: 7 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:54.270290 Submitted: 8 Running: 8 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:54.271965 Submitted: 9 Running: 9 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:54.304348 Submitted: 10 Running: 10 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:55.779125 Submitted: 11 Running: 11 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:56.215001 Submitted: 12 Running: 12 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:56.450113 Submitted: 13 Running: 13 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:56.629193 Submitted: 14 Running: 14 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:56.870996 Submitted: 15 Running: 15 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:57.416381 Submitted: 16 Running: 16 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:58.016569 Submitted: 17 Running: 17 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:58.099256 Submitted: 18 Running: 18 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:58.167254 Submitted: 19 Running: 19 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:57:58.257594 Submitted: 20 Running: 20 Cancelled: 0 Done-Ok: 0 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 0/1000 2014-08-18 11:59:14.163061 Submitted: 20 Running: 19 Cancelled: 0 Done-Ok: 1 Failed: 0 Aborted: 0 Status Fail JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:56,294 DEBUG - Will invoke JobStart for JobID [CREAM604400605]\n', 'https://cert-08.pd.infn.it:8443/CREAM604400605\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM604400605 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM604400605 2014-08-18 11:57:56.868936 Submit https://cert-08.pd.infn.it:8443/CREAM604400605 Left: 985 (at submission time:985) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM604400605 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:56,881 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:56,904 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:56,904 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:56,904 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115756.log]\n', '2014-08-18 11:57:56,908 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:58,072 DEBUG - Will invoke JobStart for JobID [CREAM610488107]\n', 'https://cert-08.pd.infn.it:8443/CREAM610488107\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM610488107 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM610488107 2014-08-18 11:57:58.255743 Submit https://cert-08.pd.infn.it:8443/CREAM610488107 Left: 980 (at submission time:980) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM610488107 2014-08-18 12:00:13.631297 Exit https://cert-08.pd.infn.it:8443/CREAM248968919 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:00:14,018 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:00:14,043 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:00:14,043 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:00:14,043 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120014.log]\n', '2014-08-18 12:00:14,046 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:00:14,543 DEBUG - Will invoke JobStart for JobID [CREAM958386571]\n', 'https://cert-08.pd.infn.it:8443/CREAM958386571\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM958386571 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM958386571 2014-08-18 12:00:14.737845 Submit https://cert-08.pd.infn.it:8443/CREAM958386571 Left: 977 (at submission time:977) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM958386571 2014-08-18 12:01:12.114936 Exit https://cert-08.pd.infn.it:8443/CREAM425639248 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/crea JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:56,220 DEBUG - Will invoke JobStart for JobID [CREAM634357731]\n', 'https://cert-08.pd.infn.it:8443/CREAM634357731\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM634357731 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM634357731 2014-08-18 11:57:56.626453 Submit https://cert-08.pd.infn.it:8443/CREAM634357731 Left: 986 (at submission time:986) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM634357731 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:56,644 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:56,667 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:56,667 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:56,667 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115756.log]\n', '2014-08-18 11:57:56,670 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:58,011 DEBUG - Will invoke JobStart for JobID [CREAM527045750]\n', 'https://cert-08.pd.infn.it:8443/CREAM527045750\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM527045750 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM527045750 2014-08-18 11:57:58.164677 Submit https://cert-08.pd.infn.it:8443/CREAM527045750 Left: 981 (at submission time:981) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM527045750 2014-08-18 12:00:14.734507 Exit https://cert-08.pd.infn.it:8443/CREAM931018489 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:00:15,334 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:00:15,353 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:00:15,353 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:00:15,353 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120015.log]\n', '2014-08-18 12:00:15,359 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:00:15,801 DEBUG - Will invoke JobStart for JobID [CREAM706231781]\n', 'https://cert-08.pd.infn.it:8443/CREAM706231781\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM706231781 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM706231781 2014-08-18 12:00:15.919696 Submit https://cert-08.pd.infn.it:8443/CREAM706231781 Left: 975 (at submission time:975) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM706231781 2014-08-18 12:01:14.122108 Exit https://cert-08.pd.infn.it:8443/CREAM310998887 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/crea JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:55,902 DEBUG - Will invoke JobStart for JobID [CREAM954026166]\n', 'https://cert-08.pd.infn.it:8443/CREAM954026166\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM954026166 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM954026166 2014-08-18 11:57:56.447504 Submit https://cert-08.pd.infn.it:8443/CREAM954026166 Left: 987 (at submission time:987) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM954026166 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:56,461 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:56,485 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:56,485 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:56,486 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115756.log]\n', '2014-08-18 11:57:56,496 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:57,780 DEBUG - Will invoke JobStart for JobID [CREAM222102099]\n', 'https://cert-08.pd.infn.it:8443/CREAM222102099\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM222102099 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM222102099 2014-08-18 11:57:58.097367 Submit https://cert-08.pd.infn.it:8443/CREAM222102099 Left: 982 (at submission time:982) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM222102099 2014-08-18 12:00:14.232158 Exit https://cert-08.pd.infn.it:8443/CREAM724830226 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:00:14,686 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:00:14,706 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:00:14,706 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:00:14,706 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120014.log]\n', '2014-08-18 12:00:14,709 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:00:15,150 DEBUG - Will invoke JobStart for JobID [CREAM979519612]\n', 'https://cert-08.pd.infn.it:8443/CREAM979519612\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM979519612 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM979519612 2014-08-18 12:00:15.345561 Submit https://cert-08.pd.infn.it:8443/CREAM979519612 Left: 976 (at submission time:976) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM979519612 2014-08-18 12:01:14.489228 Exit https://cert-08.pd.infn.it:8443/CREAM393885965 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/crea JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:54,756 DEBUG - Will invoke JobStart for JobID [CREAM426334707]\n', 'https://cert-08.pd.infn.it:8443/CREAM426334707\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM426334707 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM426334707 2014-08-18 11:57:55.777376 Submit https://cert-08.pd.infn.it:8443/CREAM426334707 Left: 989 (at submission time:989) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM426334707 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:55,789 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:55,809 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:55,809 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:55,809 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115755.log]\n', '2014-08-18 11:57:55,813 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:56,631 DEBUG - Will invoke JobStart for JobID [CREAM281738302]\n', 'https://cert-08.pd.infn.it:8443/CREAM281738302\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM281738302 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM281738302 2014-08-18 11:57:57.413749 Submit https://cert-08.pd.infn.it:8443/CREAM281738302 Left: 984 (at submission time:984) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM281738302 2014-08-18 11:59:14.160119 Exit https://cert-08.pd.infn.it:8443/CREAM210740270 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:59:14,516 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:59:14,541 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:59:14,541 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:59:14,541 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115914.log]\n', '2014-08-18 11:59:14,552 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:59:15,201 DEBUG - Will invoke JobStart for JobID [CREAM585391990]\n', 'https://cert-08.pd.infn.it:8443/CREAM585391990\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM585391990 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM585391990 2014-08-18 11:59:15.344723 Submit https://cert-08.pd.infn.it:8443/CREAM585391990 Left: 979 (at submission time:979) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM585391990 2014-08-18 12:01:15.183934 Exit https://cert-08.pd.infn.it:8443/CREAM173698016 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/crea JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:55,771 DEBUG - Will invoke JobStart for JobID [CREAM037939889]\n', 'https://cert-08.pd.infn.it:8443/CREAM037939889\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM037939889 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM037939889 2014-08-18 11:57:56.211711 Submit https://cert-08.pd.infn.it:8443/CREAM037939889 Left: 988 (at submission time:988) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM037939889 Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 11:57:56,234 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 11:57:56,258 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 11:57:56,258 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 11:57:56,259 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-115756.log]\n', '2014-08-18 11:57:56,261 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 11:57:57,547 DEBUG - Will invoke JobStart for JobID [CREAM117748518]\n', 'https://cert-08.pd.infn.it:8443/CREAM117748518\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM117748518 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM117748518 2014-08-18 11:57:58.014120 Submit https://cert-08.pd.infn.it:8443/CREAM117748518 Left: 983 (at submission time:983) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM117748518 2014-08-18 12:00:11.405035 Exit https://cert-08.pd.infn.it:8443/CREAM499661068 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:00:11,833 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:00:11,861 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:00:11,861 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:00:11,862 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120011.log]\n', '2014-08-18 12:00:11,867 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:00:12,418 DEBUG - Will invoke JobStart for JobID [CREAM267661052]\n', 'https://cert-08.pd.infn.it:8443/CREAM267661052\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM267661052 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM267661052 2014-08-18 12:00:12.570181 Submit https://cert-08.pd.infn.it:8443/CREAM267661052 Left: 978 (at submission time:978) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM267661052 2014-08-18 12:02:12.669976 Exit https://cert-08.pd.infn.it:8443/CREAM813729575 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/creaed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 1/1000 2014-08-18 11:59:15.347029 Submitted: 21 Running: 20 Cancelled: 0 Done-Ok: 1 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 1/1000 2014-08-18 12:00:11.407439 Submitted: 21 Running: 19 Cancelled: 0 Done-Ok: 2 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 2/1000 2014-08-18 12:00:12.571860 Submitted: 22 Running: 20 Cancelled: 0 Done-Ok: 2 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 2/1000 2014-08-18 12:00:13.633376 Submitted: 22 Running: 19 Cancelled: 0 Done-Ok: 3 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 3/1000 2014-08-18 12:00:14.234352 Submitted: 22 Running: 18 Cancelled: 0 Done-Ok: 4 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 4/1000 2014-08-18 12:00:14.736456 Submitted: 22 Running: 17 Cancelled: 0 Done-Ok: 5 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 5/1000 2014-08-18 12:00:14.739566 Submitted: 23 Running: 18 Cancelled: 0 Done-Ok: 5 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 5/1000 2014-08-18 12:00:15.347730 Submitted: 24 Running: 19 Cancelled: 0 Done-Ok: 5 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 5/1000 2014-08-18 12:00:15.920892 Submitted: 25 Running: 20 Cancelled: 0 Done-Ok: 5 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 5/1000 2014-08-18 12:01:12.116358 Submitted: 25 Running: 19 Cancelled: 0 Done-Ok: 6 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 6/1000 2014-08-18 12:01:13.296793 Submitted: 26 Running: 20 Cancelled: 0 Done-Ok: 6 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 6/1000 2014-08-18 12:01:14.124213 Submitted: 26 Running: 19 Cancelled: 0 Done-Ok: 7 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 7/1000 2014-08-18 12:01:14.490422 Submitted: 26 Running: 18 Cancelled: 0 Done-Ok: 8 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 8/1000 2014-08-18 12:01:15.187208 Submitted: 26 Running: 17 Cancelled: 0 Done-Ok: 9 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 9/1000 2014-08-18 12:01:15.348673 Submitted: 27 Running: 18 Cancelled: 0 Done-Ok: 9 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 9/1000 2014-08-18 12:01:15.643845 Submitted: 28 Running: 19 Cancelled: 0 Done-Ok: 9 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 9/1000 2014-08-18 12:01:16.510819 Submitted: 29 Running: 20 Cancelled: 0 Done-Ok: 9 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 9/1000 2014-08-18 12:02:12.671427 Submitted: 29 Running: 19 Cancelled: 0 Done-Ok: 10 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 10/1000 2014-08-18 12:02:13.770326 Submitted: 30 Running: 20 Cancelled: 0 Done-Ok: 10 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 10/1000 2014-08-18 12:02:14.638693 Submitted: 30 Running: 19 Cancelled: 0 Done-Ok: 11 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 11/1000 2014m-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:01:14,464 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:01:14,488 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:01:14,488 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:01:14,488 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120114.log]\n', '2014-08-18 12:01:14,492 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:01:15,168 DEBUG - Will invoke JobStart for JobID [CREAM414852058]\n', 'https://cert-08.pd.infn.it:8443/CREAM414852058\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM414852058 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM414852058 2014-08-18 12:01:15.345127 Submit https://cert-08.pd.infn.it:8443/CREAM414852058 Left: 973 (at submission time:973) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM414852058 2014-08-18 12:02:16.235823 Exit https://cert-08.pd.infn.it:8443/CREAM634357731 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:02:16,870 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:02:16,893 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:02:16,893 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:02:16,893 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120216.log]\n', '2014-08-18 12:02:16,897 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:02:17,833 DEBUG - Will invoke JobStart for JobID [CREAM010422044]\n', 'https://cert-08.pd.infn.it:8443/CREAM010422044\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM010422044 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM010422044 2014-08-18 12:02:17.988291 Submit https://cert-08.pd.infn.it:8443/CREAM010422044 Left: 967 (at submission time:967) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM010422044 2014-08-18 12:03:15.210635 Exit https://cert-08.pd.infn.it:8443/CREAM527045750 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:03:15,542 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:03:15,564 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:03:15,564 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:03:15,564 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120315.log]\n', '2014-08-18 12:03:15,572 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Argumenm-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:02:13,089 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:02:13,133 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:02:13,133 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:02:13,133 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120213.log]\n', '2014-08-18 12:02:13,141 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:02:13,657 DEBUG - Will invoke JobStart for JobID [CREAM904860316]\n', 'https://cert-08.pd.infn.it:8443/CREAM904860316\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM904860316 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM904860316 2014-08-18 12:02:13.767311 Submit https://cert-08.pd.infn.it:8443/CREAM904860316 Left: 970 (at submission time:970) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM904860316 2014-08-18 12:02:14.779697 Exit https://cert-08.pd.infn.it:8443/CREAM037939889 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:02:15,145 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:02:15,182 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:02:15,182 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:02:15,182 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120215.log]\n', '2014-08-18 12:02:15,185 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:02:16,159 DEBUG - Will invoke JobStart for JobID [CREAM999651233]\n', 'https://cert-08.pd.infn.it:8443/CREAM999651233\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM999651233 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM999651233 2014-08-18 12:02:16.428715 Submit https://cert-08.pd.infn.it:8443/CREAM999651233 Left: 968 (at submission time:968) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM999651233 2014-08-18 12:03:16.636213 Exit https://cert-08.pd.infn.it:8443/CREAM117748518 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:03:17,121 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:03:17,143 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:03:17,143 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:03:17,143 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120317.log]\n', '2014-08-18 12:03:17,146 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Argumenm-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:01:15,067 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:01:15,090 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:01:15,091 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:01:15,091 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120115.log]\n', '2014-08-18 12:01:15,094 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:01:15,475 DEBUG - Will invoke JobStart for JobID [CREAM575577218]\n', 'https://cert-08.pd.infn.it:8443/CREAM575577218\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM575577218 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM575577218 2014-08-18 12:01:15.642962 Submit https://cert-08.pd.infn.it:8443/CREAM575577218 Left: 972 (at submission time:972) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM575577218 2014-08-18 12:03:13.176058 Exit https://cert-08.pd.infn.it:8443/CREAM954026166 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:03:13,517 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:03:13,540 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:03:13,540 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:03:13,540 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120313.log]\n', '2014-08-18 12:03:13,552 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:03:13,985 DEBUG - Will invoke JobStart for JobID [CREAM997424268]\n', 'https://cert-08.pd.infn.it:8443/CREAM997424268\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM997424268 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM997424268 2014-08-18 12:03:14.155841 Submit https://cert-08.pd.infn.it:8443/CREAM997424268 Left: 966 (at submission time:966) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM997424268 2014-08-18 12:04:13.455710 Exit https://cert-08.pd.infn.it:8443/CREAM222102099 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:04:13,797 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:04:13,820 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:04:13,820 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:04:13,820 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120413.log]\n', '2014-08-18 12:04:13,831 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Argumenm-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:01:12,509 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:01:12,534 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:01:12,534 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:01:12,534 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120112.log]\n', '2014-08-18 12:01:12,544 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:01:13,009 DEBUG - Will invoke JobStart for JobID [CREAM317070777]\n', 'https://cert-08.pd.infn.it:8443/CREAM317070777\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM317070777 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM317070777 2014-08-18 12:01:13.294900 Submit https://cert-08.pd.infn.it:8443/CREAM317070777 Left: 974 (at submission time:974) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM317070777 2014-08-18 12:03:15.131105 Exit https://cert-08.pd.infn.it:8443/CREAM604400605 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:03:15,439 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:03:15,458 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:03:15,458 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:03:15,458 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120315.log]\n', '2014-08-18 12:03:15,464 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:03:16,258 DEBUG - Will invoke JobStart for JobID [CREAM192563275]\n', 'https://cert-08.pd.infn.it:8443/CREAM192563275\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM192563275 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM192563275 2014-08-18 12:03:16.408834 Submit https://cert-08.pd.infn.it:8443/CREAM192563275 Left: 965 (at submission time:965) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM192563275 2014-08-18 12:04:14.785194 Exit https://cert-08.pd.infn.it:8443/CREAM610488107 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:04:15,316 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:04:15,347 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:04:15,347 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:04:15,347 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120415.log]\n', '2014-08-18 12:04:15,352 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Argumenm-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:01:15,629 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:01:15,664 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:01:15,665 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:01:15,665 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120115.log]\n', '2014-08-18 12:01:15,672 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:01:16,350 DEBUG - Will invoke JobStart for JobID [CREAM655373640]\n', 'https://cert-08.pd.infn.it:8443/CREAM655373640\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM655373640 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM655373640 2014-08-18 12:01:16.510232 Submit https://cert-08.pd.infn.it:8443/CREAM655373640 Left: 971 (at submission time:971) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM655373640 2014-08-18 12:02:14.636491 Exit https://cert-08.pd.infn.it:8443/CREAM426334707 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:02:15,041 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:02:15,063 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:02:15,063 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:02:15,063 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120215.log]\n', '2014-08-18 12:02:15,072 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:02:15,807 DEBUG - Will invoke JobStart for JobID [CREAM505981591]\n', 'https://cert-08.pd.infn.it:8443/CREAM505981591\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM505981591 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM505981591 2014-08-18 12:02:16.156320 Submit https://cert-08.pd.infn.it:8443/CREAM505981591 Left: 969 (at submission time:969) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM505981591 2014-08-18 12:04:15.924852 Exit https://cert-08.pd.infn.it:8443/CREAM281738302 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:04:16,342 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:04:16,365 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:04:16,366 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:04:16,366 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120416.log]\n', '2014-08-18 12:04:16,375 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Argumen-08-18 12:02:14.782411 Submitted: 30 Running: 18 Cancelled: 0 Done-Ok: 12 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 12/1000 2014-08-18 12:02:16.161741 Submitted: 31 Running: 19 Cancelled: 0 Done-Ok: 12 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 12/1000 2014-08-18 12:02:16.237813 Submitted: 31 Running: 18 Cancelled: 0 Done-Ok: 13 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 13/1000 2014-08-18 12:02:16.430055 Submitted: 32 Running: 19 Cancelled: 0 Done-Ok: 13 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 13/1000 2014-08-18 12:02:17.989849 Submitted: 33 Running: 20 Cancelled: 0 Done-Ok: 13 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 13/1000 2014-08-18 12:03:13.178594 Submitted: 33 Running: 19 Cancelled: 0 Done-Ok: 14 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 14/1000 2014-08-18 12:03:14.157506 Submitted: 34 Running: 20 Cancelled: 0 Done-Ok: 14 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 14/1000 2014-08-18 12:03:15.134227 Submitted: 34 Running: 19 Cancelled: 0 Done-Ok: 15 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 15/1000 2014-08-18 12:03:15.211872 Submitted: 34 Running: 18 Cancelled: 0 Done-Ok: 16 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 16/1000 2014-08-18 12:03:16.409863 Submitted: 35 Running: 19 Cancelled: 0 Done-Ok: 16 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 16/1000 2014-08-18 12:03:16.488130 Submitted: 36 Running: 20 Cancelled: 0 Done-Ok: 16 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 16/1000 2014-08-18 12:03:16.637706 Submitted: 36 Running: 19 Cancelled: 0 Done-Ok: 17 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 17/1000 2014-08-18 12:03:17.910075 Submitted: 37 Running: 20 Cancelled: 0 Done-Ok: 17 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 17/1000 2014-08-18 12:04:13.456934 Submitted: 37 Running: 19 Cancelled: 0 Done-Ok: 18 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 18/1000 2014-08-18 12:04:14.519213 Submitted: 38 Running: 20 Cancelled: 0 Done-Ok: 18 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 18/1000 2014-08-18 12:04:14.788287 Submitted: 38 Running: 19 Cancelled: 0 Done-Ok: 19 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 19/1000 2014-08-18 12:04:15.926078 Submitted: 38 Running: 18 Cancelled: 0 Done-Ok: 20 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 20/1000 2014-08-18 12:04:16.074188 Submitted: 39 Running: 19 Cancelled: 0 Done-Ok: 20 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 20/1000 2014-08-18 12:04:17.155663 Submitted: 40 Running: 20 Cancelled: 0 Done-Ok: 20 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 20/1000 2014-08-18 12:04:17.321221 Submitted: 40 Running: 19 Cancelled: 0 Done-Ok: 21 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 21/1000 2014-08-18 12:04:18.594032 Submitted: 41 Running: 20 Cancellts = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:04:16,958 DEBUG - Will invoke JobStart for JobID [CREAM076319306]\n', 'https://cert-08.pd.infn.it:8443/CREAM076319306\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM076319306 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM076319306 2014-08-18 12:04:17.152643 Submit https://cert-08.pd.infn.it:8443/CREAM076319306 Left: 960 (at submission time:960) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM076319306 2014-08-18 12:04:17.318214 Exit https://cert-08.pd.infn.it:8443/CREAM585391990 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:04:17,801 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:04:17,824 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:04:17,824 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:04:17,825 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120417.log]\n', '2014-08-18 12:04:17,833 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:04:18,416 DEBUG - Will invoke JobStart for JobID [CREAM840861541]\n', 'https://cert-08.pd.infn.it:8443/CREAM840861541\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM840861541 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM840861541 2014-08-18 12:04:18.592860 Submit https://cert-08.pd.infn.it:8443/CREAM840861541 Left: 959 (at submission time:959) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM840861541 2014-08-18 12:06:17.231848 Exit https://cert-08.pd.infn.it:8443/CREAM655373640 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:06:17,602 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:06:17,625 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:06:17,625 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:06:17,625 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120617.log]\n', '2014-08-18 12:06:17,629 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:06:18,244 DEBUG - Will invoke JobStart for JobID [CREAM321377980]\n', 'https://cert-08.pd.infn.it:8443/CREAM321377980\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM321377980 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM321377980 2014-08-18 12:06:18.430638 Submit https://cert-08.pd.infn.it:8443/CREAM321377980 Left: 952 (at submission time:952) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM321377980 2014-08-18 12:07:16.878674 Exit https://cert-08.pd.infn.it:8443/CREAM505ts = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:03:17,744 DEBUG - Will invoke JobStart for JobID [CREAM346505351]\n', 'https://cert-08.pd.infn.it:8443/CREAM346505351\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM346505351 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM346505351 2014-08-18 12:03:17.907158 Submit https://cert-08.pd.infn.it:8443/CREAM346505351 Left: 963 (at submission time:963) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM346505351 2014-08-18 12:05:13.639167 Exit https://cert-08.pd.infn.it:8443/CREAM267661052 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:05:14,003 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:05:14,037 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:05:14,037 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:05:14,037 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120514.log]\n', '2014-08-18 12:05:14,048 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:05:14,566 DEBUG - Will invoke JobStart for JobID [CREAM733636978]\n', 'https://cert-08.pd.infn.it:8443/CREAM733636978\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM733636978 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM733636978 2014-08-18 12:05:14.701561 Submit https://cert-08.pd.infn.it:8443/CREAM733636978 Left: 958 (at submission time:958) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM733636978 2014-08-18 12:07:14.503755 Exit https://cert-08.pd.infn.it:8443/CREAM904860316 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:07:14,942 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:07:14,967 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:07:14,967 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:07:14,967 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120714.log]\n', '2014-08-18 12:07:14,974 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:07:15,565 DEBUG - Will invoke JobStart for JobID [CREAM717917912]\n', 'https://cert-08.pd.infn.it:8443/CREAM717917912\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM717917912 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM717917912 2014-08-18 12:07:15.811302 Submit https://cert-08.pd.infn.it:8443/CREAM717917912 Left: 950 (at submission time:950) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM717917912 2014-08-18 12:07:17.076052 Exit https://cert-08.pd.infn.it:8443/CREAM999ed: 0 Done-Ok: 21 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 21/1000 2014-08-18 12:05:13.642913 Submitted: 41 Running: 19 Cancelled: 0 Done-Ok: 22 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 22/1000 2014-08-18 12:05:14.703002 Submitted: 42 Running: 20 Cancelled: 0 Done-Ok: 22 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 22/1000 2014-08-18 12:05:16.177743 Submitted: 42 Running: 19 Cancelled: 0 Done-Ok: 23 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 23/1000 2014-08-18 12:05:16.207845 Submitted: 42 Running: 18 Cancelled: 0 Done-Ok: 24 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 24/1000 2014-08-18 12:05:17.528611 Submitted: 43 Running: 19 Cancelled: 0 Done-Ok: 24 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 24/1000 2014-08-18 12:05:17.648416 Submitted: 44 Running: 20 Cancelled: 0 Done-Ok: 24 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 24/1000 2014-08-18 12:05:17.761009 Submitted: 44 Running: 19 Cancelled: 0 Done-Ok: 25 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 25/1000 2014-08-18 12:05:19.143521 Submitted: 45 Running: 20 Cancelled: 0 Done-Ok: 25 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 25/1000 2014-08-18 12:06:14.346731 Submitted: 45 Running: 19 Cancelled: 0 Done-Ok: 26 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 26/1000 2014-08-18 12:06:15.501817 Submitted: 46 Running: 20 Cancelled: 0 Done-Ok: 26 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 26/1000 2014-08-18 12:06:16.163140 Submitted: 46 Running: 19 Cancelled: 0 Done-Ok: 27 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 27/1000 2014-08-18 12:06:17.234385 Submitted: 46 Running: 18 Cancelled: 0 Done-Ok: 28 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 28/1000 2014-08-18 12:06:17.450421 Submitted: 47 Running: 19 Cancelled: 0 Done-Ok: 28 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 28/1000 2014-08-18 12:06:17.770447 Submitted: 47 Running: 18 Cancelled: 0 Done-Ok: 29 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 29/1000 2014-08-18 12:06:18.432749 Submitted: 48 Running: 19 Cancelled: 0 Done-Ok: 29 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 29/1000 2014-08-18 12:06:19.502046 Submitted: 49 Running: 20 Cancelled: 0 Done-Ok: 29 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 29/1000 2014-08-18 12:07:14.506863 Submitted: 49 Running: 19 Cancelled: 0 Done-Ok: 30 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 30/1000 2014-08-18 12:07:15.814345 Submitted: 50 Running: 20 Cancelled: 0 Done-Ok: 30 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 30/1000 2014-08-18 12:07:16.879929 Submitted: 50 Running: 19 Cancelled: 0 Done-Ok: 31 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 31/1000 2014-08-18 12:07:17.078722 Submitted: 50 Running: 18 Cancelled: 0 Done-Ok: 32 Failed: 0 Aborted: 0 Status Failets = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:03:16,324 DEBUG - Will invoke JobStart for JobID [CREAM742041238]\n', 'https://cert-08.pd.infn.it:8443/CREAM742041238\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM742041238 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM742041238 2014-08-18 12:03:16.485452 Submit https://cert-08.pd.infn.it:8443/CREAM742041238 Left: 964 (at submission time:964) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM742041238 2014-08-18 12:05:17.759034 Exit https://cert-08.pd.infn.it:8443/CREAM706231781 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:05:18,260 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:05:18,300 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:05:18,301 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:05:18,301 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120518.log]\n', '2014-08-18 12:05:18,307 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:05:18,947 DEBUG - Will invoke JobStart for JobID [CREAM914600623]\n', 'https://cert-08.pd.infn.it:8443/CREAM914600623\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM914600623 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM914600623 2014-08-18 12:05:19.140397 Submit https://cert-08.pd.infn.it:8443/CREAM914600623 Left: 955 (at submission time:955) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM914600623 2014-08-18 12:06:16.160347 Exit https://cert-08.pd.infn.it:8443/CREAM414852058 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:06:16,671 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:06:16,689 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:06:16,689 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:06:16,690 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120616.log]\n', '2014-08-18 12:06:16,693 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:06:17,323 DEBUG - Will invoke JobStart for JobID [CREAM273403604]\n', 'https://cert-08.pd.infn.it:8443/CREAM273403604\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM273403604 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM273403604 2014-08-18 12:06:17.446973 Submit https://cert-08.pd.infn.it:8443/CREAM273403604 Left: 953 (at submission time:953) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM273403604 2014-08-18 12:07:17.738636 Exit https://cert-08.pd.infn.it:8443/CREAM010ts = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:04:14,316 DEBUG - Will invoke JobStart for JobID [CREAM041006309]\n', 'https://cert-08.pd.infn.it:8443/CREAM041006309\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM041006309 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM041006309 2014-08-18 12:04:14.518314 Submit https://cert-08.pd.infn.it:8443/CREAM041006309 Left: 962 (at submission time:962) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM041006309 2014-08-18 12:05:16.204677 Exit https://cert-08.pd.infn.it:8443/CREAM979519612 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:05:16,611 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:05:16,637 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:05:16,637 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:05:16,637 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120516.log]\n', '2014-08-18 12:05:16,648 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:05:17,492 DEBUG - Will invoke JobStart for JobID [CREAM682114459]\n', 'https://cert-08.pd.infn.it:8443/CREAM682114459\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM682114459 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM682114459 2014-08-18 12:05:17.643894 Submit https://cert-08.pd.infn.it:8443/CREAM682114459 Left: 956 (at submission time:956) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM682114459 2014-08-18 12:06:17.768186 Exit https://cert-08.pd.infn.it:8443/CREAM575577218 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:06:18,341 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:06:18,369 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:06:18,369 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:06:18,370 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120618.log]\n', '2014-08-18 12:06:18,383 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:06:19,142 DEBUG - Will invoke JobStart for JobID [CREAM932296728]\n', 'https://cert-08.pd.infn.it:8443/CREAM932296728\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM932296728 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM932296728 2014-08-18 12:06:19.500909 Submit https://cert-08.pd.infn.it:8443/CREAM932296728 Left: 951 (at submission time:951) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM932296728 2014-08-18 12:08:15.581970 Exit https://cert-08.pd.infn.it:8443/CREAM997ts = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:04:15,884 DEBUG - Will invoke JobStart for JobID [CREAM320186924]\n', 'https://cert-08.pd.infn.it:8443/CREAM320186924\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM320186924 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM320186924 2014-08-18 12:04:16.072117 Submit https://cert-08.pd.infn.it:8443/CREAM320186924 Left: 961 (at submission time:961) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM320186924 2014-08-18 12:05:16.174683 Exit https://cert-08.pd.infn.it:8443/CREAM958386571 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:05:16,555 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:05:16,599 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:05:16,599 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:05:16,599 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120516.log]\n', '2014-08-18 12:05:16,607 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:05:17,295 DEBUG - Will invoke JobStart for JobID [CREAM868757563]\n', 'https://cert-08.pd.infn.it:8443/CREAM868757563\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM868757563 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM868757563 2014-08-18 12:05:17.526865 Submit https://cert-08.pd.infn.it:8443/CREAM868757563 Left: 957 (at submission time:957) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM868757563 2014-08-18 12:06:14.345235 Exit https://cert-08.pd.infn.it:8443/CREAM317070777 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:06:14,674 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:06:14,710 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:06:14,710 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:06:14,710 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120614.log]\n', '2014-08-18 12:06:14,713 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:06:15,323 DEBUG - Will invoke JobStart for JobID [CREAM211596173]\n', 'https://cert-08.pd.infn.it:8443/CREAM211596173\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM211596173 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM211596173 2014-08-18 12:06:15.500444 Submit https://cert-08.pd.infn.it:8443/CREAM211596173 Left: 954 (at submission time:954) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM211596173 2014-08-18 12:08:17.411991 Exit https://cert-08.pd.infn.it:8443/CREAM192981591 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:07:17,517 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:07:17,554 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:07:17,554 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:07:17,554 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120717.log]\n', '2014-08-18 12:07:17,557 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:07:18,424 DEBUG - Will invoke JobStart for JobID [CREAM957145201]\n', 'https://cert-08.pd.infn.it:8443/CREAM957145201\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM957145201 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM957145201 2014-08-18 12:07:18.799908 Submit https://cert-08.pd.infn.it:8443/CREAM957145201 Left: 949 (at submission time:949) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM957145201 2014-08-18 12:09:18.015216 Exit https://cert-08.pd.infn.it:8443/CREAM076319306 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:09:18,502 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:09:18,540 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:09:18,540 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:09:18,540 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120918.log]\n', '2014-08-18 12:09:18,543 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:09:19,297 DEBUG - Will invoke JobStart for JobID [CREAM390188217]\n', 'https://cert-08.pd.infn.it:8443/CREAM390188217\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM390188217 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM390188217 2014-08-18 12:09:19.667449 Submit https://cert-08.pd.infn.it:8443/CREAM390188217 Left: 940 (at submission time:940) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM390188217 2014-08-18 12:09:19.887842 Exit https://cert-08.pd.infn.it:8443/CREAM840861541 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:09:20,571 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:09:20,592 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:09:20,592 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:09:20,592 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120920.log]\n', '2014-08-18 12:09:20,595 DEBUG - Registering to [https://cert-08.pd.id: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 32/1000 2014-08-18 12:07:17.741178 Submitted: 50 Running: 17 Cancelled: 0 Done-Ok: 33 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 33/1000 2014-08-18 12:07:18.795395 Submitted: 51 Running: 18 Cancelled: 0 Done-Ok: 33 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 33/1000 2014-08-18 12:07:18.801942 Submitted: 52 Running: 19 Cancelled: 0 Done-Ok: 33 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 33/1000 2014-08-18 12:07:19.226411 Submitted: 53 Running: 20 Cancelled: 0 Done-Ok: 33 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 33/1000 2014-08-18 12:08:15.583221 Submitted: 53 Running: 19 Cancelled: 0 Done-Ok: 34 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 34/1000 2014-08-18 12:08:16.801585 Submitted: 54 Running: 20 Cancelled: 0 Done-Ok: 34 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 34/1000 2014-08-18 12:08:17.377853 Submitted: 54 Running: 19 Cancelled: 0 Done-Ok: 35 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 35/1000 2014-08-18 12:08:17.414333 Submitted: 54 Running: 18 Cancelled: 0 Done-Ok: 36 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 36/1000 2014-08-18 12:08:19.120402 Submitted: 55 Running: 19 Cancelled: 0 Done-Ok: 36 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 36/1000 2014-08-18 12:08:19.261647 Submitted: 56 Running: 20 Cancelled: 0 Done-Ok: 36 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 36/1000 2014-08-18 12:08:19.471137 Submitted: 56 Running: 19 Cancelled: 0 Done-Ok: 37 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 37/1000 2014-08-18 12:08:21.236196 Submitted: 57 Running: 20 Cancelled: 0 Done-Ok: 37 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 37/1000 2014-08-18 12:09:15.700887 Submitted: 57 Running: 19 Cancelled: 0 Done-Ok: 38 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 38/1000 2014-08-18 12:09:16.874940 Submitted: 58 Running: 20 Cancelled: 0 Done-Ok: 38 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 38/1000 2014-08-18 12:09:17.729616 Submitted: 58 Running: 19 Cancelled: 0 Done-Ok: 39 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 39/1000 2014-08-18 12:09:18.017308 Submitted: 58 Running: 18 Cancelled: 0 Done-Ok: 40 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 40/1000 2014-08-18 12:09:19.168579 Submitted: 59 Running: 19 Cancelled: 0 Done-Ok: 40 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 40/1000 2014-08-18 12:09:19.669327 Submitted: 60 Running: 20 Cancelled: 0 Done-Ok: 40 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 40/1000 2014-08-18 12:09:19.889959 Submitted: 60 Running: 19 Cancelled: 0 Done-Ok: 41 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 41/1000 2014-08-18 12:09:21.446646 Submitted: 61 Running: 20 Cancelled: 0 Done-Ok: 41 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Sta651233 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:07:17,711 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:07:17,733 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:07:17,733 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:07:17,733 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120717.log]\n', '2014-08-18 12:07:17,742 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:07:18,493 DEBUG - Will invoke JobStart for JobID [CREAM673087649]\n', 'https://cert-08.pd.infn.it:8443/CREAM673087649\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM673087649 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM673087649 2014-08-18 12:07:18.792916 Submit https://cert-08.pd.infn.it:8443/CREAM673087649 Left: 948 (at submission time:948) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM673087649 2014-08-18 12:08:19.468359 Exit https://cert-08.pd.infn.it:8443/CREAM346505351 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:08:19,961 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:08:19,990 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:08:19,990 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:08:19,990 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120819.log]\n', '2014-08-18 12:08:19,995 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:08:20,715 DEBUG - Will invoke JobStart for JobID [CREAM555363622]\n', 'https://cert-08.pd.infn.it:8443/CREAM555363622\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM555363622 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM555363622 2014-08-18 12:08:21.233052 Submit https://cert-08.pd.infn.it:8443/CREAM555363622 Left: 943 (at submission time:943) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM555363622 2014-08-18 12:10:15.990802 Exit https://cert-08.pd.infn.it:8443/CREAM733636978 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:10:16,413 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:10:16,438 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:10:16,438 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:10:16,438 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121016.log]\n', '2014-08-18 12:10:16,447 DEBUG - Registering to [https://cert-08.pd.i563275 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:08:17,825 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:08:17,855 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:08:17,856 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:08:17,856 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120817.log]\n', '2014-08-18 12:08:17,867 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:08:18,723 DEBUG - Will invoke JobStart for JobID [CREAM160277062]\n', 'https://cert-08.pd.infn.it:8443/CREAM160277062\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM160277062 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM160277062 2014-08-18 12:08:19.117616 Submit https://cert-08.pd.infn.it:8443/CREAM160277062 Left: 945 (at submission time:945) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM160277062 2014-08-18 12:09:17.728410 Exit https://cert-08.pd.infn.it:8443/CREAM320186924 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:09:18,173 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:09:18,201 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:09:18,201 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:09:18,201 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120918.log]\n', '2014-08-18 12:09:18,210 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:09:18,881 DEBUG - Will invoke JobStart for JobID [CREAM779576777]\n', 'https://cert-08.pd.infn.it:8443/CREAM779576777\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM779576777 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM779576777 2014-08-18 12:09:19.163824 Submit https://cert-08.pd.infn.it:8443/CREAM779576777 Left: 941 (at submission time:941) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM779576777 2014-08-18 12:10:17.937522 Exit https://cert-08.pd.infn.it:8443/CREAM868757563 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:10:18,481 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:10:18,504 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:10:18,505 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:10:18,505 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121018.log]\n', '2014-08-18 12:10:18,512 DEBUG - Registering to [https://cert-08.pd.i424268 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:08:15,958 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:08:15,987 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:08:15,987 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:08:15,987 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120815.log]\n', '2014-08-18 12:08:15,990 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:08:16,622 DEBUG - Will invoke JobStart for JobID [CREAM683684647]\n', 'https://cert-08.pd.infn.it:8443/CREAM683684647\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM683684647 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM683684647 2014-08-18 12:08:16.798731 Submit https://cert-08.pd.infn.it:8443/CREAM683684647 Left: 946 (at submission time:946) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM683684647 2014-08-18 12:09:15.699682 Exit https://cert-08.pd.infn.it:8443/CREAM041006309 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:09:16,087 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:09:16,114 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:09:16,114 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:09:16,114 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120916.log]\n', '2014-08-18 12:09:16,119 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:09:16,710 DEBUG - Will invoke JobStart for JobID [CREAM564632199]\n', 'https://cert-08.pd.infn.it:8443/CREAM564632199\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM564632199 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM564632199 2014-08-18 12:09:16.873357 Submit https://cert-08.pd.infn.it:8443/CREAM564632199 Left: 942 (at submission time:942) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM564632199 2014-08-18 12:10:18.741888 Exit https://cert-08.pd.infn.it:8443/CREAM682114459 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:10:19,480 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:10:19,504 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:10:19,504 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:10:19,504 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121019.log]\n', '2014-08-18 12:10:19,509 DEBUG - Registering to [https://cert-08.pd.i422044 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:07:18,408 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:07:18,436 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:07:18,437 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:07:18,437 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120718.log]\n', '2014-08-18 12:07:18,441 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:07:19,093 DEBUG - Will invoke JobStart for JobID [CREAM458790095]\n', 'https://cert-08.pd.infn.it:8443/CREAM458790095\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM458790095 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM458790095 2014-08-18 12:07:19.224550 Submit https://cert-08.pd.infn.it:8443/CREAM458790095 Left: 947 (at submission time:947) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM458790095 2014-08-18 12:08:17.374759 Exit https://cert-08.pd.infn.it:8443/CREAM742041238 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:08:17,855 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:08:17,884 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:08:17,884 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:08:17,884 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-120817.log]\n', '2014-08-18 12:08:17,895 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:08:19,103 DEBUG - Will invoke JobStart for JobID [CREAM122731080]\n', 'https://cert-08.pd.infn.it:8443/CREAM122731080\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM122731080 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM122731080 2014-08-18 12:08:19.259009 Submit https://cert-08.pd.infn.it:8443/CREAM122731080 Left: 944 (at submission time:944) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM122731080 2014-08-18 12:10:19.891440 Exit https://cert-08.pd.infn.it:8443/CREAM914600623 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:10:20,360 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:10:20,388 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:10:20,388 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:10:20,388 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121020.log]\n', '2014-08-18 12:10:20,391 DEBUG - Registering to [https://cert-08.pd.itus: 0 Collected 41/1000 2014-08-18 12:10:15.994260 Submitted: 61 Running: 19 Cancelled: 0 Done-Ok: 42 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 42/1000 2014-08-18 12:10:17.238900 Submitted: 62 Running: 20 Cancelled: 0 Done-Ok: 42 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 42/1000 2014-08-18 12:10:17.939386 Submitted: 62 Running: 19 Cancelled: 0 Done-Ok: 43 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 43/1000 2014-08-18 12:10:18.743787 Submitted: 62 Running: 18 Cancelled: 0 Done-Ok: 44 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 44/1000 2014-08-18 12:10:19.623337 Submitted: 63 Running: 19 Cancelled: 0 Done-Ok: 44 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 44/1000 2014-08-18 12:10:19.892864 Submitted: 63 Running: 18 Cancelled: 0 Done-Ok: 45 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 45/1000 2014-08-18 12:10:20.474663 Submitted: 64 Running: 19 Cancelled: 0 Done-Ok: 45 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 45/1000 2014-08-18 12:10:21.346133 Submitted: 65 Running: 20 Cancelled: 0 Done-Ok: 45 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 45/1000 2014-08-18 12:11:16.668312 Submitted: 65 Running: 19 Cancelled: 0 Done-Ok: 46 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 46/1000 2014-08-18 12:11:18.104997 Submitted: 66 Running: 20 Cancelled: 0 Done-Ok: 46 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 46/1000 2014-08-18 12:11:19.054452 Submitted: 66 Running: 19 Cancelled: 0 Done-Ok: 47 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 47/1000 2014-08-18 12:11:19.159091 Submitted: 66 Running: 18 Cancelled: 0 Done-Ok: 48 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 48/1000 2014-08-18 12:11:20.558296 Submitted: 66 Running: 17 Cancelled: 0 Done-Ok: 49 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 49/1000 2014-08-18 12:11:20.851696 Submitted: 67 Running: 18 Cancelled: 0 Done-Ok: 49 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 49/1000 2014-08-18 12:11:21.050551 Submitted: 68 Running: 19 Cancelled: 0 Done-Ok: 49 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 49/1000 2014-08-18 12:11:21.762787 Submitted: 69 Running: 20 Cancelled: 0 Done-Ok: 49 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 49/1000 2014-08-18 12:12:16.758878 Submitted: 69 Running: 19 Cancelled: 0 Done-Ok: 50 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 50/1000 2014-08-18 12:12:17.995613 Submitted: 70 Running: 20 Cancelled: 0 Done-Ok: 50 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 50/1000 2014-08-18 12:12:19.628977 Submitted: 70 Running: 19 Cancelled: 0 Done-Ok: 51 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 51/1000 2014-08-18 12:12:20.575838 Submitted: 70 Running: 18 Cancelled: 0 Done-Ok: 52 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 52/1000 2014-08-18 12:12:20.598507nfn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:10:17,110 DEBUG - Will invoke JobStart for JobID [CREAM390059086]\n', 'https://cert-08.pd.infn.it:8443/CREAM390059086\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM390059086 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM390059086 2014-08-18 12:10:17.235815 Submit https://cert-08.pd.infn.it:8443/CREAM390059086 Left: 938 (at submission time:938) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM390059086 2014-08-18 12:12:16.757836 Exit https://cert-08.pd.infn.it:8443/CREAM717917912 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:12:17,068 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:12:17,088 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:12:17,088 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:12:17,089 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121217.log]\n', '2014-08-18 12:12:17,098 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:12:17,762 DEBUG - Will invoke JobStart for JobID [CREAM244238514]\n', 'https://cert-08.pd.infn.it:8443/CREAM244238514\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM244238514 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM244238514 2014-08-18 12:12:17.992873 Submit https://cert-08.pd.infn.it:8443/CREAM244238514 Left: 930 (at submission time:930) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM244238514 2014-08-18 12:12:19.627428 Exit https://cert-08.pd.infn.it:8443/CREAM673087649 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:12:20,062 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:12:20,099 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:12:20,099 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:12:20,099 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121220.log]\n', '2014-08-18 12:12:20,109 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:12:20,939 DEBUG - Will invoke JobStart for JobID [CREAM551395179]\n', 'https://cert-08.pd.infn.it:8443/CREAM551395179\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM551395179 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM551395179 2014-08-18 12:12:21.166601 Submit https://cert-08.pd.infn.it:8443/CREAM551395179 Left: 929 (at submission time:929) sunfn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:09:21,349 DEBUG - Will invoke JobStart for JobID [CREAM257255347]\n', 'https://cert-08.pd.infn.it:8443/CREAM257255347\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM257255347 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM257255347 2014-08-18 12:09:21.443922 Submit https://cert-08.pd.infn.it:8443/CREAM257255347 Left: 939 (at submission time:939) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM257255347 2014-08-18 12:11:19.156308 Exit https://cert-08.pd.infn.it:8443/CREAM321377980 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:11:19,705 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:11:19,724 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:11:19,724 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:11:19,724 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121119.log]\n', '2014-08-18 12:11:19,727 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:11:20,810 DEBUG - Will invoke JobStart for JobID [CREAM833422341]\n', 'https://cert-08.pd.infn.it:8443/CREAM833422341\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM833422341 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM833422341 2014-08-18 12:11:21.046679 Submit https://cert-08.pd.infn.it:8443/CREAM833422341 Left: 932 (at submission time:932) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM833422341 2014-08-18 12:12:20.574413 Exit https://cert-08.pd.infn.it:8443/CREAM957145201 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:12:21,259 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:12:21,283 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:12:21,283 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:12:21,283 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121221.log]\n', '2014-08-18 12:12:21,286 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:12:22,420 DEBUG - Will invoke JobStart for JobID [CREAM811749200]\n', 'https://cert-08.pd.infn.it:8443/CREAM811749200\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM811749200 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM811749200 2014-08-18 12:12:22.720375 Submit https://cert-08.pd.infn.it:8443/CREAM811749200 Left: 928 (at submission time:928) sunfn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:10:21,100 DEBUG - Will invoke JobStart for JobID [CREAM055494006]\n', 'https://cert-08.pd.infn.it:8443/CREAM055494006\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM055494006 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM055494006 2014-08-18 12:10:21.344826 Submit https://cert-08.pd.infn.it:8443/CREAM055494006 Left: 935 (at submission time:935) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM055494006 2014-08-18 12:11:19.053175 Exit https://cert-08.pd.infn.it:8443/CREAM273403604 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:11:19,595 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:11:19,614 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:11:19,614 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:11:19,614 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121119.log]\n', '2014-08-18 12:11:19,618 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:11:20,668 DEBUG - Will invoke JobStart for JobID [CREAM686224001]\n', 'https://cert-08.pd.infn.it:8443/CREAM686224001\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM686224001 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM686224001 2014-08-18 12:11:20.849978 Submit https://cert-08.pd.infn.it:8443/CREAM686224001 Left: 933 (at submission time:933) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM686224001 2014-08-18 12:12:20.595425 Exit https://cert-08.pd.infn.it:8443/CREAM458790095 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:12:21,339 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:12:21,367 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:12:21,367 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:12:21,367 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121221.log]\n', '2014-08-18 12:12:21,371 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:12:22,537 DEBUG - Will invoke JobStart for JobID [CREAM479691458]\n', 'https://cert-08.pd.infn.it:8443/CREAM479691458\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM479691458 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM479691458 2014-08-18 12:12:22.877222 Submit https://cert-08.pd.infn.it:8443/CREAM479691458 Left: 927 (at submission time:927) sunfn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:10:20,309 DEBUG - Will invoke JobStart for JobID [CREAM661870981]\n', 'https://cert-08.pd.infn.it:8443/CREAM661870981\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM661870981 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM661870981 2014-08-18 12:10:20.471654 Submit https://cert-08.pd.infn.it:8443/CREAM661870981 Left: 936 (at submission time:936) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM661870981 2014-08-18 12:11:20.554598 Exit https://cert-08.pd.infn.it:8443/CREAM932296728 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:11:20,941 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:11:20,964 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:11:20,964 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:11:20,964 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121120.log]\n', '2014-08-18 12:11:20,986 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:11:21,568 DEBUG - Will invoke JobStart for JobID [CREAM979928878]\n', 'https://cert-08.pd.infn.it:8443/CREAM979928878\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM979928878 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM979928878 2014-08-18 12:11:21.760659 Submit https://cert-08.pd.infn.it:8443/CREAM979928878 Left: 931 (at submission time:931) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM979928878 2014-08-18 12:13:17.267648 Exit https://cert-08.pd.infn.it:8443/CREAM683684647 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:13:17,598 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:13:17,620 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:13:17,620 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:13:17,620 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121317.log]\n', '2014-08-18 12:13:17,629 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:13:18,362 DEBUG - Will invoke JobStart for JobID [CREAM829761802]\n', 'https://cert-08.pd.infn.it:8443/CREAM829761802\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM829761802 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM829761802 2014-08-18 12:13:18.656946 Submit https://cert-08.pd.infn.it:8443/CREAM829761802 Left: 926 (at submission time:926) sunfn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:10:19,435 DEBUG - Will invoke JobStart for JobID [CREAM950376443]\n', 'https://cert-08.pd.infn.it:8443/CREAM950376443\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM950376443 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM950376443 2014-08-18 12:10:19.621754 Submit https://cert-08.pd.infn.it:8443/CREAM950376443 Left: 937 (at submission time:937) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM950376443 2014-08-18 12:11:16.666013 Exit https://cert-08.pd.infn.it:8443/CREAM211596173 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:11:17,014 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:11:17,044 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:11:17,045 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:11:17,045 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121117.log]\n', '2014-08-18 12:11:17,048 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:11:17,925 DEBUG - Will invoke JobStart for JobID [CREAM018257569]\n', 'https://cert-08.pd.infn.it:8443/CREAM018257569\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM018257569 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM018257569 2014-08-18 12:11:18.103417 Submit https://cert-08.pd.infn.it:8443/CREAM018257569 Left: 934 (at submission time:934) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM018257569 2014-08-18 12:13:19.762324 Exit https://cert-08.pd.infn.it:8443/CREAM160277062 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:13:20,332 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:13:20,361 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:13:20,361 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:13:20,361 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121320.log]\n', '2014-08-18 12:13:20,364 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:13:21,529 DEBUG - Will invoke JobStart for JobID [CREAM841151830]\n', 'https://cert-08.pd.infn.it:8443/CREAM841151830\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM841151830 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM841151830 2014-08-18 12:13:21.908284 Submit https://cert-08.pd.infn.it:8443/CREAM841151830 Left: 924 (at submission time:924) su Submitted: 70 Running: 17 Cancelled: 0 Done-Ok: 53 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 53/1000 2014-08-18 12:12:21.169624 Submitted: 71 Running: 18 Cancelled: 0 Done-Ok: 53 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 53/1000 2014-08-18 12:12:22.722101 Submitted: 72 Running: 19 Cancelled: 0 Done-Ok: 53 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 53/1000 2014-08-18 12:12:22.879473 Submitted: 73 Running: 20 Cancelled: 0 Done-Ok: 53 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 53/1000 2014-08-18 12:13:17.269671 Submitted: 73 Running: 19 Cancelled: 0 Done-Ok: 54 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 54/1000 2014-08-18 12:13:18.658203 Submitted: 74 Running: 20 Cancelled: 0 Done-Ok: 54 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 54/1000 2014-08-18 12:13:19.696236 Submitted: 74 Running: 19 Cancelled: 0 Done-Ok: 55 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 55/1000 2014-08-18 12:13:19.766871 Submitted: 74 Running: 18 Cancelled: 0 Done-Ok: 56 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 56/1000 2014-08-18 12:13:20.500935 Submitted: 74 Running: 17 Cancelled: 0 Done-Ok: 57 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 57/1000 2014-08-18 12:13:21.607905 Submitted: 75 Running: 18 Cancelled: 0 Done-Ok: 57 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 57/1000 2014-08-18 12:13:21.910051 Submitted: 76 Running: 19 Cancelled: 0 Done-Ok: 57 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 57/1000 2014-08-18 12:13:22.689687 Submitted: 77 Running: 20 Cancelled: 0 Done-Ok: 57 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 57/1000 2014-08-18 12:14:17.970865 Submitted: 77 Running: 19 Cancelled: 0 Done-Ok: 58 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 58/1000 2014-08-18 12:14:19.359372 Submitted: 78 Running: 20 Cancelled: 0 Done-Ok: 58 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 58/1000 2014-08-18 12:14:20.042197 Submitted: 78 Running: 19 Cancelled: 0 Done-Ok: 59 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 59/1000 2014-08-18 12:14:20.149170 Submitted: 78 Running: 18 Cancelled: 0 Done-Ok: 60 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 60/1000 2014-08-18 12:14:21.605401 Submitted: 79 Running: 19 Cancelled: 0 Done-Ok: 60 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 60/1000 2014-08-18 12:14:21.785891 Submitted: 80 Running: 20 Cancelled: 0 Done-Ok: 60 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 60/1000 2014-08-18 12:14:22.113284 Submitted: 80 Running: 19 Cancelled: 0 Done-Ok: 61 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 61/1000 2014-08-18 12:14:23.713465 Submitted: 81 Running: 20 Cancelled: 0 Done-Ok: 61 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 61/1000 2014-08-18 12:15:18.193382 Submitted: 81 Running: 19 Cancelled: 0 Done-Ok: 62 Failbmission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM841151830 2014-08-18 12:14:20.040839 Exit https://cert-08.pd.infn.it:8443/CREAM779576777 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:14:20,588 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:14:20,620 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:14:20,620 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:14:20,620 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121420.log]\n', '2014-08-18 12:14:20,624 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:14:21,469 DEBUG - Will invoke JobStart for JobID [CREAM822941354]\n', 'https://cert-08.pd.infn.it:8443/CREAM822941354\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM822941354 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM822941354 2014-08-18 12:14:21.603747 Submit https://cert-08.pd.infn.it:8443/CREAM822941354 Left: 921 (at submission time:921) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM822941354 2014-08-18 12:15:20.129984 Exit https://cert-08.pd.infn.it:8443/CREAM950376443 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:15:20,675 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:15:20,699 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:15:20,699 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:15:20,699 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121520.log]\n', '2014-08-18 12:15:20,702 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:15:21,529 DEBUG - Will invoke JobStart for JobID [CREAM332261131]\n', 'https://cert-08.pd.infn.it:8443/CREAM332261131\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM332261131 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM332261131 2014-08-18 12:15:21.805715 Submit https://cert-08.pd.infn.it:8443/CREAM332261131 Left: 917 (at submission time:917) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM332261131 2014-08-18 12:16:18.552874 Exit https://cert-08.pd.infn.it:8443/CREAM018257569 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:16:18,889 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:16:18,929 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:16:18,930 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:16:18,930 DEBUG - Logfbmission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM811749200 2014-08-18 12:14:20.146435 Exit https://cert-08.pd.infn.it:8443/CREAM390188217 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:14:20,674 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:14:20,695 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:14:20,695 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:14:20,696 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121420.log]\n', '2014-08-18 12:14:20,704 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:14:21,528 DEBUG - Will invoke JobStart for JobID [CREAM400242658]\n', 'https://cert-08.pd.infn.it:8443/CREAM400242658\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM400242658 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM400242658 2014-08-18 12:14:21.782826 Submit https://cert-08.pd.infn.it:8443/CREAM400242658 Left: 920 (at submission time:920) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM400242658 2014-08-18 12:14:22.111698 Exit https://cert-08.pd.infn.it:8443/CREAM257255347 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:14:22,603 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:14:22,625 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:14:22,625 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:14:22,625 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121422.log]\n', '2014-08-18 12:14:22,629 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:14:23,528 DEBUG - Will invoke JobStart for JobID [CREAM259417421]\n', 'https://cert-08.pd.infn.it:8443/CREAM259417421\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM259417421 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM259417421 2014-08-18 12:14:23.710552 Submit https://cert-08.pd.infn.it:8443/CREAM259417421 Left: 919 (at submission time:919) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM259417421 2014-08-18 12:16:20.949228 Exit https://cert-08.pd.infn.it:8443/CREAM833422341 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:16:21,702 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:16:21,744 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:16:21,744 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:16:21,744 DEBUG - Logfbmission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM479691458 2014-08-18 12:13:19.694950 Exit https://cert-08.pd.infn.it:8443/CREAM122731080 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:13:20,258 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:13:20,286 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:13:20,287 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:13:20,287 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121320.log]\n', '2014-08-18 12:13:20,290 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:13:21,245 DEBUG - Will invoke JobStart for JobID [CREAM494697263]\n', 'https://cert-08.pd.infn.it:8443/CREAM494697263\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM494697263 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM494697263 2014-08-18 12:13:21.604955 Submit https://cert-08.pd.infn.it:8443/CREAM494697263 Left: 925 (at submission time:925) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM494697263 2014-08-18 12:15:21.925648 Exit https://cert-08.pd.infn.it:8443/CREAM055494006 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:15:22,618 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:15:22,654 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:15:22,654 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:15:22,654 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121522.log]\n', '2014-08-18 12:15:22,658 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:15:23,550 DEBUG - Will invoke JobStart for JobID [CREAM877288766]\n', 'https://cert-08.pd.infn.it:8443/CREAM877288766\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM877288766 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM877288766 2014-08-18 12:15:23.905169 Submit https://cert-08.pd.infn.it:8443/CREAM877288766 Left: 915 (at submission time:915) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM877288766 2014-08-18 12:16:21.529189 Exit https://cert-08.pd.infn.it:8443/CREAM686224001 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:16:22,115 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:16:22,140 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:16:22,140 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:16:22,140 DEBUG - Logfbmission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM829761802 2014-08-18 12:14:17.968707 Exit https://cert-08.pd.infn.it:8443/CREAM564632199 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:14:18,379 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:14:18,404 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:14:18,404 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:14:18,405 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121418.log]\n', '2014-08-18 12:14:18,415 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:14:19,168 DEBUG - Will invoke JobStart for JobID [CREAM855389088]\n', 'https://cert-08.pd.infn.it:8443/CREAM855389088\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM855389088 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM855389088 2014-08-18 12:14:19.356105 Submit https://cert-08.pd.infn.it:8443/CREAM855389088 Left: 922 (at submission time:922) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM855389088 2014-08-18 12:15:21.490328 Exit https://cert-08.pd.infn.it:8443/CREAM661870981 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:15:22,098 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:15:22,129 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:15:22,130 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:15:22,130 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121522.log]\n', '2014-08-18 12:15:22,139 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:15:23,002 DEBUG - Will invoke JobStart for JobID [CREAM332063505]\n', 'https://cert-08.pd.infn.it:8443/CREAM332063505\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM332063505 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM332063505 2014-08-18 12:15:23.297124 Submit https://cert-08.pd.infn.it:8443/CREAM332063505 Left: 916 (at submission time:916) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM332063505 2014-08-18 12:16:22.517811 Exit https://cert-08.pd.infn.it:8443/CREAM979928878 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:16:23,037 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:16:23,057 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:16:23,057 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:16:23,057 DEBUG - Logfbmission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM551395179 2014-08-18 12:13:20.498432 Exit https://cert-08.pd.infn.it:8443/CREAM555363622 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:13:21,389 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:13:21,424 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:13:21,424 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:13:21,424 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121321.log]\n', '2014-08-18 12:13:21,427 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:13:22,287 DEBUG - Will invoke JobStart for JobID [CREAM376189650]\n', 'https://cert-08.pd.infn.it:8443/CREAM376189650\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM376189650 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM376189650 2014-08-18 12:13:22.686019 Submit https://cert-08.pd.infn.it:8443/CREAM376189650 Left: 923 (at submission time:923) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM376189650 2014-08-18 12:15:18.191392 Exit https://cert-08.pd.infn.it:8443/CREAM390059086 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:15:18,560 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:15:18,598 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:15:18,598 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:15:18,598 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121518.log]\n', '2014-08-18 12:15:18,603 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:15:19,303 DEBUG - Will invoke JobStart for JobID [CREAM384520505]\n', 'https://cert-08.pd.infn.it:8443/CREAM384520505\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM384520505 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM384520505 2014-08-18 12:15:19.578972 Submit https://cert-08.pd.infn.it:8443/CREAM384520505 Left: 918 (at submission time:918) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM384520505 2014-08-18 12:17:18.954991 Exit https://cert-08.pd.infn.it:8443/CREAM244238514 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:17:19,378 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:17:19,405 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:17:19,406 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:17:19,406 DEBUG - Logfed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 62/1000 2014-08-18 12:15:19.580719 Submitted: 82 Running: 20 Cancelled: 0 Done-Ok: 62 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 62/1000 2014-08-18 12:15:20.131797 Submitted: 82 Running: 19 Cancelled: 0 Done-Ok: 63 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 63/1000 2014-08-18 12:15:21.491830 Submitted: 82 Running: 18 Cancelled: 0 Done-Ok: 64 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 64/1000 2014-08-18 12:15:21.806872 Submitted: 83 Running: 19 Cancelled: 0 Done-Ok: 64 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 64/1000 2014-08-18 12:15:21.927474 Submitted: 83 Running: 18 Cancelled: 0 Done-Ok: 65 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 65/1000 2014-08-18 12:15:23.298296 Submitted: 84 Running: 19 Cancelled: 0 Done-Ok: 65 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 65/1000 2014-08-18 12:15:23.906383 Submitted: 85 Running: 20 Cancelled: 0 Done-Ok: 65 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 65/1000 2014-08-18 12:16:18.555180 Submitted: 85 Running: 19 Cancelled: 0 Done-Ok: 66 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 66/1000 2014-08-18 12:16:19.868179 Submitted: 86 Running: 20 Cancelled: 0 Done-Ok: 66 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 66/1000 2014-08-18 12:16:20.952898 Submitted: 86 Running: 19 Cancelled: 0 Done-Ok: 67 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 67/1000 2014-08-18 12:16:21.530822 Submitted: 86 Running: 18 Cancelled: 0 Done-Ok: 68 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 68/1000 2014-08-18 12:16:22.519210 Submitted: 86 Running: 17 Cancelled: 0 Done-Ok: 69 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 69/1000 2014-08-18 12:16:22.671139 Submitted: 87 Running: 18 Cancelled: 0 Done-Ok: 69 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 69/1000 2014-08-18 12:16:23.591354 Submitted: 88 Running: 19 Cancelled: 0 Done-Ok: 69 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 69/1000 2014-08-18 12:16:24.220678 Submitted: 89 Running: 20 Cancelled: 0 Done-Ok: 69 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 69/1000 2014-08-18 12:17:18.957897 Submitted: 89 Running: 19 Cancelled: 0 Done-Ok: 70 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 70/1000 2014-08-18 12:17:20.270694 Submitted: 90 Running: 20 Cancelled: 0 Done-Ok: 70 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 70/1000 2014-08-18 12:17:21.560080 Submitted: 90 Running: 19 Cancelled: 0 Done-Ok: 71 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 71/1000 2014-08-18 12:17:22.127554 Submitted: 90 Running: 18 Cancelled: 0 Done-Ok: 72 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 72/1000 2014-08-18 12:17:22.996813 Submitted: 90 Running: 17 Cancelled: 0 Done-Ok: 73 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 ile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121622.log]\n', '2014-08-18 12:16:22,147 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:16:23,264 DEBUG - Will invoke JobStart for JobID [CREAM021781264]\n', 'https://cert-08.pd.infn.it:8443/CREAM021781264\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM021781264 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM021781264 2014-08-18 12:16:23.589765 Submit https://cert-08.pd.infn.it:8443/CREAM021781264 Left: 912 (at submission time:912) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM021781264 2014-08-18 12:17:22.993624 Exit https://cert-08.pd.infn.it:8443/CREAM479691458 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:17:23,643 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:17:23,666 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:17:23,666 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:17:23,666 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121723.log]\n', '2014-08-18 12:17:23,669 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:17:24,576 DEBUG - Will invoke JobStart for JobID [CREAM142712220]\n', 'https://cert-08.pd.infn.it:8443/CREAM142712220\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM142712220 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM142712220 2014-08-18 12:17:24.855692 Submit https://cert-08.pd.infn.it:8443/CREAM142712220 Left: 907 (at submission time:907) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM142712220 2014-08-18 12:18:21.744044 Exit https://cert-08.pd.infn.it:8443/CREAM494697263 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:18:22,217 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:18:22,243 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:18:22,243 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:18:22,243 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121822.log]\n', '2014-08-18 12:18:22,246 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:18:23,218 DEBUG - Will invoke JobStart for JobID [CREAM423359419]\n', 'https://cert-08.pd.infn.it:8443/CREAM423359419\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM423359419 Submitted job: jid = https://cert-ile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121719.log]\n', '2014-08-18 12:17:19,418 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:17:19,969 DEBUG - Will invoke JobStart for JobID [CREAM714199958]\n', 'https://cert-08.pd.infn.it:8443/CREAM714199958\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM714199958 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM714199958 2014-08-18 12:17:20.268586 Submit https://cert-08.pd.infn.it:8443/CREAM714199958 Left: 910 (at submission time:910) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM714199958 2014-08-18 12:17:21.557892 Exit https://cert-08.pd.infn.it:8443/CREAM551395179 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:17:22,188 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:17:22,214 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:17:22,214 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:17:22,214 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121722.log]\n', '2014-08-18 12:17:22,224 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:17:22,945 DEBUG - Will invoke JobStart for JobID [CREAM951107727]\n', 'https://cert-08.pd.infn.it:8443/CREAM951107727\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM951107727 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM951107727 2014-08-18 12:17:23.304459 Submit https://cert-08.pd.infn.it:8443/CREAM951107727 Left: 909 (at submission time:909) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM951107727 2014-08-18 12:18:23.162325 Exit https://cert-08.pd.infn.it:8443/CREAM376189650 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:18:23,789 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:18:23,813 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:18:23,813 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:18:23,813 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121823.log]\n', '2014-08-18 12:18:23,816 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:18:24,935 DEBUG - Will invoke JobStart for JobID [CREAM728013161]\n', 'https://cert-08.pd.infn.it:8443/CREAM728013161\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM728013161 Submitted job: jid = https://cert-ile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121623.log]\n', '2014-08-18 12:16:23,061 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:16:24,060 DEBUG - Will invoke JobStart for JobID [CREAM441100642]\n', 'https://cert-08.pd.infn.it:8443/CREAM441100642\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM441100642 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM441100642 2014-08-18 12:16:24.217897 Submit https://cert-08.pd.infn.it:8443/CREAM441100642 Left: 911 (at submission time:911) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM441100642 2014-08-18 12:18:19.829346 Exit https://cert-08.pd.infn.it:8443/CREAM829761802 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:18:20,175 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:18:20,205 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:18:20,205 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:18:20,205 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121820.log]\n', '2014-08-18 12:18:20,220 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:18:21,033 DEBUG - Will invoke JobStart for JobID [CREAM442267389]\n', 'https://cert-08.pd.infn.it:8443/CREAM442267389\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM442267389 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM442267389 2014-08-18 12:18:21.355679 Submit https://cert-08.pd.infn.it:8443/CREAM442267389 Left: 906 (at submission time:906) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM442267389 2014-08-18 12:19:19.752673 Exit https://cert-08.pd.infn.it:8443/CREAM855389088 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:19:20,212 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:19:20,237 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:19:20,237 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:19:20,237 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121920.log]\n', '2014-08-18 12:19:20,241 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:19:20,960 DEBUG - Will invoke JobStart for JobID [CREAM652902294]\n', 'https://cert-08.pd.infn.it:8443/CREAM652902294\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM652902294 Submitted job: jid = https://cert-ile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121618.log]\n', '2014-08-18 12:16:18,937 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:16:19,603 DEBUG - Will invoke JobStart for JobID [CREAM317087958]\n', 'https://cert-08.pd.infn.it:8443/CREAM317087958\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM317087958 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM317087958 2014-08-18 12:16:19.864404 Submit https://cert-08.pd.infn.it:8443/CREAM317087958 Left: 914 (at submission time:914) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM317087958 2014-08-18 12:18:22.468657 Exit https://cert-08.pd.infn.it:8443/CREAM841151830 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:18:23,170 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:18:23,210 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:18:23,211 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:18:23,211 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121823.log]\n', '2014-08-18 12:18:23,224 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:18:24,204 DEBUG - Will invoke JobStart for JobID [CREAM742282359]\n', 'https://cert-08.pd.infn.it:8443/CREAM742282359\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM742282359 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM742282359 2014-08-18 12:18:24.537833 Submit https://cert-08.pd.infn.it:8443/CREAM742282359 Left: 904 (at submission time:904) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM742282359 2014-08-18 12:19:22.843932 Exit https://cert-08.pd.infn.it:8443/CREAM822941354 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:19:23,301 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:19:23,324 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:19:23,324 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:19:23,324 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121923.log]\n', '2014-08-18 12:19:23,327 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:19:24,169 DEBUG - Will invoke JobStart for JobID [CREAM772480543]\n', 'https://cert-08.pd.infn.it:8443/CREAM772480543\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM772480543 Submitted job: jid = https://cert-ile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121621.log]\n', '2014-08-18 12:16:21,758 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:16:22,306 DEBUG - Will invoke JobStart for JobID [CREAM689396817]\n', 'https://cert-08.pd.infn.it:8443/CREAM689396817\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM689396817 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM689396817 2014-08-18 12:16:22.669345 Submit https://cert-08.pd.infn.it:8443/CREAM689396817 Left: 913 (at submission time:913) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM689396817 2014-08-18 12:17:22.124226 Exit https://cert-08.pd.infn.it:8443/CREAM811749200 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:17:22,827 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:17:22,852 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:17:22,852 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:17:22,853 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121722.log]\n', '2014-08-18 12:17:22,855 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:17:23,519 DEBUG - Will invoke JobStart for JobID [CREAM566513341]\n', 'https://cert-08.pd.infn.it:8443/CREAM566513341\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM566513341 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM566513341 2014-08-18 12:17:23.713984 Submit https://cert-08.pd.infn.it:8443/CREAM566513341 Left: 908 (at submission time:908) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM566513341 2014-08-18 12:19:23.460067 Exit https://cert-08.pd.infn.it:8443/CREAM400242658 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:19:24,196 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:19:24,220 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:19:24,220 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:19:24,221 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121924.log]\n', '2014-08-18 12:19:24,230 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:19:25,271 DEBUG - Will invoke JobStart for JobID [CREAM596391150]\n', 'https://cert-08.pd.infn.it:8443/CREAM596391150\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM596391150 Submitted job: jid = https://cert-Cancel Failed: 0 Illegal Final Status: 0 Collected 73/1000 2014-08-18 12:17:23.307571 Submitted: 91 Running: 18 Cancelled: 0 Done-Ok: 73 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 73/1000 2014-08-18 12:17:23.718009 Submitted: 92 Running: 19 Cancelled: 0 Done-Ok: 73 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 73/1000 2014-08-18 12:17:24.859655 Submitted: 93 Running: 20 Cancelled: 0 Done-Ok: 73 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 73/1000 2014-08-18 12:18:19.831451 Submitted: 93 Running: 19 Cancelled: 0 Done-Ok: 74 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 74/1000 2014-08-18 12:18:21.360779 Submitted: 94 Running: 20 Cancelled: 0 Done-Ok: 74 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 74/1000 2014-08-18 12:18:21.755736 Submitted: 94 Running: 19 Cancelled: 0 Done-Ok: 75 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 75/1000 2014-08-18 12:18:22.471370 Submitted: 94 Running: 18 Cancelled: 0 Done-Ok: 76 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 76/1000 2014-08-18 12:18:23.165006 Submitted: 94 Running: 17 Cancelled: 0 Done-Ok: 77 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 77/1000 2014-08-18 12:18:23.725764 Submitted: 95 Running: 18 Cancelled: 0 Done-Ok: 77 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 77/1000 2014-08-18 12:18:24.539756 Submitted: 96 Running: 19 Cancelled: 0 Done-Ok: 77 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 77/1000 2014-08-18 12:18:25.181217 Submitted: 97 Running: 20 Cancelled: 0 Done-Ok: 77 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 77/1000 2014-08-18 12:19:19.753810 Submitted: 97 Running: 19 Cancelled: 0 Done-Ok: 78 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 78/1000 2014-08-18 12:19:21.275578 Submitted: 98 Running: 20 Cancelled: 0 Done-Ok: 78 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 78/1000 2014-08-18 12:19:22.847448 Submitted: 98 Running: 19 Cancelled: 0 Done-Ok: 79 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 79/1000 2014-08-18 12:19:23.461216 Submitted: 98 Running: 18 Cancelled: 0 Done-Ok: 80 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 80/1000 2014-08-18 12:19:24.408194 Submitted: 99 Running: 19 Cancelled: 0 Done-Ok: 80 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 80/1000 2014-08-18 12:19:25.533765 Submitted: 100 Running: 20 Cancelled: 0 Done-Ok: 80 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 80/1000 2014-08-18 12:19:25.867735 Submitted: 100 Running: 19 Cancelled: 0 Done-Ok: 81 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 81/1000 2014-08-18 12:19:27.607105 Submitted: 101 Running: 20 Cancelled: 0 Done-Ok: 81 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 81/1000 2014-08-18 12:20:20.424135 Submitted: 101 Running: 19 Cancelled: 0 Done-Ok: 82 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collec08.pd.infn.it:8443/CREAM423359419 2014-08-18 12:18:23.723663 Submit https://cert-08.pd.infn.it:8443/CREAM423359419 Left: 905 (at submission time:905) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM423359419 2014-08-18 12:20:23.739549 Exit https://cert-08.pd.infn.it:8443/CREAM877288766 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:20:24,408 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:20:24,432 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:20:24,432 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:20:24,432 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122024.log]\n', '2014-08-18 12:20:24,435 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:20:25,517 DEBUG - Will invoke JobStart for JobID [CREAM791642991]\n', 'https://cert-08.pd.infn.it:8443/CREAM791642991\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM791642991 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM791642991 2014-08-18 12:20:25.685180 Submit https://cert-08.pd.infn.it:8443/CREAM791642991 Left: 895 (at submission time:895) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM791642991 2014-08-18 12:21:22.967164 Exit https://cert-08.pd.infn.it:8443/CREAM021781264 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:21:23,704 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:21:23,726 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:21:23,726 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:21:23,727 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122123.log]\n', '2014-08-18 12:21:23,730 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:21:24,542 DEBUG - Will invoke JobStart for JobID [CREAM113065408]\n', 'https://cert-08.pd.infn.it:8443/CREAM113065408\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM113065408 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM113065408 2014-08-18 12:21:24.769275 Submit https://cert-08.pd.infn.it:8443/CREAM113065408 Left: 893 (at submission time:893) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM113065408 2014-08-18 12:22:24.319212 Exit https://cert-08.pd.infn.it:8443/CREAM142712220 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:22:25,008 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:22:25,034 DEBUG - VO from certifited 82/1000 2014-08-18 12:20:21.803947 Submitted: 102 Running: 20 Cancelled: 0 Done-Ok: 82 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 82/1000 2014-08-18 12:20:23.213931 Submitted: 102 Running: 19 Cancelled: 0 Done-Ok: 83 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 83/1000 2014-08-18 12:20:23.484867 Submitted: 102 Running: 18 Cancelled: 0 Done-Ok: 84 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 84/1000 2014-08-18 12:20:23.740824 Submitted: 102 Running: 17 Cancelled: 0 Done-Ok: 85 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 85/1000 2014-08-18 12:20:25.221888 Submitted: 103 Running: 18 Cancelled: 0 Done-Ok: 85 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 85/1000 2014-08-18 12:20:25.579760 Submitted: 104 Running: 19 Cancelled: 0 Done-Ok: 85 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 85/1000 2014-08-18 12:20:25.686401 Submitted: 105 Running: 20 Cancelled: 0 Done-Ok: 85 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 85/1000 2014-08-18 12:21:20.660964 Submitted: 105 Running: 19 Cancelled: 0 Done-Ok: 86 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 86/1000 2014-08-18 12:21:21.960211 Submitted: 106 Running: 20 Cancelled: 0 Done-Ok: 86 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 86/1000 2014-08-18 12:21:22.969975 Submitted: 106 Running: 19 Cancelled: 0 Done-Ok: 87 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 87/1000 2014-08-18 12:21:24.770910 Submitted: 107 Running: 20 Cancelled: 0 Done-Ok: 87 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 87/1000 2014-08-18 12:21:24.808672 Submitted: 107 Running: 19 Cancelled: 0 Done-Ok: 88 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 88/1000 2014-08-18 12:21:24.943709 Submitted: 107 Running: 18 Cancelled: 0 Done-Ok: 89 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 89/1000 2014-08-18 12:21:26.490149 Submitted: 108 Running: 19 Cancelled: 0 Done-Ok: 89 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 89/1000 2014-08-18 12:21:26.702993 Submitted: 109 Running: 20 Cancelled: 0 Done-Ok: 89 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 89/1000 2014-08-18 12:22:21.307595 Submitted: 109 Running: 19 Cancelled: 0 Done-Ok: 90 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 90/1000 2014-08-18 12:22:22.646519 Submitted: 110 Running: 20 Cancelled: 0 Done-Ok: 90 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 90/1000 2014-08-18 12:22:24.240895 Submitted: 110 Running: 19 Cancelled: 0 Done-Ok: 91 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 91/1000 2014-08-18 12:22:24.320729 Submitted: 110 Running: 18 Cancelled: 0 Done-Ok: 92 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 92/1000 2014-08-18 12:22:25.089062 Submitted: 110 Running: 17 Cancelled: 0 Done-Ok: 93 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 93/1000 2014-08-18 12:22:26.137408.pd.infn.it:8443/CREAM728013161 2014-08-18 12:18:25.178912 Submit https://cert-08.pd.infn.it:8443/CREAM728013161 Left: 903 (at submission time:903) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM728013161 2014-08-18 12:20:20.421798 Exit https://cert-08.pd.infn.it:8443/CREAM384520505 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:20:20,836 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:20:20,865 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:20:20,872 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:20:20,872 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122020.log]\n', '2014-08-18 12:20:20,878 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:20:21,665 DEBUG - Will invoke JobStart for JobID [CREAM657158976]\n', 'https://cert-08.pd.infn.it:8443/CREAM657158976\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM657158976 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM657158976 2014-08-18 12:20:21.801328 Submit https://cert-08.pd.infn.it:8443/CREAM657158976 Left: 898 (at submission time:898) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM657158976 2014-08-18 12:22:21.304216 Exit https://cert-08.pd.infn.it:8443/CREAM714199958 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:22:21,628 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:22:21,652 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:22:21,652 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:22:21,653 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122221.log]\n', '2014-08-18 12:22:21,656 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:22:22,458 DEBUG - Will invoke JobStart for JobID [CREAM675701370]\n', 'https://cert-08.pd.infn.it:8443/CREAM675701370\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM675701370 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM675701370 2014-08-18 12:22:22.642802 Submit https://cert-08.pd.infn.it:8443/CREAM675701370 Left: 890 (at submission time:890) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM675701370 2014-08-18 12:22:24.239663 Exit https://cert-08.pd.infn.it:8443/CREAM951107727 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:22:25,101 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:22:25,133 DEBUG - VO from certifi08.pd.infn.it:8443/CREAM596391150 2014-08-18 12:19:25.532167 Submit https://cert-08.pd.infn.it:8443/CREAM596391150 Left: 900 (at submission time:900) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM596391150 2014-08-18 12:19:25.866128 Exit https://cert-08.pd.infn.it:8443/CREAM259417421 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:19:26,470 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:19:26,493 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:19:26,493 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:19:26,493 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-121926.log]\n', '2014-08-18 12:19:26,495 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:19:27,392 DEBUG - Will invoke JobStart for JobID [CREAM306557377]\n', 'https://cert-08.pd.infn.it:8443/CREAM306557377\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM306557377 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM306557377 2014-08-18 12:19:27.605173 Submit https://cert-08.pd.infn.it:8443/CREAM306557377 Left: 899 (at submission time:899) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM306557377 2014-08-18 12:21:24.941666 Exit https://cert-08.pd.infn.it:8443/CREAM689396817 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:21:25,758 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:21:25,785 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:21:25,786 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:21:25,786 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122125.log]\n', '2014-08-18 12:21:25,788 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:21:26,562 DEBUG - Will invoke JobStart for JobID [CREAM839269015]\n', 'https://cert-08.pd.infn.it:8443/CREAM839269015\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM839269015 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM839269015 2014-08-18 12:21:26.701909 Submit https://cert-08.pd.infn.it:8443/CREAM839269015 Left: 891 (at submission time:891) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM839269015 2014-08-18 12:22:25.087620 Exit https://cert-08.pd.infn.it:8443/CREAM566513341 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:22:25,989 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:22:26,009 DEBUG - VO from certifi08.pd.infn.it:8443/CREAM652902294 2014-08-18 12:19:21.272189 Submit https://cert-08.pd.infn.it:8443/CREAM652902294 Left: 902 (at submission time:902) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM652902294 2014-08-18 12:20:23.482796 Exit https://cert-08.pd.infn.it:8443/CREAM332063505 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:20:24,028 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:20:24,053 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:20:24,053 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:20:24,053 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122024.log]\n', '2014-08-18 12:20:24,060 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:20:25,233 DEBUG - Will invoke JobStart for JobID [CREAM902724610]\n', 'https://cert-08.pd.infn.it:8443/CREAM902724610\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM902724610 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM902724610 2014-08-18 12:20:25.576907 Submit https://cert-08.pd.infn.it:8443/CREAM902724610 Left: 896 (at submission time:896) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM902724610 2014-08-18 12:21:24.805769 Exit https://cert-08.pd.infn.it:8443/CREAM441100642 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:21:25,339 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:21:25,361 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:21:25,362 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:21:25,362 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122125.log]\n', '2014-08-18 12:21:25,365 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:21:26,180 DEBUG - Will invoke JobStart for JobID [CREAM309475742]\n', 'https://cert-08.pd.infn.it:8443/CREAM309475742\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM309475742 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM309475742 2014-08-18 12:21:26.487845 Submit https://cert-08.pd.infn.it:8443/CREAM309475742 Left: 892 (at submission time:892) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM309475742 2014-08-18 12:23:21.747455 Exit https://cert-08.pd.infn.it:8443/CREAM442267389 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:23:22,094 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:23:22,117 DEBUG - VO from certifi08.pd.infn.it:8443/CREAM772480543 2014-08-18 12:19:24.404474 Submit https://cert-08.pd.infn.it:8443/CREAM772480543 Left: 901 (at submission time:901) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM772480543 2014-08-18 12:20:23.211996 Exit https://cert-08.pd.infn.it:8443/CREAM332261131 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:20:23,982 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:20:24,007 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:20:24,007 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:20:24,007 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122024.log]\n', '2014-08-18 12:20:24,014 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:20:24,900 DEBUG - Will invoke JobStart for JobID [CREAM815298471]\n', 'https://cert-08.pd.infn.it:8443/CREAM815298471\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM815298471 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM815298471 2014-08-18 12:20:25.219501 Submit https://cert-08.pd.infn.it:8443/CREAM815298471 Left: 897 (at submission time:897) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM815298471 2014-08-18 12:21:20.658969 Exit https://cert-08.pd.infn.it:8443/CREAM317087958 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:21:20,979 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:21:20,998 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:21:20,998 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:21:20,998 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122120.log]\n', '2014-08-18 12:21:21,001 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:21:21,716 DEBUG - Will invoke JobStart for JobID [CREAM319491077]\n', 'https://cert-08.pd.infn.it:8443/CREAM319491077\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM319491077 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM319491077 2014-08-18 12:21:21.955803 Submit https://cert-08.pd.infn.it:8443/CREAM319491077 Left: 894 (at submission time:894) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM319491077 2014-08-18 12:23:24.634934 Exit https://cert-08.pd.infn.it:8443/CREAM742282359 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:23:25,399 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:23:25,430 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:22:26,009 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:22:26,009 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122226.log]\n', '2014-08-18 12:22:26,012 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:22:26,816 DEBUG - Will invoke JobStart for JobID [CREAM134897189]\n', 'https://cert-08.pd.infn.it:8443/CREAM134897189\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM134897189 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM134897189 2014-08-18 12:22:27.115473 Submit https://cert-08.pd.infn.it:8443/CREAM134897189 Left: 887 (at submission time:887) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM134897189 2014-08-18 12:24:25.473287 Exit https://cert-08.pd.infn.it:8443/CREAM596391150 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:24:26,079 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:24:26,111 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:24:26,112 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:24:26,112 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122426.log]\n', '2014-08-18 12:24:26,123 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:24:27,239 DEBUG - Will invoke JobStart for JobID [CREAM599804284]\n', 'https://cert-08.pd.infn.it:8443/CREAM599804284\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM599804284 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM599804284 2014-08-18 12:24:27.565819 Submit https://cert-08.pd.infn.it:8443/CREAM599804284 Left: 880 (at submission time:880) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM599804284 2014-08-18 12:24:27.886756 Exit https://cert-08.pd.infn.it:8443/CREAM306557377 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:24:28,605 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:24:28,626 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:24:28,626 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:24:28,626 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122428.log]\n', '2014-08-18 12:24:28,630 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:24:29,437 DEBUG - Will invoke JobStart for JobID [CREAM194706095]\n', 'https://cert-08.pd.infn.it:8443/CREAM194706095\n'] job subcate=[dteam]\n', '2014-08-18 12:22:25,133 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:22:25,134 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122225.log]\n', '2014-08-18 12:22:25,140 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:22:26,158 DEBUG - Will invoke JobStart for JobID [CREAM432395263]\n', 'https://cert-08.pd.infn.it:8443/CREAM432395263\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM432395263 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM432395263 2014-08-18 12:22:26.560906 Submit https://cert-08.pd.infn.it:8443/CREAM432395263 Left: 888 (at submission time:888) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM432395263 2014-08-18 12:23:25.518946 Exit https://cert-08.pd.infn.it:8443/CREAM728013161 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:23:26,457 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:23:26,491 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:23:26,491 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:23:26,492 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122326.log]\n', '2014-08-18 12:23:26,495 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:23:27,139 DEBUG - Will invoke JobStart for JobID [CREAM599743223]\n', 'https://cert-08.pd.infn.it:8443/CREAM599743223\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM599743223 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM599743223 2014-08-18 12:23:27.349092 Submit https://cert-08.pd.infn.it:8443/CREAM599743223 Left: 883 (at submission time:883) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM599743223 2014-08-18 12:25:22.745640 Exit https://cert-08.pd.infn.it:8443/CREAM657158976 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:25:23,163 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:25:23,183 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:25:23,183 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:25:23,183 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122523.log]\n', '2014-08-18 12:25:23,186 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:25:23,873 DEBUG - Will invoke JobStart for JobID [CREAM708748408]\n', 'https://cert-08.pd.infn.it:8443/CREAM708748408\n'] job sub47 Submitted: 111 Running: 18 Cancelled: 0 Done-Ok: 93 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 93/1000 2014-08-18 12:22:26.563002 Submitted: 112 Running: 19 Cancelled: 0 Done-Ok: 93 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 93/1000 2014-08-18 12:22:27.117196 Submitted: 113 Running: 20 Cancelled: 0 Done-Ok: 93 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 93/1000 2014-08-18 12:23:21.752802 Submitted: 113 Running: 19 Cancelled: 0 Done-Ok: 94 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 94/1000 2014-08-18 12:23:23.209679 Submitted: 114 Running: 20 Cancelled: 0 Done-Ok: 94 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 94/1000 2014-08-18 12:23:24.528030 Submitted: 114 Running: 19 Cancelled: 0 Done-Ok: 95 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 95/1000 2014-08-18 12:23:24.636963 Submitted: 114 Running: 18 Cancelled: 0 Done-Ok: 96 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 96/1000 2014-08-18 12:23:25.520598 Submitted: 114 Running: 17 Cancelled: 0 Done-Ok: 97 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 97/1000 2014-08-18 12:23:26.595204 Submitted: 115 Running: 18 Cancelled: 0 Done-Ok: 97 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 97/1000 2014-08-18 12:23:26.836845 Submitted: 116 Running: 19 Cancelled: 0 Done-Ok: 97 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 97/1000 2014-08-18 12:23:27.352021 Submitted: 117 Running: 20 Cancelled: 0 Done-Ok: 97 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 97/1000 2014-08-18 12:24:22.093552 Submitted: 117 Running: 19 Cancelled: 0 Done-Ok: 98 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 98/1000 2014-08-18 12:24:23.500066 Submitted: 118 Running: 20 Cancelled: 0 Done-Ok: 98 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 98/1000 2014-08-18 12:24:25.339605 Submitted: 118 Running: 19 Cancelled: 0 Done-Ok: 99 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 99/1000 2014-08-18 12:24:25.475223 Submitted: 118 Running: 18 Cancelled: 0 Done-Ok: 100 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 100/1000 2014-08-18 12:24:27.172066 Submitted: 119 Running: 19 Cancelled: 0 Done-Ok: 100 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 100/1000 2014-08-18 12:24:27.567639 Submitted: 120 Running: 20 Cancelled: 0 Done-Ok: 100 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 100/1000 2014-08-18 12:24:27.888813 Submitted: 120 Running: 19 Cancelled: 0 Done-Ok: 101 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 101/1000 2014-08-18 12:24:29.702836 Submitted: 121 Running: 20 Cancelled: 0 Done-Ok: 101 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 101/1000 2014-08-18 12:25:22.747040 Submitted: 121 Running: 19 Cancelled: 0 Done-Ok: 102 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 102/1000 2014-08-18 12:25:24.098799 Submitted: 122 Runnincate=[dteam]\n', '2014-08-18 12:23:25,430 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:23:25,430 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122325.log]\n', '2014-08-18 12:23:25,434 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:23:26,519 DEBUG - Will invoke JobStart for JobID [CREAM171321503]\n', 'https://cert-08.pd.infn.it:8443/CREAM171321503\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM171321503 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM171321503 2014-08-18 12:23:26.833437 Submit https://cert-08.pd.infn.it:8443/CREAM171321503 Left: 884 (at submission time:884) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM171321503 2014-08-18 12:24:25.335863 Exit https://cert-08.pd.infn.it:8443/CREAM772480543 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:24:25,989 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:24:26,014 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:24:26,014 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:24:26,014 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122426.log]\n', '2014-08-18 12:24:26,019 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:24:26,672 DEBUG - Will invoke JobStart for JobID [CREAM388996805]\n', 'https://cert-08.pd.infn.it:8443/CREAM388996805\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM388996805 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM388996805 2014-08-18 12:24:27.169376 Submit https://cert-08.pd.infn.it:8443/CREAM388996805 Left: 881 (at submission time:881) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM388996805 2014-08-18 12:25:25.350539 Exit https://cert-08.pd.infn.it:8443/CREAM815298471 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:25:25,965 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:25:25,984 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:25:25,985 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:25:25,985 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122525.log]\n', '2014-08-18 12:25:25,988 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:25:26,831 DEBUG - Will invoke JobStart for JobID [CREAM467703548]\n', 'https://cert-08.pd.infn.it:8443/CREAM467703548\n'] job subcate=[dteam]\n', '2014-08-18 12:22:25,034 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:22:25,035 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122225.log]\n', '2014-08-18 12:22:25,038 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:22:25,798 DEBUG - Will invoke JobStart for JobID [CREAM916836626]\n', 'https://cert-08.pd.infn.it:8443/CREAM916836626\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM916836626 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM916836626 2014-08-18 12:22:26.134363 Submit https://cert-08.pd.infn.it:8443/CREAM916836626 Left: 889 (at submission time:889) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM916836626 2014-08-18 12:23:24.526020 Exit https://cert-08.pd.infn.it:8443/CREAM423359419 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:23:25,249 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:23:25,276 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:23:25,276 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:23:25,276 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122325.log]\n', '2014-08-18 12:23:25,280 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:23:26,409 DEBUG - Will invoke JobStart for JobID [CREAM634691295]\n', 'https://cert-08.pd.infn.it:8443/CREAM634691295\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM634691295 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM634691295 2014-08-18 12:23:26.592150 Submit https://cert-08.pd.infn.it:8443/CREAM634691295 Left: 885 (at submission time:885) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM634691295 2014-08-18 12:25:25.832188 Exit https://cert-08.pd.infn.it:8443/CREAM791642991 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:25:26,621 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:25:26,649 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:25:26,649 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:25:26,649 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122526.log]\n', '2014-08-18 12:25:26,652 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:25:27,580 DEBUG - Will invoke JobStart for JobID [CREAM910670561]\n', 'https://cert-08.pd.infn.it:8443/CREAM910670561\n'] job subcate=[dteam]\n', '2014-08-18 12:23:22,117 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:23:22,117 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122322.log]\n', '2014-08-18 12:23:22,126 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:23:22,882 DEBUG - Will invoke JobStart for JobID [CREAM487755761]\n', 'https://cert-08.pd.infn.it:8443/CREAM487755761\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM487755761 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM487755761 2014-08-18 12:23:23.208072 Submit https://cert-08.pd.infn.it:8443/CREAM487755761 Left: 886 (at submission time:886) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM487755761 2014-08-18 12:24:22.091252 Exit https://cert-08.pd.infn.it:8443/CREAM652902294 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:24:22,456 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:24:22,478 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:24:22,478 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:24:22,478 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122422.log]\n', '2014-08-18 12:24:22,483 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:24:23,299 DEBUG - Will invoke JobStart for JobID [CREAM289405219]\n', 'https://cert-08.pd.infn.it:8443/CREAM289405219\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM289405219 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM289405219 2014-08-18 12:24:23.498605 Submit https://cert-08.pd.infn.it:8443/CREAM289405219 Left: 882 (at submission time:882) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM289405219 2014-08-18 12:25:26.496406 Exit https://cert-08.pd.infn.it:8443/CREAM902724610 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:25:27,253 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:25:27,276 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:25:27,276 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:25:27,276 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122527.log]\n', '2014-08-18 12:25:27,279 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:25:28,196 DEBUG - Will invoke JobStart for JobID [CREAM374692804]\n', 'https://cert-08.pd.infn.it:8443/CREAM374692804\n'] job subg: 20 Cancelled: 0 Done-Ok: 102 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 102/1000 2014-08-18 12:25:25.351933 Submitted: 122 Running: 19 Cancelled: 0 Done-Ok: 103 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 103/1000 2014-08-18 12:25:25.833752 Submitted: 122 Running: 18 Cancelled: 0 Done-Ok: 104 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 104/1000 2014-08-18 12:25:26.499495 Submitted: 122 Running: 17 Cancelled: 0 Done-Ok: 105 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 105/1000 2014-08-18 12:25:27.373648 Submitted: 123 Running: 18 Cancelled: 0 Done-Ok: 105 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 105/1000 2014-08-18 12:25:27.837475 Submitted: 124 Running: 19 Cancelled: 0 Done-Ok: 105 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 105/1000 2014-08-18 12:25:28.401937 Submitted: 125 Running: 20 Cancelled: 0 Done-Ok: 105 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 105/1000 2014-08-18 12:26:23.431310 Submitted: 125 Running: 19 Cancelled: 0 Done-Ok: 106 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 106/1000 2014-08-18 12:26:24.658875 Submitted: 126 Running: 20 Cancelled: 0 Done-Ok: 106 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 106/1000 2014-08-18 12:26:26.256191 Submitted: 126 Running: 19 Cancelled: 0 Done-Ok: 107 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 107/1000 2014-08-18 12:26:26.795414 Submitted: 126 Running: 18 Cancelled: 0 Done-Ok: 108 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 108/1000 2014-08-18 12:26:26.940262 Submitted: 126 Running: 17 Cancelled: 0 Done-Ok: 109 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 109/1000 2014-08-18 12:26:28.230710 Submitted: 127 Running: 18 Cancelled: 0 Done-Ok: 109 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 109/1000 2014-08-18 12:26:28.702714 Submitted: 128 Running: 19 Cancelled: 0 Done-Ok: 109 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 109/1000 2014-08-18 12:26:28.949628 Submitted: 129 Running: 20 Cancelled: 0 Done-Ok: 109 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 109/1000 2014-08-18 12:27:23.623947 Submitted: 129 Running: 19 Cancelled: 0 Done-Ok: 110 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 110/1000 2014-08-18 12:27:24.867745 Submitted: 130 Running: 20 Cancelled: 0 Done-Ok: 110 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 110/1000 2014-08-18 12:27:26.182653 Submitted: 130 Running: 19 Cancelled: 0 Done-Ok: 111 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 111/1000 2014-08-18 12:27:26.404046 Submitted: 130 Running: 18 Cancelled: 0 Done-Ok: 112 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 112/1000 2014-08-18 12:27:27.010836 Submitted: 130 Running: 17 Cancelled: 0 Done-Ok: 113 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 113/1000 2014-08-18 12:27:28.205485 Submitted: 131 Rumission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM910670561 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM910670561 2014-08-18 12:25:27.834836 Submit https://cert-08.pd.infn.it:8443/CREAM910670561 Left: 876 (at submission time:876) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM910670561 2014-08-18 12:26:26.253255 Exit https://cert-08.pd.infn.it:8443/CREAM113065408 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:26:26,893 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:26:26,920 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:26:26,920 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:26:26,920 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122626.log]\n', '2014-08-18 12:26:26,927 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:26:27,779 DEBUG - Will invoke JobStart for JobID [CREAM213197161]\n', 'https://cert-08.pd.infn.it:8443/CREAM213197161\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM213197161 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM213197161 2014-08-18 12:26:28.229596 Submit https://cert-08.pd.infn.it:8443/CREAM213197161 Left: 873 (at submission time:873) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM213197161 2014-08-18 12:27:27.009289 Exit https://cert-08.pd.infn.it:8443/CREAM916836626 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:27:27,858 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:27:27,895 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:27:27,895 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:27:27,895 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122727.log]\n', '2014-08-18 12:27:27,899 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:27:28,707 DEBUG - Will invoke JobStart for JobID [CREAM748903873]\n', 'https://cert-08.pd.infn.it:8443/CREAM748903873\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM748903873 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM748903873 2014-08-18 12:27:28.965723 Submit https://cert-08.pd.infn.it:8443/CREAM748903873 Left: 867 (at submission time:867) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM748903873 2014-08-18 12:28:26.844765 Exit https://cert-08.pd.infn.it:8443/CREAM634691295 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retvmission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM708748408 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM708748408 2014-08-18 12:25:24.096740 Submit https://cert-08.pd.infn.it:8443/CREAM708748408 Left: 878 (at submission time:878) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM708748408 2014-08-18 12:27:23.621974 Exit https://cert-08.pd.infn.it:8443/CREAM675701370 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:27:23,945 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:27:23,969 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:27:23,969 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:27:23,969 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122723.log]\n', '2014-08-18 12:27:23,974 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:27:24,716 DEBUG - Will invoke JobStart for JobID [CREAM287459881]\n', 'https://cert-08.pd.infn.it:8443/CREAM287459881\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM287459881 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM287459881 2014-08-18 12:27:24.866314 Submit https://cert-08.pd.infn.it:8443/CREAM287459881 Left: 870 (at submission time:870) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM287459881 2014-08-18 12:27:26.401308 Exit https://cert-08.pd.infn.it:8443/CREAM432395263 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:27:26,945 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:27:26,968 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:27:26,968 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:27:26,969 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122726.log]\n', '2014-08-18 12:27:26,971 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:27:28,176 DEBUG - Will invoke JobStart for JobID [CREAM120150172]\n', 'https://cert-08.pd.infn.it:8443/CREAM120150172\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM120150172 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM120150172 2014-08-18 12:27:28.395569 Submit https://cert-08.pd.infn.it:8443/CREAM120150172 Left: 868 (at submission time:868) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM120150172 2014-08-18 12:28:27.063731 Exit https://cert-08.pd.infn.it:8443/CREAM599743223 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retvmission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM374692804 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM374692804 2014-08-18 12:25:28.399102 Submit https://cert-08.pd.infn.it:8443/CREAM374692804 Left: 875 (at submission time:875) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM374692804 2014-08-18 12:26:26.937857 Exit https://cert-08.pd.infn.it:8443/CREAM309475742 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:26:27,999 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:26:28,026 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:26:28,026 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:26:28,026 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122628.log]\n', '2014-08-18 12:26:28,029 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:26:28,763 DEBUG - Will invoke JobStart for JobID [CREAM323376457]\n', 'https://cert-08.pd.infn.it:8443/CREAM323376457\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM323376457 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM323376457 2014-08-18 12:26:28.948287 Submit https://cert-08.pd.infn.it:8443/CREAM323376457 Left: 871 (at submission time:871) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM323376457 2014-08-18 12:28:24.241161 Exit https://cert-08.pd.infn.it:8443/CREAM487755761 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:28:24,649 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:28:24,674 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:28:24,674 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:28:24,674 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122824.log]\n', '2014-08-18 12:28:24,682 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:28:25,373 DEBUG - Will invoke JobStart for JobID [CREAM558889333]\n', 'https://cert-08.pd.infn.it:8443/CREAM558889333\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM558889333 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM558889333 2014-08-18 12:28:25.706428 Submit https://cert-08.pd.infn.it:8443/CREAM558889333 Left: 866 (at submission time:866) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM558889333 2014-08-18 12:29:24.275703 Exit https://cert-08.pd.infn.it:8443/CREAM289405219 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retvmission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM467703548 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM467703548 2014-08-18 12:25:27.370490 Submit https://cert-08.pd.infn.it:8443/CREAM467703548 Left: 877 (at submission time:877) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM467703548 2014-08-18 12:26:23.428623 Exit https://cert-08.pd.infn.it:8443/CREAM319491077 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:26:23,772 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:26:23,796 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:26:23,796 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:26:23,796 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122623.log]\n', '2014-08-18 12:26:23,802 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:26:24,530 DEBUG - Will invoke JobStart for JobID [CREAM646165410]\n', 'https://cert-08.pd.infn.it:8443/CREAM646165410\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM646165410 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM646165410 2014-08-18 12:26:24.657568 Submit https://cert-08.pd.infn.it:8443/CREAM646165410 Left: 874 (at submission time:874) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM646165410 2014-08-18 12:28:27.706567 Exit https://cert-08.pd.infn.it:8443/CREAM171321503 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:28:28,555 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:28:28,589 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:28:28,589 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:28:28,589 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122828.log]\n', '2014-08-18 12:28:28,595 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:28:29,472 DEBUG - Will invoke JobStart for JobID [CREAM990651363]\n', 'https://cert-08.pd.infn.it:8443/CREAM990651363\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM990651363 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM990651363 2014-08-18 12:28:29.743891 Submit https://cert-08.pd.infn.it:8443/CREAM990651363 Left: 863 (at submission time:863) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM990651363 2014-08-18 12:29:27.542437 Exit https://cert-08.pd.infn.it:8443/CREAM388996805 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retvmission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM194706095 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM194706095 2014-08-18 12:24:29.700528 Submit https://cert-08.pd.infn.it:8443/CREAM194706095 Left: 879 (at submission time:879) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM194706095 2014-08-18 12:26:26.794076 Exit https://cert-08.pd.infn.it:8443/CREAM839269015 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:26:27,507 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:26:27,537 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:26:27,537 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:26:27,537 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122627.log]\n', '2014-08-18 12:26:27,547 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:26:28,376 DEBUG - Will invoke JobStart for JobID [CREAM578434873]\n', 'https://cert-08.pd.infn.it:8443/CREAM578434873\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM578434873 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM578434873 2014-08-18 12:26:28.700143 Submit https://cert-08.pd.infn.it:8443/CREAM578434873 Left: 872 (at submission time:872) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM578434873 2014-08-18 12:27:26.181226 Exit https://cert-08.pd.infn.it:8443/CREAM134897189 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:27:26,851 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:27:26,880 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:27:26,880 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:27:26,880 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122726.log]\n', '2014-08-18 12:27:26,884 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:27:27,806 DEBUG - Will invoke JobStart for JobID [CREAM457127255]\n', 'https://cert-08.pd.infn.it:8443/CREAM457127255\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM457127255 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM457127255 2014-08-18 12:27:28.201409 Submit https://cert-08.pd.infn.it:8443/CREAM457127255 Left: 869 (at submission time:869) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM457127255 2014-08-18 12:29:27.629560 Exit https://cert-08.pd.infn.it:8443/CREAM599804284 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retvnning: 18 Cancelled: 0 Done-Ok: 113 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 113/1000 2014-08-18 12:27:28.397405 Submitted: 132 Running: 19 Cancelled: 0 Done-Ok: 113 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 113/1000 2014-08-18 12:27:28.968657 Submitted: 133 Running: 20 Cancelled: 0 Done-Ok: 113 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 113/1000 2014-08-18 12:28:24.243532 Submitted: 133 Running: 19 Cancelled: 0 Done-Ok: 114 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 114/1000 2014-08-18 12:28:25.711080 Submitted: 134 Running: 20 Cancelled: 0 Done-Ok: 114 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 114/1000 2014-08-18 12:28:26.847204 Submitted: 134 Running: 19 Cancelled: 0 Done-Ok: 115 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 115/1000 2014-08-18 12:28:27.067161 Submitted: 134 Running: 18 Cancelled: 0 Done-Ok: 116 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 116/1000 2014-08-18 12:28:27.708679 Submitted: 134 Running: 17 Cancelled: 0 Done-Ok: 117 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 117/1000 2014-08-18 12:28:28.593033 Submitted: 135 Running: 18 Cancelled: 0 Done-Ok: 117 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 117/1000 2014-08-18 12:28:29.233196 Submitted: 136 Running: 19 Cancelled: 0 Done-Ok: 117 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 117/1000 2014-08-18 12:28:29.746480 Submitted: 137 Running: 20 Cancelled: 0 Done-Ok: 117 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 117/1000 2014-08-18 12:29:24.278174 Submitted: 137 Running: 19 Cancelled: 0 Done-Ok: 118 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 118/1000 2014-08-18 12:29:25.720185 Submitted: 138 Running: 20 Cancelled: 0 Done-Ok: 118 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 118/1000 2014-08-18 12:29:27.548496 Submitted: 138 Running: 19 Cancelled: 0 Done-Ok: 119 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 119/1000 2014-08-18 12:29:27.631787 Submitted: 138 Running: 18 Cancelled: 0 Done-Ok: 120 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 120/1000 2014-08-18 12:29:29.418982 Submitted: 139 Running: 19 Cancelled: 0 Done-Ok: 120 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 120/1000 2014-08-18 12:29:30.168681 Submitted: 140 Running: 20 Cancelled: 0 Done-Ok: 120 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 120/1000 2014-08-18 12:29:30.404158 Submitted: 140 Running: 19 Cancelled: 0 Done-Ok: 121 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 121/1000 2014-08-18 12:29:32.342605 Submitted: 141 Running: 20 Cancelled: 0 Done-Ok: 121 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 121/1000 2014-08-18 12:30:24.677635 Submitted: 141 Running: 19 Cancelled: 0 Done-Ok: 122 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 122/1000 2014-08-18 12:30:26.243171 Submitted: 14al :0 JOB SUBMISSION output: ['2014-08-18 12:29:28,170 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:29:28,193 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:29:28,193 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:29:28,193 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122928.log]\n', '2014-08-18 12:29:28,196 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:29:29,196 DEBUG - Will invoke JobStart for JobID [CREAM127633804]\n', 'https://cert-08.pd.infn.it:8443/CREAM127633804\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM127633804 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM127633804 2014-08-18 12:29:29.416080 Submit https://cert-08.pd.infn.it:8443/CREAM127633804 Left: 861 (at submission time:861) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM127633804 2014-08-18 12:30:28.002894 Exit https://cert-08.pd.infn.it:8443/CREAM467703548 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:30:28,762 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:30:28,782 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:30:28,782 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:30:28,782 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123028.log]\n', '2014-08-18 12:30:28,785 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:30:29,779 DEBUG - Will invoke JobStart for JobID [CREAM873594801]\n', 'https://cert-08.pd.infn.it:8443/CREAM873594801\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM873594801 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM873594801 2014-08-18 12:30:30.196989 Submit https://cert-08.pd.infn.it:8443/CREAM873594801 Left: 857 (at submission time:857) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM873594801 2014-08-18 12:31:25.555035 Exit https://cert-08.pd.infn.it:8443/CREAM646165410 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:31:25,890 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:31:25,915 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:31:25,915 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:31:25,916 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123125.log]\n', '2014-08-18 12:31:25,925 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868al :0 JOB SUBMISSION output: ['2014-08-18 12:28:27,492 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:28:27,522 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:28:27,522 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:28:27,522 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122827.log]\n', '2014-08-18 12:28:27,525 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:28:28,454 DEBUG - Will invoke JobStart for JobID [CREAM329111111]\n', 'https://cert-08.pd.infn.it:8443/CREAM329111111\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM329111111 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM329111111 2014-08-18 12:28:28.590146 Submit https://cert-08.pd.infn.it:8443/CREAM329111111 Left: 865 (at submission time:865) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM329111111 2014-08-18 12:30:28.532166 Exit https://cert-08.pd.infn.it:8443/CREAM910670561 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:30:29,328 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:30:29,351 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:30:29,351 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:30:29,351 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123029.log]\n', '2014-08-18 12:30:29,354 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:30:30,178 DEBUG - Will invoke JobStart for JobID [CREAM740519185]\n', 'https://cert-08.pd.infn.it:8443/CREAM740519185\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM740519185 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM740519185 2014-08-18 12:30:30.501591 Submit https://cert-08.pd.infn.it:8443/CREAM740519185 Left: 856 (at submission time:856) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM740519185 2014-08-18 12:31:28.181682 Exit https://cert-08.pd.infn.it:8443/CREAM213197161 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:31:28,734 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:31:28,757 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:31:28,757 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:31:28,758 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123128.log]\n', '2014-08-18 12:31:28,761 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868al :0 JOB SUBMISSION output: ['2014-08-18 12:29:28,565 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:29:28,589 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:29:28,590 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:29:28,590 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122928.log]\n', '2014-08-18 12:29:28,599 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:29:29,712 DEBUG - Will invoke JobStart for JobID [CREAM747320408]\n', 'https://cert-08.pd.infn.it:8443/CREAM747320408\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM747320408 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM747320408 2014-08-18 12:29:30.165270 Submit https://cert-08.pd.infn.it:8443/CREAM747320408 Left: 860 (at submission time:860) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM747320408 2014-08-18 12:29:30.399836 Exit https://cert-08.pd.infn.it:8443/CREAM194706095 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:29:31,015 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:29:31,040 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:29:31,040 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:29:31,040 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122931.log]\n', '2014-08-18 12:29:31,046 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:29:32,138 DEBUG - Will invoke JobStart for JobID [CREAM114444827]\n', 'https://cert-08.pd.infn.it:8443/CREAM114444827\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM114444827 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM114444827 2014-08-18 12:29:32.339463 Submit https://cert-08.pd.infn.it:8443/CREAM114444827 Left: 859 (at submission time:859) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM114444827 2014-08-18 12:31:28.326148 Exit https://cert-08.pd.infn.it:8443/CREAM578434873 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:31:28,913 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:31:28,933 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:31:28,933 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:31:28,933 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123128.log]\n', '2014-08-18 12:31:28,936 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868al :0 JOB SUBMISSION output: ['2014-08-18 12:29:24,655 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:29:24,683 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:29:24,683 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:29:24,683 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122924.log]\n', '2014-08-18 12:29:24,695 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:29:25,450 DEBUG - Will invoke JobStart for JobID [CREAM148421817]\n', 'https://cert-08.pd.infn.it:8443/CREAM148421817\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM148421817 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM148421817 2014-08-18 12:29:25.717488 Submit https://cert-08.pd.infn.it:8443/CREAM148421817 Left: 862 (at submission time:862) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM148421817 2014-08-18 12:30:28.599473 Exit https://cert-08.pd.infn.it:8443/CREAM374692804 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:30:29,380 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:30:29,403 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:30:29,403 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:30:29,403 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123029.log]\n', '2014-08-18 12:30:29,407 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:30:30,646 DEBUG - Will invoke JobStart for JobID [CREAM740482274]\n', 'https://cert-08.pd.infn.it:8443/CREAM740482274\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM740482274 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM740482274 2014-08-18 12:30:30.856225 Submit https://cert-08.pd.infn.it:8443/CREAM740482274 Left: 855 (at submission time:855) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM740482274 2014-08-18 12:31:29.699813 Exit https://cert-08.pd.infn.it:8443/CREAM323376457 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:31:30,409 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:31:30,433 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:31:30,433 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:31:30,433 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123130.log]\n', '2014-08-18 12:31:30,436 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868al :0 JOB SUBMISSION output: ['2014-08-18 12:28:27,671 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:28:27,697 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:28:27,697 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:28:27,697 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-122827.log]\n', '2014-08-18 12:28:27,700 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:28:28,772 DEBUG - Will invoke JobStart for JobID [CREAM308622445]\n', 'https://cert-08.pd.infn.it:8443/CREAM308622445\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM308622445 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM308622445 2014-08-18 12:28:29.231640 Submit https://cert-08.pd.infn.it:8443/CREAM308622445 Left: 864 (at submission time:864) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM308622445 2014-08-18 12:30:24.674595 Exit https://cert-08.pd.infn.it:8443/CREAM708748408 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:30:25,081 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:30:25,120 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:30:25,120 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:30:25,120 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123025.log]\n', '2014-08-18 12:30:25,136 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:30:25,837 DEBUG - Will invoke JobStart for JobID [CREAM111693721]\n', 'https://cert-08.pd.infn.it:8443/CREAM111693721\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM111693721 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM111693721 2014-08-18 12:30:26.239957 Submit https://cert-08.pd.infn.it:8443/CREAM111693721 Left: 858 (at submission time:858) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM111693721 2014-08-18 12:32:25.529335 Exit https://cert-08.pd.infn.it:8443/CREAM287459881 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:32:25,927 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:32:25,950 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:32:25,950 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:32:25,950 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123225.log]\n', '2014-08-18 12:32:25,955 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-14083558682 Running: 20 Cancelled: 0 Done-Ok: 122 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 122/1000 2014-08-18 12:30:28.004921 Submitted: 142 Running: 19 Cancelled: 0 Done-Ok: 123 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 123/1000 2014-08-18 12:30:28.534244 Submitted: 142 Running: 18 Cancelled: 0 Done-Ok: 124 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 124/1000 2014-08-18 12:30:28.601675 Submitted: 142 Running: 17 Cancelled: 0 Done-Ok: 125 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 125/1000 2014-08-18 12:30:30.199001 Submitted: 143 Running: 18 Cancelled: 0 Done-Ok: 125 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 125/1000 2014-08-18 12:30:30.502832 Submitted: 144 Running: 19 Cancelled: 0 Done-Ok: 125 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 125/1000 2014-08-18 12:30:30.858697 Submitted: 145 Running: 20 Cancelled: 0 Done-Ok: 125 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 125/1000 2014-08-18 12:31:25.556681 Submitted: 145 Running: 19 Cancelled: 0 Done-Ok: 126 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 126/1000 2014-08-18 12:31:26.933947 Submitted: 146 Running: 20 Cancelled: 0 Done-Ok: 126 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 126/1000 2014-08-18 12:31:28.185328 Submitted: 146 Running: 19 Cancelled: 0 Done-Ok: 127 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 127/1000 2014-08-18 12:31:28.327252 Submitted: 146 Running: 18 Cancelled: 0 Done-Ok: 128 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 128/1000 2014-08-18 12:31:29.702774 Submitted: 146 Running: 17 Cancelled: 0 Done-Ok: 129 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 129/1000 2014-08-18 12:31:29.979701 Submitted: 147 Running: 18 Cancelled: 0 Done-Ok: 129 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 129/1000 2014-08-18 12:31:30.235351 Submitted: 148 Running: 19 Cancelled: 0 Done-Ok: 129 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 129/1000 2014-08-18 12:31:31.497365 Submitted: 149 Running: 20 Cancelled: 0 Done-Ok: 129 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 129/1000 2014-08-18 12:32:25.536455 Submitted: 149 Running: 19 Cancelled: 0 Done-Ok: 130 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 130/1000 2014-08-18 12:32:26.941212 Submitted: 150 Running: 20 Cancelled: 0 Done-Ok: 130 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 130/1000 2014-08-18 12:32:28.764003 Submitted: 150 Running: 19 Cancelled: 0 Done-Ok: 131 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 131/1000 2014-08-18 12:32:29.007204 Submitted: 150 Running: 18 Cancelled: 0 Done-Ok: 132 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 132/1000 2014-08-18 12:32:30.109770 Submitted: 150 Running: 17 Cancelled: 0 Done-Ok: 133 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 133/1000 2014-08-18 12:32:30.730355 Submitted.51-sleep.jdl]\n', '2014-08-18 12:31:29,931 DEBUG - Will invoke JobStart for JobID [CREAM019732758]\n', 'https://cert-08.pd.infn.it:8443/CREAM019732758\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM019732758 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM019732758 2014-08-18 12:31:30.234030 Submit https://cert-08.pd.infn.it:8443/CREAM019732758 Left: 852 (at submission time:852) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM019732758 2014-08-18 12:32:28.762417 Exit https://cert-08.pd.infn.it:8443/CREAM457127255 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:32:29,497 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:32:29,527 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:32:29,528 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:32:29,528 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123229.log]\n', '2014-08-18 12:32:29,536 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:32:30,405 DEBUG - Will invoke JobStart for JobID [CREAM472912477]\n', 'https://cert-08.pd.infn.it:8443/CREAM472912477\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM472912477 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM472912477 2014-08-18 12:32:30.726003 Submit https://cert-08.pd.infn.it:8443/CREAM472912477 Left: 849 (at submission time:849) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM472912477 2014-08-18 12:34:30.159464 Exit https://cert-08.pd.infn.it:8443/CREAM747320408 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:34:30,835 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:34:30,861 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:34:30,861 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:34:30,862 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123430.log]\n', '2014-08-18 12:34:30,865 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:34:31,819 DEBUG - Will invoke JobStart for JobID [CREAM941157085]\n', 'https://cert-08.pd.infn.it:8443/CREAM941157085\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM941157085 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM941157085 2014-08-18 12:34:32.146344 Submit https://cert-08.pd.infn.it:8443/CREAM941157085 Left: 840 (at submission time:840) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM941157085 2014-08-18 12:34:32.375314 Exit https://cert-08.pd.infn.it:8443/CREAM114444827 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /u.51-sleep.jdl]\n', '2014-08-18 12:32:26,678 DEBUG - Will invoke JobStart for JobID [CREAM553415220]\n', 'https://cert-08.pd.infn.it:8443/CREAM553415220\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM553415220 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM553415220 2014-08-18 12:32:26.937918 Submit https://cert-08.pd.infn.it:8443/CREAM553415220 Left: 850 (at submission time:850) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM553415220 2014-08-18 12:32:30.106163 Exit https://cert-08.pd.infn.it:8443/CREAM120150172 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:32:30,937 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:32:30,969 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:32:30,969 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:32:30,969 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123230.log]\n', '2014-08-18 12:32:30,972 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:32:31,959 DEBUG - Will invoke JobStart for JobID [CREAM547943078]\n', 'https://cert-08.pd.infn.it:8443/CREAM547943078\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM547943078 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM547943078 2014-08-18 12:32:32.123834 Submit https://cert-08.pd.infn.it:8443/CREAM547943078 Left: 847 (at submission time:847) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM547943078 2014-08-18 12:33:30.873589 Exit https://cert-08.pd.infn.it:8443/CREAM308622445 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:33:31,707 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:33:31,730 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:33:31,730 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:33:31,730 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123331.log]\n', '2014-08-18 12:33:31,733 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:33:32,717 DEBUG - Will invoke JobStart for JobID [CREAM662531707]\n', 'https://cert-08.pd.infn.it:8443/CREAM662531707\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM662531707 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM662531707 2014-08-18 12:33:32.939390 Submit https://cert-08.pd.infn.it:8443/CREAM662531707 Left: 844 (at submission time:844) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM662531707 2014-08-18 12:35:26.917560 Exit https://cert-08.pd.infn.it:8443/CREAM111693721 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /u: 151 Running: 18 Cancelled: 0 Done-Ok: 133 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 133/1000 2014-08-18 12:32:31.182480 Submitted: 152 Running: 19 Cancelled: 0 Done-Ok: 133 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 133/1000 2014-08-18 12:32:32.127032 Submitted: 153 Running: 20 Cancelled: 0 Done-Ok: 133 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 133/1000 2014-08-18 12:33:26.417056 Submitted: 153 Running: 19 Cancelled: 0 Done-Ok: 134 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 134/1000 2014-08-18 12:33:27.739489 Submitted: 154 Running: 20 Cancelled: 0 Done-Ok: 134 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 134/1000 2014-08-18 12:33:29.798030 Submitted: 154 Running: 19 Cancelled: 0 Done-Ok: 135 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 135/1000 2014-08-18 12:33:30.877136 Submitted: 154 Running: 18 Cancelled: 0 Done-Ok: 136 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 136/1000 2014-08-18 12:33:31.214248 Submitted: 154 Running: 17 Cancelled: 0 Done-Ok: 137 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 137/1000 2014-08-18 12:33:31.947919 Submitted: 155 Running: 18 Cancelled: 0 Done-Ok: 137 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 137/1000 2014-08-18 12:33:32.942768 Submitted: 156 Running: 19 Cancelled: 0 Done-Ok: 137 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 137/1000 2014-08-18 12:33:33.186826 Submitted: 157 Running: 20 Cancelled: 0 Done-Ok: 137 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 137/1000 2014-08-18 12:34:26.828962 Submitted: 157 Running: 19 Cancelled: 0 Done-Ok: 138 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 138/1000 2014-08-18 12:34:28.424797 Submitted: 158 Running: 20 Cancelled: 0 Done-Ok: 138 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 138/1000 2014-08-18 12:34:29.882658 Submitted: 158 Running: 19 Cancelled: 0 Done-Ok: 139 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 139/1000 2014-08-18 12:34:30.162770 Submitted: 158 Running: 18 Cancelled: 0 Done-Ok: 140 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 140/1000 2014-08-18 12:34:32.003378 Submitted: 159 Running: 19 Cancelled: 0 Done-Ok: 140 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 140/1000 2014-08-18 12:34:32.147586 Submitted: 160 Running: 20 Cancelled: 0 Done-Ok: 140 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 140/1000 2014-08-18 12:34:32.379877 Submitted: 160 Running: 19 Cancelled: 0 Done-Ok: 141 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 141/1000 2014-08-18 12:34:34.288230 Submitted: 161 Running: 20 Cancelled: 0 Done-Ok: 141 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 141/1000 2014-08-18 12:35:26.919971 Submitted: 161 Running: 19 Cancelled: 0 Done-Ok: 142 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 142/1000 2014-08-18 12:35:28.409201 Submi.51-sleep.jdl]\n', '2014-08-18 12:31:29,730 DEBUG - Will invoke JobStart for JobID [CREAM427541391]\n', 'https://cert-08.pd.infn.it:8443/CREAM427541391\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM427541391 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM427541391 2014-08-18 12:31:29.976069 Submit https://cert-08.pd.infn.it:8443/CREAM427541391 Left: 853 (at submission time:853) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM427541391 2014-08-18 12:32:29.005705 Exit https://cert-08.pd.infn.it:8443/CREAM748903873 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:32:29,699 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:32:29,725 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:32:29,725 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:32:29,725 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123229.log]\n', '2014-08-18 12:32:29,733 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:32:30,729 DEBUG - Will invoke JobStart for JobID [CREAM932308044]\n', 'https://cert-08.pd.infn.it:8443/CREAM932308044\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM932308044 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM932308044 2014-08-18 12:32:31.180900 Submit https://cert-08.pd.infn.it:8443/CREAM932308044 Left: 848 (at submission time:848) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM932308044 2014-08-18 12:33:31.212236 Exit https://cert-08.pd.infn.it:8443/CREAM329111111 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:33:31,771 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:33:31,794 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:33:31,794 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:33:31,794 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123331.log]\n', '2014-08-18 12:33:31,797 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:33:32,803 DEBUG - Will invoke JobStart for JobID [CREAM685703071]\n', 'https://cert-08.pd.infn.it:8443/CREAM685703071\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM685703071 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM685703071 2014-08-18 12:33:33.185144 Submit https://cert-08.pd.infn.it:8443/CREAM685703071 Left: 843 (at submission time:843) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM685703071 2014-08-18 12:35:30.228589 Exit https://cert-08.pd.infn.it:8443/CREAM740519185 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /u.51-sleep.jdl]\n', '2014-08-18 12:31:26,679 DEBUG - Will invoke JobStart for JobID [CREAM694190950]\n', 'https://cert-08.pd.infn.it:8443/CREAM694190950\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM694190950 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM694190950 2014-08-18 12:31:26.932242 Submit https://cert-08.pd.infn.it:8443/CREAM694190950 Left: 854 (at submission time:854) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM694190950 2014-08-18 12:33:29.796622 Exit https://cert-08.pd.infn.it:8443/CREAM990651363 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:33:30,689 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:33:30,713 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:33:30,713 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:33:30,713 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123330.log]\n', '2014-08-18 12:33:30,731 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:33:31,529 DEBUG - Will invoke JobStart for JobID [CREAM316056821]\n', 'https://cert-08.pd.infn.it:8443/CREAM316056821\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM316056821 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM316056821 2014-08-18 12:33:31.946476 Submit https://cert-08.pd.infn.it:8443/CREAM316056821 Left: 845 (at submission time:845) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM316056821 2014-08-18 12:34:29.879753 Exit https://cert-08.pd.infn.it:8443/CREAM127633804 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:34:30,717 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:34:30,737 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:34:30,737 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:34:30,737 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123430.log]\n', '2014-08-18 12:34:30,741 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:34:31,763 DEBUG - Will invoke JobStart for JobID [CREAM605773944]\n', 'https://cert-08.pd.infn.it:8443/CREAM605773944\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM605773944 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM605773944 2014-08-18 12:34:32.001570 Submit https://cert-08.pd.infn.it:8443/CREAM605773944 Left: 841 (at submission time:841) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM605773944 2014-08-18 12:35:30.756370 Exit https://cert-08.pd.infn.it:8443/CREAM873594801 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /u.51-sleep.jdl]\n', '2014-08-18 12:31:31,239 DEBUG - Will invoke JobStart for JobID [CREAM654173108]\n', 'https://cert-08.pd.infn.it:8443/CREAM654173108\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM654173108 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM654173108 2014-08-18 12:31:31.494120 Submit https://cert-08.pd.infn.it:8443/CREAM654173108 Left: 851 (at submission time:851) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM654173108 2014-08-18 12:33:26.415017 Exit https://cert-08.pd.infn.it:8443/CREAM558889333 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:33:26,752 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:33:26,770 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:33:26,770 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:33:26,770 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123326.log]\n', '2014-08-18 12:33:26,773 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:33:27,545 DEBUG - Will invoke JobStart for JobID [CREAM755589544]\n', 'https://cert-08.pd.infn.it:8443/CREAM755589544\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM755589544 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM755589544 2014-08-18 12:33:27.738135 Submit https://cert-08.pd.infn.it:8443/CREAM755589544 Left: 846 (at submission time:846) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM755589544 2014-08-18 12:34:26.825965 Exit https://cert-08.pd.infn.it:8443/CREAM148421817 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:34:27,159 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:34:27,208 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:34:27,208 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:34:27,208 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123427.log]\n', '2014-08-18 12:34:27,215 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:34:28,169 DEBUG - Will invoke JobStart for JobID [CREAM596155706]\n', 'https://cert-08.pd.infn.it:8443/CREAM596155706\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM596155706 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM596155706 2014-08-18 12:34:28.423024 Submit https://cert-08.pd.infn.it:8443/CREAM596155706 Left: 842 (at submission time:842) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM596155706 2014-08-18 12:35:30.969866 Exit https://cert-08.pd.infn.it:8443/CREAM740482274 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:35:27,386 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:35:27,405 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:35:27,405 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:35:27,405 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123527.log]\n', '2014-08-18 12:35:27,408 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:35:28,186 DEBUG - Will invoke JobStart for JobID [CREAM267569045]\n', 'https://cert-08.pd.infn.it:8443/CREAM267569045\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM267569045 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM267569045 2014-08-18 12:35:28.405267 Submit https://cert-08.pd.infn.it:8443/CREAM267569045 Left: 838 (at submission time:838) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM267569045 2014-08-18 12:37:28.232687 Exit https://cert-08.pd.infn.it:8443/CREAM553415220 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:37:28,589 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:37:28,617 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:37:28,618 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:37:28,618 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123728.log]\n', '2014-08-18 12:37:28,627 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:37:29,401 DEBUG - Will invoke JobStart for JobID [CREAM861756125]\n', 'https://cert-08.pd.infn.it:8443/CREAM861756125\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM861756125 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM861756125 2014-08-18 12:37:29.597127 Submit https://cert-08.pd.infn.it:8443/CREAM861756125 Left: 830 (at submission time:830) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM861756125 2014-08-18 12:37:31.082755 Exit https://cert-08.pd.infn.it:8443/CREAM547943078 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:37:31,643 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:37:31,666 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:37:31,666 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:37:31,666 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123731.log]\n', '2014-08-18 12:37:31,669 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = tted: 162 Running: 20 Cancelled: 0 Done-Ok: 142 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 142/1000 2014-08-18 12:35:30.231581 Submitted: 162 Running: 19 Cancelled: 0 Done-Ok: 143 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 143/1000 2014-08-18 12:35:30.758760 Submitted: 162 Running: 18 Cancelled: 0 Done-Ok: 144 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 144/1000 2014-08-18 12:35:30.973295 Submitted: 162 Running: 17 Cancelled: 0 Done-Ok: 145 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 145/1000 2014-08-18 12:35:32.665841 Submitted: 163 Running: 18 Cancelled: 0 Done-Ok: 145 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 145/1000 2014-08-18 12:35:32.764669 Submitted: 164 Running: 19 Cancelled: 0 Done-Ok: 145 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 145/1000 2014-08-18 12:35:33.406069 Submitted: 165 Running: 20 Cancelled: 0 Done-Ok: 145 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 145/1000 2014-08-18 12:36:27.878663 Submitted: 165 Running: 19 Cancelled: 0 Done-Ok: 146 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 146/1000 2014-08-18 12:36:29.374459 Submitted: 166 Running: 20 Cancelled: 0 Done-Ok: 146 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 146/1000 2014-08-18 12:36:29.880934 Submitted: 166 Running: 19 Cancelled: 0 Done-Ok: 147 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 147/1000 2014-08-18 12:36:31.392030 Submitted: 166 Running: 18 Cancelled: 0 Done-Ok: 148 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 148/1000 2014-08-18 12:36:31.539896 Submitted: 166 Running: 17 Cancelled: 0 Done-Ok: 149 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 149/1000 2014-08-18 12:36:31.698025 Submitted: 167 Running: 18 Cancelled: 0 Done-Ok: 149 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 149/1000 2014-08-18 12:36:33.547756 Submitted: 168 Running: 19 Cancelled: 0 Done-Ok: 149 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 149/1000 2014-08-18 12:36:33.709350 Submitted: 169 Running: 20 Cancelled: 0 Done-Ok: 149 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 149/1000 2014-08-18 12:37:28.234893 Submitted: 169 Running: 19 Cancelled: 0 Done-Ok: 150 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 150/1000 2014-08-18 12:37:29.598819 Submitted: 170 Running: 20 Cancelled: 0 Done-Ok: 150 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 150/1000 2014-08-18 12:37:31.085400 Submitted: 170 Running: 19 Cancelled: 0 Done-Ok: 151 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 151/1000 2014-08-18 12:37:31.590282 Submitted: 170 Running: 18 Cancelled: 0 Done-Ok: 152 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 152/1000 2014-08-18 12:37:31.847224 Submitted: 170 Running: 17 Cancelled: 0 Done-Ok: 153 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 153/1000 2014-08-18 12:37:33.361535 Ssr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:34:32,986 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:34:33,010 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:34:33,011 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:34:33,011 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123433.log]\n', '2014-08-18 12:34:33,019 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:34:33,870 DEBUG - Will invoke JobStart for JobID [CREAM569272322]\n', 'https://cert-08.pd.infn.it:8443/CREAM569272322\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM569272322 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM569272322 2014-08-18 12:34:34.285032 Submit https://cert-08.pd.infn.it:8443/CREAM569272322 Left: 839 (at submission time:839) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM569272322 2014-08-18 12:36:31.538367 Exit https://cert-08.pd.infn.it:8443/CREAM019732758 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:36:32,189 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:36:32,212 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:36:32,212 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:36:32,212 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123632.log]\n', '2014-08-18 12:36:32,215 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:36:33,263 DEBUG - Will invoke JobStart for JobID [CREAM447820806]\n', 'https://cert-08.pd.infn.it:8443/CREAM447820806\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM447820806 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM447820806 2014-08-18 12:36:33.546469 Submit https://cert-08.pd.infn.it:8443/CREAM447820806 Left: 831 (at submission time:831) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM447820806 2014-08-18 12:37:31.588167 Exit https://cert-08.pd.infn.it:8443/CREAM472912477 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:37:32,375 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:37:32,405 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:37:32,405 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:37:32,406 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123732.log]\n', '2014-08-18 12:37:32,409 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = sr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:35:31,072 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:35:31,095 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:35:31,095 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:35:31,095 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123531.log]\n', '2014-08-18 12:35:31,098 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:35:32,271 DEBUG - Will invoke JobStart for JobID [CREAM401468947]\n', 'https://cert-08.pd.infn.it:8443/CREAM401468947\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM401468947 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM401468947 2014-08-18 12:35:32.762843 Submit https://cert-08.pd.infn.it:8443/CREAM401468947 Left: 837 (at submission time:837) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM401468947 2014-08-18 12:36:29.878171 Exit https://cert-08.pd.infn.it:8443/CREAM427541391 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:36:30,446 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:36:30,474 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:36:30,474 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:36:30,474 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123630.log]\n', '2014-08-18 12:36:30,484 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:36:31,471 DEBUG - Will invoke JobStart for JobID [CREAM223416755]\n', 'https://cert-08.pd.infn.it:8443/CREAM223416755\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM223416755 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM223416755 2014-08-18 12:36:31.696283 Submit https://cert-08.pd.infn.it:8443/CREAM223416755 Left: 833 (at submission time:833) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM223416755 2014-08-18 12:37:31.844204 Exit https://cert-08.pd.infn.it:8443/CREAM932308044 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:37:32,638 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:37:32,671 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:37:32,671 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:37:32,671 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123732.log]\n', '2014-08-18 12:37:32,674 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = sr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:35:32,084 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:35:32,116 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:35:32,117 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:35:32,117 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123532.log]\n', '2014-08-18 12:35:32,127 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:35:33,161 DEBUG - Will invoke JobStart for JobID [CREAM733602392]\n', 'https://cert-08.pd.infn.it:8443/CREAM733602392\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM733602392 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM733602392 2014-08-18 12:35:33.403342 Submit https://cert-08.pd.infn.it:8443/CREAM733602392 Left: 835 (at submission time:835) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM733602392 2014-08-18 12:36:31.390184 Exit https://cert-08.pd.infn.it:8443/CREAM654173108 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:36:32,120 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:36:32,143 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:36:32,143 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:36:32,143 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123632.log]\n', '2014-08-18 12:36:32,146 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:36:33,395 DEBUG - Will invoke JobStart for JobID [CREAM654091561]\n', 'https://cert-08.pd.infn.it:8443/CREAM654091561\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM654091561 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM654091561 2014-08-18 12:36:33.707004 Submit https://cert-08.pd.infn.it:8443/CREAM654091561 Left: 832 (at submission time:832) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM654091561 2014-08-18 12:38:28.559666 Exit https://cert-08.pd.infn.it:8443/CREAM755589544 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:38:28,881 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:38:28,901 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:38:28,901 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:38:28,901 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123828.log]\n', '2014-08-18 12:38:28,919 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = sr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:35:31,384 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:35:31,404 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:35:31,404 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:35:31,404 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123531.log]\n', '2014-08-18 12:35:31,408 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:35:32,344 DEBUG - Will invoke JobStart for JobID [CREAM912695966]\n', 'https://cert-08.pd.infn.it:8443/CREAM912695966\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM912695966 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM912695966 2014-08-18 12:35:32.662600 Submit https://cert-08.pd.infn.it:8443/CREAM912695966 Left: 836 (at submission time:836) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM912695966 2014-08-18 12:36:27.877479 Exit https://cert-08.pd.infn.it:8443/CREAM694190950 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:36:28,219 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:36:28,244 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:36:28,244 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:36:28,244 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123628.log]\n', '2014-08-18 12:36:28,253 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:36:29,167 DEBUG - Will invoke JobStart for JobID [CREAM764724310]\n', 'https://cert-08.pd.infn.it:8443/CREAM764724310\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM764724310 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM764724310 2014-08-18 12:36:29.371406 Submit https://cert-08.pd.infn.it:8443/CREAM764724310 Left: 834 (at submission time:834) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM764724310 2014-08-18 12:38:32.407698 Exit https://cert-08.pd.infn.it:8443/CREAM316056821 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:38:32,932 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:38:32,959 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:38:32,959 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:38:32,959 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123832.log]\n', '2014-08-18 12:38:32,964 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = ubmitted: 171 Running: 18 Cancelled: 0 Done-Ok: 153 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 153/1000 2014-08-18 12:37:33.750311 Submitted: 172 Running: 19 Cancelled: 0 Done-Ok: 153 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 153/1000 2014-08-18 12:37:33.897289 Submitted: 173 Running: 20 Cancelled: 0 Done-Ok: 153 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 153/1000 2014-08-18 12:38:28.561113 Submitted: 173 Running: 19 Cancelled: 0 Done-Ok: 154 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 154/1000 2014-08-18 12:38:29.799812 Submitted: 174 Running: 20 Cancelled: 0 Done-Ok: 154 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 154/1000 2014-08-18 12:38:32.140670 Submitted: 174 Running: 19 Cancelled: 0 Done-Ok: 155 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 155/1000 2014-08-18 12:38:32.409745 Submitted: 174 Running: 18 Cancelled: 0 Done-Ok: 156 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 156/1000 2014-08-18 12:38:32.670134 Submitted: 174 Running: 17 Cancelled: 0 Done-Ok: 157 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 157/1000 2014-08-18 12:38:34.109218 Submitted: 175 Running: 18 Cancelled: 0 Done-Ok: 157 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 157/1000 2014-08-18 12:38:34.351453 Submitted: 176 Running: 19 Cancelled: 0 Done-Ok: 157 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 157/1000 2014-08-18 12:38:34.698469 Submitted: 177 Running: 20 Cancelled: 0 Done-Ok: 157 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 157/1000 2014-08-18 12:39:28.978280 Submitted: 177 Running: 19 Cancelled: 0 Done-Ok: 158 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 158/1000 2014-08-18 12:39:30.908711 Submitted: 178 Running: 20 Cancelled: 0 Done-Ok: 158 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 158/1000 2014-08-18 12:39:31.218210 Submitted: 178 Running: 19 Cancelled: 0 Done-Ok: 159 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 159/1000 2014-08-18 12:39:32.857073 Submitted: 178 Running: 18 Cancelled: 0 Done-Ok: 160 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 160/1000 2014-08-18 12:39:33.231844 Submitted: 179 Running: 19 Cancelled: 0 Done-Ok: 160 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 160/1000 2014-08-18 12:39:34.818470 Submitted: 180 Running: 20 Cancelled: 0 Done-Ok: 160 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 160/1000 2014-08-18 12:39:35.107152 Submitted: 180 Running: 19 Cancelled: 0 Done-Ok: 161 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 161/1000 2014-08-18 12:39:36.774130 Submitted: 181 Running: 20 Cancelled: 0 Done-Ok: 161 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 161/1000 2014-08-18 12:40:29.764615 Submitted: 181 Running: 19 Cancelled: 0 Done-Ok: 162 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 162/1000 2014-08-18 12:40:31.1200"creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:38:34,078 DEBUG - Will invoke JobStart for JobID [CREAM292446384]\n', 'https://cert-08.pd.infn.it:8443/CREAM292446384\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM292446384 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM292446384 2014-08-18 12:38:34.348975 Submit https://cert-08.pd.infn.it:8443/CREAM292446384 Left: 824 (at submission time:824) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM292446384 2014-08-18 12:39:31.215232 Exit https://cert-08.pd.infn.it:8443/CREAM605773944 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:39:31,861 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:39:31,885 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:39:31,885 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:39:31,885 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123931.log]\n', '2014-08-18 12:39:31,888 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:39:32,862 DEBUG - Will invoke JobStart for JobID [CREAM052391539]\n', 'https://cert-08.pd.infn.it:8443/CREAM052391539\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM052391539 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM052391539 2014-08-18 12:39:33.229763 Submit https://cert-08.pd.infn.it:8443/CREAM052391539 Left: 821 (at submission time:821) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM052391539 2014-08-18 12:40:33.207891 Exit https://cert-08.pd.infn.it:8443/CREAM912695966 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:40:33,979 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:40:34,004 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:40:34,004 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:40:34,004 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124034.log]\n', '2014-08-18 12:40:34,007 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:40:35,279 DEBUG - Will invoke JobStart for JobID [CREAM152064294]\n', 'https://cert-08.pd.infn.it:8443/CREAM152064294\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM152064294 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM152064294 2014-08-18 12:40:35.594006 Submit https://cert-08.pd.infn.it:8443/CREAM152064294 Left: 815 (at submission time:815) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM152064294 2014-08-18 12:41:3"creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:37:33,653 DEBUG - Will invoke JobStart for JobID [CREAM667134125]\n', 'https://cert-08.pd.infn.it:8443/CREAM667134125\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM667134125 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM667134125 2014-08-18 12:37:33.895346 Submit https://cert-08.pd.infn.it:8443/CREAM667134125 Left: 827 (at submission time:827) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM667134125 2014-08-18 12:38:32.135482 Exit https://cert-08.pd.infn.it:8443/CREAM685703071 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:38:32,819 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:38:32,844 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:38:32,844 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:38:32,844 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123832.log]\n', '2014-08-18 12:38:32,849 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:38:33,712 DEBUG - Will invoke JobStart for JobID [CREAM326498528]\n', 'https://cert-08.pd.infn.it:8443/CREAM326498528\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM326498528 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM326498528 2014-08-18 12:38:34.107659 Submit https://cert-08.pd.infn.it:8443/CREAM326498528 Left: 825 (at submission time:825) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM326498528 2014-08-18 12:40:33.008731 Exit https://cert-08.pd.infn.it:8443/CREAM401468947 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:40:33,710 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:40:33,734 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:40:33,734 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:40:33,734 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124033.log]\n', '2014-08-18 12:40:33,742 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:40:34,878 DEBUG - Will invoke JobStart for JobID [CREAM133295397]\n', 'https://cert-08.pd.infn.it:8443/CREAM133295397\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM133295397 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM133295397 2014-08-18 12:40:35.290411 Submit https://cert-08.pd.infn.it:8443/CREAM133295397 Left: 817 (at submission time:817) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM133295397 2014-08-18 12:41:3"creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:38:29,609 DEBUG - Will invoke JobStart for JobID [CREAM460509421]\n', 'https://cert-08.pd.infn.it:8443/CREAM460509421\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM460509421 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM460509421 2014-08-18 12:38:29.799016 Submit https://cert-08.pd.infn.it:8443/CREAM460509421 Left: 826 (at submission time:826) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM460509421 2014-08-18 12:39:28.976818 Exit https://cert-08.pd.infn.it:8443/CREAM596155706 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:39:29,720 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:39:29,747 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:39:29,747 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:39:29,747 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123929.log]\n', '2014-08-18 12:39:29,750 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:39:30,712 DEBUG - Will invoke JobStart for JobID [CREAM052430005]\n', 'https://cert-08.pd.infn.it:8443/CREAM052430005\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM052430005 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM052430005 2014-08-18 12:39:30.906779 Submit https://cert-08.pd.infn.it:8443/CREAM052430005 Left: 822 (at submission time:822) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM052430005 2014-08-18 12:40:33.099010 Exit https://cert-08.pd.infn.it:8443/CREAM733602392 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:40:33,758 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:40:33,780 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:40:33,781 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:40:33,781 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124033.log]\n', '2014-08-18 12:40:33,784 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:40:34,870 DEBUG - Will invoke JobStart for JobID [CREAM750196449]\n', 'https://cert-08.pd.infn.it:8443/CREAM750196449\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM750196449 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM750196449 2014-08-18 12:40:35.015979 Submit https://cert-08.pd.infn.it:8443/CREAM750196449 Left: 816 (at submission time:816) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM750196449 2014-08-18 12:41:3"creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:37:33,524 DEBUG - Will invoke JobStart for JobID [CREAM545641701]\n', 'https://cert-08.pd.infn.it:8443/CREAM545641701\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM545641701 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM545641701 2014-08-18 12:37:33.748338 Submit https://cert-08.pd.infn.it:8443/CREAM545641701 Left: 828 (at submission time:828) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM545641701 2014-08-18 12:39:32.853720 Exit https://cert-08.pd.infn.it:8443/CREAM941157085 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:39:33,560 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:39:33,596 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:39:33,597 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:39:33,597 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123933.log]\n', '2014-08-18 12:39:33,600 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:39:34,596 DEBUG - Will invoke JobStart for JobID [CREAM403196478]\n', 'https://cert-08.pd.infn.it:8443/CREAM403196478\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM403196478 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM403196478 2014-08-18 12:39:34.817174 Submit https://cert-08.pd.infn.it:8443/CREAM403196478 Left: 820 (at submission time:820) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM403196478 2014-08-18 12:39:35.105452 Exit https://cert-08.pd.infn.it:8443/CREAM569272322 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:39:35,670 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:39:35,691 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:39:35,692 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:39:35,692 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123935.log]\n', '2014-08-18 12:39:35,695 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:39:36,456 DEBUG - Will invoke JobStart for JobID [CREAM486227252]\n', 'https://cert-08.pd.infn.it:8443/CREAM486227252\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM486227252 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM486227252 2014-08-18 12:39:36.773195 Submit https://cert-08.pd.infn.it:8443/CREAM486227252 Left: 819 (at submission time:819) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM486227252 2014-08-18 12:41:3"creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:37:32,806 DEBUG - Will invoke JobStart for JobID [CREAM972549192]\n', 'https://cert-08.pd.infn.it:8443/CREAM972549192\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM972549192 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM972549192 2014-08-18 12:37:33.358211 Submit https://cert-08.pd.infn.it:8443/CREAM972549192 Left: 829 (at submission time:829) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM972549192 2014-08-18 12:38:32.666791 Exit https://cert-08.pd.infn.it:8443/CREAM662531707 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:38:33,272 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:38:33,302 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:38:33,302 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:38:33,302 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-123833.log]\n', '2014-08-18 12:38:33,306 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:38:34,489 DEBUG - Will invoke JobStart for JobID [CREAM526251980]\n', 'https://cert-08.pd.infn.it:8443/CREAM526251980\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM526251980 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM526251980 2014-08-18 12:38:34.697487 Submit https://cert-08.pd.infn.it:8443/CREAM526251980 Left: 823 (at submission time:823) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM526251980 2014-08-18 12:40:29.763649 Exit https://cert-08.pd.infn.it:8443/CREAM267569045 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:40:30,080 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:40:30,103 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:40:30,103 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:40:30,103 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124030.log]\n', '2014-08-18 12:40:30,115 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:40:30,938 DEBUG - Will invoke JobStart for JobID [CREAM720463423]\n', 'https://cert-08.pd.infn.it:8443/CREAM720463423\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM720463423 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM720463423 2014-08-18 12:40:31.118124 Submit https://cert-08.pd.infn.it:8443/CREAM720463423 Left: 818 (at submission time:818) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM720463423 2014-08-18 12:42:338 Submitted: 182 Running: 20 Cancelled: 0 Done-Ok: 162 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 162/1000 2014-08-18 12:40:33.010461 Submitted: 182 Running: 19 Cancelled: 0 Done-Ok: 163 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 163/1000 2014-08-18 12:40:33.101137 Submitted: 182 Running: 18 Cancelled: 0 Done-Ok: 164 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 164/1000 2014-08-18 12:40:33.211089 Submitted: 182 Running: 17 Cancelled: 0 Done-Ok: 165 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 165/1000 2014-08-18 12:40:35.019362 Submitted: 183 Running: 18 Cancelled: 0 Done-Ok: 165 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 165/1000 2014-08-18 12:40:35.294702 Submitted: 184 Running: 19 Cancelled: 0 Done-Ok: 165 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 165/1000 2014-08-18 12:40:35.596864 Submitted: 185 Running: 20 Cancelled: 0 Done-Ok: 165 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 165/1000 2014-08-18 12:41:30.019442 Submitted: 185 Running: 19 Cancelled: 0 Done-Ok: 166 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 166/1000 2014-08-18 12:41:31.391808 Submitted: 186 Running: 20 Cancelled: 0 Done-Ok: 166 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 166/1000 2014-08-18 12:41:32.987689 Submitted: 186 Running: 19 Cancelled: 0 Done-Ok: 167 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 167/1000 2014-08-18 12:41:33.192682 Submitted: 186 Running: 18 Cancelled: 0 Done-Ok: 168 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 168/1000 2014-08-18 12:41:33.309149 Submitted: 186 Running: 17 Cancelled: 0 Done-Ok: 169 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 169/1000 2014-08-18 12:41:34.877373 Submitted: 187 Running: 18 Cancelled: 0 Done-Ok: 169 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 169/1000 2014-08-18 12:41:35.107671 Submitted: 188 Running: 19 Cancelled: 0 Done-Ok: 169 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 169/1000 2014-08-18 12:41:35.649804 Submitted: 189 Running: 20 Cancelled: 0 Done-Ok: 169 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 169/1000 2014-08-18 12:42:30.538258 Submitted: 189 Running: 19 Cancelled: 0 Done-Ok: 170 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 170/1000 2014-08-18 12:42:32.115868 Submitted: 190 Running: 20 Cancelled: 0 Done-Ok: 170 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 170/1000 2014-08-18 12:42:33.361870 Submitted: 190 Running: 19 Cancelled: 0 Done-Ok: 171 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 171/1000 2014-08-18 12:42:33.788313 Submitted: 190 Running: 18 Cancelled: 0 Done-Ok: 172 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 172/1000 2014-08-18 12:42:34.427521 Submitted: 190 Running: 17 Cancelled: 0 Done-Ok: 173 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 173/1000 2014-08-18 12:42:35.2.986408 Exit https://cert-08.pd.infn.it:8443/CREAM223416755 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:41:33,457 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:41:33,480 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:41:33,480 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:41:33,480 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124133.log]\n', '2014-08-18 12:41:33,484 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:41:34,475 DEBUG - Will invoke JobStart for JobID [CREAM259446110]\n', 'https://cert-08.pd.infn.it:8443/CREAM259446110\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM259446110 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM259446110 2014-08-18 12:41:34.874381 Submit https://cert-08.pd.infn.it:8443/CREAM259446110 Left: 813 (at submission time:813) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM259446110 2014-08-18 12:42:33.360462 Exit https://cert-08.pd.infn.it:8443/CREAM667134125 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:42:33,973 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:42:33,998 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:42:33,998 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:42:33,998 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124233.log]\n', '2014-08-18 12:42:34,001 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:42:34,957 DEBUG - Will invoke JobStart for JobID [CREAM956016312]\n', 'https://cert-08.pd.infn.it:8443/CREAM956016312\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM956016312 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM956016312 2014-08-18 12:42:35.374369 Submit https://cert-08.pd.infn.it:8443/CREAM956016312 Left: 809 (at submission time:809) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM956016312 2014-08-18 12:43:33.882984 Exit https://cert-08.pd.infn.it:8443/CREAM326498528 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:43:34,553 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:43:34,577 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:43:34,577 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:43:34,577 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124334.log]\n', '2014-080.534908 Exit https://cert-08.pd.infn.it:8443/CREAM861756125 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:42:30,898 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:42:30,920 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:42:30,920 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:42:30,921 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124230.log]\n', '2014-08-18 12:42:30,931 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:42:31,860 DEBUG - Will invoke JobStart for JobID [CREAM960336499]\n', 'https://cert-08.pd.infn.it:8443/CREAM960336499\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM960336499 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM960336499 2014-08-18 12:42:32.113446 Submit https://cert-08.pd.infn.it:8443/CREAM960336499 Left: 810 (at submission time:810) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM960336499 2014-08-18 12:42:33.787217 Exit https://cert-08.pd.infn.it:8443/CREAM972549192 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:42:34,581 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:42:34,606 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:42:34,606 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:42:34,606 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124234.log]\n', '2014-08-18 12:42:34,610 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:42:35,722 DEBUG - Will invoke JobStart for JobID [CREAM933730737]\n', 'https://cert-08.pd.infn.it:8443/CREAM933730737\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM933730737 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM933730737 2014-08-18 12:42:36.143240 Submit https://cert-08.pd.infn.it:8443/CREAM933730737 Left: 808 (at submission time:808) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM933730737 2014-08-18 12:43:34.336580 Exit https://cert-08.pd.infn.it:8443/CREAM526251980 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:43:34,915 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:43:34,940 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:43:34,940 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:43:34,940 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124334.log]\n', '2014-083.191738 Exit https://cert-08.pd.infn.it:8443/CREAM654091561 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:41:33,763 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:41:33,786 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:41:33,787 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:41:33,787 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124133.log]\n', '2014-08-18 12:41:33,790 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:41:34,878 DEBUG - Will invoke JobStart for JobID [CREAM322891579]\n', 'https://cert-08.pd.infn.it:8443/CREAM322891579\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM322891579 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM322891579 2014-08-18 12:41:35.105892 Submit https://cert-08.pd.infn.it:8443/CREAM322891579 Left: 812 (at submission time:812) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM322891579 2014-08-18 12:43:30.864685 Exit https://cert-08.pd.infn.it:8443/CREAM460509421 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:43:31,199 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:43:31,218 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:43:31,218 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:43:31,218 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124331.log]\n', '2014-08-18 12:43:31,226 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:43:32,331 DEBUG - Will invoke JobStart for JobID [CREAM118623213]\n', 'https://cert-08.pd.infn.it:8443/CREAM118623213\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM118623213 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM118623213 2014-08-18 12:43:32.563626 Submit https://cert-08.pd.infn.it:8443/CREAM118623213 Left: 806 (at submission time:806) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM118623213 2014-08-18 12:44:30.882143 Exit https://cert-08.pd.infn.it:8443/CREAM052430005 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:44:31,258 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:44:31,283 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:44:31,283 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:44:31,283 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124431.log]\n', '2014-080.014712 Exit https://cert-08.pd.infn.it:8443/CREAM764724310 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:41:30,353 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:41:30,373 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:41:30,373 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:41:30,373 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124130.log]\n', '2014-08-18 12:41:30,376 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:41:31,154 DEBUG - Will invoke JobStart for JobID [CREAM197011577]\n', 'https://cert-08.pd.infn.it:8443/CREAM197011577\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM197011577 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM197011577 2014-08-18 12:41:31.390608 Submit https://cert-08.pd.infn.it:8443/CREAM197011577 Left: 814 (at submission time:814) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM197011577 2014-08-18 12:43:34.329123 Exit https://cert-08.pd.infn.it:8443/CREAM292446384 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:43:35,101 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:43:35,124 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:43:35,124 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:43:35,124 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124335.log]\n', '2014-08-18 12:43:35,127 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:43:36,126 DEBUG - Will invoke JobStart for JobID [CREAM855937532]\n', 'https://cert-08.pd.infn.it:8443/CREAM855937532\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM855937532 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM855937532 2014-08-18 12:43:36.405059 Submit https://cert-08.pd.infn.it:8443/CREAM855937532 Left: 803 (at submission time:803) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM855937532 2014-08-18 12:44:33.893901 Exit https://cert-08.pd.infn.it:8443/CREAM052391539 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:44:34,507 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:44:34,538 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:44:34,538 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:44:34,538 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124434.log]\n', '2014-083.305499 Exit https://cert-08.pd.infn.it:8443/CREAM447820806 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:41:34,108 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:41:34,133 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:41:34,133 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:41:34,133 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124134.log]\n', '2014-08-18 12:41:34,136 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:41:35,425 DEBUG - Will invoke JobStart for JobID [CREAM941007730]\n', 'https://cert-08.pd.infn.it:8443/CREAM941007730\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM941007730 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM941007730 2014-08-18 12:41:35.648105 Submit https://cert-08.pd.infn.it:8443/CREAM941007730 Left: 811 (at submission time:811) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM941007730 2014-08-18 12:42:34.422952 Exit https://cert-08.pd.infn.it:8443/CREAM545641701 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:42:35,192 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:42:35,217 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:42:35,218 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:42:35,218 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124235.log]\n', '2014-08-18 12:42:35,221 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:42:36,168 DEBUG - Will invoke JobStart for JobID [CREAM833918278]\n', 'https://cert-08.pd.infn.it:8443/CREAM833918278\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM833918278 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM833918278 2014-08-18 12:42:36.408110 Submit https://cert-08.pd.infn.it:8443/CREAM833918278 Left: 807 (at submission time:807) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM833918278 2014-08-18 12:44:34.359331 Exit https://cert-08.pd.infn.it:8443/CREAM403196478 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:44:35,182 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:44:35,217 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:44:35,217 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:44:35,217 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124435.log]\n', '2014-08376821 Submitted: 191 Running: 18 Cancelled: 0 Done-Ok: 173 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 173/1000 2014-08-18 12:42:36.145781 Submitted: 192 Running: 19 Cancelled: 0 Done-Ok: 173 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 173/1000 2014-08-18 12:42:36.409187 Submitted: 193 Running: 20 Cancelled: 0 Done-Ok: 173 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 173/1000 2014-08-18 12:43:30.866770 Submitted: 193 Running: 19 Cancelled: 0 Done-Ok: 174 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 174/1000 2014-08-18 12:43:32.565994 Submitted: 194 Running: 20 Cancelled: 0 Done-Ok: 174 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 174/1000 2014-08-18 12:43:33.885897 Submitted: 194 Running: 19 Cancelled: 0 Done-Ok: 175 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 175/1000 2014-08-18 12:43:34.333706 Submitted: 194 Running: 18 Cancelled: 0 Done-Ok: 176 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 176/1000 2014-08-18 12:43:34.339508 Submitted: 194 Running: 17 Cancelled: 0 Done-Ok: 177 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 177/1000 2014-08-18 12:43:36.190211 Submitted: 195 Running: 18 Cancelled: 0 Done-Ok: 177 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 177/1000 2014-08-18 12:43:36.310572 Submitted: 196 Running: 19 Cancelled: 0 Done-Ok: 177 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 177/1000 2014-08-18 12:43:36.407112 Submitted: 197 Running: 20 Cancelled: 0 Done-Ok: 177 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 177/1000 2014-08-18 12:44:30.884546 Submitted: 197 Running: 19 Cancelled: 0 Done-Ok: 178 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 178/1000 2014-08-18 12:44:32.312659 Submitted: 198 Running: 20 Cancelled: 0 Done-Ok: 178 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 178/1000 2014-08-18 12:44:33.896008 Submitted: 198 Running: 19 Cancelled: 0 Done-Ok: 179 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 179/1000 2014-08-18 12:44:34.362566 Submitted: 198 Running: 18 Cancelled: 0 Done-Ok: 180 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 180/1000 2014-08-18 12:44:35.948374 Submitted: 199 Running: 19 Cancelled: 0 Done-Ok: 180 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 180/1000 2014-08-18 12:44:36.340813 Submitted: 200 Running: 20 Cancelled: 0 Done-Ok: 180 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 180/1000 2014-08-18 12:44:36.781698 Submitted: 200 Running: 19 Cancelled: 0 Done-Ok: 181 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 181/1000 2014-08-18 12:44:38.760783 Submitted: 201 Running: 20 Cancelled: 0 Done-Ok: 181 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 181/1000 2014-08-18 12:45:31.790893 Submitted: 201 Running: 19 Cancelled: 0 Done-Ok: 182 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 182/1000 2014-08-18 12:45-18 12:44:34,541 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:44:35,536 DEBUG - Will invoke JobStart for JobID [CREAM749621791]\n', 'https://cert-08.pd.infn.it:8443/CREAM749621791\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM749621791 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM749621791 2014-08-18 12:44:35.945670 Submit https://cert-08.pd.infn.it:8443/CREAM749621791 Left: 801 (at submission time:801) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM749621791 2014-08-18 12:45:34.896431 Exit https://cert-08.pd.infn.it:8443/CREAM152064294 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:45:35,624 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:45:35,649 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:45:35,649 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:45:35,649 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124535.log]\n', '2014-08-18 12:45:35,653 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:45:36,550 DEBUG - Will invoke JobStart for JobID [CREAM026273143]\n', 'https://cert-08.pd.infn.it:8443/CREAM026273143\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM026273143 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM026273143 2014-08-18 12:45:36.968023 Submit https://cert-08.pd.infn.it:8443/CREAM026273143 Left: 796 (at submission time:796) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM026273143 2014-08-18 12:46:32.400377 Exit https://cert-08.pd.infn.it:8443/CREAM197011577 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:46:32,802 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:46:32,839 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:46:32,839 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:46:32,839 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124632.log]\n', '2014-08-18 12:46:32,850 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:46:33,591 DEBUG - Will invoke JobStart for JobID [CREAM190893384]\n', 'https://cert-08.pd.infn.it:8443/CREAM190893384\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM190893384 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM190893384 2014-08-18 12:46:33.917463 Submit https://cert-08.pd.infn.it:-18 12:44:31,288 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:44:32,085 DEBUG - Will invoke JobStart for JobID [CREAM796045816]\n', 'https://cert-08.pd.infn.it:8443/CREAM796045816\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM796045816 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM796045816 2014-08-18 12:44:32.310590 Submit https://cert-08.pd.infn.it:8443/CREAM796045816 Left: 802 (at submission time:802) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM796045816 2014-08-18 12:45:34.520004 Exit https://cert-08.pd.infn.it:8443/CREAM750196449 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:45:35,017 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:45:35,036 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:45:35,036 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:45:35,037 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124535.log]\n', '2014-08-18 12:45:35,039 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:45:36,202 DEBUG - Will invoke JobStart for JobID [CREAM159811083]\n', 'https://cert-08.pd.infn.it:8443/CREAM159811083\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM159811083 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM159811083 2014-08-18 12:45:36.367189 Submit https://cert-08.pd.infn.it:8443/CREAM159811083 Left: 797 (at submission time:797) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM159811083 2014-08-18 12:46:35.189395 Exit https://cert-08.pd.infn.it:8443/CREAM322891579 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:46:35,870 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:46:35,899 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:46:35,899 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:46:35,899 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124635.log]\n', '2014-08-18 12:46:35,907 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:46:36,875 DEBUG - Will invoke JobStart for JobID [CREAM305777493]\n', 'https://cert-08.pd.infn.it:8443/CREAM305777493\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM305777493 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM305777493 2014-08-18 12:46:37.428401 Submit https://cert-08.pd.infn.it:-18 12:43:34,581 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:43:35,793 DEBUG - Will invoke JobStart for JobID [CREAM254500962]\n', 'https://cert-08.pd.infn.it:8443/CREAM254500962\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM254500962 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM254500962 2014-08-18 12:43:36.187615 Submit https://cert-08.pd.infn.it:8443/CREAM254500962 Left: 805 (at submission time:805) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM254500962 2014-08-18 12:45:36.208809 Exit https://cert-08.pd.infn.it:8443/CREAM133295397 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:45:36,762 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:45:36,791 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:45:36,791 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:45:36,791 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124536.log]\n', '2014-08-18 12:45:36,794 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:45:37,603 DEBUG - Will invoke JobStart for JobID [CREAM629202562]\n', 'https://cert-08.pd.infn.it:8443/CREAM629202562\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM629202562 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM629202562 2014-08-18 12:45:37.937637 Submit https://cert-08.pd.infn.it:8443/CREAM629202562 Left: 795 (at submission time:795) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM629202562 2014-08-18 12:46:36.007637 Exit https://cert-08.pd.infn.it:8443/CREAM259446110 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:46:36,839 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:46:36,864 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:46:36,864 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:46:36,864 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124636.log]\n', '2014-08-18 12:46:36,867 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:46:37,823 DEBUG - Will invoke JobStart for JobID [CREAM508855316]\n', 'https://cert-08.pd.infn.it:8443/CREAM508855316\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM508855316 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM508855316 2014-08-18 12:46:38.068901 Submit https://cert-08.pd.infn.it:-18 12:44:35,220 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:44:36,085 DEBUG - Will invoke JobStart for JobID [CREAM904451163]\n', 'https://cert-08.pd.infn.it:8443/CREAM904451163\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM904451163 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM904451163 2014-08-18 12:44:36.338131 Submit https://cert-08.pd.infn.it:8443/CREAM904451163 Left: 800 (at submission time:800) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM904451163 2014-08-18 12:44:36.779376 Exit https://cert-08.pd.infn.it:8443/CREAM486227252 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:44:37,447 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:44:37,466 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:44:37,466 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:44:37,466 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124437.log]\n', '2014-08-18 12:44:37,470 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:44:38,525 DEBUG - Will invoke JobStart for JobID [CREAM567653878]\n', 'https://cert-08.pd.infn.it:8443/CREAM567653878\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM567653878 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM567653878 2014-08-18 12:44:38.758152 Submit https://cert-08.pd.infn.it:8443/CREAM567653878 Left: 799 (at submission time:799) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM567653878 2014-08-18 12:46:36.436909 Exit https://cert-08.pd.infn.it:8443/CREAM941007730 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:46:36,996 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:46:37,020 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:46:37,020 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:46:37,020 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124637.log]\n', '2014-08-18 12:46:37,023 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:46:38,266 DEBUG - Will invoke JobStart for JobID [CREAM910396084]\n', 'https://cert-08.pd.infn.it:8443/CREAM910396084\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM910396084 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM910396084 2014-08-18 12:46:38.708753 Submit https://cert-08.pd.infn.it:-18 12:43:34,944 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:43:36,118 DEBUG - Will invoke JobStart for JobID [CREAM487981579]\n', 'https://cert-08.pd.infn.it:8443/CREAM487981579\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM487981579 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM487981579 2014-08-18 12:43:36.308938 Submit https://cert-08.pd.infn.it:8443/CREAM487981579 Left: 804 (at submission time:804) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM487981579 2014-08-18 12:45:31.785365 Exit https://cert-08.pd.infn.it:8443/CREAM720463423 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:45:32,146 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:45:32,174 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:45:32,174 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:45:32,174 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124532.log]\n', '2014-08-18 12:45:32,179 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:45:33,008 DEBUG - Will invoke JobStart for JobID [CREAM128212279]\n', 'https://cert-08.pd.infn.it:8443/CREAM128212279\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM128212279 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM128212279 2014-08-18 12:45:33.231701 Submit https://cert-08.pd.infn.it:8443/CREAM128212279 Left: 798 (at submission time:798) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM128212279 2014-08-18 12:47:32.455590 Exit https://cert-08.pd.infn.it:8443/CREAM960336499 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:47:32,867 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:47:32,922 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:47:32,922 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:47:32,922 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124732.log]\n', '2014-08-18 12:47:32,931 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:47:33,761 DEBUG - Will invoke JobStart for JobID [CREAM026285800]\n', 'https://cert-08.pd.infn.it:8443/CREAM026285800\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM026285800 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM026285800 2014-08-18 12:47:34.150397 Submit https://cert-08.pd.infn.it::33.234372 Submitted: 202 Running: 20 Cancelled: 0 Done-Ok: 182 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 182/1000 2014-08-18 12:45:34.521964 Submitted: 202 Running: 19 Cancelled: 0 Done-Ok: 183 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 183/1000 2014-08-18 12:45:34.898271 Submitted: 202 Running: 18 Cancelled: 0 Done-Ok: 184 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 184/1000 2014-08-18 12:45:36.209880 Submitted: 202 Running: 17 Cancelled: 0 Done-Ok: 185 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 185/1000 2014-08-18 12:45:36.370347 Submitted: 203 Running: 18 Cancelled: 0 Done-Ok: 185 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 185/1000 2014-08-18 12:45:36.971142 Submitted: 204 Running: 19 Cancelled: 0 Done-Ok: 185 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 185/1000 2014-08-18 12:45:37.940844 Submitted: 205 Running: 20 Cancelled: 0 Done-Ok: 185 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 185/1000 2014-08-18 12:46:32.402497 Submitted: 205 Running: 19 Cancelled: 0 Done-Ok: 186 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 186/1000 2014-08-18 12:46:33.919260 Submitted: 206 Running: 20 Cancelled: 0 Done-Ok: 186 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 186/1000 2014-08-18 12:46:35.191365 Submitted: 206 Running: 19 Cancelled: 0 Done-Ok: 187 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 187/1000 2014-08-18 12:46:36.010623 Submitted: 206 Running: 18 Cancelled: 0 Done-Ok: 188 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 188/1000 2014-08-18 12:46:36.438699 Submitted: 206 Running: 17 Cancelled: 0 Done-Ok: 189 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 189/1000 2014-08-18 12:46:37.429993 Submitted: 207 Running: 18 Cancelled: 0 Done-Ok: 189 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 189/1000 2014-08-18 12:46:38.071817 Submitted: 208 Running: 19 Cancelled: 0 Done-Ok: 189 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 189/1000 2014-08-18 12:46:38.713752 Submitted: 209 Running: 20 Cancelled: 0 Done-Ok: 189 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 189/1000 2014-08-18 12:47:32.458576 Submitted: 209 Running: 19 Cancelled: 0 Done-Ok: 190 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 190/1000 2014-08-18 12:47:34.154400 Submitted: 210 Running: 20 Cancelled: 0 Done-Ok: 190 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 190/1000 2014-08-18 12:47:36.047501 Submitted: 210 Running: 19 Cancelled: 0 Done-Ok: 191 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 191/1000 2014-08-18 12:47:36.056650 Submitted: 210 Running: 18 Cancelled: 0 Done-Ok: 192 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 192/1000 2014-08-18 12:47:36.540944 Submitted: 210 Running: 17 Cancelled: 0 Done-Ok: 193 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 193/1000 2014-08-18 18443/CREAM910396084 Left: 791 (at submission time:791) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM910396084 2014-08-18 12:47:36.045833 Exit https://cert-08.pd.infn.it:8443/CREAM833918278 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:47:36,742 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:47:36,770 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:47:36,770 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:47:36,770 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124736.log]\n', '2014-08-18 12:47:36,774 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:47:37,924 DEBUG - Will invoke JobStart for JobID [CREAM867131895]\n', 'https://cert-08.pd.infn.it:8443/CREAM867131895\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM867131895 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM867131895 2014-08-18 12:47:38.341972 Submit https://cert-08.pd.infn.it:8443/CREAM867131895 Left: 788 (at submission time:788) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM867131895 2014-08-18 12:49:36.532391 Exit https://cert-08.pd.infn.it:8443/CREAM567653878 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:49:36,823 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:49:36,846 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:49:36,846 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:49:36,846 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124936.log]\n', '2014-08-18 12:49:36,849 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:49:37,924 DEBUG - Will invoke JobStart for JobID [CREAM208118494]\n', 'https://cert-08.pd.infn.it:8443/CREAM208118494\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM208118494 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM208118494 2014-08-18 12:49:38.178843 Submit https://cert-08.pd.infn.it:8443/CREAM208118494 Left: 781 (at submission time:781) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM208118494 2014-08-18 12:49:38.479673 Exit https://cert-08.pd.infn.it:8443/CREAM904451163 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:49:39,261 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:49:39,285 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:49:39,285 WARN - No configuration file suitable for loading. Using bui8443/CREAM026285800 Left: 790 (at submission time:790) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM026285800 2014-08-18 12:47:36.053407 Exit https://cert-08.pd.infn.it:8443/CREAM933730737 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:47:36,690 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:47:36,710 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:47:36,710 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:47:36,710 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124736.log]\n', '2014-08-18 12:47:36,714 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:47:37,752 DEBUG - Will invoke JobStart for JobID [CREAM564599148]\n', 'https://cert-08.pd.infn.it:8443/CREAM564599148\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM564599148 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM564599148 2014-08-18 12:47:38.334581 Submit https://cert-08.pd.infn.it:8443/CREAM564599148 Left: 789 (at submission time:789) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM564599148 2014-08-18 12:48:36.100120 Exit https://cert-08.pd.infn.it:8443/CREAM487981579 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:48:36,772 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:48:36,795 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:48:36,795 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:48:36,795 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124836.log]\n', '2014-08-18 12:48:36,801 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:48:37,671 DEBUG - Will invoke JobStart for JobID [CREAM773671601]\n', 'https://cert-08.pd.infn.it:8443/CREAM773671601\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM773671601 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM773671601 2014-08-18 12:48:37.867497 Submit https://cert-08.pd.infn.it:8443/CREAM773671601 Left: 784 (at submission time:784) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM773671601 2014-08-18 12:50:33.739766 Exit https://cert-08.pd.infn.it:8443/CREAM128212279 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:50:34,040 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:50:34,077 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:50:34,077 WARN - No configuration file suitable for loading. Using bui2:47:38.336113 Submitted: 211 Running: 18 Cancelled: 0 Done-Ok: 193 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 193/1000 2014-08-18 12:47:38.343835 Submitted: 212 Running: 19 Cancelled: 0 Done-Ok: 193 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 193/1000 2014-08-18 12:47:39.102971 Submitted: 213 Running: 20 Cancelled: 0 Done-Ok: 193 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 193/1000 2014-08-18 12:48:32.887252 Submitted: 213 Running: 19 Cancelled: 0 Done-Ok: 194 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 194/1000 2014-08-18 12:48:34.701312 Submitted: 214 Running: 20 Cancelled: 0 Done-Ok: 194 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 194/1000 2014-08-18 12:48:36.102373 Submitted: 214 Running: 19 Cancelled: 0 Done-Ok: 195 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 195/1000 2014-08-18 12:48:36.120345 Submitted: 214 Running: 18 Cancelled: 0 Done-Ok: 196 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 196/1000 2014-08-18 12:48:36.851343 Submitted: 214 Running: 17 Cancelled: 0 Done-Ok: 197 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 197/1000 2014-08-18 12:48:37.869343 Submitted: 215 Running: 18 Cancelled: 0 Done-Ok: 197 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 197/1000 2014-08-18 12:48:38.478765 Submitted: 216 Running: 19 Cancelled: 0 Done-Ok: 197 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 197/1000 2014-08-18 12:48:39.244103 Submitted: 217 Running: 20 Cancelled: 0 Done-Ok: 197 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 197/1000 2014-08-18 12:49:33.335659 Submitted: 217 Running: 19 Cancelled: 0 Done-Ok: 198 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 198/1000 2014-08-18 12:49:34.937746 Submitted: 218 Running: 20 Cancelled: 0 Done-Ok: 198 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 198/1000 2014-08-18 12:49:36.535572 Submitted: 218 Running: 19 Cancelled: 0 Done-Ok: 199 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 199/1000 2014-08-18 12:49:37.787395 Submitted: 218 Running: 18 Cancelled: 0 Done-Ok: 200 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 200/1000 2014-08-18 12:49:38.180495 Submitted: 219 Running: 19 Cancelled: 0 Done-Ok: 200 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 200/1000 2014-08-18 12:49:38.480924 Submitted: 219 Running: 18 Cancelled: 0 Done-Ok: 201 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 201/1000 2014-08-18 12:49:39.862420 Submitted: 220 Running: 19 Cancelled: 0 Done-Ok: 201 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 201/1000 2014-08-18 12:49:40.561489 Submitted: 221 Running: 20 Cancelled: 0 Done-Ok: 201 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 201/1000 2014-08-18 12:50:33.741801 Submitted: 221 Running: 19 Cancelled: 0 Done-Ok: 202 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 202/1000 2014-08-8443/CREAM508855316 Left: 792 (at submission time:792) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM508855316 2014-08-18 12:47:36.538947 Exit https://cert-08.pd.infn.it:8443/CREAM956016312 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:47:37,507 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:47:37,530 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:47:37,530 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:47:37,530 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124737.log]\n', '2014-08-18 12:47:37,534 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:47:38,758 DEBUG - Will invoke JobStart for JobID [CREAM369630600]\n', 'https://cert-08.pd.infn.it:8443/CREAM369630600\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM369630600 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM369630600 2014-08-18 12:47:39.099930 Submit https://cert-08.pd.infn.it:8443/CREAM369630600 Left: 787 (at submission time:787) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM369630600 2014-08-18 12:48:36.849909 Exit https://cert-08.pd.infn.it:8443/CREAM254500962 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:48:37,770 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:48:37,799 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:48:37,799 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:48:37,799 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124837.log]\n', '2014-08-18 12:48:37,802 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:48:38,891 DEBUG - Will invoke JobStart for JobID [CREAM005726005]\n', 'https://cert-08.pd.infn.it:8443/CREAM005726005\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM005726005 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM005726005 2014-08-18 12:48:39.241088 Submit https://cert-08.pd.infn.it:8443/CREAM005726005 Left: 783 (at submission time:783) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM005726005 2014-08-18 12:50:37.086451 Exit https://cert-08.pd.infn.it:8443/CREAM629202562 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:50:37,844 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:50:37,876 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:50:37,876 WARN - No configuration file suitable for loading. Using bui8443/CREAM190893384 Left: 794 (at submission time:794) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM190893384 2014-08-18 12:48:36.118577 Exit https://cert-08.pd.infn.it:8443/CREAM855937532 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:48:36,745 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:48:36,777 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:48:36,777 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:48:36,778 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124836.log]\n', '2014-08-18 12:48:36,781 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:48:38,202 DEBUG - Will invoke JobStart for JobID [CREAM780622339]\n', 'https://cert-08.pd.infn.it:8443/CREAM780622339\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM780622339 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM780622339 2014-08-18 12:48:38.477363 Submit https://cert-08.pd.infn.it:8443/CREAM780622339 Left: 785 (at submission time:785) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM780622339 2014-08-18 12:49:37.783839 Exit https://cert-08.pd.infn.it:8443/CREAM749621791 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:49:38,308 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:49:38,341 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:49:38,341 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:49:38,341 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124938.log]\n', '2014-08-18 12:49:38,354 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:49:39,326 DEBUG - Will invoke JobStart for JobID [CREAM493499177]\n', 'https://cert-08.pd.infn.it:8443/CREAM493499177\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM493499177 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM493499177 2014-08-18 12:49:39.859340 Submit https://cert-08.pd.infn.it:8443/CREAM493499177 Left: 780 (at submission time:780) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM493499177 2014-08-18 12:50:37.378799 Exit https://cert-08.pd.infn.it:8443/CREAM026273143 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:50:37,894 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:50:37,925 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:50:37,925 WARN - No configuration file suitable for loading. Using bui8443/CREAM305777493 Left: 793 (at submission time:793) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM305777493 2014-08-18 12:48:32.884699 Exit https://cert-08.pd.infn.it:8443/CREAM118623213 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:48:33,406 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:48:33,430 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:48:33,430 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:48:33,430 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124833.log]\n', '2014-08-18 12:48:33,436 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:48:34,382 DEBUG - Will invoke JobStart for JobID [CREAM418813931]\n', 'https://cert-08.pd.infn.it:8443/CREAM418813931\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM418813931 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM418813931 2014-08-18 12:48:34.700185 Submit https://cert-08.pd.infn.it:8443/CREAM418813931 Left: 786 (at submission time:786) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM418813931 2014-08-18 12:49:33.334130 Exit https://cert-08.pd.infn.it:8443/CREAM796045816 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:49:33,711 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:49:33,736 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:49:33,736 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:49:33,736 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124933.log]\n', '2014-08-18 12:49:33,741 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:49:34,724 DEBUG - Will invoke JobStart for JobID [CREAM591285880]\n', 'https://cert-08.pd.infn.it:8443/CREAM591285880\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM591285880 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM591285880 2014-08-18 12:49:34.935685 Submit https://cert-08.pd.infn.it:8443/CREAM591285880 Left: 782 (at submission time:782) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM591285880 2014-08-18 12:50:37.674144 Exit https://cert-08.pd.infn.it:8443/CREAM159811083 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:50:38,756 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:50:38,778 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:50:38,779 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:50:34,077 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125034.log]\n', '2014-08-18 12:50:34,081 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:50:35,053 DEBUG - Will invoke JobStart for JobID [CREAM467730873]\n', 'https://cert-08.pd.infn.it:8443/CREAM467730873\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM467730873 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM467730873 2014-08-18 12:50:35.399283 Submit https://cert-08.pd.infn.it:8443/CREAM467730873 Left: 778 (at submission time:778) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM467730873 2014-08-18 12:52:34.665295 Exit https://cert-08.pd.infn.it:8443/CREAM026285800 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:52:35,021 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:52:35,047 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:52:35,047 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:52:35,047 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125235.log]\n', '2014-08-18 12:52:35,064 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:52:35,814 DEBUG - Will invoke JobStart for JobID [CREAM874190217]\n', 'https://cert-08.pd.infn.it:8443/CREAM874190217\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM874190217 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM874190217 2014-08-18 12:52:35.988753 Submit https://cert-08.pd.infn.it:8443/CREAM874190217 Left: 770 (at submission time:770) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM874190217 2014-08-18 12:52:37.640824 Exit https://cert-08.pd.infn.it:8443/CREAM564599148 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:52:38,421 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:52:38,445 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:52:38,446 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:52:38,446 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125238.log]\n', '2014-08-18 12:52:38,449 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:52:39,401 DEBUG - Will invoke JobStart for JobID [CREAM377593670]\n', 'https://cert-08.pd.infn.it:8443/CREAM377593670\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.i18 12:50:35.402597 Submitted: 222 Running: 20 Cancelled: 0 Done-Ok: 202 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 202/1000 2014-08-18 12:50:37.089380 Submitted: 222 Running: 19 Cancelled: 0 Done-Ok: 203 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 203/1000 2014-08-18 12:50:37.382122 Submitted: 222 Running: 18 Cancelled: 0 Done-Ok: 204 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 204/1000 2014-08-18 12:50:37.677269 Submitted: 222 Running: 17 Cancelled: 0 Done-Ok: 205 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 205/1000 2014-08-18 12:50:39.384655 Submitted: 223 Running: 18 Cancelled: 0 Done-Ok: 205 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 205/1000 2014-08-18 12:50:39.409904 Submitted: 224 Running: 19 Cancelled: 0 Done-Ok: 205 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 205/1000 2014-08-18 12:50:39.926095 Submitted: 225 Running: 20 Cancelled: 0 Done-Ok: 205 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 205/1000 2014-08-18 12:51:34.505976 Submitted: 225 Running: 19 Cancelled: 0 Done-Ok: 206 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 206/1000 2014-08-18 12:51:35.846824 Submitted: 226 Running: 20 Cancelled: 0 Done-Ok: 206 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 206/1000 2014-08-18 12:51:37.568884 Submitted: 226 Running: 19 Cancelled: 0 Done-Ok: 207 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 207/1000 2014-08-18 12:51:38.071103 Submitted: 226 Running: 18 Cancelled: 0 Done-Ok: 208 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 208/1000 2014-08-18 12:51:38.220693 Submitted: 226 Running: 17 Cancelled: 0 Done-Ok: 209 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 209/1000 2014-08-18 12:51:39.485717 Submitted: 227 Running: 18 Cancelled: 0 Done-Ok: 209 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 209/1000 2014-08-18 12:51:40.355502 Submitted: 228 Running: 19 Cancelled: 0 Done-Ok: 209 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 209/1000 2014-08-18 12:51:40.702759 Submitted: 229 Running: 20 Cancelled: 0 Done-Ok: 209 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 209/1000 2014-08-18 12:52:34.666951 Submitted: 229 Running: 19 Cancelled: 0 Done-Ok: 210 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 210/1000 2014-08-18 12:52:35.992080 Submitted: 230 Running: 20 Cancelled: 0 Done-Ok: 210 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 210/1000 2014-08-18 12:52:37.642070 Submitted: 230 Running: 19 Cancelled: 0 Done-Ok: 211 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 211/1000 2014-08-18 12:52:38.135347 Submitted: 230 Running: 18 Cancelled: 0 Done-Ok: 212 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 212/1000 2014-08-18 12:52:38.686223 Submitted: 230 Running: 17 Cancelled: 0 Done-Ok: 213 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 213/1000 2014lt-in configuration\n', '2014-08-18 12:50:37,876 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125037.log]\n', '2014-08-18 12:50:37,885 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:50:38,975 DEBUG - Will invoke JobStart for JobID [CREAM210512316]\n', 'https://cert-08.pd.infn.it:8443/CREAM210512316\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM210512316 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM210512316 2014-08-18 12:50:39.383579 Submit https://cert-08.pd.infn.it:8443/CREAM210512316 Left: 777 (at submission time:777) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM210512316 2014-08-18 12:51:38.218610 Exit https://cert-08.pd.infn.it:8443/CREAM508855316 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:51:39,364 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:51:39,390 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:51:39,390 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:51:39,391 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125139.log]\n', '2014-08-18 12:51:39,393 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:51:40,474 DEBUG - Will invoke JobStart for JobID [CREAM823058073]\n', 'https://cert-08.pd.infn.it:8443/CREAM823058073\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM823058073 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM823058073 2014-08-18 12:51:40.701080 Submit https://cert-08.pd.infn.it:8443/CREAM823058073 Left: 771 (at submission time:771) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM823058073 2014-08-18 12:52:38.133272 Exit https://cert-08.pd.infn.it:8443/CREAM369630600 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:52:39,029 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:52:39,053 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:52:39,053 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:52:39,053 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125239.log]\n', '2014-08-18 12:52:39,057 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:52:40,105 DEBUG - Will invoke JobStart for JobID [CREAM462326157]\n', 'https://cert-08.pd.infn.it:8443/CREAM462326157\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.ilt-in configuration\n', '2014-08-18 12:49:39,285 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-124939.log]\n', '2014-08-18 12:49:39,288 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:49:40,392 DEBUG - Will invoke JobStart for JobID [CREAM066013963]\n', 'https://cert-08.pd.infn.it:8443/CREAM066013963\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM066013963 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM066013963 2014-08-18 12:49:40.559803 Submit https://cert-08.pd.infn.it:8443/CREAM066013963 Left: 779 (at submission time:779) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM066013963 2014-08-18 12:51:37.565145 Exit https://cert-08.pd.infn.it:8443/CREAM910396084 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:51:38,116 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:51:38,141 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:51:38,141 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:51:38,141 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125138.log]\n', '2014-08-18 12:51:38,144 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:51:39,161 DEBUG - Will invoke JobStart for JobID [CREAM058025322]\n', 'https://cert-08.pd.infn.it:8443/CREAM058025322\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM058025322 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM058025322 2014-08-18 12:51:39.481108 Submit https://cert-08.pd.infn.it:8443/CREAM058025322 Left: 773 (at submission time:773) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM058025322 2014-08-18 12:52:38.684637 Exit https://cert-08.pd.infn.it:8443/CREAM867131895 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:52:39,629 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:52:39,652 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:52:39,652 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:52:39,652 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125239.log]\n', '2014-08-18 12:52:39,655 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:52:40,663 DEBUG - Will invoke JobStart for JobID [CREAM854808308]\n', 'https://cert-08.pd.infn.it:8443/CREAM854808308\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.ilt-in configuration\n', '2014-08-18 12:50:38,779 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125038.log]\n', '2014-08-18 12:50:38,782 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:50:39,682 DEBUG - Will invoke JobStart for JobID [CREAM771835391]\n', 'https://cert-08.pd.infn.it:8443/CREAM771835391\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM771835391 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM771835391 2014-08-18 12:50:39.924028 Submit https://cert-08.pd.infn.it:8443/CREAM771835391 Left: 775 (at submission time:775) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM771835391 2014-08-18 12:51:38.068245 Exit https://cert-08.pd.infn.it:8443/CREAM305777493 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:51:38,859 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:51:38,884 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:51:38,884 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:51:38,884 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125138.log]\n', '2014-08-18 12:51:38,887 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:51:39,926 DEBUG - Will invoke JobStart for JobID [CREAM457871928]\n', 'https://cert-08.pd.infn.it:8443/CREAM457871928\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM457871928 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM457871928 2014-08-18 12:51:40.352318 Submit https://cert-08.pd.infn.it:8443/CREAM457871928 Left: 772 (at submission time:772) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM457871928 2014-08-18 12:53:35.453565 Exit https://cert-08.pd.infn.it:8443/CREAM418813931 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:53:35,829 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:53:35,853 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:53:35,853 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:53:35,854 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125335.log]\n', '2014-08-18 12:53:35,858 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:53:36,814 DEBUG - Will invoke JobStart for JobID [CREAM225978206]\n', 'https://cert-08.pd.infn.it:8443/CREAM225978206\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.ilt-in configuration\n', '2014-08-18 12:50:37,925 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125037.log]\n', '2014-08-18 12:50:37,928 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:50:39,253 DEBUG - Will invoke JobStart for JobID [CREAM669236912]\n', 'https://cert-08.pd.infn.it:8443/CREAM669236912\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM669236912 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM669236912 2014-08-18 12:50:39.408677 Submit https://cert-08.pd.infn.it:8443/CREAM669236912 Left: 776 (at submission time:776) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM669236912 2014-08-18 12:51:34.503781 Exit https://cert-08.pd.infn.it:8443/CREAM190893384 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:51:34,814 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:51:34,839 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:51:34,839 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:51:34,839 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125134.log]\n', '2014-08-18 12:51:34,848 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:51:35,662 DEBUG - Will invoke JobStart for JobID [CREAM700052909]\n', 'https://cert-08.pd.infn.it:8443/CREAM700052909\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM700052909 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM700052909 2014-08-18 12:51:35.842843 Submit https://cert-08.pd.infn.it:8443/CREAM700052909 Left: 774 (at submission time:774) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM700052909 2014-08-18 12:53:38.850649 Exit https://cert-08.pd.infn.it:8443/CREAM780622339 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:53:39,661 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:53:39,683 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:53:39,683 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:53:39,683 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125339.log]\n', '2014-08-18 12:53:39,687 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:53:41,256 DEBUG - Will invoke JobStart for JobID [CREAM017715978]\n', 'https://cert-08.pd.infn.it:8443/CREAM017715978\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.i-08-18 12:52:39.684259 Submitted: 231 Running: 18 Cancelled: 0 Done-Ok: 213 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 213/1000 2014-08-18 12:52:40.529897 Submitted: 232 Running: 19 Cancelled: 0 Done-Ok: 213 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 213/1000 2014-08-18 12:52:40.946678 Submitted: 233 Running: 20 Cancelled: 0 Done-Ok: 213 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 213/1000 2014-08-18 12:53:35.455945 Submitted: 233 Running: 19 Cancelled: 0 Done-Ok: 214 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 214/1000 2014-08-18 12:53:37.289163 Submitted: 234 Running: 20 Cancelled: 0 Done-Ok: 214 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 214/1000 2014-08-18 12:53:37.847801 Submitted: 234 Running: 19 Cancelled: 0 Done-Ok: 215 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 215/1000 2014-08-18 12:53:38.855344 Submitted: 234 Running: 18 Cancelled: 0 Done-Ok: 216 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 216/1000 2014-08-18 12:53:39.795201 Submitted: 235 Running: 19 Cancelled: 0 Done-Ok: 216 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 216/1000 2014-08-18 12:53:40.371118 Submitted: 235 Running: 18 Cancelled: 0 Done-Ok: 217 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 217/1000 2014-08-18 12:53:41.609788 Submitted: 236 Running: 19 Cancelled: 0 Done-Ok: 217 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 217/1000 2014-08-18 12:53:42.650374 Submitted: 237 Running: 20 Cancelled: 0 Done-Ok: 217 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 217/1000 2014-08-18 12:54:35.839877 Submitted: 237 Running: 19 Cancelled: 0 Done-Ok: 218 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 218/1000 2014-08-18 12:54:37.211965 Submitted: 238 Running: 20 Cancelled: 0 Done-Ok: 218 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 218/1000 2014-08-18 12:54:38.598841 Submitted: 238 Running: 19 Cancelled: 0 Done-Ok: 219 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 219/1000 2014-08-18 12:54:39.005904 Submitted: 238 Running: 18 Cancelled: 0 Done-Ok: 220 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 220/1000 2014-08-18 12:54:40.201568 Submitted: 239 Running: 19 Cancelled: 0 Done-Ok: 220 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 220/1000 2014-08-18 12:54:40.716666 Submitted: 239 Running: 18 Cancelled: 0 Done-Ok: 221 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 221/1000 2014-08-18 12:54:41.444506 Submitted: 240 Running: 19 Cancelled: 0 Done-Ok: 221 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 221/1000 2014-08-18 12:54:42.698993 Submitted: 241 Running: 20 Cancelled: 0 Done-Ok: 221 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 221/1000 2014-08-18 12:55:36.345726 Submitted: 241 Running: 19 Cancelled: 0 Done-Ok: 222 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 222/1000 nfn.it:8443/CREAM017715978 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM017715978 2014-08-18 12:53:41.608032 Submit https://cert-08.pd.infn.it:8443/CREAM017715978 Left: 764 (at submission time:764) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM017715978 2014-08-18 12:54:39.004017 Exit https://cert-08.pd.infn.it:8443/CREAM493499177 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:54:40,015 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:54:40,039 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:54:40,039 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:54:40,039 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125440.log]\n', '2014-08-18 12:54:40,042 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:54:41,180 DEBUG - Will invoke JobStart for JobID [CREAM038601753]\n', 'https://cert-08.pd.infn.it:8443/CREAM038601753\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM038601753 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM038601753 2014-08-18 12:54:41.442737 Submit https://cert-08.pd.infn.it:8443/CREAM038601753 Left: 760 (at submission time:760) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM038601753 2014-08-18 12:55:39.541877 Exit https://cert-08.pd.infn.it:8443/CREAM669236912 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:55:40,320 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:55:40,340 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:55:40,340 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:55:40,340 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125540.log]\n', '2014-08-18 12:55:40,343 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:55:41,530 DEBUG - Will invoke JobStart for JobID [CREAM356644296]\n', 'https://cert-08.pd.infn.it:8443/CREAM356644296\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM356644296 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM356644296 2014-08-18 12:55:41.706157 Submit https://cert-08.pd.infn.it:8443/CREAM356644296 Left: 756 (at submission time:756) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM356644296 2014-08-18 12:56:36.259762 Exit https://cert-08.pd.infn.it:8443/CREAM700052909 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:56:36,663 DEBUG - Using certificate proxy file [/tmp/x509nfn.it:8443/CREAM462326157 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM462326157 2014-08-18 12:52:40.528757 Submit https://cert-08.pd.infn.it:8443/CREAM462326157 Left: 768 (at submission time:768) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM462326157 2014-08-18 12:53:40.369300 Exit https://cert-08.pd.infn.it:8443/CREAM005726005 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:53:41,094 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:53:41,119 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:53:41,119 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:53:41,119 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125341.log]\n', '2014-08-18 12:53:41,124 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:53:42,330 DEBUG - Will invoke JobStart for JobID [CREAM554991613]\n', 'https://cert-08.pd.infn.it:8443/CREAM554991613\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM554991613 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM554991613 2014-08-18 12:53:42.647597 Submit https://cert-08.pd.infn.it:8443/CREAM554991613 Left: 763 (at submission time:763) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM554991613 2014-08-18 12:55:40.130566 Exit https://cert-08.pd.infn.it:8443/CREAM210512316 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:55:41,031 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:55:41,056 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:55:41,056 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:55:41,056 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125541.log]\n', '2014-08-18 12:55:41,060 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:55:42,165 DEBUG - Will invoke JobStart for JobID [CREAM240363140]\n', 'https://cert-08.pd.infn.it:8443/CREAM240363140\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM240363140 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM240363140 2014-08-18 12:55:42.388751 Submit https://cert-08.pd.infn.it:8443/CREAM240363140 Left: 755 (at submission time:755) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM240363140 2014-08-18 12:56:39.488787 Exit https://cert-08.pd.infn.it:8443/CREAM823058073 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:56:40,001 DEBUG - Using certificate proxy file [/tmp/x509nfn.it:8443/CREAM854808308 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM854808308 2014-08-18 12:52:40.942487 Submit https://cert-08.pd.infn.it:8443/CREAM854808308 Left: 767 (at submission time:767) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM854808308 2014-08-18 12:54:38.596693 Exit https://cert-08.pd.infn.it:8443/CREAM066013963 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:54:38,892 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:54:38,917 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:54:38,917 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:54:38,917 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125438.log]\n', '2014-08-18 12:54:38,920 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:54:39,906 DEBUG - Will invoke JobStart for JobID [CREAM974704078]\n', 'https://cert-08.pd.infn.it:8443/CREAM974704078\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM974704078 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM974704078 2014-08-18 12:54:40.197044 Submit https://cert-08.pd.infn.it:8443/CREAM974704078 Left: 761 (at submission time:761) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM974704078 2014-08-18 12:54:40.714871 Exit https://cert-08.pd.infn.it:8443/CREAM208118494 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:54:41,287 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:54:41,324 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:54:41,324 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:54:41,324 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125441.log]\n', '2014-08-18 12:54:41,327 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:54:42,338 DEBUG - Will invoke JobStart for JobID [CREAM086452572]\n', 'https://cert-08.pd.infn.it:8443/CREAM086452572\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM086452572 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM086452572 2014-08-18 12:54:42.697368 Submit https://cert-08.pd.infn.it:8443/CREAM086452572 Left: 759 (at submission time:759) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM086452572 2014-08-18 12:56:39.747628 Exit https://cert-08.pd.infn.it:8443/CREAM058025322 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:56:40,646 DEBUG - Using certificate proxy file [/tmp/x509nfn.it:8443/CREAM225978206 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM225978206 2014-08-18 12:53:37.285891 Submit https://cert-08.pd.infn.it:8443/CREAM225978206 Left: 766 (at submission time:766) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM225978206 2014-08-18 12:54:35.838334 Exit https://cert-08.pd.infn.it:8443/CREAM591285880 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:54:36,176 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:54:36,206 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:54:36,206 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:54:36,206 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125436.log]\n', '2014-08-18 12:54:36,218 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:54:36,988 DEBUG - Will invoke JobStart for JobID [CREAM574843282]\n', 'https://cert-08.pd.infn.it:8443/CREAM574843282\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM574843282 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM574843282 2014-08-18 12:54:37.210637 Submit https://cert-08.pd.infn.it:8443/CREAM574843282 Left: 762 (at submission time:762) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM574843282 2014-08-18 12:55:39.349182 Exit https://cert-08.pd.infn.it:8443/CREAM771835391 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:55:40,097 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:55:40,117 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:55:40,117 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:55:40,117 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125540.log]\n', '2014-08-18 12:55:40,121 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:55:41,077 DEBUG - Will invoke JobStart for JobID [CREAM226039973]\n', 'https://cert-08.pd.infn.it:8443/CREAM226039973\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM226039973 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM226039973 2014-08-18 12:55:41.528328 Submit https://cert-08.pd.infn.it:8443/CREAM226039973 Left: 757 (at submission time:757) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM226039973 2014-08-18 12:56:40.750151 Exit https://cert-08.pd.infn.it:8443/CREAM457871928 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:56:41,373 DEBUG - Using certificate proxy file [/tmp/x509nfn.it:8443/CREAM377593670 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM377593670 2014-08-18 12:52:39.682189 Submit https://cert-08.pd.infn.it:8443/CREAM377593670 Left: 769 (at submission time:769) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM377593670 2014-08-18 12:53:37.844894 Exit https://cert-08.pd.infn.it:8443/CREAM773671601 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:53:38,485 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:53:38,510 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:53:38,510 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:53:38,510 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125338.log]\n', '2014-08-18 12:53:38,513 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:53:39,557 DEBUG - Will invoke JobStart for JobID [CREAM883439119]\n', 'https://cert-08.pd.infn.it:8443/CREAM883439119\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM883439119 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM883439119 2014-08-18 12:53:39.792824 Submit https://cert-08.pd.infn.it:8443/CREAM883439119 Left: 765 (at submission time:765) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM883439119 2014-08-18 12:55:36.343286 Exit https://cert-08.pd.infn.it:8443/CREAM467730873 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:55:36,659 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:55:36,679 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:55:36,679 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:55:36,679 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125536.log]\n', '2014-08-18 12:55:36,683 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:55:37,707 DEBUG - Will invoke JobStart for JobID [CREAM793349880]\n', 'https://cert-08.pd.infn.it:8443/CREAM793349880\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM793349880 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM793349880 2014-08-18 12:55:37.941588 Submit https://cert-08.pd.infn.it:8443/CREAM793349880 Left: 758 (at submission time:758) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM793349880 2014-08-18 12:57:37.022788 Exit https://cert-08.pd.infn.it:8443/CREAM874190217 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:57:37,345 DEBUG - Using certificate proxy file [/tmp/x5092014-08-18 12:55:37.942719 Submitted: 242 Running: 20 Cancelled: 0 Done-Ok: 222 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 222/1000 2014-08-18 12:55:39.350796 Submitted: 242 Running: 19 Cancelled: 0 Done-Ok: 223 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 223/1000 2014-08-18 12:55:39.545315 Submitted: 242 Running: 18 Cancelled: 0 Done-Ok: 224 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 224/1000 2014-08-18 12:55:40.133918 Submitted: 242 Running: 17 Cancelled: 0 Done-Ok: 225 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 225/1000 2014-08-18 12:55:41.529997 Submitted: 243 Running: 18 Cancelled: 0 Done-Ok: 225 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 225/1000 2014-08-18 12:55:41.708974 Submitted: 244 Running: 19 Cancelled: 0 Done-Ok: 225 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 225/1000 2014-08-18 12:55:42.391656 Submitted: 245 Running: 20 Cancelled: 0 Done-Ok: 225 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 225/1000 2014-08-18 12:56:36.261119 Submitted: 245 Running: 19 Cancelled: 0 Done-Ok: 226 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 226/1000 2014-08-18 12:56:37.831091 Submitted: 246 Running: 20 Cancelled: 0 Done-Ok: 226 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 226/1000 2014-08-18 12:56:39.489869 Submitted: 246 Running: 19 Cancelled: 0 Done-Ok: 227 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 227/1000 2014-08-18 12:56:39.749303 Submitted: 246 Running: 18 Cancelled: 0 Done-Ok: 228 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 228/1000 2014-08-18 12:56:40.751682 Submitted: 246 Running: 17 Cancelled: 0 Done-Ok: 229 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 229/1000 2014-08-18 12:56:41.429903 Submitted: 247 Running: 18 Cancelled: 0 Done-Ok: 229 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 229/1000 2014-08-18 12:56:42.400038 Submitted: 248 Running: 19 Cancelled: 0 Done-Ok: 229 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 229/1000 2014-08-18 12:56:42.931930 Submitted: 249 Running: 20 Cancelled: 0 Done-Ok: 229 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 229/1000 2014-08-18 12:57:37.024745 Submitted: 249 Running: 19 Cancelled: 0 Done-Ok: 230 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 230/1000 2014-08-18 12:57:38.448275 Submitted: 250 Running: 20 Cancelled: 0 Done-Ok: 230 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 230/1000 2014-08-18 12:57:40.292370 Submitted: 250 Running: 19 Cancelled: 0 Done-Ok: 231 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 231/1000 2014-08-18 12:57:40.389873 Submitted: 250 Running: 18 Cancelled: 0 Done-Ok: 232 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 232/1000 2014-08-18 12:57:42.021639 Submitted: 250 Running: 17 Cancelled: 0 Done-Ok: 233 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 233/1up_u500]\n', '2014-08-18 12:57:37,365 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:57:37,365 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:57:37,365 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125737.log]\n', '2014-08-18 12:57:37,370 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:57:38,236 DEBUG - Will invoke JobStart for JobID [CREAM053410182]\n', 'https://cert-08.pd.infn.it:8443/CREAM053410182\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM053410182 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM053410182 2014-08-18 12:57:38.444323 Submit https://cert-08.pd.infn.it:8443/CREAM053410182 Left: 750 (at submission time:750) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM053410182 2014-08-18 12:57:40.388173 Exit https://cert-08.pd.infn.it:8443/CREAM377593670 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:57:41,072 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:57:41,096 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:57:41,096 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:57:41,097 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125741.log]\n', '2014-08-18 12:57:41,100 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:57:42,363 DEBUG - Will invoke JobStart for JobID [CREAM422201941]\n', 'https://cert-08.pd.infn.it:8443/CREAM422201941\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM422201941 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM422201941 2014-08-18 12:57:42.541362 Submit https://cert-08.pd.infn.it:8443/CREAM422201941 Left: 748 (at submission time:748) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM422201941 2014-08-18 12:58:40.584081 Exit https://cert-08.pd.infn.it:8443/CREAM883439119 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:58:41,250 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:58:41,281 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:58:41,281 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:58:41,281 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125841.log]\n', '2014-08-18 12:58:41,284 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:58:42,391 DEBUG - Will invoke JobStart for JobID [CREAM864199700]\n'up_u500]\n', '2014-08-18 12:56:40,024 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:56:40,024 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:56:40,024 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125640.log]\n', '2014-08-18 12:56:40,027 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:56:41,227 DEBUG - Will invoke JobStart for JobID [CREAM012643934]\n', 'https://cert-08.pd.infn.it:8443/CREAM012643934\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM012643934 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM012643934 2014-08-18 12:56:41.428450 Submit https://cert-08.pd.infn.it:8443/CREAM012643934 Left: 753 (at submission time:753) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM012643934 2014-08-18 12:57:40.289238 Exit https://cert-08.pd.infn.it:8443/CREAM462326157 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:57:40,927 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:57:40,949 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:57:40,949 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:57:40,949 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125740.log]\n', '2014-08-18 12:57:40,952 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:57:41,859 DEBUG - Will invoke JobStart for JobID [CREAM263568411]\n', 'https://cert-08.pd.infn.it:8443/CREAM263568411\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM263568411 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM263568411 2014-08-18 12:57:42.264990 Submit https://cert-08.pd.infn.it:8443/CREAM263568411 Left: 749 (at submission time:749) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM263568411 2014-08-18 12:58:42.403973 Exit https://cert-08.pd.infn.it:8443/CREAM554991613 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:58:43,138 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:58:43,162 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:58:43,162 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:58:43,162 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125843.log]\n', '2014-08-18 12:58:43,165 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:58:44,199 DEBUG - Will invoke JobStart for JobID [CREAM199551983]\n'up_u500]\n', '2014-08-18 12:56:41,401 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:56:41,401 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:56:41,401 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125641.log]\n', '2014-08-18 12:56:41,410 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:56:42,547 DEBUG - Will invoke JobStart for JobID [CREAM298894878]\n', 'https://cert-08.pd.infn.it:8443/CREAM298894878\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM298894878 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM298894878 2014-08-18 12:56:42.929237 Submit https://cert-08.pd.infn.it:8443/CREAM298894878 Left: 751 (at submission time:751) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM298894878 2014-08-18 12:58:37.223800 Exit https://cert-08.pd.infn.it:8443/CREAM225978206 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:58:37,600 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:58:37,627 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:58:37,627 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:58:37,627 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125837.log]\n', '2014-08-18 12:58:37,637 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:58:38,520 DEBUG - Will invoke JobStart for JobID [CREAM982507851]\n', 'https://cert-08.pd.infn.it:8443/CREAM982507851\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM982507851 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM982507851 2014-08-18 12:58:38.727769 Submit https://cert-08.pd.infn.it:8443/CREAM982507851 Left: 746 (at submission time:746) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM982507851 2014-08-18 12:59:38.058392 Exit https://cert-08.pd.infn.it:8443/CREAM574843282 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:59:38,401 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:59:38,423 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:59:38,424 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:59:38,424 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125938.log]\n', '2014-08-18 12:59:38,436 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:59:39,390 DEBUG - Will invoke JobStart for JobID [CREAM211150607]\n'up_u500]\n', '2014-08-18 12:56:36,691 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:56:36,691 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:56:36,691 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125636.log]\n', '2014-08-18 12:56:36,700 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:56:37,563 DEBUG - Will invoke JobStart for JobID [CREAM553226610]\n', 'https://cert-08.pd.infn.it:8443/CREAM553226610\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM553226610 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM553226610 2014-08-18 12:56:37.828761 Submit https://cert-08.pd.infn.it:8443/CREAM553226610 Left: 754 (at submission time:754) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM553226610 2014-08-18 12:58:40.519583 Exit https://cert-08.pd.infn.it:8443/CREAM017715978 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:58:41,360 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:58:41,393 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:58:41,393 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:58:41,393 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125841.log]\n', '2014-08-18 12:58:41,396 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:58:42,658 DEBUG - Will invoke JobStart for JobID [CREAM902402522]\n', 'https://cert-08.pd.infn.it:8443/CREAM902402522\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM902402522 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM902402522 2014-08-18 12:58:42.894631 Submit https://cert-08.pd.infn.it:8443/CREAM902402522 Left: 744 (at submission time:744) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM902402522 2014-08-18 12:59:41.535927 Exit https://cert-08.pd.infn.it:8443/CREAM038601753 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:59:42,187 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:59:42,210 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:59:42,211 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:59:42,211 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125942.log]\n', '2014-08-18 12:59:42,219 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:59:43,368 DEBUG - Will invoke JobStart for JobID [CREAM662580471]\n'up_u500]\n', '2014-08-18 12:56:40,670 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:56:40,671 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:56:40,671 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125640.log]\n', '2014-08-18 12:56:40,674 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:56:41,741 DEBUG - Will invoke JobStart for JobID [CREAM509925452]\n', 'https://cert-08.pd.infn.it:8443/CREAM509925452\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM509925452 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM509925452 2014-08-18 12:56:42.398653 Submit https://cert-08.pd.infn.it:8443/CREAM509925452 Left: 752 (at submission time:752) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM509925452 2014-08-18 12:57:42.020273 Exit https://cert-08.pd.infn.it:8443/CREAM854808308 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:57:42,809 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:57:42,832 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:57:42,832 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:57:42,832 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125742.log]\n', '2014-08-18 12:57:42,835 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:57:43,809 DEBUG - Will invoke JobStart for JobID [CREAM886445400]\n', 'https://cert-08.pd.infn.it:8443/CREAM886445400\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM886445400 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM886445400 2014-08-18 12:57:44.219301 Submit https://cert-08.pd.infn.it:8443/CREAM886445400 Left: 747 (at submission time:747) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM886445400 2014-08-18 12:59:41.659636 Exit https://cert-08.pd.infn.it:8443/CREAM974704078 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:59:42,320 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:59:42,348 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:59:42,349 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:59:42,349 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125942.log]\n', '2014-08-18 12:59:42,352 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:59:43,524 DEBUG - Will invoke JobStart for JobID [CREAM348574246]\n'000 2014-08-18 12:57:42.266129 Submitted: 251 Running: 18 Cancelled: 0 Done-Ok: 233 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 233/1000 2014-08-18 12:57:42.543153 Submitted: 252 Running: 19 Cancelled: 0 Done-Ok: 233 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 233/1000 2014-08-18 12:57:44.225699 Submitted: 253 Running: 20 Cancelled: 0 Done-Ok: 233 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 233/1000 2014-08-18 12:58:37.235844 Submitted: 253 Running: 19 Cancelled: 0 Done-Ok: 234 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 234/1000 2014-08-18 12:58:38.731727 Submitted: 254 Running: 20 Cancelled: 0 Done-Ok: 234 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 234/1000 2014-08-18 12:58:40.521957 Submitted: 254 Running: 19 Cancelled: 0 Done-Ok: 235 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 235/1000 2014-08-18 12:58:40.586170 Submitted: 254 Running: 18 Cancelled: 0 Done-Ok: 236 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 236/1000 2014-08-18 12:58:42.406046 Submitted: 254 Running: 17 Cancelled: 0 Done-Ok: 237 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 237/1000 2014-08-18 12:58:42.819037 Submitted: 255 Running: 18 Cancelled: 0 Done-Ok: 237 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 237/1000 2014-08-18 12:58:42.897698 Submitted: 256 Running: 19 Cancelled: 0 Done-Ok: 237 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 237/1000 2014-08-18 12:58:44.517628 Submitted: 257 Running: 20 Cancelled: 0 Done-Ok: 237 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 237/1000 2014-08-18 12:59:38.060495 Submitted: 257 Running: 19 Cancelled: 0 Done-Ok: 238 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 238/1000 2014-08-18 12:59:39.608307 Submitted: 258 Running: 20 Cancelled: 0 Done-Ok: 238 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 238/1000 2014-08-18 12:59:41.538644 Submitted: 258 Running: 19 Cancelled: 0 Done-Ok: 239 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 239/1000 2014-08-18 12:59:41.662824 Submitted: 258 Running: 18 Cancelled: 0 Done-Ok: 240 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 240/1000 2014-08-18 12:59:43.711766 Submitted: 259 Running: 19 Cancelled: 0 Done-Ok: 240 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 240/1000 2014-08-18 12:59:43.788847 Submitted: 260 Running: 20 Cancelled: 0 Done-Ok: 240 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 240/1000 2014-08-18 12:59:44.085191 Submitted: 260 Running: 19 Cancelled: 0 Done-Ok: 241 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 241/1000 2014-08-18 12:59:46.351064 Submitted: 261 Running: 20 Cancelled: 0 Done-Ok: 241 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 241/1000 2014-08-18 13:00:37.994690 Submitted: 261 Running: 19 Cancelled: 0 Done-Ok: 242 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 2, 'https://cert-08.pd.infn.it:8443/CREAM199551983\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM199551983 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM199551983 2014-08-18 12:58:44.513917 Submit https://cert-08.pd.infn.it:8443/CREAM199551983 Left: 743 (at submission time:743) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM199551983 2014-08-18 13:00:43.406577 Exit https://cert-08.pd.infn.it:8443/CREAM240363140 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:00:44,054 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:00:44,078 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:00:44,078 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:00:44,078 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130044.log]\n', '2014-08-18 13:00:44,082 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:00:45,478 DEBUG - Will invoke JobStart for JobID [CREAM086933931]\n', 'https://cert-08.pd.infn.it:8443/CREAM086933931\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM086933931 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM086933931 2014-08-18 13:00:45.740194 Submit https://cert-08.pd.infn.it:8443/CREAM086933931 Left: 735 (at submission time:735) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM086933931 2014-08-18 13:01:42.808698 Exit https://cert-08.pd.infn.it:8443/CREAM012643934 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:01:43,799 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:01:43,822 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:01:43,822 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:01:43,822 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130143.log]\n', '2014-08-18 13:01:43,833 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:01:44,694 DEBUG - Will invoke JobStart for JobID [CREAM821841517]\n', 'https://cert-08.pd.infn.it:8443/CREAM821841517\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM821841517 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM821841517 2014-08-18 13:01:45.090069 Submit https://cert-08.pd.infn.it:8443/CREAM821841517 Left: 732 (at submission time:732) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM821841517 2014-08-18 13:02:42.410012 Exit https://cert-08.pd.infn.it:8443/CREAM263568411 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp42/1000 2014-08-18 13:00:39.528536 Submitted: 262 Running: 20 Cancelled: 0 Done-Ok: 242 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 242/1000 2014-08-18 13:00:41.235559 Submitted: 262 Running: 19 Cancelled: 0 Done-Ok: 243 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 243/1000 2014-08-18 13:00:43.168702 Submitted: 262 Running: 18 Cancelled: 0 Done-Ok: 244 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 244/1000 2014-08-18 13:00:43.359693 Submitted: 263 Running: 19 Cancelled: 0 Done-Ok: 244 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 244/1000 2014-08-18 13:00:43.409006 Submitted: 263 Running: 18 Cancelled: 0 Done-Ok: 245 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 245/1000 2014-08-18 13:00:45.320836 Submitted: 264 Running: 19 Cancelled: 0 Done-Ok: 245 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 245/1000 2014-08-18 13:00:45.742762 Submitted: 265 Running: 20 Cancelled: 0 Done-Ok: 245 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 245/1000 2014-08-18 13:01:38.462117 Submitted: 265 Running: 19 Cancelled: 0 Done-Ok: 246 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 246/1000 2014-08-18 13:01:39.895350 Submitted: 266 Running: 20 Cancelled: 0 Done-Ok: 246 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 246/1000 2014-08-18 13:01:42.528840 Submitted: 266 Running: 19 Cancelled: 0 Done-Ok: 247 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 247/1000 2014-08-18 13:01:42.810828 Submitted: 266 Running: 18 Cancelled: 0 Done-Ok: 248 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 248/1000 2014-08-18 13:01:43.380167 Submitted: 266 Running: 17 Cancelled: 0 Done-Ok: 249 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 249/1000 2014-08-18 13:01:44.434259 Submitted: 267 Running: 18 Cancelled: 0 Done-Ok: 249 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 249/1000 2014-08-18 13:01:45.092944 Submitted: 268 Running: 19 Cancelled: 0 Done-Ok: 249 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 249/1000 2014-08-18 13:01:45.541000 Submitted: 269 Running: 20 Cancelled: 0 Done-Ok: 249 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 249/1000 2014-08-18 13:02:38.918702 Submitted: 269 Running: 19 Cancelled: 0 Done-Ok: 250 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 250/1000 2014-08-18 13:02:40.578589 Submitted: 270 Running: 20 Cancelled: 0 Done-Ok: 250 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 250/1000 2014-08-18 13:02:42.411476 Submitted: 270 Running: 19 Cancelled: 0 Done-Ok: 251 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 251/1000 2014-08-18 13:02:43.416671 Submitted: 270 Running: 18 Cancelled: 0 Done-Ok: 252 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 252/1000 2014-08-18 13:02:43.773922 Submitted: 270 Running: 17 Cancelled: 0 Done-Ok: 253 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collect, 'https://cert-08.pd.infn.it:8443/CREAM864199700\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM864199700 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM864199700 2014-08-18 12:58:42.818084 Submit https://cert-08.pd.infn.it:8443/CREAM864199700 Left: 745 (at submission time:745) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM864199700 2014-08-18 13:00:37.991107 Exit https://cert-08.pd.infn.it:8443/CREAM793349880 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:00:38,403 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:00:38,434 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:00:38,434 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:00:38,434 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130038.log]\n', '2014-08-18 13:00:38,445 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:00:39,299 DEBUG - Will invoke JobStart for JobID [CREAM245304253]\n', 'https://cert-08.pd.infn.it:8443/CREAM245304253\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM245304253 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM245304253 2014-08-18 13:00:39.526209 Submit https://cert-08.pd.infn.it:8443/CREAM245304253 Left: 738 (at submission time:738) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM245304253 2014-08-18 13:02:38.917281 Exit https://cert-08.pd.infn.it:8443/CREAM053410182 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:02:39,246 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:02:39,271 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:02:39,271 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:02:39,271 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130239.log]\n', '2014-08-18 13:02:39,283 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:02:40,270 DEBUG - Will invoke JobStart for JobID [CREAM423181801]\n', 'https://cert-08.pd.infn.it:8443/CREAM423181801\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM423181801 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM423181801 2014-08-18 13:02:40.576728 Submit https://cert-08.pd.infn.it:8443/CREAM423181801 Left: 730 (at submission time:730) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM423181801 2014-08-18 13:02:43.413561 Exit https://cert-08.pd.infn.it:8443/CREAM422201941 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp, 'https://cert-08.pd.infn.it:8443/CREAM348574246\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM348574246 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM348574246 2014-08-18 12:59:43.785815 Submit https://cert-08.pd.infn.it:8443/CREAM348574246 Left: 740 (at submission time:740) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM348574246 2014-08-18 12:59:44.082704 Exit https://cert-08.pd.infn.it:8443/CREAM086452572 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 12:59:44,831 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 12:59:44,849 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 12:59:44,850 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 12:59:44,850 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-125944.log]\n', '2014-08-18 12:59:44,853 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 12:59:46,157 DEBUG - Will invoke JobStart for JobID [CREAM219587354]\n', 'https://cert-08.pd.infn.it:8443/CREAM219587354\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM219587354 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM219587354 2014-08-18 12:59:46.349949 Submit https://cert-08.pd.infn.it:8443/CREAM219587354 Left: 739 (at submission time:739) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM219587354 2014-08-18 13:01:42.527391 Exit https://cert-08.pd.infn.it:8443/CREAM509925452 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:01:43,098 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:01:43,125 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:01:43,125 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:01:43,125 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130143.log]\n', '2014-08-18 13:01:43,128 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:01:44,149 DEBUG - Will invoke JobStart for JobID [CREAM153386542]\n', 'https://cert-08.pd.infn.it:8443/CREAM153386542\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM153386542 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM153386542 2014-08-18 13:01:44.431050 Submit https://cert-08.pd.infn.it:8443/CREAM153386542 Left: 733 (at submission time:733) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM153386542 2014-08-18 13:02:43.771942 Exit https://cert-08.pd.infn.it:8443/CREAM886445400 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp, 'https://cert-08.pd.infn.it:8443/CREAM211150607\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM211150607 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM211150607 2014-08-18 12:59:39.604846 Submit https://cert-08.pd.infn.it:8443/CREAM211150607 Left: 742 (at submission time:742) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM211150607 2014-08-18 13:00:43.166872 Exit https://cert-08.pd.infn.it:8443/CREAM226039973 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:00:43,904 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:00:43,935 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:00:43,935 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:00:43,935 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130043.log]\n', '2014-08-18 13:00:43,950 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:00:44,956 DEBUG - Will invoke JobStart for JobID [CREAM700996576]\n', 'https://cert-08.pd.infn.it:8443/CREAM700996576\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM700996576 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM700996576 2014-08-18 13:00:45.318450 Submit https://cert-08.pd.infn.it:8443/CREAM700996576 Left: 736 (at submission time:736) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM700996576 2014-08-18 13:01:43.378087 Exit https://cert-08.pd.infn.it:8443/CREAM298894878 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:01:44,291 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:01:44,321 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:01:44,321 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:01:44,321 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130144.log]\n', '2014-08-18 13:01:44,325 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:01:45,313 DEBUG - Will invoke JobStart for JobID [CREAM356718707]\n', 'https://cert-08.pd.infn.it:8443/CREAM356718707\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM356718707 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM356718707 2014-08-18 13:01:45.539185 Submit https://cert-08.pd.infn.it:8443/CREAM356718707 Left: 731 (at submission time:731) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM356718707 2014-08-18 13:03:39.457222 Exit https://cert-08.pd.infn.it:8443/CREAM982507851 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp, 'https://cert-08.pd.infn.it:8443/CREAM662580471\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM662580471 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM662580471 2014-08-18 12:59:43.709685 Submit https://cert-08.pd.infn.it:8443/CREAM662580471 Left: 741 (at submission time:741) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM662580471 2014-08-18 13:00:41.232678 Exit https://cert-08.pd.infn.it:8443/CREAM356644296 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:00:41,930 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:00:41,954 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:00:41,955 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:00:41,955 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130041.log]\n', '2014-08-18 13:00:41,958 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:00:43,096 DEBUG - Will invoke JobStart for JobID [CREAM327522677]\n', 'https://cert-08.pd.infn.it:8443/CREAM327522677\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM327522677 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM327522677 2014-08-18 13:00:43.358523 Submit https://cert-08.pd.infn.it:8443/CREAM327522677 Left: 737 (at submission time:737) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM327522677 2014-08-18 13:01:38.459091 Exit https://cert-08.pd.infn.it:8443/CREAM553226610 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:01:38,782 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:01:38,804 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:01:38,804 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:01:38,804 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130138.log]\n', '2014-08-18 13:01:38,813 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:01:39,746 DEBUG - Will invoke JobStart for JobID [CREAM696900015]\n', 'https://cert-08.pd.infn.it:8443/CREAM696900015\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM696900015 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM696900015 2014-08-18 13:01:39.890869 Submit https://cert-08.pd.infn.it:8443/CREAM696900015 Left: 734 (at submission time:734) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM696900015 2014-08-18 13:03:43.881930 Exit https://cert-08.pd.infn.it:8443/CREAM902402522 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:02:44,412 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:02:44,450 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:02:44,451 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:02:44,451 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130244.log]\n', '2014-08-18 13:02:44,454 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:02:45,521 DEBUG - Will invoke JobStart for JobID [CREAM799614428]\n', 'https://cert-08.pd.infn.it:8443/CREAM799614428\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM799614428 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM799614428 2014-08-18 13:02:45.729668 Submit https://cert-08.pd.infn.it:8443/CREAM799614428 Left: 727 (at submission time:727) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM799614428 2014-08-18 13:04:43.318112 Exit https://cert-08.pd.infn.it:8443/CREAM348574246 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:04:44,242 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:04:44,266 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:04:44,266 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:04:44,266 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130444.log]\n', '2014-08-18 13:04:44,269 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:04:45,193 DEBUG - Will invoke JobStart for JobID [CREAM144624265]\n', 'https://cert-08.pd.infn.it:8443/CREAM144624265\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM144624265 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM144624265 2014-08-18 13:04:45.338395 Submit https://cert-08.pd.infn.it:8443/CREAM144624265 Left: 721 (at submission time:721) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM144624265 2014-08-18 13:04:45.752705 Exit https://cert-08.pd.infn.it:8443/CREAM219587354 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:04:46,507 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:04:46,526 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:04:46,526 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:04:46,526 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130446.log]\n', '2014-08-18 13:04:46,530 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError =ed 253/1000 2014-08-18 13:02:44.659542 Submitted: 271 Running: 18 Cancelled: 0 Done-Ok: 253 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 253/1000 2014-08-18 13:02:45.733140 Submitted: 272 Running: 19 Cancelled: 0 Done-Ok: 253 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 253/1000 2014-08-18 13:02:45.943640 Submitted: 273 Running: 20 Cancelled: 0 Done-Ok: 253 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 253/1000 2014-08-18 13:03:39.458371 Submitted: 273 Running: 19 Cancelled: 0 Done-Ok: 254 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 254/1000 2014-08-18 13:03:41.222078 Submitted: 274 Running: 20 Cancelled: 0 Done-Ok: 254 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 254/1000 2014-08-18 13:03:43.101786 Submitted: 274 Running: 19 Cancelled: 0 Done-Ok: 255 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 255/1000 2014-08-18 13:03:43.884899 Submitted: 274 Running: 18 Cancelled: 0 Done-Ok: 256 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 256/1000 2014-08-18 13:03:44.640690 Submitted: 274 Running: 17 Cancelled: 0 Done-Ok: 257 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 257/1000 2014-08-18 13:03:45.466922 Submitted: 275 Running: 18 Cancelled: 0 Done-Ok: 257 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 257/1000 2014-08-18 13:03:46.326896 Submitted: 276 Running: 19 Cancelled: 0 Done-Ok: 257 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 257/1000 2014-08-18 13:03:46.832622 Submitted: 277 Running: 20 Cancelled: 0 Done-Ok: 257 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 257/1000 2014-08-18 13:04:40.033558 Submitted: 277 Running: 19 Cancelled: 0 Done-Ok: 258 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 258/1000 2014-08-18 13:04:41.525221 Submitted: 278 Running: 20 Cancelled: 0 Done-Ok: 258 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 258/1000 2014-08-18 13:04:43.319482 Submitted: 278 Running: 19 Cancelled: 0 Done-Ok: 259 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 259/1000 2014-08-18 13:04:44.467855 Submitted: 278 Running: 18 Cancelled: 0 Done-Ok: 260 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 260/1000 2014-08-18 13:04:45.341657 Submitted: 279 Running: 19 Cancelled: 0 Done-Ok: 260 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 260/1000 2014-08-18 13:04:45.755855 Submitted: 279 Running: 18 Cancelled: 0 Done-Ok: 261 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 261/1000 2014-08-18 13:04:46.323820 Submitted: 280 Running: 19 Cancelled: 0 Done-Ok: 261 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 261/1000 2014-08-18 13:04:47.718335 Submitted: 281 Running: 20 Cancelled: 0 Done-Ok: 261 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 261/1000 2014-08-18 13:05:40.633945 Submitted: 281 Running: 19 Cancelled: 0 Done-Ok: 262 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Col/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:02:44,339 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:02:44,371 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:02:44,371 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:02:44,371 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130244.log]\n', '2014-08-18 13:02:44,376 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:02:45,666 DEBUG - Will invoke JobStart for JobID [CREAM585458036]\n', 'https://cert-08.pd.infn.it:8443/CREAM585458036\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM585458036 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM585458036 2014-08-18 13:02:45.940678 Submit https://cert-08.pd.infn.it:8443/CREAM585458036 Left: 728 (at submission time:728) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM585458036 2014-08-18 13:03:43.100431 Exit https://cert-08.pd.infn.it:8443/CREAM864199700 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:03:43,820 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:03:43,845 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:03:43,845 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:03:43,845 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130343.log]\n', '2014-08-18 13:03:43,855 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:03:44,994 DEBUG - Will invoke JobStart for JobID [CREAM032358748]\n', 'https://cert-08.pd.infn.it:8443/CREAM032358748\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM032358748 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM032358748 2014-08-18 13:03:45.464459 Submit https://cert-08.pd.infn.it:8443/CREAM032358748 Left: 725 (at submission time:725) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM032358748 2014-08-18 13:05:40.631782 Exit https://cert-08.pd.infn.it:8443/CREAM245304253 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:05:40,969 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:05:40,997 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:05:40,998 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:05:40,998 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130540.log]\n', '2014-08-18 13:05:41,004 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError =/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:03:44,687 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:03:44,707 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:03:44,707 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:03:44,707 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130344.log]\n', '2014-08-18 13:03:44,710 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:03:45,780 DEBUG - Will invoke JobStart for JobID [CREAM588250244]\n', 'https://cert-08.pd.infn.it:8443/CREAM588250244\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM588250244 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM588250244 2014-08-18 13:03:46.322072 Submit https://cert-08.pd.infn.it:8443/CREAM588250244 Left: 724 (at submission time:724) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM588250244 2014-08-18 13:04:44.465908 Exit https://cert-08.pd.infn.it:8443/CREAM662580471 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:04:45,211 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:04:45,230 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:04:45,230 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:04:45,230 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130445.log]\n', '2014-08-18 13:04:45,233 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:04:46,086 DEBUG - Will invoke JobStart for JobID [CREAM691321181]\n', 'https://cert-08.pd.infn.it:8443/CREAM691321181\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM691321181 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM691321181 2014-08-18 13:04:46.322487 Submit https://cert-08.pd.infn.it:8443/CREAM691321181 Left: 720 (at submission time:720) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM691321181 2014-08-18 13:05:43.592499 Exit https://cert-08.pd.infn.it:8443/CREAM327522677 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:05:44,291 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:05:44,314 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:05:44,315 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:05:44,315 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130544.log]\n', '2014-08-18 13:05:44,318 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError =/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:02:43,231 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:02:43,258 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:02:43,259 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:02:43,259 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130243.log]\n', '2014-08-18 13:02:43,262 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:02:44,245 DEBUG - Will invoke JobStart for JobID [CREAM943694352]\n', 'https://cert-08.pd.infn.it:8443/CREAM943694352\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM943694352 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM943694352 2014-08-18 13:02:44.656316 Submit https://cert-08.pd.infn.it:8443/CREAM943694352 Left: 729 (at submission time:729) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM943694352 2014-08-18 13:03:44.638829 Exit https://cert-08.pd.infn.it:8443/CREAM199551983 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:03:45,518 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:03:45,554 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:03:45,554 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:03:45,554 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130345.log]\n', '2014-08-18 13:03:45,567 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:03:46,594 DEBUG - Will invoke JobStart for JobID [CREAM863285117]\n', 'https://cert-08.pd.infn.it:8443/CREAM863285117\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM863285117 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM863285117 2014-08-18 13:03:46.829823 Submit https://cert-08.pd.infn.it:8443/CREAM863285117 Left: 723 (at submission time:723) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM863285117 2014-08-18 13:05:44.852053 Exit https://cert-08.pd.infn.it:8443/CREAM086933931 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:05:45,542 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:05:45,566 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:05:45,566 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:05:45,567 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130545.log]\n', '2014-08-18 13:05:45,570 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError =/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:03:39,823 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:03:39,851 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:03:39,851 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:03:39,851 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130339.log]\n', '2014-08-18 13:03:39,859 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:03:40,778 DEBUG - Will invoke JobStart for JobID [CREAM864962154]\n', 'https://cert-08.pd.infn.it:8443/CREAM864962154\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM864962154 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM864962154 2014-08-18 13:03:41.220119 Submit https://cert-08.pd.infn.it:8443/CREAM864962154 Left: 726 (at submission time:726) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM864962154 2014-08-18 13:04:40.031346 Exit https://cert-08.pd.infn.it:8443/CREAM211150607 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:04:40,394 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:04:40,413 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:04:40,413 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:04:40,413 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130440.log]\n', '2014-08-18 13:04:40,426 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:04:41,236 DEBUG - Will invoke JobStart for JobID [CREAM193279785]\n', 'https://cert-08.pd.infn.it:8443/CREAM193279785\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM193279785 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM193279785 2014-08-18 13:04:41.523937 Submit https://cert-08.pd.infn.it:8443/CREAM193279785 Left: 722 (at submission time:722) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM193279785 2014-08-18 13:05:45.383200 Exit https://cert-08.pd.infn.it:8443/CREAM700996576 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:05:46,241 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:05:46,266 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:05:46,267 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:05:46,267 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130546.log]\n', '2014-08-18 13:05:46,273 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError =lected 262/1000 2014-08-18 13:05:42.368465 Submitted: 282 Running: 20 Cancelled: 0 Done-Ok: 262 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 262/1000 2014-08-18 13:05:43.595649 Submitted: 282 Running: 19 Cancelled: 0 Done-Ok: 263 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 263/1000 2014-08-18 13:05:44.853293 Submitted: 282 Running: 18 Cancelled: 0 Done-Ok: 264 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 264/1000 2014-08-18 13:05:45.386263 Submitted: 282 Running: 17 Cancelled: 0 Done-Ok: 265 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 265/1000 2014-08-18 13:05:45.487332 Submitted: 283 Running: 18 Cancelled: 0 Done-Ok: 265 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 265/1000 2014-08-18 13:05:46.967318 Submitted: 284 Running: 19 Cancelled: 0 Done-Ok: 265 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 265/1000 2014-08-18 13:05:47.668016 Submitted: 285 Running: 20 Cancelled: 0 Done-Ok: 265 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 265/1000 2014-08-18 13:06:40.619861 Submitted: 285 Running: 19 Cancelled: 0 Done-Ok: 266 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 266/1000 2014-08-18 13:06:41.951176 Submitted: 286 Running: 20 Cancelled: 0 Done-Ok: 266 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 266/1000 2014-08-18 13:06:44.471161 Submitted: 286 Running: 19 Cancelled: 0 Done-Ok: 267 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 267/1000 2014-08-18 13:06:44.547436 Submitted: 286 Running: 18 Cancelled: 0 Done-Ok: 268 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 268/1000 2014-08-18 13:06:45.572986 Submitted: 286 Running: 17 Cancelled: 0 Done-Ok: 269 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 269/1000 2014-08-18 13:06:46.299275 Submitted: 287 Running: 18 Cancelled: 0 Done-Ok: 269 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 269/1000 2014-08-18 13:06:46.771774 Submitted: 288 Running: 19 Cancelled: 0 Done-Ok: 269 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 269/1000 2014-08-18 13:06:47.928327 Submitted: 289 Running: 20 Cancelled: 0 Done-Ok: 269 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 269/1000 2014-08-18 13:07:41.129459 Submitted: 289 Running: 19 Cancelled: 0 Done-Ok: 270 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 270/1000 2014-08-18 13:07:42.713561 Submitted: 290 Running: 20 Cancelled: 0 Done-Ok: 270 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 270/1000 2014-08-18 13:07:44.999837 Submitted: 290 Running: 19 Cancelled: 0 Done-Ok: 271 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 271/1000 2014-08-18 13:07:45.155130 Submitted: 290 Running: 18 Cancelled: 0 Done-Ok: 272 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 272/1000 2014-08-18 13:07:45.759793 Submitted: 290 Running: 17 Cancelled: 0 Done-Ok: 273 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:05:41,884 DEBUG - Will invoke JobStart for JobID [CREAM046997851]\n', 'https://cert-08.pd.infn.it:8443/CREAM046997851\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM046997851 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM046997851 2014-08-18 13:05:42.363750 Submit https://cert-08.pd.infn.it:8443/CREAM046997851 Left: 718 (at submission time:718) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM046997851 2014-08-18 13:07:41.127325 Exit https://cert-08.pd.infn.it:8443/CREAM423181801 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:07:41,463 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:07:41,488 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:07:41,488 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:07:41,488 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130741.log]\n', '2014-08-18 13:07:41,491 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:07:42,409 DEBUG - Will invoke JobStart for JobID [CREAM188407646]\n', 'https://cert-08.pd.infn.it:8443/CREAM188407646\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM188407646 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM188407646 2014-08-18 13:07:42.711031 Submit https://cert-08.pd.infn.it:8443/CREAM188407646 Left: 710 (at submission time:710) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM188407646 2014-08-18 13:07:45.756986 Exit https://cert-08.pd.infn.it:8443/CREAM585458036 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:07:46,678 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:07:46,699 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:07:46,699 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:07:46,699 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130746.log]\n', '2014-08-18 13:07:46,702 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:07:47,993 DEBUG - Will invoke JobStart for JobID [CREAM701349339]\n', 'https://cert-08.pd.infn.it:8443/CREAM701349339\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM701349339 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM701349339 2014-08-18 13:07:48.518173 Submit https://cert-08.pd.infn.it:8443/CREAM701349339 Left: 707 (at submission time:707) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM701349339 2014-08-18 13:08:44.902620 Exit https://cert-08.pd.infn.it:8443/CREAM032358748 Status: "DONE-OK" Entering sub "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:05:46,654 DEBUG - Will invoke JobStart for JobID [CREAM587924918]\n', 'https://cert-08.pd.infn.it:8443/CREAM587924918\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM587924918 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM587924918 2014-08-18 13:05:46.963251 Submit https://cert-08.pd.infn.it:8443/CREAM587924918 Left: 716 (at submission time:716) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM587924918 2014-08-18 13:06:45.571671 Exit https://cert-08.pd.infn.it:8443/CREAM821841517 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:06:46,461 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:06:46,496 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:06:46,497 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:06:46,497 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130646.log]\n', '2014-08-18 13:06:46,501 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:06:47,668 DEBUG - Will invoke JobStart for JobID [CREAM344711224]\n', 'https://cert-08.pd.infn.it:8443/CREAM344711224\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM344711224 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM344711224 2014-08-18 13:06:47.924252 Submit https://cert-08.pd.infn.it:8443/CREAM344711224 Left: 711 (at submission time:711) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM344711224 2014-08-18 13:07:44.995588 Exit https://cert-08.pd.infn.it:8443/CREAM943694352 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:07:45,694 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:07:45,713 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:07:45,714 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:07:45,714 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130745.log]\n', '2014-08-18 13:07:45,717 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:07:46,976 DEBUG - Will invoke JobStart for JobID [CREAM050725776]\n', 'https://cert-08.pd.infn.it:8443/CREAM050725776\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM050725776 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM050725776 2014-08-18 13:07:47.308591 Submit https://cert-08.pd.infn.it:8443/CREAM050725776 Left: 709 (at submission time:709) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM050725776 2014-08-18 13:08:45.583343 Exit https://cert-08.pd.infn.it:8443/CREAM863285117 Status: "DONE-OK" Entering sub "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:05:47,394 DEBUG - Will invoke JobStart for JobID [CREAM931462869]\n', 'https://cert-08.pd.infn.it:8443/CREAM931462869\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM931462869 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM931462869 2014-08-18 13:05:47.665098 Submit https://cert-08.pd.infn.it:8443/CREAM931462869 Left: 715 (at submission time:715) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM931462869 2014-08-18 13:06:44.544186 Exit https://cert-08.pd.infn.it:8443/CREAM356718707 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:06:45,280 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:06:45,303 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:06:45,303 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:06:45,303 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130645.log]\n', '2014-08-18 13:06:45,307 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:06:46,451 DEBUG - Will invoke JobStart for JobID [CREAM841724341]\n', 'https://cert-08.pd.infn.it:8443/CREAM841724341\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM841724341 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM841724341 2014-08-18 13:06:46.769949 Submit https://cert-08.pd.infn.it:8443/CREAM841724341 Left: 712 (at submission time:712) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM841724341 2014-08-18 13:08:41.356480 Exit https://cert-08.pd.infn.it:8443/CREAM864962154 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:08:41,761 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:08:41,785 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:08:41,785 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:08:41,785 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130841.log]\n', '2014-08-18 13:08:41,788 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:08:42,626 DEBUG - Will invoke JobStart for JobID [CREAM785441999]\n', 'https://cert-08.pd.infn.it:8443/CREAM785441999\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM785441999 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM785441999 2014-08-18 13:08:42.920426 Submit https://cert-08.pd.infn.it:8443/CREAM785441999 Left: 706 (at submission time:706) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM785441999 2014-08-18 13:09:41.823694 Exit https://cert-08.pd.infn.it:8443/CREAM193279785 Status: "DONE-OK" Entering sub "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:04:47,518 DEBUG - Will invoke JobStart for JobID [CREAM255585902]\n', 'https://cert-08.pd.infn.it:8443/CREAM255585902\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM255585902 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM255585902 2014-08-18 13:04:47.715029 Submit https://cert-08.pd.infn.it:8443/CREAM255585902 Left: 719 (at submission time:719) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM255585902 2014-08-18 13:06:44.469967 Exit https://cert-08.pd.infn.it:8443/CREAM153386542 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:06:44,935 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:06:44,964 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:06:44,964 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:06:44,964 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130644.log]\n', '2014-08-18 13:06:44,973 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:06:46,092 DEBUG - Will invoke JobStart for JobID [CREAM185563836]\n', 'https://cert-08.pd.infn.it:8443/CREAM185563836\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM185563836 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM185563836 2014-08-18 13:06:46.296644 Submit https://cert-08.pd.infn.it:8443/CREAM185563836 Left: 713 (at submission time:713) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM185563836 2014-08-18 13:07:45.152611 Exit https://cert-08.pd.infn.it:8443/CREAM799614428 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:07:45,829 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:07:45,871 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:07:45,871 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:07:45,871 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130745.log]\n', '2014-08-18 13:07:45,879 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:07:47,299 DEBUG - Will invoke JobStart for JobID [CREAM838641241]\n', 'https://cert-08.pd.infn.it:8443/CREAM838641241\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM838641241 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM838641241 2014-08-18 13:07:47.544781 Submit https://cert-08.pd.infn.it:8443/CREAM838641241 Left: 708 (at submission time:708) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM838641241 2014-08-18 13:09:46.177226 Exit https://cert-08.pd.infn.it:8443/CREAM144624265 Status: "DONE-OK" Entering sub "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:05:45,186 DEBUG - Will invoke JobStart for JobID [CREAM989832911]\n', 'https://cert-08.pd.infn.it:8443/CREAM989832911\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM989832911 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM989832911 2014-08-18 13:05:45.485923 Submit https://cert-08.pd.infn.it:8443/CREAM989832911 Left: 717 (at submission time:717) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM989832911 2014-08-18 13:06:40.616830 Exit https://cert-08.pd.infn.it:8443/CREAM696900015 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:06:40,933 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:06:40,956 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:06:40,956 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:06:40,956 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130640.log]\n', '2014-08-18 13:06:40,970 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:06:41,760 DEBUG - Will invoke JobStart for JobID [CREAM101528785]\n', 'https://cert-08.pd.infn.it:8443/CREAM101528785\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM101528785 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM101528785 2014-08-18 13:06:41.949688 Submit https://cert-08.pd.infn.it:8443/CREAM101528785 Left: 714 (at submission time:714) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM101528785 2014-08-18 13:08:45.517198 Exit https://cert-08.pd.infn.it:8443/CREAM588250244 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:08:46,237 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:08:46,268 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:08:46,268 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:08:46,268 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130846.log]\n', '2014-08-18 13:08:46,271 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:08:47,515 DEBUG - Will invoke JobStart for JobID [CREAM184905119]\n', 'https://cert-08.pd.infn.it:8443/CREAM184905119\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM184905119 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM184905119 2014-08-18 13:08:47.864805 Submit https://cert-08.pd.infn.it:8443/CREAM184905119 Left: 704 (at submission time:704) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM184905119 2014-08-18 13:09:47.264589 Exit https://cert-08.pd.infn.it:8443/CREAM691321181 Status: "DONE-OK" Entering sub Collected 273/1000 2014-08-18 13:07:47.312018 Submitted: 291 Running: 18 Cancelled: 0 Done-Ok: 273 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 273/1000 2014-08-18 13:07:47.548985 Submitted: 292 Running: 19 Cancelled: 0 Done-Ok: 273 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 273/1000 2014-08-18 13:07:48.524775 Submitted: 293 Running: 20 Cancelled: 0 Done-Ok: 273 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 273/1000 2014-08-18 13:08:41.359068 Submitted: 293 Running: 19 Cancelled: 0 Done-Ok: 274 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 274/1000 2014-08-18 13:08:42.923056 Submitted: 294 Running: 20 Cancelled: 0 Done-Ok: 274 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 274/1000 2014-08-18 13:08:44.904590 Submitted: 294 Running: 19 Cancelled: 0 Done-Ok: 275 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 275/1000 2014-08-18 13:08:45.520022 Submitted: 294 Running: 18 Cancelled: 0 Done-Ok: 276 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 276/1000 2014-08-18 13:08:45.586597 Submitted: 294 Running: 17 Cancelled: 0 Done-Ok: 277 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 277/1000 2014-08-18 13:08:47.316729 Submitted: 295 Running: 18 Cancelled: 0 Done-Ok: 277 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 277/1000 2014-08-18 13:08:47.866656 Submitted: 296 Running: 19 Cancelled: 0 Done-Ok: 277 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 277/1000 2014-08-18 13:08:48.180747 Submitted: 297 Running: 20 Cancelled: 0 Done-Ok: 277 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 277/1000 2014-08-18 13:09:41.828471 Submitted: 297 Running: 19 Cancelled: 0 Done-Ok: 278 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 278/1000 2014-08-18 13:09:43.660811 Submitted: 298 Running: 20 Cancelled: 0 Done-Ok: 278 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 278/1000 2014-08-18 13:09:46.180341 Submitted: 298 Running: 19 Cancelled: 0 Done-Ok: 279 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 279/1000 2014-08-18 13:09:47.268076 Submitted: 298 Running: 18 Cancelled: 0 Done-Ok: 280 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 280/1000 2014-08-18 13:09:47.995006 Submitted: 299 Running: 19 Cancelled: 0 Done-Ok: 280 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 280/1000 2014-08-18 13:09:48.573352 Submitted: 299 Running: 18 Cancelled: 0 Done-Ok: 281 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 281/1000 2014-08-18 13:09:49.348554 Submitted: 300 Running: 19 Cancelled: 0 Done-Ok: 281 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 281/1000 2014-08-18 13:09:50.605805 Submitted: 301 Running: 20 Cancelled: 0 Done-Ok: 281 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 281/1000 2014-08-18 13:10:42.528920 Submitted: 301 Running: 19 Cancelled: 0 Done-Ok: 282 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 mit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:09:47,862 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:09:47,884 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:09:47,884 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:09:47,884 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130947.log]\n', '2014-08-18 13:09:47,888 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:09:48,916 DEBUG - Will invoke JobStart for JobID [CREAM566442954]\n', 'https://cert-08.pd.infn.it:8443/CREAM566442954\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM566442954 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM566442954 2014-08-18 13:09:49.344056 Submit https://cert-08.pd.infn.it:8443/CREAM566442954 Left: 700 (at submission time:700) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM566442954 2014-08-18 13:10:45.764868 Exit https://cert-08.pd.infn.it:8443/CREAM989832911 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:10:46,530 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:10:46,561 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:10:46,561 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:10:46,561 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131046.log]\n', '2014-08-18 13:10:46,565 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:10:47,607 DEBUG - Will invoke JobStart for JobID [CREAM965298598]\n', 'https://cert-08.pd.infn.it:8443/CREAM965298598\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM965298598 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM965298598 2014-08-18 13:10:48.072796 Submit https://cert-08.pd.infn.it:8443/CREAM965298598 Left: 697 (at submission time:697) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM965298598 2014-08-18 13:11:42.929106 Exit https://cert-08.pd.infn.it:8443/CREAM101528785 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:11:43,291 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:11:43,316 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:11:43,316 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:11:43,317 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131143.log]\n', '2014-08-18 13:11:43,321 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDLmit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:09:46,667 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:09:46,699 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:09:46,699 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:09:46,699 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130946.log]\n', '2014-08-18 13:09:46,703 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:09:47,692 DEBUG - Will invoke JobStart for JobID [CREAM931423244]\n', 'https://cert-08.pd.infn.it:8443/CREAM931423244\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM931423244 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM931423244 2014-08-18 13:09:47.992839 Submit https://cert-08.pd.infn.it:8443/CREAM931423244 Left: 701 (at submission time:701) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM931423244 2014-08-18 13:09:48.570087 Exit https://cert-08.pd.infn.it:8443/CREAM255585902 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:09:49,100 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:09:49,123 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:09:49,123 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:09:49,124 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130949.log]\n', '2014-08-18 13:09:49,132 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:09:50,314 DEBUG - Will invoke JobStart for JobID [CREAM587157742]\n', 'https://cert-08.pd.infn.it:8443/CREAM587157742\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM587157742 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM587157742 2014-08-18 13:09:50.603255 Submit https://cert-08.pd.infn.it:8443/CREAM587157742 Left: 699 (at submission time:699) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM587157742 2014-08-18 13:11:46.939068 Exit https://cert-08.pd.infn.it:8443/CREAM185563836 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:11:47,608 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:11:47,631 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:11:47,631 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:11:47,631 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131147.log]\n', '2014-08-18 13:11:47,634 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDLmit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:08:46,355 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:08:46,378 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:08:46,378 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:08:46,378 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130846.log]\n', '2014-08-18 13:08:46,381 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:08:47,758 DEBUG - Will invoke JobStart for JobID [CREAM131372734]\n', 'https://cert-08.pd.infn.it:8443/CREAM131372734\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM131372734 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM131372734 2014-08-18 13:08:48.179023 Submit https://cert-08.pd.infn.it:8443/CREAM131372734 Left: 703 (at submission time:703) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM131372734 2014-08-18 13:10:46.590016 Exit https://cert-08.pd.infn.it:8443/CREAM587924918 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:10:47,499 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:10:47,523 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:10:47,523 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:10:47,523 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131047.log]\n', '2014-08-18 13:10:47,527 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:10:48,590 DEBUG - Will invoke JobStart for JobID [CREAM577766952]\n', 'https://cert-08.pd.infn.it:8443/CREAM577766952\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM577766952 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM577766952 2014-08-18 13:10:48.726685 Submit https://cert-08.pd.infn.it:8443/CREAM577766952 Left: 696 (at submission time:696) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM577766952 2014-08-18 13:11:47.076781 Exit https://cert-08.pd.infn.it:8443/CREAM344711224 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:11:47,753 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:11:47,776 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:11:47,777 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:11:47,777 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131147.log]\n', '2014-08-18 13:11:47,780 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDLmit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:09:42,161 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:09:42,184 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:09:42,184 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:09:42,184 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130942.log]\n', '2014-08-18 13:09:42,196 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:09:43,245 DEBUG - Will invoke JobStart for JobID [CREAM080469433]\n', 'https://cert-08.pd.infn.it:8443/CREAM080469433\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM080469433 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM080469433 2014-08-18 13:09:43.659685 Submit https://cert-08.pd.infn.it:8443/CREAM080469433 Left: 702 (at submission time:702) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM080469433 2014-08-18 13:10:47.679984 Exit https://cert-08.pd.infn.it:8443/CREAM931462869 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:10:48,597 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:10:48,668 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:10:48,668 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:10:48,668 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131048.log]\n', '2014-08-18 13:10:48,676 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:10:49,782 DEBUG - Will invoke JobStart for JobID [CREAM348250262]\n', 'https://cert-08.pd.infn.it:8443/CREAM348250262\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM348250262 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM348250262 2014-08-18 13:10:49.966547 Submit https://cert-08.pd.infn.it:8443/CREAM348250262 Left: 695 (at submission time:695) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM348250262 2014-08-18 13:11:48.084860 Exit https://cert-08.pd.infn.it:8443/CREAM841724341 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:11:48,909 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:11:48,937 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:11:48,937 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:11:48,937 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131148.log]\n', '2014-08-18 13:11:48,947 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDLmit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:08:45,668 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:08:45,693 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:08:45,693 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:08:45,693 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-130845.log]\n', '2014-08-18 13:08:45,695 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:08:46,710 DEBUG - Will invoke JobStart for JobID [CREAM244888671]\n', 'https://cert-08.pd.infn.it:8443/CREAM244888671\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM244888671 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM244888671 2014-08-18 13:08:47.314209 Submit https://cert-08.pd.infn.it:8443/CREAM244888671 Left: 705 (at submission time:705) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM244888671 2014-08-18 13:10:42.526709 Exit https://cert-08.pd.infn.it:8443/CREAM046997851 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:10:42,862 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:10:42,902 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:10:42,902 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:10:42,902 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131042.log]\n', '2014-08-18 13:10:42,905 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:10:43,631 DEBUG - Will invoke JobStart for JobID [CREAM364330210]\n', 'https://cert-08.pd.infn.it:8443/CREAM364330210\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM364330210 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM364330210 2014-08-18 13:10:43.897721 Submit https://cert-08.pd.infn.it:8443/CREAM364330210 Left: 698 (at submission time:698) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM364330210 2014-08-18 13:12:42.795192 Exit https://cert-08.pd.infn.it:8443/CREAM188407646 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:12:43,563 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:12:43,614 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:12:43,614 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:12:43,614 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131243.log]\n', '2014-08-18 13:12:43,617 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL Collected 282/1000 2014-08-18 13:10:43.900711 Submitted: 302 Running: 20 Cancelled: 0 Done-Ok: 282 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 282/1000 2014-08-18 13:10:45.768465 Submitted: 302 Running: 19 Cancelled: 0 Done-Ok: 283 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 283/1000 2014-08-18 13:10:46.591982 Submitted: 302 Running: 18 Cancelled: 0 Done-Ok: 284 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 284/1000 2014-08-18 13:10:47.682743 Submitted: 302 Running: 17 Cancelled: 0 Done-Ok: 285 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 285/1000 2014-08-18 13:10:48.073873 Submitted: 303 Running: 18 Cancelled: 0 Done-Ok: 285 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 285/1000 2014-08-18 13:10:48.730009 Submitted: 304 Running: 19 Cancelled: 0 Done-Ok: 285 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 285/1000 2014-08-18 13:10:49.970978 Submitted: 305 Running: 20 Cancelled: 0 Done-Ok: 285 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 285/1000 2014-08-18 13:11:42.930294 Submitted: 305 Running: 19 Cancelled: 0 Done-Ok: 286 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 286/1000 2014-08-18 13:11:44.505145 Submitted: 306 Running: 20 Cancelled: 0 Done-Ok: 286 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 286/1000 2014-08-18 13:11:46.940900 Submitted: 306 Running: 19 Cancelled: 0 Done-Ok: 287 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 287/1000 2014-08-18 13:11:47.080552 Submitted: 306 Running: 18 Cancelled: 0 Done-Ok: 288 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 288/1000 2014-08-18 13:11:48.088948 Submitted: 306 Running: 17 Cancelled: 0 Done-Ok: 289 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 289/1000 2014-08-18 13:11:49.180328 Submitted: 307 Running: 18 Cancelled: 0 Done-Ok: 289 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 289/1000 2014-08-18 13:11:49.199475 Submitted: 308 Running: 19 Cancelled: 0 Done-Ok: 289 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 289/1000 2014-08-18 13:11:50.012479 Submitted: 309 Running: 20 Cancelled: 0 Done-Ok: 289 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 289/1000 2014-08-18 13:12:42.797159 Submitted: 309 Running: 19 Cancelled: 0 Done-Ok: 290 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 290/1000 2014-08-18 13:12:44.768763 Submitted: 310 Running: 20 Cancelled: 0 Done-Ok: 290 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 290/1000 2014-08-18 13:12:47.635079 Submitted: 310 Running: 19 Cancelled: 0 Done-Ok: 291 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 291/1000 2014-08-18 13:12:47.851753 Submitted: 310 Running: 18 Cancelled: 0 Done-Ok: 292 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 292/1000 2014-08-18 13:12:47.944299 Submitted: 310 Running: 17 Cancelled: 0 Done-Ok: 293 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:12:44,489 DEBUG - Will invoke JobStart for JobID [CREAM490564582]\n', 'https://cert-08.pd.infn.it:8443/CREAM490564582\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM490564582 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM490564582 2014-08-18 13:12:44.765974 Submit https://cert-08.pd.infn.it:8443/CREAM490564582 Left: 690 (at submission time:690) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM490564582 2014-08-18 13:12:47.850181 Exit https://cert-08.pd.infn.it:8443/CREAM701349339 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:12:48,427 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:12:48,450 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:12:48,450 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:12:48,451 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131248.log]\n', '2014-08-18 13:12:48,454 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:12:49,753 DEBUG - Will invoke JobStart for JobID [CREAM801470158]\n', 'https://cert-08.pd.infn.it:8443/CREAM801470158\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM801470158 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM801470158 2014-08-18 13:12:49.941809 Submit https://cert-08.pd.infn.it:8443/CREAM801470158 Left: 688 (at submission time:688) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM801470158 2014-08-18 13:13:47.383910 Exit https://cert-08.pd.infn.it:8443/CREAM244888671 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:13:48,020 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:13:48,044 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:13:48,044 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:13:48,045 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131348.log]\n', '2014-08-18 13:13:48,048 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:13:48,973 DEBUG - Will invoke JobStart for JobID [CREAM727669301]\n', 'https://cert-08.pd.infn.it:8443/CREAM727669301\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM727669301 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM727669301 2014-08-18 13:13:49.390635 Submit https://cert-08.pd.infn.it:8443/CREAM727669301 Left: 685 (at submission time:685) submission succeeded, returned jobid = http=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:11:48,947 DEBUG - Will invoke JobStart for JobID [CREAM114715270]\n', 'https://cert-08.pd.infn.it:8443/CREAM114715270\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM114715270 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM114715270 2014-08-18 13:11:49.197220 Submit https://cert-08.pd.infn.it:8443/CREAM114715270 Left: 692 (at submission time:692) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM114715270 2014-08-18 13:12:47.633435 Exit https://cert-08.pd.infn.it:8443/CREAM050725776 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:12:48,351 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:12:48,376 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:12:48,376 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:12:48,376 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131248.log]\n', '2014-08-18 13:12:48,379 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:12:49,798 DEBUG - Will invoke JobStart for JobID [CREAM550928277]\n', 'https://cert-08.pd.infn.it:8443/CREAM550928277\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM550928277 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM550928277 2014-08-18 13:12:50.158210 Submit https://cert-08.pd.infn.it:8443/CREAM550928277 Left: 689 (at submission time:689) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM550928277 2014-08-18 13:13:48.805678 Exit https://cert-08.pd.infn.it:8443/CREAM131372734 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:13:49,412 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:13:49,475 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:13:49,475 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:13:49,475 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131349.log]\n', '2014-08-18 13:13:49,482 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:13:50,463 DEBUG - Will invoke JobStart for JobID [CREAM935480235]\n', 'https://cert-08.pd.infn.it:8443/CREAM935480235\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM935480235 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM935480235 2014-08-18 13:13:50.867109 Submit https://cert-08.pd.infn.it:8443/CREAM935480235 Left: 683 (at submission time:683) submission succeeded, returned jobid = http=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:11:49,823 DEBUG - Will invoke JobStart for JobID [CREAM135725029]\n', 'https://cert-08.pd.infn.it:8443/CREAM135725029\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM135725029 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM135725029 2014-08-18 13:11:50.009595 Submit https://cert-08.pd.infn.it:8443/CREAM135725029 Left: 691 (at submission time:691) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM135725029 2014-08-18 13:13:44.025559 Exit https://cert-08.pd.infn.it:8443/CREAM785441999 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:13:44,371 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:13:44,407 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:13:44,407 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:13:44,407 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131344.log]\n', '2014-08-18 13:13:44,412 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:13:45,431 DEBUG - Will invoke JobStart for JobID [CREAM293142029]\n', 'https://cert-08.pd.infn.it:8443/CREAM293142029\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM293142029 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM293142029 2014-08-18 13:13:45.758489 Submit https://cert-08.pd.infn.it:8443/CREAM293142029 Left: 686 (at submission time:686) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM293142029 2014-08-18 13:14:44.995968 Exit https://cert-08.pd.infn.it:8443/CREAM080469433 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:14:45,284 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:14:45,317 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:14:45,317 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:14:45,317 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131445.log]\n', '2014-08-18 13:14:45,326 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:14:46,287 DEBUG - Will invoke JobStart for JobID [CREAM366774941]\n', 'https://cert-08.pd.infn.it:8443/CREAM366774941\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM366774941 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM366774941 2014-08-18 13:14:46.555139 Submit https://cert-08.pd.infn.it:8443/CREAM366774941 Left: 682 (at submission time:682) submission succeeded, returned jobid = http=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:11:48,827 DEBUG - Will invoke JobStart for JobID [CREAM283120877]\n', 'https://cert-08.pd.infn.it:8443/CREAM283120877\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM283120877 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM283120877 2014-08-18 13:11:49.178004 Submit https://cert-08.pd.infn.it:8443/CREAM283120877 Left: 693 (at submission time:693) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM283120877 2014-08-18 13:12:47.940943 Exit https://cert-08.pd.infn.it:8443/CREAM838641241 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:12:48,538 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:12:48,562 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:12:48,562 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:12:48,563 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131248.log]\n', '2014-08-18 13:12:48,566 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:12:49,921 DEBUG - Will invoke JobStart for JobID [CREAM738806084]\n', 'https://cert-08.pd.infn.it:8443/CREAM738806084\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM738806084 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM738806084 2014-08-18 13:12:50.164472 Submit https://cert-08.pd.infn.it:8443/CREAM738806084 Left: 687 (at submission time:687) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM738806084 2014-08-18 13:14:47.635945 Exit https://cert-08.pd.infn.it:8443/CREAM931423244 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:14:48,313 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:14:48,337 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:14:48,337 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:14:48,337 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131448.log]\n', '2014-08-18 13:14:48,341 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:14:49,313 DEBUG - Will invoke JobStart for JobID [CREAM959230573]\n', 'https://cert-08.pd.infn.it:8443/CREAM959230573\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM959230573 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM959230573 2014-08-18 13:14:49.658847 Submit https://cert-08.pd.infn.it:8443/CREAM959230573 Left: 681 (at submission time:681) submission succeeded, returned jobid = http=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:11:44,185 DEBUG - Will invoke JobStart for JobID [CREAM822408071]\n', 'https://cert-08.pd.infn.it:8443/CREAM822408071\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM822408071 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM822408071 2014-08-18 13:11:44.501832 Submit https://cert-08.pd.infn.it:8443/CREAM822408071 Left: 694 (at submission time:694) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM822408071 2014-08-18 13:13:47.840652 Exit https://cert-08.pd.infn.it:8443/CREAM184905119 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:13:48,612 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:13:48,637 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:13:48,638 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:13:48,638 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131348.log]\n', '2014-08-18 13:13:48,647 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:13:49,666 DEBUG - Will invoke JobStart for JobID [CREAM391637835]\n', 'https://cert-08.pd.infn.it:8443/CREAM391637835\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM391637835 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM391637835 2014-08-18 13:13:50.168570 Submit https://cert-08.pd.infn.it:8443/CREAM391637835 Left: 684 (at submission time:684) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM391637835 2014-08-18 13:14:48.950764 Exit https://cert-08.pd.infn.it:8443/CREAM566442954 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:14:49,768 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:14:49,796 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:14:49,796 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:14:49,797 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131449.log]\n', '2014-08-18 13:14:49,800 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:14:50,989 DEBUG - Will invoke JobStart for JobID [CREAM684916433]\n', 'https://cert-08.pd.infn.it:8443/CREAM684916433\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM684916433 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM684916433 2014-08-18 13:14:51.699411 Submit https://cert-08.pd.infn.it:8443/CREAM684916433 Left: 680 (at submission time:680) submission succeeded, returned jobid = http: 0 Collected 293/1000 2014-08-18 13:12:49.943051 Submitted: 311 Running: 18 Cancelled: 0 Done-Ok: 293 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 293/1000 2014-08-18 13:12:50.159518 Submitted: 312 Running: 19 Cancelled: 0 Done-Ok: 293 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 293/1000 2014-08-18 13:12:50.166266 Submitted: 313 Running: 20 Cancelled: 0 Done-Ok: 293 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 293/1000 2014-08-18 13:13:44.027853 Submitted: 313 Running: 19 Cancelled: 0 Done-Ok: 294 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 294/1000 2014-08-18 13:13:45.761619 Submitted: 314 Running: 20 Cancelled: 0 Done-Ok: 294 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 294/1000 2014-08-18 13:13:47.385230 Submitted: 314 Running: 19 Cancelled: 0 Done-Ok: 295 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 295/1000 2014-08-18 13:13:47.843550 Submitted: 314 Running: 18 Cancelled: 0 Done-Ok: 296 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 296/1000 2014-08-18 13:13:48.810304 Submitted: 314 Running: 17 Cancelled: 0 Done-Ok: 297 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 297/1000 2014-08-18 13:13:49.391812 Submitted: 315 Running: 18 Cancelled: 0 Done-Ok: 297 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 297/1000 2014-08-18 13:13:50.170427 Submitted: 316 Running: 19 Cancelled: 0 Done-Ok: 297 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 297/1000 2014-08-18 13:13:50.868874 Submitted: 317 Running: 20 Cancelled: 0 Done-Ok: 297 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 297/1000 2014-08-18 13:14:44.997895 Submitted: 317 Running: 19 Cancelled: 0 Done-Ok: 298 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 298/1000 2014-08-18 13:14:46.556954 Submitted: 318 Running: 20 Cancelled: 0 Done-Ok: 298 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 298/1000 2014-08-18 13:14:47.640298 Submitted: 318 Running: 19 Cancelled: 0 Done-Ok: 299 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 299/1000 2014-08-18 13:14:48.953727 Submitted: 318 Running: 18 Cancelled: 0 Done-Ok: 300 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 300/1000 2014-08-18 13:14:49.660421 Submitted: 319 Running: 19 Cancelled: 0 Done-Ok: 300 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 300/1000 2014-08-18 13:14:50.031687 Submitted: 319 Running: 18 Cancelled: 0 Done-Ok: 301 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 301/1000 2014-08-18 13:14:51.702319 Submitted: 320 Running: 19 Cancelled: 0 Done-Ok: 301 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 301/1000 2014-08-18 13:14:52.235915 Submitted: 321 Running: 20 Cancelled: 0 Done-Ok: 301 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 301/1000 2014-08-18 13:15:45.268663 Submitted: 321 Running: 19 Cancelled: 0 Done-Ok: 302 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 302/1000 2014-08-18 13:15:46.855743 Submitted: 322 Running: 20 Cancelled: 0 Done-Ok: 302 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 302/1000 2014-08-18 13:15:47.707928 Submitted: 322 Running: 19 Cancelled: 0 Done-Ok: 303 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 303/1000 2014-08-18 13:15:48.749133 Submitted: 322 Running: 18 Cancelled: 0 Done-Ok: 304 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 304/1000 2014-08-18 13:15:49.067687 Submitted: 322 Running: 17 Cancelled: 0 Done-Ok: 305 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 305/1000 2014-08-18 13:15:49.841276 Submitted: 323 Running: 18 Cancelled: 0 Done-Ok: 305 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 305/1000 2014-08-18 13:15:51.132465 Submitted: 324 Running: 19 Cancelled: 0 Done-Ok: 305 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 305/1000 2014-08-18 13:15:51.355876 Submitted: 325 Running: 20 Cancelled: 0 Done-Ok: 305 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 305/1000 2014-08-18 13:16:45.692128 Submitted: 325 Running: 19 Cancelled: 0 Done-Ok: 306 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 306/1000 2014-08-18 13:16:47.257019 Submitted: 326 Running: 20 Cancelled: 0 Done-Ok: 306 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 306/1000 2014-08-18 13:16:49.095324 Submitted: 326 Running: 19 Cancelled: 0 Done-Ok: 307 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 307/1000 2014-08-18 13:16:49.346060 Submitted: 326 Running: 18 Cancelled: 0 Done-Ok: 308 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 308/1000 2014-08-18 13:16:49.713891 Submitted: 326 Running: 17 Cancelled: 0 Done-Ok: 309 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 309/1000 2014-08-18 13:16:51.369488 Submitted: 327 Running: 18 Cancelled: 0 Done-Ok: 309 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 309/1000 2014-08-18 13:16:51.828481 Submitted: 328 Running: 19 Cancelled: 0 Done-Ok: 309 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 309/1000 2014-08-18 13:16:52.322412 Submitted: 329 Running: 20 Cancelled: 0 Done-Ok: 309 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 309/1000 2014-08-18 13:17:45.801947 Submitted: 329 Running: 19 Cancelled: 0 Done-Ok: 310 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 310/1000 2014-08-18 13:17:47.330948 Submitted: 330 Running: 20 Cancelled: 0 Done-Ok: 310 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 310/1000 2014-08-18 13:17:49.330335 Submitted: 330 Running: 19 Cancelled: 0 Done-Ok: 311 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 311/1000 2014-08-18 13:17:49.857622 Submitted: 330 Running: 18 Cancelled: 0 Done-Ok: 312 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 312/1000 2014-08-18 13:17:50.059423 Submitted: 330 Running: 17 Cancelled: 0 Done-Ok: 313 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Finas://cert-08.pd.infn.it:8443/CREAM727669301 2014-08-18 13:15:45.265694 Exit https://cert-08.pd.infn.it:8443/CREAM364330210 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:15:45,646 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:15:45,670 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:15:45,670 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:15:45,670 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131545.log]\n', '2014-08-18 13:15:45,677 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:15:46,613 DEBUG - Will invoke JobStart for JobID [CREAM742654156]\n', 'https://cert-08.pd.infn.it:8443/CREAM742654156\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM742654156 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM742654156 2014-08-18 13:15:46.852934 Submit https://cert-08.pd.infn.it:8443/CREAM742654156 Left: 678 (at submission time:678) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM742654156 2014-08-18 13:17:45.798430 Exit https://cert-08.pd.infn.it:8443/CREAM490564582 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:17:46,147 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:17:46,173 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:17:46,173 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:17:46,173 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131746.log]\n', '2014-08-18 13:17:46,181 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:17:47,140 DEBUG - Will invoke JobStart for JobID [CREAM359941701]\n', 'https://cert-08.pd.infn.it:8443/CREAM359941701\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM359941701 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM359941701 2014-08-18 13:17:47.327667 Submit https://cert-08.pd.infn.it:8443/CREAM359941701 Left: 670 (at submission time:670) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM359941701 2014-08-18 13:17:49.326273 Exit https://cert-08.pd.infn.it:8443/CREAM801470158 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:17:50,190 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:17:50,215 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:17:50,215 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:17:50,215 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-cs://cert-08.pd.infn.it:8443/CREAM935480235 2014-08-18 13:15:49.066181 Exit https://cert-08.pd.infn.it:8443/CREAM577766952 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:15:49,709 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:15:49,732 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:15:49,732 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:15:49,732 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131549.log]\n', '2014-08-18 13:15:49,735 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:15:51,138 DEBUG - Will invoke JobStart for JobID [CREAM167299703]\n', 'https://cert-08.pd.infn.it:8443/CREAM167299703\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM167299703 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM167299703 2014-08-18 13:15:51.354990 Submit https://cert-08.pd.infn.it:8443/CREAM167299703 Left: 675 (at submission time:675) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM167299703 2014-08-18 13:16:49.092175 Exit https://cert-08.pd.infn.it:8443/CREAM114715270 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:16:49,835 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:16:49,863 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:16:49,863 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:16:49,863 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131649.log]\n', '2014-08-18 13:16:49,867 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:16:50,957 DEBUG - Will invoke JobStart for JobID [CREAM272443113]\n', 'https://cert-08.pd.infn.it:8443/CREAM272443113\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM272443113 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM272443113 2014-08-18 13:16:51.368593 Submit https://cert-08.pd.infn.it:8443/CREAM272443113 Left: 673 (at submission time:673) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM272443113 2014-08-18 13:17:49.852760 Exit https://cert-08.pd.infn.it:8443/CREAM550928277 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:17:50,477 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:17:50,502 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:17:50,502 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:17:50,502 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-cs://cert-08.pd.infn.it:8443/CREAM959230573 2014-08-18 13:14:50.029404 Exit https://cert-08.pd.infn.it:8443/CREAM587157742 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:14:50,923 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:14:50,952 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:14:50,952 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:14:50,952 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131450.log]\n', '2014-08-18 13:14:50,955 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:14:52,014 DEBUG - Will invoke JobStart for JobID [CREAM158707268]\n', 'https://cert-08.pd.infn.it:8443/CREAM158707268\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM158707268 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM158707268 2014-08-18 13:14:52.232891 Submit https://cert-08.pd.infn.it:8443/CREAM158707268 Left: 679 (at submission time:679) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM158707268 2014-08-18 13:16:49.343188 Exit https://cert-08.pd.infn.it:8443/CREAM283120877 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:16:50,272 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:16:50,298 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:16:50,298 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:16:50,298 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131650.log]\n', '2014-08-18 13:16:50,301 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:16:51,424 DEBUG - Will invoke JobStart for JobID [CREAM143572751]\n', 'https://cert-08.pd.infn.it:8443/CREAM143572751\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM143572751 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM143572751 2014-08-18 13:16:51.826946 Submit https://cert-08.pd.infn.it:8443/CREAM143572751 Left: 672 (at submission time:672) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM143572751 2014-08-18 13:17:50.055181 Exit https://cert-08.pd.infn.it:8443/CREAM738806084 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:17:50,761 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:17:50,785 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:17:50,785 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:17:50,785 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-cs://cert-08.pd.infn.it:8443/CREAM366774941 2014-08-18 13:15:48.744302 Exit https://cert-08.pd.infn.it:8443/CREAM348250262 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:15:49,543 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:15:49,566 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:15:49,566 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:15:49,566 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131549.log]\n', '2014-08-18 13:15:49,570 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:15:50,813 DEBUG - Will invoke JobStart for JobID [CREAM974846878]\n', 'https://cert-08.pd.infn.it:8443/CREAM974846878\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM974846878 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM974846878 2014-08-18 13:15:51.130538 Submit https://cert-08.pd.infn.it:8443/CREAM974846878 Left: 676 (at submission time:676) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM974846878 2014-08-18 13:16:49.710846 Exit https://cert-08.pd.infn.it:8443/CREAM135725029 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:16:50,582 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:16:50,607 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:16:50,607 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:16:50,607 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131650.log]\n', '2014-08-18 13:16:50,610 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:16:51,949 DEBUG - Will invoke JobStart for JobID [CREAM096940528]\n', 'https://cert-08.pd.infn.it:8443/CREAM096940528\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM096940528 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM096940528 2014-08-18 13:16:52.320913 Submit https://cert-08.pd.infn.it:8443/CREAM096940528 Left: 671 (at submission time:671) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM096940528 2014-08-18 13:18:46.444231 Exit https://cert-08.pd.infn.it:8443/CREAM293142029 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:18:46,839 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:18:46,865 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:18:46,865 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:18:46,865 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-cs://cert-08.pd.infn.it:8443/CREAM684916433 2014-08-18 13:15:47.705689 Exit https://cert-08.pd.infn.it:8443/CREAM965298598 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:15:48,490 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:15:48,514 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:15:48,514 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:15:48,514 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131548.log]\n', '2014-08-18 13:15:48,517 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:15:49,496 DEBUG - Will invoke JobStart for JobID [CREAM285597431]\n', 'https://cert-08.pd.infn.it:8443/CREAM285597431\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM285597431 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM285597431 2014-08-18 13:15:49.839585 Submit https://cert-08.pd.infn.it:8443/CREAM285597431 Left: 677 (at submission time:677) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM285597431 2014-08-18 13:16:45.690289 Exit https://cert-08.pd.infn.it:8443/CREAM822408071 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:16:46,017 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:16:46,048 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:16:46,048 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:16:46,049 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131646.log]\n', '2014-08-18 13:16:46,052 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:16:46,954 DEBUG - Will invoke JobStart for JobID [CREAM031258374]\n', 'https://cert-08.pd.infn.it:8443/CREAM031258374\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM031258374 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM031258374 2014-08-18 13:16:47.254738 Submit https://cert-08.pd.infn.it:8443/CREAM031258374 Left: 674 (at submission time:674) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM031258374 2014-08-18 13:18:50.450388 Exit https://cert-08.pd.infn.it:8443/CREAM391637835 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:18:51,150 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:18:51,181 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:18:51,182 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:18:51,182 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131750.log]\n', '2014-08-18 13:17:50,788 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:17:52,133 DEBUG - Will invoke JobStart for JobID [CREAM684312188]\n', 'https://cert-08.pd.infn.it:8443/CREAM684312188\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM684312188 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM684312188 2014-08-18 13:17:52.336090 Submit https://cert-08.pd.infn.it:8443/CREAM684312188 Left: 667 (at submission time:667) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM684312188 2014-08-18 13:19:50.558080 Exit https://cert-08.pd.infn.it:8443/CREAM959230573 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:19:51,100 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:19:51,125 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:19:51,126 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:19:51,126 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131951.log]\n', '2014-08-18 13:19:51,129 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:19:52,166 DEBUG - Will invoke JobStart for JobID [CREAM557495074]\n', 'https://cert-08.pd.infn.it:8443/CREAM557495074\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM557495074 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM557495074 2014-08-18 13:19:52.543826 Submit https://cert-08.pd.infn.it:8443/CREAM557495074 Left: 661 (at submission time:661) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM557495074 2014-08-18 13:19:52.961043 Exit https://cert-08.pd.infn.it:8443/CREAM158707268 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:19:53,638 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:19:53,666 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:19:53,666 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:19:53,666 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131953.log]\n', '2014-08-18 13:19:53,669 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:19:54,743 DEBUG - Will invoke JobStart for JobID [CREAM104957688]\n', 'https://cert-08.pd.infn.it:8443/CREAM104957688\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM104957688 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM104957688 2014-08l Status: 0 Collected 313/1000 2014-08-18 13:17:52.013837 Submitted: 331 Running: 18 Cancelled: 0 Done-Ok: 313 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 313/1000 2014-08-18 13:17:52.122086 Submitted: 332 Running: 19 Cancelled: 0 Done-Ok: 313 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 313/1000 2014-08-18 13:17:52.337935 Submitted: 333 Running: 20 Cancelled: 0 Done-Ok: 313 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 313/1000 2014-08-18 13:18:46.446404 Submitted: 333 Running: 19 Cancelled: 0 Done-Ok: 314 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 314/1000 2014-08-18 13:18:48.113008 Submitted: 334 Running: 20 Cancelled: 0 Done-Ok: 314 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 314/1000 2014-08-18 13:18:50.300857 Submitted: 334 Running: 19 Cancelled: 0 Done-Ok: 315 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 315/1000 2014-08-18 13:18:50.453895 Submitted: 334 Running: 18 Cancelled: 0 Done-Ok: 316 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 316/1000 2014-08-18 13:18:50.610864 Submitted: 334 Running: 17 Cancelled: 0 Done-Ok: 317 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 317/1000 2014-08-18 13:18:52.690060 Submitted: 335 Running: 18 Cancelled: 0 Done-Ok: 317 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 317/1000 2014-08-18 13:18:52.777793 Submitted: 336 Running: 19 Cancelled: 0 Done-Ok: 317 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 317/1000 2014-08-18 13:18:53.103851 Submitted: 337 Running: 20 Cancelled: 0 Done-Ok: 317 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 317/1000 2014-08-18 13:19:46.905081 Submitted: 337 Running: 19 Cancelled: 0 Done-Ok: 318 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 318/1000 2014-08-18 13:19:48.540779 Submitted: 338 Running: 20 Cancelled: 0 Done-Ok: 318 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 318/1000 2014-08-18 13:19:50.561462 Submitted: 338 Running: 19 Cancelled: 0 Done-Ok: 319 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 319/1000 2014-08-18 13:19:51.859488 Submitted: 338 Running: 18 Cancelled: 0 Done-Ok: 320 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 320/1000 2014-08-18 13:19:52.546079 Submitted: 339 Running: 19 Cancelled: 0 Done-Ok: 320 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 320/1000 2014-08-18 13:19:52.962817 Submitted: 339 Running: 18 Cancelled: 0 Done-Ok: 321 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 321/1000 2014-08-18 13:19:53.830663 Submitted: 340 Running: 19 Cancelled: 0 Done-Ok: 321 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 321/1000 2014-08-18 13:19:54.927146 Submitted: 341 Running: 20 Cancelled: 0 Done-Ok: 321 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 321/1000 2014-08-18 13:20:47.214677 Submitted: 341 Running: 19 Cancelled: 0 Done-Ok: 322 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal e-job-submit_CREAM_bertocco_20140818-131750.log]\n', '2014-08-18 13:17:50,218 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:17:51,856 DEBUG - Will invoke JobStart for JobID [CREAM594042610]\n', 'https://cert-08.pd.infn.it:8443/CREAM594042610\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM594042610 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM594042610 2014-08-18 13:17:52.012050 Submit https://cert-08.pd.infn.it:8443/CREAM594042610 Left: 669 (at submission time:669) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM594042610 2014-08-18 13:18:50.298578 Exit https://cert-08.pd.infn.it:8443/CREAM727669301 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:18:51,036 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:18:51,062 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:18:51,062 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:18:51,062 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131851.log]\n', '2014-08-18 13:18:51,065 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:18:52,340 DEBUG - Will invoke JobStart for JobID [CREAM767798522]\n', 'https://cert-08.pd.infn.it:8443/CREAM767798522\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM767798522 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM767798522 2014-08-18 13:18:52.688074 Submit https://cert-08.pd.infn.it:8443/CREAM767798522 Left: 665 (at submission time:665) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM767798522 2014-08-18 13:20:47.213512 Exit https://cert-08.pd.infn.it:8443/CREAM742654156 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:20:47,703 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:20:47,728 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:20:47,728 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:20:47,728 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132047.log]\n', '2014-08-18 13:20:47,731 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:20:48,671 DEBUG - Will invoke JobStart for JobID [CREAM851702925]\n', 'https://cert-08.pd.infn.it:8443/CREAM851702925\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM851702925 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM851702925 2014-08e-job-submit_CREAM_bertocco_20140818-131851.log]\n', '2014-08-18 13:18:51,188 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:18:52,451 DEBUG - Will invoke JobStart for JobID [CREAM398765743]\n', 'https://cert-08.pd.infn.it:8443/CREAM398765743\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM398765743 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM398765743 2014-08-18 13:18:52.775915 Submit https://cert-08.pd.infn.it:8443/CREAM398765743 Left: 664 (at submission time:664) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM398765743 2014-08-18 13:19:51.857927 Exit https://cert-08.pd.infn.it:8443/CREAM684916433 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:19:52,459 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:19:52,487 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:19:52,487 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:19:52,487 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131952.log]\n', '2014-08-18 13:19:52,491 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:19:53,591 DEBUG - Will invoke JobStart for JobID [CREAM022208221]\n', 'https://cert-08.pd.infn.it:8443/CREAM022208221\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM022208221 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM022208221 2014-08-18 13:19:53.827404 Submit https://cert-08.pd.infn.it:8443/CREAM022208221 Left: 660 (at submission time:660) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM022208221 2014-08-18 13:20:50.148267 Exit https://cert-08.pd.infn.it:8443/CREAM285597431 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:20:50,743 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:20:50,774 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:20:50,774 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:20:50,774 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132050.log]\n', '2014-08-18 13:20:50,778 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:20:51,832 DEBUG - Will invoke JobStart for JobID [CREAM216556578]\n', 'https://cert-08.pd.infn.it:8443/CREAM216556578\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM216556578 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM216556578 2014-08e-job-submit_CREAM_bertocco_20140818-131846.log]\n', '2014-08-18 13:18:46,868 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:18:47,799 DEBUG - Will invoke JobStart for JobID [CREAM334274240]\n', 'https://cert-08.pd.infn.it:8443/CREAM334274240\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM334274240 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM334274240 2014-08-18 13:18:48.108582 Submit https://cert-08.pd.infn.it:8443/CREAM334274240 Left: 666 (at submission time:666) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM334274240 2014-08-18 13:19:46.903123 Exit https://cert-08.pd.infn.it:8443/CREAM366774941 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:19:47,305 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:19:47,334 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:19:47,334 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:19:47,334 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131947.log]\n', '2014-08-18 13:19:47,339 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:19:48,307 DEBUG - Will invoke JobStart for JobID [CREAM259288996]\n', 'https://cert-08.pd.infn.it:8443/CREAM259288996\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM259288996 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM259288996 2014-08-18 13:19:48.535683 Submit https://cert-08.pd.infn.it:8443/CREAM259288996 Left: 662 (at submission time:662) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM259288996 2014-08-18 13:20:51.990105 Exit https://cert-08.pd.infn.it:8443/CREAM974846878 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:20:52,788 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:20:52,812 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:20:52,812 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:20:52,812 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132052.log]\n', '2014-08-18 13:20:52,815 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:20:54,127 DEBUG - Will invoke JobStart for JobID [CREAM515956137]\n', 'https://cert-08.pd.infn.it:8443/CREAM515956137\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM515956137 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM515956137 2014-08e-job-submit_CREAM_bertocco_20140818-131750.log]\n', '2014-08-18 13:17:50,505 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:17:51,893 DEBUG - Will invoke JobStart for JobID [CREAM750088630]\n', 'https://cert-08.pd.infn.it:8443/CREAM750088630\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM750088630 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM750088630 2014-08-18 13:17:52.119421 Submit https://cert-08.pd.infn.it:8443/CREAM750088630 Left: 668 (at submission time:668) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM750088630 2014-08-18 13:18:50.608235 Exit https://cert-08.pd.infn.it:8443/CREAM935480235 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:18:51,415 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:18:51,439 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:18:51,439 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:18:51,439 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-131851.log]\n', '2014-08-18 13:18:51,442 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:18:52,716 DEBUG - Will invoke JobStart for JobID [CREAM822872439]\n', 'https://cert-08.pd.infn.it:8443/CREAM822872439\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM822872439 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM822872439 2014-08-18 13:18:53.102921 Submit https://cert-08.pd.infn.it:8443/CREAM822872439 Left: 663 (at submission time:663) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM822872439 2014-08-18 13:20:52.106645 Exit https://cert-08.pd.infn.it:8443/CREAM167299703 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:20:52,990 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:20:53,017 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:20:53,017 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:20:53,018 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132053.log]\n', '2014-08-18 13:20:53,021 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:20:54,523 DEBUG - Will invoke JobStart for JobID [CREAM542831225]\n', 'https://cert-08.pd.infn.it:8443/CREAM542831225\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM542831225 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM542831225 2014-08Final Status: 0 Collected 322/1000 2014-08-18 13:20:48.948937 Submitted: 342 Running: 20 Cancelled: 0 Done-Ok: 322 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 322/1000 2014-08-18 13:20:50.150166 Submitted: 342 Running: 19 Cancelled: 0 Done-Ok: 323 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 323/1000 2014-08-18 13:20:51.991203 Submitted: 342 Running: 18 Cancelled: 0 Done-Ok: 324 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 324/1000 2014-08-18 13:20:52.110129 Submitted: 342 Running: 17 Cancelled: 0 Done-Ok: 325 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 325/1000 2014-08-18 13:20:52.125796 Submitted: 343 Running: 18 Cancelled: 0 Done-Ok: 325 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 325/1000 2014-08-18 13:20:54.436373 Submitted: 344 Running: 19 Cancelled: 0 Done-Ok: 325 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 325/1000 2014-08-18 13:20:54.873331 Submitted: 345 Running: 20 Cancelled: 0 Done-Ok: 325 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 325/1000 2014-08-18 13:21:48.117046 Submitted: 345 Running: 19 Cancelled: 0 Done-Ok: 326 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 326/1000 2014-08-18 13:21:49.838062 Submitted: 346 Running: 20 Cancelled: 0 Done-Ok: 326 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 326/1000 2014-08-18 13:21:51.200527 Submitted: 346 Running: 19 Cancelled: 0 Done-Ok: 327 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 327/1000 2014-08-18 13:21:51.737404 Submitted: 346 Running: 18 Cancelled: 0 Done-Ok: 328 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 328/1000 2014-08-18 13:21:52.706382 Submitted: 346 Running: 17 Cancelled: 0 Done-Ok: 329 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 329/1000 2014-08-18 13:21:53.311735 Submitted: 347 Running: 18 Cancelled: 0 Done-Ok: 329 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 329/1000 2014-08-18 13:21:54.270101 Submitted: 348 Running: 19 Cancelled: 0 Done-Ok: 329 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 329/1000 2014-08-18 13:21:54.906094 Submitted: 349 Running: 20 Cancelled: 0 Done-Ok: 329 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 329/1000 2014-08-18 13:22:48.068957 Submitted: 349 Running: 19 Cancelled: 0 Done-Ok: 330 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 330/1000 2014-08-18 13:22:49.780655 Submitted: 350 Running: 20 Cancelled: 0 Done-Ok: 330 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 330/1000 2014-08-18 13:22:51.641262 Submitted: 350 Running: 19 Cancelled: 0 Done-Ok: 331 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 331/1000 2014-08-18 13:22:52.699584 Submitted: 350 Running: 18 Cancelled: 0 Done-Ok: 332 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 332/1000 2014-08-18 13:22:53.021831 Submitted: 350 Running: 17 Cancelled: 0 Done-Ok: 333 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Ille-18 13:20:54.870126 Submit https://cert-08.pd.infn.it:8443/CREAM542831225 Left: 655 (at submission time:655) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM542831225 2014-08-18 13:21:51.732179 Exit https://cert-08.pd.infn.it:8443/CREAM272443113 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:21:52,641 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:21:52,662 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:21:52,662 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:21:52,662 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132152.log]\n', '2014-08-18 13:21:52,665 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:21:53,744 DEBUG - Will invoke JobStart for JobID [CREAM023184457]\n', 'https://cert-08.pd.infn.it:8443/CREAM023184457\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM023184457 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM023184457 2014-08-18 13:21:54.268274 Submit https://cert-08.pd.infn.it:8443/CREAM023184457 Left: 652 (at submission time:652) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM023184457 2014-08-18 13:22:52.698247 Exit https://cert-08.pd.infn.it:8443/CREAM750088630 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:22:53,614 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:22:53,637 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:22:53,637 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:22:53,637 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132253.log]\n', '2014-08-18 13:22:53,648 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:22:55,188 DEBUG - Will invoke JobStart for JobID [CREAM165344281]\n', 'https://cert-08.pd.infn.it:8443/CREAM165344281\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM165344281 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM165344281 2014-08-18 13:22:55.632047 Submit https://cert-08.pd.infn.it:8443/CREAM165344281 Left: 648 (at submission time:648) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM165344281 2014-08-18 13:23:51.595174 Exit https://cert-08.pd.infn.it:8443/CREAM822872439 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:23:52,436 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:23:52,467 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:23:52,467-18 13:20:48.946120 Submit https://cert-08.pd.infn.it:8443/CREAM851702925 Left: 658 (at submission time:658) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM851702925 2014-08-18 13:22:48.066856 Exit https://cert-08.pd.infn.it:8443/CREAM359941701 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:22:48,428 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:22:48,464 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:22:48,465 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:22:48,465 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132248.log]\n', '2014-08-18 13:22:48,469 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:22:49,470 DEBUG - Will invoke JobStart for JobID [CREAM003930481]\n', 'https://cert-08.pd.infn.it:8443/CREAM003930481\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM003930481 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM003930481 2014-08-18 13:22:49.777029 Submit https://cert-08.pd.infn.it:8443/CREAM003930481 Left: 650 (at submission time:650) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM003930481 2014-08-18 13:22:51.638089 Exit https://cert-08.pd.infn.it:8443/CREAM594042610 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:22:52,384 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:22:52,406 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:22:52,406 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:22:52,406 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132252.log]\n', '2014-08-18 13:22:52,414 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:22:53,532 DEBUG - Will invoke JobStart for JobID [CREAM510873954]\n', 'https://cert-08.pd.infn.it:8443/CREAM510873954\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM510873954 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM510873954 2014-08-18 13:22:53.776466 Submit https://cert-08.pd.infn.it:8443/CREAM510873954 Left: 649 (at submission time:649) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM510873954 2014-08-18 13:23:52.145464 Exit https://cert-08.pd.infn.it:8443/CREAM767798522 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:23:52,685 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:23:52,708 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:23:52,708-18 13:20:54.433476 Submit https://cert-08.pd.infn.it:8443/CREAM515956137 Left: 656 (at submission time:656) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM515956137 2014-08-18 13:21:52.703305 Exit https://cert-08.pd.infn.it:8443/CREAM096940528 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:21:53,473 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:21:53,497 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:21:53,498 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:21:53,498 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132153.log]\n', '2014-08-18 13:21:53,501 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:21:54,613 DEBUG - Will invoke JobStart for JobID [CREAM192553001]\n', 'https://cert-08.pd.infn.it:8443/CREAM192553001\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM192553001 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM192553001 2014-08-18 13:21:54.903030 Submit https://cert-08.pd.infn.it:8443/CREAM192553001 Left: 651 (at submission time:651) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM192553001 2014-08-18 13:23:48.387712 Exit https://cert-08.pd.infn.it:8443/CREAM334274240 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:23:48,754 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:23:48,777 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:23:48,777 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:23:48,777 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132348.log]\n', '2014-08-18 13:23:48,783 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:23:49,722 DEBUG - Will invoke JobStart for JobID [CREAM142994504]\n', 'https://cert-08.pd.infn.it:8443/CREAM142994504\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM142994504 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM142994504 2014-08-18 13:23:49.974920 Submit https://cert-08.pd.infn.it:8443/CREAM142994504 Left: 646 (at submission time:646) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM142994504 2014-08-18 13:24:48.787922 Exit https://cert-08.pd.infn.it:8443/CREAM259288996 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:24:49,110 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:24:49,131 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:24:49,131-18 13:20:52.124509 Submit https://cert-08.pd.infn.it:8443/CREAM216556578 Left: 657 (at submission time:657) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM216556578 2014-08-18 13:21:48.114445 Exit https://cert-08.pd.infn.it:8443/CREAM031258374 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:21:48,456 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:21:48,494 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:21:48,494 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:21:48,494 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132148.log]\n', '2014-08-18 13:21:48,497 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:21:49,441 DEBUG - Will invoke JobStart for JobID [CREAM680930797]\n', 'https://cert-08.pd.infn.it:8443/CREAM680930797\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM680930797 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM680930797 2014-08-18 13:21:49.835278 Submit https://cert-08.pd.infn.it:8443/CREAM680930797 Left: 654 (at submission time:654) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM680930797 2014-08-18 13:23:54.064082 Exit https://cert-08.pd.infn.it:8443/CREAM398765743 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:23:54,928 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:23:54,951 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:23:54,951 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:23:54,951 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132354.log]\n', '2014-08-18 13:23:54,954 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:23:55,781 DEBUG - Will invoke JobStart for JobID [CREAM992535612]\n', 'https://cert-08.pd.infn.it:8443/CREAM992535612\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM992535612 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM992535612 2014-08-18 13:23:55.983832 Submit https://cert-08.pd.infn.it:8443/CREAM992535612 Left: 643 (at submission time:643) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM992535612 2014-08-18 13:24:53.135137 Exit https://cert-08.pd.infn.it:8443/CREAM022208221 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:24:53,821 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:24:53,844 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:24:53,844-18 13:19:54.925552 Submit https://cert-08.pd.infn.it:8443/CREAM104957688 Left: 659 (at submission time:659) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM104957688 2014-08-18 13:21:51.197717 Exit https://cert-08.pd.infn.it:8443/CREAM143572751 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:21:51,990 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:21:52,025 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:21:52,025 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:21:52,025 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132152.log]\n', '2014-08-18 13:21:52,028 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:21:53,158 DEBUG - Will invoke JobStart for JobID [CREAM609767790]\n', 'https://cert-08.pd.infn.it:8443/CREAM609767790\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM609767790 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM609767790 2014-08-18 13:21:53.308989 Submit https://cert-08.pd.infn.it:8443/CREAM609767790 Left: 653 (at submission time:653) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM609767790 2014-08-18 13:22:53.020261 Exit https://cert-08.pd.infn.it:8443/CREAM684312188 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:22:53,661 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:22:53,680 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:22:53,680 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:22:53,680 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132253.log]\n', '2014-08-18 13:22:53,684 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:22:55,007 DEBUG - Will invoke JobStart for JobID [CREAM337355200]\n', 'https://cert-08.pd.infn.it:8443/CREAM337355200\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM337355200 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM337355200 2014-08-18 13:22:55.200508 Submit https://cert-08.pd.infn.it:8443/CREAM337355200 Left: 647 (at submission time:647) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM337355200 2014-08-18 13:24:53.058651 Exit https://cert-08.pd.infn.it:8443/CREAM557495074 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:24:53,709 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:24:53,732 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:24:53,732gal Final Status: 0 Collected 333/1000 2014-08-18 13:22:53.778283 Submitted: 351 Running: 18 Cancelled: 0 Done-Ok: 333 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 333/1000 2014-08-18 13:22:55.202609 Submitted: 352 Running: 19 Cancelled: 0 Done-Ok: 333 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 333/1000 2014-08-18 13:22:55.636256 Submitted: 353 Running: 20 Cancelled: 0 Done-Ok: 333 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 333/1000 2014-08-18 13:23:48.388972 Submitted: 353 Running: 19 Cancelled: 0 Done-Ok: 334 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 334/1000 2014-08-18 13:23:49.977616 Submitted: 354 Running: 20 Cancelled: 0 Done-Ok: 334 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 334/1000 2014-08-18 13:23:51.597423 Submitted: 354 Running: 19 Cancelled: 0 Done-Ok: 335 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 335/1000 2014-08-18 13:23:52.146940 Submitted: 354 Running: 18 Cancelled: 0 Done-Ok: 336 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 336/1000 2014-08-18 13:23:54.066378 Submitted: 354 Running: 17 Cancelled: 0 Done-Ok: 337 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 337/1000 2014-08-18 13:23:54.103013 Submitted: 355 Running: 18 Cancelled: 0 Done-Ok: 337 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 337/1000 2014-08-18 13:23:54.154340 Submitted: 356 Running: 19 Cancelled: 0 Done-Ok: 337 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 337/1000 2014-08-18 13:23:55.986537 Submitted: 357 Running: 20 Cancelled: 0 Done-Ok: 337 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 337/1000 2014-08-18 13:24:48.790909 Submitted: 357 Running: 19 Cancelled: 0 Done-Ok: 338 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 338/1000 2014-08-18 13:24:50.311311 Submitted: 358 Running: 20 Cancelled: 0 Done-Ok: 338 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 338/1000 2014-08-18 13:24:53.060174 Submitted: 358 Running: 19 Cancelled: 0 Done-Ok: 339 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 339/1000 2014-08-18 13:24:53.138973 Submitted: 358 Running: 18 Cancelled: 0 Done-Ok: 340 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 340/1000 2014-08-18 13:24:55.173389 Submitted: 359 Running: 19 Cancelled: 0 Done-Ok: 340 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 340/1000 2014-08-18 13:24:55.269931 Submitted: 360 Running: 20 Cancelled: 0 Done-Ok: 340 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 340/1000 2014-08-18 13:24:55.637917 Submitted: 360 Running: 19 Cancelled: 0 Done-Ok: 341 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 341/1000 2014-08-18 13:24:57.870929 Submitted: 361 Running: 20 Cancelled: 0 Done-Ok: 341 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 341/1000 2014-08-18 13:25:49.923046 Submitted: 361 Running: 19 Cancelled: 0 Done-Ok: 342 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:24:53,844 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132453.log]\n', '2014-08-18 13:24:53,847 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:24:54,881 DEBUG - Will invoke JobStart for JobID [CREAM611605608]\n', 'https://cert-08.pd.infn.it:8443/CREAM611605608\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM611605608 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM611605608 2014-08-18 13:24:55.171975 Submit https://cert-08.pd.infn.it:8443/CREAM611605608 Left: 640 (at submission time:640) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM611605608 2014-08-18 13:25:53.510636 Exit https://cert-08.pd.infn.it:8443/CREAM216556578 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:25:54,199 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:25:54,228 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:25:54,228 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:25:54,228 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132554.log]\n', '2014-08-18 13:25:54,233 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:25:55,628 DEBUG - Will invoke JobStart for JobID [CREAM892256089]\n', 'https://cert-08.pd.infn.it:8443/CREAM892256089\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM892256089 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM892256089 2014-08-18 13:25:56.227248 Submit https://cert-08.pd.infn.it:8443/CREAM892256089 Left: 637 (at submission time:637) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM892256089 2014-08-18 13:26:49.944285 Exit https://cert-08.pd.infn.it:8443/CREAM680930797 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:26:50,292 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:26:50,310 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:26:50,310 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:26:50,310 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132650.log]\n', '2014-08-18 13:26:50,313 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:26:51,221 DEBUG - Will invoke JobStart for JobID [CREAM415246524]\n', 'https://cert-08.pd.infn.it:8443/CREAM415246524\n'] job submission failed?! job submission successfu WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:24:53,732 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132453.log]\n', '2014-08-18 13:24:53,740 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:24:55,098 DEBUG - Will invoke JobStart for JobID [CREAM251066063]\n', 'https://cert-08.pd.infn.it:8443/CREAM251066063\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM251066063 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM251066063 2014-08-18 13:24:55.266959 Submit https://cert-08.pd.infn.it:8443/CREAM251066063 Left: 641 (at submission time:641) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM251066063 2014-08-18 13:24:55.634777 Exit https://cert-08.pd.infn.it:8443/CREAM104957688 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:24:56,435 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:24:56,460 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:24:56,460 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:24:56,460 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132456.log]\n', '2014-08-18 13:24:56,468 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:24:57,572 DEBUG - Will invoke JobStart for JobID [CREAM643072119]\n', 'https://cert-08.pd.infn.it:8443/CREAM643072119\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM643072119 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM643072119 2014-08-18 13:24:57.868767 Submit https://cert-08.pd.infn.it:8443/CREAM643072119 Left: 639 (at submission time:639) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM643072119 2014-08-18 13:26:53.849355 Exit https://cert-08.pd.infn.it:8443/CREAM609767790 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:26:54,540 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:26:54,564 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:26:54,565 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:26:54,565 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132654.log]\n', '2014-08-18 13:26:54,568 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:26:55,760 DEBUG - Will invoke JobStart for JobID [CREAM762032480]\n', 'https://cert-08.pd.infn.it:8443/CREAM762032480\n'] job submission failed?! job submission successfu WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:24:49,131 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132449.log]\n', '2014-08-18 13:24:49,135 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:24:50,017 DEBUG - Will invoke JobStart for JobID [CREAM585619313]\n', 'https://cert-08.pd.infn.it:8443/CREAM585619313\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM585619313 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM585619313 2014-08-18 13:24:50.309056 Submit https://cert-08.pd.infn.it:8443/CREAM585619313 Left: 642 (at submission time:642) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM585619313 2014-08-18 13:25:53.979389 Exit https://cert-08.pd.infn.it:8443/CREAM515956137 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:25:54,809 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:25:54,833 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:25:54,833 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:25:54,834 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132554.log]\n', '2014-08-18 13:25:54,837 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:25:55,998 DEBUG - Will invoke JobStart for JobID [CREAM527098374]\n', 'https://cert-08.pd.infn.it:8443/CREAM527098374\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM527098374 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM527098374 2014-08-18 13:25:56.291496 Submit https://cert-08.pd.infn.it:8443/CREAM527098374 Left: 636 (at submission time:636) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM527098374 2014-08-18 13:26:53.723627 Exit https://cert-08.pd.infn.it:8443/CREAM192553001 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:26:54,458 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:26:54,482 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:26:54,483 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:26:54,483 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132654.log]\n', '2014-08-18 13:26:54,487 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:26:55,788 DEBUG - Will invoke JobStart for JobID [CREAM624236782]\n', 'https://cert-08.pd.infn.it:8443/CREAM624236782\n'] job submission failed?! job submission successfu WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:23:52,467 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132352.log]\n', '2014-08-18 13:23:52,471 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:23:53,680 DEBUG - Will invoke JobStart for JobID [CREAM599424627]\n', 'https://cert-08.pd.infn.it:8443/CREAM599424627\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM599424627 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM599424627 2014-08-18 13:23:54.101070 Submit https://cert-08.pd.infn.it:8443/CREAM599424627 Left: 645 (at submission time:645) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM599424627 2014-08-18 13:25:54.895905 Exit https://cert-08.pd.infn.it:8443/CREAM542831225 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:25:55,663 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:25:55,687 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:25:55,687 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:25:55,687 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132555.log]\n', '2014-08-18 13:25:55,690 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:25:56,730 DEBUG - Will invoke JobStart for JobID [CREAM329148974]\n', 'https://cert-08.pd.infn.it:8443/CREAM329148974\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM329148974 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM329148974 2014-08-18 13:25:56.986019 Submit https://cert-08.pd.infn.it:8443/CREAM329148974 Left: 635 (at submission time:635) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM329148974 2014-08-18 13:26:55.443666 Exit https://cert-08.pd.infn.it:8443/CREAM023184457 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:26:56,211 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:26:56,238 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:26:56,238 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:26:56,238 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132656.log]\n', '2014-08-18 13:26:56,245 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:26:57,470 DEBUG - Will invoke JobStart for JobID [CREAM551355576]\n', 'https://cert-08.pd.infn.it:8443/CREAM551355576\n'] job submission failed?! job submission successfu WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:23:52,708 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132352.log]\n', '2014-08-18 13:23:52,711 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:23:54,022 DEBUG - Will invoke JobStart for JobID [CREAM268406904]\n', 'https://cert-08.pd.infn.it:8443/CREAM268406904\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM268406904 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM268406904 2014-08-18 13:23:54.148872 Submit https://cert-08.pd.infn.it:8443/CREAM268406904 Left: 644 (at submission time:644) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM268406904 2014-08-18 13:25:49.919531 Exit https://cert-08.pd.infn.it:8443/CREAM851702925 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:25:50,286 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:25:50,349 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:25:50,349 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:25:50,349 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132550.log]\n', '2014-08-18 13:25:50,358 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:25:51,351 DEBUG - Will invoke JobStart for JobID [CREAM693322114]\n', 'https://cert-08.pd.infn.it:8443/CREAM693322114\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM693322114 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM693322114 2014-08-18 13:25:51.641897 Submit https://cert-08.pd.infn.it:8443/CREAM693322114 Left: 638 (at submission time:638) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM693322114 2014-08-18 13:27:50.561348 Exit https://cert-08.pd.infn.it:8443/CREAM003930481 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:27:50,947 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:27:50,971 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:27:50,972 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:27:50,972 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132750.log]\n', '2014-08-18 13:27:50,981 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:27:51,904 DEBUG - Will invoke JobStart for JobID [CREAM936612379]\n', 'https://cert-08.pd.infn.it:8443/CREAM936612379\n'] job submission failed?! job submission successfuIllegal Final Status: 0 Collected 342/1000 2014-08-18 13:25:51.645035 Submitted: 362 Running: 20 Cancelled: 0 Done-Ok: 342 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 342/1000 2014-08-18 13:25:53.512427 Submitted: 362 Running: 19 Cancelled: 0 Done-Ok: 343 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 343/1000 2014-08-18 13:25:53.982719 Submitted: 362 Running: 18 Cancelled: 0 Done-Ok: 344 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 344/1000 2014-08-18 13:25:54.898182 Submitted: 362 Running: 17 Cancelled: 0 Done-Ok: 345 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 345/1000 2014-08-18 13:25:56.230278 Submitted: 363 Running: 18 Cancelled: 0 Done-Ok: 345 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 345/1000 2014-08-18 13:25:56.295050 Submitted: 364 Running: 19 Cancelled: 0 Done-Ok: 345 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 345/1000 2014-08-18 13:25:56.988567 Submitted: 365 Running: 20 Cancelled: 0 Done-Ok: 345 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 345/1000 2014-08-18 13:26:49.946091 Submitted: 365 Running: 19 Cancelled: 0 Done-Ok: 346 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 346/1000 2014-08-18 13:26:51.452097 Submitted: 366 Running: 20 Cancelled: 0 Done-Ok: 346 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 346/1000 2014-08-18 13:26:53.725447 Submitted: 366 Running: 19 Cancelled: 0 Done-Ok: 347 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 347/1000 2014-08-18 13:26:53.852414 Submitted: 366 Running: 18 Cancelled: 0 Done-Ok: 348 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 348/1000 2014-08-18 13:26:55.447049 Submitted: 366 Running: 17 Cancelled: 0 Done-Ok: 349 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 349/1000 2014-08-18 13:26:55.961728 Submitted: 367 Running: 18 Cancelled: 0 Done-Ok: 349 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 349/1000 2014-08-18 13:26:56.118008 Submitted: 368 Running: 19 Cancelled: 0 Done-Ok: 349 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 349/1000 2014-08-18 13:26:57.650761 Submitted: 369 Running: 20 Cancelled: 0 Done-Ok: 349 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 349/1000 2014-08-18 13:27:50.564619 Submitted: 369 Running: 19 Cancelled: 0 Done-Ok: 350 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 350/1000 2014-08-18 13:27:52.284479 Submitted: 370 Running: 20 Cancelled: 0 Done-Ok: 350 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 350/1000 2014-08-18 13:27:53.958854 Submitted: 370 Running: 19 Cancelled: 0 Done-Ok: 351 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 351/1000 2014-08-18 13:27:54.497486 Submitted: 370 Running: 18 Cancelled: 0 Done-Ok: 352 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 352/1000 2014-08-18 13:27:55.990103 Submitted: 371 Running: 19 Cancelled: 0 Done-Ok: 352 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failedl Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM762032480 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM762032480 2014-08-18 13:26:55.959037 Submit https://cert-08.pd.infn.it:8443/CREAM762032480 Left: 632 (at submission time:632) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM762032480 2014-08-18 13:27:54.494598 Exit https://cert-08.pd.infn.it:8443/CREAM337355200 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:27:55,220 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:27:55,243 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:27:55,244 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:27:55,244 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132755.log]\n', '2014-08-18 13:27:55,249 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:27:56,371 DEBUG - Will invoke JobStart for JobID [CREAM906926884]\n', 'https://cert-08.pd.infn.it:8443/CREAM906926884\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM906926884 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM906926884 2014-08-18 13:27:56.651360 Submit https://cert-08.pd.infn.it:8443/CREAM906926884 Left: 628 (at submission time:628) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM906926884 2014-08-18 13:29:55.858131 Exit https://cert-08.pd.infn.it:8443/CREAM251066063 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:29:56,542 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:29:56,565 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:29:56,565 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:29:56,565 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132956.log]\n', '2014-08-18 13:29:56,569 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:29:57,811 DEBUG - Will invoke JobStart for JobID [CREAM007908141]\n', 'https://cert-08.pd.infn.it:8443/CREAM007908141\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM007908141 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM007908141 2014-08-18 13:29:58.370364 Submit https://cert-08.pd.infn.it:8443/CREAM007908141 Left: 620 (at submission time:620) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM007908141 2014-08-18 13:29:58.730596 Exit https://cert-08.pd.infn.it:8443/CREAM643072119 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18: 0 Illegal Final Status: 0 Collected 352/1000 2014-08-18 13:27:56.061297 Submitted: 371 Running: 18 Cancelled: 0 Done-Ok: 353 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 353/1000 2014-08-18 13:27:56.654522 Submitted: 372 Running: 19 Cancelled: 0 Done-Ok: 353 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 353/1000 2014-08-18 13:27:58.395768 Submitted: 373 Running: 20 Cancelled: 0 Done-Ok: 353 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 353/1000 2014-08-18 13:28:50.847674 Submitted: 373 Running: 19 Cancelled: 0 Done-Ok: 354 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 354/1000 2014-08-18 13:28:52.601454 Submitted: 374 Running: 20 Cancelled: 0 Done-Ok: 354 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 354/1000 2014-08-18 13:28:54.570481 Submitted: 374 Running: 19 Cancelled: 0 Done-Ok: 355 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 355/1000 2014-08-18 13:28:55.652023 Submitted: 374 Running: 18 Cancelled: 0 Done-Ok: 356 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 356/1000 2014-08-18 13:28:56.044999 Submitted: 374 Running: 17 Cancelled: 0 Done-Ok: 357 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 357/1000 2014-08-18 13:28:56.459981 Submitted: 375 Running: 18 Cancelled: 0 Done-Ok: 357 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 357/1000 2014-08-18 13:28:58.225358 Submitted: 376 Running: 19 Cancelled: 0 Done-Ok: 357 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 357/1000 2014-08-18 13:28:58.642816 Submitted: 377 Running: 20 Cancelled: 0 Done-Ok: 357 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 357/1000 2014-08-18 13:29:51.305884 Submitted: 377 Running: 19 Cancelled: 0 Done-Ok: 358 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 358/1000 2014-08-18 13:29:53.019949 Submitted: 378 Running: 20 Cancelled: 0 Done-Ok: 358 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 358/1000 2014-08-18 13:29:54.163036 Submitted: 378 Running: 19 Cancelled: 0 Done-Ok: 359 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 359/1000 2014-08-18 13:29:55.859849 Submitted: 378 Running: 18 Cancelled: 0 Done-Ok: 360 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 360/1000 2014-08-18 13:29:56.279709 Submitted: 379 Running: 19 Cancelled: 0 Done-Ok: 360 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 360/1000 2014-08-18 13:29:58.373103 Submitted: 380 Running: 20 Cancelled: 0 Done-Ok: 360 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 360/1000 2014-08-18 13:29:58.733923 Submitted: 380 Running: 19 Cancelled: 0 Done-Ok: 361 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 361/1000 2014-08-18 13:30:00.928354 Submitted: 381 Running: 20 Cancelled: 0 Done-Ok: 361 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 361/1000 2014-08-18 13:30:51.976022 Submitted: 381 Running: 19 Cancelled: 0 Done-Ok: 362 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Fal Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM936612379 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM936612379 2014-08-18 13:27:52.281371 Submit https://cert-08.pd.infn.it:8443/CREAM936612379 Left: 630 (at submission time:630) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM936612379 2014-08-18 13:27:53.955469 Exit https://cert-08.pd.infn.it:8443/CREAM510873954 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:27:54,579 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:27:54,602 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:27:54,602 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:27:54,602 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132754.log]\n', '2014-08-18 13:27:54,605 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:27:55,722 DEBUG - Will invoke JobStart for JobID [CREAM762957340]\n', 'https://cert-08.pd.infn.it:8443/CREAM762957340\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM762957340 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM762957340 2014-08-18 13:27:55.988592 Submit https://cert-08.pd.infn.it:8443/CREAM762957340 Left: 629 (at submission time:629) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM762957340 2014-08-18 13:28:55.649805 Exit https://cert-08.pd.infn.it:8443/CREAM268406904 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:28:56,706 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:28:56,726 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:28:56,726 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:28:56,726 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132856.log]\n', '2014-08-18 13:28:56,729 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:28:58,237 DEBUG - Will invoke JobStart for JobID [CREAM406652144]\n', 'https://cert-08.pd.infn.it:8443/CREAM406652144\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM406652144 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM406652144 2014-08-18 13:28:58.639843 Submit https://cert-08.pd.infn.it:8443/CREAM406652144 Left: 624 (at submission time:624) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM406652144 2014-08-18 13:30:51.973793 Exit https://cert-08.pd.infn.it:8443/CREAM693322114 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18l Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM624236782 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM624236782 2014-08-18 13:26:56.116487 Submit https://cert-08.pd.infn.it:8443/CREAM624236782 Left: 633 (at submission time:633) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM624236782 2014-08-18 13:28:50.842910 Exit https://cert-08.pd.infn.it:8443/CREAM142994504 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:28:51,179 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:28:51,199 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:28:51,199 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:28:51,199 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132851.log]\n', '2014-08-18 13:28:51,202 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:28:52,255 DEBUG - Will invoke JobStart for JobID [CREAM353562154]\n', 'https://cert-08.pd.infn.it:8443/CREAM353562154\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM353562154 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM353562154 2014-08-18 13:28:52.598732 Submit https://cert-08.pd.infn.it:8443/CREAM353562154 Left: 626 (at submission time:626) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM353562154 2014-08-18 13:29:51.303227 Exit https://cert-08.pd.infn.it:8443/CREAM585619313 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:29:51,744 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:29:51,771 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:29:51,771 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:29:51,771 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132951.log]\n', '2014-08-18 13:29:51,775 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:29:52,694 DEBUG - Will invoke JobStart for JobID [CREAM361785017]\n', 'https://cert-08.pd.infn.it:8443/CREAM361785017\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM361785017 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM361785017 2014-08-18 13:29:53.016217 Submit https://cert-08.pd.infn.it:8443/CREAM361785017 Left: 622 (at submission time:622) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM361785017 2014-08-18 13:30:55.523112 Exit https://cert-08.pd.infn.it:8443/CREAM527098374 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18l Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM415246524 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM415246524 2014-08-18 13:26:51.449914 Submit https://cert-08.pd.infn.it:8443/CREAM415246524 Left: 634 (at submission time:634) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM415246524 2014-08-18 13:28:56.042875 Exit https://cert-08.pd.infn.it:8443/CREAM992535612 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:28:56,770 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:28:56,790 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:28:56,790 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:28:56,790 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132856.log]\n', '2014-08-18 13:28:56,792 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:28:57,950 DEBUG - Will invoke JobStart for JobID [CREAM839595640]\n', 'https://cert-08.pd.infn.it:8443/CREAM839595640\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM839595640 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM839595640 2014-08-18 13:28:58.222786 Submit https://cert-08.pd.infn.it:8443/CREAM839595640 Left: 623 (at submission time:623) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM839595640 2014-08-18 13:29:54.161276 Exit https://cert-08.pd.infn.it:8443/CREAM611605608 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:29:54,917 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:29:54,940 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:29:54,940 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:29:54,940 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132954.log]\n', '2014-08-18 13:29:54,943 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:29:55,929 DEBUG - Will invoke JobStart for JobID [CREAM033116619]\n', 'https://cert-08.pd.infn.it:8443/CREAM033116619\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM033116619 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM033116619 2014-08-18 13:29:56.276157 Submit https://cert-08.pd.infn.it:8443/CREAM033116619 Left: 621 (at submission time:621) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM033116619 2014-08-18 13:30:55.422399 Exit https://cert-08.pd.infn.it:8443/CREAM892256089 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18l Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM551355576 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM551355576 2014-08-18 13:26:57.648953 Submit https://cert-08.pd.infn.it:8443/CREAM551355576 Left: 631 (at submission time:631) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM551355576 2014-08-18 13:27:56.058939 Exit https://cert-08.pd.infn.it:8443/CREAM165344281 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:27:56,800 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:27:56,828 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:27:56,829 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:27:56,829 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132756.log]\n', '2014-08-18 13:27:56,832 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:27:57,986 DEBUG - Will invoke JobStart for JobID [CREAM577110377]\n', 'https://cert-08.pd.infn.it:8443/CREAM577110377\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM577110377 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM577110377 2014-08-18 13:27:58.392783 Submit https://cert-08.pd.infn.it:8443/CREAM577110377 Left: 627 (at submission time:627) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM577110377 2014-08-18 13:28:54.568323 Exit https://cert-08.pd.infn.it:8443/CREAM599424627 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:28:55,021 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:28:55,044 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:28:55,044 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:28:55,044 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132855.log]\n', '2014-08-18 13:28:55,047 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:28:56,154 DEBUG - Will invoke JobStart for JobID [CREAM550304974]\n', 'https://cert-08.pd.infn.it:8443/CREAM550304974\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM550304974 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM550304974 2014-08-18 13:28:56.457251 Submit https://cert-08.pd.infn.it:8443/CREAM550304974 Left: 625 (at submission time:625) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM550304974 2014-08-18 13:30:56.917968 Exit https://cert-08.pd.infn.it:8443/CREAM329148974 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18iled: 0 Illegal Final Status: 0 Collected 362/1000 2014-08-18 13:30:53.610936 Submitted: 382 Running: 20 Cancelled: 0 Done-Ok: 362 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 362/1000 2014-08-18 13:30:55.425514 Submitted: 382 Running: 19 Cancelled: 0 Done-Ok: 363 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 363/1000 2014-08-18 13:30:55.525102 Submitted: 382 Running: 18 Cancelled: 0 Done-Ok: 364 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 364/1000 2014-08-18 13:30:56.919621 Submitted: 382 Running: 17 Cancelled: 0 Done-Ok: 365 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 365/1000 2014-08-18 13:30:57.510151 Submitted: 383 Running: 18 Cancelled: 0 Done-Ok: 365 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 365/1000 2014-08-18 13:30:57.736839 Submitted: 384 Running: 19 Cancelled: 0 Done-Ok: 365 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 365/1000 2014-08-18 13:30:59.329115 Submitted: 385 Running: 20 Cancelled: 0 Done-Ok: 365 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 365/1000 2014-08-18 13:31:52.228993 Submitted: 385 Running: 19 Cancelled: 0 Done-Ok: 366 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 366/1000 2014-08-18 13:31:54.242633 Submitted: 386 Running: 20 Cancelled: 0 Done-Ok: 366 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 366/1000 2014-08-18 13:31:55.400565 Submitted: 386 Running: 19 Cancelled: 0 Done-Ok: 367 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 367/1000 2014-08-18 13:31:56.271987 Submitted: 386 Running: 18 Cancelled: 0 Done-Ok: 368 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 368/1000 2014-08-18 13:31:56.738970 Submitted: 386 Running: 17 Cancelled: 0 Done-Ok: 369 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 369/1000 2014-08-18 13:31:57.728316 Submitted: 387 Running: 18 Cancelled: 0 Done-Ok: 369 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 369/1000 2014-08-18 13:31:58.720160 Submitted: 388 Running: 19 Cancelled: 0 Done-Ok: 369 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 369/1000 2014-08-18 13:31:59.176934 Submitted: 389 Running: 20 Cancelled: 0 Done-Ok: 369 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 369/1000 2014-08-18 13:32:52.241048 Submitted: 389 Running: 19 Cancelled: 0 Done-Ok: 370 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 370/1000 2014-08-18 13:32:53.926927 Submitted: 390 Running: 20 Cancelled: 0 Done-Ok: 370 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 370/1000 2014-08-18 13:32:55.728016 Submitted: 390 Running: 19 Cancelled: 0 Done-Ok: 371 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 371/1000 2014-08-18 13:32:57.251124 Submitted: 390 Running: 18 Cancelled: 0 Done-Ok: 372 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 372/1000 2014-08-18 13:32:57.328249 Submitted: 390 Running: 17 Cancelled: 0 Done-Ok: 373 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cance 13:30:52,385 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:30:52,429 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:30:52,429 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:30:52,429 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133052.log]\n', '2014-08-18 13:30:52,440 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:30:53,366 DEBUG - Will invoke JobStart for JobID [CREAM469539930]\n', 'https://cert-08.pd.infn.it:8443/CREAM469539930\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM469539930 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM469539930 2014-08-18 13:30:53.607665 Submit https://cert-08.pd.infn.it:8443/CREAM469539930 Left: 618 (at submission time:618) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM469539930 2014-08-18 13:32:52.237337 Exit https://cert-08.pd.infn.it:8443/CREAM936612379 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:32:52,645 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:32:52,671 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:32:52,671 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:32:52,671 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133252.log]\n', '2014-08-18 13:32:52,674 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:32:53,658 DEBUG - Will invoke JobStart for JobID [CREAM783054600]\n', 'https://cert-08.pd.infn.it:8443/CREAM783054600\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM783054600 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM783054600 2014-08-18 13:32:53.925428 Submit https://cert-08.pd.infn.it:8443/CREAM783054600 Left: 610 (at submission time:610) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM783054600 2014-08-18 13:32:55.724228 Exit https://cert-08.pd.infn.it:8443/CREAM762957340 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:32:56,423 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:32:56,448 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:32:56,453 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:32:56,453 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133256.log]\n', '2014-08-18 13:32:56,463 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:32:57,6 13:29:59,487 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:29:59,512 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:29:59,513 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:29:59,513 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-132959.log]\n', '2014-08-18 13:29:59,516 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:30:00,620 DEBUG - Will invoke JobStart for JobID [CREAM245802757]\n', 'https://cert-08.pd.infn.it:8443/CREAM245802757\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM245802757 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM245802757 2014-08-18 13:30:00.924745 Submit https://cert-08.pd.infn.it:8443/CREAM245802757 Left: 619 (at submission time:619) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM245802757 2014-08-18 13:31:55.397217 Exit https://cert-08.pd.infn.it:8443/CREAM762032480 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:31:56,214 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:31:56,247 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:31:56,248 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:31:56,248 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133156.log]\n', '2014-08-18 13:31:56,252 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:31:57,283 DEBUG - Will invoke JobStart for JobID [CREAM005085266]\n', 'https://cert-08.pd.infn.it:8443/CREAM005085266\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM005085266 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM005085266 2014-08-18 13:31:57.726300 Submit https://cert-08.pd.infn.it:8443/CREAM005085266 Left: 613 (at submission time:613) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM005085266 2014-08-18 13:32:57.323478 Exit https://cert-08.pd.infn.it:8443/CREAM906926884 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:32:58,022 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:32:58,059 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:32:58,059 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:32:58,059 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133258.log]\n', '2014-08-18 13:32:58,062 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:32:59,2 13:30:57,627 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:30:57,646 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:30:57,646 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:30:57,646 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133057.log]\n', '2014-08-18 13:30:57,650 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:30:58,958 DEBUG - Will invoke JobStart for JobID [CREAM131803268]\n', 'https://cert-08.pd.infn.it:8443/CREAM131803268\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM131803268 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM131803268 2014-08-18 13:30:59.326387 Submit https://cert-08.pd.infn.it:8443/CREAM131803268 Left: 615 (at submission time:615) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM131803268 2014-08-18 13:31:56.269619 Exit https://cert-08.pd.infn.it:8443/CREAM551355576 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:31:57,218 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:31:57,245 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:31:57,245 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:31:57,245 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133157.log]\n', '2014-08-18 13:31:57,250 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:31:58,458 DEBUG - Will invoke JobStart for JobID [CREAM566918820]\n', 'https://cert-08.pd.infn.it:8443/CREAM566918820\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM566918820 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM566918820 2014-08-18 13:31:58.718425 Submit https://cert-08.pd.infn.it:8443/CREAM566918820 Left: 612 (at submission time:612) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM566918820 2014-08-18 13:32:57.248320 Exit https://cert-08.pd.infn.it:8443/CREAM577110377 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:32:58,102 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:32:58,125 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:32:58,125 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:32:58,126 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133258.log]\n', '2014-08-18 13:32:58,132 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:32:59,3 13:30:56,113 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:30:56,142 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:30:56,142 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:30:56,142 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133056.log]\n', '2014-08-18 13:30:56,145 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:30:57,294 DEBUG - Will invoke JobStart for JobID [CREAM540228620]\n', 'https://cert-08.pd.infn.it:8443/CREAM540228620\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM540228620 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM540228620 2014-08-18 13:30:57.509124 Submit https://cert-08.pd.infn.it:8443/CREAM540228620 Left: 616 (at submission time:616) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM540228620 2014-08-18 13:31:56.737300 Exit https://cert-08.pd.infn.it:8443/CREAM624236782 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:31:57,339 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:31:57,370 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:31:57,370 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:31:57,370 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133157.log]\n', '2014-08-18 13:31:57,373 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:31:58,749 DEBUG - Will invoke JobStart for JobID [CREAM501458544]\n', 'https://cert-08.pd.infn.it:8443/CREAM501458544\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM501458544 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM501458544 2014-08-18 13:31:59.173782 Submit https://cert-08.pd.infn.it:8443/CREAM501458544 Left: 611 (at submission time:611) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM501458544 2014-08-18 13:33:52.929604 Exit https://cert-08.pd.infn.it:8443/CREAM353562154 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:33:53,323 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:33:53,373 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:33:53,373 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:33:53,373 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133353.log]\n', '2014-08-18 13:33:53,391 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:33:54,5 13:30:56,079 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:30:56,108 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:30:56,108 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:30:56,108 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133056.log]\n', '2014-08-18 13:30:56,118 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:30:57,482 DEBUG - Will invoke JobStart for JobID [CREAM696938436]\n', 'https://cert-08.pd.infn.it:8443/CREAM696938436\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM696938436 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM696938436 2014-08-18 13:30:57.735169 Submit https://cert-08.pd.infn.it:8443/CREAM696938436 Left: 617 (at submission time:617) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM696938436 2014-08-18 13:31:52.227596 Exit https://cert-08.pd.infn.it:8443/CREAM415246524 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:31:52,583 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:31:52,613 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:31:52,613 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:31:52,613 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133152.log]\n', '2014-08-18 13:31:52,622 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:31:53,720 DEBUG - Will invoke JobStart for JobID [CREAM535377037]\n', 'https://cert-08.pd.infn.it:8443/CREAM535377037\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM535377037 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM535377037 2014-08-18 13:31:54.239488 Submit https://cert-08.pd.infn.it:8443/CREAM535377037 Left: 614 (at submission time:614) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM535377037 2014-08-18 13:33:58.203405 Exit https://cert-08.pd.infn.it:8443/CREAM839595640 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:33:59,190 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:33:59,230 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:33:59,230 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:33:59,230 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133359.log]\n', '2014-08-18 13:33:59,242 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:34:00,3l Failed: 0 Illegal Final Status: 0 Collected 373/1000 2014-08-18 13:32:57.943099 Submitted: 391 Running: 18 Cancelled: 0 Done-Ok: 373 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 373/1000 2014-08-18 13:32:59.491499 Submitted: 392 Running: 19 Cancelled: 0 Done-Ok: 373 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 373/1000 2014-08-18 13:32:59.784044 Submitted: 393 Running: 20 Cancelled: 0 Done-Ok: 373 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 373/1000 2014-08-18 13:33:52.931956 Submitted: 393 Running: 19 Cancelled: 0 Done-Ok: 374 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 374/1000 2014-08-18 13:33:54.906994 Submitted: 394 Running: 20 Cancelled: 0 Done-Ok: 374 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 374/1000 2014-08-18 13:33:56.519027 Submitted: 394 Running: 19 Cancelled: 0 Done-Ok: 375 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 375/1000 2014-08-18 13:33:57.644868 Submitted: 394 Running: 18 Cancelled: 0 Done-Ok: 376 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 376/1000 2014-08-18 13:33:58.205697 Submitted: 394 Running: 17 Cancelled: 0 Done-Ok: 377 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 377/1000 2014-08-18 13:33:59.185964 Submitted: 395 Running: 18 Cancelled: 0 Done-Ok: 377 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 377/1000 2014-08-18 13:33:59.929937 Submitted: 396 Running: 19 Cancelled: 0 Done-Ok: 377 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 377/1000 2014-08-18 13:34:00.714227 Submitted: 397 Running: 20 Cancelled: 0 Done-Ok: 377 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 377/1000 2014-08-18 13:34:53.318958 Submitted: 397 Running: 19 Cancelled: 0 Done-Ok: 378 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 378/1000 2014-08-18 13:34:54.886836 Submitted: 398 Running: 20 Cancelled: 0 Done-Ok: 378 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 378/1000 2014-08-18 13:34:57.359784 Submitted: 398 Running: 19 Cancelled: 0 Done-Ok: 379 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 379/1000 2014-08-18 13:34:57.538661 Submitted: 398 Running: 18 Cancelled: 0 Done-Ok: 380 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 380/1000 2014-08-18 13:34:59.380895 Submitted: 399 Running: 19 Cancelled: 0 Done-Ok: 380 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 380/1000 2014-08-18 13:34:59.768314 Submitted: 399 Running: 18 Cancelled: 0 Done-Ok: 381 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 381/1000 2014-08-18 13:34:59.988797 Submitted: 400 Running: 19 Cancelled: 0 Done-Ok: 381 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 381/1000 2014-08-18 13:35:02.240656 Submitted: 401 Running: 20 Cancelled: 0 Done-Ok: 381 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 381/1000 2014-08-18 13:35:54.090930 Submitted: 401 Running: 19 Cancelled: 0 Done-Ok: 382 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 C87 DEBUG - Will invoke JobStart for JobID [CREAM132233294]\n', 'https://cert-08.pd.infn.it:8443/CREAM132233294\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM132233294 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM132233294 2014-08-18 13:34:00.712023 Submit https://cert-08.pd.infn.it:8443/CREAM132233294 Left: 603 (at submission time:603) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM132233294 2014-08-18 13:34:57.535683 Exit https://cert-08.pd.infn.it:8443/CREAM033116619 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:34:58,557 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:34:58,581 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:34:58,581 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:34:58,581 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133458.log]\n', '2014-08-18 13:34:58,589 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:34:59,685 DEBUG - Will invoke JobStart for JobID [CREAM719246908]\n', 'https://cert-08.pd.infn.it:8443/CREAM719246908\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM719246908 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM719246908 2014-08-18 13:34:59.986181 Submit https://cert-08.pd.infn.it:8443/CREAM719246908 Left: 600 (at submission time:600) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM719246908 2014-08-18 13:35:58.823023 Exit https://cert-08.pd.infn.it:8443/CREAM696938436 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:35:59,760 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:35:59,783 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:35:59,783 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:35:59,784 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133559.log]\n', '2014-08-18 13:35:59,787 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:36:01,201 DEBUG - Will invoke JobStart for JobID [CREAM270769118]\n', 'https://cert-08.pd.infn.it:8443/CREAM270769118\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM270769118 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM270769118 2014-08-18 13:36:01.573974 Submit https://cert-08.pd.infn.it:8443/CREAM270769118 Left: 595 (at submission time:595) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM270769118 2014-08-18 13:36:54.055388 Exit https://cert-08.pd.infn.it:8443/CREAM535377037 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.52 DEBUG - Will invoke JobStart for JobID [CREAM902385686]\n', 'https://cert-08.pd.infn.it:8443/CREAM902385686\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM902385686 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM902385686 2014-08-18 13:32:59.488602 Submit https://cert-08.pd.infn.it:8443/CREAM902385686 Left: 608 (at submission time:608) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM902385686 2014-08-18 13:34:57.358576 Exit https://cert-08.pd.infn.it:8443/CREAM245802757 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:34:57,787 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:34:57,810 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:34:57,811 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:34:57,811 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133457.log]\n', '2014-08-18 13:34:57,813 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:34:58,950 DEBUG - Will invoke JobStart for JobID [CREAM833166054]\n', 'https://cert-08.pd.infn.it:8443/CREAM833166054\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM833166054 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM833166054 2014-08-18 13:34:59.379133 Submit https://cert-08.pd.infn.it:8443/CREAM833166054 Left: 601 (at submission time:601) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM833166054 2014-08-18 13:34:59.763982 Exit https://cert-08.pd.infn.it:8443/CREAM007908141 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:35:00,556 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:35:00,579 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:35:00,579 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:35:00,579 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133500.log]\n', '2014-08-18 13:35:00,582 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:35:01,962 DEBUG - Will invoke JobStart for JobID [CREAM050759268]\n', 'https://cert-08.pd.infn.it:8443/CREAM050759268\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM050759268 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM050759268 2014-08-18 13:35:02.238070 Submit https://cert-08.pd.infn.it:8443/CREAM050759268 Left: 599 (at submission time:599) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM050759268 2014-08-18 13:36:57.757967 Exit https://cert-08.pd.infn.it:8443/CREAM005085266 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.27 DEBUG - Will invoke JobStart for JobID [CREAM742062739]\n', 'https://cert-08.pd.infn.it:8443/CREAM742062739\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM742062739 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM742062739 2014-08-18 13:33:54.903779 Submit https://cert-08.pd.infn.it:8443/CREAM742062739 Left: 606 (at submission time:606) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM742062739 2014-08-18 13:34:53.317107 Exit https://cert-08.pd.infn.it:8443/CREAM361785017 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:34:53,673 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:34:53,715 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:34:53,716 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:34:53,716 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133453.log]\n', '2014-08-18 13:34:53,719 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:34:54,659 DEBUG - Will invoke JobStart for JobID [CREAM945380223]\n', 'https://cert-08.pd.infn.it:8443/CREAM945380223\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM945380223 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM945380223 2014-08-18 13:34:54.885650 Submit https://cert-08.pd.infn.it:8443/CREAM945380223 Left: 602 (at submission time:602) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM945380223 2014-08-18 13:35:58.273363 Exit https://cert-08.pd.infn.it:8443/CREAM540228620 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:35:58,995 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:35:59,018 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:35:59,018 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:35:59,018 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133559.log]\n', '2014-08-18 13:35:59,022 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:36:00,325 DEBUG - Will invoke JobStart for JobID [CREAM759445310]\n', 'https://cert-08.pd.infn.it:8443/CREAM759445310\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM759445310 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM759445310 2014-08-18 13:36:00.766176 Submit https://cert-08.pd.infn.it:8443/CREAM759445310 Left: 596 (at submission time:596) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM759445310 2014-08-18 13:36:58.646033 Exit https://cert-08.pd.infn.it:8443/CREAM501458544 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.77 DEBUG - Will invoke JobStart for JobID [CREAM707852556]\n', 'https://cert-08.pd.infn.it:8443/CREAM707852556\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM707852556 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM707852556 2014-08-18 13:32:59.782230 Submit https://cert-08.pd.infn.it:8443/CREAM707852556 Left: 607 (at submission time:607) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM707852556 2014-08-18 13:33:56.516098 Exit https://cert-08.pd.infn.it:8443/CREAM550304974 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:33:57,311 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:33:57,339 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:33:57,339 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:33:57,339 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133357.log]\n', '2014-08-18 13:33:57,342 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:33:58,610 DEBUG - Will invoke JobStart for JobID [CREAM875336642]\n', 'https://cert-08.pd.infn.it:8443/CREAM875336642\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM875336642 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM875336642 2014-08-18 13:33:59.182989 Submit https://cert-08.pd.infn.it:8443/CREAM875336642 Left: 605 (at submission time:605) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM875336642 2014-08-18 13:35:58.004427 Exit https://cert-08.pd.infn.it:8443/CREAM131803268 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:35:58,787 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:35:58,810 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:35:58,811 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:35:58,811 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133558.log]\n', '2014-08-18 13:35:58,814 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:36:00,295 DEBUG - Will invoke JobStart for JobID [CREAM325126716]\n', 'https://cert-08.pd.infn.it:8443/CREAM325126716\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM325126716 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM325126716 2014-08-18 13:36:00.555115 Submit https://cert-08.pd.infn.it:8443/CREAM325126716 Left: 597 (at submission time:597) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM325126716 2014-08-18 13:36:59.308018 Exit https://cert-08.pd.infn.it:8443/CREAM566918820 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.94 DEBUG - Will invoke JobStart for JobID [CREAM185169559]\n', 'https://cert-08.pd.infn.it:8443/CREAM185169559\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM185169559 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM185169559 2014-08-18 13:32:57.939460 Submit https://cert-08.pd.infn.it:8443/CREAM185169559 Left: 609 (at submission time:609) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM185169559 2014-08-18 13:33:57.643429 Exit https://cert-08.pd.infn.it:8443/CREAM406652144 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:33:58,460 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:33:58,484 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:33:58,485 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:33:58,485 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133358.log]\n', '2014-08-18 13:33:58,488 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:33:59,613 DEBUG - Will invoke JobStart for JobID [CREAM059394811]\n', 'https://cert-08.pd.infn.it:8443/CREAM059394811\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM059394811 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM059394811 2014-08-18 13:33:59.928544 Submit https://cert-08.pd.infn.it:8443/CREAM059394811 Left: 604 (at submission time:604) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM059394811 2014-08-18 13:35:54.089860 Exit https://cert-08.pd.infn.it:8443/CREAM469539930 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:35:54,510 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:35:54,533 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:35:54,533 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:35:54,533 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133554.log]\n', '2014-08-18 13:35:54,537 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:35:55,428 DEBUG - Will invoke JobStart for JobID [CREAM367268553]\n', 'https://cert-08.pd.infn.it:8443/CREAM367268553\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM367268553 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM367268553 2014-08-18 13:35:55.746458 Submit https://cert-08.pd.infn.it:8443/CREAM367268553 Left: 598 (at submission time:598) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM367268553 2014-08-18 13:37:54.441432 Exit https://cert-08.pd.infn.it:8443/CREAM783054600 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.ancel Failed: 0 Illegal Final Status: 0 Collected 382/1000 2014-08-18 13:35:55.750669 Submitted: 402 Running: 20 Cancelled: 0 Done-Ok: 382 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 382/1000 2014-08-18 13:35:58.005673 Submitted: 402 Running: 19 Cancelled: 0 Done-Ok: 383 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 383/1000 2014-08-18 13:35:58.276815 Submitted: 402 Running: 18 Cancelled: 0 Done-Ok: 384 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 384/1000 2014-08-18 13:35:58.826234 Submitted: 402 Running: 17 Cancelled: 0 Done-Ok: 385 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 385/1000 2014-08-18 13:36:00.556895 Submitted: 403 Running: 18 Cancelled: 0 Done-Ok: 385 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 385/1000 2014-08-18 13:36:00.768911 Submitted: 404 Running: 19 Cancelled: 0 Done-Ok: 385 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 385/1000 2014-08-18 13:36:01.580017 Submitted: 405 Running: 20 Cancelled: 0 Done-Ok: 385 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 385/1000 2014-08-18 13:36:54.057563 Submitted: 405 Running: 19 Cancelled: 0 Done-Ok: 386 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 386/1000 2014-08-18 13:36:55.794941 Submitted: 406 Running: 20 Cancelled: 0 Done-Ok: 386 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 386/1000 2014-08-18 13:36:57.759482 Submitted: 406 Running: 19 Cancelled: 0 Done-Ok: 387 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 387/1000 2014-08-18 13:36:58.649927 Submitted: 406 Running: 18 Cancelled: 0 Done-Ok: 388 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 388/1000 2014-08-18 13:36:59.311265 Submitted: 406 Running: 17 Cancelled: 0 Done-Ok: 389 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 389/1000 2014-08-18 13:36:59.930871 Submitted: 407 Running: 18 Cancelled: 0 Done-Ok: 389 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 389/1000 2014-08-18 13:37:01.318859 Submitted: 408 Running: 19 Cancelled: 0 Done-Ok: 389 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 389/1000 2014-08-18 13:37:01.828497 Submitted: 409 Running: 20 Cancelled: 0 Done-Ok: 389 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 389/1000 2014-08-18 13:37:54.443076 Submitted: 409 Running: 19 Cancelled: 0 Done-Ok: 390 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 390/1000 2014-08-18 13:37:55.985821 Submitted: 410 Running: 20 Cancelled: 0 Done-Ok: 390 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 390/1000 2014-08-18 13:37:59.073363 Submitted: 410 Running: 19 Cancelled: 0 Done-Ok: 391 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 391/1000 2014-08-18 13:38:00.339244 Submitted: 410 Running: 18 Cancelled: 0 Done-Ok: 392 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 392/1000 2014-08-18 13:38:00.807640 Submitted: 410 Running: 17 Cancelled: 0 Done-Ok: 393 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed:pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:37:00,365 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:37:00,388 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:37:00,388 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:37:00,388 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133700.log]\n', '2014-08-18 13:37:00,392 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:37:01,721 DEBUG - Will invoke JobStart for JobID [CREAM321674141]\n', 'https://cert-08.pd.infn.it:8443/CREAM321674141\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM321674141 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM321674141 2014-08-18 13:37:01.827183 Submit https://cert-08.pd.infn.it:8443/CREAM321674141 Left: 591 (at submission time:591) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM321674141 2014-08-18 13:38:00.805844 Exit https://cert-08.pd.infn.it:8443/CREAM707852556 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:38:01,691 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:38:01,728 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:38:01,729 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:38:01,729 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133801.log]\n', '2014-08-18 13:38:01,737 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:38:02,867 DEBUG - Will invoke JobStart for JobID [CREAM316233258]\n', 'https://cert-08.pd.infn.it:8443/CREAM316233258\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM316233258 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM316233258 2014-08-18 13:38:03.209445 Submit https://cert-08.pd.infn.it:8443/CREAM316233258 Left: 587 (at submission time:587) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM316233258 2014-08-18 13:38:59.469313 Exit https://cert-08.pd.infn.it:8443/CREAM875336642 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:39:00,287 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:39:00,315 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:39:00,315 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:39:00,315 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133900.log]\n', '2014-08-18 13:39:00,318 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Tpd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:37:54,782 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:37:54,806 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:37:54,806 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:37:54,806 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133754.log]\n', '2014-08-18 13:37:54,817 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:37:55,742 DEBUG - Will invoke JobStart for JobID [CREAM989874838]\n', 'https://cert-08.pd.infn.it:8443/CREAM989874838\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM989874838 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM989874838 2014-08-18 13:37:55.983491 Submit https://cert-08.pd.infn.it:8443/CREAM989874838 Left: 590 (at submission time:590) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM989874838 2014-08-18 13:37:59.070474 Exit https://cert-08.pd.infn.it:8443/CREAM185169559 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:37:59,749 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:37:59,772 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:37:59,772 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:37:59,772 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133759.log]\n', '2014-08-18 13:37:59,776 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:38:00,833 DEBUG - Will invoke JobStart for JobID [CREAM798130689]\n', 'https://cert-08.pd.infn.it:8443/CREAM798130689\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM798130689 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM798130689 2014-08-18 13:38:01.114552 Submit https://cert-08.pd.infn.it:8443/CREAM798130689 Left: 589 (at submission time:589) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM798130689 2014-08-18 13:39:00.071006 Exit https://cert-08.pd.infn.it:8443/CREAM059394811 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:39:00,683 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:39:00,706 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:39:00,706 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:39:00,706 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133900.log]\n', '2014-08-18 13:39:00,710 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Tpd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:36:59,637 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:36:59,655 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:36:59,655 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:36:59,655 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133659.log]\n', '2014-08-18 13:36:59,660 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:37:00,799 DEBUG - Will invoke JobStart for JobID [CREAM415301497]\n', 'https://cert-08.pd.infn.it:8443/CREAM415301497\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM415301497 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM415301497 2014-08-18 13:37:01.318042 Submit https://cert-08.pd.infn.it:8443/CREAM415301497 Left: 592 (at submission time:592) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM415301497 2014-08-18 13:38:55.549191 Exit https://cert-08.pd.infn.it:8443/CREAM742062739 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:38:55,846 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:38:55,869 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:38:55,870 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:38:55,870 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133855.log]\n', '2014-08-18 13:38:55,873 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:38:56,867 DEBUG - Will invoke JobStart for JobID [CREAM101762016]\n', 'https://cert-08.pd.infn.it:8443/CREAM101762016\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM101762016 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM101762016 2014-08-18 13:38:57.240236 Submit https://cert-08.pd.infn.it:8443/CREAM101762016 Left: 586 (at submission time:586) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM101762016 2014-08-18 13:39:55.733199 Exit https://cert-08.pd.infn.it:8443/CREAM945380223 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:39:56,138 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:39:56,159 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:39:56,159 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:39:56,160 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133956.log]\n', '2014-08-18 13:39:56,176 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Tpd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:36:54,358 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:36:54,392 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:36:54,393 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:36:54,393 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133654.log]\n', '2014-08-18 13:36:54,396 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:36:55,450 DEBUG - Will invoke JobStart for JobID [CREAM877661409]\n', 'https://cert-08.pd.infn.it:8443/CREAM877661409\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM877661409 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM877661409 2014-08-18 13:36:55.792760 Submit https://cert-08.pd.infn.it:8443/CREAM877661409 Left: 594 (at submission time:594) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM877661409 2014-08-18 13:39:01.004361 Exit https://cert-08.pd.infn.it:8443/CREAM132233294 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:39:02,006 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:39:02,029 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:39:02,030 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:39:02,030 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133902.log]\n', '2014-08-18 13:39:02,034 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:39:03,166 DEBUG - Will invoke JobStart for JobID [CREAM391448938]\n', 'https://cert-08.pd.infn.it:8443/CREAM391448938\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM391448938 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM391448938 2014-08-18 13:39:03.469040 Submit https://cert-08.pd.infn.it:8443/CREAM391448938 Left: 583 (at submission time:583) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM391448938 2014-08-18 13:39:59.312715 Exit https://cert-08.pd.infn.it:8443/CREAM719246908 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:39:59,915 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:39:59,935 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:39:59,935 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:39:59,935 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133959.log]\n', '2014-08-18 13:39:59,943 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Tpd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:36:58,480 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:36:58,511 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:36:58,511 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:36:58,511 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133658.log]\n', '2014-08-18 13:36:58,515 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:36:59,693 DEBUG - Will invoke JobStart for JobID [CREAM862703515]\n', 'https://cert-08.pd.infn.it:8443/CREAM862703515\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM862703515 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM862703515 2014-08-18 13:36:59.928153 Submit https://cert-08.pd.infn.it:8443/CREAM862703515 Left: 593 (at submission time:593) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM862703515 2014-08-18 13:38:00.334917 Exit https://cert-08.pd.infn.it:8443/CREAM902385686 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:38:00,892 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:38:00,915 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:38:00,915 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:38:00,915 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-133800.log]\n', '2014-08-18 13:38:00,918 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:38:02,261 DEBUG - Will invoke JobStart for JobID [CREAM837959890]\n', 'https://cert-08.pd.infn.it:8443/CREAM837959890\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM837959890 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM837959890 2014-08-18 13:38:02.472033 Submit https://cert-08.pd.infn.it:8443/CREAM837959890 Left: 588 (at submission time:588) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM837959890 2014-08-18 13:40:00.036903 Exit https://cert-08.pd.infn.it:8443/CREAM833166054 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:40:00,689 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:40:00,718 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:40:00,718 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:40:00,718 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134000.log]\n', '2014-08-18 13:40:00,725 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; T 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 393/1000 2014-08-18 13:38:01.117081 Submitted: 411 Running: 18 Cancelled: 0 Done-Ok: 393 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 393/1000 2014-08-18 13:38:02.473162 Submitted: 412 Running: 19 Cancelled: 0 Done-Ok: 393 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 393/1000 2014-08-18 13:38:03.211070 Submitted: 413 Running: 20 Cancelled: 0 Done-Ok: 393 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 393/1000 2014-08-18 13:38:55.550288 Submitted: 413 Running: 19 Cancelled: 0 Done-Ok: 394 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 394/1000 2014-08-18 13:38:57.241693 Submitted: 414 Running: 20 Cancelled: 0 Done-Ok: 394 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 394/1000 2014-08-18 13:38:59.471155 Submitted: 414 Running: 19 Cancelled: 0 Done-Ok: 395 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 395/1000 2014-08-18 13:39:00.073480 Submitted: 414 Running: 18 Cancelled: 0 Done-Ok: 396 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 396/1000 2014-08-18 13:39:01.007386 Submitted: 414 Running: 17 Cancelled: 0 Done-Ok: 397 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 397/1000 2014-08-18 13:39:02.117108 Submitted: 415 Running: 18 Cancelled: 0 Done-Ok: 397 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 397/1000 2014-08-18 13:39:02.278942 Submitted: 416 Running: 19 Cancelled: 0 Done-Ok: 397 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 397/1000 2014-08-18 13:39:03.470132 Submitted: 417 Running: 20 Cancelled: 0 Done-Ok: 397 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 397/1000 2014-08-18 13:39:55.735051 Submitted: 417 Running: 19 Cancelled: 0 Done-Ok: 398 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 398/1000 2014-08-18 13:39:57.509413 Submitted: 418 Running: 20 Cancelled: 0 Done-Ok: 398 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 398/1000 2014-08-18 13:39:59.313975 Submitted: 418 Running: 19 Cancelled: 0 Done-Ok: 399 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 399/1000 2014-08-18 13:40:00.038436 Submitted: 418 Running: 18 Cancelled: 0 Done-Ok: 400 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 400/1000 2014-08-18 13:40:01.529293 Submitted: 419 Running: 19 Cancelled: 0 Done-Ok: 400 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 400/1000 2014-08-18 13:40:02.076390 Submitted: 420 Running: 20 Cancelled: 0 Done-Ok: 400 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 400/1000 2014-08-18 13:40:02.509668 Submitted: 420 Running: 19 Cancelled: 0 Done-Ok: 401 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 401/1000 2014-08-18 13:40:04.696150 Submitted: 421 Running: 20 Cancelled: 0 Done-Ok: 401 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 401/1000 2014-08-18 13:40:56.027040 Submitted: 421 Running: 19 Cancelled: 0 Done-Ok: 402 Failed: 0 Aborted: 0 Status Failed: 0 Submit Faiype = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:39:01,849 DEBUG - Will invoke JobStart for JobID [CREAM510929185]\n', 'https://cert-08.pd.infn.it:8443/CREAM510929185\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM510929185 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM510929185 2014-08-18 13:39:02.277425 Submit https://cert-08.pd.infn.it:8443/CREAM510929185 Left: 584 (at submission time:584) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM510929185 2014-08-18 13:40:56.025105 Exit https://cert-08.pd.infn.it:8443/CREAM367268553 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:40:56,377 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:40:56,400 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:40:56,401 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:40:56,401 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134056.log]\n', '2014-08-18 13:40:56,406 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:40:57,349 DEBUG - Will invoke JobStart for JobID [CREAM712251999]\n', 'https://cert-08.pd.infn.it:8443/CREAM712251999\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM712251999 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM712251999 2014-08-18 13:40:57.604307 Submit https://cert-08.pd.infn.it:8443/CREAM712251999 Left: 578 (at submission time:578) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM712251999 2014-08-18 13:42:57.160583 Exit https://cert-08.pd.infn.it:8443/CREAM989874838 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:42:57,594 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:42:57,621 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:42:57,621 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:42:57,622 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134257.log]\n', '2014-08-18 13:42:57,628 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:42:58,814 DEBUG - Will invoke JobStart for JobID [CREAM884538892]\n', 'https://cert-08.pd.infn.it:8443/CREAM884538892\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM884538892 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM884538892 2014-08-18 13:42:59.086223 Submit https://cert-08.pd.infn.it:8443/CREAM884538892 Left: 570 (at submission time:570) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM884538892 2014-08-18 13:43:00.742451 Exit https://cert-08.pd.iype = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:40:01,786 DEBUG - Will invoke JobStart for JobID [CREAM878502241]\n', 'https://cert-08.pd.infn.it:8443/CREAM878502241\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM878502241 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM878502241 2014-08-18 13:40:02.072108 Submit https://cert-08.pd.infn.it:8443/CREAM878502241 Left: 580 (at submission time:580) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM878502241 2014-08-18 13:40:02.508179 Exit https://cert-08.pd.infn.it:8443/CREAM050759268 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:40:03,225 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:40:03,250 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:40:03,250 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:40:03,250 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134003.log]\n', '2014-08-18 13:40:03,253 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:40:04,508 DEBUG - Will invoke JobStart for JobID [CREAM646783996]\n', 'https://cert-08.pd.infn.it:8443/CREAM646783996\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM646783996 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM646783996 2014-08-18 13:40:04.693403 Submit https://cert-08.pd.infn.it:8443/CREAM646783996 Left: 579 (at submission time:579) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM646783996 2014-08-18 13:42:00.252834 Exit https://cert-08.pd.infn.it:8443/CREAM862703515 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:42:00,976 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:42:01,001 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:42:01,001 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:42:01,001 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134201.log]\n', '2014-08-18 13:42:01,004 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:42:02,214 DEBUG - Will invoke JobStart for JobID [CREAM706684542]\n', 'https://cert-08.pd.infn.it:8443/CREAM706684542\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM706684542 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM706684542 2014-08-18 13:42:02.699673 Submit https://cert-08.pd.infn.it:8443/CREAM706684542 Left: 573 (at submission time:573) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM706684542 2014-08-18 13:43:02.050398 Exit https://cert-08.pd.iype = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:39:01,803 DEBUG - Will invoke JobStart for JobID [CREAM176218300]\n', 'https://cert-08.pd.infn.it:8443/CREAM176218300\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM176218300 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM176218300 2014-08-18 13:39:02.114894 Submit https://cert-08.pd.infn.it:8443/CREAM176218300 Left: 585 (at submission time:585) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM176218300 2014-08-18 13:40:59.789048 Exit https://cert-08.pd.infn.it:8443/CREAM325126716 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:41:00,514 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:41:00,545 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:41:00,546 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:41:00,546 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134100.log]\n', '2014-08-18 13:41:00,556 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:41:01,623 DEBUG - Will invoke JobStart for JobID [CREAM756148048]\n', 'https://cert-08.pd.infn.it:8443/CREAM756148048\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM756148048 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM756148048 2014-08-18 13:41:02.235320 Submit https://cert-08.pd.infn.it:8443/CREAM756148048 Left: 577 (at submission time:577) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM756148048 2014-08-18 13:42:01.814739 Exit https://cert-08.pd.infn.it:8443/CREAM321674141 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:42:02,617 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:42:02,637 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:42:02,637 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:42:02,637 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134202.log]\n', '2014-08-18 13:42:02,639 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:42:03,750 DEBUG - Will invoke JobStart for JobID [CREAM021364239]\n', 'https://cert-08.pd.infn.it:8443/CREAM021364239\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM021364239 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM021364239 2014-08-18 13:42:04.193949 Submit https://cert-08.pd.infn.it:8443/CREAM021364239 Left: 571 (at submission time:571) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM021364239 2014-08-18 13:43:02.560343 Exit https://cert-08.pd.iled: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 402/1000 2014-08-18 13:40:57.605946 Submitted: 422 Running: 20 Cancelled: 0 Done-Ok: 402 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 402/1000 2014-08-18 13:40:59.793368 Submitted: 422 Running: 19 Cancelled: 0 Done-Ok: 403 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 403/1000 2014-08-18 13:41:00.755928 Submitted: 422 Running: 18 Cancelled: 0 Done-Ok: 404 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 404/1000 2014-08-18 13:41:01.206988 Submitted: 422 Running: 17 Cancelled: 0 Done-Ok: 405 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 405/1000 2014-08-18 13:41:02.237022 Submitted: 423 Running: 18 Cancelled: 0 Done-Ok: 405 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 405/1000 2014-08-18 13:41:02.791318 Submitted: 424 Running: 19 Cancelled: 0 Done-Ok: 405 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 405/1000 2014-08-18 13:41:03.356756 Submitted: 425 Running: 20 Cancelled: 0 Done-Ok: 405 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 405/1000 2014-08-18 13:41:56.707569 Submitted: 425 Running: 19 Cancelled: 0 Done-Ok: 406 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 406/1000 2014-08-18 13:41:58.451228 Submitted: 426 Running: 20 Cancelled: 0 Done-Ok: 406 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 406/1000 2014-08-18 13:42:00.257423 Submitted: 426 Running: 19 Cancelled: 0 Done-Ok: 407 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 407/1000 2014-08-18 13:42:01.331337 Submitted: 426 Running: 18 Cancelled: 0 Done-Ok: 408 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 408/1000 2014-08-18 13:42:01.817012 Submitted: 426 Running: 17 Cancelled: 0 Done-Ok: 409 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 409/1000 2014-08-18 13:42:02.700446 Submitted: 427 Running: 18 Cancelled: 0 Done-Ok: 409 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 409/1000 2014-08-18 13:42:03.808288 Submitted: 428 Running: 19 Cancelled: 0 Done-Ok: 409 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 409/1000 2014-08-18 13:42:04.197911 Submitted: 429 Running: 20 Cancelled: 0 Done-Ok: 409 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 409/1000 2014-08-18 13:42:57.162931 Submitted: 429 Running: 19 Cancelled: 0 Done-Ok: 410 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 410/1000 2014-08-18 13:42:59.088199 Submitted: 430 Running: 20 Cancelled: 0 Done-Ok: 410 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 410/1000 2014-08-18 13:43:00.745479 Submitted: 430 Running: 19 Cancelled: 0 Done-Ok: 411 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 411/1000 2014-08-18 13:43:02.051751 Submitted: 430 Running: 18 Cancelled: 0 Done-Ok: 412 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 412/1000 2014-08-18 13:43:02.561957 Submitted: 430 Running: 17 Cancelled: 0 Done-Ok: 413 Failed: 0 Aborted: 0 Status Failed: 0 Submitype = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:39:57,199 DEBUG - Will invoke JobStart for JobID [CREAM076762258]\n', 'https://cert-08.pd.infn.it:8443/CREAM076762258\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM076762258 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM076762258 2014-08-18 13:39:57.507082 Submit https://cert-08.pd.infn.it:8443/CREAM076762258 Left: 582 (at submission time:582) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM076762258 2014-08-18 13:41:01.205255 Exit https://cert-08.pd.infn.it:8443/CREAM759445310 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:41:01,980 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:41:02,003 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:41:02,003 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:41:02,003 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134102.log]\n', '2014-08-18 13:41:02,006 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:41:02,950 DEBUG - Will invoke JobStart for JobID [CREAM333138796]\n', 'https://cert-08.pd.infn.it:8443/CREAM333138796\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM333138796 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM333138796 2014-08-18 13:41:03.355699 Submit https://cert-08.pd.infn.it:8443/CREAM333138796 Left: 575 (at submission time:575) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM333138796 2014-08-18 13:42:01.328207 Exit https://cert-08.pd.infn.it:8443/CREAM415301497 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:42:02,189 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:42:02,212 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:42:02,212 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:42:02,212 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134202.log]\n', '2014-08-18 13:42:02,231 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:42:03,613 DEBUG - Will invoke JobStart for JobID [CREAM447163726]\n', 'https://cert-08.pd.infn.it:8443/CREAM447163726\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM447163726 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM447163726 2014-08-18 13:42:03.806950 Submit https://cert-08.pd.infn.it:8443/CREAM447163726 Left: 572 (at submission time:572) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM447163726 2014-08-18 13:43:57.644172 Exit https://cert-08.pd.iype = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:40:01,331 DEBUG - Will invoke JobStart for JobID [CREAM539718396]\n', 'https://cert-08.pd.infn.it:8443/CREAM539718396\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM539718396 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM539718396 2014-08-18 13:40:01.527307 Submit https://cert-08.pd.infn.it:8443/CREAM539718396 Left: 581 (at submission time:581) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM539718396 2014-08-18 13:41:00.754419 Exit https://cert-08.pd.infn.it:8443/CREAM270769118 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:41:01,326 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:41:01,351 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:41:01,351 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:41:01,351 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134101.log]\n', '2014-08-18 13:41:01,354 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:41:02,525 DEBUG - Will invoke JobStart for JobID [CREAM082396342]\n', 'https://cert-08.pd.infn.it:8443/CREAM082396342\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM082396342 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM082396342 2014-08-18 13:41:02.788320 Submit https://cert-08.pd.infn.it:8443/CREAM082396342 Left: 576 (at submission time:576) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM082396342 2014-08-18 13:41:56.705377 Exit https://cert-08.pd.infn.it:8443/CREAM877661409 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:41:57,071 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:41:57,104 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:41:57,104 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:41:57,104 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134157.log]\n', '2014-08-18 13:41:57,107 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:41:58,165 DEBUG - Will invoke JobStart for JobID [CREAM590955811]\n', 'https://cert-08.pd.infn.it:8443/CREAM590955811\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM590955811 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM590955811 2014-08-18 13:41:58.449825 Submit https://cert-08.pd.infn.it:8443/CREAM590955811 Left: 574 (at submission time:574) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM590955811 2014-08-18 13:44:02.292757 Exit https://cert-08.pd.infn.it:8443/CREAM837959890 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:43:02,937 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:43:02,958 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:43:02,958 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:43:02,958 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134302.log]\n', '2014-08-18 13:43:02,961 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:43:04,379 DEBUG - Will invoke JobStart for JobID [CREAM403444545]\n', 'https://cert-08.pd.infn.it:8443/CREAM403444545\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM403444545 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM403444545 2014-08-18 13:43:04.706467 Submit https://cert-08.pd.infn.it:8443/CREAM403444545 Left: 568 (at submission time:568) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM403444545 2014-08-18 13:45:02.503975 Exit https://cert-08.pd.infn.it:8443/CREAM878502241 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:45:03,175 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:45:03,198 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:45:03,198 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:45:03,198 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134503.log]\n', '2014-08-18 13:45:03,201 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:45:04,336 DEBUG - Will invoke JobStart for JobID [CREAM492191966]\n', 'https://cert-08.pd.infn.it:8443/CREAM492191966\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM492191966 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM492191966 2014-08-18 13:45:04.613501 Submit https://cert-08.pd.infn.it:8443/CREAM492191966 Left: 560 (at submission time:560) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM492191966 2014-08-18 13:45:05.123784 Exit https://cert-08.pd.infn.it:8443/CREAM646783996 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:45:05,812 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:45:05,845 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:45:05,845 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:45:05,845 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134505.log]\n', '2014-08-18 13:45:05,853 DEBUG - Registering to [ Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 413/1000 2014-08-18 13:43:02.794983 Submitted: 431 Running: 18 Cancelled: 0 Done-Ok: 413 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 413/1000 2014-08-18 13:43:04.708993 Submitted: 432 Running: 19 Cancelled: 0 Done-Ok: 413 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 413/1000 2014-08-18 13:43:04.858658 Submitted: 433 Running: 20 Cancelled: 0 Done-Ok: 413 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 413/1000 2014-08-18 13:43:57.646991 Submitted: 433 Running: 19 Cancelled: 0 Done-Ok: 414 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 414/1000 2014-08-18 13:43:59.604882 Submitted: 434 Running: 20 Cancelled: 0 Done-Ok: 414 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 414/1000 2014-08-18 13:44:01.768987 Submitted: 434 Running: 19 Cancelled: 0 Done-Ok: 415 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 415/1000 2014-08-18 13:44:02.294694 Submitted: 434 Running: 18 Cancelled: 0 Done-Ok: 416 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 416/1000 2014-08-18 13:44:03.297807 Submitted: 434 Running: 17 Cancelled: 0 Done-Ok: 417 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 417/1000 2014-08-18 13:44:04.208297 Submitted: 435 Running: 18 Cancelled: 0 Done-Ok: 417 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 417/1000 2014-08-18 13:44:04.991223 Submitted: 436 Running: 19 Cancelled: 0 Done-Ok: 417 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 417/1000 2014-08-18 13:44:05.681190 Submitted: 437 Running: 20 Cancelled: 0 Done-Ok: 417 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 417/1000 2014-08-18 13:44:58.184531 Submitted: 437 Running: 19 Cancelled: 0 Done-Ok: 418 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 418/1000 2014-08-18 13:44:59.932702 Submitted: 438 Running: 20 Cancelled: 0 Done-Ok: 418 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 418/1000 2014-08-18 13:45:01.231785 Submitted: 438 Running: 19 Cancelled: 0 Done-Ok: 419 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 419/1000 2014-08-18 13:45:02.505472 Submitted: 438 Running: 18 Cancelled: 0 Done-Ok: 420 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 420/1000 2014-08-18 13:45:03.531968 Submitted: 439 Running: 19 Cancelled: 0 Done-Ok: 420 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 420/1000 2014-08-18 13:45:04.616582 Submitted: 440 Running: 20 Cancelled: 0 Done-Ok: 420 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 420/1000 2014-08-18 13:45:05.125175 Submitted: 440 Running: 19 Cancelled: 0 Done-Ok: 421 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 421/1000 2014-08-18 13:45:07.687014 Submitted: 441 Running: 20 Cancelled: 0 Done-Ok: 421 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 421/1000 2014-08-18 13:45:58.498064 Submitted: 441 Running: 19 Cancelled: 0 Done-Ok: 422 Failed: 0 Aborted: 0 Status Failed: 0 Sunfn.it:8443/CREAM798130689 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:43:01,323 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:43:01,341 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:43:01,342 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:43:01,342 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134301.log]\n', '2014-08-18 13:43:01,344 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:43:02,506 DEBUG - Will invoke JobStart for JobID [CREAM297625613]\n', 'https://cert-08.pd.infn.it:8443/CREAM297625613\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM297625613 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM297625613 2014-08-18 13:43:02.792066 Submit https://cert-08.pd.infn.it:8443/CREAM297625613 Left: 569 (at submission time:569) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM297625613 2014-08-18 13:44:03.295037 Exit https://cert-08.pd.infn.it:8443/CREAM510929185 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:44:04,252 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:44:04,293 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:44:04,293 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:44:04,293 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134404.log]\n', '2014-08-18 13:44:04,298 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:44:05,445 DEBUG - Will invoke JobStart for JobID [CREAM607607166]\n', 'https://cert-08.pd.infn.it:8443/CREAM607607166\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM607607166 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM607607166 2014-08-18 13:44:05.679938 Submit https://cert-08.pd.infn.it:8443/CREAM607607166 Left: 563 (at submission time:563) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM607607166 2014-08-18 13:45:58.495449 Exit https://cert-08.pd.infn.it:8443/CREAM712251999 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:45:58,819 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:45:58,838 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:45:58,838 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:45:58,838 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134558.log]\n', '2014-08-18 13:45:58,858 DEBUG - Registering to [nfn.it:8443/CREAM101762016 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:43:58,072 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:43:58,096 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:43:58,096 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:43:58,096 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134358.log]\n', '2014-08-18 13:43:58,100 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:43:59,229 DEBUG - Will invoke JobStart for JobID [CREAM571104906]\n', 'https://cert-08.pd.infn.it:8443/CREAM571104906\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM571104906 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM571104906 2014-08-18 13:43:59.602871 Submit https://cert-08.pd.infn.it:8443/CREAM571104906 Left: 566 (at submission time:566) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM571104906 2014-08-18 13:44:58.183107 Exit https://cert-08.pd.infn.it:8443/CREAM076762258 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:44:58,479 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:44:58,498 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:44:58,498 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:44:58,498 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134458.log]\n', '2014-08-18 13:44:58,508 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:44:59,723 DEBUG - Will invoke JobStart for JobID [CREAM263090226]\n', 'https://cert-08.pd.infn.it:8443/CREAM263090226\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM263090226 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM263090226 2014-08-18 13:44:59.930170 Submit https://cert-08.pd.infn.it:8443/CREAM263090226 Left: 562 (at submission time:562) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM263090226 2014-08-18 13:46:02.839141 Exit https://cert-08.pd.infn.it:8443/CREAM333138796 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:46:03,504 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:46:03,527 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:46:03,527 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:46:03,527 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134603.log]\n', '2014-08-18 13:46:03,532 DEBUG - Registering to [nfn.it:8443/CREAM316233258 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:43:03,141 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:43:03,170 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:43:03,170 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:43:03,170 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134303.log]\n', '2014-08-18 13:43:03,173 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:43:04,497 DEBUG - Will invoke JobStart for JobID [CREAM531653638]\n', 'https://cert-08.pd.infn.it:8443/CREAM531653638\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM531653638 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM531653638 2014-08-18 13:43:04.855442 Submit https://cert-08.pd.infn.it:8443/CREAM531653638 Left: 567 (at submission time:567) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM531653638 2014-08-18 13:44:01.767510 Exit https://cert-08.pd.infn.it:8443/CREAM176218300 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:44:02,512 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:44:02,535 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:44:02,535 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:44:02,535 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134402.log]\n', '2014-08-18 13:44:02,538 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:44:03,750 DEBUG - Will invoke JobStart for JobID [CREAM836113484]\n', 'https://cert-08.pd.infn.it:8443/CREAM836113484\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM836113484 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM836113484 2014-08-18 13:44:04.206361 Submit https://cert-08.pd.infn.it:8443/CREAM836113484 Left: 565 (at submission time:565) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM836113484 2014-08-18 13:46:03.719685 Exit https://cert-08.pd.infn.it:8443/CREAM756148048 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:46:04,557 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:46:04,584 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:46:04,584 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:46:04,585 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134604.log]\n', '2014-08-18 13:46:04,595 DEBUG - Registering to [nfn.it:8443/CREAM391448938 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:44:03,241 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:44:03,262 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:44:03,263 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:44:03,263 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134403.log]\n', '2014-08-18 13:44:03,272 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:44:04,704 DEBUG - Will invoke JobStart for JobID [CREAM716958777]\n', 'https://cert-08.pd.infn.it:8443/CREAM716958777\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM716958777 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM716958777 2014-08-18 13:44:04.989601 Submit https://cert-08.pd.infn.it:8443/CREAM716958777 Left: 564 (at submission time:564) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM716958777 2014-08-18 13:45:01.228927 Exit https://cert-08.pd.infn.it:8443/CREAM539718396 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:45:01,841 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:45:01,867 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:45:01,867 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:45:01,867 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134501.log]\n', '2014-08-18 13:45:01,870 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:45:02,878 DEBUG - Will invoke JobStart for JobID [CREAM767540506]\n', 'https://cert-08.pd.infn.it:8443/CREAM767540506\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM767540506 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM767540506 2014-08-18 13:45:03.529869 Submit https://cert-08.pd.infn.it:8443/CREAM767540506 Left: 561 (at submission time:561) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM767540506 2014-08-18 13:46:04.026285 Exit https://cert-08.pd.infn.it:8443/CREAM082396342 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:46:04,825 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:46:04,849 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:46:04,849 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:46:04,849 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134604.log]\n', '2014-08-18 13:46:04,852 DEBUG - Registering to [bmit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 422/1000 2014-08-18 13:46:00.153245 Submitted: 442 Running: 20 Cancelled: 0 Done-Ok: 422 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 422/1000 2014-08-18 13:46:02.841595 Submitted: 442 Running: 19 Cancelled: 0 Done-Ok: 423 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 423/1000 2014-08-18 13:46:03.720900 Submitted: 442 Running: 18 Cancelled: 0 Done-Ok: 424 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 424/1000 2014-08-18 13:46:04.029793 Submitted: 442 Running: 17 Cancelled: 0 Done-Ok: 425 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 425/1000 2014-08-18 13:46:05.029787 Submitted: 443 Running: 18 Cancelled: 0 Done-Ok: 425 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 425/1000 2014-08-18 13:46:05.965948 Submitted: 444 Running: 19 Cancelled: 0 Done-Ok: 425 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 425/1000 2014-08-18 13:46:06.537907 Submitted: 445 Running: 20 Cancelled: 0 Done-Ok: 425 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 425/1000 2014-08-18 13:46:59.069346 Submitted: 445 Running: 19 Cancelled: 0 Done-Ok: 426 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 426/1000 2014-08-18 13:47:00.856468 Submitted: 446 Running: 20 Cancelled: 0 Done-Ok: 426 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 426/1000 2014-08-18 13:47:03.120805 Submitted: 446 Running: 19 Cancelled: 0 Done-Ok: 427 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 427/1000 2014-08-18 13:47:03.233333 Submitted: 446 Running: 18 Cancelled: 0 Done-Ok: 428 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 428/1000 2014-08-18 13:47:03.801114 Submitted: 446 Running: 17 Cancelled: 0 Done-Ok: 429 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 429/1000 2014-08-18 13:47:05.428623 Submitted: 447 Running: 18 Cancelled: 0 Done-Ok: 429 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 429/1000 2014-08-18 13:47:06.130493 Submitted: 448 Running: 19 Cancelled: 0 Done-Ok: 429 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 429/1000 2014-08-18 13:47:06.218112 Submitted: 449 Running: 20 Cancelled: 0 Done-Ok: 429 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 429/1000 2014-08-18 13:47:59.733048 Submitted: 449 Running: 19 Cancelled: 0 Done-Ok: 430 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 430/1000 2014-08-18 13:48:01.501020 Submitted: 450 Running: 20 Cancelled: 0 Done-Ok: 430 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 430/1000 2014-08-18 13:48:04.266977 Submitted: 450 Running: 19 Cancelled: 0 Done-Ok: 431 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 431/1000 2014-08-18 13:48:04.957008 Submitted: 450 Running: 18 Cancelled: 0 Done-Ok: 432 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 432/1000 2014-08-18 13:48:05.745504 Submitted: 450 Running: 17 Cancelled: 0 Done-Ok: 433 Failed: 0 Aborted: 0 Status Failed: https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:46:05,802 DEBUG - Will invoke JobStart for JobID [CREAM750265879]\n', 'https://cert-08.pd.infn.it:8443/CREAM750265879\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM750265879 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM750265879 2014-08-18 13:46:05.964946 Submit https://cert-08.pd.infn.it:8443/CREAM750265879 Left: 556 (at submission time:556) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM750265879 2014-08-18 13:47:03.230445 Exit https://cert-08.pd.infn.it:8443/CREAM021364239 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:47:03,863 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:47:03,887 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:47:03,887 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:47:03,888 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134703.log]\n', '2014-08-18 13:47:03,896 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:47:05,817 DEBUG - Will invoke JobStart for JobID [CREAM864756146]\n', 'https://cert-08.pd.infn.it:8443/CREAM864756146\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM864756146 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM864756146 2014-08-18 13:47:06.127026 Submit https://cert-08.pd.infn.it:8443/CREAM864756146 Left: 552 (at submission time:552) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM864756146 2014-08-18 13:48:04.264757 Exit https://cert-08.pd.infn.it:8443/CREAM531653638 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:48:05,043 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:48:05,069 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:48:05,070 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:48:05,070 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134805.log]\n', '2014-08-18 13:48:05,073 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:48:06,330 DEBUG - Will invoke JobStart for JobID [CREAM668718846]\n', 'https://cert-08.pd.infn.it:8443/CREAM668718846\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM668718846 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM668718846 2014-08-18 13:48:06.641641 Submit https://cert-08.pd.infn.it:8443/CREAM668718846 Left: 549 (at submisshttps://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:45:59,794 DEBUG - Will invoke JobStart for JobID [CREAM494637912]\n', 'https://cert-08.pd.infn.it:8443/CREAM494637912\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM494637912 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM494637912 2014-08-18 13:46:00.150014 Submit https://cert-08.pd.infn.it:8443/CREAM494637912 Left: 558 (at submission time:558) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM494637912 2014-08-18 13:47:59.731990 Exit https://cert-08.pd.infn.it:8443/CREAM884538892 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:48:00,169 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:48:00,193 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:48:00,194 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:48:00,194 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134800.log]\n', '2014-08-18 13:48:00,199 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:48:01,205 DEBUG - Will invoke JobStart for JobID [CREAM085572247]\n', 'https://cert-08.pd.infn.it:8443/CREAM085572247\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM085572247 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM085572247 2014-08-18 13:48:01.499414 Submit https://cert-08.pd.infn.it:8443/CREAM085572247 Left: 550 (at submission time:550) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM085572247 2014-08-18 13:48:04.955174 Exit https://cert-08.pd.infn.it:8443/CREAM297625613 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:48:05,766 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:48:05,795 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:48:05,796 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:48:05,796 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134805.log]\n', '2014-08-18 13:48:05,805 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:48:06,784 DEBUG - Will invoke JobStart for JobID [CREAM073409805]\n', 'https://cert-08.pd.infn.it:8443/CREAM073409805\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM073409805 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM073409805 2014-08-18 13:48:07.319696 Submit https://cert-08.pd.infn.it:8443/CREAM073409805 Left: 548 (at submisshttps://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:45:07,255 DEBUG - Will invoke JobStart for JobID [CREAM791071502]\n', 'https://cert-08.pd.infn.it:8443/CREAM791071502\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM791071502 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM791071502 2014-08-18 13:45:07.682777 Submit https://cert-08.pd.infn.it:8443/CREAM791071502 Left: 559 (at submission time:559) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM791071502 2014-08-18 13:47:03.119153 Exit https://cert-08.pd.infn.it:8443/CREAM706684542 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:47:03,698 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:47:03,717 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:47:03,717 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:47:03,717 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134703.log]\n', '2014-08-18 13:47:03,727 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:47:04,851 DEBUG - Will invoke JobStart for JobID [CREAM366675397]\n', 'https://cert-08.pd.infn.it:8443/CREAM366675397\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM366675397 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM366675397 2014-08-18 13:47:05.426675 Submit https://cert-08.pd.infn.it:8443/CREAM366675397 Left: 553 (at submission time:553) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM366675397 2014-08-18 13:48:05.743546 Exit https://cert-08.pd.infn.it:8443/CREAM403444545 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:48:06,515 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:48:06,540 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:48:06,540 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:48:06,540 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134806.log]\n', '2014-08-18 13:48:06,543 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:48:07,652 DEBUG - Will invoke JobStart for JobID [CREAM952358483]\n', 'https://cert-08.pd.infn.it:8443/CREAM952358483\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM952358483 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM952358483 2014-08-18 13:48:07.948348 Submit https://cert-08.pd.infn.it:8443/CREAM952358483 Left: 547 (at submisshttps://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:46:04,661 DEBUG - Will invoke JobStart for JobID [CREAM477098400]\n', 'https://cert-08.pd.infn.it:8443/CREAM477098400\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM477098400 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM477098400 2014-08-18 13:46:05.026710 Submit https://cert-08.pd.infn.it:8443/CREAM477098400 Left: 557 (at submission time:557) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM477098400 2014-08-18 13:47:03.796625 Exit https://cert-08.pd.infn.it:8443/CREAM447163726 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:47:04,865 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:47:04,883 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:47:04,884 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:47:04,884 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134704.log]\n', '2014-08-18 13:47:04,886 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:47:05,988 DEBUG - Will invoke JobStart for JobID [CREAM880759470]\n', 'https://cert-08.pd.infn.it:8443/CREAM880759470\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM880759470 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM880759470 2014-08-18 13:47:06.215033 Submit https://cert-08.pd.infn.it:8443/CREAM880759470 Left: 551 (at submission time:551) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM880759470 2014-08-18 13:48:59.490939 Exit https://cert-08.pd.infn.it:8443/CREAM571104906 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:48:59,842 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:48:59,865 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:48:59,865 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:48:59,865 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134859.log]\n', '2014-08-18 13:48:59,869 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:49:00,923 DEBUG - Will invoke JobStart for JobID [CREAM123722844]\n', 'https://cert-08.pd.infn.it:8443/CREAM123722844\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM123722844 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM123722844 2014-08-18 13:49:01.248028 Submit https://cert-08.pd.infn.it:8443/CREAM123722844 Left: 546 (at submisshttps://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:46:06,352 DEBUG - Will invoke JobStart for JobID [CREAM952919002]\n', 'https://cert-08.pd.infn.it:8443/CREAM952919002\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM952919002 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM952919002 2014-08-18 13:46:06.536791 Submit https://cert-08.pd.infn.it:8443/CREAM952919002 Left: 555 (at submission time:555) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM952919002 2014-08-18 13:46:59.068051 Exit https://cert-08.pd.infn.it:8443/CREAM590955811 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:46:59,469 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:46:59,507 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:46:59,507 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:46:59,507 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134659.log]\n', '2014-08-18 13:46:59,510 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:47:00,543 DEBUG - Will invoke JobStart for JobID [CREAM006305039]\n', 'https://cert-08.pd.infn.it:8443/CREAM006305039\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM006305039 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM006305039 2014-08-18 13:47:00.855021 Submit https://cert-08.pd.infn.it:8443/CREAM006305039 Left: 554 (at submission time:554) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM006305039 2014-08-18 13:49:04.243940 Exit https://cert-08.pd.infn.it:8443/CREAM716958777 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:49:04,912 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:49:04,944 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:49:04,944 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:49:04,944 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134904.log]\n', '2014-08-18 13:49:04,947 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:49:06,490 DEBUG - Will invoke JobStart for JobID [CREAM157335725]\n', 'https://cert-08.pd.infn.it:8443/CREAM157335725\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM157335725 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM157335725 2014-08-18 13:49:06.692291 Submit https://cert-08.pd.infn.it:8443/CREAM157335725 Left: 544 (at submiss0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 433/1000 2014-08-18 13:48:06.645464 Submitted: 451 Running: 18 Cancelled: 0 Done-Ok: 433 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 433/1000 2014-08-18 13:48:07.320723 Submitted: 452 Running: 19 Cancelled: 0 Done-Ok: 433 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 433/1000 2014-08-18 13:48:07.950676 Submitted: 453 Running: 20 Cancelled: 0 Done-Ok: 433 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 433/1000 2014-08-18 13:48:59.491800 Submitted: 453 Running: 19 Cancelled: 0 Done-Ok: 434 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 434/1000 2014-08-18 13:49:01.250182 Submitted: 454 Running: 20 Cancelled: 0 Done-Ok: 434 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 434/1000 2014-08-18 13:49:03.651058 Submitted: 454 Running: 19 Cancelled: 0 Done-Ok: 435 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 435/1000 2014-08-18 13:49:04.245991 Submitted: 454 Running: 18 Cancelled: 0 Done-Ok: 436 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 436/1000 2014-08-18 13:49:04.689318 Submitted: 454 Running: 17 Cancelled: 0 Done-Ok: 437 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 437/1000 2014-08-18 13:49:06.446422 Submitted: 455 Running: 18 Cancelled: 0 Done-Ok: 437 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 437/1000 2014-08-18 13:49:06.696570 Submitted: 456 Running: 19 Cancelled: 0 Done-Ok: 437 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 437/1000 2014-08-18 13:49:07.494355 Submitted: 457 Running: 20 Cancelled: 0 Done-Ok: 437 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 437/1000 2014-08-18 13:50:00.130135 Submitted: 457 Running: 19 Cancelled: 0 Done-Ok: 438 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 438/1000 2014-08-18 13:50:01.791952 Submitted: 458 Running: 20 Cancelled: 0 Done-Ok: 438 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 438/1000 2014-08-18 13:50:04.566790 Submitted: 458 Running: 19 Cancelled: 0 Done-Ok: 439 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 439/1000 2014-08-18 13:50:06.511389 Submitted: 458 Running: 18 Cancelled: 0 Done-Ok: 440 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 440/1000 2014-08-18 13:50:06.640886 Submitted: 459 Running: 19 Cancelled: 0 Done-Ok: 440 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 440/1000 2014-08-18 13:50:07.049074 Submitted: 459 Running: 18 Cancelled: 0 Done-Ok: 441 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 441/1000 2014-08-18 13:50:08.948851 Submitted: 460 Running: 19 Cancelled: 0 Done-Ok: 441 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 441/1000 2014-08-18 13:50:09.204688 Submitted: 461 Running: 20 Cancelled: 0 Done-Ok: 441 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 441/1000 2014-08-18 13:51:00.550212 Submitted: 461 Running: 19 Cancelled: 0 Done-Ok: 442 Failed: 0 Aborted: 0 Status Failion time:544) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM157335725 2014-08-18 13:50:06.508161 Exit https://cert-08.pd.infn.it:8443/CREAM767540506 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:50:07,374 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:50:07,400 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:50:07,400 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:50:07,400 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135007.log]\n', '2014-08-18 13:50:07,404 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:50:08,736 DEBUG - Will invoke JobStart for JobID [CREAM941244671]\n', 'https://cert-08.pd.infn.it:8443/CREAM941244671\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM941244671 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM941244671 2014-08-18 13:50:08.946249 Submit https://cert-08.pd.infn.it:8443/CREAM941244671 Left: 540 (at submission time:540) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM941244671 2014-08-18 13:51:06.339800 Exit https://cert-08.pd.infn.it:8443/CREAM952919002 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:51:06,989 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:51:07,012 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:51:07,012 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:51:07,013 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135107.log]\n', '2014-08-18 13:51:07,016 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:51:08,095 DEBUG - Will invoke JobStart for JobID [CREAM442475630]\n', 'https://cert-08.pd.infn.it:8443/CREAM442475630\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM442475630 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM442475630 2014-08-18 13:51:08.366594 Submit https://cert-08.pd.infn.it:8443/CREAM442475630 Left: 535 (at submission time:535) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM442475630 2014-08-18 13:52:00.982431 Exit https://cert-08.pd.infn.it:8443/CREAM006305039 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:52:01,337 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:52:01,361 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:52:01,361 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:52ion time:549) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM668718846 2014-08-18 13:49:03.649595 Exit https://cert-08.pd.infn.it:8443/CREAM836113484 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:49:04,545 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:49:04,568 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:49:04,568 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:49:04,568 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134904.log]\n', '2014-08-18 13:49:04,576 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:49:05,881 DEBUG - Will invoke JobStart for JobID [CREAM720985486]\n', 'https://cert-08.pd.infn.it:8443/CREAM720985486\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM720985486 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM720985486 2014-08-18 13:49:06.442467 Submit https://cert-08.pd.infn.it:8443/CREAM720985486 Left: 545 (at submission time:545) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM720985486 2014-08-18 13:51:04.786813 Exit https://cert-08.pd.infn.it:8443/CREAM750265879 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:51:05,404 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:51:05,431 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:51:05,431 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:51:05,431 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135105.log]\n', '2014-08-18 13:51:05,436 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:51:06,751 DEBUG - Will invoke JobStart for JobID [CREAM530992270]\n', 'https://cert-08.pd.infn.it:8443/CREAM530992270\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM530992270 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM530992270 2014-08-18 13:51:07.131861 Submit https://cert-08.pd.infn.it:8443/CREAM530992270 Left: 536 (at submission time:536) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM530992270 2014-08-18 13:52:05.436329 Exit https://cert-08.pd.infn.it:8443/CREAM864756146 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:52:06,218 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:52:06,247 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:52:06,247 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:52ion time:547) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM952358483 2014-08-18 13:50:04.564958 Exit https://cert-08.pd.infn.it:8443/CREAM492191966 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:50:05,250 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:50:05,277 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:50:05,277 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:50:05,278 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135005.log]\n', '2014-08-18 13:50:05,283 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:50:06,337 DEBUG - Will invoke JobStart for JobID [CREAM751049351]\n', 'https://cert-08.pd.infn.it:8443/CREAM751049351\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM751049351 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM751049351 2014-08-18 13:50:06.639067 Submit https://cert-08.pd.infn.it:8443/CREAM751049351 Left: 541 (at submission time:541) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM751049351 2014-08-18 13:50:07.044234 Exit https://cert-08.pd.infn.it:8443/CREAM791071502 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:50:07,649 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:50:07,673 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:50:07,673 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:50:07,673 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135007.log]\n', '2014-08-18 13:50:07,677 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:50:08,860 DEBUG - Will invoke JobStart for JobID [CREAM475209580]\n', 'https://cert-08.pd.infn.it:8443/CREAM475209580\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM475209580 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM475209580 2014-08-18 13:50:09.203952 Submit https://cert-08.pd.infn.it:8443/CREAM475209580 Left: 539 (at submission time:539) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM475209580 2014-08-18 13:52:05.741285 Exit https://cert-08.pd.infn.it:8443/CREAM366675397 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:52:06,412 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:52:06,435 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:52:06,435 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:52ion time:546) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM123722844 2014-08-18 13:50:00.127461 Exit https://cert-08.pd.infn.it:8443/CREAM263090226 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:50:00,455 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:50:00,478 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:50:00,478 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:50:00,478 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135000.log]\n', '2014-08-18 13:50:00,486 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:50:01,418 DEBUG - Will invoke JobStart for JobID [CREAM234410654]\n', 'https://cert-08.pd.infn.it:8443/CREAM234410654\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM234410654 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM234410654 2014-08-18 13:50:01.789962 Submit https://cert-08.pd.infn.it:8443/CREAM234410654 Left: 542 (at submission time:542) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM234410654 2014-08-18 13:51:04.637730 Exit https://cert-08.pd.infn.it:8443/CREAM477098400 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:51:05,306 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:51:05,339 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:51:05,339 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:51:05,339 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135105.log]\n', '2014-08-18 13:51:05,341 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:51:06,669 DEBUG - Will invoke JobStart for JobID [CREAM504052608]\n', 'https://cert-08.pd.infn.it:8443/CREAM504052608\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM504052608 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM504052608 2014-08-18 13:51:06.922049 Submit https://cert-08.pd.infn.it:8443/CREAM504052608 Left: 537 (at submission time:537) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM504052608 2014-08-18 13:52:06.438265 Exit https://cert-08.pd.infn.it:8443/CREAM880759470 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:52:07,514 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:52:07,537 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:52:07,537 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:52ion time:548) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM073409805 2014-08-18 13:49:04.687334 Exit https://cert-08.pd.infn.it:8443/CREAM607607166 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:49:05,850 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:49:05,873 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:49:05,874 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:49:05,874 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-134905.log]\n', '2014-08-18 13:49:05,877 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:49:07,322 DEBUG - Will invoke JobStart for JobID [CREAM498297145]\n', 'https://cert-08.pd.infn.it:8443/CREAM498297145\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM498297145 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM498297145 2014-08-18 13:49:07.492817 Submit https://cert-08.pd.infn.it:8443/CREAM498297145 Left: 543 (at submission time:543) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM498297145 2014-08-18 13:51:00.547283 Exit https://cert-08.pd.infn.it:8443/CREAM494637912 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:51:00,859 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:51:00,889 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:51:00,889 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:51:00,889 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135100.log]\n', '2014-08-18 13:51:00,892 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:51:01,801 DEBUG - Will invoke JobStart for JobID [CREAM209388623]\n', 'https://cert-08.pd.infn.it:8443/CREAM209388623\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM209388623 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM209388623 2014-08-18 13:51:02.215687 Submit https://cert-08.pd.infn.it:8443/CREAM209388623 Left: 538 (at submission time:538) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM209388623 2014-08-18 13:53:01.282020 Exit https://cert-08.pd.infn.it:8443/CREAM085572247 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:53:01,663 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:53:01,694 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:53:01,694 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:53ed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 442/1000 2014-08-18 13:51:02.216769 Submitted: 462 Running: 20 Cancelled: 0 Done-Ok: 442 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 442/1000 2014-08-18 13:51:04.639222 Submitted: 462 Running: 19 Cancelled: 0 Done-Ok: 443 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 443/1000 2014-08-18 13:51:04.788141 Submitted: 462 Running: 18 Cancelled: 0 Done-Ok: 444 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 444/1000 2014-08-18 13:51:06.343232 Submitted: 462 Running: 17 Cancelled: 0 Done-Ok: 445 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 445/1000 2014-08-18 13:51:06.923842 Submitted: 463 Running: 18 Cancelled: 0 Done-Ok: 445 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 445/1000 2014-08-18 13:51:07.134936 Submitted: 464 Running: 19 Cancelled: 0 Done-Ok: 445 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 445/1000 2014-08-18 13:51:08.369936 Submitted: 465 Running: 20 Cancelled: 0 Done-Ok: 445 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 445/1000 2014-08-18 13:52:00.983919 Submitted: 465 Running: 19 Cancelled: 0 Done-Ok: 446 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 446/1000 2014-08-18 13:52:02.629857 Submitted: 466 Running: 20 Cancelled: 0 Done-Ok: 446 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 446/1000 2014-08-18 13:52:05.437812 Submitted: 466 Running: 19 Cancelled: 0 Done-Ok: 447 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 447/1000 2014-08-18 13:52:05.744158 Submitted: 466 Running: 18 Cancelled: 0 Done-Ok: 448 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 448/1000 2014-08-18 13:52:06.439425 Submitted: 466 Running: 17 Cancelled: 0 Done-Ok: 449 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 449/1000 2014-08-18 13:52:07.558038 Submitted: 467 Running: 18 Cancelled: 0 Done-Ok: 449 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 449/1000 2014-08-18 13:52:08.304803 Submitted: 468 Running: 19 Cancelled: 0 Done-Ok: 449 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 449/1000 2014-08-18 13:52:09.090219 Submitted: 469 Running: 20 Cancelled: 0 Done-Ok: 449 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 449/1000 2014-08-18 13:53:01.283669 Submitted: 469 Running: 19 Cancelled: 0 Done-Ok: 450 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 450/1000 2014-08-18 13:53:03.267946 Submitted: 470 Running: 20 Cancelled: 0 Done-Ok: 450 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 450/1000 2014-08-18 13:53:06.285441 Submitted: 470 Running: 19 Cancelled: 0 Done-Ok: 451 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 451/1000 2014-08-18 13:53:06.868791 Submitted: 470 Running: 18 Cancelled: 0 Done-Ok: 452 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 452/1000 2014-08-18 13:53:07.798817 Submitted: 470 Running: 17 Cancelled: 0 Done-Ok: 453 Failed: 0 Aborted: 0 Status :06,247 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135206.log]\n', '2014-08-18 13:52:06,261 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:52:07,288 DEBUG - Will invoke JobStart for JobID [CREAM406851620]\n', 'https://cert-08.pd.infn.it:8443/CREAM406851620\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM406851620 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM406851620 2014-08-18 13:52:07.555045 Submit https://cert-08.pd.infn.it:8443/CREAM406851620 Left: 533 (at submission time:533) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM406851620 2014-08-18 13:53:06.867392 Exit https://cert-08.pd.infn.it:8443/CREAM668718846 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:53:07,519 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:53:07,542 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:53:07,542 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:53:07,542 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135307.log]\n', '2014-08-18 13:53:07,546 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:53:08,744 DEBUG - Will invoke JobStart for JobID [CREAM807400575]\n', 'https://cert-08.pd.infn.it:8443/CREAM807400575\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM807400575 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM807400575 2014-08-18 13:53:09.258087 Submit https://cert-08.pd.infn.it:8443/CREAM807400575 Left: 528 (at submission time:528) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM807400575 2014-08-18 13:54:06.771016 Exit https://cert-08.pd.infn.it:8443/CREAM720985486 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:54:07,420 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:54:07,443 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:54:07,443 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:54:07,443 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135407.log]\n', '2014-08-18 13:54:07,446 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:54:08,737 DEBUG - Will invoke JobStart for JobID [CREAM149559558]\n', 'https://cert-08.pd.infn.it:8443/CREAM149559558\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM149559558 Submitted job::01,694 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135301.log]\n', '2014-08-18 13:53:01,700 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:53:02,764 DEBUG - Will invoke JobStart for JobID [CREAM866235093]\n', 'https://cert-08.pd.infn.it:8443/CREAM866235093\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM866235093 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM866235093 2014-08-18 13:53:03.265886 Submit https://cert-08.pd.infn.it:8443/CREAM866235093 Left: 530 (at submission time:530) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM866235093 2014-08-18 13:53:06.281931 Exit https://cert-08.pd.infn.it:8443/CREAM073409805 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:53:06,962 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:53:06,986 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:53:06,987 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:53:06,987 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135306.log]\n', '2014-08-18 13:53:06,995 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:53:08,234 DEBUG - Will invoke JobStart for JobID [CREAM812375478]\n', 'https://cert-08.pd.infn.it:8443/CREAM812375478\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM812375478 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM812375478 2014-08-18 13:53:08.394984 Submit https://cert-08.pd.infn.it:8443/CREAM812375478 Left: 529 (at submission time:529) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM812375478 2014-08-18 13:54:07.262562 Exit https://cert-08.pd.infn.it:8443/CREAM498297145 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:54:08,152 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:54:08,181 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:54:08,181 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:54:08,181 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135408.log]\n', '2014-08-18 13:54:08,184 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:54:09,212 DEBUG - Will invoke JobStart for JobID [CREAM167361264]\n', 'https://cert-08.pd.infn.it:8443/CREAM167361264\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM167361264 Submitted job::07,537 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135207.log]\n', '2014-08-18 13:52:07,540 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:52:08,711 DEBUG - Will invoke JobStart for JobID [CREAM457024546]\n', 'https://cert-08.pd.infn.it:8443/CREAM457024546\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM457024546 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM457024546 2014-08-18 13:52:09.089042 Submit https://cert-08.pd.infn.it:8443/CREAM457024546 Left: 531 (at submission time:531) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM457024546 2014-08-18 13:54:02.201077 Exit https://cert-08.pd.infn.it:8443/CREAM123722844 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:54:02,512 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:54:02,540 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:54:02,541 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:54:02,541 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135402.log]\n', '2014-08-18 13:54:02,544 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:54:03,643 DEBUG - Will invoke JobStart for JobID [CREAM361539263]\n', 'https://cert-08.pd.infn.it:8443/CREAM361539263\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM361539263 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM361539263 2014-08-18 13:54:04.199796 Submit https://cert-08.pd.infn.it:8443/CREAM361539263 Left: 526 (at submission time:526) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM361539263 2014-08-18 13:55:01.985229 Exit https://cert-08.pd.infn.it:8443/CREAM234410654 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:55:02,344 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:55:02,366 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:55:02,366 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:55:02,367 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135502.log]\n', '2014-08-18 13:55:02,370 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:55:03,452 DEBUG - Will invoke JobStart for JobID [CREAM635928751]\n', 'https://cert-08.pd.infn.it:8443/CREAM635928751\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM635928751 Submitted job::06,436 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135206.log]\n', '2014-08-18 13:52:06,442 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:52:07,978 DEBUG - Will invoke JobStart for JobID [CREAM744388127]\n', 'https://cert-08.pd.infn.it:8443/CREAM744388127\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM744388127 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM744388127 2014-08-18 13:52:08.303456 Submit https://cert-08.pd.infn.it:8443/CREAM744388127 Left: 532 (at submission time:532) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM744388127 2014-08-18 13:53:07.793603 Exit https://cert-08.pd.infn.it:8443/CREAM952358483 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:53:08,655 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:53:08,681 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:53:08,681 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:53:08,681 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135308.log]\n', '2014-08-18 13:53:08,684 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:53:09,710 DEBUG - Will invoke JobStart for JobID [CREAM225374484]\n', 'https://cert-08.pd.infn.it:8443/CREAM225374484\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM225374484 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM225374484 2014-08-18 13:53:10.175666 Submit https://cert-08.pd.infn.it:8443/CREAM225374484 Left: 527 (at submission time:527) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM225374484 2014-08-18 13:55:06.905069 Exit https://cert-08.pd.infn.it:8443/CREAM751049351 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:55:07,713 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:55:07,736 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:55:07,736 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:55:07,737 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135507.log]\n', '2014-08-18 13:55:07,746 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:55:08,818 DEBUG - Will invoke JobStart for JobID [CREAM774871161]\n', 'https://cert-08.pd.infn.it:8443/CREAM774871161\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM774871161 Submitted job::01,361 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135201.log]\n', '2014-08-18 13:52:01,367 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:52:02,387 DEBUG - Will invoke JobStart for JobID [CREAM050379821]\n', 'https://cert-08.pd.infn.it:8443/CREAM050379821\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM050379821 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM050379821 2014-08-18 13:52:02.627403 Submit https://cert-08.pd.infn.it:8443/CREAM050379821 Left: 534 (at submission time:534) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM050379821 2014-08-18 13:54:08.261126 Exit https://cert-08.pd.infn.it:8443/CREAM157335725 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:54:09,224 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:54:09,263 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:54:09,264 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:54:09,264 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135409.log]\n', '2014-08-18 13:54:09,272 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:54:10,569 DEBUG - Will invoke JobStart for JobID [CREAM776591891]\n', 'https://cert-08.pd.infn.it:8443/CREAM776591891\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM776591891 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM776591891 2014-08-18 13:54:10.885749 Submit https://cert-08.pd.infn.it:8443/CREAM776591891 Left: 523 (at submission time:523) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM776591891 2014-08-18 13:55:08.333141 Exit https://cert-08.pd.infn.it:8443/CREAM941244671 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:55:09,229 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:55:09,266 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:55:09,266 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:55:09,266 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135509.log]\n', '2014-08-18 13:55:09,270 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:55:10,393 DEBUG - Will invoke JobStart for JobID [CREAM086280939]\n', 'https://cert-08.pd.infn.it:8443/CREAM086280939\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM086280939 Submitted job:Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 453/1000 2014-08-18 13:53:08.399291 Submitted: 471 Running: 18 Cancelled: 0 Done-Ok: 453 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 453/1000 2014-08-18 13:53:09.259370 Submitted: 472 Running: 19 Cancelled: 0 Done-Ok: 453 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 453/1000 2014-08-18 13:53:10.177859 Submitted: 473 Running: 20 Cancelled: 0 Done-Ok: 453 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 453/1000 2014-08-18 13:54:02.202986 Submitted: 473 Running: 19 Cancelled: 0 Done-Ok: 454 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 454/1000 2014-08-18 13:54:04.201184 Submitted: 474 Running: 20 Cancelled: 0 Done-Ok: 454 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 454/1000 2014-08-18 13:54:06.774472 Submitted: 474 Running: 19 Cancelled: 0 Done-Ok: 455 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 455/1000 2014-08-18 13:54:07.264962 Submitted: 474 Running: 18 Cancelled: 0 Done-Ok: 456 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 456/1000 2014-08-18 13:54:08.263090 Submitted: 474 Running: 17 Cancelled: 0 Done-Ok: 457 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 457/1000 2014-08-18 13:54:09.179730 Submitted: 475 Running: 18 Cancelled: 0 Done-Ok: 457 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 457/1000 2014-08-18 13:54:09.459551 Submitted: 476 Running: 19 Cancelled: 0 Done-Ok: 457 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 457/1000 2014-08-18 13:54:10.888684 Submitted: 477 Running: 20 Cancelled: 0 Done-Ok: 457 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 457/1000 2014-08-18 13:55:01.988495 Submitted: 477 Running: 19 Cancelled: 0 Done-Ok: 458 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 458/1000 2014-08-18 13:55:03.759340 Submitted: 478 Running: 20 Cancelled: 0 Done-Ok: 458 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 458/1000 2014-08-18 13:55:06.908168 Submitted: 478 Running: 19 Cancelled: 0 Done-Ok: 459 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 459/1000 2014-08-18 13:55:08.335304 Submitted: 478 Running: 18 Cancelled: 0 Done-Ok: 460 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 460/1000 2014-08-18 13:55:09.210923 Submitted: 479 Running: 19 Cancelled: 0 Done-Ok: 460 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 460/1000 2014-08-18 13:55:09.566066 Submitted: 479 Running: 18 Cancelled: 0 Done-Ok: 461 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 461/1000 2014-08-18 13:55:10.882381 Submitted: 480 Running: 19 Cancelled: 0 Done-Ok: 461 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 461/1000 2014-08-18 13:55:11.975671 Submitted: 481 Running: 20 Cancelled: 0 Done-Ok: 461 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 461/1000 2014-08-18 13:56:02.645944 Submitted: 481 Running: 19 Cancelled: 0 Done-Ok: 462 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 462/1000 2014-08-18 13:56:04.384667 Submitted: 482 Running: 20 Cancelled: 0 Done-Ok: 462 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 462/1000 2014-08-18 13:56:07.823691 Submitted: 482 Running: 19 Cancelled: 0 Done-Ok: 463 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 463/1000 2014-08-18 13:56:07.906594 Submitted: 482 Running: 18 Cancelled: 0 Done-Ok: 464 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 464/1000 2014-08-18 13:56:09.142474 Submitted: 482 Running: 17 Cancelled: 0 Done-Ok: 465 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 465/1000 2014-08-18 13:56:09.739431 Submitted: 483 Running: 18 Cancelled: 0 Done-Ok: 465 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 465/1000 2014-08-18 13:56:09.946655 Submitted: 484 Running: 19 Cancelled: 0 Done-Ok: 465 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 465/1000 2014-08-18 13:56:11.290721 Submitted: 485 Running: 20 Cancelled: 0 Done-Ok: 465 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 465/1000 2014-08-18 13:57:03.034231 Submitted: 485 Running: 19 Cancelled: 0 Done-Ok: 466 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 466/1000 2014-08-18 13:57:04.720239 Submitted: 486 Running: 20 Cancelled: 0 Done-Ok: 466 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 466/1000 2014-08-18 13:57:07.530328 Submitted: 486 Running: 19 Cancelled: 0 Done-Ok: 467 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 467/1000 2014-08-18 13:57:08.387974 Submitted: 486 Running: 18 Cancelled: 0 Done-Ok: 468 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 468/1000 2014-08-18 13:57:08.646870 Submitted: 486 Running: 17 Cancelled: 0 Done-Ok: 469 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 469/1000 2014-08-18 13:57:09.679312 Submitted: 487 Running: 18 Cancelled: 0 Done-Ok: 469 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 469/1000 2014-08-18 13:57:10.940424 Submitted: 488 Running: 19 Cancelled: 0 Done-Ok: 469 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 469/1000 2014-08-18 13:57:10.989033 Submitted: 489 Running: 20 Cancelled: 0 Done-Ok: 469 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 469/1000 2014-08-18 13:58:03.745872 Submitted: 489 Running: 19 Cancelled: 0 Done-Ok: 470 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 470/1000 2014-08-18 13:58:05.390040 Submitted: 490 Running: 20 Cancelled: 0 Done-Ok: 470 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 470/1000 2014-08-18 13:58:08.411439 Submitted: 490 Running: 19 Cancelled: 0 Done-Ok: 471 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 471/1000 2014-08-18 13:58:08.619861 Submitted: 490 Running: 18 Cancelled: 0 Done-Ok: 472 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 472/1000 2014-08-18 13:58:10.514943 Submitted: 490 Running: 17 Cancelled: 0 Done-Ok: 473 Failed: 0 Aborted: 0 jid = https://cert-08.pd.infn.it:8443/CREAM149559558 2014-08-18 13:54:09.174750 Submit https://cert-08.pd.infn.it:8443/CREAM149559558 Left: 525 (at submission time:525) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM149559558 2014-08-18 13:56:09.140975 Exit https://cert-08.pd.infn.it:8443/CREAM530992270 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:56:09,862 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:56:09,895 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:56:09,895 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:56:09,895 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135609.log]\n', '2014-08-18 13:56:09,898 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:56:11,077 DEBUG - Will invoke JobStart for JobID [CREAM136130738]\n', 'https://cert-08.pd.infn.it:8443/CREAM136130738\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM136130738 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM136130738 2014-08-18 13:56:11.288760 Submit https://cert-08.pd.infn.it:8443/CREAM136130738 Left: 515 (at submission time:515) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM136130738 2014-08-18 13:57:07.528868 Exit https://cert-08.pd.infn.it:8443/CREAM406851620 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:57:08,184 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:57:08,207 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:57:08,207 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:57:08,207 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135708.log]\n', '2014-08-18 13:57:08,211 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:57:09,343 DEBUG - Will invoke JobStart for JobID [CREAM130832967]\n', 'https://cert-08.pd.infn.it:8443/CREAM130832967\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM130832967 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM130832967 2014-08-18 13:57:09.677436 Submit https://cert-08.pd.infn.it:8443/CREAM130832967 Left: 513 (at submission time:513) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM130832967 2014-08-18 13:58:08.408285 Exit https://cert-08.pd.infn.it:8443/CREAM807400575 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:58:09,361 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:58:09,386 DEB jid = https://cert-08.pd.infn.it:8443/CREAM167361264 2014-08-18 13:54:09.455091 Submit https://cert-08.pd.infn.it:8443/CREAM167361264 Left: 524 (at submission time:524) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM167361264 2014-08-18 13:56:02.644779 Exit https://cert-08.pd.infn.it:8443/CREAM209388623 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:56:03,031 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:56:03,064 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:56:03,064 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:56:03,064 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135603.log]\n', '2014-08-18 13:56:03,073 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:56:04,124 DEBUG - Will invoke JobStart for JobID [CREAM307684345]\n', 'https://cert-08.pd.infn.it:8443/CREAM307684345\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM307684345 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM307684345 2014-08-18 13:56:04.381864 Submit https://cert-08.pd.infn.it:8443/CREAM307684345 Left: 518 (at submission time:518) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM307684345 2014-08-18 13:58:03.744165 Exit https://cert-08.pd.infn.it:8443/CREAM866235093 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:58:04,151 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:58:04,180 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:58:04,180 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:58:04,181 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135804.log]\n', '2014-08-18 13:58:04,195 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:58:05,085 DEBUG - Will invoke JobStart for JobID [CREAM122526341]\n', 'https://cert-08.pd.infn.it:8443/CREAM122526341\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM122526341 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM122526341 2014-08-18 13:58:05.387997 Submit https://cert-08.pd.infn.it:8443/CREAM122526341 Left: 510 (at submission time:510) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM122526341 2014-08-18 13:58:08.616722 Exit https://cert-08.pd.infn.it:8443/CREAM812375478 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:58:09,441 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:58:09,476 DEB jid = https://cert-08.pd.infn.it:8443/CREAM774871161 2014-08-18 13:55:09.209819 Submit https://cert-08.pd.infn.it:8443/CREAM774871161 Left: 521 (at submission time:521) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM774871161 2014-08-18 13:55:09.563999 Exit https://cert-08.pd.infn.it:8443/CREAM475209580 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:55:10,434 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:55:10,458 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:55:10,458 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:55:10,459 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135510.log]\n', '2014-08-18 13:55:10,462 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:55:11,652 DEBUG - Will invoke JobStart for JobID [CREAM576000641]\n', 'https://cert-08.pd.infn.it:8443/CREAM576000641\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM576000641 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM576000641 2014-08-18 13:55:11.967187 Submit https://cert-08.pd.infn.it:8443/CREAM576000641 Left: 519 (at submission time:519) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM576000641 2014-08-18 13:57:08.641430 Exit https://cert-08.pd.infn.it:8443/CREAM744388127 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:57:09,422 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:57:09,446 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:57:09,446 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:57:09,446 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135709.log]\n', '2014-08-18 13:57:09,451 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:57:10,702 DEBUG - Will invoke JobStart for JobID [CREAM440387180]\n', 'https://cert-08.pd.infn.it:8443/CREAM440387180\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM440387180 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM440387180 2014-08-18 13:57:10.986801 Submit https://cert-08.pd.infn.it:8443/CREAM440387180 Left: 511 (at submission time:511) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM440387180 2014-08-18 13:58:10.513252 Exit https://cert-08.pd.infn.it:8443/CREAM225374484 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:58:11,069 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:58:11,115 DEB jid = https://cert-08.pd.infn.it:8443/CREAM635928751 2014-08-18 13:55:03.756594 Submit https://cert-08.pd.infn.it:8443/CREAM635928751 Left: 522 (at submission time:522) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM635928751 2014-08-18 13:56:07.904778 Exit https://cert-08.pd.infn.it:8443/CREAM504052608 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:56:08,449 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:56:08,493 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:56:08,494 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:56:08,494 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135608.log]\n', '2014-08-18 13:56:08,501 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:56:09,519 DEBUG - Will invoke JobStart for JobID [CREAM990167860]\n', 'https://cert-08.pd.infn.it:8443/CREAM990167860\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM990167860 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM990167860 2014-08-18 13:56:09.736546 Submit https://cert-08.pd.infn.it:8443/CREAM990167860 Left: 517 (at submission time:517) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM990167860 2014-08-18 13:57:08.385301 Exit https://cert-08.pd.infn.it:8443/CREAM457024546 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:57:09,373 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:57:09,396 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:57:09,396 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:57:09,397 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135709.log]\n', '2014-08-18 13:57:09,399 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:57:10,572 DEBUG - Will invoke JobStart for JobID [CREAM968163628]\n', 'https://cert-08.pd.infn.it:8443/CREAM968163628\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM968163628 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM968163628 2014-08-18 13:57:10.938716 Submit https://cert-08.pd.infn.it:8443/CREAM968163628 Left: 512 (at submission time:512) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM968163628 2014-08-18 13:59:03.822681 Exit https://cert-08.pd.infn.it:8443/CREAM361539263 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:59:04,185 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:59:04,230 DEB jid = https://cert-08.pd.infn.it:8443/CREAM086280939 2014-08-18 13:55:10.880215 Submit https://cert-08.pd.infn.it:8443/CREAM086280939 Left: 520 (at submission time:520) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM086280939 2014-08-18 13:56:07.820945 Exit https://cert-08.pd.infn.it:8443/CREAM442475630 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:56:08,471 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:56:08,510 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:56:08,510 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:56:08,510 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135608.log]\n', '2014-08-18 13:56:08,520 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:56:09,678 DEBUG - Will invoke JobStart for JobID [CREAM403492768]\n', 'https://cert-08.pd.infn.it:8443/CREAM403492768\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM403492768 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM403492768 2014-08-18 13:56:09.942528 Submit https://cert-08.pd.infn.it:8443/CREAM403492768 Left: 516 (at submission time:516) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM403492768 2014-08-18 13:57:03.032792 Exit https://cert-08.pd.infn.it:8443/CREAM050379821 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:57:03,334 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:57:03,353 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:57:03,353 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:57:03,353 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135703.log]\n', '2014-08-18 13:57:03,356 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:57:04,385 DEBUG - Will invoke JobStart for JobID [CREAM947699206]\n', 'https://cert-08.pd.infn.it:8443/CREAM947699206\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM947699206 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM947699206 2014-08-18 13:57:04.719380 Submit https://cert-08.pd.infn.it:8443/CREAM947699206 Left: 514 (at submission time:514) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM947699206 2014-08-18 13:59:09.358564 Exit https://cert-08.pd.infn.it:8443/CREAM776591891 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:59:10,192 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:59:10,217 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:58:11,116 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:58:11,116 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135811.log]\n', '2014-08-18 13:58:11,119 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:58:12,229 DEBUG - Will invoke JobStart for JobID [CREAM743664271]\n', 'https://cert-08.pd.infn.it:8443/CREAM743664271\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM743664271 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM743664271 2014-08-18 13:58:12.526146 Submit https://cert-08.pd.infn.it:8443/CREAM743664271 Left: 507 (at submission time:507) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM743664271 2014-08-18 14:00:09.372991 Exit https://cert-08.pd.infn.it:8443/CREAM774871161 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:00:10,089 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:00:10,112 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:00:10,112 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:00:10,112 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140010.log]\n', '2014-08-18 14:00:10,121 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:00:11,301 DEBUG - Will invoke JobStart for JobID [CREAM476383013]\n', 'https://cert-08.pd.infn.it:8443/CREAM476383013\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM476383013 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM476383013 2014-08-18 14:00:11.670234 Submit https://cert-08.pd.infn.it:8443/CREAM476383013 Left: 501 (at submission time:501) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM476383013 2014-08-18 14:00:12.031333 Exit https://cert-08.pd.infn.it:8443/CREAM576000641 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:00:12,862 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:00:12,885 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:00:12,885 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:00:12,886 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140012.log]\n', '2014-08-18 14:00:12,889 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:00:14,245 DEBUG - Will invoke JobStart for JobID [CREAM372312895]\n', 'https://cert-08.pd.infn.it:8443/CREAM3 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 473/1000 2014-08-18 13:58:10.755034 Submitted: 491 Running: 18 Cancelled: 0 Done-Ok: 473 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 473/1000 2014-08-18 13:58:11.240611 Submitted: 492 Running: 19 Cancelled: 0 Done-Ok: 473 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 473/1000 2014-08-18 13:58:12.528898 Submitted: 493 Running: 20 Cancelled: 0 Done-Ok: 473 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 473/1000 2014-08-18 13:59:03.825795 Submitted: 493 Running: 19 Cancelled: 0 Done-Ok: 474 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 474/1000 2014-08-18 13:59:05.698743 Submitted: 494 Running: 20 Cancelled: 0 Done-Ok: 474 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 474/1000 2014-08-18 13:59:08.284847 Submitted: 494 Running: 19 Cancelled: 0 Done-Ok: 475 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 475/1000 2014-08-18 13:59:09.360506 Submitted: 494 Running: 18 Cancelled: 0 Done-Ok: 476 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 476/1000 2014-08-18 13:59:09.620743 Submitted: 494 Running: 17 Cancelled: 0 Done-Ok: 477 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 477/1000 2014-08-18 13:59:10.739226 Submitted: 495 Running: 18 Cancelled: 0 Done-Ok: 477 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 477/1000 2014-08-18 13:59:11.660599 Submitted: 496 Running: 19 Cancelled: 0 Done-Ok: 477 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 477/1000 2014-08-18 13:59:11.955481 Submitted: 497 Running: 20 Cancelled: 0 Done-Ok: 477 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 477/1000 2014-08-18 14:00:04.316528 Submitted: 497 Running: 19 Cancelled: 0 Done-Ok: 478 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 478/1000 2014-08-18 14:00:05.926684 Submitted: 498 Running: 20 Cancelled: 0 Done-Ok: 478 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 478/1000 2014-08-18 14:00:09.376764 Submitted: 498 Running: 19 Cancelled: 0 Done-Ok: 479 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 479/1000 2014-08-18 14:00:09.802009 Submitted: 498 Running: 18 Cancelled: 0 Done-Ok: 480 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 480/1000 2014-08-18 14:00:11.676727 Submitted: 499 Running: 19 Cancelled: 0 Done-Ok: 480 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 480/1000 2014-08-18 14:00:11.836411 Submitted: 500 Running: 20 Cancelled: 0 Done-Ok: 480 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 480/1000 2014-08-18 14:00:12.033344 Submitted: 500 Running: 19 Cancelled: 0 Done-Ok: 481 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 481/1000 2014-08-18 14:00:14.521826 Submitted: 501 Running: 20 Cancelled: 0 Done-Ok: 481 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 481/1000 2014-08-18 14:01:04.569566 Submitted: 501 Running: 19 Cancelled: 0 Done-Ok: 482 Failed: 0 Aborted: 0 UG - VO from certificate=[dteam]\n', '2014-08-18 13:58:09,476 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:58:09,476 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135809.log]\n', '2014-08-18 13:58:09,480 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:58:10,947 DEBUG - Will invoke JobStart for JobID [CREAM418510106]\n', 'https://cert-08.pd.infn.it:8443/CREAM418510106\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM418510106 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM418510106 2014-08-18 13:58:11.238609 Submit https://cert-08.pd.infn.it:8443/CREAM418510106 Left: 508 (at submission time:508) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM418510106 2014-08-18 13:59:09.618328 Exit https://cert-08.pd.infn.it:8443/CREAM167361264 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:59:10,368 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:59:10,403 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:59:10,403 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:59:10,403 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135910.log]\n', '2014-08-18 13:59:10,408 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:59:11,689 DEBUG - Will invoke JobStart for JobID [CREAM420466701]\n', 'https://cert-08.pd.infn.it:8443/CREAM420466701\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM420466701 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM420466701 2014-08-18 13:59:11.952840 Submit https://cert-08.pd.infn.it:8443/CREAM420466701 Left: 503 (at submission time:503) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM420466701 2014-08-18 14:01:04.565138 Exit https://cert-08.pd.infn.it:8443/CREAM307684345 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:01:04,962 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:01:04,999 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:01:05,000 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:01:05,000 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140105.log]\n', '2014-08-18 14:01:05,009 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:01:06,184 DEBUG - Will invoke JobStart for JobID [CREAM806394479]\n', 'https://cert-08.pd.infn.it:8443/CREAM8UG - VO from certificate=[dteam]\n', '2014-08-18 13:59:04,230 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:59:04,231 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135904.log]\n', '2014-08-18 13:59:04,235 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:59:05,328 DEBUG - Will invoke JobStart for JobID [CREAM736785794]\n', 'https://cert-08.pd.infn.it:8443/CREAM736785794\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM736785794 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM736785794 2014-08-18 13:59:05.697668 Submit https://cert-08.pd.infn.it:8443/CREAM736785794 Left: 506 (at submission time:506) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM736785794 2014-08-18 14:00:04.314222 Exit https://cert-08.pd.infn.it:8443/CREAM635928751 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:00:04,657 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:00:04,680 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:00:04,680 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:00:04,681 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140004.log]\n', '2014-08-18 14:00:04,690 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:00:05,594 DEBUG - Will invoke JobStart for JobID [CREAM539997845]\n', 'https://cert-08.pd.infn.it:8443/CREAM539997845\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM539997845 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM539997845 2014-08-18 14:00:05.922125 Submit https://cert-08.pd.infn.it:8443/CREAM539997845 Left: 502 (at submission time:502) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM539997845 2014-08-18 14:01:09.710568 Exit https://cert-08.pd.infn.it:8443/CREAM990167860 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:01:10,532 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:01:10,558 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:01:10,558 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:01:10,558 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140110.log]\n', '2014-08-18 14:01:10,562 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:01:11,677 DEBUG - Will invoke JobStart for JobID [CREAM523730937]\n', 'https://cert-08.pd.infn.it:8443/CREAM5UG - VO from certificate=[dteam]\n', '2014-08-18 13:59:10,218 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:59:10,218 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135910.log]\n', '2014-08-18 13:59:10,221 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:59:11,344 DEBUG - Will invoke JobStart for JobID [CREAM595355526]\n', 'https://cert-08.pd.infn.it:8443/CREAM595355526\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM595355526 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM595355526 2014-08-18 13:59:11.657400 Submit https://cert-08.pd.infn.it:8443/CREAM595355526 Left: 504 (at submission time:504) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM595355526 2014-08-18 14:00:09.800502 Exit https://cert-08.pd.infn.it:8443/CREAM086280939 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:00:10,443 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:00:10,467 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:00:10,467 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:00:10,467 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140010.log]\n', '2014-08-18 14:00:10,477 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:00:11,619 DEBUG - Will invoke JobStart for JobID [CREAM111725815]\n', 'https://cert-08.pd.infn.it:8443/CREAM111725815\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM111725815 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM111725815 2014-08-18 14:00:11.830556 Submit https://cert-08.pd.infn.it:8443/CREAM111725815 Left: 500 (at submission time:500) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM111725815 2014-08-18 14:01:10.302168 Exit https://cert-08.pd.infn.it:8443/CREAM403492768 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:01:11,031 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:01:11,054 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:01:11,054 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:01:11,054 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140111.log]\n', '2014-08-18 14:01:11,057 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:01:12,499 DEBUG - Will invoke JobStart for JobID [CREAM831604027]\n', 'https://cert-08.pd.infn.it:8443/CREAM8UG - VO from certificate=[dteam]\n', '2014-08-18 13:58:09,387 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:58:09,387 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135809.log]\n', '2014-08-18 13:58:09,390 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:58:10,504 DEBUG - Will invoke JobStart for JobID [CREAM598594344]\n', 'https://cert-08.pd.infn.it:8443/CREAM598594344\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM598594344 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM598594344 2014-08-18 13:58:10.751976 Submit https://cert-08.pd.infn.it:8443/CREAM598594344 Left: 509 (at submission time:509) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM598594344 2014-08-18 13:59:08.282480 Exit https://cert-08.pd.infn.it:8443/CREAM149559558 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 13:59:09,060 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 13:59:09,096 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 13:59:09,096 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 13:59:09,096 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-135909.log]\n', '2014-08-18 13:59:09,100 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 13:59:10,403 DEBUG - Will invoke JobStart for JobID [CREAM907962892]\n', 'https://cert-08.pd.infn.it:8443/CREAM907962892\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM907962892 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM907962892 2014-08-18 13:59:10.738003 Submit https://cert-08.pd.infn.it:8443/CREAM907962892 Left: 505 (at submission time:505) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM907962892 2014-08-18 14:01:10.696965 Exit https://cert-08.pd.infn.it:8443/CREAM136130738 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:01:11,826 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:01:11,856 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:01:11,856 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:01:11,857 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140111.log]\n', '2014-08-18 14:01:11,860 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:01:13,187 DEBUG - Will invoke JobStart for JobID [CREAM542288441]\n', 'https://cert-08.pd.infn.it:8443/CREAM5 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 482/1000 2014-08-18 14:01:06.480784 Submitted: 502 Running: 20 Cancelled: 0 Done-Ok: 482 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 482/1000 2014-08-18 14:01:09.711708 Submitted: 502 Running: 19 Cancelled: 0 Done-Ok: 483 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 483/1000 2014-08-18 14:01:10.303729 Submitted: 502 Running: 18 Cancelled: 0 Done-Ok: 484 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 484/1000 2014-08-18 14:01:10.698950 Submitted: 502 Running: 17 Cancelled: 0 Done-Ok: 485 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 485/1000 2014-08-18 14:01:11.950286 Submitted: 503 Running: 18 Cancelled: 0 Done-Ok: 485 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 485/1000 2014-08-18 14:01:12.636976 Submitted: 504 Running: 19 Cancelled: 0 Done-Ok: 485 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 485/1000 2014-08-18 14:01:13.454685 Submitted: 505 Running: 20 Cancelled: 0 Done-Ok: 485 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 485/1000 2014-08-18 14:02:05.172358 Submitted: 505 Running: 19 Cancelled: 0 Done-Ok: 486 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 486/1000 2014-08-18 14:02:06.873185 Submitted: 506 Running: 20 Cancelled: 0 Done-Ok: 486 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 486/1000 2014-08-18 14:02:09.602070 Submitted: 506 Running: 19 Cancelled: 0 Done-Ok: 487 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 487/1000 2014-08-18 14:02:10.455826 Submitted: 506 Running: 18 Cancelled: 0 Done-Ok: 488 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 488/1000 2014-08-18 14:02:11.669665 Submitted: 506 Running: 17 Cancelled: 0 Done-Ok: 489 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 489/1000 2014-08-18 14:02:12.228147 Submitted: 507 Running: 18 Cancelled: 0 Done-Ok: 489 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 489/1000 2014-08-18 14:02:13.159486 Submitted: 508 Running: 19 Cancelled: 0 Done-Ok: 489 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 489/1000 2014-08-18 14:02:13.914013 Submitted: 509 Running: 20 Cancelled: 0 Done-Ok: 489 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 489/1000 2014-08-18 14:03:06.250738 Submitted: 509 Running: 19 Cancelled: 0 Done-Ok: 490 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 490/1000 2014-08-18 14:03:07.934644 Submitted: 510 Running: 20 Cancelled: 0 Done-Ok: 490 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 490/1000 2014-08-18 14:03:10.879184 Submitted: 510 Running: 19 Cancelled: 0 Done-Ok: 491 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 491/1000 2014-08-18 14:03:11.225859 Submitted: 510 Running: 18 Cancelled: 0 Done-Ok: 492 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 492/1000 2014-08-18 14:03:12.127996 Submitted: 510 Running: 17 Cancelled: 0 Done-Ok: 493 Failed: 0 Aborted42288441\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM542288441 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM542288441 2014-08-18 14:01:13.451247 Submit https://cert-08.pd.infn.it:8443/CREAM542288441 Left: 495 (at submission time:495) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM542288441 2014-08-18 14:02:09.598931 Exit https://cert-08.pd.infn.it:8443/CREAM130832967 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:02:10,409 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:02:10,432 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:02:10,432 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:02:10,432 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140210.log]\n', '2014-08-18 14:02:10,436 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:02:11,815 DEBUG - Will invoke JobStart for JobID [CREAM120122136]\n', 'https://cert-08.pd.infn.it:8443/CREAM120122136\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM120122136 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM120122136 2014-08-18 14:02:12.225920 Submit https://cert-08.pd.infn.it:8443/CREAM120122136 Left: 493 (at submission time:493) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM120122136 2014-08-18 14:03:11.223886 Exit https://cert-08.pd.infn.it:8443/CREAM598594344 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:03:11,866 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:03:11,895 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:03:11,895 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:03:11,895 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140311.log]\n', '2014-08-18 14:03:11,899 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:03:13,334 DEBUG - Will invoke JobStart for JobID [CREAM993173849]\n', 'https://cert-08.pd.infn.it:8443/CREAM993173849\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM993173849 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM993173849 2014-08-18 14:03:13.628425 Submit https://cert-08.pd.infn.it:8443/CREAM993173849 Left: 488 (at submission time:488) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM993173849 2014-08-18 14:04:11.206478 Exit https://cert-08.pd.infn.it:8443/CREAM907962892 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep06394479\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM806394479 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM806394479 2014-08-18 14:01:06.479178 Submit https://cert-08.pd.infn.it:8443/CREAM806394479 Left: 498 (at submission time:498) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM806394479 2014-08-18 14:03:06.247798 Exit https://cert-08.pd.infn.it:8443/CREAM122526341 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:03:06,641 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:03:06,664 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:03:06,664 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:03:06,664 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140306.log]\n', '2014-08-18 14:03:06,671 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:03:07,634 DEBUG - Will invoke JobStart for JobID [CREAM374908309]\n', 'https://cert-08.pd.infn.it:8443/CREAM374908309\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM374908309 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM374908309 2014-08-18 14:03:07.928551 Submit https://cert-08.pd.infn.it:8443/CREAM374908309 Left: 490 (at submission time:490) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM374908309 2014-08-18 14:03:10.876412 Exit https://cert-08.pd.infn.it:8443/CREAM418510106 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:03:11,679 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:03:11,710 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:03:11,711 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:03:11,711 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140311.log]\n', '2014-08-18 14:03:11,723 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:03:12,798 DEBUG - Will invoke JobStart for JobID [CREAM943072763]\n', 'https://cert-08.pd.infn.it:8443/CREAM943072763\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM943072763 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM943072763 2014-08-18 14:03:12.927974 Submit https://cert-08.pd.infn.it:8443/CREAM943072763 Left: 489 (at submission time:489) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM943072763 2014-08-18 14:04:13.263494 Exit https://cert-08.pd.infn.it:8443/CREAM420466701 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep23730937\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM523730937 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM523730937 2014-08-18 14:01:11.946819 Submit https://cert-08.pd.infn.it:8443/CREAM523730937 Left: 497 (at submission time:497) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM523730937 2014-08-18 14:02:11.668335 Exit https://cert-08.pd.infn.it:8443/CREAM968163628 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:02:12,305 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:02:12,330 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:02:12,330 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:02:12,330 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140212.log]\n', '2014-08-18 14:02:12,340 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:02:13,677 DEBUG - Will invoke JobStart for JobID [CREAM446699107]\n', 'https://cert-08.pd.infn.it:8443/CREAM446699107\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM446699107 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM446699107 2014-08-18 14:02:13.912457 Submit https://cert-08.pd.infn.it:8443/CREAM446699107 Left: 491 (at submission time:491) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM446699107 2014-08-18 14:04:06.525482 Exit https://cert-08.pd.infn.it:8443/CREAM736785794 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:04:06,906 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:04:06,925 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:04:06,925 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:04:06,925 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140406.log]\n', '2014-08-18 14:04:06,930 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:04:08,116 DEBUG - Will invoke JobStart for JobID [CREAM133694851]\n', 'https://cert-08.pd.infn.it:8443/CREAM133694851\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM133694851 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM133694851 2014-08-18 14:04:08.478815 Submit https://cert-08.pd.infn.it:8443/CREAM133694851 Left: 486 (at submission time:486) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM133694851 2014-08-18 14:05:07.113882 Exit https://cert-08.pd.infn.it:8443/CREAM539997845 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep72312895\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM372312895 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM372312895 2014-08-18 14:00:14.520355 Submit https://cert-08.pd.infn.it:8443/CREAM372312895 Left: 499 (at submission time:499) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM372312895 2014-08-18 14:02:10.453670 Exit https://cert-08.pd.infn.it:8443/CREAM440387180 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:02:11,327 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:02:11,350 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:02:11,351 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:02:11,351 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140211.log]\n', '2014-08-18 14:02:11,355 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:02:12,737 DEBUG - Will invoke JobStart for JobID [CREAM788342086]\n', 'https://cert-08.pd.infn.it:8443/CREAM788342086\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM788342086 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM788342086 2014-08-18 14:02:13.158040 Submit https://cert-08.pd.infn.it:8443/CREAM788342086 Left: 492 (at submission time:492) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM788342086 2014-08-18 14:03:12.124612 Exit https://cert-08.pd.infn.it:8443/CREAM743664271 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:03:13,283 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:03:13,312 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:03:13,312 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:03:13,313 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140313.log]\n', '2014-08-18 14:03:13,315 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:03:14,546 DEBUG - Will invoke JobStart for JobID [CREAM786286510]\n', 'https://cert-08.pd.infn.it:8443/CREAM786286510\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM786286510 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM786286510 2014-08-18 14:03:14.903474 Submit https://cert-08.pd.infn.it:8443/CREAM786286510 Left: 487 (at submission time:487) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM786286510 2014-08-18 14:05:11.744124 Exit https://cert-08.pd.infn.it:8443/CREAM476383013 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep31604027\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM831604027 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM831604027 2014-08-18 14:01:12.635933 Submit https://cert-08.pd.infn.it:8443/CREAM831604027 Left: 496 (at submission time:496) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM831604027 2014-08-18 14:02:05.171137 Exit https://cert-08.pd.infn.it:8443/CREAM947699206 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:02:05,514 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:02:05,555 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:02:05,555 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:02:05,556 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140205.log]\n', '2014-08-18 14:02:05,559 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:02:06,600 DEBUG - Will invoke JobStart for JobID [CREAM157956351]\n', 'https://cert-08.pd.infn.it:8443/CREAM157956351\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM157956351 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM157956351 2014-08-18 14:02:06.868651 Submit https://cert-08.pd.infn.it:8443/CREAM157956351 Left: 494 (at submission time:494) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM157956351 2014-08-18 14:04:12.900573 Exit https://cert-08.pd.infn.it:8443/CREAM595355526 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:04:13,759 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:04:13,782 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:04:13,783 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:04:13,783 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140413.log]\n', '2014-08-18 14:04:13,786 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:04:15,192 DEBUG - Will invoke JobStart for JobID [CREAM431919179]\n', 'https://cert-08.pd.infn.it:8443/CREAM431919179\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM431919179 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM431919179 2014-08-18 14:04:15.554422 Submit https://cert-08.pd.infn.it:8443/CREAM431919179 Left: 484 (at submission time:484) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM431919179 2014-08-18 14:05:12.335319 Exit https://cert-08.pd.infn.it:8443/CREAM111725815 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 493/1000 2014-08-18 14:03:12.929326 Submitted: 511 Running: 18 Cancelled: 0 Done-Ok: 493 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 493/1000 2014-08-18 14:03:13.629896 Submitted: 512 Running: 19 Cancelled: 0 Done-Ok: 493 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 493/1000 2014-08-18 14:03:14.907316 Submitted: 513 Running: 20 Cancelled: 0 Done-Ok: 493 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 493/1000 2014-08-18 14:04:06.529899 Submitted: 513 Running: 19 Cancelled: 0 Done-Ok: 494 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 494/1000 2014-08-18 14:04:08.482961 Submitted: 514 Running: 20 Cancelled: 0 Done-Ok: 494 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 494/1000 2014-08-18 14:04:11.210361 Submitted: 514 Running: 19 Cancelled: 0 Done-Ok: 495 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 495/1000 2014-08-18 14:04:12.902252 Submitted: 514 Running: 18 Cancelled: 0 Done-Ok: 496 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 496/1000 2014-08-18 14:04:13.268341 Submitted: 514 Running: 17 Cancelled: 0 Done-Ok: 497 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 497/1000 2014-08-18 14:04:14.006046 Submitted: 515 Running: 18 Cancelled: 0 Done-Ok: 497 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 497/1000 2014-08-18 14:04:15.468737 Submitted: 516 Running: 19 Cancelled: 0 Done-Ok: 497 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 497/1000 2014-08-18 14:04:15.556115 Submitted: 517 Running: 20 Cancelled: 0 Done-Ok: 497 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 497/1000 2014-08-18 14:05:07.116316 Submitted: 517 Running: 19 Cancelled: 0 Done-Ok: 498 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 498/1000 2014-08-18 14:05:08.828669 Submitted: 518 Running: 20 Cancelled: 0 Done-Ok: 498 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 498/1000 2014-08-18 14:05:11.746038 Submitted: 518 Running: 19 Cancelled: 0 Done-Ok: 499 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 499/1000 2014-08-18 14:05:12.339523 Submitted: 518 Running: 18 Cancelled: 0 Done-Ok: 500 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 500/1000 2014-08-18 14:05:14.017662 Submitted: 519 Running: 19 Cancelled: 0 Done-Ok: 500 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 500/1000 2014-08-18 14:05:14.354293 Submitted: 519 Running: 18 Cancelled: 0 Done-Ok: 501 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 501/1000 2014-08-18 14:05:14.823599 Submitted: 520 Running: 19 Cancelled: 0 Done-Ok: 501 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 501/1000 2014-08-18 14:05:16.589991 Submitted: 521 Running: 20 Cancelled: 0 Done-Ok: 501 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 501/1000 2014-08-18 14:06:06.984372 Submitted: 521 Running: 19 Cancelled: 0 Done-Ok: 502 Failed: 0 Abo.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:05:13,188 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:05:13,235 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:05:13,235 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:05:13,235 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140513.log]\n', '2014-08-18 14:05:13,238 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:05:14,490 DEBUG - Will invoke JobStart for JobID [CREAM098350933]\n', 'https://cert-08.pd.infn.it:8443/CREAM098350933\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM098350933 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM098350933 2014-08-18 14:05:14.820434 Submit https://cert-08.pd.infn.it:8443/CREAM098350933 Left: 480 (at submission time:480) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM098350933 2014-08-18 14:06:12.710098 Exit https://cert-08.pd.infn.it:8443/CREAM831604027 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:06:13,599 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:06:13,624 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:06:13,624 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:06:13,625 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140613.log]\n', '2014-08-18 14:06:13,628 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:06:14,907 DEBUG - Will invoke JobStart for JobID [CREAM734026120]\n', 'https://cert-08.pd.infn.it:8443/CREAM734026120\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM734026120 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM734026120 2014-08-18 14:06:15.424295 Submit https://cert-08.pd.infn.it:8443/CREAM734026120 Left: 476 (at submission time:476) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM734026120 2014-08-18 14:07:07.443164 Exit https://cert-08.pd.infn.it:8443/CREAM157956351 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:07:07,883 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:07:07,917 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:07:07,917 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:07:07,917 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140707.log]\n', '2014-08-18 14:07:07,920 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stres.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:04:12,025 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:04:12,045 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:04:12,045 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:04:12,045 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140412.log]\n', '2014-08-18 14:04:12,048 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:04:13,443 DEBUG - Will invoke JobStart for JobID [CREAM922938717]\n', 'https://cert-08.pd.infn.it:8443/CREAM922938717\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM922938717 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM922938717 2014-08-18 14:04:14.004066 Submit https://cert-08.pd.infn.it:8443/CREAM922938717 Left: 485 (at submission time:485) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM922938717 2014-08-18 14:06:13.858885 Exit https://cert-08.pd.infn.it:8443/CREAM542288441 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:06:14,838 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:06:14,861 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:06:14,861 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:06:14,861 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140614.log]\n', '2014-08-18 14:06:14,865 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:06:15,907 DEBUG - Will invoke JobStart for JobID [CREAM431686196]\n', 'https://cert-08.pd.infn.it:8443/CREAM431686196\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM431686196 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM431686196 2014-08-18 14:06:16.248049 Submit https://cert-08.pd.infn.it:8443/CREAM431686196 Left: 475 (at submission time:475) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM431686196 2014-08-18 14:07:13.381429 Exit https://cert-08.pd.infn.it:8443/CREAM120122136 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:07:13,757 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:07:13,780 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:07:13,780 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:07:13,780 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140713.log]\n', '2014-08-18 14:07:13,785 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stres.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:05:07,441 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:05:07,465 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:05:07,465 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:05:07,465 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140507.log]\n', '2014-08-18 14:05:07,468 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:05:08,524 DEBUG - Will invoke JobStart for JobID [CREAM645737643]\n', 'https://cert-08.pd.infn.it:8443/CREAM645737643\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM645737643 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM645737643 2014-08-18 14:05:08.826672 Submit https://cert-08.pd.infn.it:8443/CREAM645737643 Left: 482 (at submission time:482) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM645737643 2014-08-18 14:06:11.963253 Exit https://cert-08.pd.infn.it:8443/CREAM523730937 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:06:12,581 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:06:12,604 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:06:12,604 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:06:12,605 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140612.log]\n', '2014-08-18 14:06:12,608 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:06:13,657 DEBUG - Will invoke JobStart for JobID [CREAM675423039]\n', 'https://cert-08.pd.infn.it:8443/CREAM675423039\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM675423039 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM675423039 2014-08-18 14:06:13.929206 Submit https://cert-08.pd.infn.it:8443/CREAM675423039 Left: 477 (at submission time:477) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM675423039 2014-08-18 14:07:13.515902 Exit https://cert-08.pd.infn.it:8443/CREAM446699107 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:07:13,911 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:07:13,934 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:07:13,934 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:07:13,934 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140713.log]\n', '2014-08-18 14:07:13,936 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stres.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:05:12,413 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:05:12,436 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:05:12,436 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:05:12,436 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140512.log]\n', '2014-08-18 14:05:12,440 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:05:13,698 DEBUG - Will invoke JobStart for JobID [CREAM462148890]\n', 'https://cert-08.pd.infn.it:8443/CREAM462148890\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM462148890 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM462148890 2014-08-18 14:05:14.013298 Submit https://cert-08.pd.infn.it:8443/CREAM462148890 Left: 481 (at submission time:481) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM462148890 2014-08-18 14:05:14.352879 Exit https://cert-08.pd.infn.it:8443/CREAM372312895 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:05:15,109 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:05:15,133 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:05:15,133 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:05:15,133 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140515.log]\n', '2014-08-18 14:05:15,137 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:05:16,316 DEBUG - Will invoke JobStart for JobID [CREAM001058323]\n', 'https://cert-08.pd.infn.it:8443/CREAM001058323\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM001058323 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM001058323 2014-08-18 14:05:16.586114 Submit https://cert-08.pd.infn.it:8443/CREAM001058323 Left: 479 (at submission time:479) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM001058323 2014-08-18 14:07:13.702817 Exit https://cert-08.pd.infn.it:8443/CREAM788342086 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:07:14,544 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:07:14,567 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:07:14,567 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:07:14,567 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140714.log]\n', '2014-08-18 14:07:14,571 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stres.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:04:13,950 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:04:13,973 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:04:13,974 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:04:13,974 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140413.log]\n', '2014-08-18 14:04:13,977 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:04:15,209 DEBUG - Will invoke JobStart for JobID [CREAM535592927]\n', 'https://cert-08.pd.infn.it:8443/CREAM535592927\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM535592927 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM535592927 2014-08-18 14:04:15.465962 Submit https://cert-08.pd.infn.it:8443/CREAM535592927 Left: 483 (at submission time:483) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM535592927 2014-08-18 14:06:06.982016 Exit https://cert-08.pd.infn.it:8443/CREAM806394479 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:06:07,353 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:06:07,386 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:06:07,386 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:06:07,386 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140607.log]\n', '2014-08-18 14:06:07,399 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:06:08,523 DEBUG - Will invoke JobStart for JobID [CREAM335859132]\n', 'https://cert-08.pd.infn.it:8443/CREAM335859132\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM335859132 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM335859132 2014-08-18 14:06:08.857650 Submit https://cert-08.pd.infn.it:8443/CREAM335859132 Left: 478 (at submission time:478) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM335859132 2014-08-18 14:08:08.392058 Exit https://cert-08.pd.infn.it:8443/CREAM374908309 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:08:08,801 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:08:08,824 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:08:08,824 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:08:08,824 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140808.log]\n', '2014-08-18 14:08:08,832 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stresrted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 502/1000 2014-08-18 14:06:08.860334 Submitted: 522 Running: 20 Cancelled: 0 Done-Ok: 502 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 502/1000 2014-08-18 14:06:11.966365 Submitted: 522 Running: 19 Cancelled: 0 Done-Ok: 503 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 503/1000 2014-08-18 14:06:12.713190 Submitted: 522 Running: 18 Cancelled: 0 Done-Ok: 504 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 504/1000 2014-08-18 14:06:13.861075 Submitted: 522 Running: 17 Cancelled: 0 Done-Ok: 505 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 505/1000 2014-08-18 14:06:13.931250 Submitted: 523 Running: 18 Cancelled: 0 Done-Ok: 505 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 505/1000 2014-08-18 14:06:15.426766 Submitted: 524 Running: 19 Cancelled: 0 Done-Ok: 505 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 505/1000 2014-08-18 14:06:16.250970 Submitted: 525 Running: 20 Cancelled: 0 Done-Ok: 505 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 505/1000 2014-08-18 14:07:07.446244 Submitted: 525 Running: 19 Cancelled: 0 Done-Ok: 506 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 506/1000 2014-08-18 14:07:09.419865 Submitted: 526 Running: 20 Cancelled: 0 Done-Ok: 506 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 506/1000 2014-08-18 14:07:13.385539 Submitted: 526 Running: 19 Cancelled: 0 Done-Ok: 507 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 507/1000 2014-08-18 14:07:13.517832 Submitted: 526 Running: 18 Cancelled: 0 Done-Ok: 508 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 508/1000 2014-08-18 14:07:13.704938 Submitted: 526 Running: 17 Cancelled: 0 Done-Ok: 509 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 509/1000 2014-08-18 14:07:15.436921 Submitted: 527 Running: 18 Cancelled: 0 Done-Ok: 509 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 509/1000 2014-08-18 14:07:15.889514 Submitted: 528 Running: 19 Cancelled: 0 Done-Ok: 509 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 509/1000 2014-08-18 14:07:16.252909 Submitted: 529 Running: 20 Cancelled: 0 Done-Ok: 509 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 509/1000 2014-08-18 14:08:08.394002 Submitted: 529 Running: 19 Cancelled: 0 Done-Ok: 510 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 510/1000 2014-08-18 14:08:10.341497 Submitted: 530 Running: 20 Cancelled: 0 Done-Ok: 510 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 510/1000 2014-08-18 14:08:13.395803 Submitted: 530 Running: 19 Cancelled: 0 Done-Ok: 511 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 511/1000 2014-08-18 14:08:13.700943 Submitted: 530 Running: 18 Cancelled: 0 Done-Ok: 512 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 512/1000 2014-08-18 14:08:14.760655 Submitted: 530 Running: 17 Cancelled: 0 Done-Ok: 513 Failed: 0s_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:07:15,798 DEBUG - Will invoke JobStart for JobID [CREAM065967244]\n', 'https://cert-08.pd.infn.it:8443/CREAM065967244\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM065967244 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM065967244 2014-08-18 14:07:16.250383 Submit https://cert-08.pd.infn.it:8443/CREAM065967244 Left: 471 (at submission time:471) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM065967244 2014-08-18 14:08:13.698667 Exit https://cert-08.pd.infn.it:8443/CREAM786286510 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:08:14,495 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:08:14,518 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:08:14,518 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:08:14,519 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140814.log]\n', '2014-08-18 14:08:14,523 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:08:15,832 DEBUG - Will invoke JobStart for JobID [CREAM902953912]\n', 'https://cert-08.pd.infn.it:8443/CREAM902953912\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM902953912 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM902953912 2014-08-18 14:08:16.447938 Submit https://cert-08.pd.infn.it:8443/CREAM902953912 Left: 468 (at submission time:468) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM902953912 2014-08-18 14:10:14.939221 Exit https://cert-08.pd.infn.it:8443/CREAM462148890 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:10:15,353 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:10:15,385 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:10:15,386 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:10:15,397 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141015.log]\n', '2014-08-18 14:10:15,402 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:10:16,948 DEBUG - Will invoke JobStart for JobID [CREAM814867065]\n', 'https://cert-08.pd.infn.it:8443/CREAM814867065\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM814867065 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM814867065 2014-08-18 14:10:17.460792 Submit https://cert-08.pd.infn.it:8443/CREAM814867065 Left: 460 (at submission time:460) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM814867065 2014-08-18 14:10:17.802740 Exit https://cert-08.pd.infn.it:8443/CREAM001058323 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 513/1000 2014-08-18 14:08:15.960868 Submitted: 531 Running: 18 Cancelled: 0 Done-Ok: 513 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 513/1000 2014-08-18 14:08:16.451759 Submitted: 532 Running: 19 Cancelled: 0 Done-Ok: 513 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 513/1000 2014-08-18 14:08:17.413014 Submitted: 533 Running: 20 Cancelled: 0 Done-Ok: 513 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 513/1000 2014-08-18 14:09:08.664602 Submitted: 533 Running: 19 Cancelled: 0 Done-Ok: 514 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 514/1000 2014-08-18 14:09:10.462717 Submitted: 534 Running: 20 Cancelled: 0 Done-Ok: 514 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 514/1000 2014-08-18 14:09:14.244620 Submitted: 534 Running: 19 Cancelled: 0 Done-Ok: 515 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 515/1000 2014-08-18 14:09:14.287217 Submitted: 534 Running: 18 Cancelled: 0 Done-Ok: 516 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 516/1000 2014-08-18 14:09:14.876878 Submitted: 534 Running: 17 Cancelled: 0 Done-Ok: 517 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 517/1000 2014-08-18 14:09:16.194977 Submitted: 535 Running: 18 Cancelled: 0 Done-Ok: 517 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 517/1000 2014-08-18 14:09:16.758700 Submitted: 536 Running: 19 Cancelled: 0 Done-Ok: 517 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 517/1000 2014-08-18 14:09:17.676071 Submitted: 537 Running: 20 Cancelled: 0 Done-Ok: 517 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 517/1000 2014-08-18 14:10:09.267434 Submitted: 537 Running: 19 Cancelled: 0 Done-Ok: 518 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 518/1000 2014-08-18 14:10:10.946015 Submitted: 538 Running: 20 Cancelled: 0 Done-Ok: 518 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 518/1000 2014-08-18 14:10:14.751374 Submitted: 538 Running: 19 Cancelled: 0 Done-Ok: 519 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 519/1000 2014-08-18 14:10:14.941176 Submitted: 538 Running: 18 Cancelled: 0 Done-Ok: 520 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 520/1000 2014-08-18 14:10:16.552772 Submitted: 539 Running: 19 Cancelled: 0 Done-Ok: 520 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 520/1000 2014-08-18 14:10:17.464028 Submitted: 540 Running: 20 Cancelled: 0 Done-Ok: 520 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 520/1000 2014-08-18 14:10:17.804366 Submitted: 540 Running: 19 Cancelled: 0 Done-Ok: 521 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 521/1000 2014-08-18 14:10:19.987226 Submitted: 541 Running: 20 Cancelled: 0 Done-Ok: 521 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 521/1000 2014-08-18 14:11:09.659376 Submitted: 541 Running: 19 Cancelled: 0 Done-Ok: 522 Failes_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:08:09,940 DEBUG - Will invoke JobStart for JobID [CREAM192455005]\n', 'https://cert-08.pd.infn.it:8443/CREAM192455005\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM192455005 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM192455005 2014-08-18 14:08:10.337626 Submit https://cert-08.pd.infn.it:8443/CREAM192455005 Left: 470 (at submission time:470) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM192455005 2014-08-18 14:08:13.392505 Exit https://cert-08.pd.infn.it:8443/CREAM943072763 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:08:13,986 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:08:14,010 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:08:14,010 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:08:14,011 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140814.log]\n', '2014-08-18 14:08:14,014 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:08:15,680 DEBUG - Will invoke JobStart for JobID [CREAM571372072]\n', 'https://cert-08.pd.infn.it:8443/CREAM571372072\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM571372072 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM571372072 2014-08-18 14:08:15.959151 Submit https://cert-08.pd.infn.it:8443/CREAM571372072 Left: 469 (at submission time:469) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM571372072 2014-08-18 14:09:14.875650 Exit https://cert-08.pd.infn.it:8443/CREAM535592927 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:09:16,070 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:09:16,094 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:09:16,094 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:09:16,094 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140916.log]\n', '2014-08-18 14:09:16,097 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:09:17,240 DEBUG - Will invoke JobStart for JobID [CREAM161390677]\n', 'https://cert-08.pd.infn.it:8443/CREAM161390677\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM161390677 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM161390677 2014-08-18 14:09:17.674181 Submit https://cert-08.pd.infn.it:8443/CREAM161390677 Left: 463 (at submission time:463) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM161390677 2014-08-18 14:11:09.656773 Exit https://cert-08.pd.infn.it:8443/CREAM335859132 Status: "DONE-OK" Entering submit wrapper I am going to call submit_jobs_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:07:15,439 DEBUG - Will invoke JobStart for JobID [CREAM558487528]\n', 'https://cert-08.pd.infn.it:8443/CREAM558487528\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM558487528 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM558487528 2014-08-18 14:07:15.885612 Submit https://cert-08.pd.infn.it:8443/CREAM558487528 Left: 472 (at submission time:472) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM558487528 2014-08-18 14:09:08.661332 Exit https://cert-08.pd.infn.it:8443/CREAM133694851 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:09:09,080 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:09:09,120 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:09:09,120 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:09:09,120 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140909.log]\n', '2014-08-18 14:09:09,136 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:09:10,098 DEBUG - Will invoke JobStart for JobID [CREAM318055802]\n', 'https://cert-08.pd.infn.it:8443/CREAM318055802\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM318055802 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM318055802 2014-08-18 14:09:10.459887 Submit https://cert-08.pd.infn.it:8443/CREAM318055802 Left: 466 (at submission time:466) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM318055802 2014-08-18 14:10:09.265324 Exit https://cert-08.pd.infn.it:8443/CREAM645737643 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:10:09,606 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:10:09,627 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:10:09,627 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:10:09,627 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141009.log]\n', '2014-08-18 14:10:09,631 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:10:10,731 DEBUG - Will invoke JobStart for JobID [CREAM262058091]\n', 'https://cert-08.pd.infn.it:8443/CREAM262058091\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM262058091 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM262058091 2014-08-18 14:10:10.944171 Submit https://cert-08.pd.infn.it:8443/CREAM262058091 Left: 462 (at submission time:462) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM262058091 2014-08-18 14:11:15.057815 Exit https://cert-08.pd.infn.it:8443/CREAM675423039 Status: "DONE-OK" Entering submit wrapper I am going to call submit_jobs_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:07:09,058 DEBUG - Will invoke JobStart for JobID [CREAM265870842]\n', 'https://cert-08.pd.infn.it:8443/CREAM265870842\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM265870842 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM265870842 2014-08-18 14:07:09.417939 Submit https://cert-08.pd.infn.it:8443/CREAM265870842 Left: 474 (at submission time:474) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM265870842 2014-08-18 14:09:14.285741 Exit https://cert-08.pd.infn.it:8443/CREAM431919179 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:09:14,794 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:09:14,813 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:09:14,813 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:09:14,814 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140914.log]\n', '2014-08-18 14:09:14,828 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:09:16,012 DEBUG - Will invoke JobStart for JobID [CREAM748358976]\n', 'https://cert-08.pd.infn.it:8443/CREAM748358976\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM748358976 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM748358976 2014-08-18 14:09:16.192818 Submit https://cert-08.pd.infn.it:8443/CREAM748358976 Left: 465 (at submission time:465) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM748358976 2014-08-18 14:10:14.748769 Exit https://cert-08.pd.infn.it:8443/CREAM098350933 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:10:15,232 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:10:15,270 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:10:15,270 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:10:15,270 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141015.log]\n', '2014-08-18 14:10:15,273 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:10:16,348 DEBUG - Will invoke JobStart for JobID [CREAM093417888]\n', 'https://cert-08.pd.infn.it:8443/CREAM093417888\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM093417888 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM093417888 2014-08-18 14:10:16.550162 Submit https://cert-08.pd.infn.it:8443/CREAM093417888 Left: 461 (at submission time:461) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM093417888 2014-08-18 14:11:15.778401 Exit https://cert-08.pd.infn.it:8443/CREAM734026120 Status: "DONE-OK" Entering submit wrapper I am going to call submit_jobs_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:07:14,964 DEBUG - Will invoke JobStart for JobID [CREAM958852392]\n', 'https://cert-08.pd.infn.it:8443/CREAM958852392\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM958852392 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM958852392 2014-08-18 14:07:15.434510 Submit https://cert-08.pd.infn.it:8443/CREAM958852392 Left: 473 (at submission time:473) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM958852392 2014-08-18 14:08:14.757082 Exit https://cert-08.pd.infn.it:8443/CREAM993173849 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:08:15,828 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:08:15,856 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:08:15,856 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:08:15,856 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140815.log]\n', '2014-08-18 14:08:15,865 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:08:17,084 DEBUG - Will invoke JobStart for JobID [CREAM704082565]\n', 'https://cert-08.pd.infn.it:8443/CREAM704082565\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM704082565 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM704082565 2014-08-18 14:08:17.410888 Submit https://cert-08.pd.infn.it:8443/CREAM704082565 Left: 467 (at submission time:467) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM704082565 2014-08-18 14:09:14.242672 Exit https://cert-08.pd.infn.it:8443/CREAM922938717 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:09:14,844 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:09:14,865 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:09:14,865 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:09:14,865 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-140914.log]\n', '2014-08-18 14:09:14,878 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:09:16,214 DEBUG - Will invoke JobStart for JobID [CREAM549311869]\n', 'https://cert-08.pd.infn.it:8443/CREAM549311869\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM549311869 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM549311869 2014-08-18 14:09:16.752659 Submit https://cert-08.pd.infn.it:8443/CREAM549311869 Left: 464 (at submission time:464) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM549311869 2014-08-18 14:11:16.239925 Exit https://cert-08.pd.infn.it:8443/CREAM431686196 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:11:09,993 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:11:10,018 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:11:10,018 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:11:10,018 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141110.log]\n', '2014-08-18 14:11:10,021 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:11:11,221 DEBUG - Will invoke JobStart for JobID [CREAM829570064]\n', 'https://cert-08.pd.infn.it:8443/CREAM829570064\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM829570064 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM829570064 2014-08-18 14:11:11.425754 Submit https://cert-08.pd.infn.it:8443/CREAM829570064 Left: 458 (at submission time:458) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM829570064 2014-08-18 14:13:10.643215 Exit https://cert-08.pd.infn.it:8443/CREAM192455005 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:13:10,971 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:13:11,002 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:13:11,002 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:13:11,002 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141311.log]\n', '2014-08-18 14:13:11,006 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:13:11,846 DEBUG - Will invoke JobStart for JobID [CREAM065858168]\n', 'https://cert-08.pd.infn.it:8443/CREAM065858168\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM065858168 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM065858168 2014-08-18 14:13:12.338897 Submit https://cert-08.pd.infn.it:8443/CREAM065858168 Left: 450 (at submission time:450) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM065858168 2014-08-18 14:13:15.529373 Exit https://cert-08.pd.infn.it:8443/CREAM571372072 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:13:16,160 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:13:16,193 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:13:16,193 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:13:16,193 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141316.log]\n', '2014-08-18 14:13:16,197 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "d: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 522/1000 2014-08-18 14:11:11.429483 Submitted: 542 Running: 20 Cancelled: 0 Done-Ok: 522 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 522/1000 2014-08-18 14:11:15.060435 Submitted: 542 Running: 19 Cancelled: 0 Done-Ok: 523 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 523/1000 2014-08-18 14:11:15.780418 Submitted: 542 Running: 18 Cancelled: 0 Done-Ok: 524 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 524/1000 2014-08-18 14:11:16.243673 Submitted: 542 Running: 17 Cancelled: 0 Done-Ok: 525 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 525/1000 2014-08-18 14:11:17.602340 Submitted: 543 Running: 18 Cancelled: 0 Done-Ok: 525 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 525/1000 2014-08-18 14:11:18.178455 Submitted: 544 Running: 19 Cancelled: 0 Done-Ok: 525 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 525/1000 2014-08-18 14:11:18.543473 Submitted: 545 Running: 20 Cancelled: 0 Done-Ok: 525 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 525/1000 2014-08-18 14:12:09.888706 Submitted: 545 Running: 19 Cancelled: 0 Done-Ok: 526 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 526/1000 2014-08-18 14:12:11.801404 Submitted: 546 Running: 20 Cancelled: 0 Done-Ok: 526 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 526/1000 2014-08-18 14:12:14.918717 Submitted: 546 Running: 19 Cancelled: 0 Done-Ok: 527 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 527/1000 2014-08-18 14:12:15.164030 Submitted: 546 Running: 18 Cancelled: 0 Done-Ok: 528 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 528/1000 2014-08-18 14:12:16.788771 Submitted: 546 Running: 17 Cancelled: 0 Done-Ok: 529 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 529/1000 2014-08-18 14:12:17.332632 Submitted: 547 Running: 18 Cancelled: 0 Done-Ok: 529 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 529/1000 2014-08-18 14:12:17.592119 Submitted: 548 Running: 19 Cancelled: 0 Done-Ok: 529 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 529/1000 2014-08-18 14:12:19.220827 Submitted: 549 Running: 20 Cancelled: 0 Done-Ok: 529 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 529/1000 2014-08-18 14:13:10.646369 Submitted: 549 Running: 19 Cancelled: 0 Done-Ok: 530 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 530/1000 2014-08-18 14:13:12.341333 Submitted: 550 Running: 20 Cancelled: 0 Done-Ok: 530 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 530/1000 2014-08-18 14:13:15.532602 Submitted: 550 Running: 19 Cancelled: 0 Done-Ok: 531 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 531/1000 2014-08-18 14:13:17.068648 Submitted: 550 Running: 18 Cancelled: 0 Done-Ok: 532 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 532/1000 2014-08-18 14:13:17.678917 Submitted: 551 Running: 19 Cancelled: 0 Done-Ok: 532 F submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:11:16,866 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:11:16,891 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:11:16,891 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:11:16,891 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141116.log]\n', '2014-08-18 14:11:16,894 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:11:18,188 DEBUG - Will invoke JobStart for JobID [CREAM671229957]\n', 'https://cert-08.pd.infn.it:8443/CREAM671229957\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM671229957 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM671229957 2014-08-18 14:11:18.540618 Submit https://cert-08.pd.infn.it:8443/CREAM671229957 Left: 455 (at submission time:455) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM671229957 2014-08-18 14:12:14.914222 Exit https://cert-08.pd.infn.it:8443/CREAM958852392 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:12:15,612 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:12:15,633 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:12:15,634 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:12:15,634 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141215.log]\n', '2014-08-18 14:12:15,636 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:12:17,149 DEBUG - Will invoke JobStart for JobID [CREAM398339297]\n', 'https://cert-08.pd.infn.it:8443/CREAM398339297\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM398339297 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM398339297 2014-08-18 14:12:17.330047 Submit https://cert-08.pd.infn.it:8443/CREAM398339297 Left: 453 (at submission time:453) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM398339297 2014-08-18 14:13:17.062771 Exit https://cert-08.pd.infn.it:8443/CREAM704082565 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:13:17,753 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:13:17,777 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:13:17,777 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:13:17,777 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141317.log]\n', '2014-08-18 14:13:17,780 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = " submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:10:18,379 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:10:18,416 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:10:18,417 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:10:18,417 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141018.log]\n', '2014-08-18 14:10:18,420 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:10:19,663 DEBUG - Will invoke JobStart for JobID [CREAM561916162]\n', 'https://cert-08.pd.infn.it:8443/CREAM561916162\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM561916162 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM561916162 2014-08-18 14:10:19.985934 Submit https://cert-08.pd.infn.it:8443/CREAM561916162 Left: 459 (at submission time:459) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM561916162 2014-08-18 14:12:16.787043 Exit https://cert-08.pd.infn.it:8443/CREAM065967244 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:12:17,540 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:12:17,570 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:12:17,570 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:12:17,570 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141217.log]\n', '2014-08-18 14:12:17,574 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:12:18,838 DEBUG - Will invoke JobStart for JobID [CREAM209968628]\n', 'https://cert-08.pd.infn.it:8443/CREAM209968628\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM209968628 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM209968628 2014-08-18 14:12:19.218052 Submit https://cert-08.pd.infn.it:8443/CREAM209968628 Left: 451 (at submission time:451) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM209968628 2014-08-18 14:13:17.964590 Exit https://cert-08.pd.infn.it:8443/CREAM902953912 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:13:18,925 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:13:18,949 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:13:18,949 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:13:18,949 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141318.log]\n', '2014-08-18 14:13:18,953 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = " submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:11:15,736 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:11:15,775 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:11:15,775 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:11:15,775 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141115.log]\n', '2014-08-18 14:11:15,778 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:11:16,856 DEBUG - Will invoke JobStart for JobID [CREAM082991279]\n', 'https://cert-08.pd.infn.it:8443/CREAM082991279\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM082991279 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM082991279 2014-08-18 14:11:17.599460 Submit https://cert-08.pd.infn.it:8443/CREAM082991279 Left: 457 (at submission time:457) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM082991279 2014-08-18 14:12:15.160903 Exit https://cert-08.pd.infn.it:8443/CREAM558487528 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:12:15,773 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:12:15,796 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:12:15,796 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:12:15,796 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141215.log]\n', '2014-08-18 14:12:15,814 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:12:17,187 DEBUG - Will invoke JobStart for JobID [CREAM211047271]\n', 'https://cert-08.pd.infn.it:8443/CREAM211047271\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM211047271 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM211047271 2014-08-18 14:12:17.590486 Submit https://cert-08.pd.infn.it:8443/CREAM211047271 Left: 452 (at submission time:452) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM211047271 2014-08-18 14:14:10.987852 Exit https://cert-08.pd.infn.it:8443/CREAM318055802 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:14:11,392 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:14:11,411 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:14:11,411 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:14:11,411 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141411.log]\n', '2014-08-18 14:14:11,419 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = " submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:11:16,599 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:11:16,622 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:11:16,622 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:11:16,622 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141116.log]\n', '2014-08-18 14:11:16,625 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:11:17,985 DEBUG - Will invoke JobStart for JobID [CREAM546800015]\n', 'https://cert-08.pd.infn.it:8443/CREAM546800015\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM546800015 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM546800015 2014-08-18 14:11:18.175709 Submit https://cert-08.pd.infn.it:8443/CREAM546800015 Left: 456 (at submission time:456) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM546800015 2014-08-18 14:12:09.886825 Exit https://cert-08.pd.infn.it:8443/CREAM265870842 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:12:10,267 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:12:10,287 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:12:10,287 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:12:10,288 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141210.log]\n', '2014-08-18 14:12:10,296 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:12:11,412 DEBUG - Will invoke JobStart for JobID [CREAM208393421]\n', 'https://cert-08.pd.infn.it:8443/CREAM208393421\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM208393421 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM208393421 2014-08-18 14:12:11.798770 Submit https://cert-08.pd.infn.it:8443/CREAM208393421 Left: 454 (at submission time:454) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM208393421 2014-08-18 14:14:15.943602 Exit https://cert-08.pd.infn.it:8443/CREAM748358976 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:14:16,468 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:14:16,500 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:14:16,500 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:14:16,501 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141416.log]\n', '2014-08-18 14:14:16,504 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:13:20,238 DEBUG - Will invoke JobStart for JobID [CREAM965006383]\n', 'https://cert-08.pd.infn.it:8443/CREAM965006383\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM965006383 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM965006383 2014-08-18 14:13:20.518613 Submit https://cert-08.pd.infn.it:8443/CREAM965006383 Left: 447 (at submission time:447) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM965006383 2014-08-18 14:15:17.771374 Exit https://cert-08.pd.infn.it:8443/CREAM814867065 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:15:18,505 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:15:18,527 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:15:18,527 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:15:18,527 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141518.log]\n', '2014-08-18 14:15:18,530 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:15:19,771 DEBUG - Will invoke JobStart for JobID [CREAM519191637]\n', 'https://cert-08.pd.infn.it:8443/CREAM519191637\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM519191637 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM519191637 2014-08-18 14:15:20.120172 Submit https://cert-08.pd.infn.it:8443/CREAM519191637 Left: 440 (at submission time:440) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM519191637 2014-08-18 14:15:20.529267 Exit https://cert-08.pd.infn.it:8443/CREAM561916162 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:15:21,179 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:15:21,202 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:15:21,202 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:15:21,202 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141521.log]\n', '2014-08-18 14:15:21,205 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:15:22,506 DEBUG - Will invoke JobStart for JobID [CREAM723187137]\n', 'https://cert-08.pd.infn.it:8443/CREAM723187137\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM723187137 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM723187137 2014-08-18 14:15:22.757292 Submit https://cert-08.pd.infn.it:8443/CREAM723187137 Left: 439 (at submission time:439) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM72318713ailed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 532/1000 2014-08-18 14:13:17.967025 Submitted: 551 Running: 18 Cancelled: 0 Done-Ok: 533 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 533/1000 2014-08-18 14:13:19.142732 Submitted: 552 Running: 19 Cancelled: 0 Done-Ok: 533 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 533/1000 2014-08-18 14:13:20.520319 Submitted: 553 Running: 20 Cancelled: 0 Done-Ok: 533 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 533/1000 2014-08-18 14:14:10.990023 Submitted: 553 Running: 19 Cancelled: 0 Done-Ok: 534 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 534/1000 2014-08-18 14:14:12.892681 Submitted: 554 Running: 20 Cancelled: 0 Done-Ok: 534 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 534/1000 2014-08-18 14:14:15.946677 Submitted: 554 Running: 19 Cancelled: 0 Done-Ok: 535 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 535/1000 2014-08-18 14:14:17.217427 Submitted: 554 Running: 18 Cancelled: 0 Done-Ok: 536 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 536/1000 2014-08-18 14:14:17.385204 Submitted: 554 Running: 17 Cancelled: 0 Done-Ok: 537 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 537/1000 2014-08-18 14:14:18.122335 Submitted: 555 Running: 18 Cancelled: 0 Done-Ok: 537 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 537/1000 2014-08-18 14:14:19.565028 Submitted: 556 Running: 19 Cancelled: 0 Done-Ok: 537 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 537/1000 2014-08-18 14:14:19.699734 Submitted: 557 Running: 20 Cancelled: 0 Done-Ok: 537 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 537/1000 2014-08-18 14:15:11.227809 Submitted: 557 Running: 19 Cancelled: 0 Done-Ok: 538 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 538/1000 2014-08-18 14:15:12.964679 Submitted: 558 Running: 20 Cancelled: 0 Done-Ok: 538 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 538/1000 2014-08-18 14:15:16.324644 Submitted: 558 Running: 19 Cancelled: 0 Done-Ok: 539 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 539/1000 2014-08-18 14:15:17.772934 Submitted: 558 Running: 18 Cancelled: 0 Done-Ok: 540 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 540/1000 2014-08-18 14:15:18.648070 Submitted: 559 Running: 19 Cancelled: 0 Done-Ok: 540 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 540/1000 2014-08-18 14:15:20.121312 Submitted: 560 Running: 20 Cancelled: 0 Done-Ok: 540 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 540/1000 2014-08-18 14:15:20.530880 Submitted: 560 Running: 19 Cancelled: 0 Done-Ok: 541 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 541/1000 2014-08-18 14:15:22.762133 Submitted: 561 Running: 20 Cancelled: 0 Done-Ok: 541 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 541/1000 2014-08-18 14:16:11.999944 Submitted: 561 Running: 19 Cancelled: 0 Done-Ok: 5slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:13:17,355 DEBUG - Will invoke JobStart for JobID [CREAM428377902]\n', 'https://cert-08.pd.infn.it:8443/CREAM428377902\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM428377902 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM428377902 2014-08-18 14:13:17.677668 Submit https://cert-08.pd.infn.it:8443/CREAM428377902 Left: 449 (at submission time:449) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM428377902 2014-08-18 14:14:17.215359 Exit https://cert-08.pd.infn.it:8443/CREAM161390677 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:14:17,790 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:14:17,832 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:14:17,833 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:14:17,833 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141417.log]\n', '2014-08-18 14:14:17,836 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:14:19,178 DEBUG - Will invoke JobStart for JobID [CREAM626044676]\n', 'https://cert-08.pd.infn.it:8443/CREAM626044676\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM626044676 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM626044676 2014-08-18 14:14:19.563245 Submit https://cert-08.pd.infn.it:8443/CREAM626044676 Left: 444 (at submission time:444) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM626044676 2014-08-18 14:16:11.997872 Exit https://cert-08.pd.infn.it:8443/CREAM829570064 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:16:12,363 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:16:12,382 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:16:12,382 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:16:12,382 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141612.log]\n', '2014-08-18 14:16:12,393 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:16:13,497 DEBUG - Will invoke JobStart for JobID [CREAM732172895]\n', 'https://cert-08.pd.infn.it:8443/CREAM732172895\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM732172895 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM732172895 2014-08-18 14:16:13.687645 Submit https://cert-08.pd.infn.it:8443/CREAM732172895 Left: 438 (at submission time:438) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM73217289slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:14:12,588 DEBUG - Will invoke JobStart for JobID [CREAM603195380]\n', 'https://cert-08.pd.infn.it:8443/CREAM603195380\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM603195380 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM603195380 2014-08-18 14:14:12.889734 Submit https://cert-08.pd.infn.it:8443/CREAM603195380 Left: 446 (at submission time:446) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM603195380 2014-08-18 14:15:11.225748 Exit https://cert-08.pd.infn.it:8443/CREAM262058091 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:15:11,602 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:15:11,641 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:15:11,642 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:15:11,642 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141511.log]\n', '2014-08-18 14:15:11,648 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:15:12,669 DEBUG - Will invoke JobStart for JobID [CREAM338369526]\n', 'https://cert-08.pd.infn.it:8443/CREAM338369526\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM338369526 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM338369526 2014-08-18 14:15:12.961509 Submit https://cert-08.pd.infn.it:8443/CREAM338369526 Left: 442 (at submission time:442) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM338369526 2014-08-18 14:16:16.785361 Exit https://cert-08.pd.infn.it:8443/CREAM082991279 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:16:17,462 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:16:17,485 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:16:17,485 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:16:17,485 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141617.log]\n', '2014-08-18 14:16:17,489 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:16:18,887 DEBUG - Will invoke JobStart for JobID [CREAM833077515]\n', 'https://cert-08.pd.infn.it:8443/CREAM833077515\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM833077515 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM833077515 2014-08-18 14:16:19.275362 Submit https://cert-08.pd.infn.it:8443/CREAM833077515 Left: 437 (at submission time:437) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM83307751slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:13:18,874 DEBUG - Will invoke JobStart for JobID [CREAM783493455]\n', 'https://cert-08.pd.infn.it:8443/CREAM783493455\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM783493455 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM783493455 2014-08-18 14:13:19.139174 Submit https://cert-08.pd.infn.it:8443/CREAM783493455 Left: 448 (at submission time:448) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM783493455 2014-08-18 14:14:17.383920 Exit https://cert-08.pd.infn.it:8443/CREAM549311869 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:14:18,141 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:14:18,164 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:14:18,164 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:14:18,164 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141418.log]\n', '2014-08-18 14:14:18,168 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:14:19,487 DEBUG - Will invoke JobStart for JobID [CREAM046047672]\n', 'https://cert-08.pd.infn.it:8443/CREAM046047672\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM046047672 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM046047672 2014-08-18 14:14:19.698164 Submit https://cert-08.pd.infn.it:8443/CREAM046047672 Left: 443 (at submission time:443) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM046047672 2014-08-18 14:16:17.655259 Exit https://cert-08.pd.infn.it:8443/CREAM671229957 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:16:18,380 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:16:18,412 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:16:18,412 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:16:18,412 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141618.log]\n', '2014-08-18 14:16:18,420 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:16:19,737 DEBUG - Will invoke JobStart for JobID [CREAM302582360]\n', 'https://cert-08.pd.infn.it:8443/CREAM302582360\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM302582360 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM302582360 2014-08-18 14:16:20.203343 Submit https://cert-08.pd.infn.it:8443/CREAM302582360 Left: 436 (at submission time:436) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM30258236slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:14:17,745 DEBUG - Will invoke JobStart for JobID [CREAM786847247]\n', 'https://cert-08.pd.infn.it:8443/CREAM786847247\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM786847247 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM786847247 2014-08-18 14:14:18.119735 Submit https://cert-08.pd.infn.it:8443/CREAM786847247 Left: 445 (at submission time:445) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM786847247 2014-08-18 14:15:16.322265 Exit https://cert-08.pd.infn.it:8443/CREAM093417888 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:15:16,952 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:15:16,977 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:15:16,977 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:15:16,977 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141516.log]\n', '2014-08-18 14:15:16,980 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:15:18,287 DEBUG - Will invoke JobStart for JobID [CREAM263653396]\n', 'https://cert-08.pd.infn.it:8443/CREAM263653396\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM263653396 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM263653396 2014-08-18 14:15:18.639824 Submit https://cert-08.pd.infn.it:8443/CREAM263653396 Left: 441 (at submission time:441) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM263653396 2014-08-18 14:16:18.228835 Exit https://cert-08.pd.infn.it:8443/CREAM546800015 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:16:18,942 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:16:18,970 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:16:18,970 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:16:18,970 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141618.log]\n', '2014-08-18 14:16:18,978 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:16:20,469 DEBUG - Will invoke JobStart for JobID [CREAM757702724]\n', 'https://cert-08.pd.infn.it:8443/CREAM757702724\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM757702724 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM757702724 2014-08-18 14:16:20.813938 Submit https://cert-08.pd.infn.it:8443/CREAM757702724 Left: 435 (at submission time:435) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM7577027242 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 542/1000 2014-08-18 14:16:13.688952 Submitted: 562 Running: 20 Cancelled: 0 Done-Ok: 542 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 542/1000 2014-08-18 14:16:16.787273 Submitted: 562 Running: 19 Cancelled: 0 Done-Ok: 543 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 543/1000 2014-08-18 14:16:17.656483 Submitted: 562 Running: 18 Cancelled: 0 Done-Ok: 544 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 544/1000 2014-08-18 14:16:18.231604 Submitted: 562 Running: 17 Cancelled: 0 Done-Ok: 545 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 545/1000 2014-08-18 14:16:19.277773 Submitted: 563 Running: 18 Cancelled: 0 Done-Ok: 545 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 545/1000 2014-08-18 14:16:20.205103 Submitted: 564 Running: 19 Cancelled: 0 Done-Ok: 545 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 545/1000 2014-08-18 14:16:20.816581 Submitted: 565 Running: 20 Cancelled: 0 Done-Ok: 545 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 545/1000 2014-08-18 14:17:12.232656 Submitted: 565 Running: 19 Cancelled: 0 Done-Ok: 546 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 546/1000 2014-08-18 14:17:13.767674 Submitted: 566 Running: 20 Cancelled: 0 Done-Ok: 546 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 546/1000 2014-08-18 14:17:16.978092 Submitted: 566 Running: 19 Cancelled: 0 Done-Ok: 547 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 547/1000 2014-08-18 14:17:18.144743 Submitted: 566 Running: 18 Cancelled: 0 Done-Ok: 548 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 548/1000 2014-08-18 14:17:18.793460 Submitted: 566 Running: 17 Cancelled: 0 Done-Ok: 549 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 549/1000 2014-08-18 14:17:19.317079 Submitted: 567 Running: 18 Cancelled: 0 Done-Ok: 549 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 549/1000 2014-08-18 14:17:20.516227 Submitted: 568 Running: 19 Cancelled: 0 Done-Ok: 549 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 549/1000 2014-08-18 14:17:21.190751 Submitted: 569 Running: 20 Cancelled: 0 Done-Ok: 549 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 549/1000 2014-08-18 14:18:12.853773 Submitted: 569 Running: 19 Cancelled: 0 Done-Ok: 550 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 550/1000 2014-08-18 14:18:14.790625 Submitted: 570 Running: 20 Cancelled: 0 Done-Ok: 550 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 550/1000 2014-08-18 14:18:18.055482 Submitted: 570 Running: 19 Cancelled: 0 Done-Ok: 551 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 551/1000 2014-08-18 14:18:19.337419 Submitted: 570 Running: 18 Cancelled: 0 Done-Ok: 552 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 552/1000 2014-08-18 14:18:19.489842 Submitted: 570 Running: 17 Cancelled: 0 Done-O0 2014-08-18 14:17:16.976135 Exit https://cert-08.pd.infn.it:8443/CREAM398339297 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:17:17,729 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:17:17,752 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:17:17,752 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:17:17,752 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141717.log]\n', '2014-08-18 14:17:17,756 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:17:18,877 DEBUG - Will invoke JobStart for JobID [CREAM784077111]\n', 'https://cert-08.pd.infn.it:8443/CREAM784077111\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM784077111 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM784077111 2014-08-18 14:17:19.314443 Submit https://cert-08.pd.infn.it:8443/CREAM784077111 Left: 433 (at submission time:433) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM784077111 2014-08-18 14:18:19.335234 Exit https://cert-08.pd.infn.it:8443/CREAM783493455 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:18:20,041 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:18:20,062 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:18:20,062 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:18:20,062 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141820.log]\n', '2014-08-18 14:18:20,066 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:18:21,411 DEBUG - Will invoke JobStart for JobID [CREAM100130738]\n', 'https://cert-08.pd.infn.it:8443/CREAM100130738\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM100130738 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM100130738 2014-08-18 14:18:21.604119 Submit https://cert-08.pd.infn.it:8443/CREAM100130738 Left: 428 (at submission time:428) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM100130738 2014-08-18 14:19:19.761328 Exit https://cert-08.pd.infn.it:8443/CREAM046047672 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:19:20,463 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:19:20,486 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:19:20,486 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:19:20,486 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-14195 2014-08-18 14:18:12.851560 Exit https://cert-08.pd.infn.it:8443/CREAM065858168 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:18:13,214 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:18:13,237 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:18:13,237 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:18:13,237 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141813.log]\n', '2014-08-18 14:18:13,240 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:18:14,454 DEBUG - Will invoke JobStart for JobID [CREAM948257107]\n', 'https://cert-08.pd.infn.it:8443/CREAM948257107\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM948257107 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM948257107 2014-08-18 14:18:14.787674 Submit https://cert-08.pd.infn.it:8443/CREAM948257107 Left: 430 (at submission time:430) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM948257107 2014-08-18 14:18:18.054283 Exit https://cert-08.pd.infn.it:8443/CREAM428377902 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:18:18,690 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:18:18,714 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:18:18,714 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:18:18,714 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141818.log]\n', '2014-08-18 14:18:18,717 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:18:19,844 DEBUG - Will invoke JobStart for JobID [CREAM116324618]\n', 'https://cert-08.pd.infn.it:8443/CREAM116324618\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM116324618 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM116324618 2014-08-18 14:18:20.246081 Submit https://cert-08.pd.infn.it:8443/CREAM116324618 Left: 429 (at submission time:429) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM116324618 2014-08-18 14:19:20.097924 Exit https://cert-08.pd.infn.it:8443/CREAM626044676 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:19:21,121 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:19:21,146 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:19:21,146 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:19:21,146 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-14195 2014-08-18 14:17:18.791317 Exit https://cert-08.pd.infn.it:8443/CREAM211047271 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:17:19,709 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:17:19,732 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:17:19,733 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:17:19,733 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141719.log]\n', '2014-08-18 14:17:19,736 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:17:20,992 DEBUG - Will invoke JobStart for JobID [CREAM875350721]\n', 'https://cert-08.pd.infn.it:8443/CREAM875350721\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM875350721 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM875350721 2014-08-18 14:17:21.188872 Submit https://cert-08.pd.infn.it:8443/CREAM875350721 Left: 431 (at submission time:431) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM875350721 2014-08-18 14:19:13.255038 Exit https://cert-08.pd.infn.it:8443/CREAM603195380 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:19:13,551 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:19:13,584 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:19:13,584 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:19:13,584 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141913.log]\n', '2014-08-18 14:19:13,597 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:19:14,561 DEBUG - Will invoke JobStart for JobID [CREAM083023824]\n', 'https://cert-08.pd.infn.it:8443/CREAM083023824\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM083023824 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM083023824 2014-08-18 14:19:14.844200 Submit https://cert-08.pd.infn.it:8443/CREAM083023824 Left: 426 (at submission time:426) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM083023824 2014-08-18 14:20:13.512957 Exit https://cert-08.pd.infn.it:8443/CREAM338369526 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:20:13,886 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:20:13,917 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:20:13,917 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:20:13,917 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-14204 2014-08-18 14:17:12.231008 Exit https://cert-08.pd.infn.it:8443/CREAM208393421 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:17:12,569 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:17:12,592 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:17:12,593 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:17:12,593 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141712.log]\n', '2014-08-18 14:17:12,598 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:17:13,519 DEBUG - Will invoke JobStart for JobID [CREAM133394671]\n', 'https://cert-08.pd.infn.it:8443/CREAM133394671\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM133394671 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM133394671 2014-08-18 14:17:13.761028 Submit https://cert-08.pd.infn.it:8443/CREAM133394671 Left: 434 (at submission time:434) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM133394671 2014-08-18 14:19:17.744709 Exit https://cert-08.pd.infn.it:8443/CREAM786847247 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:19:18,510 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:19:18,534 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:19:18,534 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:19:18,534 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141918.log]\n', '2014-08-18 14:19:18,538 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:19:19,872 DEBUG - Will invoke JobStart for JobID [CREAM000872996]\n', 'https://cert-08.pd.infn.it:8443/CREAM000872996\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM000872996 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM000872996 2014-08-18 14:19:20.223271 Submit https://cert-08.pd.infn.it:8443/CREAM000872996 Left: 425 (at submission time:425) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM000872996 2014-08-18 14:20:19.564683 Exit https://cert-08.pd.infn.it:8443/CREAM263653396 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:20:19,894 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:20:19,922 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:20:19,922 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:20:19,922 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-14207 2014-08-18 14:17:18.139768 Exit https://cert-08.pd.infn.it:8443/CREAM209968628 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:17:18,862 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:17:18,903 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:17:18,904 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:17:18,904 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141718.log]\n', '2014-08-18 14:17:18,907 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:17:20,211 DEBUG - Will invoke JobStart for JobID [CREAM368047361]\n', 'https://cert-08.pd.infn.it:8443/CREAM368047361\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM368047361 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM368047361 2014-08-18 14:17:20.514154 Submit https://cert-08.pd.infn.it:8443/CREAM368047361 Left: 432 (at submission time:432) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM368047361 2014-08-18 14:18:19.488380 Exit https://cert-08.pd.infn.it:8443/CREAM965006383 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:18:20,504 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:18:20,528 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:18:20,528 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:18:20,528 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-141820.log]\n', '2014-08-18 14:18:20,531 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:18:21,927 DEBUG - Will invoke JobStart for JobID [CREAM958601521]\n', 'https://cert-08.pd.infn.it:8443/CREAM958601521\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM958601521 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM958601521 2014-08-18 14:18:22.216643 Submit https://cert-08.pd.infn.it:8443/CREAM958601521 Left: 427 (at submission time:427) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM958601521 2014-08-18 14:20:19.938495 Exit https://cert-08.pd.infn.it:8443/CREAM519191637 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:20:20,628 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:20:20,653 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:20:20,653 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:20:20,653 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-1420k: 553 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 553/1000 2014-08-18 14:18:20.247111 Submitted: 571 Running: 18 Cancelled: 0 Done-Ok: 553 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 553/1000 2014-08-18 14:18:21.608492 Submitted: 572 Running: 19 Cancelled: 0 Done-Ok: 553 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 553/1000 2014-08-18 14:18:22.218097 Submitted: 573 Running: 20 Cancelled: 0 Done-Ok: 553 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 553/1000 2014-08-18 14:19:13.256557 Submitted: 573 Running: 19 Cancelled: 0 Done-Ok: 554 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 554/1000 2014-08-18 14:19:14.845908 Submitted: 574 Running: 20 Cancelled: 0 Done-Ok: 554 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 554/1000 2014-08-18 14:19:17.749092 Submitted: 574 Running: 19 Cancelled: 0 Done-Ok: 555 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 555/1000 2014-08-18 14:19:19.762723 Submitted: 574 Running: 18 Cancelled: 0 Done-Ok: 556 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 556/1000 2014-08-18 14:19:20.101127 Submitted: 574 Running: 17 Cancelled: 0 Done-Ok: 557 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 557/1000 2014-08-18 14:19:20.226251 Submitted: 575 Running: 18 Cancelled: 0 Done-Ok: 557 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 557/1000 2014-08-18 14:19:21.967986 Submitted: 576 Running: 19 Cancelled: 0 Done-Ok: 557 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 557/1000 2014-08-18 14:19:22.629394 Submitted: 577 Running: 20 Cancelled: 0 Done-Ok: 557 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 557/1000 2014-08-18 14:20:13.517014 Submitted: 577 Running: 19 Cancelled: 0 Done-Ok: 558 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 558/1000 2014-08-18 14:20:15.395765 Submitted: 578 Running: 20 Cancelled: 0 Done-Ok: 558 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 558/1000 2014-08-18 14:20:19.569343 Submitted: 578 Running: 19 Cancelled: 0 Done-Ok: 559 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 559/1000 2014-08-18 14:20:19.941439 Submitted: 578 Running: 18 Cancelled: 0 Done-Ok: 560 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 560/1000 2014-08-18 14:20:21.555957 Submitted: 579 Running: 19 Cancelled: 0 Done-Ok: 560 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 560/1000 2014-08-18 14:20:22.238563 Submitted: 580 Running: 20 Cancelled: 0 Done-Ok: 560 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 560/1000 2014-08-18 14:20:22.484734 Submitted: 580 Running: 19 Cancelled: 0 Done-Ok: 561 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 561/1000 2014-08-18 14:20:25.203240 Submitted: 581 Running: 20 Cancelled: 0 Done-Ok: 561 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 561/1000 2014-08-18 14:21:14.184997 Submitted: 581 Running: 19 Cancelled: 0 Do19.log]\n', '2014-08-18 14:20:19,929 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:20:21,005 DEBUG - Will invoke JobStart for JobID [CREAM907709156]\n', 'https://cert-08.pd.infn.it:8443/CREAM907709156\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM907709156 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM907709156 2014-08-18 14:20:21.553649 Submit https://cert-08.pd.infn.it:8443/CREAM907709156 Left: 421 (at submission time:421) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM907709156 2014-08-18 14:21:20.425907 Exit https://cert-08.pd.infn.it:8443/CREAM757702724 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:21:21,091 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:21:21,110 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:21:21,110 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:21:21,110 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142121.log]\n', '2014-08-18 14:21:21,123 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:21:22,613 DEBUG - Will invoke JobStart for JobID [CREAM697317686]\n', 'https://cert-08.pd.infn.it:8443/CREAM697317686\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM697317686 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM697317686 2014-08-18 14:21:22.765130 Submit https://cert-08.pd.infn.it:8443/CREAM697317686 Left: 415 (at submission time:415) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM697317686 2014-08-18 14:22:14.577576 Exit https://cert-08.pd.infn.it:8443/CREAM133394671 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:22:14,904 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:22:14,937 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:22:14,937 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:22:14,937 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142214.log]\n', '2014-08-18 14:22:14,948 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:22:16,134 DEBUG - Will invoke JobStart for JobID [CREAM772232053]\n', 'https://cert-08.pd.infn.it:8443/CREAM772232053\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM772232053 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM772232053 2014-08-18 14:22:16.335230 Submit https:/20.log]\n', '2014-08-18 14:19:20,489 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:19:21,763 DEBUG - Will invoke JobStart for JobID [CREAM760419392]\n', 'https://cert-08.pd.infn.it:8443/CREAM760419392\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM760419392 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM760419392 2014-08-18 14:19:21.966107 Submit https://cert-08.pd.infn.it:8443/CREAM760419392 Left: 424 (at submission time:424) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM760419392 2014-08-18 14:21:19.703879 Exit https://cert-08.pd.infn.it:8443/CREAM302582360 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:21:20,400 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:21:20,424 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:21:20,424 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:21:20,424 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142120.log]\n', '2014-08-18 14:21:20,433 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:21:21,630 DEBUG - Will invoke JobStart for JobID [CREAM403277862]\n', 'https://cert-08.pd.infn.it:8443/CREAM403277862\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM403277862 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM403277862 2014-08-18 14:21:22.206856 Submit https://cert-08.pd.infn.it:8443/CREAM403277862 Left: 417 (at submission time:417) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM403277862 2014-08-18 14:22:19.411185 Exit https://cert-08.pd.infn.it:8443/CREAM784077111 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:22:20,062 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:22:20,085 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:22:20,085 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:22:20,085 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142220.log]\n', '2014-08-18 14:22:20,095 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:22:21,275 DEBUG - Will invoke JobStart for JobID [CREAM157223373]\n', 'https://cert-08.pd.infn.it:8443/CREAM157223373\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM157223373 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM157223373 2014-08-18 14:22:21.550387 Submit https:/13.log]\n', '2014-08-18 14:20:13,927 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:20:15,103 DEBUG - Will invoke JobStart for JobID [CREAM391910101]\n', 'https://cert-08.pd.infn.it:8443/CREAM391910101\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM391910101 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM391910101 2014-08-18 14:20:15.392558 Submit https://cert-08.pd.infn.it:8443/CREAM391910101 Left: 422 (at submission time:422) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM391910101 2014-08-18 14:21:20.330580 Exit https://cert-08.pd.infn.it:8443/CREAM833077515 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:21:21,006 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:21:21,034 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:21:21,034 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:21:21,034 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142121.log]\n', '2014-08-18 14:21:21,037 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:21:22,228 DEBUG - Will invoke JobStart for JobID [CREAM300243594]\n', 'https://cert-08.pd.infn.it:8443/CREAM300243594\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM300243594 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM300243594 2014-08-18 14:21:22.546981 Submit https://cert-08.pd.infn.it:8443/CREAM300243594 Left: 416 (at submission time:416) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM300243594 2014-08-18 14:22:21.279048 Exit https://cert-08.pd.infn.it:8443/CREAM875350721 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:22:22,150 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:22:22,179 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:22:22,179 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:22:22,179 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142222.log]\n', '2014-08-18 14:22:22,182 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:22:23,658 DEBUG - Will invoke JobStart for JobID [CREAM820418291]\n', 'https://cert-08.pd.infn.it:8443/CREAM820418291\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM820418291 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM820418291 2014-08-18 14:22:23.948201 Submit https:/20.log]\n', '2014-08-18 14:20:20,656 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:20:21,990 DEBUG - Will invoke JobStart for JobID [CREAM271882553]\n', 'https://cert-08.pd.infn.it:8443/CREAM271882553\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM271882553 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM271882553 2014-08-18 14:20:22.237784 Submit https://cert-08.pd.infn.it:8443/CREAM271882553 Left: 420 (at submission time:420) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM271882553 2014-08-18 14:20:22.483226 Exit https://cert-08.pd.infn.it:8443/CREAM723187137 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:20:23,296 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:20:23,319 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:20:23,319 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:20:23,319 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142023.log]\n', '2014-08-18 14:20:23,322 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:20:24,737 DEBUG - Will invoke JobStart for JobID [CREAM250664772]\n', 'https://cert-08.pd.infn.it:8443/CREAM250664772\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM250664772 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM250664772 2014-08-18 14:20:25.200285 Submit https://cert-08.pd.infn.it:8443/CREAM250664772 Left: 419 (at submission time:419) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM250664772 2014-08-18 14:22:21.779994 Exit https://cert-08.pd.infn.it:8443/CREAM368047361 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:22:22,461 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:22:22,485 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:22:22,485 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:22:22,485 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142222.log]\n', '2014-08-18 14:22:22,488 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:22:24,142 DEBUG - Will invoke JobStart for JobID [CREAM202278234]\n', 'https://cert-08.pd.infn.it:8443/CREAM202278234\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM202278234 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM202278234 2014-08-18 14:22:24.546770 Submit https:/21.log]\n', '2014-08-18 14:19:21,150 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:19:22,304 DEBUG - Will invoke JobStart for JobID [CREAM540637083]\n', 'https://cert-08.pd.infn.it:8443/CREAM540637083\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM540637083 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM540637083 2014-08-18 14:19:22.624929 Submit https://cert-08.pd.infn.it:8443/CREAM540637083 Left: 423 (at submission time:423) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM540637083 2014-08-18 14:21:14.182778 Exit https://cert-08.pd.infn.it:8443/CREAM732172895 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:21:14,582 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:21:14,612 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:21:14,613 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:21:14,613 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142114.log]\n', '2014-08-18 14:21:14,620 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:21:15,579 DEBUG - Will invoke JobStart for JobID [CREAM117527785]\n', 'https://cert-08.pd.infn.it:8443/CREAM117527785\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM117527785 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM117527785 2014-08-18 14:21:15.980865 Submit https://cert-08.pd.infn.it:8443/CREAM117527785 Left: 418 (at submission time:418) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM117527785 2014-08-18 14:23:20.514440 Exit https://cert-08.pd.infn.it:8443/CREAM948257107 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:23:20,871 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:23:20,894 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:23:20,894 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:23:20,894 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142320.log]\n', '2014-08-18 14:23:20,897 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:23:22,516 DEBUG - Will invoke JobStart for JobID [CREAM785964612]\n', 'https://cert-08.pd.infn.it:8443/CREAM785964612\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM785964612 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM785964612 2014-08-18 14:23:22.869651 Submit https:/ne-Ok: 562 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 562/1000 2014-08-18 14:21:15.984674 Submitted: 582 Running: 20 Cancelled: 0 Done-Ok: 562 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 562/1000 2014-08-18 14:21:19.708482 Submitted: 582 Running: 19 Cancelled: 0 Done-Ok: 563 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 563/1000 2014-08-18 14:21:20.333441 Submitted: 582 Running: 18 Cancelled: 0 Done-Ok: 564 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 564/1000 2014-08-18 14:21:20.427613 Submitted: 582 Running: 17 Cancelled: 0 Done-Ok: 565 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 565/1000 2014-08-18 14:21:22.207912 Submitted: 583 Running: 18 Cancelled: 0 Done-Ok: 565 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 565/1000 2014-08-18 14:21:22.549395 Submitted: 584 Running: 19 Cancelled: 0 Done-Ok: 565 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 565/1000 2014-08-18 14:21:22.766770 Submitted: 585 Running: 20 Cancelled: 0 Done-Ok: 565 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 565/1000 2014-08-18 14:22:14.578896 Submitted: 585 Running: 19 Cancelled: 0 Done-Ok: 566 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 566/1000 2014-08-18 14:22:16.338507 Submitted: 586 Running: 20 Cancelled: 0 Done-Ok: 566 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 566/1000 2014-08-18 14:22:19.414219 Submitted: 586 Running: 19 Cancelled: 0 Done-Ok: 567 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 567/1000 2014-08-18 14:22:21.281064 Submitted: 586 Running: 18 Cancelled: 0 Done-Ok: 568 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 568/1000 2014-08-18 14:22:21.553315 Submitted: 587 Running: 19 Cancelled: 0 Done-Ok: 568 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 568/1000 2014-08-18 14:22:21.783088 Submitted: 587 Running: 18 Cancelled: 0 Done-Ok: 569 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 569/1000 2014-08-18 14:22:23.950288 Submitted: 588 Running: 19 Cancelled: 0 Done-Ok: 569 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 569/1000 2014-08-18 14:22:24.550163 Submitted: 589 Running: 20 Cancelled: 0 Done-Ok: 569 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 569/1000 2014-08-18 14:23:20.408067 Submitted: 589 Running: 19 Cancelled: 0 Done-Ok: 570 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 570/1000 2014-08-18 14:23:20.516058 Submitted: 589 Running: 18 Cancelled: 0 Done-Ok: 571 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 571/1000 2014-08-18 14:23:20.825576 Submitted: 589 Running: 17 Cancelled: 0 Done-Ok: 572 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 572/1000 2014-08-18 14:23:22.079961 Submitted: 590 Running: 18 Cancelled: 0 Done-Ok: 572 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 572/1000 2014-08-18 14:23:22.870788 Submitted: 591 Running: 19 Cancelled: /cert-08.pd.infn.it:8443/CREAM202278234 Left: 411 (at submission time:411) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM202278234 2014-08-18 14:23:20.406289 Exit https://cert-08.pd.infn.it:8443/CREAM958601521 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:23:20,707 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:23:20,736 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:23:20,736 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:23:20,736 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142320.log]\n', '2014-08-18 14:23:20,751 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:23:21,870 DEBUG - Will invoke JobStart for JobID [CREAM696966378]\n', 'https://cert-08.pd.infn.it:8443/CREAM696966378\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM696966378 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM696966378 2014-08-18 14:23:22.076086 Submit https://cert-08.pd.infn.it:8443/CREAM696966378 Left: 410 (at submission time:410) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM696966378 2014-08-18 14:25:22.023561 Exit https://cert-08.pd.infn.it:8443/CREAM271882553 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:25:22,737 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:25:22,756 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:25:22,756 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:25:22,756 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142522.log]\n', '2014-08-18 14:25:22,764 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:25:23,966 DEBUG - Will invoke JobStart for JobID [CREAM946199175]\n', 'https://cert-08.pd.infn.it:8443/CREAM946199175\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM946199175 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM946199175 2014-08-18 14:25:24.468274 Submit https://cert-08.pd.infn.it:8443/CREAM946199175 Left: 400 (at submission time:400) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM946199175 2014-08-18 14:25:24.817299 Exit https://cert-08.pd.infn.it:8443/CREAM250664772 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:25:25,302 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:25:25,325 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:25:25,325 WARN - No configuration file suitable fo0 Done-Ok: 572 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 572/1000 2014-08-18 14:23:23.104952 Submitted: 591 Running: 18 Cancelled: 0 Done-Ok: 573 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 573/1000 2014-08-18 14:23:23.829176 Submitted: 592 Running: 19 Cancelled: 0 Done-Ok: 573 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 573/1000 2014-08-18 14:23:25.366204 Submitted: 593 Running: 20 Cancelled: 0 Done-Ok: 573 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 573/1000 2014-08-18 14:24:15.694494 Submitted: 593 Running: 19 Cancelled: 0 Done-Ok: 574 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 574/1000 2014-08-18 14:24:17.633145 Submitted: 594 Running: 20 Cancelled: 0 Done-Ok: 574 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 574/1000 2014-08-18 14:24:21.214361 Submitted: 594 Running: 19 Cancelled: 0 Done-Ok: 575 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 575/1000 2014-08-18 14:24:21.359539 Submitted: 594 Running: 18 Cancelled: 0 Done-Ok: 576 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 576/1000 2014-08-18 14:24:21.497078 Submitted: 594 Running: 17 Cancelled: 0 Done-Ok: 577 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 577/1000 2014-08-18 14:24:23.288964 Submitted: 595 Running: 18 Cancelled: 0 Done-Ok: 577 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 577/1000 2014-08-18 14:24:23.682070 Submitted: 596 Running: 19 Cancelled: 0 Done-Ok: 577 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 577/1000 2014-08-18 14:24:24.139826 Submitted: 597 Running: 20 Cancelled: 0 Done-Ok: 577 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 577/1000 2014-08-18 14:25:15.715810 Submitted: 597 Running: 19 Cancelled: 0 Done-Ok: 578 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 578/1000 2014-08-18 14:25:17.853926 Submitted: 598 Running: 20 Cancelled: 0 Done-Ok: 578 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 578/1000 2014-08-18 14:25:21.598057 Submitted: 598 Running: 19 Cancelled: 0 Done-Ok: 579 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 579/1000 2014-08-18 14:25:22.025466 Submitted: 598 Running: 18 Cancelled: 0 Done-Ok: 580 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 580/1000 2014-08-18 14:25:23.762581 Submitted: 599 Running: 19 Cancelled: 0 Done-Ok: 580 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 580/1000 2014-08-18 14:25:24.469589 Submitted: 600 Running: 20 Cancelled: 0 Done-Ok: 580 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 580/1000 2014-08-18 14:25:24.820766 Submitted: 600 Running: 19 Cancelled: 0 Done-Ok: 581 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 581/1000 2014-08-18 14:25:27.019132 Submitted: 601 Running: 20 Cancelled: 0 Done-Ok: 581 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 581/1000 2014-08-18 14:26:16.111949 Submitted: 601 Running: 19 Cancell/cert-08.pd.infn.it:8443/CREAM785964612 Left: 409 (at submission time:409) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM785964612 2014-08-18 14:23:23.103254 Exit https://cert-08.pd.infn.it:8443/CREAM116324618 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:23:23,741 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:23:23,766 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:23:23,766 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:23:23,767 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142323.log]\n', '2014-08-18 14:23:23,770 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:23:24,990 DEBUG - Will invoke JobStart for JobID [CREAM532354825]\n', 'https://cert-08.pd.infn.it:8443/CREAM532354825\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM532354825 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM532354825 2014-08-18 14:23:25.362283 Submit https://cert-08.pd.infn.it:8443/CREAM532354825 Left: 407 (at submission time:407) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM532354825 2014-08-18 14:24:21.358238 Exit https://cert-08.pd.infn.it:8443/CREAM540637083 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:24:21,874 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:24:21,901 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:24:21,901 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:24:21,901 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142421.log]\n', '2014-08-18 14:24:21,904 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:24:23,467 DEBUG - Will invoke JobStart for JobID [CREAM161096896]\n', 'https://cert-08.pd.infn.it:8443/CREAM161096896\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM161096896 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM161096896 2014-08-18 14:24:23.678742 Submit https://cert-08.pd.infn.it:8443/CREAM161096896 Left: 404 (at submission time:404) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM161096896 2014-08-18 14:26:16.108958 Exit https://cert-08.pd.infn.it:8443/CREAM117527785 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:26:16,548 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:26:16,579 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:26:16,579 WARN - No configuration file suitable fo/cert-08.pd.infn.it:8443/CREAM157223373 Left: 413 (at submission time:413) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM157223373 2014-08-18 14:23:20.815119 Exit https://cert-08.pd.infn.it:8443/CREAM100130738 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:23:21,978 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:23:22,011 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:23:22,012 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:23:22,012 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142322.log]\n', '2014-08-18 14:23:22,018 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:23:23,499 DEBUG - Will invoke JobStart for JobID [CREAM040397039]\n', 'https://cert-08.pd.infn.it:8443/CREAM040397039\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM040397039 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM040397039 2014-08-18 14:23:23.828538 Submit https://cert-08.pd.infn.it:8443/CREAM040397039 Left: 408 (at submission time:408) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM040397039 2014-08-18 14:24:21.494469 Exit https://cert-08.pd.infn.it:8443/CREAM760419392 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:24:22,226 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:24:22,249 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:24:22,250 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:24:22,250 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142422.log]\n', '2014-08-18 14:24:22,265 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:24:23,616 DEBUG - Will invoke JobStart for JobID [CREAM813909815]\n', 'https://cert-08.pd.infn.it:8443/CREAM813909815\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM813909815 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM813909815 2014-08-18 14:24:24.136551 Submit https://cert-08.pd.infn.it:8443/CREAM813909815 Left: 403 (at submission time:403) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM813909815 2014-08-18 14:26:21.160909 Exit https://cert-08.pd.infn.it:8443/CREAM403277862 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:26:21,946 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:26:21,971 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:26:21,972 WARN - No configuration file suitable fo/cert-08.pd.infn.it:8443/CREAM772232053 Left: 414 (at submission time:414) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM772232053 2014-08-18 14:24:21.211863 Exit https://cert-08.pd.infn.it:8443/CREAM000872996 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:24:21,770 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:24:21,794 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:24:21,794 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:24:21,794 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142421.log]\n', '2014-08-18 14:24:21,797 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:24:22,875 DEBUG - Will invoke JobStart for JobID [CREAM139749286]\n', 'https://cert-08.pd.infn.it:8443/CREAM139749286\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM139749286 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM139749286 2014-08-18 14:24:23.286358 Submit https://cert-08.pd.infn.it:8443/CREAM139749286 Left: 405 (at submission time:405) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM139749286 2014-08-18 14:25:21.595642 Exit https://cert-08.pd.infn.it:8443/CREAM907709156 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:25:22,082 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:25:22,107 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:25:22,107 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:25:22,107 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142522.log]\n', '2014-08-18 14:25:22,111 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:25:23,424 DEBUG - Will invoke JobStart for JobID [CREAM043604862]\n', 'https://cert-08.pd.infn.it:8443/CREAM043604862\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM043604862 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM043604862 2014-08-18 14:25:23.760561 Submit https://cert-08.pd.infn.it:8443/CREAM043604862 Left: 401 (at submission time:401) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM043604862 2014-08-18 14:26:22.949937 Exit https://cert-08.pd.infn.it:8443/CREAM697317686 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:26:23,555 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:26:23,583 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:26:23,583 WARN - No configuration file suitable fo/cert-08.pd.infn.it:8443/CREAM820418291 Left: 412 (at submission time:412) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM820418291 2014-08-18 14:24:15.692808 Exit https://cert-08.pd.infn.it:8443/CREAM083023824 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:24:16,053 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:24:16,074 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:24:16,074 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:24:16,074 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142416.log]\n', '2014-08-18 14:24:16,077 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:24:17,258 DEBUG - Will invoke JobStart for JobID [CREAM723214958]\n', 'https://cert-08.pd.infn.it:8443/CREAM723214958\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM723214958 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM723214958 2014-08-18 14:24:17.629560 Submit https://cert-08.pd.infn.it:8443/CREAM723214958 Left: 406 (at submission time:406) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM723214958 2014-08-18 14:25:15.713816 Exit https://cert-08.pd.infn.it:8443/CREAM391910101 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:25:16,095 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:25:16,115 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:25:16,115 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:25:16,115 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142516.log]\n', '2014-08-18 14:25:16,118 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:25:17,449 DEBUG - Will invoke JobStart for JobID [CREAM835565099]\n', 'https://cert-08.pd.infn.it:8443/CREAM835565099\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM835565099 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM835565099 2014-08-18 14:25:17.850840 Submit https://cert-08.pd.infn.it:8443/CREAM835565099 Left: 402 (at submission time:402) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM835565099 2014-08-18 14:26:23.076952 Exit https://cert-08.pd.infn.it:8443/CREAM300243594 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:26:23,787 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:26:23,811 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:26:23,812 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:25:25,325 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142525.log]\n', '2014-08-18 14:25:25,328 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:25:26,616 DEBUG - Will invoke JobStart for JobID [CREAM615110654]\n', 'https://cert-08.pd.infn.it:8443/CREAM615110654\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM615110654 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM615110654 2014-08-18 14:25:27.017648 Submit https://cert-08.pd.infn.it:8443/CREAM615110654 Left: 399 (at submission time:399) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM615110654 2014-08-18 14:27:23.680690 Exit https://cert-08.pd.infn.it:8443/CREAM202278234 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:27:24,316 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:27:24,351 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:27:24,351 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:27:24,351 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142724.log]\n', '2014-08-18 14:27:24,361 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:27:26,130 DEBUG - Will invoke JobStart for JobID [CREAM880647470]\n', 'https://cert-08.pd.infn.it:8443/CREAM880647470\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM880647470 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM880647470 2014-08-18 14:27:26.365697 Submit https://cert-08.pd.infn.it:8443/CREAM880647470 Left: 391 (at submission time:391) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM880647470 2014-08-18 14:28:17.369395 Exit https://cert-08.pd.infn.it:8443/CREAM696966378 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:28:17,683 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:28:17,706 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:28:17,706 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:28:17,706 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142817.log]\n', '2014-08-18 14:28:17,709 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:28:18,814 DEBUG - Will invoke JobStart for JobID [CREAM367766627]\n', 'https://cert-08.pd.infn.it:8443/CREAM367766627\n'] job submission failed?! job submission successful Returning from submit_job with jobid = ed: 0 Done-Ok: 582 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 582/1000 2014-08-18 14:26:17.938881 Submitted: 602 Running: 20 Cancelled: 0 Done-Ok: 582 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 582/1000 2014-08-18 14:26:21.164238 Submitted: 602 Running: 19 Cancelled: 0 Done-Ok: 583 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 583/1000 2014-08-18 14:26:22.951352 Submitted: 602 Running: 18 Cancelled: 0 Done-Ok: 584 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 584/1000 2014-08-18 14:26:23.079255 Submitted: 602 Running: 17 Cancelled: 0 Done-Ok: 585 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 585/1000 2014-08-18 14:26:23.869616 Submitted: 603 Running: 18 Cancelled: 0 Done-Ok: 585 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 585/1000 2014-08-18 14:26:25.191937 Submitted: 604 Running: 19 Cancelled: 0 Done-Ok: 585 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 585/1000 2014-08-18 14:26:25.890402 Submitted: 605 Running: 20 Cancelled: 0 Done-Ok: 585 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 585/1000 2014-08-18 14:27:16.891087 Submitted: 605 Running: 19 Cancelled: 0 Done-Ok: 586 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 586/1000 2014-08-18 14:27:18.739248 Submitted: 606 Running: 20 Cancelled: 0 Done-Ok: 586 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 586/1000 2014-08-18 14:27:22.562990 Submitted: 606 Running: 19 Cancelled: 0 Done-Ok: 587 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 587/1000 2014-08-18 14:27:23.377065 Submitted: 606 Running: 18 Cancelled: 0 Done-Ok: 588 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 588/1000 2014-08-18 14:27:23.683523 Submitted: 606 Running: 17 Cancelled: 0 Done-Ok: 589 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 589/1000 2014-08-18 14:27:24.768434 Submitted: 607 Running: 18 Cancelled: 0 Done-Ok: 589 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 589/1000 2014-08-18 14:27:26.010888 Submitted: 608 Running: 19 Cancelled: 0 Done-Ok: 589 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 589/1000 2014-08-18 14:27:26.366706 Submitted: 609 Running: 20 Cancelled: 0 Done-Ok: 589 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 589/1000 2014-08-18 14:28:17.372375 Submitted: 609 Running: 19 Cancelled: 0 Done-Ok: 590 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 590/1000 2014-08-18 14:28:19.235605 Submitted: 610 Running: 20 Cancelled: 0 Done-Ok: 590 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 590/1000 2014-08-18 14:28:22.204388 Submitted: 610 Running: 19 Cancelled: 0 Done-Ok: 591 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 591/1000 2014-08-18 14:28:23.171005 Submitted: 610 Running: 18 Cancelled: 0 Done-Ok: 592 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 592/1000 2014-08-18 14:28:24.868109 Submitted: 611 Running: 19 Canr loading. Using built-in configuration\n', '2014-08-18 14:26:21,972 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142621.log]\n', '2014-08-18 14:26:21,976 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:26:23,601 DEBUG - Will invoke JobStart for JobID [CREAM266478431]\n', 'https://cert-08.pd.infn.it:8443/CREAM266478431\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM266478431 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM266478431 2014-08-18 14:26:23.866638 Submit https://cert-08.pd.infn.it:8443/CREAM266478431 Left: 397 (at submission time:397) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM266478431 2014-08-18 14:27:22.559902 Exit https://cert-08.pd.infn.it:8443/CREAM157223373 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:27:23,011 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:27:23,035 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:27:23,035 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:27:23,035 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142723.log]\n', '2014-08-18 14:27:23,045 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:27:24,324 DEBUG - Will invoke JobStart for JobID [CREAM196683343]\n', 'https://cert-08.pd.infn.it:8443/CREAM196683343\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM196683343 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM196683343 2014-08-18 14:27:24.763511 Submit https://cert-08.pd.infn.it:8443/CREAM196683343 Left: 393 (at submission time:393) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM196683343 2014-08-18 14:28:23.169189 Exit https://cert-08.pd.infn.it:8443/CREAM040397039 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:28:24,054 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:28:24,075 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:28:24,075 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:28:24,075 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142824.log]\n', '2014-08-18 14:28:24,078 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:28:25,372 DEBUG - Will invoke JobStart for JobID [CREAM230581411]\n', 'https://cert-08.pd.infn.it:8443/CREAM230581411\n'] job submission failed?! job submission successful Returning from submit_job with jobid = r loading. Using built-in configuration\n', '2014-08-18 14:26:16,579 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142616.log]\n', '2014-08-18 14:26:16,583 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:26:17,723 DEBUG - Will invoke JobStart for JobID [CREAM665080061]\n', 'https://cert-08.pd.infn.it:8443/CREAM665080061\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM665080061 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM665080061 2014-08-18 14:26:17.936268 Submit https://cert-08.pd.infn.it:8443/CREAM665080061 Left: 398 (at submission time:398) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM665080061 2014-08-18 14:28:22.201984 Exit https://cert-08.pd.infn.it:8443/CREAM785964612 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:28:22,993 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:28:23,013 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:28:23,013 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:28:23,013 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142823.log]\n', '2014-08-18 14:28:23,016 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:28:24,247 DEBUG - Will invoke JobStart for JobID [CREAM259785211]\n', 'https://cert-08.pd.infn.it:8443/CREAM259785211\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM259785211 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM259785211 2014-08-18 14:28:24.865227 Submit https://cert-08.pd.infn.it:8443/CREAM259785211 Left: 389 (at submission time:389) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM259785211 2014-08-18 14:28:25.259486 Exit https://cert-08.pd.infn.it:8443/CREAM532354825 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:28:25,889 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:28:25,921 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:28:25,921 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:28:25,921 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142825.log]\n', '2014-08-18 14:28:25,926 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:28:27,239 DEBUG - Will invoke JobStart for JobID [CREAM876800901]\n', 'https://cert-08.pd.infn.it:8443/CREAM876800901\n'] job submission failed?! job submission successful Returning from submit_job with jobid = r loading. Using built-in configuration\n', '2014-08-18 14:26:23,812 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142623.log]\n', '2014-08-18 14:26:23,815 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:26:25,673 DEBUG - Will invoke JobStart for JobID [CREAM269172097]\n', 'https://cert-08.pd.infn.it:8443/CREAM269172097\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM269172097 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM269172097 2014-08-18 14:26:25.887063 Submit https://cert-08.pd.infn.it:8443/CREAM269172097 Left: 395 (at submission time:395) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM269172097 2014-08-18 14:27:23.375793 Exit https://cert-08.pd.infn.it:8443/CREAM820418291 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:27:24,189 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:27:24,213 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:27:24,213 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:27:24,213 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142724.log]\n', '2014-08-18 14:27:24,216 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:27:25,642 DEBUG - Will invoke JobStart for JobID [CREAM435681034]\n', 'https://cert-08.pd.infn.it:8443/CREAM435681034\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM435681034 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM435681034 2014-08-18 14:27:26.009429 Submit https://cert-08.pd.infn.it:8443/CREAM435681034 Left: 392 (at submission time:392) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM435681034 2014-08-18 14:29:17.632282 Exit https://cert-08.pd.infn.it:8443/CREAM723214958 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:29:18,063 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:29:18,090 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:29:18,090 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:29:18,090 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142918.log]\n', '2014-08-18 14:29:18,094 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:29:19,075 DEBUG - Will invoke JobStart for JobID [CREAM776419989]\n', 'https://cert-08.pd.infn.it:8443/CREAM776419989\n'] job submission failed?! job submission successful Returning from submit_job with jobid = r loading. Using built-in configuration\n', '2014-08-18 14:26:23,583 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142623.log]\n', '2014-08-18 14:26:23,586 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:26:24,830 DEBUG - Will invoke JobStart for JobID [CREAM661304007]\n', 'https://cert-08.pd.infn.it:8443/CREAM661304007\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM661304007 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM661304007 2014-08-18 14:26:25.190750 Submit https://cert-08.pd.infn.it:8443/CREAM661304007 Left: 396 (at submission time:396) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM661304007 2014-08-18 14:27:16.887795 Exit https://cert-08.pd.infn.it:8443/CREAM772232053 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:27:17,216 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:27:17,255 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:27:17,256 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:27:17,256 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142717.log]\n', '2014-08-18 14:27:17,263 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:27:18,515 DEBUG - Will invoke JobStart for JobID [CREAM536221059]\n', 'https://cert-08.pd.infn.it:8443/CREAM536221059\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM536221059 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM536221059 2014-08-18 14:27:18.735020 Submit https://cert-08.pd.infn.it:8443/CREAM536221059 Left: 394 (at submission time:394) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM536221059 2014-08-18 14:29:23.280584 Exit https://cert-08.pd.infn.it:8443/CREAM139749286 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:29:23,839 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:29:23,862 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:29:23,862 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:29:23,862 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142923.log]\n', '2014-08-18 14:29:23,867 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:29:25,005 DEBUG - Will invoke JobStart for JobID [CREAM953780305]\n', 'https://cert-08.pd.infn.it:8443/CREAM953780305\n'] job submission failed?! job submission successful Returning from submit_job with jobid = celled: 0 Done-Ok: 592 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 592/1000 2014-08-18 14:28:25.262246 Submitted: 611 Running: 18 Cancelled: 0 Done-Ok: 593 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 593/1000 2014-08-18 14:28:25.727027 Submitted: 612 Running: 19 Cancelled: 0 Done-Ok: 593 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 593/1000 2014-08-18 14:28:27.489020 Submitted: 613 Running: 20 Cancelled: 0 Done-Ok: 593 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 593/1000 2014-08-18 14:29:17.638654 Submitted: 613 Running: 19 Cancelled: 0 Done-Ok: 594 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 594/1000 2014-08-18 14:29:19.350138 Submitted: 614 Running: 20 Cancelled: 0 Done-Ok: 594 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 594/1000 2014-08-18 14:29:23.282805 Submitted: 614 Running: 19 Cancelled: 0 Done-Ok: 595 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 595/1000 2014-08-18 14:29:23.711995 Submitted: 614 Running: 18 Cancelled: 0 Done-Ok: 596 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 596/1000 2014-08-18 14:29:24.950474 Submitted: 614 Running: 17 Cancelled: 0 Done-Ok: 597 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 597/1000 2014-08-18 14:29:25.378194 Submitted: 615 Running: 18 Cancelled: 0 Done-Ok: 597 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 597/1000 2014-08-18 14:29:25.869653 Submitted: 616 Running: 19 Cancelled: 0 Done-Ok: 597 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 597/1000 2014-08-18 14:29:27.284309 Submitted: 617 Running: 20 Cancelled: 0 Done-Ok: 597 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 597/1000 2014-08-18 14:30:18.102294 Submitted: 617 Running: 19 Cancelled: 0 Done-Ok: 598 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 598/1000 2014-08-18 14:30:19.836198 Submitted: 618 Running: 20 Cancelled: 0 Done-Ok: 598 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 598/1000 2014-08-18 14:30:23.540033 Submitted: 618 Running: 19 Cancelled: 0 Done-Ok: 599 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 599/1000 2014-08-18 14:30:24.116969 Submitted: 618 Running: 18 Cancelled: 0 Done-Ok: 600 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 600/1000 2014-08-18 14:30:25.575101 Submitted: 619 Running: 19 Cancelled: 0 Done-Ok: 600 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 600/1000 2014-08-18 14:30:26.383834 Submitted: 620 Running: 20 Cancelled: 0 Done-Ok: 600 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 600/1000 2014-08-18 14:30:26.760751 Submitted: 620 Running: 19 Cancelled: 0 Done-Ok: 601 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 601/1000 2014-08-18 14:30:29.239688 Submitted: 621 Running: 20 Cancelled: 0 Done-Ok: 601 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 601/1000 2014-08-18 14:31:18.536304 Submitted: 621 Running: 19https://cert-08.pd.infn.it:8443/CREAM953780305 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM953780305 2014-08-18 14:29:25.375766 Submit https://cert-08.pd.infn.it:8443/CREAM953780305 Left: 385 (at submission time:385) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM953780305 2014-08-18 14:30:23.538034 Exit https://cert-08.pd.infn.it:8443/CREAM043604862 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:30:24,237 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:30:24,265 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:30:24,265 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:30:24,265 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143024.log]\n', '2014-08-18 14:30:24,273 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:30:25,279 DEBUG - Will invoke JobStart for JobID [CREAM640783101]\n', 'https://cert-08.pd.infn.it:8443/CREAM640783101\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM640783101 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM640783101 2014-08-18 14:30:25.572464 Submit https://cert-08.pd.infn.it:8443/CREAM640783101 Left: 381 (at submission time:381) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM640783101 2014-08-18 14:31:24.316324 Exit https://cert-08.pd.infn.it:8443/CREAM661304007 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:31:24,823 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:31:24,885 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:31:24,886 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:31:24,886 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143124.log]\n', '2014-08-18 14:31:24,894 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:31:26,255 DEBUG - Will invoke JobStart for JobID [CREAM297543394]\n', 'https://cert-08.pd.infn.it:8443/CREAM297543394\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM297543394 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM297543394 2014-08-18 14:31:26.671303 Submit https://cert-08.pd.infn.it:8443/CREAM297543394 Left: 377 (at submission time:377) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM297543394 2014-08-18 14:32:18.962921 Exit https://cert-08.pd.infn.it:8443/CREAM536221059 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:32:19,316 DEBUG - Using certificate phttps://cert-08.pd.infn.it:8443/CREAM230581411 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM230581411 2014-08-18 14:28:25.724635 Submit https://cert-08.pd.infn.it:8443/CREAM230581411 Left: 388 (at submission time:388) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM230581411 2014-08-18 14:29:23.710785 Exit https://cert-08.pd.infn.it:8443/CREAM813909815 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:29:24,209 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:29:24,232 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:29:24,232 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:29:24,232 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142924.log]\n', '2014-08-18 14:29:24,235 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:29:25,581 DEBUG - Will invoke JobStart for JobID [CREAM663358105]\n', 'https://cert-08.pd.infn.it:8443/CREAM663358105\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM663358105 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM663358105 2014-08-18 14:29:25.865880 Submit https://cert-08.pd.infn.it:8443/CREAM663358105 Left: 384 (at submission time:384) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM663358105 2014-08-18 14:31:24.367939 Exit https://cert-08.pd.infn.it:8443/CREAM266478431 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:31:24,857 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:31:24,903 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:31:24,903 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:31:24,903 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143124.log]\n', '2014-08-18 14:31:24,914 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:31:26,260 DEBUG - Will invoke JobStart for JobID [CREAM913284491]\n', 'https://cert-08.pd.infn.it:8443/CREAM913284491\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM913284491 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM913284491 2014-08-18 14:31:26.657278 Submit https://cert-08.pd.infn.it:8443/CREAM913284491 Left: 376 (at submission time:376) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM913284491 2014-08-18 14:32:24.274911 Exit https://cert-08.pd.infn.it:8443/CREAM196683343 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:32:24,858 DEBUG - Using certificate phttps://cert-08.pd.infn.it:8443/CREAM776419989 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM776419989 2014-08-18 14:29:19.348298 Submit https://cert-08.pd.infn.it:8443/CREAM776419989 Left: 386 (at submission time:386) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM776419989 2014-08-18 14:30:18.100384 Exit https://cert-08.pd.infn.it:8443/CREAM835565099 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:30:18,520 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:30:18,568 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:30:18,568 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:30:18,568 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143018.log]\n', '2014-08-18 14:30:18,574 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:30:19,556 DEBUG - Will invoke JobStart for JobID [CREAM716647113]\n', 'https://cert-08.pd.infn.it:8443/CREAM716647113\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM716647113 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM716647113 2014-08-18 14:30:19.833190 Submit https://cert-08.pd.infn.it:8443/CREAM716647113 Left: 382 (at submission time:382) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM716647113 2014-08-18 14:31:24.439054 Exit https://cert-08.pd.infn.it:8443/CREAM269172097 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:31:24,884 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:31:24,924 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:31:24,924 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:31:24,924 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143124.log]\n', '2014-08-18 14:31:24,933 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:31:26,778 DEBUG - Will invoke JobStart for JobID [CREAM712803438]\n', 'https://cert-08.pd.infn.it:8443/CREAM712803438\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM712803438 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM712803438 2014-08-18 14:31:27.042634 Submit https://cert-08.pd.infn.it:8443/CREAM712803438 Left: 375 (at submission time:375) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM712803438 2014-08-18 14:32:25.686674 Exit https://cert-08.pd.infn.it:8443/CREAM435681034 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:32:26,370 DEBUG - Using certificate phttps://cert-08.pd.infn.it:8443/CREAM367766627 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM367766627 2014-08-18 14:28:19.234251 Submit https://cert-08.pd.infn.it:8443/CREAM367766627 Left: 390 (at submission time:390) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM367766627 2014-08-18 14:30:24.112356 Exit https://cert-08.pd.infn.it:8443/CREAM946199175 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:30:24,758 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:30:24,778 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:30:24,778 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:30:24,778 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143024.log]\n', '2014-08-18 14:30:24,781 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:30:25,946 DEBUG - Will invoke JobStart for JobID [CREAM730453176]\n', 'https://cert-08.pd.infn.it:8443/CREAM730453176\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM730453176 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM730453176 2014-08-18 14:30:26.382136 Submit https://cert-08.pd.infn.it:8443/CREAM730453176 Left: 380 (at submission time:380) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM730453176 2014-08-18 14:30:26.757280 Exit https://cert-08.pd.infn.it:8443/CREAM615110654 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:30:27,458 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:30:27,479 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:30:27,479 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:30:27,479 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143027.log]\n', '2014-08-18 14:30:27,489 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:30:28,939 DEBUG - Will invoke JobStart for JobID [CREAM405065007]\n', 'https://cert-08.pd.infn.it:8443/CREAM405065007\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM405065007 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM405065007 2014-08-18 14:30:29.238096 Submit https://cert-08.pd.infn.it:8443/CREAM405065007 Left: 379 (at submission time:379) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM405065007 2014-08-18 14:32:25.808218 Exit https://cert-08.pd.infn.it:8443/CREAM880647470 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:32:26,431 DEBUG - Using certificate phttps://cert-08.pd.infn.it:8443/CREAM876800901 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM876800901 2014-08-18 14:28:27.486059 Submit https://cert-08.pd.infn.it:8443/CREAM876800901 Left: 387 (at submission time:387) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM876800901 2014-08-18 14:29:24.948973 Exit https://cert-08.pd.infn.it:8443/CREAM161096896 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:29:25,519 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:29:25,541 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:29:25,541 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:29:25,541 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-142925.log]\n', '2014-08-18 14:29:25,544 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:29:26,931 DEBUG - Will invoke JobStart for JobID [CREAM416201091]\n', 'https://cert-08.pd.infn.it:8443/CREAM416201091\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM416201091 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM416201091 2014-08-18 14:29:27.283260 Submit https://cert-08.pd.infn.it:8443/CREAM416201091 Left: 383 (at submission time:383) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM416201091 2014-08-18 14:31:18.534429 Exit https://cert-08.pd.infn.it:8443/CREAM665080061 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:31:18,918 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:31:18,949 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:31:18,949 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:31:18,949 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143118.log]\n', '2014-08-18 14:31:18,965 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:31:20,203 DEBUG - Will invoke JobStart for JobID [CREAM908592877]\n', 'https://cert-08.pd.infn.it:8443/CREAM908592877\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM908592877 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM908592877 2014-08-18 14:31:20.429074 Submit https://cert-08.pd.infn.it:8443/CREAM908592877 Left: 378 (at submission time:378) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM908592877 2014-08-18 14:33:24.537977 Exit https://cert-08.pd.infn.it:8443/CREAM259785211 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:33:25,349 DEBUG - Using certificate p Cancelled: 0 Done-Ok: 602 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 602/1000 2014-08-18 14:31:20.433455 Submitted: 622 Running: 20 Cancelled: 0 Done-Ok: 602 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 602/1000 2014-08-18 14:31:24.319608 Submitted: 622 Running: 19 Cancelled: 0 Done-Ok: 603 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 603/1000 2014-08-18 14:31:24.369501 Submitted: 622 Running: 18 Cancelled: 0 Done-Ok: 604 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 604/1000 2014-08-18 14:31:24.441835 Submitted: 622 Running: 17 Cancelled: 0 Done-Ok: 605 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 605/1000 2014-08-18 14:31:26.658920 Submitted: 623 Running: 18 Cancelled: 0 Done-Ok: 605 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 605/1000 2014-08-18 14:31:26.673400 Submitted: 624 Running: 19 Cancelled: 0 Done-Ok: 605 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 605/1000 2014-08-18 14:31:27.044921 Submitted: 625 Running: 20 Cancelled: 0 Done-Ok: 605 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 605/1000 2014-08-18 14:32:18.966385 Submitted: 625 Running: 19 Cancelled: 0 Done-Ok: 606 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 606/1000 2014-08-18 14:32:20.806790 Submitted: 626 Running: 20 Cancelled: 0 Done-Ok: 606 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 606/1000 2014-08-18 14:32:24.277214 Submitted: 626 Running: 19 Cancelled: 0 Done-Ok: 607 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 607/1000 2014-08-18 14:32:25.690365 Submitted: 626 Running: 18 Cancelled: 0 Done-Ok: 608 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 608/1000 2014-08-18 14:32:25.811196 Submitted: 626 Running: 17 Cancelled: 0 Done-Ok: 609 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 609/1000 2014-08-18 14:32:26.271715 Submitted: 627 Running: 18 Cancelled: 0 Done-Ok: 609 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 609/1000 2014-08-18 14:32:28.145179 Submitted: 628 Running: 19 Cancelled: 0 Done-Ok: 609 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 609/1000 2014-08-18 14:32:28.276237 Submitted: 629 Running: 20 Cancelled: 0 Done-Ok: 609 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 609/1000 2014-08-18 14:33:19.510646 Submitted: 629 Running: 19 Cancelled: 0 Done-Ok: 610 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 610/1000 2014-08-18 14:33:21.316959 Submitted: 630 Running: 20 Cancelled: 0 Done-Ok: 610 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 610/1000 2014-08-18 14:33:24.539483 Submitted: 630 Running: 19 Cancelled: 0 Done-Ok: 611 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 611/1000 2014-08-18 14:33:26.192456 Submitted: 630 Running: 18 Cancelled: 0 Done-Ok: 612 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 612/1000 2014-08-18 14:33:26.881083 Submitted: 631 Runningroxy file [/tmp/x509up_u500]\n', '2014-08-18 14:32:24,882 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:32:24,882 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:32:24,882 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143224.log]\n', '2014-08-18 14:32:24,888 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:32:25,911 DEBUG - Will invoke JobStart for JobID [CREAM014705689]\n', 'https://cert-08.pd.infn.it:8443/CREAM014705689\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM014705689 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM014705689 2014-08-18 14:32:26.268948 Submit https://cert-08.pd.infn.it:8443/CREAM014705689 Left: 373 (at submission time:373) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM014705689 2014-08-18 14:33:26.190869 Exit https://cert-08.pd.infn.it:8443/CREAM230581411 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:33:26,942 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:33:26,963 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:33:26,963 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:33:26,964 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143326.log]\n', '2014-08-18 14:33:26,973 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:33:28,269 DEBUG - Will invoke JobStart for JobID [CREAM220256801]\n', 'https://cert-08.pd.infn.it:8443/CREAM220256801\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM220256801 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM220256801 2014-08-18 14:33:28.737745 Submit https://cert-08.pd.infn.it:8443/CREAM220256801 Left: 368 (at submission time:368) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM220256801 2014-08-18 14:34:25.775124 Exit https://cert-08.pd.infn.it:8443/CREAM663358105 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:34:26,317 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:34:26,340 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:34:26,340 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:34:26,340 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143426.log]\n', '2014-08-18 14:34:26,343 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:34:27,786 DEBUG - Will invoke JobStart for JobIDroxy file [/tmp/x509up_u500]\n', '2014-08-18 14:33:25,372 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:33:25,373 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:33:25,373 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143325.log]\n', '2014-08-18 14:33:25,376 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:33:26,669 DEBUG - Will invoke JobStart for JobID [CREAM375989310]\n', 'https://cert-08.pd.infn.it:8443/CREAM375989310\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM375989310 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM375989310 2014-08-18 14:33:26.879767 Submit https://cert-08.pd.infn.it:8443/CREAM375989310 Left: 369 (at submission time:369) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM375989310 2014-08-18 14:33:27.182483 Exit https://cert-08.pd.infn.it:8443/CREAM876800901 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:33:28,185 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:33:28,213 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:33:28,213 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:33:28,213 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143328.log]\n', '2014-08-18 14:33:28,217 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:33:29,673 DEBUG - Will invoke JobStart for JobID [CREAM968160518]\n', 'https://cert-08.pd.infn.it:8443/CREAM968160518\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM968160518 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM968160518 2014-08-18 14:33:29.974149 Submit https://cert-08.pd.infn.it:8443/CREAM968160518 Left: 367 (at submission time:367) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM968160518 2014-08-18 14:34:26.127166 Exit https://cert-08.pd.infn.it:8443/CREAM416201091 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:34:26,932 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:34:26,957 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:34:26,957 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:34:26,957 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143426.log]\n', '2014-08-18 14:34:26,960 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:34:28,490 DEBUG - Will invoke JobStart for JobIDroxy file [/tmp/x509up_u500]\n', '2014-08-18 14:32:26,393 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:32:26,393 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:32:26,393 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143226.log]\n', '2014-08-18 14:32:26,397 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:32:27,807 DEBUG - Will invoke JobStart for JobID [CREAM920863006]\n', 'https://cert-08.pd.infn.it:8443/CREAM920863006\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM920863006 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM920863006 2014-08-18 14:32:28.139687 Submit https://cert-08.pd.infn.it:8443/CREAM920863006 Left: 372 (at submission time:372) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM920863006 2014-08-18 14:34:20.125575 Exit https://cert-08.pd.infn.it:8443/CREAM776419989 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:34:20,460 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:34:20,487 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:34:20,488 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:34:20,488 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143420.log]\n', '2014-08-18 14:34:20,493 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:34:21,427 DEBUG - Will invoke JobStart for JobID [CREAM920817351]\n', 'https://cert-08.pd.infn.it:8443/CREAM920817351\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM920817351 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM920817351 2014-08-18 14:34:21.770702 Submit https://cert-08.pd.infn.it:8443/CREAM920817351 Left: 366 (at submission time:366) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM920817351 2014-08-18 14:35:20.543159 Exit https://cert-08.pd.infn.it:8443/CREAM716647113 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:35:20,895 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:35:20,915 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:35:20,915 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:35:20,915 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143520.log]\n', '2014-08-18 14:35:20,918 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:35:21,967 DEBUG - Will invoke JobStart for JobIDroxy file [/tmp/x509up_u500]\n', '2014-08-18 14:32:19,357 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:32:19,357 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:32:19,357 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143219.log]\n', '2014-08-18 14:32:19,362 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:32:20,403 DEBUG - Will invoke JobStart for JobID [CREAM549635680]\n', 'https://cert-08.pd.infn.it:8443/CREAM549635680\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM549635680 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM549635680 2014-08-18 14:32:20.804635 Submit https://cert-08.pd.infn.it:8443/CREAM549635680 Left: 374 (at submission time:374) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM549635680 2014-08-18 14:34:25.317038 Exit https://cert-08.pd.infn.it:8443/CREAM953780305 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:34:26,135 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:34:26,175 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:34:26,175 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:34:26,175 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143426.log]\n', '2014-08-18 14:34:26,180 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:34:27,269 DEBUG - Will invoke JobStart for JobID [CREAM518128661]\n', 'https://cert-08.pd.infn.it:8443/CREAM518128661\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM518128661 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM518128661 2014-08-18 14:34:27.764612 Submit https://cert-08.pd.infn.it:8443/CREAM518128661 Left: 365 (at submission time:365) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM518128661 2014-08-18 14:35:25.679185 Exit https://cert-08.pd.infn.it:8443/CREAM640783101 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:35:26,619 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:35:26,643 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:35:26,643 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:35:26,643 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143526.log]\n', '2014-08-18 14:35:26,649 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:35:27,694 DEBUG - Will invoke JobStart for JobIDroxy file [/tmp/x509up_u500]\n', '2014-08-18 14:32:26,470 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:32:26,470 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:32:26,470 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143226.log]\n', '2014-08-18 14:32:26,473 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:32:28,001 DEBUG - Will invoke JobStart for JobID [CREAM509767986]\n', 'https://cert-08.pd.infn.it:8443/CREAM509767986\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM509767986 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM509767986 2014-08-18 14:32:28.272431 Submit https://cert-08.pd.infn.it:8443/CREAM509767986 Left: 371 (at submission time:371) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM509767986 2014-08-18 14:33:19.508783 Exit https://cert-08.pd.infn.it:8443/CREAM367766627 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:33:19,831 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:33:19,855 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:33:19,856 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:33:19,856 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143319.log]\n', '2014-08-18 14:33:19,863 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:33:21,063 DEBUG - Will invoke JobStart for JobID [CREAM632818395]\n', 'https://cert-08.pd.infn.it:8443/CREAM632818395\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM632818395 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM632818395 2014-08-18 14:33:21.314404 Submit https://cert-08.pd.infn.it:8443/CREAM632818395 Left: 370 (at submission time:370) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM632818395 2014-08-18 14:35:26.524853 Exit https://cert-08.pd.infn.it:8443/CREAM405065007 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:35:26,743 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:35:26,770 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:35:26,770 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:35:26,770 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143526.log]\n', '2014-08-18 14:35:26,779 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:35:28,091 DEBUG - Will invoke JobStart for JobID: 19 Cancelled: 0 Done-Ok: 612 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 612/1000 2014-08-18 14:33:27.184746 Submitted: 631 Running: 18 Cancelled: 0 Done-Ok: 613 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 613/1000 2014-08-18 14:33:28.738848 Submitted: 632 Running: 19 Cancelled: 0 Done-Ok: 613 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 613/1000 2014-08-18 14:33:29.978698 Submitted: 633 Running: 20 Cancelled: 0 Done-Ok: 613 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 613/1000 2014-08-18 14:34:20.128096 Submitted: 633 Running: 19 Cancelled: 0 Done-Ok: 614 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 614/1000 2014-08-18 14:34:21.771603 Submitted: 634 Running: 20 Cancelled: 0 Done-Ok: 614 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 614/1000 2014-08-18 14:34:25.320312 Submitted: 634 Running: 19 Cancelled: 0 Done-Ok: 615 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 615/1000 2014-08-18 14:34:25.776707 Submitted: 634 Running: 18 Cancelled: 0 Done-Ok: 616 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 616/1000 2014-08-18 14:34:26.129907 Submitted: 634 Running: 17 Cancelled: 0 Done-Ok: 617 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 617/1000 2014-08-18 14:34:27.766125 Submitted: 635 Running: 18 Cancelled: 0 Done-Ok: 617 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 617/1000 2014-08-18 14:34:27.967825 Submitted: 636 Running: 19 Cancelled: 0 Done-Ok: 617 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 617/1000 2014-08-18 14:34:28.750705 Submitted: 637 Running: 20 Cancelled: 0 Done-Ok: 617 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 617/1000 2014-08-18 14:35:20.548501 Submitted: 637 Running: 19 Cancelled: 0 Done-Ok: 618 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 618/1000 2014-08-18 14:35:22.306968 Submitted: 638 Running: 20 Cancelled: 0 Done-Ok: 618 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 618/1000 2014-08-18 14:35:25.681629 Submitted: 638 Running: 19 Cancelled: 0 Done-Ok: 619 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 619/1000 2014-08-18 14:35:26.528865 Submitted: 638 Running: 18 Cancelled: 0 Done-Ok: 620 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 620/1000 2014-08-18 14:35:28.111829 Submitted: 639 Running: 19 Cancelled: 0 Done-Ok: 620 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 620/1000 2014-08-18 14:35:28.480616 Submitted: 640 Running: 20 Cancelled: 0 Done-Ok: 620 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 620/1000 2014-08-18 14:35:29.006334 Submitted: 640 Running: 19 Cancelled: 0 Done-Ok: 621 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 621/1000 2014-08-18 14:35:31.194075 Submitted: 641 Running: 20 Cancelled: 0 Done-Ok: 621 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 621/1000 2014-08-18 14:36:21.120835 Submitted: 641 Run [CREAM349825894]\n', 'https://cert-08.pd.infn.it:8443/CREAM349825894\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM349825894 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM349825894 2014-08-18 14:35:28.477950 Submit https://cert-08.pd.infn.it:8443/CREAM349825894 Left: 360 (at submission time:360) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM349825894 2014-08-18 14:35:29.004991 Exit https://cert-08.pd.infn.it:8443/CREAM730453176 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:35:29,751 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:35:29,770 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:35:29,770 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:35:29,770 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143529.log]\n', '2014-08-18 14:35:29,772 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:35:30,793 DEBUG - Will invoke JobStart for JobID [CREAM789940350]\n', 'https://cert-08.pd.infn.it:8443/CREAM789940350\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM789940350 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM789940350 2014-08-18 14:35:31.189487 Submit https://cert-08.pd.infn.it:8443/CREAM789940350 Left: 359 (at submission time:359) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM789940350 2014-08-18 14:37:27.195630 Exit https://cert-08.pd.infn.it:8443/CREAM509767986 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:37:27,781 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:37:27,805 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:37:27,805 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:37:27,805 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143727.log]\n', '2014-08-18 14:37:27,808 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:37:29,423 DEBUG - Will invoke JobStart for JobID [CREAM984328939]\n', 'https://cert-08.pd.infn.it:8443/CREAM984328939\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM984328939 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM984328939 2014-08-18 14:37:29.814741 Submit https://cert-08.pd.infn.it:8443/CREAM984328939 Left: 352 (at submission time:352) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM984328939 2014-08-18 14:38:21.781718 Exit https://cert-08.pd.infn.it:8443/CREAM632818395 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D [CREAM997027070]\n', 'https://cert-08.pd.infn.it:8443/CREAM997027070\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM997027070 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM997027070 2014-08-18 14:34:27.963200 Submit https://cert-08.pd.infn.it:8443/CREAM997027070 Left: 364 (at submission time:364) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM997027070 2014-08-18 14:36:28.087355 Exit https://cert-08.pd.infn.it:8443/CREAM913284491 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:36:29,057 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:36:29,080 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:36:29,081 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:36:29,081 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143629.log]\n', '2014-08-18 14:36:29,090 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:36:30,462 DEBUG - Will invoke JobStart for JobID [CREAM761804837]\n', 'https://cert-08.pd.infn.it:8443/CREAM761804837\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM761804837 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM761804837 2014-08-18 14:36:30.706012 Submit https://cert-08.pd.infn.it:8443/CREAM761804837 Left: 355 (at submission time:355) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM761804837 2014-08-18 14:37:27.081373 Exit https://cert-08.pd.infn.it:8443/CREAM014705689 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:37:27,651 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:37:27,684 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:37:27,685 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:37:27,685 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143727.log]\n', '2014-08-18 14:37:27,694 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:37:28,866 DEBUG - Will invoke JobStart for JobID [CREAM699116446]\n', 'https://cert-08.pd.infn.it:8443/CREAM699116446\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM699116446 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM699116446 2014-08-18 14:37:29.490670 Submit https://cert-08.pd.infn.it:8443/CREAM699116446 Left: 353 (at submission time:353) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM699116446 2014-08-18 14:38:28.057725 Exit https://cert-08.pd.infn.it:8443/CREAM220256801 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D ning: 19 Cancelled: 0 Done-Ok: 622 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 622/1000 2014-08-18 14:36:22.847823 Submitted: 642 Running: 20 Cancelled: 0 Done-Ok: 622 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 622/1000 2014-08-18 14:36:25.884162 Submitted: 642 Running: 19 Cancelled: 0 Done-Ok: 623 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 623/1000 2014-08-18 14:36:27.495399 Submitted: 642 Running: 18 Cancelled: 0 Done-Ok: 624 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 624/1000 2014-08-18 14:36:28.089862 Submitted: 642 Running: 17 Cancelled: 0 Done-Ok: 625 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 625/1000 2014-08-18 14:36:28.470469 Submitted: 643 Running: 18 Cancelled: 0 Done-Ok: 625 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 625/1000 2014-08-18 14:36:29.906926 Submitted: 644 Running: 19 Cancelled: 0 Done-Ok: 625 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 625/1000 2014-08-18 14:36:30.708975 Submitted: 645 Running: 20 Cancelled: 0 Done-Ok: 625 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 625/1000 2014-08-18 14:37:21.379646 Submitted: 645 Running: 19 Cancelled: 0 Done-Ok: 626 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 626/1000 2014-08-18 14:37:23.171802 Submitted: 646 Running: 20 Cancelled: 0 Done-Ok: 626 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 626/1000 2014-08-18 14:37:27.084365 Submitted: 646 Running: 19 Cancelled: 0 Done-Ok: 627 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 627/1000 2014-08-18 14:37:27.198349 Submitted: 646 Running: 18 Cancelled: 0 Done-Ok: 628 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 628/1000 2014-08-18 14:37:27.675838 Submitted: 646 Running: 17 Cancelled: 0 Done-Ok: 629 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 629/1000 2014-08-18 14:37:29.493784 Submitted: 647 Running: 18 Cancelled: 0 Done-Ok: 629 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 629/1000 2014-08-18 14:37:29.819438 Submitted: 648 Running: 19 Cancelled: 0 Done-Ok: 629 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 629/1000 2014-08-18 14:37:30.331017 Submitted: 649 Running: 20 Cancelled: 0 Done-Ok: 629 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 629/1000 2014-08-18 14:38:21.782970 Submitted: 649 Running: 19 Cancelled: 0 Done-Ok: 630 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 630/1000 2014-08-18 14:38:23.964643 Submitted: 650 Running: 20 Cancelled: 0 Done-Ok: 630 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 630/1000 2014-08-18 14:38:27.140773 Submitted: 650 Running: 19 Cancelled: 0 Done-Ok: 631 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 631/1000 2014-08-18 14:38:28.059579 Submitted: 650 Running: 18 Cancelled: 0 Done-Ok: 632 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 632/1000 2014-08-18 14:38:29.508882 Submitted: 651 [CREAM362990314]\n', 'https://cert-08.pd.infn.it:8443/CREAM362990314\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM362990314 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM362990314 2014-08-18 14:34:28.749415 Submit https://cert-08.pd.infn.it:8443/CREAM362990314 Left: 363 (at submission time:363) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM362990314 2014-08-18 14:36:21.118031 Exit https://cert-08.pd.infn.it:8443/CREAM908592877 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:36:21,455 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:36:21,478 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:36:21,478 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:36:21,479 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143621.log]\n', '2014-08-18 14:36:21,484 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:36:22,585 DEBUG - Will invoke JobStart for JobID [CREAM039018793]\n', 'https://cert-08.pd.infn.it:8443/CREAM039018793\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM039018793 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM039018793 2014-08-18 14:36:22.845467 Submit https://cert-08.pd.infn.it:8443/CREAM039018793 Left: 358 (at submission time:358) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM039018793 2014-08-18 14:38:27.136038 Exit https://cert-08.pd.infn.it:8443/CREAM375989310 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:38:27,908 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:38:27,935 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:38:27,935 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:38:27,936 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143827.log]\n', '2014-08-18 14:38:27,938 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:38:29,141 DEBUG - Will invoke JobStart for JobID [CREAM397855889]\n', 'https://cert-08.pd.infn.it:8443/CREAM397855889\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM397855889 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM397855889 2014-08-18 14:38:29.504611 Submit https://cert-08.pd.infn.it:8443/CREAM397855889 Left: 349 (at submission time:349) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM397855889 2014-08-18 14:38:29.856729 Exit https://cert-08.pd.infn.it:8443/CREAM968160518 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D [CREAM173644264]\n', 'https://cert-08.pd.infn.it:8443/CREAM173644264\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM173644264 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM173644264 2014-08-18 14:35:22.303471 Submit https://cert-08.pd.infn.it:8443/CREAM173644264 Left: 362 (at submission time:362) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM173644264 2014-08-18 14:36:27.493727 Exit https://cert-08.pd.infn.it:8443/CREAM712803438 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:36:28,296 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:36:28,335 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:36:28,335 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:36:28,336 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143628.log]\n', '2014-08-18 14:36:28,339 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:36:29,725 DEBUG - Will invoke JobStart for JobID [CREAM007596556]\n', 'https://cert-08.pd.infn.it:8443/CREAM007596556\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM007596556 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM007596556 2014-08-18 14:36:29.904245 Submit https://cert-08.pd.infn.it:8443/CREAM007596556 Left: 356 (at submission time:356) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM007596556 2014-08-18 14:37:27.672837 Exit https://cert-08.pd.infn.it:8443/CREAM920863006 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:37:28,508 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:37:28,533 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:37:28,533 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:37:28,533 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143728.log]\n', '2014-08-18 14:37:28,536 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:37:30,123 DEBUG - Will invoke JobStart for JobID [CREAM276772664]\n', 'https://cert-08.pd.infn.it:8443/CREAM276772664\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM276772664 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM276772664 2014-08-18 14:37:30.328030 Submit https://cert-08.pd.infn.it:8443/CREAM276772664 Left: 351 (at submission time:351) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM276772664 2014-08-18 14:39:21.935457 Exit https://cert-08.pd.infn.it:8443/CREAM920817351 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D [CREAM044397604]\n', 'https://cert-08.pd.infn.it:8443/CREAM044397604\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM044397604 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM044397604 2014-08-18 14:35:28.109569 Submit https://cert-08.pd.infn.it:8443/CREAM044397604 Left: 361 (at submission time:361) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM044397604 2014-08-18 14:36:25.880937 Exit https://cert-08.pd.infn.it:8443/CREAM297543394 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:36:26,659 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:36:26,682 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:36:26,682 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:36:26,683 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143626.log]\n', '2014-08-18 14:36:26,685 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:36:28,267 DEBUG - Will invoke JobStart for JobID [CREAM901342106]\n', 'https://cert-08.pd.infn.it:8443/CREAM901342106\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM901342106 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM901342106 2014-08-18 14:36:28.469361 Submit https://cert-08.pd.infn.it:8443/CREAM901342106 Left: 357 (at submission time:357) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM901342106 2014-08-18 14:37:21.377422 Exit https://cert-08.pd.infn.it:8443/CREAM549635680 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:37:21,792 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:37:21,819 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:37:21,819 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:37:21,820 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143721.log]\n', '2014-08-18 14:37:21,822 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:37:22,934 DEBUG - Will invoke JobStart for JobID [CREAM540835583]\n', 'https://cert-08.pd.infn.it:8443/CREAM540835583\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM540835583 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM540835583 2014-08-18 14:37:23.169073 Submit https://cert-08.pd.infn.it:8443/CREAM540835583 Left: 354 (at submission time:354) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM540835583 2014-08-18 14:39:28.030185 Exit https://cert-08.pd.infn.it:8443/CREAM518128661 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:38:22,236 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:38:22,267 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:38:22,267 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:38:22,267 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143822.log]\n', '2014-08-18 14:38:22,280 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:38:23,741 DEBUG - Will invoke JobStart for JobID [CREAM570663146]\n', 'https://cert-08.pd.infn.it:8443/CREAM570663146\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM570663146 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM570663146 2014-08-18 14:38:23.961785 Submit https://cert-08.pd.infn.it:8443/CREAM570663146 Left: 350 (at submission time:350) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM570663146 2014-08-18 14:40:29.105770 Exit https://cert-08.pd.infn.it:8443/CREAM349825894 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:40:29,790 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:40:29,819 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:40:29,819 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:40:29,819 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144029.log]\n', '2014-08-18 14:40:29,825 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:40:31,128 DEBUG - Will invoke JobStart for JobID [CREAM257294439]\n', 'https://cert-08.pd.infn.it:8443/CREAM257294439\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM257294439 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM257294439 2014-08-18 14:40:31.429637 Submit https://cert-08.pd.infn.it:8443/CREAM257294439 Left: 340 (at submission time:340) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM257294439 2014-08-18 14:40:31.821096 Exit https://cert-08.pd.infn.it:8443/CREAM789940350 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:40:32,541 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:40:32,566 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:40:32,566 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:40:32,566 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144032.log]\n', '2014-08-18 14:40:32,569 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = Running: 19 Cancelled: 0 Done-Ok: 632 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 632/1000 2014-08-18 14:38:29.857696 Submitted: 651 Running: 18 Cancelled: 0 Done-Ok: 633 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 633/1000 2014-08-18 14:38:30.687453 Submitted: 652 Running: 19 Cancelled: 0 Done-Ok: 633 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 633/1000 2014-08-18 14:38:32.188844 Submitted: 653 Running: 20 Cancelled: 0 Done-Ok: 633 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 633/1000 2014-08-18 14:39:21.936746 Submitted: 653 Running: 19 Cancelled: 0 Done-Ok: 634 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 634/1000 2014-08-18 14:39:23.850873 Submitted: 654 Running: 20 Cancelled: 0 Done-Ok: 634 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 634/1000 2014-08-18 14:39:28.033693 Submitted: 654 Running: 19 Cancelled: 0 Done-Ok: 635 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 635/1000 2014-08-18 14:39:28.224671 Submitted: 654 Running: 18 Cancelled: 0 Done-Ok: 636 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 636/1000 2014-08-18 14:39:29.621216 Submitted: 654 Running: 17 Cancelled: 0 Done-Ok: 637 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 637/1000 2014-08-18 14:39:30.560664 Submitted: 655 Running: 18 Cancelled: 0 Done-Ok: 637 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 637/1000 2014-08-18 14:39:30.970782 Submitted: 656 Running: 19 Cancelled: 0 Done-Ok: 637 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 637/1000 2014-08-18 14:39:32.212131 Submitted: 657 Running: 20 Cancelled: 0 Done-Ok: 637 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 637/1000 2014-08-18 14:40:23.163239 Submitted: 657 Running: 19 Cancelled: 0 Done-Ok: 638 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 638/1000 2014-08-18 14:40:24.999640 Submitted: 658 Running: 20 Cancelled: 0 Done-Ok: 638 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 638/1000 2014-08-18 14:40:28.198419 Submitted: 658 Running: 19 Cancelled: 0 Done-Ok: 639 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 639/1000 2014-08-18 14:40:29.107980 Submitted: 658 Running: 18 Cancelled: 0 Done-Ok: 640 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 640/1000 2014-08-18 14:40:30.653023 Submitted: 659 Running: 19 Cancelled: 0 Done-Ok: 640 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 640/1000 2014-08-18 14:40:31.432224 Submitted: 660 Running: 20 Cancelled: 0 Done-Ok: 640 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 640/1000 2014-08-18 14:40:31.822857 Submitted: 660 Running: 19 Cancelled: 0 Done-Ok: 641 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 641/1000 2014-08-18 14:40:34.456856 Submitted: 661 Running: 20 Cancelled: 0 Done-Ok: 641 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 641/1000 2014-08-18 14:41:23.657398 Submitted:DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:38:30,496 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:38:30,523 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:38:30,523 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:38:30,523 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143830.log]\n', '2014-08-18 14:38:30,526 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:38:31,788 DEBUG - Will invoke JobStart for JobID [CREAM483196633]\n', 'https://cert-08.pd.infn.it:8443/CREAM483196633\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM483196633 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM483196633 2014-08-18 14:38:32.187628 Submit https://cert-08.pd.infn.it:8443/CREAM483196633 Left: 347 (at submission time:347) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM483196633 2014-08-18 14:39:29.619583 Exit https://cert-08.pd.infn.it:8443/CREAM362990314 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:39:30,645 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:39:30,675 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:39:30,675 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:39:30,675 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143930.log]\n', '2014-08-18 14:39:30,678 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:39:31,938 DEBUG - Will invoke JobStart for JobID [CREAM259838948]\n', 'https://cert-08.pd.infn.it:8443/CREAM259838948\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM259838948 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM259838948 2014-08-18 14:39:32.210319 Submit https://cert-08.pd.infn.it:8443/CREAM259838948 Left: 343 (at submission time:343) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM259838948 2014-08-18 14:41:23.653122 Exit https://cert-08.pd.infn.it:8443/CREAM039018793 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:41:23,971 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:41:23,992 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:41:23,992 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:41:23,992 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144123.log]\n', '2014-08-18 14:41:24,004 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:39:28,613 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:39:28,637 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:39:28,637 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:39:28,637 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143928.log]\n', '2014-08-18 14:39:28,642 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:39:30,255 DEBUG - Will invoke JobStart for JobID [CREAM115995802]\n', 'https://cert-08.pd.infn.it:8443/CREAM115995802\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM115995802 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM115995802 2014-08-18 14:39:30.559187 Submit https://cert-08.pd.infn.it:8443/CREAM115995802 Left: 345 (at submission time:345) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM115995802 2014-08-18 14:40:28.194425 Exit https://cert-08.pd.infn.it:8443/CREAM044397604 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:40:28,947 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:40:28,967 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:40:28,967 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:40:28,967 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144028.log]\n', '2014-08-18 14:40:28,971 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:40:30,300 DEBUG - Will invoke JobStart for JobID [CREAM228135233]\n', 'https://cert-08.pd.infn.it:8443/CREAM228135233\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM228135233 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM228135233 2014-08-18 14:40:30.651741 Submit https://cert-08.pd.infn.it:8443/CREAM228135233 Left: 341 (at submission time:341) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM228135233 2014-08-18 14:41:28.653846 Exit https://cert-08.pd.infn.it:8443/CREAM901342106 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:41:29,119 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:41:29,145 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:41:29,145 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:41:29,145 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144129.log]\n', '2014-08-18 14:41:29,148 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:39:22,414 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:39:22,442 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:39:22,442 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:39:22,442 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143922.log]\n', '2014-08-18 14:39:22,448 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:39:23,638 DEBUG - Will invoke JobStart for JobID [CREAM968935687]\n', 'https://cert-08.pd.infn.it:8443/CREAM968935687\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM968935687 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM968935687 2014-08-18 14:39:23.849178 Submit https://cert-08.pd.infn.it:8443/CREAM968935687 Left: 346 (at submission time:346) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM968935687 2014-08-18 14:40:23.161688 Exit https://cert-08.pd.infn.it:8443/CREAM173644264 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:40:23,513 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:40:23,543 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:40:23,543 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:40:23,543 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144023.log]\n', '2014-08-18 14:40:23,546 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:40:24,794 DEBUG - Will invoke JobStart for JobID [CREAM242755234]\n', 'https://cert-08.pd.infn.it:8443/CREAM242755234\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM242755234 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM242755234 2014-08-18 14:40:24.997873 Submit https://cert-08.pd.infn.it:8443/CREAM242755234 Left: 342 (at submission time:342) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM242755234 2014-08-18 14:41:29.079866 Exit https://cert-08.pd.infn.it:8443/CREAM007596556 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:41:29,898 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:41:29,925 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:41:29,926 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:41:29,926 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144129.log]\n', '2014-08-18 14:41:29,929 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:38:28,982 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:38:29,021 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:38:29,021 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:38:29,021 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143829.log]\n', '2014-08-18 14:38:29,025 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:38:30,377 DEBUG - Will invoke JobStart for JobID [CREAM489566078]\n', 'https://cert-08.pd.infn.it:8443/CREAM489566078\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM489566078 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM489566078 2014-08-18 14:38:30.685926 Submit https://cert-08.pd.infn.it:8443/CREAM489566078 Left: 348 (at submission time:348) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM489566078 2014-08-18 14:39:28.222476 Exit https://cert-08.pd.infn.it:8443/CREAM997027070 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:39:29,259 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:39:29,283 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:39:29,283 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:39:29,283 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-143929.log]\n', '2014-08-18 14:39:29,286 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:39:30,740 DEBUG - Will invoke JobStart for JobID [CREAM863221186]\n', 'https://cert-08.pd.infn.it:8443/CREAM863221186\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM863221186 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM863221186 2014-08-18 14:39:30.969385 Submit https://cert-08.pd.infn.it:8443/CREAM863221186 Left: 344 (at submission time:344) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM863221186 2014-08-18 14:41:30.661021 Exit https://cert-08.pd.infn.it:8443/CREAM761804837 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:41:31,298 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:41:31,322 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:41:31,323 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:41:31,323 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144131.log]\n', '2014-08-18 14:41:31,326 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = 661 Running: 19 Cancelled: 0 Done-Ok: 642 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 642/1000 2014-08-18 14:41:25.601341 Submitted: 662 Running: 20 Cancelled: 0 Done-Ok: 642 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 642/1000 2014-08-18 14:41:28.657131 Submitted: 662 Running: 19 Cancelled: 0 Done-Ok: 643 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 643/1000 2014-08-18 14:41:29.083595 Submitted: 662 Running: 18 Cancelled: 0 Done-Ok: 644 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 644/1000 2014-08-18 14:41:30.662507 Submitted: 662 Running: 17 Cancelled: 0 Done-Ok: 645 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 645/1000 2014-08-18 14:41:30.801487 Submitted: 663 Running: 18 Cancelled: 0 Done-Ok: 645 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 645/1000 2014-08-18 14:41:31.780773 Submitted: 664 Running: 19 Cancelled: 0 Done-Ok: 645 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 645/1000 2014-08-18 14:41:32.834715 Submitted: 665 Running: 20 Cancelled: 0 Done-Ok: 645 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 645/1000 2014-08-18 14:42:23.451900 Submitted: 665 Running: 19 Cancelled: 0 Done-Ok: 646 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 646/1000 2014-08-18 14:42:25.122783 Submitted: 666 Running: 20 Cancelled: 0 Done-Ok: 646 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 646/1000 2014-08-18 14:42:28.692272 Submitted: 666 Running: 19 Cancelled: 0 Done-Ok: 647 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 647/1000 2014-08-18 14:42:29.846859 Submitted: 666 Running: 18 Cancelled: 0 Done-Ok: 648 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 648/1000 2014-08-18 14:42:30.610215 Submitted: 666 Running: 17 Cancelled: 0 Done-Ok: 649 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 649/1000 2014-08-18 14:42:31.340974 Submitted: 667 Running: 18 Cancelled: 0 Done-Ok: 649 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 649/1000 2014-08-18 14:42:32.346630 Submitted: 668 Running: 19 Cancelled: 0 Done-Ok: 649 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 649/1000 2014-08-18 14:42:33.035149 Submitted: 669 Running: 20 Cancelled: 0 Done-Ok: 649 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 649/1000 2014-08-18 14:43:24.261720 Submitted: 669 Running: 19 Cancelled: 0 Done-Ok: 650 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 650/1000 2014-08-18 14:43:26.136769 Submitted: 670 Running: 20 Cancelled: 0 Done-Ok: 650 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 650/1000 2014-08-18 14:43:29.100844 Submitted: 670 Running: 19 Cancelled: 0 Done-Ok: 651 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 651/1000 2014-08-18 14:43:30.941744 Submitted: 670 Running: 18 Cancelled: 0 Done-Ok: 652 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 652/1000 2014-08-18 14:43:31.423953 Submit"normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:41:32,663 DEBUG - Will invoke JobStart for JobID [CREAM569931285]\n', 'https://cert-08.pd.infn.it:8443/CREAM569931285\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM569931285 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM569931285 2014-08-18 14:41:32.832944 Submit https://cert-08.pd.infn.it:8443/CREAM569931285 Left: 335 (at submission time:335) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM569931285 2014-08-18 14:42:28.686013 Exit https://cert-08.pd.infn.it:8443/CREAM699116446 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:42:29,237 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:42:29,260 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:42:29,260 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:42:29,260 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144229.log]\n', '2014-08-18 14:42:29,264 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:42:30,828 DEBUG - Will invoke JobStart for JobID [CREAM860268926]\n', 'https://cert-08.pd.infn.it:8443/CREAM860268926\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM860268926 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM860268926 2014-08-18 14:42:31.337980 Submit https://cert-08.pd.infn.it:8443/CREAM860268926 Left: 333 (at submission time:333) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM860268926 2014-08-18 14:43:30.938828 Exit https://cert-08.pd.infn.it:8443/CREAM489566078 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:43:31,591 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:43:31,616 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:43:31,616 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:43:31,616 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144331.log]\n', '2014-08-18 14:43:31,619 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:43:32,828 DEBUG - Will invoke JobStart for JobID [CREAM538587414]\n', 'https://cert-08.pd.infn.it:8443/CREAM538587414\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM538587414 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM538587414 2014-08-18 14:43:33.224706 Submit https://cert-08.pd.infn.it:8443/CREAM538587414 Left: 328 (at submission time:328) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM538587414 2014-08-18 14:44:30.590184 Exit https://cert-08.pd.infn.it:8443/CREAM863221186 Status: "DONE-"normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:41:25,204 DEBUG - Will invoke JobStart for JobID [CREAM758931220]\n', 'https://cert-08.pd.infn.it:8443/CREAM758931220\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM758931220 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM758931220 2014-08-18 14:41:25.598807 Submit https://cert-08.pd.infn.it:8443/CREAM758931220 Left: 338 (at submission time:338) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM758931220 2014-08-18 14:43:29.099112 Exit https://cert-08.pd.infn.it:8443/CREAM397855889 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:43:29,901 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:43:29,931 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:43:29,931 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:43:29,931 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144329.log]\n', '2014-08-18 14:43:29,938 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:43:31,144 DEBUG - Will invoke JobStart for JobID [CREAM233475751]\n', 'https://cert-08.pd.infn.it:8443/CREAM233475751\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM233475751 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM233475751 2014-08-18 14:43:31.420501 Submit https://cert-08.pd.infn.it:8443/CREAM233475751 Left: 329 (at submission time:329) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM233475751 2014-08-18 14:43:31.821820 Exit https://cert-08.pd.infn.it:8443/CREAM483196633 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:43:32,769 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:43:32,790 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:43:32,790 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:43:32,790 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144332.log]\n', '2014-08-18 14:43:32,794 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:43:34,203 DEBUG - Will invoke JobStart for JobID [CREAM744645305]\n', 'https://cert-08.pd.infn.it:8443/CREAM744645305\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM744645305 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM744645305 2014-08-18 14:43:34.521013 Submit https://cert-08.pd.infn.it:8443/CREAM744645305 Left: 327 (at submission time:327) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM744645305 2014-08-18 14:44:30.905482 Exit https://cert-08.pd.infn.it:8443/CREAM259838948 Status: "DONE-"normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:41:31,395 DEBUG - Will invoke JobStart for JobID [CREAM887955829]\n', 'https://cert-08.pd.infn.it:8443/CREAM887955829\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM887955829 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM887955829 2014-08-18 14:41:31.779003 Submit https://cert-08.pd.infn.it:8443/CREAM887955829 Left: 336 (at submission time:336) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM887955829 2014-08-18 14:42:29.845659 Exit https://cert-08.pd.infn.it:8443/CREAM276772664 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:42:30,549 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:42:30,573 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:42:30,573 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:42:30,573 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144230.log]\n', '2014-08-18 14:42:30,576 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:42:31,929 DEBUG - Will invoke JobStart for JobID [CREAM697046724]\n', 'https://cert-08.pd.infn.it:8443/CREAM697046724\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM697046724 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM697046724 2014-08-18 14:42:32.338364 Submit https://cert-08.pd.infn.it:8443/CREAM697046724 Left: 332 (at submission time:332) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM697046724 2014-08-18 14:44:24.818097 Exit https://cert-08.pd.infn.it:8443/CREAM968935687 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:44:25,196 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:44:25,222 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:44:25,223 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:44:25,223 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144425.log]\n', '2014-08-18 14:44:25,226 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:44:26,194 DEBUG - Will invoke JobStart for JobID [CREAM972761938]\n', 'https://cert-08.pd.infn.it:8443/CREAM972761938\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM972761938 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM972761938 2014-08-18 14:44:26.409077 Submit https://cert-08.pd.infn.it:8443/CREAM972761938 Left: 326 (at submission time:326) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM972761938 2014-08-18 14:45:25.398444 Exit https://cert-08.pd.infn.it:8443/CREAM242755234 Status: "DONE-"normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:41:30,437 DEBUG - Will invoke JobStart for JobID [CREAM635728348]\n', 'https://cert-08.pd.infn.it:8443/CREAM635728348\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM635728348 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM635728348 2014-08-18 14:41:30.798452 Submit https://cert-08.pd.infn.it:8443/CREAM635728348 Left: 337 (at submission time:337) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM635728348 2014-08-18 14:42:23.450811 Exit https://cert-08.pd.infn.it:8443/CREAM540835583 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:42:23,777 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:42:23,802 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:42:23,802 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:42:23,802 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144223.log]\n', '2014-08-18 14:42:23,806 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:42:24,793 DEBUG - Will invoke JobStart for JobID [CREAM374760435]\n', 'https://cert-08.pd.infn.it:8443/CREAM374760435\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM374760435 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM374760435 2014-08-18 14:42:25.113729 Submit https://cert-08.pd.infn.it:8443/CREAM374760435 Left: 334 (at submission time:334) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM374760435 2014-08-18 14:44:30.549700 Exit https://cert-08.pd.infn.it:8443/CREAM115995802 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:44:31,010 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:44:31,035 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:44:31,036 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:44:31,036 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144431.log]\n', '2014-08-18 14:44:31,039 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:44:32,635 DEBUG - Will invoke JobStart for JobID [CREAM565553592]\n', 'https://cert-08.pd.infn.it:8443/CREAM565553592\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM565553592 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM565553592 2014-08-18 14:44:33.227081 Submit https://cert-08.pd.infn.it:8443/CREAM565553592 Left: 324 (at submission time:324) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM565553592 2014-08-18 14:45:30.291598 Exit https://cert-08.pd.infn.it:8443/CREAM228135233 Status: "DONE-"normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:40:33,896 DEBUG - Will invoke JobStart for JobID [CREAM179416761]\n', 'https://cert-08.pd.infn.it:8443/CREAM179416761\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM179416761 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM179416761 2014-08-18 14:40:34.452893 Submit https://cert-08.pd.infn.it:8443/CREAM179416761 Left: 339 (at submission time:339) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM179416761 2014-08-18 14:42:30.606363 Exit https://cert-08.pd.infn.it:8443/CREAM984328939 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:42:31,408 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:42:31,431 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:42:31,432 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:42:31,432 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144231.log]\n', '2014-08-18 14:42:31,435 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:42:32,770 DEBUG - Will invoke JobStart for JobID [CREAM245281804]\n', 'https://cert-08.pd.infn.it:8443/CREAM245281804\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM245281804 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM245281804 2014-08-18 14:42:33.032803 Submit https://cert-08.pd.infn.it:8443/CREAM245281804 Left: 331 (at submission time:331) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM245281804 2014-08-18 14:43:24.260585 Exit https://cert-08.pd.infn.it:8443/CREAM570663146 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:43:24,598 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:43:24,618 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:43:24,619 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:43:24,619 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144324.log]\n', '2014-08-18 14:43:24,621 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:43:25,869 DEBUG - Will invoke JobStart for JobID [CREAM354374751]\n', 'https://cert-08.pd.infn.it:8443/CREAM354374751\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM354374751 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM354374751 2014-08-18 14:43:26.131743 Submit https://cert-08.pd.infn.it:8443/CREAM354374751 Left: 330 (at submission time:330) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM354374751 2014-08-18 14:45:31.955590 Exit https://cert-08.pd.infn.it:8443/CREAM257294439 Status: "DONE-ted: 671 Running: 19 Cancelled: 0 Done-Ok: 652 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 652/1000 2014-08-18 14:43:31.823294 Submitted: 671 Running: 18 Cancelled: 0 Done-Ok: 653 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 653/1000 2014-08-18 14:43:33.228697 Submitted: 672 Running: 19 Cancelled: 0 Done-Ok: 653 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 653/1000 2014-08-18 14:43:34.521851 Submitted: 673 Running: 20 Cancelled: 0 Done-Ok: 653 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 653/1000 2014-08-18 14:44:24.820336 Submitted: 673 Running: 19 Cancelled: 0 Done-Ok: 654 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 654/1000 2014-08-18 14:44:26.410409 Submitted: 674 Running: 20 Cancelled: 0 Done-Ok: 654 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 654/1000 2014-08-18 14:44:30.551480 Submitted: 674 Running: 19 Cancelled: 0 Done-Ok: 655 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 655/1000 2014-08-18 14:44:30.593061 Submitted: 674 Running: 18 Cancelled: 0 Done-Ok: 656 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 656/1000 2014-08-18 14:44:30.907490 Submitted: 674 Running: 17 Cancelled: 0 Done-Ok: 657 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 657/1000 2014-08-18 14:44:33.215836 Submitted: 675 Running: 18 Cancelled: 0 Done-Ok: 657 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 657/1000 2014-08-18 14:44:33.228175 Submitted: 676 Running: 19 Cancelled: 0 Done-Ok: 657 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 657/1000 2014-08-18 14:44:33.929683 Submitted: 677 Running: 20 Cancelled: 0 Done-Ok: 657 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 657/1000 2014-08-18 14:45:25.402137 Submitted: 677 Running: 19 Cancelled: 0 Done-Ok: 658 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 658/1000 2014-08-18 14:45:27.310973 Submitted: 678 Running: 20 Cancelled: 0 Done-Ok: 658 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 658/1000 2014-08-18 14:45:30.293977 Submitted: 678 Running: 19 Cancelled: 0 Done-Ok: 659 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 659/1000 2014-08-18 14:45:31.956968 Submitted: 678 Running: 18 Cancelled: 0 Done-Ok: 660 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 660/1000 2014-08-18 14:45:32.687953 Submitted: 679 Running: 19 Cancelled: 0 Done-Ok: 660 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 660/1000 2014-08-18 14:45:34.444303 Submitted: 680 Running: 20 Cancelled: 0 Done-Ok: 660 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 660/1000 2014-08-18 14:45:34.759811 Submitted: 680 Running: 19 Cancelled: 0 Done-Ok: 661 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 661/1000 2014-08-18 14:45:37.525814 Submitted: 681 Running: 20 Cancelled: 0 Done-Ok: 661 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 661/1000 2014-08-18 14:46:25.338955 SuOK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:45:31,203 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:45:31,222 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:45:31,222 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:45:31,222 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144531.log]\n', '2014-08-18 14:45:31,225 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:45:32,335 DEBUG - Will invoke JobStart for JobID [CREAM160430610]\n', 'https://cert-08.pd.infn.it:8443/CREAM160430610\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM160430610 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM160430610 2014-08-18 14:45:32.685873 Submit https://cert-08.pd.infn.it:8443/CREAM160430610 Left: 321 (at submission time:321) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM160430610 2014-08-18 14:46:31.352234 Exit https://cert-08.pd.infn.it:8443/CREAM635728348 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:46:31,694 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:46:31,718 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:46:31,718 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:46:31,718 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144631.log]\n', '2014-08-18 14:46:31,723 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:46:33,191 DEBUG - Will invoke JobStart for JobID [CREAM468180911]\n', 'https://cert-08.pd.infn.it:8443/CREAM468180911\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM468180911 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM468180911 2014-08-18 14:46:33.504740 Submit https://cert-08.pd.infn.it:8443/CREAM468180911 Left: 317 (at submission time:317) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM468180911 2014-08-18 14:47:25.632832 Exit https://cert-08.pd.infn.it:8443/CREAM374760435 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:47:26,098 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:47:26,137 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:47:26,137 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:47:26,137 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144726.log]\n', '2014-08-18 14:47:26,145 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:44:30,968 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:44:30,988 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:44:30,988 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:44:30,988 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144430.log]\n', '2014-08-18 14:44:31,003 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:44:32,387 DEBUG - Will invoke JobStart for JobID [CREAM343920236]\n', 'https://cert-08.pd.infn.it:8443/CREAM343920236\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM343920236 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM343920236 2014-08-18 14:44:33.214282 Submit https://cert-08.pd.infn.it:8443/CREAM343920236 Left: 325 (at submission time:325) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM343920236 2014-08-18 14:46:31.499273 Exit https://cert-08.pd.infn.it:8443/CREAM569931285 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:46:31,838 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:46:31,860 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:46:31,860 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:46:31,860 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144631.log]\n', '2014-08-18 14:46:31,864 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:46:33,293 DEBUG - Will invoke JobStart for JobID [CREAM232063453]\n', 'https://cert-08.pd.infn.it:8443/CREAM232063453\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM232063453 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM232063453 2014-08-18 14:46:33.761021 Submit https://cert-08.pd.infn.it:8443/CREAM232063453 Left: 316 (at submission time:316) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM232063453 2014-08-18 14:47:31.729394 Exit https://cert-08.pd.infn.it:8443/CREAM860268926 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:47:38,735 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:47:38,772 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:47:38,772 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:47:38,772 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144738.log]\n', '2014-08-18 14:47:38,788 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:45:32,923 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:45:32,946 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:45:32,946 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:45:32,946 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144532.log]\n', '2014-08-18 14:45:32,949 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:45:34,224 DEBUG - Will invoke JobStart for JobID [CREAM364468996]\n', 'https://cert-08.pd.infn.it:8443/CREAM364468996\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM364468996 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM364468996 2014-08-18 14:45:34.443210 Submit https://cert-08.pd.infn.it:8443/CREAM364468996 Left: 320 (at submission time:320) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM364468996 2014-08-18 14:45:34.755346 Exit https://cert-08.pd.infn.it:8443/CREAM179416761 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:45:35,644 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:45:35,667 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:45:35,668 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:45:35,668 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144535.log]\n', '2014-08-18 14:45:35,671 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:45:37,243 DEBUG - Will invoke JobStart for JobID [CREAM871811047]\n', 'https://cert-08.pd.infn.it:8443/CREAM871811047\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM871811047 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM871811047 2014-08-18 14:45:37.523497 Submit https://cert-08.pd.infn.it:8443/CREAM871811047 Left: 319 (at submission time:319) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM871811047 2014-08-18 14:47:39.329811 Exit https://cert-08.pd.infn.it:8443/CREAM245281804 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:47:39,993 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:47:40,018 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:47:40,018 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:47:40,018 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144740.log]\n', '2014-08-18 14:47:40,021 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:45:25,735 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:45:25,754 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:45:25,755 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:45:25,755 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144525.log]\n', '2014-08-18 14:45:25,758 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:45:26,772 DEBUG - Will invoke JobStart for JobID [CREAM090588046]\n', 'https://cert-08.pd.infn.it:8443/CREAM090588046\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM090588046 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM090588046 2014-08-18 14:45:27.309230 Submit https://cert-08.pd.infn.it:8443/CREAM090588046 Left: 322 (at submission time:322) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM090588046 2014-08-18 14:46:31.730663 Exit https://cert-08.pd.infn.it:8443/CREAM887955829 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:46:32,943 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:46:32,981 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:46:32,981 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:46:32,981 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144632.log]\n', '2014-08-18 14:46:32,985 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:46:34,410 DEBUG - Will invoke JobStart for JobID [CREAM848112187]\n', 'https://cert-08.pd.infn.it:8443/CREAM848112187\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM848112187 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM848112187 2014-08-18 14:46:34.710794 Submit https://cert-08.pd.infn.it:8443/CREAM848112187 Left: 315 (at submission time:315) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM848112187 2014-08-18 14:47:39.349071 Exit https://cert-08.pd.infn.it:8443/CREAM697046724 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:47:40,142 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:47:40,167 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:47:40,167 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:47:40,167 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144740.log]\n', '2014-08-18 14:47:40,171 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:44:31,950 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:44:31,978 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:44:31,978 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:44:31,978 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144431.log]\n', '2014-08-18 14:44:31,991 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:44:33,676 DEBUG - Will invoke JobStart for JobID [CREAM299036086]\n', 'https://cert-08.pd.infn.it:8443/CREAM299036086\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM299036086 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM299036086 2014-08-18 14:44:33.926467 Submit https://cert-08.pd.infn.it:8443/CREAM299036086 Left: 323 (at submission time:323) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM299036086 2014-08-18 14:46:25.337781 Exit https://cert-08.pd.infn.it:8443/CREAM758931220 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:46:25,687 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:46:25,718 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:46:25,718 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:46:25,718 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144625.log]\n', '2014-08-18 14:46:25,733 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:46:26,808 DEBUG - Will invoke JobStart for JobID [CREAM156030062]\n', 'https://cert-08.pd.infn.it:8443/CREAM156030062\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM156030062 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM156030062 2014-08-18 14:46:27.239416 Submit https://cert-08.pd.infn.it:8443/CREAM156030062 Left: 318 (at submission time:318) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM156030062 2014-08-18 14:48:31.254300 Exit https://cert-08.pd.infn.it:8443/CREAM233475751 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:48:32,030 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:48:32,053 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:48:32,053 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:48:32,053 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144832.log]\n', '2014-08-18 14:48:32,056 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/bmitted: 681 Running: 19 Cancelled: 0 Done-Ok: 662 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 662/1000 2014-08-18 14:46:27.242097 Submitted: 682 Running: 20 Cancelled: 0 Done-Ok: 662 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 662/1000 2014-08-18 14:46:31.354659 Submitted: 682 Running: 19 Cancelled: 0 Done-Ok: 663 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 663/1000 2014-08-18 14:46:31.501590 Submitted: 682 Running: 18 Cancelled: 0 Done-Ok: 664 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 664/1000 2014-08-18 14:46:31.733244 Submitted: 682 Running: 17 Cancelled: 0 Done-Ok: 665 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 665/1000 2014-08-18 14:46:33.507778 Submitted: 683 Running: 18 Cancelled: 0 Done-Ok: 665 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 665/1000 2014-08-18 14:46:33.763606 Submitted: 684 Running: 19 Cancelled: 0 Done-Ok: 665 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 665/1000 2014-08-18 14:46:34.712955 Submitted: 685 Running: 20 Cancelled: 0 Done-Ok: 665 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 665/1000 2014-08-18 14:47:25.635606 Submitted: 685 Running: 19 Cancelled: 0 Done-Ok: 666 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 666/1000 2014-08-18 14:47:27.626378 Submitted: 686 Running: 20 Cancelled: 0 Done-Ok: 666 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 666/1000 2014-08-18 14:47:31.730885 Submitted: 686 Running: 19 Cancelled: 0 Done-Ok: 667 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 667/1000 2014-08-18 14:47:39.333531 Submitted: 686 Running: 18 Cancelled: 0 Done-Ok: 668 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 668/1000 2014-08-18 14:47:39.350985 Submitted: 686 Running: 17 Cancelled: 0 Done-Ok: 669 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 669/1000 2014-08-18 14:47:40.331912 Submitted: 687 Running: 18 Cancelled: 0 Done-Ok: 669 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 669/1000 2014-08-18 14:47:41.890638 Submitted: 688 Running: 19 Cancelled: 0 Done-Ok: 669 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 669/1000 2014-08-18 14:47:42.214965 Submitted: 689 Running: 20 Cancelled: 0 Done-Ok: 669 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 669/1000 2014-08-18 14:48:26.759522 Submitted: 689 Running: 19 Cancelled: 0 Done-Ok: 670 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 670/1000 2014-08-18 14:48:28.690720 Submitted: 690 Running: 20 Cancelled: 0 Done-Ok: 670 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 670/1000 2014-08-18 14:48:31.255751 Submitted: 690 Running: 19 Cancelled: 0 Done-Ok: 671 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 671/1000 2014-08-18 14:48:33.316935 Submitted: 690 Running: 18 Cancelled: 0 Done-Ok: 672 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 672/1000 2014-08-18 14:48:33.61360services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:47:39,967 DEBUG - Will invoke JobStart for JobID [CREAM653793078]\n', 'https://cert-08.pd.infn.it:8443/CREAM653793078\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM653793078 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM653793078 2014-08-18 14:47:40.328917 Submit https://cert-08.pd.infn.it:8443/CREAM653793078 Left: 313 (at submission time:313) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM653793078 2014-08-18 14:48:33.315374 Exit https://cert-08.pd.infn.it:8443/CREAM538587414 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:48:34,132 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:48:34,159 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:48:34,159 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:48:34,160 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144834.log]\n', '2014-08-18 14:48:34,163 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:48:35,474 DEBUG - Will invoke JobStart for JobID [CREAM900542601]\n', 'https://cert-08.pd.infn.it:8443/CREAM900542601\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM900542601 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM900542601 2014-08-18 14:48:35.671218 Submit https://cert-08.pd.infn.it:8443/CREAM900542601 Left: 308 (at submission time:308) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM900542601 2014-08-18 14:49:32.249204 Exit https://cert-08.pd.infn.it:8443/CREAM343920236 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:49:33,132 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:49:33,166 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:49:33,167 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:49:33,167 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144933.log]\n', '2014-08-18 14:49:33,170 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:49:34,475 DEBUG - Will invoke JobStart for JobID [CREAM667561144]\n', 'https://cert-08.pd.infn.it:8443/CREAM667561144\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM667561144 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM667561144 2014-08-18 14:49:34.817682 Submit https://cert-08.pd.infn.it:8443/CREAM667561144 Left: 305 (at submission time:305) submission succeeded, rservices/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:48:33,317 DEBUG - Will invoke JobStart for JobID [CREAM866251810]\n', 'https://cert-08.pd.infn.it:8443/CREAM866251810\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM866251810 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM866251810 2014-08-18 14:48:33.611220 Submit https://cert-08.pd.infn.it:8443/CREAM866251810 Left: 309 (at submission time:309) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM866251810 2014-08-18 14:48:34.031386 Exit https://cert-08.pd.infn.it:8443/CREAM744645305 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:48:34,843 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:48:34,892 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:48:34,893 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:48:34,893 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144834.log]\n', '2014-08-18 14:48:34,900 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:48:36,325 DEBUG - Will invoke JobStart for JobID [CREAM199459629]\n', 'https://cert-08.pd.infn.it:8443/CREAM199459629\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM199459629 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM199459629 2014-08-18 14:48:36.642566 Submit https://cert-08.pd.infn.it:8443/CREAM199459629 Left: 307 (at submission time:307) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM199459629 2014-08-18 14:49:33.039726 Exit https://cert-08.pd.infn.it:8443/CREAM299036086 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:49:34,012 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:49:34,034 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:49:34,035 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:49:34,035 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144934.log]\n', '2014-08-18 14:49:34,044 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:49:35,400 DEBUG - Will invoke JobStart for JobID [CREAM607763425]\n', 'https://cert-08.pd.infn.it:8443/CREAM607763425\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM607763425 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM607763425 2014-08-18 14:49:35.688348 Submit https://cert-08.pd.infn.it:8443/CREAM607763425 Left: 304 (at submission time:304) submission succeeded, rservices/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:47:41,743 DEBUG - Will invoke JobStart for JobID [CREAM981205412]\n', 'https://cert-08.pd.infn.it:8443/CREAM981205412\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM981205412 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM981205412 2014-08-18 14:47:42.213723 Submit https://cert-08.pd.infn.it:8443/CREAM981205412 Left: 311 (at submission time:311) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM981205412 2014-08-18 14:49:26.715326 Exit https://cert-08.pd.infn.it:8443/CREAM972761938 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:49:27,044 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:49:27,071 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:49:27,072 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:49:27,072 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144927.log]\n', '2014-08-18 14:49:27,079 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:49:28,198 DEBUG - Will invoke JobStart for JobID [CREAM270300598]\n', 'https://cert-08.pd.infn.it:8443/CREAM270300598\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM270300598 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM270300598 2014-08-18 14:49:28.460392 Submit https://cert-08.pd.infn.it:8443/CREAM270300598 Left: 306 (at submission time:306) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM270300598 2014-08-18 14:50:27.071716 Exit https://cert-08.pd.infn.it:8443/CREAM090588046 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:50:27,511 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:50:27,539 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:50:27,540 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:50:27,540 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145027.log]\n', '2014-08-18 14:50:27,545 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:50:28,646 DEBUG - Will invoke JobStart for JobID [CREAM056167299]\n', 'https://cert-08.pd.infn.it:8443/CREAM056167299\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM056167299 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM056167299 2014-08-18 14:50:28.944700 Submit https://cert-08.pd.infn.it:8443/CREAM056167299 Left: 302 (at submission time:302) submission succeeded, rservices/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:47:27,300 DEBUG - Will invoke JobStart for JobID [CREAM860308845]\n', 'https://cert-08.pd.infn.it:8443/CREAM860308845\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM860308845 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM860308845 2014-08-18 14:47:27.624841 Submit https://cert-08.pd.infn.it:8443/CREAM860308845 Left: 314 (at submission time:314) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM860308845 2014-08-18 14:49:33.600792 Exit https://cert-08.pd.infn.it:8443/CREAM565553592 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:49:34,527 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:49:34,550 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:49:34,551 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:49:34,551 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144934.log]\n', '2014-08-18 14:49:34,559 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:49:36,381 DEBUG - Will invoke JobStart for JobID [CREAM610240546]\n', 'https://cert-08.pd.infn.it:8443/CREAM610240546\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM610240546 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM610240546 2014-08-18 14:49:36.594208 Submit https://cert-08.pd.infn.it:8443/CREAM610240546 Left: 303 (at submission time:303) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM610240546 2014-08-18 14:50:32.778706 Exit https://cert-08.pd.infn.it:8443/CREAM160430610 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:50:33,309 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:50:33,343 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:50:33,343 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:50:33,344 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145033.log]\n', '2014-08-18 14:50:33,351 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:50:34,541 DEBUG - Will invoke JobStart for JobID [CREAM772032149]\n', 'https://cert-08.pd.infn.it:8443/CREAM772032149\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM772032149 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM772032149 2014-08-18 14:50:34.864648 Submit https://cert-08.pd.infn.it:8443/CREAM772032149 Left: 301 (at submission time:301) submission succeeded, rservices/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:47:41,567 DEBUG - Will invoke JobStart for JobID [CREAM090987558]\n', 'https://cert-08.pd.infn.it:8443/CREAM090987558\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM090987558 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM090987558 2014-08-18 14:47:41.887193 Submit https://cert-08.pd.infn.it:8443/CREAM090987558 Left: 312 (at submission time:312) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM090987558 2014-08-18 14:48:26.755689 Exit https://cert-08.pd.infn.it:8443/CREAM354374751 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:48:27,070 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:48:27,106 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:48:27,107 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:48:27,107 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-144827.log]\n', '2014-08-18 14:48:27,123 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:48:28,384 DEBUG - Will invoke JobStart for JobID [CREAM789726896]\n', 'https://cert-08.pd.infn.it:8443/CREAM789726896\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM789726896 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM789726896 2014-08-18 14:48:28.687725 Submit https://cert-08.pd.infn.it:8443/CREAM789726896 Left: 310 (at submission time:310) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM789726896 2014-08-18 14:50:33.233476 Exit https://cert-08.pd.infn.it:8443/CREAM364468996 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:50:33,932 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:50:33,954 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:50:33,954 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:50:33,954 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145033.log]\n', '2014-08-18 14:50:33,957 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:50:35,216 DEBUG - Will invoke JobStart for JobID [CREAM751623490]\n', 'https://cert-08.pd.infn.it:8443/CREAM751623490\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM751623490 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM751623490 2014-08-18 14:50:35.543234 Submit https://cert-08.pd.infn.it:8443/CREAM751623490 Left: 300 (at submission time:300) submission succeeded, r6 Submitted: 691 Running: 19 Cancelled: 0 Done-Ok: 672 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 672/1000 2014-08-18 14:48:34.034518 Submitted: 691 Running: 18 Cancelled: 0 Done-Ok: 673 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 673/1000 2014-08-18 14:48:35.675716 Submitted: 692 Running: 19 Cancelled: 0 Done-Ok: 673 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 673/1000 2014-08-18 14:48:36.644207 Submitted: 693 Running: 20 Cancelled: 0 Done-Ok: 673 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 673/1000 2014-08-18 14:49:26.717211 Submitted: 693 Running: 19 Cancelled: 0 Done-Ok: 674 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 674/1000 2014-08-18 14:49:28.461726 Submitted: 694 Running: 20 Cancelled: 0 Done-Ok: 674 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 674/1000 2014-08-18 14:49:32.252209 Submitted: 694 Running: 19 Cancelled: 0 Done-Ok: 675 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 675/1000 2014-08-18 14:49:33.041714 Submitted: 694 Running: 18 Cancelled: 0 Done-Ok: 676 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 676/1000 2014-08-18 14:49:33.602486 Submitted: 694 Running: 17 Cancelled: 0 Done-Ok: 677 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 677/1000 2014-08-18 14:49:34.818953 Submitted: 695 Running: 18 Cancelled: 0 Done-Ok: 677 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 677/1000 2014-08-18 14:49:35.689688 Submitted: 696 Running: 19 Cancelled: 0 Done-Ok: 677 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 677/1000 2014-08-18 14:49:36.595661 Submitted: 697 Running: 20 Cancelled: 0 Done-Ok: 677 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 677/1000 2014-08-18 14:50:27.074562 Submitted: 697 Running: 19 Cancelled: 0 Done-Ok: 678 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 678/1000 2014-08-18 14:50:28.950233 Submitted: 698 Running: 20 Cancelled: 0 Done-Ok: 678 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 678/1000 2014-08-18 14:50:32.781985 Submitted: 698 Running: 19 Cancelled: 0 Done-Ok: 679 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 679/1000 2014-08-18 14:50:33.235427 Submitted: 698 Running: 18 Cancelled: 0 Done-Ok: 680 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 680/1000 2014-08-18 14:50:34.866135 Submitted: 699 Running: 19 Cancelled: 0 Done-Ok: 680 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 680/1000 2014-08-18 14:50:35.547426 Submitted: 700 Running: 20 Cancelled: 0 Done-Ok: 680 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 680/1000 2014-08-18 14:50:35.816110 Submitted: 700 Running: 19 Cancelled: 0 Done-Ok: 681 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 681/1000 2014-08-18 14:50:38.257880 Submitted: 701 Running: 20 Cancelled: 0 Done-Ok: 681 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 681/1000 2014-08-18 14:51:28.1eturned jobid = https://cert-08.pd.infn.it:8443/CREAM751623490 2014-08-18 14:50:35.814116 Exit https://cert-08.pd.infn.it:8443/CREAM871811047 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:50:36,433 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:50:36,461 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:50:36,461 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:50:36,461 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145036.log]\n', '2014-08-18 14:50:36,468 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:50:37,891 DEBUG - Will invoke JobStart for JobID [CREAM639599963]\n', 'https://cert-08.pd.infn.it:8443/CREAM639599963\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM639599963 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM639599963 2014-08-18 14:50:38.255950 Submit https://cert-08.pd.infn.it:8443/CREAM639599963 Left: 299 (at submission time:299) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM639599963 2014-08-18 14:52:34.764903 Exit https://cert-08.pd.infn.it:8443/CREAM090987558 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:52:35,829 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:52:35,848 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:52:35,848 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:52:35,848 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145235.log]\n', '2014-08-18 14:52:35,852 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:52:37,345 DEBUG - Will invoke JobStart for JobID [CREAM654963164]\n', 'https://cert-08.pd.infn.it:8443/CREAM654963164\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM654963164 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM654963164 2014-08-18 14:52:37.628423 Submit https://cert-08.pd.infn.it:8443/CREAM654963164 Left: 291 (at submission time:291) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM654963164 2014-08-18 14:53:28.538298 Exit https://cert-08.pd.infn.it:8443/CREAM789726896 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:53:29,048 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:53:29,087 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:53:29,087 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:53:29,087 DEBUG - Logfile is [/tmp/glite_cr05684 Submitted: 701 Running: 19 Cancelled: 0 Done-Ok: 682 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 682/1000 2014-08-18 14:51:30.056348 Submitted: 702 Running: 20 Cancelled: 0 Done-Ok: 682 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 682/1000 2014-08-18 14:51:32.589962 Submitted: 702 Running: 19 Cancelled: 0 Done-Ok: 683 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 683/1000 2014-08-18 14:51:34.059695 Submitted: 702 Running: 18 Cancelled: 0 Done-Ok: 684 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 684/1000 2014-08-18 14:51:34.121034 Submitted: 702 Running: 17 Cancelled: 0 Done-Ok: 685 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 685/1000 2014-08-18 14:51:34.871567 Submitted: 703 Running: 18 Cancelled: 0 Done-Ok: 685 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 685/1000 2014-08-18 14:51:36.304085 Submitted: 704 Running: 19 Cancelled: 0 Done-Ok: 685 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 685/1000 2014-08-18 14:51:36.930281 Submitted: 705 Running: 20 Cancelled: 0 Done-Ok: 685 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 685/1000 2014-08-18 14:52:28.471763 Submitted: 705 Running: 19 Cancelled: 0 Done-Ok: 686 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 686/1000 2014-08-18 14:52:30.304214 Submitted: 706 Running: 20 Cancelled: 0 Done-Ok: 686 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 686/1000 2014-08-18 14:52:33.766554 Submitted: 706 Running: 19 Cancelled: 0 Done-Ok: 687 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 687/1000 2014-08-18 14:52:34.318877 Submitted: 706 Running: 18 Cancelled: 0 Done-Ok: 688 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 688/1000 2014-08-18 14:52:34.766655 Submitted: 706 Running: 17 Cancelled: 0 Done-Ok: 689 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 689/1000 2014-08-18 14:52:36.171891 Submitted: 707 Running: 18 Cancelled: 0 Done-Ok: 689 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 689/1000 2014-08-18 14:52:36.703843 Submitted: 708 Running: 19 Cancelled: 0 Done-Ok: 689 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 689/1000 2014-08-18 14:52:37.630176 Submitted: 709 Running: 20 Cancelled: 0 Done-Ok: 689 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 689/1000 2014-08-18 14:53:28.539723 Submitted: 709 Running: 19 Cancelled: 0 Done-Ok: 690 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 690/1000 2014-08-18 14:53:30.301405 Submitted: 710 Running: 20 Cancelled: 0 Done-Ok: 690 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 690/1000 2014-08-18 14:53:33.741368 Submitted: 710 Running: 19 Cancelled: 0 Done-Ok: 691 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 691/1000 2014-08-18 14:53:34.877961 Submitted: 710 Running: 18 Cancelled: 0 Done-Ok: 692 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 692/1000 2014-08-18 14:53:eturned jobid = https://cert-08.pd.infn.it:8443/CREAM667561144 2014-08-18 14:51:34.118104 Exit https://cert-08.pd.infn.it:8443/CREAM232063453 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:51:35,053 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:51:35,076 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:51:35,076 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:51:35,076 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145135.log]\n', '2014-08-18 14:51:35,079 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:51:36,641 DEBUG - Will invoke JobStart for JobID [CREAM730784774]\n', 'https://cert-08.pd.infn.it:8443/CREAM730784774\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM730784774 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM730784774 2014-08-18 14:51:36.926684 Submit https://cert-08.pd.infn.it:8443/CREAM730784774 Left: 295 (at submission time:295) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM730784774 2014-08-18 14:52:33.764860 Exit https://cert-08.pd.infn.it:8443/CREAM653793078 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:52:34,644 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:52:34,664 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:52:34,664 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:52:34,664 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145234.log]\n', '2014-08-18 14:52:34,667 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:52:35,804 DEBUG - Will invoke JobStart for JobID [CREAM732306068]\n', 'https://cert-08.pd.infn.it:8443/CREAM732306068\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM732306068 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM732306068 2014-08-18 14:52:36.169736 Submit https://cert-08.pd.infn.it:8443/CREAM732306068 Left: 293 (at submission time:293) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM732306068 2014-08-18 14:53:34.872553 Exit https://cert-08.pd.infn.it:8443/CREAM900542601 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:53:35,605 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:53:35,633 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:53:35,634 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:53:35,634 DEBUG - Logfile is [/tmp/glite_creturned jobid = https://cert-08.pd.infn.it:8443/CREAM607763425 2014-08-18 14:51:28.102139 Exit https://cert-08.pd.infn.it:8443/CREAM156030062 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:51:28,438 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:51:28,464 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:51:28,464 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:51:28,464 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145128.log]\n', '2014-08-18 14:51:28,473 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:51:29,641 DEBUG - Will invoke JobStart for JobID [CREAM847489219]\n', 'https://cert-08.pd.infn.it:8443/CREAM847489219\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM847489219 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM847489219 2014-08-18 14:51:30.053793 Submit https://cert-08.pd.infn.it:8443/CREAM847489219 Left: 298 (at submission time:298) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM847489219 2014-08-18 14:53:33.737697 Exit https://cert-08.pd.infn.it:8443/CREAM866251810 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:53:34,510 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:53:34,547 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:53:34,547 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:53:34,547 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145334.log]\n', '2014-08-18 14:53:34,551 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:53:35,686 DEBUG - Will invoke JobStart for JobID [CREAM385868671]\n', 'https://cert-08.pd.infn.it:8443/CREAM385868671\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM385868671 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM385868671 2014-08-18 14:53:36.308626 Submit https://cert-08.pd.infn.it:8443/CREAM385868671 Left: 289 (at submission time:289) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM385868671 2014-08-18 14:53:36.722780 Exit https://cert-08.pd.infn.it:8443/CREAM199459629 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:53:37,494 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:53:37,524 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:53:37,524 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:53:37,524 DEBUG - Logfile is [/tmp/glite_creturned jobid = https://cert-08.pd.infn.it:8443/CREAM056167299 2014-08-18 14:51:34.055900 Exit https://cert-08.pd.infn.it:8443/CREAM848112187 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:51:34,728 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:51:34,747 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:51:34,747 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:51:34,747 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145134.log]\n', '2014-08-18 14:51:34,750 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:51:36,148 DEBUG - Will invoke JobStart for JobID [CREAM127468606]\n', 'https://cert-08.pd.infn.it:8443/CREAM127468606\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM127468606 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM127468606 2014-08-18 14:51:36.300916 Submit https://cert-08.pd.infn.it:8443/CREAM127468606 Left: 296 (at submission time:296) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM127468606 2014-08-18 14:52:34.316553 Exit https://cert-08.pd.infn.it:8443/CREAM981205412 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:52:35,022 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:52:35,046 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:52:35,046 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:52:35,046 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145235.log]\n', '2014-08-18 14:52:35,050 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:52:36,495 DEBUG - Will invoke JobStart for JobID [CREAM441405364]\n', 'https://cert-08.pd.infn.it:8443/CREAM441405364\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM441405364 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM441405364 2014-08-18 14:52:36.703116 Submit https://cert-08.pd.infn.it:8443/CREAM441405364 Left: 292 (at submission time:292) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM441405364 2014-08-18 14:54:29.222328 Exit https://cert-08.pd.infn.it:8443/CREAM270300598 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:54:29,553 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:54:29,573 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:54:29,573 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:54:29,573 DEBUG - Logfile is [/tmp/glite_creturned jobid = https://cert-08.pd.infn.it:8443/CREAM772032149 2014-08-18 14:51:32.588328 Exit https://cert-08.pd.infn.it:8443/CREAM468180911 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:51:33,339 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:51:33,358 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:51:33,358 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:51:33,358 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145133.log]\n', '2014-08-18 14:51:33,361 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:51:34,674 DEBUG - Will invoke JobStart for JobID [CREAM529532126]\n', 'https://cert-08.pd.infn.it:8443/CREAM529532126\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM529532126 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM529532126 2014-08-18 14:51:34.868657 Submit https://cert-08.pd.infn.it:8443/CREAM529532126 Left: 297 (at submission time:297) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM529532126 2014-08-18 14:52:28.469668 Exit https://cert-08.pd.infn.it:8443/CREAM860308845 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:52:28,802 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:52:28,823 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:52:28,824 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:52:28,824 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145228.log]\n', '2014-08-18 14:52:28,826 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:52:30,104 DEBUG - Will invoke JobStart for JobID [CREAM073465573]\n', 'https://cert-08.pd.infn.it:8443/CREAM073465573\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM073465573 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM073465573 2014-08-18 14:52:30.300505 Submit https://cert-08.pd.infn.it:8443/CREAM073465573 Left: 294 (at submission time:294) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM073465573 2014-08-18 14:54:37.038251 Exit https://cert-08.pd.infn.it:8443/CREAM610240546 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:54:37,693 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:54:37,720 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:54:37,720 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:54:37,720 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145329.log]\n', '2014-08-18 14:53:29,091 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:53:30,068 DEBUG - Will invoke JobStart for JobID [CREAM232544586]\n', 'https://cert-08.pd.infn.it:8443/CREAM232544586\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM232544586 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM232544586 2014-08-18 14:53:30.297136 Submit https://cert-08.pd.infn.it:8443/CREAM232544586 Left: 290 (at submission time:290) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM232544586 2014-08-18 14:55:36.090449 Exit https://cert-08.pd.infn.it:8443/CREAM751623490 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:55:36,883 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:55:36,915 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:55:36,916 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:55:36,916 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145536.log]\n', '2014-08-18 14:55:36,919 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:55:38,238 DEBUG - Will invoke JobStart for JobID [CREAM062094881]\n', 'https://cert-08.pd.infn.it:8443/CREAM062094881\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM062094881 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM062094881 2014-08-18 14:55:38.483724 Submit https://cert-08.pd.infn.it:8443/CREAM062094881 Left: 280 (at submission time:280) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM062094881 2014-08-18 14:55:38.928594 Exit https://cert-08.pd.infn.it:8443/CREAM639599963 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:55:39,424 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:55:39,452 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:55:39,452 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:55:39,452 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145539.log]\n', '2014-08-18 14:55:39,461 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:55:40,765 DEBUG - Will invoke JobStart for JobID [CREAM727917827]\n', 'https://cert-08.pd.infn.it:8443/CREAM727917827\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM727917827 Submitted job: jid = https://cert-08.pd.infn.it:8443/CR36.310183 Submitted: 711 Running: 19 Cancelled: 0 Done-Ok: 692 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 692/1000 2014-08-18 14:53:36.725773 Submitted: 711 Running: 18 Cancelled: 0 Done-Ok: 693 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 693/1000 2014-08-18 14:53:36.976442 Submitted: 712 Running: 19 Cancelled: 0 Done-Ok: 693 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 693/1000 2014-08-18 14:53:39.275570 Submitted: 713 Running: 20 Cancelled: 0 Done-Ok: 693 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 693/1000 2014-08-18 14:54:29.223930 Submitted: 713 Running: 19 Cancelled: 0 Done-Ok: 694 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 694/1000 2014-08-18 14:54:30.969745 Submitted: 714 Running: 20 Cancelled: 0 Done-Ok: 694 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 694/1000 2014-08-18 14:54:33.580507 Submitted: 714 Running: 19 Cancelled: 0 Done-Ok: 695 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 695/1000 2014-08-18 14:54:35.229959 Submitted: 714 Running: 18 Cancelled: 0 Done-Ok: 696 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 696/1000 2014-08-18 14:54:36.109370 Submitted: 715 Running: 19 Cancelled: 0 Done-Ok: 696 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 696/1000 2014-08-18 14:54:37.040457 Submitted: 715 Running: 18 Cancelled: 0 Done-Ok: 697 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 697/1000 2014-08-18 14:54:37.759824 Submitted: 716 Running: 19 Cancelled: 0 Done-Ok: 697 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 697/1000 2014-08-18 14:54:39.404995 Submitted: 717 Running: 20 Cancelled: 0 Done-Ok: 697 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 697/1000 2014-08-18 14:55:29.856154 Submitted: 717 Running: 19 Cancelled: 0 Done-Ok: 698 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 698/1000 2014-08-18 14:55:31.536937 Submitted: 718 Running: 20 Cancelled: 0 Done-Ok: 698 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 698/1000 2014-08-18 14:55:34.300161 Submitted: 718 Running: 19 Cancelled: 0 Done-Ok: 699 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 699/1000 2014-08-18 14:55:36.094498 Submitted: 718 Running: 18 Cancelled: 0 Done-Ok: 700 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 700/1000 2014-08-18 14:55:36.359400 Submitted: 719 Running: 19 Cancelled: 0 Done-Ok: 700 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 700/1000 2014-08-18 14:55:38.485985 Submitted: 720 Running: 20 Cancelled: 0 Done-Ok: 700 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 700/1000 2014-08-18 14:55:38.930515 Submitted: 720 Running: 19 Cancelled: 0 Done-Ok: 701 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 701/1000 2014-08-18 14:55:41.236962 Submitted: 721 Running: 20 Cancelled: 0 Done-Ok: 701 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 701/1000 2014-08-18 14eam_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145337.log]\n', '2014-08-18 14:53:37,527 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:53:38,920 DEBUG - Will invoke JobStart for JobID [CREAM865463168]\n', 'https://cert-08.pd.infn.it:8443/CREAM865463168\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM865463168 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM865463168 2014-08-18 14:53:39.273892 Submit https://cert-08.pd.infn.it:8443/CREAM865463168 Left: 287 (at submission time:287) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM865463168 2014-08-18 14:54:35.228501 Exit https://cert-08.pd.infn.it:8443/CREAM607763425 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:54:35,846 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:54:35,871 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:54:35,871 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:54:35,871 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145435.log]\n', '2014-08-18 14:54:35,874 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:54:37,443 DEBUG - Will invoke JobStart for JobID [CREAM882495258]\n', 'https://cert-08.pd.infn.it:8443/CREAM882495258\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM882495258 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM882495258 2014-08-18 14:54:37.758463 Submit https://cert-08.pd.infn.it:8443/CREAM882495258 Left: 284 (at submission time:284) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM882495258 2014-08-18 14:56:29.995627 Exit https://cert-08.pd.infn.it:8443/CREAM847489219 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:56:30,384 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:56:30,405 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:56:30,405 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:56:30,405 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145630.log]\n', '2014-08-18 14:56:30,413 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:56:31,546 DEBUG - Will invoke JobStart for JobID [CREAM650565444]\n', 'https://cert-08.pd.infn.it:8443/CREAM650565444\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM650565444 Submitted job: jid = https://cert-08.pd.infn.it:8443/CReam_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145429.log]\n', '2014-08-18 14:54:29,576 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:54:30,665 DEBUG - Will invoke JobStart for JobID [CREAM361470528]\n', 'https://cert-08.pd.infn.it:8443/CREAM361470528\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM361470528 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM361470528 2014-08-18 14:54:30.966192 Submit https://cert-08.pd.infn.it:8443/CREAM361470528 Left: 286 (at submission time:286) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM361470528 2014-08-18 14:55:29.855010 Exit https://cert-08.pd.infn.it:8443/CREAM056167299 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:55:30,172 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:55:30,198 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:55:30,198 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:55:30,198 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145530.log]\n', '2014-08-18 14:55:30,208 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:55:31,231 DEBUG - Will invoke JobStart for JobID [CREAM333718150]\n', 'https://cert-08.pd.infn.it:8443/CREAM333718150\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM333718150 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM333718150 2014-08-18 14:55:31.534034 Submit https://cert-08.pd.infn.it:8443/CREAM333718150 Left: 282 (at submission time:282) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM333718150 2014-08-18 14:56:35.356111 Exit https://cert-08.pd.infn.it:8443/CREAM127468606 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:56:36,001 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:56:36,023 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:56:36,024 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:56:36,024 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145636.log]\n', '2014-08-18 14:56:36,027 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:56:37,304 DEBUG - Will invoke JobStart for JobID [CREAM404800424]\n', 'https://cert-08.pd.infn.it:8443/CREAM404800424\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM404800424 Submitted job: jid = https://cert-08.pd.infn.it:8443/CReam_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145437.log]\n', '2014-08-18 14:54:37,724 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:54:38,948 DEBUG - Will invoke JobStart for JobID [CREAM796744477]\n', 'https://cert-08.pd.infn.it:8443/CREAM796744477\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM796744477 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM796744477 2014-08-18 14:54:39.401977 Submit https://cert-08.pd.infn.it:8443/CREAM796744477 Left: 283 (at submission time:283) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM796744477 2014-08-18 14:55:34.293188 Exit https://cert-08.pd.infn.it:8443/CREAM772032149 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:55:34,867 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:55:34,888 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:55:34,888 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:55:34,888 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145534.log]\n', '2014-08-18 14:55:34,892 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:55:36,073 DEBUG - Will invoke JobStart for JobID [CREAM739832058]\n', 'https://cert-08.pd.infn.it:8443/CREAM739832058\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM739832058 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM739832058 2014-08-18 14:55:36.356817 Submit https://cert-08.pd.infn.it:8443/CREAM739832058 Left: 281 (at submission time:281) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM739832058 2014-08-18 14:56:36.795004 Exit https://cert-08.pd.infn.it:8443/CREAM529532126 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:56:37,628 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:56:37,654 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:56:37,654 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:56:37,654 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145637.log]\n', '2014-08-18 14:56:37,658 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:56:39,118 DEBUG - Will invoke JobStart for JobID [CREAM667759985]\n', 'https://cert-08.pd.infn.it:8443/CREAM667759985\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM667759985 Submitted job: jid = https://cert-08.pd.infn.it:8443/CReam_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145335.log]\n', '2014-08-18 14:53:35,637 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:53:36,698 DEBUG - Will invoke JobStart for JobID [CREAM156515421]\n', 'https://cert-08.pd.infn.it:8443/CREAM156515421\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM156515421 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM156515421 2014-08-18 14:53:36.972386 Submit https://cert-08.pd.infn.it:8443/CREAM156515421 Left: 288 (at submission time:288) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM156515421 2014-08-18 14:54:33.579212 Exit https://cert-08.pd.infn.it:8443/CREAM667561144 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:54:34,502 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:54:34,536 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:54:34,537 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:54:34,537 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145434.log]\n', '2014-08-18 14:54:34,540 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:54:35,835 DEBUG - Will invoke JobStart for JobID [CREAM149239605]\n', 'https://cert-08.pd.infn.it:8443/CREAM149239605\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM149239605 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM149239605 2014-08-18 14:54:36.106789 Submit https://cert-08.pd.infn.it:8443/CREAM149239605 Left: 285 (at submission time:285) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM149239605 2014-08-18 14:56:37.429100 Exit https://cert-08.pd.infn.it:8443/CREAM730784774 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:56:38,275 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:56:38,302 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:56:38,303 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:56:38,303 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145638.log]\n', '2014-08-18 14:56:38,306 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:56:39,705 DEBUG - Will invoke JobStart for JobID [CREAM117213390]\n', 'https://cert-08.pd.infn.it:8443/CREAM117213390\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM117213390 Submitted job: jid = https://cert-08.pd.infn.it:8443/CR:56:29.998793 Submitted: 721 Running: 19 Cancelled: 0 Done-Ok: 702 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 702/1000 2014-08-18 14:56:31.958008 Submitted: 722 Running: 20 Cancelled: 0 Done-Ok: 702 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 702/1000 2014-08-18 14:56:35.358592 Submitted: 722 Running: 19 Cancelled: 0 Done-Ok: 703 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 703/1000 2014-08-18 14:56:36.797035 Submitted: 722 Running: 18 Cancelled: 0 Done-Ok: 704 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 704/1000 2014-08-18 14:56:37.432576 Submitted: 722 Running: 17 Cancelled: 0 Done-Ok: 705 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 705/1000 2014-08-18 14:56:37.716771 Submitted: 723 Running: 18 Cancelled: 0 Done-Ok: 705 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 705/1000 2014-08-18 14:56:39.275287 Submitted: 724 Running: 19 Cancelled: 0 Done-Ok: 705 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 705/1000 2014-08-18 14:56:39.926899 Submitted: 725 Running: 20 Cancelled: 0 Done-Ok: 705 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 705/1000 2014-08-18 14:57:30.229801 Submitted: 725 Running: 19 Cancelled: 0 Done-Ok: 706 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 706/1000 2014-08-18 14:57:32.129786 Submitted: 726 Running: 20 Cancelled: 0 Done-Ok: 706 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 706/1000 2014-08-18 14:57:35.080500 Submitted: 726 Running: 19 Cancelled: 0 Done-Ok: 707 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 707/1000 2014-08-18 14:57:36.481977 Submitted: 726 Running: 18 Cancelled: 0 Done-Ok: 708 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 708/1000 2014-08-18 14:57:37.443059 Submitted: 727 Running: 19 Cancelled: 0 Done-Ok: 708 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 708/1000 2014-08-18 14:57:38.085411 Submitted: 727 Running: 18 Cancelled: 0 Done-Ok: 709 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 709/1000 2014-08-18 14:57:38.852603 Submitted: 728 Running: 19 Cancelled: 0 Done-Ok: 709 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 709/1000 2014-08-18 14:57:40.600643 Submitted: 729 Running: 20 Cancelled: 0 Done-Ok: 709 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 709/1000 2014-08-18 14:58:30.981587 Submitted: 729 Running: 19 Cancelled: 0 Done-Ok: 710 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 710/1000 2014-08-18 14:58:33.086025 Submitted: 730 Running: 20 Cancelled: 0 Done-Ok: 710 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 710/1000 2014-08-18 14:58:35.873821 Submitted: 730 Running: 19 Cancelled: 0 Done-Ok: 711 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 711/1000 2014-08-18 14:58:36.789918 Submitted: 730 Running: 18 Cancelled: 0 Done-Ok: 712 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 712/1000 2014-08-1EAM117213390 2014-08-18 14:56:39.924664 Submit https://cert-08.pd.infn.it:8443/CREAM117213390 Left: 275 (at submission time:275) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM117213390 2014-08-18 14:57:35.078981 Exit https://cert-08.pd.infn.it:8443/CREAM732306068 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:57:35,796 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:57:35,820 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:57:35,821 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:57:35,821 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145735.log]\n', '2014-08-18 14:57:35,824 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:57:37,238 DEBUG - Will invoke JobStart for JobID [CREAM320751401]\n', 'https://cert-08.pd.infn.it:8443/CREAM320751401\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM320751401 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM320751401 2014-08-18 14:57:37.440243 Submit https://cert-08.pd.infn.it:8443/CREAM320751401 Left: 273 (at submission time:273) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM320751401 2014-08-18 14:58:36.787808 Exit https://cert-08.pd.infn.it:8443/CREAM156515421 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:58:37,988 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:58:38,016 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:58:38,016 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:58:38,016 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145838.log]\n', '2014-08-18 14:58:38,020 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:58:39,271 DEBUG - Will invoke JobStart for JobID [CREAM019956193]\n', 'https://cert-08.pd.infn.it:8443/CREAM019956193\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM019956193 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM019956193 2014-08-18 14:58:39.448481 Submit https://cert-08.pd.infn.it:8443/CREAM019956193 Left: 268 (at submission time:268) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM019956193 2014-08-18 14:59:35.786595 Exit https://cert-08.pd.infn.it:8443/CREAM149239605 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:59:36,470 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:59:36,494 DEBUG - VO from certificate=[dteam]\n', '201EAM650565444 2014-08-18 14:56:31.955198 Submit https://cert-08.pd.infn.it:8443/CREAM650565444 Left: 278 (at submission time:278) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM650565444 2014-08-18 14:58:35.872050 Exit https://cert-08.pd.infn.it:8443/CREAM385868671 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:58:36,712 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:58:36,736 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:58:36,736 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:58:36,736 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145836.log]\n', '2014-08-18 14:58:36,740 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:58:38,096 DEBUG - Will invoke JobStart for JobID [CREAM988979581]\n', 'https://cert-08.pd.infn.it:8443/CREAM988979581\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM988979581 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM988979581 2014-08-18 14:58:38.727215 Submit https://cert-08.pd.infn.it:8443/CREAM988979581 Left: 269 (at submission time:269) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM988979581 2014-08-18 14:58:39.053472 Exit https://cert-08.pd.infn.it:8443/CREAM865463168 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:58:39,583 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:58:39,607 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:58:39,607 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:58:39,607 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145839.log]\n', '2014-08-18 14:58:39,610 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:58:40,697 DEBUG - Will invoke JobStart for JobID [CREAM558012100]\n', 'https://cert-08.pd.infn.it:8443/CREAM558012100\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM558012100 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM558012100 2014-08-18 14:58:41.114196 Submit https://cert-08.pd.infn.it:8443/CREAM558012100 Left: 267 (at submission time:267) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM558012100 2014-08-18 14:59:38.635390 Exit https://cert-08.pd.infn.it:8443/CREAM882495258 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:59:39,368 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:59:39,399 DEBUG - VO from certificate=[dteam]\n', '201EAM404800424 2014-08-18 14:56:37.714774 Submit https://cert-08.pd.infn.it:8443/CREAM404800424 Left: 277 (at submission time:277) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM404800424 2014-08-18 14:57:38.080560 Exit https://cert-08.pd.infn.it:8443/CREAM441405364 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:57:38,770 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:57:38,802 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:57:38,802 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:57:38,802 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145738.log]\n', '2014-08-18 14:57:38,805 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:57:40,189 DEBUG - Will invoke JobStart for JobID [CREAM175904788]\n', 'https://cert-08.pd.infn.it:8443/CREAM175904788\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM175904788 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM175904788 2014-08-18 14:57:40.597207 Submit https://cert-08.pd.infn.it:8443/CREAM175904788 Left: 271 (at submission time:271) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM175904788 2014-08-18 14:59:31.691318 Exit https://cert-08.pd.infn.it:8443/CREAM361470528 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:59:32,531 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:59:32,554 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:59:32,554 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:59:32,554 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145932.log]\n', '2014-08-18 14:59:32,557 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:59:34,060 DEBUG - Will invoke JobStart for JobID [CREAM717115800]\n', 'https://cert-08.pd.infn.it:8443/CREAM717115800\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM717115800 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM717115800 2014-08-18 14:59:34.340360 Submit https://cert-08.pd.infn.it:8443/CREAM717115800 Left: 266 (at submission time:266) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM717115800 2014-08-18 15:00:31.564427 Exit https://cert-08.pd.infn.it:8443/CREAM333718150 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:00:31,907 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:00:31,928 DEBUG - VO from certificate=[dteam]\n', '201EAM667759985 2014-08-18 14:56:39.272834 Submit https://cert-08.pd.infn.it:8443/CREAM667759985 Left: 276 (at submission time:276) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM667759985 2014-08-18 14:57:30.226838 Exit https://cert-08.pd.infn.it:8443/CREAM073465573 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:57:30,566 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:57:30,585 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:57:30,586 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:57:30,586 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145730.log]\n', '2014-08-18 14:57:30,598 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:57:31,753 DEBUG - Will invoke JobStart for JobID [CREAM831461941]\n', 'https://cert-08.pd.infn.it:8443/CREAM831461941\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM831461941 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM831461941 2014-08-18 14:57:32.128428 Submit https://cert-08.pd.infn.it:8443/CREAM831461941 Left: 274 (at submission time:274) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM831461941 2014-08-18 14:59:37.948723 Exit https://cert-08.pd.infn.it:8443/CREAM796744477 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:59:38,722 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:59:38,746 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:59:38,746 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:59:38,746 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145938.log]\n', '2014-08-18 14:59:38,749 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:59:40,219 DEBUG - Will invoke JobStart for JobID [CREAM046583648]\n', 'https://cert-08.pd.infn.it:8443/CREAM046583648\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM046583648 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM046583648 2014-08-18 14:59:40.683726 Submit https://cert-08.pd.infn.it:8443/CREAM046583648 Left: 264 (at submission time:264) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM046583648 2014-08-18 15:00:36.347816 Exit https://cert-08.pd.infn.it:8443/CREAM739832058 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:00:37,108 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:00:37,136 DEBUG - VO from certificate=[dteam]\n', '201EAM727917827 2014-08-18 14:55:41.235372 Submit https://cert-08.pd.infn.it:8443/CREAM727917827 Left: 279 (at submission time:279) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM727917827 2014-08-18 14:57:36.480046 Exit https://cert-08.pd.infn.it:8443/CREAM654963164 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:57:37,130 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:57:37,151 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:57:37,151 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:57:37,151 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145737.log]\n', '2014-08-18 14:57:37,160 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:57:38,490 DEBUG - Will invoke JobStart for JobID [CREAM126737846]\n', 'https://cert-08.pd.infn.it:8443/CREAM126737846\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM126737846 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM126737846 2014-08-18 14:57:38.849722 Submit https://cert-08.pd.infn.it:8443/CREAM126737846 Left: 272 (at submission time:272) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM126737846 2014-08-18 14:58:30.979388 Exit https://cert-08.pd.infn.it:8443/CREAM232544586 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 14:58:31,345 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 14:58:31,369 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 14:58:31,369 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:58:31,369 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145831.log]\n', '2014-08-18 14:58:31,383 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:58:32,712 DEBUG - Will invoke JobStart for JobID [CREAM452751454]\n', 'https://cert-08.pd.infn.it:8443/CREAM452751454\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM452751454 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM452751454 2014-08-18 14:58:33.078654 Submit https://cert-08.pd.infn.it:8443/CREAM452751454 Left: 270 (at submission time:270) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM452751454 2014-08-18 15:00:39.013992 Exit https://cert-08.pd.infn.it:8443/CREAM062094881 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:00:39,950 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:00:39,970 DEBUG - VO from certificate=[dteam]\n', '2018 14:58:38.729206 Submitted: 731 Running: 19 Cancelled: 0 Done-Ok: 712 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 712/1000 2014-08-18 14:58:39.056403 Submitted: 731 Running: 18 Cancelled: 0 Done-Ok: 713 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 713/1000 2014-08-18 14:58:39.451336 Submitted: 732 Running: 19 Cancelled: 0 Done-Ok: 713 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 713/1000 2014-08-18 14:58:41.118148 Submitted: 733 Running: 20 Cancelled: 0 Done-Ok: 713 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 713/1000 2014-08-18 14:59:31.693100 Submitted: 733 Running: 19 Cancelled: 0 Done-Ok: 714 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 714/1000 2014-08-18 14:59:34.343231 Submitted: 734 Running: 20 Cancelled: 0 Done-Ok: 714 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 714/1000 2014-08-18 14:59:35.789737 Submitted: 734 Running: 19 Cancelled: 0 Done-Ok: 715 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 715/1000 2014-08-18 14:59:37.951595 Submitted: 734 Running: 18 Cancelled: 0 Done-Ok: 716 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 716/1000 2014-08-18 14:59:38.157888 Submitted: 735 Running: 19 Cancelled: 0 Done-Ok: 716 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 716/1000 2014-08-18 14:59:38.638044 Submitted: 735 Running: 18 Cancelled: 0 Done-Ok: 717 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 717/1000 2014-08-18 14:59:40.685705 Submitted: 736 Running: 19 Cancelled: 0 Done-Ok: 717 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 717/1000 2014-08-18 14:59:41.182646 Submitted: 737 Running: 20 Cancelled: 0 Done-Ok: 717 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 717/1000 2014-08-18 15:00:31.567836 Submitted: 737 Running: 19 Cancelled: 0 Done-Ok: 718 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 718/1000 2014-08-18 15:00:33.332648 Submitted: 738 Running: 20 Cancelled: 0 Done-Ok: 718 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 718/1000 2014-08-18 15:00:36.350583 Submitted: 738 Running: 19 Cancelled: 0 Done-Ok: 719 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 719/1000 2014-08-18 15:00:38.901103 Submitted: 739 Running: 20 Cancelled: 0 Done-Ok: 719 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 719/1000 2014-08-18 15:00:39.017575 Submitted: 739 Running: 19 Cancelled: 0 Done-Ok: 720 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 720/1000 2014-08-18 15:00:41.829870 Submitted: 740 Running: 20 Cancelled: 0 Done-Ok: 720 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 720/1000 2014-08-18 15:00:42.202695 Submitted: 740 Running: 19 Cancelled: 0 Done-Ok: 721 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 721/1000 2014-08-18 15:00:44.490654 Submitted: 741 Running: 20 Cancelled: 0 Done-Ok: 721 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 721/1000 2014-4-08-18 15:00:37,136 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:00:37,136 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150037.log]\n', '2014-08-18 15:00:37,139 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:00:38,501 DEBUG - Will invoke JobStart for JobID [CREAM865046426]\n', 'https://cert-08.pd.infn.it:8443/CREAM865046426\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM865046426 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM865046426 2014-08-18 15:00:38.898503 Submit https://cert-08.pd.infn.it:8443/CREAM865046426 Left: 261 (at submission time:261) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM865046426 2014-08-18 15:01:37.108037 Exit https://cert-08.pd.infn.it:8443/CREAM667759985 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:01:37,740 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:01:37,763 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:01:37,763 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:01:37,764 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150137.log]\n', '2014-08-18 15:01:37,766 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:01:39,237 DEBUG - Will invoke JobStart for JobID [CREAM024663029]\n', 'https://cert-08.pd.infn.it:8443/CREAM024663029\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM024663029 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM024663029 2014-08-18 15:01:39.653780 Submit https://cert-08.pd.infn.it:8443/CREAM024663029 Left: 257 (at submission time:257) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM024663029 2014-08-18 15:02:32.689947 Exit https://cert-08.pd.infn.it:8443/CREAM831461941 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:02:33,033 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:02:33,053 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:02:33,053 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:02:33,053 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150233.log]\n', '2014-08-18 15:02:33,057 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:02:34,110 DEBUG - Will invoke JobStart for JobID [CREAM753454371]\n', 'https://cert-08.pd.infn.it:8443/CREAM753454371\n'] job submission failed?! job 4-08-18 14:59:36,494 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:59:36,494 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145936.log]\n', '2014-08-18 14:59:36,497 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:59:37,823 DEBUG - Will invoke JobStart for JobID [CREAM513244374]\n', 'https://cert-08.pd.infn.it:8443/CREAM513244374\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM513244374 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM513244374 2014-08-18 14:59:38.155282 Submit https://cert-08.pd.infn.it:8443/CREAM513244374 Left: 265 (at submission time:265) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM513244374 2014-08-18 15:01:39.087476 Exit https://cert-08.pd.infn.it:8443/CREAM117213390 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:01:39,562 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:01:39,585 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:01:39,585 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:01:39,585 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150139.log]\n', '2014-08-18 15:01:39,588 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:01:41,228 DEBUG - Will invoke JobStart for JobID [CREAM949713643]\n', 'https://cert-08.pd.infn.it:8443/CREAM949713643\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM949713643 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM949713643 2014-08-18 15:01:41.478959 Submit https://cert-08.pd.infn.it:8443/CREAM949713643 Left: 256 (at submission time:256) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM949713643 2014-08-18 15:02:38.080322 Exit https://cert-08.pd.infn.it:8443/CREAM320751401 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:02:38,712 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:02:38,734 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:02:38,734 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:02:38,735 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150238.log]\n', '2014-08-18 15:02:38,738 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:02:39,944 DEBUG - Will invoke JobStart for JobID [CREAM392804198]\n', 'https://cert-08.pd.infn.it:8443/CREAM392804198\n'] job submission failed?! job 4-08-18 15:00:39,970 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:00:39,971 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150039.log]\n', '2014-08-18 15:00:39,973 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:00:41,505 DEBUG - Will invoke JobStart for JobID [CREAM752420490]\n', 'https://cert-08.pd.infn.it:8443/CREAM752420490\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM752420490 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM752420490 2014-08-18 15:00:41.825833 Submit https://cert-08.pd.infn.it:8443/CREAM752420490 Left: 260 (at submission time:260) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM752420490 2014-08-18 15:00:42.200358 Exit https://cert-08.pd.infn.it:8443/CREAM727917827 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:00:42,893 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:00:42,919 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:00:42,919 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:00:42,919 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150042.log]\n', '2014-08-18 15:00:42,935 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:00:44,280 DEBUG - Will invoke JobStart for JobID [CREAM029018751]\n', 'https://cert-08.pd.infn.it:8443/CREAM029018751\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM029018751 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM029018751 2014-08-18 15:00:44.490015 Submit https://cert-08.pd.infn.it:8443/CREAM029018751 Left: 259 (at submission time:259) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM029018751 2014-08-18 15:02:39.290439 Exit https://cert-08.pd.infn.it:8443/CREAM126737846 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:02:40,133 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:02:40,156 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:02:40,157 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:02:40,157 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150240.log]\n', '2014-08-18 15:02:40,160 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:02:41,510 DEBUG - Will invoke JobStart for JobID [CREAM441694437]\n', 'https://cert-08.pd.infn.it:8443/CREAM441694437\n'] job submission failed?! job 4-08-18 15:00:31,928 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:00:31,928 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150031.log]\n', '2014-08-18 15:00:31,943 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:00:33,227 DEBUG - Will invoke JobStart for JobID [CREAM285489288]\n', 'https://cert-08.pd.infn.it:8443/CREAM285489288\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM285489288 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM285489288 2014-08-18 15:00:33.330618 Submit https://cert-08.pd.infn.it:8443/CREAM285489288 Left: 262 (at submission time:262) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM285489288 2014-08-18 15:01:39.454443 Exit https://cert-08.pd.infn.it:8443/CREAM404800424 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:01:40,560 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:01:40,584 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:01:40,584 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:01:40,584 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150140.log]\n', '2014-08-18 15:01:40,592 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:01:41,978 DEBUG - Will invoke JobStart for JobID [CREAM063395918]\n', 'https://cert-08.pd.infn.it:8443/CREAM063395918\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM063395918 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM063395918 2014-08-18 15:01:42.244287 Submit https://cert-08.pd.infn.it:8443/CREAM063395918 Left: 255 (at submission time:255) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM063395918 2014-08-18 15:02:39.404299 Exit https://cert-08.pd.infn.it:8443/CREAM175904788 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:02:40,398 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:02:40,420 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:02:40,421 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:02:40,421 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150240.log]\n', '2014-08-18 15:02:40,430 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:02:41,803 DEBUG - Will invoke JobStart for JobID [CREAM834666324]\n', 'https://cert-08.pd.infn.it:8443/CREAM834666324\n'] job submission failed?! job 4-08-18 14:59:39,399 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 14:59:39,399 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-145939.log]\n', '2014-08-18 14:59:39,407 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 14:59:40,861 DEBUG - Will invoke JobStart for JobID [CREAM904224799]\n', 'https://cert-08.pd.infn.it:8443/CREAM904224799\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM904224799 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM904224799 2014-08-18 14:59:41.179388 Submit https://cert-08.pd.infn.it:8443/CREAM904224799 Left: 263 (at submission time:263) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM904224799 2014-08-18 15:01:32.172633 Exit https://cert-08.pd.infn.it:8443/CREAM650565444 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:01:32,531 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:01:32,556 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:01:32,556 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:01:32,556 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150132.log]\n', '2014-08-18 15:01:32,560 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:01:33,936 DEBUG - Will invoke JobStart for JobID [CREAM326833877]\n', 'https://cert-08.pd.infn.it:8443/CREAM326833877\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM326833877 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM326833877 2014-08-18 15:01:34.253280 Submit https://cert-08.pd.infn.it:8443/CREAM326833877 Left: 258 (at submission time:258) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM326833877 2014-08-18 15:03:38.862209 Exit https://cert-08.pd.infn.it:8443/CREAM988979581 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:03:39,439 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:03:39,468 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:03:39,468 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:03:39,468 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150339.log]\n', '2014-08-18 15:03:39,472 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:03:40,782 DEBUG - Will invoke JobStart for JobID [CREAM988327381]\n', 'https://cert-08.pd.infn.it:8443/CREAM988327381\n'] job submission failed?! job 08-18 15:01:32.176195 Submitted: 741 Running: 19 Cancelled: 0 Done-Ok: 722 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 722/1000 2014-08-18 15:01:34.257979 Submitted: 742 Running: 20 Cancelled: 0 Done-Ok: 722 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 722/1000 2014-08-18 15:01:37.109801 Submitted: 742 Running: 19 Cancelled: 0 Done-Ok: 723 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 723/1000 2014-08-18 15:01:39.089255 Submitted: 742 Running: 18 Cancelled: 0 Done-Ok: 724 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 724/1000 2014-08-18 15:01:39.456920 Submitted: 742 Running: 17 Cancelled: 0 Done-Ok: 725 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 725/1000 2014-08-18 15:01:39.656725 Submitted: 743 Running: 18 Cancelled: 0 Done-Ok: 725 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 725/1000 2014-08-18 15:01:41.481958 Submitted: 744 Running: 19 Cancelled: 0 Done-Ok: 725 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 725/1000 2014-08-18 15:01:42.245738 Submitted: 745 Running: 20 Cancelled: 0 Done-Ok: 725 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 725/1000 2014-08-18 15:02:32.691781 Submitted: 745 Running: 19 Cancelled: 0 Done-Ok: 726 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 726/1000 2014-08-18 15:02:34.490419 Submitted: 746 Running: 20 Cancelled: 0 Done-Ok: 726 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 726/1000 2014-08-18 15:02:38.082735 Submitted: 746 Running: 19 Cancelled: 0 Done-Ok: 727 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 727/1000 2014-08-18 15:02:39.292050 Submitted: 746 Running: 18 Cancelled: 0 Done-Ok: 728 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 728/1000 2014-08-18 15:02:39.407832 Submitted: 746 Running: 17 Cancelled: 0 Done-Ok: 729 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 729/1000 2014-08-18 15:02:40.373691 Submitted: 747 Running: 18 Cancelled: 0 Done-Ok: 729 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 729/1000 2014-08-18 15:02:41.883895 Submitted: 748 Running: 19 Cancelled: 0 Done-Ok: 729 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 729/1000 2014-08-18 15:02:42.144116 Submitted: 749 Running: 20 Cancelled: 0 Done-Ok: 729 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 729/1000 2014-08-18 15:03:33.302719 Submitted: 749 Running: 19 Cancelled: 0 Done-Ok: 730 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 730/1000 2014-08-18 15:03:35.220349 Submitted: 750 Running: 20 Cancelled: 0 Done-Ok: 730 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 730/1000 2014-08-18 15:03:38.863628 Submitted: 750 Running: 19 Cancelled: 0 Done-Ok: 731 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 731/1000 2014-08-18 15:03:39.346921 Submitted: 750 Running: 18 Cancelled: 0 Done-Ok: 732 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 732/1000 2submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM441694437 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM441694437 2014-08-18 15:02:41.880699 Submit https://cert-08.pd.infn.it:8443/CREAM441694437 Left: 252 (at submission time:252) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM441694437 2014-08-18 15:03:33.301170 Exit https://cert-08.pd.infn.it:8443/CREAM452751454 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:03:33,619 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:03:33,653 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:03:33,654 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:03:33,654 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150333.log]\n', '2014-08-18 15:03:33,657 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:03:34,794 DEBUG - Will invoke JobStart for JobID [CREAM083670121]\n', 'https://cert-08.pd.infn.it:8443/CREAM083670121\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM083670121 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM083670121 2014-08-18 15:03:35.217503 Submit https://cert-08.pd.infn.it:8443/CREAM083670121 Left: 250 (at submission time:250) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM083670121 2014-08-18 15:05:39.813486 Exit https://cert-08.pd.infn.it:8443/CREAM752420490 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:05:40,883 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:05:40,903 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:05:40,904 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:05:40,904 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150540.log]\n', '2014-08-18 15:05:40,908 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:05:42,382 DEBUG - Will invoke JobStart for JobID [CREAM958534128]\n', 'https://cert-08.pd.infn.it:8443/CREAM958534128\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM958534128 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM958534128 2014-08-18 15:05:42.626308 Submit https://cert-08.pd.infn.it:8443/CREAM958534128 Left: 240 (at submission time:240) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM958534128 2014-08-18 15:05:42.958538 Exit https://cert-08.pd.infn.it:8443/CREAM029018751 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION 014-08-18 15:03:41.253239 Submitted: 751 Running: 19 Cancelled: 0 Done-Ok: 732 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 732/1000 2014-08-18 15:03:41.707807 Submitted: 751 Running: 18 Cancelled: 0 Done-Ok: 733 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 733/1000 2014-08-18 15:03:41.932381 Submitted: 752 Running: 19 Cancelled: 0 Done-Ok: 733 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 733/1000 2014-08-18 15:03:44.399607 Submitted: 753 Running: 20 Cancelled: 0 Done-Ok: 733 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 733/1000 2014-08-18 15:04:33.732357 Submitted: 753 Running: 19 Cancelled: 0 Done-Ok: 734 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 734/1000 2014-08-18 15:04:35.555514 Submitted: 754 Running: 20 Cancelled: 0 Done-Ok: 734 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 734/1000 2014-08-18 15:04:38.152979 Submitted: 754 Running: 19 Cancelled: 0 Done-Ok: 735 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 735/1000 2014-08-18 15:04:40.242135 Submitted: 754 Running: 18 Cancelled: 0 Done-Ok: 736 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 736/1000 2014-08-18 15:04:40.423841 Submitted: 755 Running: 19 Cancelled: 0 Done-Ok: 736 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 736/1000 2014-08-18 15:04:41.190804 Submitted: 755 Running: 18 Cancelled: 0 Done-Ok: 737 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 737/1000 2014-08-18 15:04:42.750020 Submitted: 756 Running: 19 Cancelled: 0 Done-Ok: 737 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 737/1000 2014-08-18 15:04:43.562441 Submitted: 757 Running: 20 Cancelled: 0 Done-Ok: 737 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 737/1000 2014-08-18 15:05:34.218128 Submitted: 757 Running: 19 Cancelled: 0 Done-Ok: 738 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 738/1000 2014-08-18 15:05:36.182810 Submitted: 758 Running: 20 Cancelled: 0 Done-Ok: 738 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 738/1000 2014-08-18 15:05:39.280943 Submitted: 758 Running: 19 Cancelled: 0 Done-Ok: 739 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 739/1000 2014-08-18 15:05:39.816649 Submitted: 758 Running: 18 Cancelled: 0 Done-Ok: 740 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 740/1000 2014-08-18 15:05:41.797580 Submitted: 759 Running: 19 Cancelled: 0 Done-Ok: 740 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 740/1000 2014-08-18 15:05:42.628157 Submitted: 760 Running: 20 Cancelled: 0 Done-Ok: 740 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 740/1000 2014-08-18 15:05:42.961412 Submitted: 760 Running: 19 Cancelled: 0 Done-Ok: 741 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 741/1000 2014-08-18 15:05:45.560394 Submitted: 761 Running: 20 Cancelled: 0 Done-Ok: 741 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 741/10submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM988327381 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM988327381 2014-08-18 15:03:41.250155 Submit https://cert-08.pd.infn.it:8443/CREAM988327381 Left: 249 (at submission time:249) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM988327381 2014-08-18 15:03:41.706616 Exit https://cert-08.pd.infn.it:8443/CREAM558012100 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:03:42,452 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:03:42,476 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:03:42,476 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:03:42,476 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150342.log]\n', '2014-08-18 15:03:42,490 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:03:44,002 DEBUG - Will invoke JobStart for JobID [CREAM994387288]\n', 'https://cert-08.pd.infn.it:8443/CREAM994387288\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM994387288 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM994387288 2014-08-18 15:03:44.395789 Submit https://cert-08.pd.infn.it:8443/CREAM994387288 Left: 247 (at submission time:247) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM994387288 2014-08-18 15:04:40.240805 Exit https://cert-08.pd.infn.it:8443/CREAM904224799 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:04:41,137 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:04:41,161 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:04:41,161 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:04:41,161 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150441.log]\n', '2014-08-18 15:04:41,171 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:04:42,310 DEBUG - Will invoke JobStart for JobID [CREAM608788323]\n', 'https://cert-08.pd.infn.it:8443/CREAM608788323\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM608788323 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM608788323 2014-08-18 15:04:42.748818 Submit https://cert-08.pd.infn.it:8443/CREAM608788323 Left: 244 (at submission time:244) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM608788323 2014-08-18 15:06:34.518005 Exit https://cert-08.pd.infn.it:8443/CREAM326833877 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM392804198 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM392804198 2014-08-18 15:02:40.370577 Submit https://cert-08.pd.infn.it:8443/CREAM392804198 Left: 253 (at submission time:253) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM392804198 2014-08-18 15:03:39.345859 Exit https://cert-08.pd.infn.it:8443/CREAM019956193 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:03:40,135 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:03:40,156 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:03:40,156 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:03:40,156 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150340.log]\n', '2014-08-18 15:03:40,159 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:03:41,702 DEBUG - Will invoke JobStart for JobID [CREAM845393357]\n', 'https://cert-08.pd.infn.it:8443/CREAM845393357\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM845393357 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM845393357 2014-08-18 15:03:41.929111 Submit https://cert-08.pd.infn.it:8443/CREAM845393357 Left: 248 (at submission time:248) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM845393357 2014-08-18 15:04:38.151240 Exit https://cert-08.pd.infn.it:8443/CREAM513244374 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:04:38,962 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:04:38,985 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:04:38,985 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:04:38,985 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150438.log]\n', '2014-08-18 15:04:38,988 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:04:40,171 DEBUG - Will invoke JobStart for JobID [CREAM057835732]\n', 'https://cert-08.pd.infn.it:8443/CREAM057835732\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM057835732 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM057835732 2014-08-18 15:04:40.421619 Submit https://cert-08.pd.infn.it:8443/CREAM057835732 Left: 245 (at submission time:245) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM057835732 2014-08-18 15:06:39.613670 Exit https://cert-08.pd.infn.it:8443/CREAM949713643 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM834666324 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM834666324 2014-08-18 15:02:42.142564 Submit https://cert-08.pd.infn.it:8443/CREAM834666324 Left: 251 (at submission time:251) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM834666324 2014-08-18 15:04:33.730230 Exit https://cert-08.pd.infn.it:8443/CREAM717115800 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:04:34,065 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:04:34,086 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:04:34,086 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:04:34,086 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150434.log]\n', '2014-08-18 15:04:34,091 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:04:35,260 DEBUG - Will invoke JobStart for JobID [CREAM654488792]\n', 'https://cert-08.pd.infn.it:8443/CREAM654488792\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM654488792 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM654488792 2014-08-18 15:04:35.551444 Submit https://cert-08.pd.infn.it:8443/CREAM654488792 Left: 246 (at submission time:246) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM654488792 2014-08-18 15:05:34.215486 Exit https://cert-08.pd.infn.it:8443/CREAM285489288 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:05:34,552 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:05:34,580 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:05:34,580 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:05:34,580 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150534.log]\n', '2014-08-18 15:05:34,589 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:05:35,726 DEBUG - Will invoke JobStart for JobID [CREAM691867721]\n', 'https://cert-08.pd.infn.it:8443/CREAM691867721\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM691867721 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM691867721 2014-08-18 15:05:36.180254 Submit https://cert-08.pd.infn.it:8443/CREAM691867721 Left: 242 (at submission time:242) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM691867721 2014-08-18 15:06:41.294332 Exit https://cert-08.pd.infn.it:8443/CREAM063395918 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM753454371 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM753454371 2014-08-18 15:02:34.486922 Submit https://cert-08.pd.infn.it:8443/CREAM753454371 Left: 254 (at submission time:254) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM753454371 2014-08-18 15:04:41.187435 Exit https://cert-08.pd.infn.it:8443/CREAM046583648 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:04:42,136 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:04:42,159 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:04:42,159 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:04:42,159 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150442.log]\n', '2014-08-18 15:04:42,162 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:04:43,317 DEBUG - Will invoke JobStart for JobID [CREAM506351788]\n', 'https://cert-08.pd.infn.it:8443/CREAM506351788\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM506351788 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM506351788 2014-08-18 15:04:43.560550 Submit https://cert-08.pd.infn.it:8443/CREAM506351788 Left: 243 (at submission time:243) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM506351788 2014-08-18 15:05:39.277995 Exit https://cert-08.pd.infn.it:8443/CREAM865046426 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:05:40,030 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:05:40,054 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:05:40,054 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:05:40,054 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150540.log]\n', '2014-08-18 15:05:40,057 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:05:41,436 DEBUG - Will invoke JobStart for JobID [CREAM845388555]\n', 'https://cert-08.pd.infn.it:8443/CREAM845388555\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM845388555 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM845388555 2014-08-18 15:05:41.794063 Submit https://cert-08.pd.infn.it:8443/CREAM845388555 Left: 241 (at submission time:241) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM845388555 2014-08-18 15:06:41.828048 Exit https://cert-08.pd.infn.it:8443/CREAM024663029 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:05:43,860 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:05:43,884 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:05:43,884 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:05:43,884 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150543.log]\n', '2014-08-18 15:05:43,887 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:05:45,275 DEBUG - Will invoke JobStart for JobID [CREAM081605577]\n', 'https://cert-08.pd.infn.it:8443/CREAM081605577\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM081605577 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM081605577 2014-08-18 15:05:45.557880 Submit https://cert-08.pd.infn.it:8443/CREAM081605577 Left: 239 (at submission time:239) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM081605577 2014-08-18 15:07:42.712805 Exit https://cert-08.pd.infn.it:8443/CREAM441694437 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:07:43,517 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:07:43,540 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:07:43,540 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:07:43,540 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150743.log]\n', '2014-08-18 15:07:43,543 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:07:44,624 DEBUG - Will invoke JobStart for JobID [CREAM664188996]\n', 'https://cert-08.pd.infn.it:8443/CREAM664188996\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM664188996 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM664188996 2014-08-18 15:07:45.005229 Submit https://cert-08.pd.infn.it:8443/CREAM664188996 Left: 231 (at submission time:231) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM664188996 2014-08-18 15:08:35.863407 Exit https://cert-08.pd.infn.it:8443/CREAM083670121 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:08:36,255 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:08:36,273 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:08:36,273 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:08:36,273 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150836.log]\n', '2014-08-18 15:08:36,280 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '200 2014-08-18 15:06:34.519355 Submitted: 761 Running: 19 Cancelled: 0 Done-Ok: 742 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 742/1000 2014-08-18 15:06:36.502984 Submitted: 762 Running: 20 Cancelled: 0 Done-Ok: 742 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 742/1000 2014-08-18 15:06:39.617210 Submitted: 762 Running: 19 Cancelled: 0 Done-Ok: 743 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 743/1000 2014-08-18 15:06:41.295749 Submitted: 762 Running: 18 Cancelled: 0 Done-Ok: 744 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 744/1000 2014-08-18 15:06:41.829851 Submitted: 762 Running: 17 Cancelled: 0 Done-Ok: 745 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 745/1000 2014-08-18 15:06:42.233819 Submitted: 763 Running: 18 Cancelled: 0 Done-Ok: 745 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 745/1000 2014-08-18 15:06:43.938462 Submitted: 764 Running: 19 Cancelled: 0 Done-Ok: 745 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 745/1000 2014-08-18 15:06:44.745228 Submitted: 765 Running: 20 Cancelled: 0 Done-Ok: 745 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 745/1000 2014-08-18 15:07:35.188928 Submitted: 765 Running: 19 Cancelled: 0 Done-Ok: 746 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 746/1000 2014-08-18 15:07:36.960245 Submitted: 766 Running: 20 Cancelled: 0 Done-Ok: 746 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 746/1000 2014-08-18 15:07:39.400767 Submitted: 766 Running: 19 Cancelled: 0 Done-Ok: 747 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 747/1000 2014-08-18 15:07:40.820320 Submitted: 766 Running: 18 Cancelled: 0 Done-Ok: 748 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 748/1000 2014-08-18 15:07:41.715837 Submitted: 767 Running: 19 Cancelled: 0 Done-Ok: 748 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 748/1000 2014-08-18 15:07:42.713953 Submitted: 767 Running: 18 Cancelled: 0 Done-Ok: 749 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 749/1000 2014-08-18 15:07:42.987463 Submitted: 768 Running: 19 Cancelled: 0 Done-Ok: 749 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 749/1000 2014-08-18 15:07:45.007366 Submitted: 769 Running: 20 Cancelled: 0 Done-Ok: 749 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 749/1000 2014-08-18 15:08:35.866273 Submitted: 769 Running: 19 Cancelled: 0 Done-Ok: 750 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 750/1000 2014-08-18 15:08:37.607289 Submitted: 770 Running: 20 Cancelled: 0 Done-Ok: 750 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 750/1000 2014-08-18 15:08:39.939623 Submitted: 770 Running: 19 Cancelled: 0 Done-Ok: 751 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 751/1000 2014-08-18 15:08:41.239729 Submitted: 770 Running: 18 Cancelled: 0 Done-Ok: 752 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 75output: ['2014-08-18 15:06:40,333 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:06:40,355 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:06:40,355 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:06:40,355 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150640.log]\n', '2014-08-18 15:06:40,358 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:06:41,890 DEBUG - Will invoke JobStart for JobID [CREAM889884587]\n', 'https://cert-08.pd.infn.it:8443/CREAM889884587\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM889884587 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM889884587 2014-08-18 15:06:42.231598 Submit https://cert-08.pd.infn.it:8443/CREAM889884587 Left: 237 (at submission time:237) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM889884587 2014-08-18 15:07:39.399394 Exit https://cert-08.pd.infn.it:8443/CREAM392804198 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:07:40,230 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:07:40,254 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:07:40,254 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:07:40,254 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150740.log]\n', '2014-08-18 15:07:40,257 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:07:41,346 DEBUG - Will invoke JobStart for JobID [CREAM769232677]\n', 'https://cert-08.pd.infn.it:8443/CREAM769232677\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM769232677 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM769232677 2014-08-18 15:07:41.713299 Submit https://cert-08.pd.infn.it:8443/CREAM769232677 Left: 233 (at submission time:233) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM769232677 2014-08-18 15:08:41.237465 Exit https://cert-08.pd.infn.it:8443/CREAM845393357 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:08:42,052 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:08:42,077 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:08:42,077 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:08:42,077 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150842.log]\n', '2014-08-18 15:08:42,080 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2output: ['2014-08-18 15:06:34,870 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:06:34,900 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:06:34,900 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:06:34,900 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150634.log]\n', '2014-08-18 15:06:34,903 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:06:36,231 DEBUG - Will invoke JobStart for JobID [CREAM572570249]\n', 'https://cert-08.pd.infn.it:8443/CREAM572570249\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM572570249 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM572570249 2014-08-18 15:06:36.500143 Submit https://cert-08.pd.infn.it:8443/CREAM572570249 Left: 238 (at submission time:238) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM572570249 2014-08-18 15:08:39.935384 Exit https://cert-08.pd.infn.it:8443/CREAM988327381 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:08:40,642 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:08:40,665 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:08:40,665 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:08:40,665 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150840.log]\n', '2014-08-18 15:08:40,668 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:08:42,190 DEBUG - Will invoke JobStart for JobID [CREAM841716267]\n', 'https://cert-08.pd.infn.it:8443/CREAM841716267\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM841716267 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM841716267 2014-08-18 15:08:42.946227 Submit https://cert-08.pd.infn.it:8443/CREAM841716267 Left: 229 (at submission time:229) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM841716267 2014-08-18 15:08:43.283456 Exit https://cert-08.pd.infn.it:8443/CREAM994387288 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:08:43,952 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:08:43,981 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:08:43,981 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:08:43,981 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150843.log]\n', '2014-08-18 15:08:43,984 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2output: ['2014-08-18 15:06:42,073 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:06:42,096 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:06:42,096 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:06:42,096 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150642.log]\n', '2014-08-18 15:06:42,099 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:06:43,500 DEBUG - Will invoke JobStart for JobID [CREAM719521699]\n', 'https://cert-08.pd.infn.it:8443/CREAM719521699\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM719521699 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM719521699 2014-08-18 15:06:43.934894 Submit https://cert-08.pd.infn.it:8443/CREAM719521699 Left: 236 (at submission time:236) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM719521699 2014-08-18 15:07:40.817890 Exit https://cert-08.pd.infn.it:8443/CREAM834666324 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:07:41,498 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:07:41,524 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:07:41,524 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:07:41,524 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150741.log]\n', '2014-08-18 15:07:41,527 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:07:42,796 DEBUG - Will invoke JobStart for JobID [CREAM862867593]\n', 'https://cert-08.pd.infn.it:8443/CREAM862867593\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM862867593 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM862867593 2014-08-18 15:07:42.984632 Submit https://cert-08.pd.infn.it:8443/CREAM862867593 Left: 232 (at submission time:232) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM862867593 2014-08-18 15:09:36.317256 Exit https://cert-08.pd.infn.it:8443/CREAM654488792 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:09:36,667 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:09:36,715 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:09:36,715 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:09:36,715 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150936.log]\n', '2014-08-18 15:09:36,725 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2output: ['2014-08-18 15:06:42,913 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:06:42,932 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:06:42,932 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:06:42,932 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150642.log]\n', '2014-08-18 15:06:42,935 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:06:44,507 DEBUG - Will invoke JobStart for JobID [CREAM940891595]\n', 'https://cert-08.pd.infn.it:8443/CREAM940891595\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM940891595 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM940891595 2014-08-18 15:06:44.742080 Submit https://cert-08.pd.infn.it:8443/CREAM940891595 Left: 235 (at submission time:235) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM940891595 2014-08-18 15:07:35.186835 Exit https://cert-08.pd.infn.it:8443/CREAM753454371 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:07:35,541 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:07:35,583 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:07:35,583 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:07:35,583 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150735.log]\n', '2014-08-18 15:07:35,592 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:07:36,681 DEBUG - Will invoke JobStart for JobID [CREAM530224410]\n', 'https://cert-08.pd.infn.it:8443/CREAM530224410\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM530224410 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM530224410 2014-08-18 15:07:36.959219 Submit https://cert-08.pd.infn.it:8443/CREAM530224410 Left: 234 (at submission time:234) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM530224410 2014-08-18 15:09:43.036002 Exit https://cert-08.pd.infn.it:8443/CREAM506351788 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:09:43,874 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:09:43,897 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:09:43,898 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:09:43,898 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150943.log]\n', '2014-08-18 15:09:43,901 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '22/1000 2014-08-18 15:08:42.948346 Submitted: 771 Running: 19 Cancelled: 0 Done-Ok: 752 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 752/1000 2014-08-18 15:08:43.287844 Submitted: 771 Running: 18 Cancelled: 0 Done-Ok: 753 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 753/1000 2014-08-18 15:08:43.527659 Submitted: 772 Running: 19 Cancelled: 0 Done-Ok: 753 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 753/1000 2014-08-18 15:08:45.743491 Submitted: 773 Running: 20 Cancelled: 0 Done-Ok: 753 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 753/1000 2014-08-18 15:09:36.318930 Submitted: 773 Running: 19 Cancelled: 0 Done-Ok: 754 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 754/1000 2014-08-18 15:09:38.214380 Submitted: 774 Running: 20 Cancelled: 0 Done-Ok: 754 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 754/1000 2014-08-18 15:09:40.008197 Submitted: 774 Running: 19 Cancelled: 0 Done-Ok: 755 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 755/1000 2014-08-18 15:09:42.279655 Submitted: 774 Running: 18 Cancelled: 0 Done-Ok: 756 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 756/1000 2014-08-18 15:09:42.487158 Submitted: 775 Running: 19 Cancelled: 0 Done-Ok: 756 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 756/1000 2014-08-18 15:09:43.039012 Submitted: 775 Running: 18 Cancelled: 0 Done-Ok: 757 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 757/1000 2014-08-18 15:09:44.895560 Submitted: 776 Running: 19 Cancelled: 0 Done-Ok: 757 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 757/1000 2014-08-18 15:09:45.840831 Submitted: 777 Running: 20 Cancelled: 0 Done-Ok: 757 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 757/1000 2014-08-18 15:10:36.497288 Submitted: 777 Running: 19 Cancelled: 0 Done-Ok: 758 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 758/1000 2014-08-18 15:10:38.554214 Submitted: 778 Running: 20 Cancelled: 0 Done-Ok: 758 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 758/1000 2014-08-18 15:10:40.723844 Submitted: 778 Running: 19 Cancelled: 0 Done-Ok: 759 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 759/1000 2014-08-18 15:10:43.040512 Submitted: 778 Running: 18 Cancelled: 0 Done-Ok: 760 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 760/1000 2014-08-18 15:10:43.161955 Submitted: 779 Running: 19 Cancelled: 0 Done-Ok: 760 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 760/1000 2014-08-18 15:10:45.652827 Submitted: 780 Running: 20 Cancelled: 0 Done-Ok: 760 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 760/1000 2014-08-18 15:10:46.032687 Submitted: 780 Running: 19 Cancelled: 0 Done-Ok: 761 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 761/1000 2014-08-18 15:10:48.462941 Submitted: 781 Running: 20 Cancelled: 0 Done-Ok: 761 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collecte014-08-18 15:09:45,558 DEBUG - Will invoke JobStart for JobID [CREAM680732095]\n', 'https://cert-08.pd.infn.it:8443/CREAM680732095\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM680732095 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM680732095 2014-08-18 15:09:45.839166 Submit https://cert-08.pd.infn.it:8443/CREAM680732095 Left: 223 (at submission time:223) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM680732095 2014-08-18 15:10:40.722231 Exit https://cert-08.pd.infn.it:8443/CREAM845388555 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:10:41,398 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:10:41,423 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:10:41,423 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:10:41,423 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151041.log]\n', '2014-08-18 15:10:41,427 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:10:42,741 DEBUG - Will invoke JobStart for JobID [CREAM876802753]\n', 'https://cert-08.pd.infn.it:8443/CREAM876802753\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM876802753 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM876802753 2014-08-18 15:10:43.158817 Submit https://cert-08.pd.infn.it:8443/CREAM876802753 Left: 221 (at submission time:221) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM876802753 2014-08-18 15:11:43.273908 Exit https://cert-08.pd.infn.it:8443/CREAM940891595 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:11:44,087 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:11:44,106 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:11:44,107 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:11:44,107 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151144.log]\n', '2014-08-18 15:11:44,110 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:11:45,523 DEBUG - Will invoke JobStart for JobID [CREAM738265611]\n', 'https://cert-08.pd.infn.it:8443/CREAM738265611\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM738265611 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM738265611 2014-08-18 15:11:45.888570 Submit https://cert-08.pd.infn.it:8443/CREAM738265611 Left: 216 (at submission time:216) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM738265611 2014-08-18 15:12:37.243726 Exit https://cert-08.pd.infn.it:8443/CREAM530224410 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-s014-08-18 15:08:43,197 DEBUG - Will invoke JobStart for JobID [CREAM481380967]\n', 'https://cert-08.pd.infn.it:8443/CREAM481380967\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM481380967 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM481380967 2014-08-18 15:08:43.523643 Submit https://cert-08.pd.infn.it:8443/CREAM481380967 Left: 228 (at submission time:228) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM481380967 2014-08-18 15:09:40.006244 Exit https://cert-08.pd.infn.it:8443/CREAM057835732 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:09:40,640 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:09:40,659 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:09:40,659 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:09:40,659 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150940.log]\n', '2014-08-18 15:09:40,663 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:09:42,092 DEBUG - Will invoke JobStart for JobID [CREAM558636044]\n', 'https://cert-08.pd.infn.it:8443/CREAM558636044\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM558636044 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM558636044 2014-08-18 15:09:42.485653 Submit https://cert-08.pd.infn.it:8443/CREAM558636044 Left: 225 (at submission time:225) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM558636044 2014-08-18 15:11:41.086168 Exit https://cert-08.pd.infn.it:8443/CREAM889884587 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:11:41,825 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:11:41,856 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:11:41,856 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:11:41,856 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151141.log]\n', '2014-08-18 15:11:41,859 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:11:43,387 DEBUG - Will invoke JobStart for JobID [CREAM320598125]\n', 'https://cert-08.pd.infn.it:8443/CREAM320598125\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM320598125 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM320598125 2014-08-18 15:11:43.712888 Submit https://cert-08.pd.infn.it:8443/CREAM320598125 Left: 217 (at submission time:217) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM320598125 2014-08-18 15:12:42.244982 Exit https://cert-08.pd.infn.it:8443/CREAM769232677 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-s014-08-18 15:08:37,311 DEBUG - Will invoke JobStart for JobID [CREAM635010195]\n', 'https://cert-08.pd.infn.it:8443/CREAM635010195\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM635010195 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM635010195 2014-08-18 15:08:37.602156 Submit https://cert-08.pd.infn.it:8443/CREAM635010195 Left: 230 (at submission time:230) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM635010195 2014-08-18 15:10:43.038070 Exit https://cert-08.pd.infn.it:8443/CREAM958534128 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:10:43,842 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:10:43,865 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:10:43,866 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:10:43,866 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151043.log]\n', '2014-08-18 15:10:43,869 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:10:45,341 DEBUG - Will invoke JobStart for JobID [CREAM055827418]\n', 'https://cert-08.pd.infn.it:8443/CREAM055827418\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM055827418 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM055827418 2014-08-18 15:10:45.650649 Submit https://cert-08.pd.infn.it:8443/CREAM055827418 Left: 220 (at submission time:220) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM055827418 2014-08-18 15:10:46.029004 Exit https://cert-08.pd.infn.it:8443/CREAM081605577 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:10:46,956 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:10:46,983 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:10:46,984 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:10:46,984 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151046.log]\n', '2014-08-18 15:10:46,990 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:10:48,171 DEBUG - Will invoke JobStart for JobID [CREAM947479795]\n', 'https://cert-08.pd.infn.it:8443/CREAM947479795\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM947479795 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM947479795 2014-08-18 15:10:48.459953 Submit https://cert-08.pd.infn.it:8443/CREAM947479795 Left: 219 (at submission time:219) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM947479795 2014-08-18 15:12:44.339034 Exit https://cert-08.pd.infn.it:8443/CREAM664188996 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-s014-08-18 15:09:37,881 DEBUG - Will invoke JobStart for JobID [CREAM645405859]\n', 'https://cert-08.pd.infn.it:8443/CREAM645405859\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM645405859 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM645405859 2014-08-18 15:09:38.210406 Submit https://cert-08.pd.infn.it:8443/CREAM645405859 Left: 226 (at submission time:226) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM645405859 2014-08-18 15:10:36.495648 Exit https://cert-08.pd.infn.it:8443/CREAM691867721 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:10:36,899 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:10:36,950 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:10:36,950 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:10:36,950 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151036.log]\n', '2014-08-18 15:10:36,960 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:10:38,249 DEBUG - Will invoke JobStart for JobID [CREAM601150438]\n', 'https://cert-08.pd.infn.it:8443/CREAM601150438\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM601150438 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM601150438 2014-08-18 15:10:38.551934 Submit https://cert-08.pd.infn.it:8443/CREAM601150438 Left: 222 (at submission time:222) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM601150438 2014-08-18 15:11:44.249744 Exit https://cert-08.pd.infn.it:8443/CREAM719521699 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:11:45,045 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:11:45,068 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:11:45,069 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:11:45,069 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151145.log]\n', '2014-08-18 15:11:45,071 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:11:46,456 DEBUG - Will invoke JobStart for JobID [CREAM766716301]\n', 'https://cert-08.pd.infn.it:8443/CREAM766716301\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM766716301 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM766716301 2014-08-18 15:11:46.786813 Submit https://cert-08.pd.infn.it:8443/CREAM766716301 Left: 215 (at submission time:215) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM766716301 2014-08-18 15:12:45.084749 Exit https://cert-08.pd.infn.it:8443/CREAM862867593 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-s014-08-18 15:08:45,539 DEBUG - Will invoke JobStart for JobID [CREAM236620127]\n', 'https://cert-08.pd.infn.it:8443/CREAM236620127\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM236620127 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM236620127 2014-08-18 15:08:45.739576 Submit https://cert-08.pd.infn.it:8443/CREAM236620127 Left: 227 (at submission time:227) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM236620127 2014-08-18 15:09:42.274952 Exit https://cert-08.pd.infn.it:8443/CREAM608788323 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:09:42,943 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:09:42,962 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:09:42,962 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:09:42,962 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-150942.log]\n', '2014-08-18 15:09:42,966 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:09:44,732 DEBUG - Will invoke JobStart for JobID [CREAM196031258]\n', 'https://cert-08.pd.infn.it:8443/CREAM196031258\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM196031258 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM196031258 2014-08-18 15:09:44.893915 Submit https://cert-08.pd.infn.it:8443/CREAM196031258 Left: 224 (at submission time:224) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM196031258 2014-08-18 15:11:36.836117 Exit https://cert-08.pd.infn.it:8443/CREAM572570249 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:11:37,202 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:11:37,229 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:11:37,229 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:11:37,230 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151137.log]\n', '2014-08-18 15:11:37,239 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:11:38,484 DEBUG - Will invoke JobStart for JobID [CREAM130320589]\n', 'https://cert-08.pd.infn.it:8443/CREAM130320589\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM130320589 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM130320589 2014-08-18 15:11:38.799743 Submit https://cert-08.pd.infn.it:8443/CREAM130320589 Left: 218 (at submission time:218) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM130320589 2014-08-18 15:13:43.051109 Exit https://cert-08.pd.infn.it:8443/CREAM841716267 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-sd 761/1000 2014-08-18 15:11:36.838404 Submitted: 781 Running: 19 Cancelled: 0 Done-Ok: 762 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 762/1000 2014-08-18 15:11:38.800874 Submitted: 782 Running: 20 Cancelled: 0 Done-Ok: 762 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 762/1000 2014-08-18 15:11:41.089607 Submitted: 782 Running: 19 Cancelled: 0 Done-Ok: 763 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 763/1000 2014-08-18 15:11:43.276433 Submitted: 782 Running: 18 Cancelled: 0 Done-Ok: 764 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 764/1000 2014-08-18 15:11:43.715583 Submitted: 783 Running: 19 Cancelled: 0 Done-Ok: 764 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 764/1000 2014-08-18 15:11:44.251997 Submitted: 783 Running: 18 Cancelled: 0 Done-Ok: 765 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 765/1000 2014-08-18 15:11:45.889903 Submitted: 784 Running: 19 Cancelled: 0 Done-Ok: 765 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 765/1000 2014-08-18 15:11:46.789647 Submitted: 785 Running: 20 Cancelled: 0 Done-Ok: 765 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 765/1000 2014-08-18 15:12:37.246588 Submitted: 785 Running: 19 Cancelled: 0 Done-Ok: 766 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 766/1000 2014-08-18 15:12:39.010090 Submitted: 786 Running: 20 Cancelled: 0 Done-Ok: 766 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 766/1000 2014-08-18 15:12:42.247959 Submitted: 786 Running: 19 Cancelled: 0 Done-Ok: 767 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 767/1000 2014-08-18 15:12:44.340562 Submitted: 786 Running: 18 Cancelled: 0 Done-Ok: 768 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 768/1000 2014-08-18 15:12:44.737781 Submitted: 787 Running: 19 Cancelled: 0 Done-Ok: 768 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 768/1000 2014-08-18 15:12:45.089548 Submitted: 787 Running: 18 Cancelled: 0 Done-Ok: 769 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 769/1000 2014-08-18 15:12:46.870493 Submitted: 788 Running: 19 Cancelled: 0 Done-Ok: 769 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 769/1000 2014-08-18 15:12:48.297637 Submitted: 789 Running: 20 Cancelled: 0 Done-Ok: 769 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 769/1000 2014-08-18 15:13:37.910008 Submitted: 789 Running: 19 Cancelled: 0 Done-Ok: 770 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 770/1000 2014-08-18 15:13:40.098241 Submitted: 790 Running: 20 Cancelled: 0 Done-Ok: 770 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 770/1000 2014-08-18 15:13:43.052993 Submitted: 790 Running: 19 Cancelled: 0 Done-Ok: 771 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 771/1000 2014-08-18 15:13:45.109598 Submitted: 790 Running: 18 Cancelled: 0 Done-Ok: 772 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collubmit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:12:43,091 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:12:43,114 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:12:43,114 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:12:43,114 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151243.log]\n', '2014-08-18 15:12:43,117 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:12:44,475 DEBUG - Will invoke JobStart for JobID [CREAM797093287]\n', 'https://cert-08.pd.infn.it:8443/CREAM797093287\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM797093287 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM797093287 2014-08-18 15:12:44.733461 Submit https://cert-08.pd.infn.it:8443/CREAM797093287 Left: 213 (at submission time:213) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM797093287 2014-08-18 15:13:45.107575 Exit https://cert-08.pd.infn.it:8443/CREAM481380967 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:13:45,802 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:13:45,821 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:13:45,821 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:13:45,821 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151345.log]\n', '2014-08-18 15:13:45,824 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:13:47,350 DEBUG - Will invoke JobStart for JobID [CREAM651248181]\n', 'https://cert-08.pd.infn.it:8443/CREAM651248181\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM651248181 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM651248181 2014-08-18 15:13:47.729872 Submit https://cert-08.pd.infn.it:8443/CREAM651248181 Left: 208 (at submission time:208) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM651248181 2014-08-18 15:14:42.413946 Exit https://cert-08.pd.infn.it:8443/CREAM558636044 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:14:43,081 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:14:43,116 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:14:43,116 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:14:43,116 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151443.log]\n', '2014-08-18 15:14:43,119 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executabubmit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:13:43,956 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:13:43,979 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:13:43,980 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:13:43,980 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151343.log]\n', '2014-08-18 15:13:43,982 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:13:45,330 DEBUG - Will invoke JobStart for JobID [CREAM365591417]\n', 'https://cert-08.pd.infn.it:8443/CREAM365591417\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM365591417 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM365591417 2014-08-18 15:13:45.729615 Submit https://cert-08.pd.infn.it:8443/CREAM365591417 Left: 209 (at submission time:209) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM365591417 2014-08-18 15:13:46.041104 Exit https://cert-08.pd.infn.it:8443/CREAM236620127 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:13:46,822 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:13:46,841 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:13:46,841 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:13:46,841 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151346.log]\n', '2014-08-18 15:13:46,845 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:13:48,291 DEBUG - Will invoke JobStart for JobID [CREAM640465177]\n', 'https://cert-08.pd.infn.it:8443/CREAM640465177\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM640465177 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM640465177 2014-08-18 15:13:48.604485 Submit https://cert-08.pd.infn.it:8443/CREAM640465177 Left: 207 (at submission time:207) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM640465177 2014-08-18 15:14:44.325429 Exit https://cert-08.pd.infn.it:8443/CREAM196031258 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:14:45,011 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:14:45,035 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:14:45,035 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:14:45,035 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151445.log]\n', '2014-08-18 15:14:45,038 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executabubmit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:12:46,036 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:12:46,061 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:12:46,061 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:12:46,061 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151246.log]\n', '2014-08-18 15:12:46,064 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:12:47,876 DEBUG - Will invoke JobStart for JobID [CREAM150509137]\n', 'https://cert-08.pd.infn.it:8443/CREAM150509137\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM150509137 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM150509137 2014-08-18 15:12:48.295733 Submit https://cert-08.pd.infn.it:8443/CREAM150509137 Left: 211 (at submission time:211) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM150509137 2014-08-18 15:14:37.894461 Exit https://cert-08.pd.infn.it:8443/CREAM645405859 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:14:38,362 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:14:38,396 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:14:38,397 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:14:38,397 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151438.log]\n', '2014-08-18 15:14:38,399 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:14:39,566 DEBUG - Will invoke JobStart for JobID [CREAM751851155]\n', 'https://cert-08.pd.infn.it:8443/CREAM751851155\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM751851155 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM751851155 2014-08-18 15:14:39.959598 Submit https://cert-08.pd.infn.it:8443/CREAM751851155 Left: 206 (at submission time:206) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM751851155 2014-08-18 15:15:38.769828 Exit https://cert-08.pd.infn.it:8443/CREAM601150438 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:15:39,093 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:15:39,120 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:15:39,120 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:15:39,120 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151539.log]\n', '2014-08-18 15:15:39,127 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executabubmit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:12:37,617 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:12:37,638 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:12:37,638 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:12:37,638 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151237.log]\n', '2014-08-18 15:12:37,646 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:12:38,831 DEBUG - Will invoke JobStart for JobID [CREAM683848808]\n', 'https://cert-08.pd.infn.it:8443/CREAM683848808\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM683848808 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM683848808 2014-08-18 15:12:39.008675 Submit https://cert-08.pd.infn.it:8443/CREAM683848808 Left: 214 (at submission time:214) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM683848808 2014-08-18 15:14:44.019265 Exit https://cert-08.pd.infn.it:8443/CREAM680732095 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:14:44,863 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:14:44,890 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:14:44,890 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:14:44,891 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151444.log]\n', '2014-08-18 15:14:44,894 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:14:46,456 DEBUG - Will invoke JobStart for JobID [CREAM156700547]\n', 'https://cert-08.pd.infn.it:8443/CREAM156700547\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM156700547 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM156700547 2014-08-18 15:14:46.602260 Submit https://cert-08.pd.infn.it:8443/CREAM156700547 Left: 204 (at submission time:204) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM156700547 2014-08-18 15:15:43.723984 Exit https://cert-08.pd.infn.it:8443/CREAM876802753 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:15:44,400 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:15:44,423 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:15:44,424 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:15:44,424 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151544.log]\n', '2014-08-18 15:15:44,427 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executabubmit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:12:44,954 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:12:44,981 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:12:44,981 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:12:44,981 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151244.log]\n', '2014-08-18 15:12:44,984 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:12:46,520 DEBUG - Will invoke JobStart for JobID [CREAM954103238]\n', 'https://cert-08.pd.infn.it:8443/CREAM954103238\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM954103238 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM954103238 2014-08-18 15:12:46.868577 Submit https://cert-08.pd.infn.it:8443/CREAM954103238 Left: 212 (at submission time:212) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM954103238 2014-08-18 15:13:37.907679 Exit https://cert-08.pd.infn.it:8443/CREAM635010195 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:13:38,281 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:13:38,304 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:13:38,305 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:13:38,305 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151338.log]\n', '2014-08-18 15:13:38,308 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:13:39,595 DEBUG - Will invoke JobStart for JobID [CREAM279763696]\n', 'https://cert-08.pd.infn.it:8443/CREAM279763696\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM279763696 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM279763696 2014-08-18 15:13:40.095148 Submit https://cert-08.pd.infn.it:8443/CREAM279763696 Left: 210 (at submission time:210) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM279763696 2014-08-18 15:15:45.182746 Exit https://cert-08.pd.infn.it:8443/CREAM055827418 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:15:45,879 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:15:45,917 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:15:45,917 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:15:45,917 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151545.log]\n', '2014-08-18 15:15:45,920 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executabected 772/1000 2014-08-18 15:13:45.732655 Submitted: 791 Running: 19 Cancelled: 0 Done-Ok: 772 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 772/1000 2014-08-18 15:13:46.044551 Submitted: 791 Running: 18 Cancelled: 0 Done-Ok: 773 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 773/1000 2014-08-18 15:13:47.731258 Submitted: 792 Running: 19 Cancelled: 0 Done-Ok: 773 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 773/1000 2014-08-18 15:13:48.609409 Submitted: 793 Running: 20 Cancelled: 0 Done-Ok: 773 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 773/1000 2014-08-18 15:14:37.897764 Submitted: 793 Running: 19 Cancelled: 0 Done-Ok: 774 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 774/1000 2014-08-18 15:14:39.960647 Submitted: 794 Running: 20 Cancelled: 0 Done-Ok: 774 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 774/1000 2014-08-18 15:14:42.417270 Submitted: 794 Running: 19 Cancelled: 0 Done-Ok: 775 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 775/1000 2014-08-18 15:14:44.022062 Submitted: 794 Running: 18 Cancelled: 0 Done-Ok: 776 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 776/1000 2014-08-18 15:14:44.326825 Submitted: 794 Running: 17 Cancelled: 0 Done-Ok: 777 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 777/1000 2014-08-18 15:14:44.784859 Submitted: 795 Running: 18 Cancelled: 0 Done-Ok: 777 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 777/1000 2014-08-18 15:14:46.606724 Submitted: 796 Running: 19 Cancelled: 0 Done-Ok: 777 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 777/1000 2014-08-18 15:14:47.150977 Submitted: 797 Running: 20 Cancelled: 0 Done-Ok: 777 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 777/1000 2014-08-18 15:15:38.772339 Submitted: 797 Running: 19 Cancelled: 0 Done-Ok: 778 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 778/1000 2014-08-18 15:15:40.600909 Submitted: 798 Running: 20 Cancelled: 0 Done-Ok: 778 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 778/1000 2014-08-18 15:15:43.726010 Submitted: 798 Running: 19 Cancelled: 0 Done-Ok: 779 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 779/1000 2014-08-18 15:15:45.184994 Submitted: 798 Running: 18 Cancelled: 0 Done-Ok: 780 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 780/1000 2014-08-18 15:15:46.193779 Submitted: 799 Running: 19 Cancelled: 0 Done-Ok: 780 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 780/1000 2014-08-18 15:15:47.516915 Submitted: 800 Running: 20 Cancelled: 0 Done-Ok: 780 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 780/1000 2014-08-18 15:15:47.909360 Submitted: 800 Running: 19 Cancelled: 0 Done-Ok: 781 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 781/1000 2014-08-18 15:15:50.416717 Submitted: 801 Running: 20 Cancelled: 0 Done-Ok: 781 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 le = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:15:47,324 DEBUG - Will invoke JobStart for JobID [CREAM819127143]\n', 'https://cert-08.pd.infn.it:8443/CREAM819127143\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM819127143 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM819127143 2014-08-18 15:15:47.514348 Submit https://cert-08.pd.infn.it:8443/CREAM819127143 Left: 200 (at submission time:200) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM819127143 2014-08-18 15:15:47.904971 Exit https://cert-08.pd.infn.it:8443/CREAM947479795 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:15:48,663 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:15:48,688 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:15:48,688 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:15:48,688 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151548.log]\n', '2014-08-18 15:15:48,691 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:15:49,986 DEBUG - Will invoke JobStart for JobID [CREAM137818593]\n', 'https://cert-08.pd.infn.it:8443/CREAM137818593\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM137818593 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM137818593 2014-08-18 15:15:50.414860 Submit https://cert-08.pd.infn.it:8443/CREAM137818593 Left: 199 (at submission time:199) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM137818593 2014-08-18 15:17:46.551117 Exit https://cert-08.pd.infn.it:8443/CREAM954103238 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:17:47,282 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:17:47,302 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:17:47,302 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:17:47,302 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151747.log]\n', '2014-08-18 15:17:47,305 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:17:48,646 DEBUG - Will invoke JobStart for JobID [CREAM583955770]\n', 'https://cert-08.pd.infn.it:8443/CREAM583955770\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM583955770 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM583955770 2014-08-18 15:17:48.797229 Submit https://cert-08.pd.infn.it:8443/CREAM583955770 Left: 192 (at submission time:192) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM583955770 2014-08-18 15:18:39.895072 Exit le = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:14:44,463 DEBUG - Will invoke JobStart for JobID [CREAM321473095]\n', 'https://cert-08.pd.infn.it:8443/CREAM321473095\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM321473095 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM321473095 2014-08-18 15:14:44.781887 Submit https://cert-08.pd.infn.it:8443/CREAM321473095 Left: 205 (at submission time:205) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM321473095 2014-08-18 15:16:44.601148 Exit https://cert-08.pd.infn.it:8443/CREAM320598125 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:16:45,230 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:16:45,253 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:16:45,253 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:16:45,253 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151645.log]\n', '2014-08-18 15:16:45,263 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:16:46,412 DEBUG - Will invoke JobStart for JobID [CREAM211263546]\n', 'https://cert-08.pd.infn.it:8443/CREAM211263546\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM211263546 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM211263546 2014-08-18 15:16:47.066046 Submit https://cert-08.pd.infn.it:8443/CREAM211263546 Left: 197 (at submission time:197) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM211263546 2014-08-18 15:17:44.158465 Exit https://cert-08.pd.infn.it:8443/CREAM797093287 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:17:44,967 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:17:45,008 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:17:45,008 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:17:45,008 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151745.log]\n', '2014-08-18 15:17:45,013 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:17:46,463 DEBUG - Will invoke JobStart for JobID [CREAM175667626]\n', 'https://cert-08.pd.infn.it:8443/CREAM175667626\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM175667626 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM175667626 2014-08-18 15:17:46.723466 Submit https://cert-08.pd.infn.it:8443/CREAM175667626 Left: 193 (at submission time:193) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM175667626 2014-08-18 15:18:46.670161 Exit Collected 781/1000 2014-08-18 15:16:38.893335 Submitted: 801 Running: 19 Cancelled: 0 Done-Ok: 782 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 782/1000 2014-08-18 15:16:40.844040 Submitted: 802 Running: 20 Cancelled: 0 Done-Ok: 782 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 782/1000 2014-08-18 15:16:44.606008 Submitted: 802 Running: 19 Cancelled: 0 Done-Ok: 783 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 783/1000 2014-08-18 15:16:44.856181 Submitted: 802 Running: 18 Cancelled: 0 Done-Ok: 784 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 784/1000 2014-08-18 15:16:45.330539 Submitted: 802 Running: 17 Cancelled: 0 Done-Ok: 785 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 785/1000 2014-08-18 15:16:47.068861 Submitted: 803 Running: 18 Cancelled: 0 Done-Ok: 785 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 785/1000 2014-08-18 15:16:47.337570 Submitted: 804 Running: 19 Cancelled: 0 Done-Ok: 785 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 785/1000 2014-08-18 15:16:47.872849 Submitted: 805 Running: 20 Cancelled: 0 Done-Ok: 785 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 785/1000 2014-08-18 15:17:39.806250 Submitted: 805 Running: 19 Cancelled: 0 Done-Ok: 786 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 786/1000 2014-08-18 15:17:41.711963 Submitted: 806 Running: 20 Cancelled: 0 Done-Ok: 786 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 786/1000 2014-08-18 15:17:44.160287 Submitted: 806 Running: 19 Cancelled: 0 Done-Ok: 787 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 787/1000 2014-08-18 15:17:46.552818 Submitted: 806 Running: 18 Cancelled: 0 Done-Ok: 788 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 788/1000 2014-08-18 15:17:46.728110 Submitted: 807 Running: 19 Cancelled: 0 Done-Ok: 788 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 788/1000 2014-08-18 15:17:47.008079 Submitted: 807 Running: 18 Cancelled: 0 Done-Ok: 789 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 789/1000 2014-08-18 15:17:48.799231 Submitted: 808 Running: 19 Cancelled: 0 Done-Ok: 789 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 789/1000 2014-08-18 15:17:49.622998 Submitted: 809 Running: 20 Cancelled: 0 Done-Ok: 789 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 789/1000 2014-08-18 15:18:39.899564 Submitted: 809 Running: 19 Cancelled: 0 Done-Ok: 790 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 790/1000 2014-08-18 15:18:41.735725 Submitted: 810 Running: 20 Cancelled: 0 Done-Ok: 790 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 790/1000 2014-08-18 15:18:45.099686 Submitted: 810 Running: 19 Cancelled: 0 Done-Ok: 791 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 791/1000 2014-08-18 15:18:46.673047 Submitted: 810 Running: 18 Cancelled: 0 Done-Ok: 792 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 le = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:14:46,618 DEBUG - Will invoke JobStart for JobID [CREAM512639561]\n', 'https://cert-08.pd.infn.it:8443/CREAM512639561\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM512639561 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM512639561 2014-08-18 15:14:47.148184 Submit https://cert-08.pd.infn.it:8443/CREAM512639561 Left: 203 (at submission time:203) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM512639561 2014-08-18 15:16:38.891807 Exit https://cert-08.pd.infn.it:8443/CREAM130320589 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:16:39,322 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:16:39,346 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:16:39,346 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:16:39,346 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151639.log]\n', '2014-08-18 15:16:39,355 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:16:40,559 DEBUG - Will invoke JobStart for JobID [CREAM188907048]\n', 'https://cert-08.pd.infn.it:8443/CREAM188907048\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM188907048 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM188907048 2014-08-18 15:16:40.841181 Submit https://cert-08.pd.infn.it:8443/CREAM188907048 Left: 198 (at submission time:198) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM188907048 2014-08-18 15:18:45.098180 Exit https://cert-08.pd.infn.it:8443/CREAM365591417 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:18:45,879 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:18:45,905 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:18:45,905 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:18:45,905 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151845.log]\n', '2014-08-18 15:18:45,908 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:18:47,353 DEBUG - Will invoke JobStart for JobID [CREAM123585227]\n', 'https://cert-08.pd.infn.it:8443/CREAM123585227\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM123585227 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM123585227 2014-08-18 15:18:47.708444 Submit https://cert-08.pd.infn.it:8443/CREAM123585227 Left: 189 (at submission time:189) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM123585227 2014-08-18 15:18:48.273757 Exit le = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:15:40,354 DEBUG - Will invoke JobStart for JobID [CREAM237415124]\n', 'https://cert-08.pd.infn.it:8443/CREAM237415124\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM237415124 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM237415124 2014-08-18 15:15:40.599483 Submit https://cert-08.pd.infn.it:8443/CREAM237415124 Left: 202 (at submission time:202) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM237415124 2014-08-18 15:16:44.854581 Exit https://cert-08.pd.infn.it:8443/CREAM766716301 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:16:45,575 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:16:45,594 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:16:45,594 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:16:45,594 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151645.log]\n', '2014-08-18 15:16:45,597 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:16:47,061 DEBUG - Will invoke JobStart for JobID [CREAM730984580]\n', 'https://cert-08.pd.infn.it:8443/CREAM730984580\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM730984580 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM730984580 2014-08-18 15:16:47.335860 Submit https://cert-08.pd.infn.it:8443/CREAM730984580 Left: 196 (at submission time:196) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM730984580 2014-08-18 15:17:47.005319 Exit https://cert-08.pd.infn.it:8443/CREAM150509137 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:17:47,821 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:17:47,842 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:17:47,842 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:17:47,842 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151747.log]\n', '2014-08-18 15:17:47,845 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:17:49,280 DEBUG - Will invoke JobStart for JobID [CREAM578668893]\n', 'https://cert-08.pd.infn.it:8443/CREAM578668893\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM578668893 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM578668893 2014-08-18 15:17:49.621730 Submit https://cert-08.pd.infn.it:8443/CREAM578668893 Left: 191 (at submission time:191) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM578668893 2014-08-18 15:19:40.483456 Exit le = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:15:45,762 DEBUG - Will invoke JobStart for JobID [CREAM180260750]\n', 'https://cert-08.pd.infn.it:8443/CREAM180260750\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM180260750 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM180260750 2014-08-18 15:15:46.192087 Submit https://cert-08.pd.infn.it:8443/CREAM180260750 Left: 201 (at submission time:201) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM180260750 2014-08-18 15:16:45.328859 Exit https://cert-08.pd.infn.it:8443/CREAM738265611 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:16:46,144 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:16:46,168 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:16:46,168 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:16:46,168 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151646.log]\n', '2014-08-18 15:16:46,171 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:16:47,496 DEBUG - Will invoke JobStart for JobID [CREAM680867907]\n', 'https://cert-08.pd.infn.it:8443/CREAM680867907\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM680867907 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM680867907 2014-08-18 15:16:47.871884 Submit https://cert-08.pd.infn.it:8443/CREAM680867907 Left: 195 (at submission time:195) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM680867907 2014-08-18 15:17:39.804181 Exit https://cert-08.pd.infn.it:8443/CREAM683848808 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:17:40,176 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:17:40,203 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:17:40,203 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:17:40,203 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151740.log]\n', '2014-08-18 15:17:40,222 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:17:41,395 DEBUG - Will invoke JobStart for JobID [CREAM420724900]\n', 'https://cert-08.pd.infn.it:8443/CREAM420724900\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM420724900 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM420724900 2014-08-18 15:17:41.710867 Submit https://cert-08.pd.infn.it:8443/CREAM420724900 Left: 194 (at submission time:194) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM420724900 2014-08-18 15:19:47.091503 Exit https://cert-08.pd.infn.it:8443/CREAM279763696 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:18:40,238 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:18:40,274 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:18:40,274 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:18:40,274 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151840.log]\n', '2014-08-18 15:18:40,282 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:18:41,519 DEBUG - Will invoke JobStart for JobID [CREAM763039051]\n', 'https://cert-08.pd.infn.it:8443/CREAM763039051\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM763039051 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM763039051 2014-08-18 15:18:41.731414 Submit https://cert-08.pd.infn.it:8443/CREAM763039051 Left: 190 (at submission time:190) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM763039051 2014-08-18 15:20:47.017516 Exit https://cert-08.pd.infn.it:8443/CREAM819127143 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:20:47,480 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:20:47,505 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:20:47,505 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:20:47,505 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152047.log]\n', '2014-08-18 15:20:47,517 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:20:49,082 DEBUG - Will invoke JobStart for JobID [CREAM491519010]\n', 'https://cert-08.pd.infn.it:8443/CREAM491519010\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM491519010 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM491519010 2014-08-18 15:20:49.242354 Submit https://cert-08.pd.infn.it:8443/CREAM491519010 Left: 181 (at submission time:181) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM491519010 2014-08-18 15:20:49.654996 Exit https://cert-08.pd.infn.it:8443/CREAM137818593 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:20:50,292 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:20:50,320 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:20:50,321 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:20:50,321 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152050.log]\n', '2014-08-18 15:20:50,331 DEBU Collected 792/1000 2014-08-18 15:18:47.711142 Submitted: 811 Running: 19 Cancelled: 0 Done-Ok: 792 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 792/1000 2014-08-18 15:18:48.277250 Submitted: 811 Running: 18 Cancelled: 0 Done-Ok: 793 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 793/1000 2014-08-18 15:18:49.179950 Submitted: 812 Running: 19 Cancelled: 0 Done-Ok: 793 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 793/1000 2014-08-18 15:18:50.883099 Submitted: 813 Running: 20 Cancelled: 0 Done-Ok: 793 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 793/1000 2014-08-18 15:19:40.485465 Submitted: 813 Running: 19 Cancelled: 0 Done-Ok: 794 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 794/1000 2014-08-18 15:19:42.636813 Submitted: 814 Running: 20 Cancelled: 0 Done-Ok: 794 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 794/1000 2014-08-18 15:19:46.754498 Submitted: 814 Running: 19 Cancelled: 0 Done-Ok: 795 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 795/1000 2014-08-18 15:19:46.847998 Submitted: 814 Running: 18 Cancelled: 0 Done-Ok: 796 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 796/1000 2014-08-18 15:19:47.097643 Submitted: 814 Running: 17 Cancelled: 0 Done-Ok: 797 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 797/1000 2014-08-18 15:19:48.952007 Submitted: 815 Running: 18 Cancelled: 0 Done-Ok: 797 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 797/1000 2014-08-18 15:19:49.109804 Submitted: 816 Running: 19 Cancelled: 0 Done-Ok: 797 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 797/1000 2014-08-18 15:19:49.822110 Submitted: 817 Running: 20 Cancelled: 0 Done-Ok: 797 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 797/1000 2014-08-18 15:20:40.957527 Submitted: 817 Running: 19 Cancelled: 0 Done-Ok: 798 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 798/1000 2014-08-18 15:20:42.845222 Submitted: 818 Running: 20 Cancelled: 0 Done-Ok: 798 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 798/1000 2014-08-18 15:20:47.020366 Submitted: 818 Running: 19 Cancelled: 0 Done-Ok: 799 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 799/1000 2014-08-18 15:20:47.054167 Submitted: 818 Running: 18 Cancelled: 0 Done-Ok: 800 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 800/1000 2014-08-18 15:20:49.244284 Submitted: 819 Running: 19 Cancelled: 0 Done-Ok: 800 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 800/1000 2014-08-18 15:20:49.520580 Submitted: 820 Running: 20 Cancelled: 0 Done-Ok: 800 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 800/1000 2014-08-18 15:20:49.656877 Submitted: 820 Running: 19 Cancelled: 0 Done-Ok: 801 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 801/1000 2014-08-18 15:20:52.109561 Submitted: 821 Running: 20 Cancelled: 0 Done-Ok: 801 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status:https://cert-08.pd.infn.it:8443/CREAM640465177 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:18:49,004 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:18:49,041 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:18:49,041 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:18:49,042 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151849.log]\n', '2014-08-18 15:18:49,045 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:18:50,472 DEBUG - Will invoke JobStart for JobID [CREAM848698380]\n', 'https://cert-08.pd.infn.it:8443/CREAM848698380\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM848698380 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM848698380 2014-08-18 15:18:50.881656 Submit https://cert-08.pd.infn.it:8443/CREAM848698380 Left: 187 (at submission time:187) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM848698380 2014-08-18 15:19:46.845612 Exit https://cert-08.pd.infn.it:8443/CREAM512639561 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:19:47,174 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:19:47,197 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:19:47,206 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:19:47,206 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151947.log]\n', '2014-08-18 15:19:47,214 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:19:48,515 DEBUG - Will invoke JobStart for JobID [CREAM460339875]\n', 'https://cert-08.pd.infn.it:8443/CREAM460339875\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM460339875 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM460339875 2014-08-18 15:19:48.950973 Submit https://cert-08.pd.infn.it:8443/CREAM460339875 Left: 184 (at submission time:184) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM460339875 2014-08-18 15:21:41.565992 Exit https://cert-08.pd.infn.it:8443/CREAM188907048 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:21:41,904 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:21:41,923 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:21:41,923 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:21:41,923 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152141.log]\n', '2014-08-18 15:21:41,932 DEBUhttps://cert-08.pd.infn.it:8443/CREAM651248181 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:18:47,580 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:18:47,603 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:18:47,603 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:18:47,603 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151847.log]\n', '2014-08-18 15:18:47,606 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:18:48,890 DEBUG - Will invoke JobStart for JobID [CREAM815148038]\n', 'https://cert-08.pd.infn.it:8443/CREAM815148038\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM815148038 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM815148038 2014-08-18 15:18:49.178343 Submit https://cert-08.pd.infn.it:8443/CREAM815148038 Left: 188 (at submission time:188) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM815148038 2014-08-18 15:19:46.752919 Exit https://cert-08.pd.infn.it:8443/CREAM321473095 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:19:47,177 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:19:47,200 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:19:47,200 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:19:47,200 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151947.log]\n', '2014-08-18 15:19:47,208 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:19:48,721 DEBUG - Will invoke JobStart for JobID [CREAM011364475]\n', 'https://cert-08.pd.infn.it:8443/CREAM011364475\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM011364475 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM011364475 2014-08-18 15:19:49.107181 Submit https://cert-08.pd.infn.it:8443/CREAM011364475 Left: 185 (at submission time:185) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM011364475 2014-08-18 15:21:46.347869 Exit https://cert-08.pd.infn.it:8443/CREAM211263546 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:21:47,061 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:21:47,086 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:21:47,087 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:21:47,087 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152147.log]\n', '2014-08-18 15:21:47,105 DEBUhttps://cert-08.pd.infn.it:8443/CREAM751851155 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:19:41,028 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:19:41,065 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:19:41,066 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:19:41,066 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151941.log]\n', '2014-08-18 15:19:41,074 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:19:42,355 DEBUG - Will invoke JobStart for JobID [CREAM940167159]\n', 'https://cert-08.pd.infn.it:8443/CREAM940167159\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM940167159 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM940167159 2014-08-18 15:19:42.630869 Submit https://cert-08.pd.infn.it:8443/CREAM940167159 Left: 186 (at submission time:186) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM940167159 2014-08-18 15:20:40.954417 Exit https://cert-08.pd.infn.it:8443/CREAM237415124 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:20:41,298 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:20:41,328 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:20:41,329 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:20:41,329 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152041.log]\n', '2014-08-18 15:20:41,343 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:20:42,556 DEBUG - Will invoke JobStart for JobID [CREAM599282763]\n', 'https://cert-08.pd.infn.it:8443/CREAM599282763\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM599282763 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM599282763 2014-08-18 15:20:42.842625 Submit https://cert-08.pd.infn.it:8443/CREAM599282763 Left: 182 (at submission time:182) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM599282763 2014-08-18 15:21:47.805897 Exit https://cert-08.pd.infn.it:8443/CREAM730984580 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:21:48,612 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:21:48,643 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:21:48,643 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:21:48,643 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152148.log]\n', '2014-08-18 15:21:48,660 DEBUhttps://cert-08.pd.infn.it:8443/CREAM156700547 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:19:48,101 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:19:48,129 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:19:48,130 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:19:48,130 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-151948.log]\n', '2014-08-18 15:19:48,133 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:19:49,531 DEBUG - Will invoke JobStart for JobID [CREAM765887617]\n', 'https://cert-08.pd.infn.it:8443/CREAM765887617\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM765887617 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM765887617 2014-08-18 15:19:49.821099 Submit https://cert-08.pd.infn.it:8443/CREAM765887617 Left: 183 (at submission time:183) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM765887617 2014-08-18 15:20:47.052579 Exit https://cert-08.pd.infn.it:8443/CREAM180260750 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:20:47,520 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:20:47,552 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:20:47,552 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:20:47,552 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152047.log]\n', '2014-08-18 15:20:47,561 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:20:49,226 DEBUG - Will invoke JobStart for JobID [CREAM725188075]\n', 'https://cert-08.pd.infn.it:8443/CREAM725188075\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM725188075 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM725188075 2014-08-18 15:20:49.516822 Submit https://cert-08.pd.infn.it:8443/CREAM725188075 Left: 180 (at submission time:180) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM725188075 2014-08-18 15:21:48.616537 Exit https://cert-08.pd.infn.it:8443/CREAM680867907 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:21:49,644 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:21:49,677 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:21:49,677 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:21:49,677 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152149.log]\n', '2014-08-18 15:21:49,685 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:20:51,806 DEBUG - Will invoke JobStart for JobID [CREAM322090594]\n', 'https://cert-08.pd.infn.it:8443/CREAM322090594\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM322090594 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM322090594 2014-08-18 15:20:52.105029 Submit https://cert-08.pd.infn.it:8443/CREAM322090594 Left: 179 (at submission time:179) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM322090594 2014-08-18 15:22:48.648714 Exit https://cert-08.pd.infn.it:8443/CREAM583955770 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:22:49,558 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:22:49,581 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:22:49,581 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:22:49,582 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152249.log]\n', '2014-08-18 15:22:49,585 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:22:50,838 DEBUG - Will invoke JobStart for JobID [CREAM569562869]\n', 'https://cert-08.pd.infn.it:8443/CREAM569562869\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM569562869 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM569562869 2014-08-18 15:22:51.151410 Submit https://cert-08.pd.infn.it:8443/CREAM569562869 Left: 171 (at submission time:171) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM569562869 2014-08-18 15:23:42.762183 Exit https://cert-08.pd.infn.it:8443/CREAM763039051 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:23:43,185 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:23:43,217 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:23:43,217 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:23:43,217 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152343.log]\n', '2014-08-18 15:23:43,227 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:23:44,396 DEBUG - Will invoke JobStart for JobID [CREAM822223673]\n', 'https://cert-08.pd.infn.it:8443/CREAM822223673\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM822223673 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM822223673 2014-08-18 15:23:44.757290 Submit https://cert-08.pd.infn.it:8443/CREAM822223673 L 0 Collected 801/1000 2014-08-18 15:21:41.568875 Submitted: 821 Running: 19 Cancelled: 0 Done-Ok: 802 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 802/1000 2014-08-18 15:21:43.599832 Submitted: 822 Running: 20 Cancelled: 0 Done-Ok: 802 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 802/1000 2014-08-18 15:21:46.350965 Submitted: 822 Running: 19 Cancelled: 0 Done-Ok: 803 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 803/1000 2014-08-18 15:21:47.808613 Submitted: 822 Running: 18 Cancelled: 0 Done-Ok: 804 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 804/1000 2014-08-18 15:21:48.617934 Submitted: 822 Running: 17 Cancelled: 0 Done-Ok: 805 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 805/1000 2014-08-18 15:21:48.720925 Submitted: 823 Running: 18 Cancelled: 0 Done-Ok: 805 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 805/1000 2014-08-18 15:21:50.651748 Submitted: 824 Running: 19 Cancelled: 0 Done-Ok: 805 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 805/1000 2014-08-18 15:21:51.734038 Submitted: 825 Running: 20 Cancelled: 0 Done-Ok: 805 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 805/1000 2014-08-18 15:22:42.361583 Submitted: 825 Running: 19 Cancelled: 0 Done-Ok: 806 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 806/1000 2014-08-18 15:22:44.324764 Submitted: 826 Running: 20 Cancelled: 0 Done-Ok: 806 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 806/1000 2014-08-18 15:22:47.782406 Submitted: 826 Running: 19 Cancelled: 0 Done-Ok: 807 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 807/1000 2014-08-18 15:22:48.610871 Submitted: 826 Running: 18 Cancelled: 0 Done-Ok: 808 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 808/1000 2014-08-18 15:22:48.649996 Submitted: 826 Running: 17 Cancelled: 0 Done-Ok: 809 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 809/1000 2014-08-18 15:22:50.459791 Submitted: 827 Running: 18 Cancelled: 0 Done-Ok: 809 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 809/1000 2014-08-18 15:22:50.936961 Submitted: 828 Running: 19 Cancelled: 0 Done-Ok: 809 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 809/1000 2014-08-18 15:22:51.152778 Submitted: 829 Running: 20 Cancelled: 0 Done-Ok: 809 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 809/1000 2014-08-18 15:23:42.763744 Submitted: 829 Running: 19 Cancelled: 0 Done-Ok: 810 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 810/1000 2014-08-18 15:23:44.759748 Submitted: 830 Running: 20 Cancelled: 0 Done-Ok: 810 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 810/1000 2014-08-18 15:23:47.767745 Submitted: 830 Running: 19 Cancelled: 0 Done-Ok: 811 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 811/1000 2014-08-18 15:23:48.807872 Submitted: 830 Running: 18 Cancelled: 0 Done-Ok: 812 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final StaG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:21:48,546 DEBUG - Will invoke JobStart for JobID [CREAM567859826]\n', 'https://cert-08.pd.infn.it:8443/CREAM567859826\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM567859826 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM567859826 2014-08-18 15:21:48.718013 Submit https://cert-08.pd.infn.it:8443/CREAM567859826 Left: 177 (at submission time:177) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM567859826 2014-08-18 15:22:47.780342 Exit https://cert-08.pd.infn.it:8443/CREAM175667626 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:22:48,544 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:22:48,567 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:22:48,567 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:22:48,567 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152248.log]\n', '2014-08-18 15:22:48,576 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:22:49,833 DEBUG - Will invoke JobStart for JobID [CREAM157131491]\n', 'https://cert-08.pd.infn.it:8443/CREAM157131491\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM157131491 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM157131491 2014-08-18 15:22:50.455456 Submit https://cert-08.pd.infn.it:8443/CREAM157131491 Left: 173 (at submission time:173) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM157131491 2014-08-18 15:23:47.765643 Exit https://cert-08.pd.infn.it:8443/CREAM815148038 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:23:48,614 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:23:48,637 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:23:48,637 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:23:48,638 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152348.log]\n', '2014-08-18 15:23:48,640 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:23:50,202 DEBUG - Will invoke JobStart for JobID [CREAM980623955]\n', 'https://cert-08.pd.infn.it:8443/CREAM980623955\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM980623955 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM980623955 2014-08-18 15:23:50.582879 Submit https://cert-08.pd.infn.it:8443/CREAM980623955 LG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:21:43,256 DEBUG - Will invoke JobStart for JobID [CREAM027379964]\n', 'https://cert-08.pd.infn.it:8443/CREAM027379964\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM027379964 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM027379964 2014-08-18 15:21:43.598751 Submit https://cert-08.pd.infn.it:8443/CREAM027379964 Left: 178 (at submission time:178) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM027379964 2014-08-18 15:23:48.805715 Exit https://cert-08.pd.infn.it:8443/CREAM123585227 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:23:49,884 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:23:49,905 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:23:49,905 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:23:49,906 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152349.log]\n', '2014-08-18 15:23:49,908 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:23:51,454 DEBUG - Will invoke JobStart for JobID [CREAM772745362]\n', 'https://cert-08.pd.infn.it:8443/CREAM772745362\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM772745362 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM772745362 2014-08-18 15:23:51.882419 Submit https://cert-08.pd.infn.it:8443/CREAM772745362 Left: 168 (at submission time:168) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM772745362 2014-08-18 15:23:52.185387 Exit https://cert-08.pd.infn.it:8443/CREAM848698380 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:23:52,809 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:23:52,831 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:23:52,832 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:23:52,832 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152352.log]\n', '2014-08-18 15:23:52,835 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:23:54,105 DEBUG - Will invoke JobStart for JobID [CREAM197628699]\n', 'https://cert-08.pd.infn.it:8443/CREAM197628699\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM197628699 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM197628699 2014-08-18 15:23:54.368032 Submit https://cert-08.pd.infn.it:8443/CREAM197628699 LG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:21:50,369 DEBUG - Will invoke JobStart for JobID [CREAM420870193]\n', 'https://cert-08.pd.infn.it:8443/CREAM420870193\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM420870193 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM420870193 2014-08-18 15:21:50.650076 Submit https://cert-08.pd.infn.it:8443/CREAM420870193 Left: 176 (at submission time:176) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM420870193 2014-08-18 15:22:48.609951 Exit https://cert-08.pd.infn.it:8443/CREAM578668893 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:22:49,373 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:22:49,393 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:22:49,393 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:22:49,393 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152249.log]\n', '2014-08-18 15:22:49,396 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:22:50,647 DEBUG - Will invoke JobStart for JobID [CREAM501945463]\n', 'https://cert-08.pd.infn.it:8443/CREAM501945463\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM501945463 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM501945463 2014-08-18 15:22:50.932828 Submit https://cert-08.pd.infn.it:8443/CREAM501945463 Left: 172 (at submission time:172) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM501945463 2014-08-18 15:24:43.244152 Exit https://cert-08.pd.infn.it:8443/CREAM940167159 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:24:43,603 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:24:43,629 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:24:43,629 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:24:43,629 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152443.log]\n', '2014-08-18 15:24:43,640 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:24:44,854 DEBUG - Will invoke JobStart for JobID [CREAM710068392]\n', 'https://cert-08.pd.infn.it:8443/CREAM710068392\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM710068392 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM710068392 2014-08-18 15:24:45.209895 Submit https://cert-08.pd.infn.it:8443/CREAM710068392 LG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:21:51,264 DEBUG - Will invoke JobStart for JobID [CREAM673966674]\n', 'https://cert-08.pd.infn.it:8443/CREAM673966674\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM673966674 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM673966674 2014-08-18 15:21:51.733085 Submit https://cert-08.pd.infn.it:8443/CREAM673966674 Left: 175 (at submission time:175) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM673966674 2014-08-18 15:22:42.358915 Exit https://cert-08.pd.infn.it:8443/CREAM420724900 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:22:42,754 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:22:42,786 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:22:42,786 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:22:42,786 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152242.log]\n', '2014-08-18 15:22:42,794 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:22:43,855 DEBUG - Will invoke JobStart for JobID [CREAM300233348]\n', 'https://cert-08.pd.infn.it:8443/CREAM300233348\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM300233348 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM300233348 2014-08-18 15:22:44.318661 Submit https://cert-08.pd.infn.it:8443/CREAM300233348 Left: 174 (at submission time:174) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM300233348 2014-08-18 15:24:48.566353 Exit https://cert-08.pd.infn.it:8443/CREAM765887617 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:24:49,553 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:24:49,584 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:24:49,584 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:24:49,584 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152449.log]\n', '2014-08-18 15:24:49,593 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:24:50,896 DEBUG - Will invoke JobStart for JobID [CREAM415111673]\n', 'https://cert-08.pd.infn.it:8443/CREAM415111673\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM415111673 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM415111673 2014-08-18 15:24:51.106279 Submit https://cert-08.pd.infn.it:8443/CREAM415111673 Ltus: 0 Collected 812/1000 2014-08-18 15:23:50.585793 Submitted: 831 Running: 19 Cancelled: 0 Done-Ok: 812 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 812/1000 2014-08-18 15:23:51.887155 Submitted: 832 Running: 20 Cancelled: 0 Done-Ok: 812 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 812/1000 2014-08-18 15:23:52.187619 Submitted: 832 Running: 19 Cancelled: 0 Done-Ok: 813 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 813/1000 2014-08-18 15:23:54.369789 Submitted: 833 Running: 20 Cancelled: 0 Done-Ok: 813 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 813/1000 2014-08-18 15:24:43.246634 Submitted: 833 Running: 19 Cancelled: 0 Done-Ok: 814 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 814/1000 2014-08-18 15:24:45.212826 Submitted: 834 Running: 20 Cancelled: 0 Done-Ok: 814 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 814/1000 2014-08-18 15:24:47.559090 Submitted: 834 Running: 19 Cancelled: 0 Done-Ok: 815 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 815/1000 2014-08-18 15:24:48.568109 Submitted: 834 Running: 18 Cancelled: 0 Done-Ok: 816 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 816/1000 2014-08-18 15:24:48.789892 Submitted: 834 Running: 17 Cancelled: 0 Done-Ok: 817 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 817/1000 2014-08-18 15:24:50.581171 Submitted: 835 Running: 18 Cancelled: 0 Done-Ok: 817 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 817/1000 2014-08-18 15:24:51.107748 Submitted: 836 Running: 19 Cancelled: 0 Done-Ok: 817 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 817/1000 2014-08-18 15:24:51.866994 Submitted: 837 Running: 20 Cancelled: 0 Done-Ok: 817 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 817/1000 2014-08-18 15:25:43.575813 Submitted: 837 Running: 19 Cancelled: 0 Done-Ok: 818 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 818/1000 2014-08-18 15:25:45.442374 Submitted: 838 Running: 20 Cancelled: 0 Done-Ok: 818 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 818/1000 2014-08-18 15:25:47.760619 Submitted: 838 Running: 19 Cancelled: 0 Done-Ok: 819 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 819/1000 2014-08-18 15:25:49.772288 Submitted: 838 Running: 18 Cancelled: 0 Done-Ok: 820 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 820/1000 2014-08-18 15:25:50.329198 Submitted: 839 Running: 19 Cancelled: 0 Done-Ok: 820 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 820/1000 2014-08-18 15:25:50.779115 Submitted: 839 Running: 18 Cancelled: 0 Done-Ok: 821 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 821/1000 2014-08-18 15:25:52.420498 Submitted: 840 Running: 19 Cancelled: 0 Done-Ok: 821 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 821/1000 2014-08-18 15:25:53.659867 Submitted: 841 Running: 20 Cancelled: 0 Done-Ok: 821 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Finaleft: 164 (at submission time:164) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM415111673 2014-08-18 15:25:49.770189 Exit https://cert-08.pd.infn.it:8443/CREAM725188075 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:25:50,472 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:25:50,501 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:25:50,502 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:25:50,502 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152550.log]\n', '2014-08-18 15:25:50,505 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:25:51,945 DEBUG - Will invoke JobStart for JobID [CREAM135567822]\n', 'https://cert-08.pd.infn.it:8443/CREAM135567822\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM135567822 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM135567822 2014-08-18 15:25:52.418597 Submit https://cert-08.pd.infn.it:8443/CREAM135567822 Left: 160 (at submission time:160) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM135567822 2014-08-18 15:26:51.809621 Exit https://cert-08.pd.infn.it:8443/CREAM673966674 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:26:52,475 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:26:52,499 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:26:52,500 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:26:52,500 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152652.log]\n', '2014-08-18 15:26:52,503 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:26:53,888 DEBUG - Will invoke JobStart for JobID [CREAM640206193]\n', 'https://cert-08.pd.infn.it:8443/CREAM640206193\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM640206193 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM640206193 2014-08-18 15:26:54.428274 Submit https://cert-08.pd.infn.it:8443/CREAM640206193 Left: 155 (at submission time:155) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM640206193 2014-08-18 15:27:44.932113 Exit https://cert-08.pd.infn.it:8443/CREAM300233348 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:27:45,279 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:27:45,306 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:27:45,306 WARN - No configuration file suitable for loading. Using built-in configuration\neft: 169 (at submission time:169) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM980623955 2014-08-18 15:24:48.785971 Exit https://cert-08.pd.infn.it:8443/CREAM011364475 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:24:49,639 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:24:49,671 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:24:49,671 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:24:49,671 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152449.log]\n', '2014-08-18 15:24:49,675 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:24:51,567 DEBUG - Will invoke JobStart for JobID [CREAM924635377]\n', 'https://cert-08.pd.infn.it:8443/CREAM924635377\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM924635377 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM924635377 2014-08-18 15:24:51.865097 Submit https://cert-08.pd.infn.it:8443/CREAM924635377 Left: 163 (at submission time:163) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM924635377 2014-08-18 15:26:49.264845 Exit https://cert-08.pd.infn.it:8443/CREAM567859826 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:26:50,059 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:26:50,087 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:26:50,088 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:26:50,088 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152650.log]\n', '2014-08-18 15:26:50,091 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:26:51,369 DEBUG - Will invoke JobStart for JobID [CREAM346326461]\n', 'https://cert-08.pd.infn.it:8443/CREAM346326461\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM346326461 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM346326461 2014-08-18 15:26:51.705473 Submit https://cert-08.pd.infn.it:8443/CREAM346326461 Left: 157 (at submission time:157) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM346326461 2014-08-18 15:27:48.989030 Exit https://cert-08.pd.infn.it:8443/CREAM157131491 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:27:49,581 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:27:49,621 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:27:49,621 WARN - No configuration file suitable for loading. Using built-in configuration\neft: 170 (at submission time:170) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM822223673 2014-08-18 15:25:47.758746 Exit https://cert-08.pd.infn.it:8443/CREAM491519010 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:25:48,531 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:25:48,555 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:25:48,555 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:25:48,556 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152548.log]\n', '2014-08-18 15:25:48,559 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:25:49,912 DEBUG - Will invoke JobStart for JobID [CREAM405094138]\n', 'https://cert-08.pd.infn.it:8443/CREAM405094138\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM405094138 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM405094138 2014-08-18 15:25:50.325338 Submit https://cert-08.pd.infn.it:8443/CREAM405094138 Left: 161 (at submission time:161) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM405094138 2014-08-18 15:25:50.776195 Exit https://cert-08.pd.infn.it:8443/CREAM322090594 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:25:51,771 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:25:51,796 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:25:51,796 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:25:51,796 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152551.log]\n', '2014-08-18 15:25:51,799 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:25:53,312 DEBUG - Will invoke JobStart for JobID [CREAM886046427]\n', 'https://cert-08.pd.infn.it:8443/CREAM886046427\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM886046427 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM886046427 2014-08-18 15:25:53.656925 Submit https://cert-08.pd.infn.it:8443/CREAM886046427 Left: 159 (at submission time:159) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM886046427 2014-08-18 15:27:50.228084 Exit https://cert-08.pd.infn.it:8443/CREAM569562869 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:27:51,023 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:27:51,048 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:27:51,048 WARN - No configuration file suitable for loading. Using built-in configuration\neft: 166 (at submission time:166) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM710068392 2014-08-18 15:25:43.573830 Exit https://cert-08.pd.infn.it:8443/CREAM599282763 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:25:43,905 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:25:43,933 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:25:43,934 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:25:43,934 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152543.log]\n', '2014-08-18 15:25:43,937 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:25:45,179 DEBUG - Will invoke JobStart for JobID [CREAM340092670]\n', 'https://cert-08.pd.infn.it:8443/CREAM340092670\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM340092670 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM340092670 2014-08-18 15:25:45.439457 Submit https://cert-08.pd.infn.it:8443/CREAM340092670 Left: 162 (at submission time:162) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM340092670 2014-08-18 15:26:49.301886 Exit https://cert-08.pd.infn.it:8443/CREAM420870193 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:26:50,207 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:26:50,237 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:26:50,238 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:26:50,238 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152650.log]\n', '2014-08-18 15:26:50,241 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:26:51,894 DEBUG - Will invoke JobStart for JobID [CREAM269304983]\n', 'https://cert-08.pd.infn.it:8443/CREAM269304983\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM269304983 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM269304983 2014-08-18 15:26:52.421053 Submit https://cert-08.pd.infn.it:8443/CREAM269304983 Left: 156 (at submission time:156) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM269304983 2014-08-18 15:27:51.249496 Exit https://cert-08.pd.infn.it:8443/CREAM501945463 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:27:52,017 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:27:52,047 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:27:52,047 WARN - No configuration file suitable for loading. Using built-in configuration\n Status: 0 Collected 821/1000 2014-08-18 15:26:44.061467 Submitted: 841 Running: 19 Cancelled: 0 Done-Ok: 822 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 822/1000 2014-08-18 15:26:46.087233 Submitted: 842 Running: 20 Cancelled: 0 Done-Ok: 822 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 822/1000 2014-08-18 15:26:49.267024 Submitted: 842 Running: 19 Cancelled: 0 Done-Ok: 823 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 823/1000 2014-08-18 15:26:49.303406 Submitted: 842 Running: 18 Cancelled: 0 Done-Ok: 824 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 824/1000 2014-08-18 15:26:51.709375 Submitted: 843 Running: 19 Cancelled: 0 Done-Ok: 824 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 824/1000 2014-08-18 15:26:51.811500 Submitted: 843 Running: 18 Cancelled: 0 Done-Ok: 825 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 825/1000 2014-08-18 15:26:52.422145 Submitted: 844 Running: 19 Cancelled: 0 Done-Ok: 825 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 825/1000 2014-08-18 15:26:54.432596 Submitted: 845 Running: 20 Cancelled: 0 Done-Ok: 825 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 825/1000 2014-08-18 15:27:44.933574 Submitted: 845 Running: 19 Cancelled: 0 Done-Ok: 826 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 826/1000 2014-08-18 15:27:47.137404 Submitted: 846 Running: 20 Cancelled: 0 Done-Ok: 826 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 826/1000 2014-08-18 15:27:48.991155 Submitted: 846 Running: 19 Cancelled: 0 Done-Ok: 827 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 827/1000 2014-08-18 15:27:50.230423 Submitted: 846 Running: 18 Cancelled: 0 Done-Ok: 828 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 828/1000 2014-08-18 15:27:51.251246 Submitted: 846 Running: 17 Cancelled: 0 Done-Ok: 829 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 829/1000 2014-08-18 15:27:51.589421 Submitted: 847 Running: 18 Cancelled: 0 Done-Ok: 829 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 829/1000 2014-08-18 15:27:53.070821 Submitted: 848 Running: 19 Cancelled: 0 Done-Ok: 829 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 829/1000 2014-08-18 15:27:53.898981 Submitted: 849 Running: 20 Cancelled: 0 Done-Ok: 829 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 829/1000 2014-08-18 15:28:45.461134 Submitted: 849 Running: 19 Cancelled: 0 Done-Ok: 830 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 830/1000 2014-08-18 15:28:47.516260 Submitted: 850 Running: 20 Cancelled: 0 Done-Ok: 830 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 830/1000 2014-08-18 15:28:49.936632 Submitted: 850 Running: 19 Cancelled: 0 Done-Ok: 831 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 831/1000 2014-08-18 15:28:51.059652 Submitted: 850 Running: 18 Cancelled: 0 Done-Ok: 832 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Feft: 167 (at submission time:167) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM197628699 2014-08-18 15:24:47.554873 Exit https://cert-08.pd.infn.it:8443/CREAM460339875 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:24:48,462 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:24:48,485 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:24:48,485 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:24:48,485 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152448.log]\n', '2014-08-18 15:24:48,489 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:24:50,089 DEBUG - Will invoke JobStart for JobID [CREAM285157484]\n', 'https://cert-08.pd.infn.it:8443/CREAM285157484\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM285157484 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM285157484 2014-08-18 15:24:50.578590 Submit https://cert-08.pd.infn.it:8443/CREAM285157484 Left: 165 (at submission time:165) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM285157484 2014-08-18 15:26:44.059293 Exit https://cert-08.pd.infn.it:8443/CREAM027379964 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:26:44,431 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:26:44,462 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:26:44,463 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:26:44,463 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152644.log]\n', '2014-08-18 15:26:44,466 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:26:45,611 DEBUG - Will invoke JobStart for JobID [CREAM559971875]\n', 'https://cert-08.pd.infn.it:8443/CREAM559971875\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM559971875 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM559971875 2014-08-18 15:26:46.085263 Submit https://cert-08.pd.infn.it:8443/CREAM559971875 Left: 158 (at submission time:158) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM559971875 2014-08-18 15:28:51.055582 Exit https://cert-08.pd.infn.it:8443/CREAM772745362 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:28:52,028 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:28:52,052 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:28:52,052 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:27:49,621 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152749.log]\n', '2014-08-18 15:27:49,624 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:27:51,127 DEBUG - Will invoke JobStart for JobID [CREAM108489132]\n', 'https://cert-08.pd.infn.it:8443/CREAM108489132\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM108489132 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM108489132 2014-08-18 15:27:51.588412 Submit https://cert-08.pd.infn.it:8443/CREAM108489132 Left: 153 (at submission time:153) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM108489132 2014-08-18 15:28:49.934880 Exit https://cert-08.pd.infn.it:8443/CREAM980623955 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:28:50,843 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:28:50,877 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:28:50,878 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:28:50,878 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152850.log]\n', '2014-08-18 15:28:50,882 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:28:52,393 DEBUG - Will invoke JobStart for JobID [CREAM870006580]\n', 'https://cert-08.pd.infn.it:8443/CREAM870006580\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM870006580 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM870006580 2014-08-18 15:28:52.907967 Submit https://cert-08.pd.infn.it:8443/CREAM870006580 Left: 149 (at submission time:149) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM870006580 2014-08-18 15:29:49.587851 Exit https://cert-08.pd.infn.it:8443/CREAM924635377 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:29:50,329 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:29:50,360 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:29:50,361 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:29:50,361 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152950.log]\n', '2014-08-18 15:29:50,364 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:29:51,652 DEBUG - Will invoke JobStart for JobID [CREAM045260169]\n', 'https://cert-08.pd.infn.it:8443/CREAM045260169\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM0452', '2014-08-18 15:28:52,052 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152852.log]\n', '2014-08-18 15:28:52,065 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:28:53,503 DEBUG - Will invoke JobStart for JobID [CREAM746241831]\n', 'https://cert-08.pd.infn.it:8443/CREAM746241831\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM746241831 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM746241831 2014-08-18 15:28:53.779572 Submit https://cert-08.pd.infn.it:8443/CREAM746241831 Left: 148 (at submission time:148) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM746241831 2014-08-18 15:28:54.120417 Exit https://cert-08.pd.infn.it:8443/CREAM197628699 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:28:54,958 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:28:54,980 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:28:54,980 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:28:54,980 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152854.log]\n', '2014-08-18 15:28:54,985 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:28:56,557 DEBUG - Will invoke JobStart for JobID [CREAM499828632]\n', 'https://cert-08.pd.infn.it:8443/CREAM499828632\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM499828632 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM499828632 2014-08-18 15:28:56.859330 Submit https://cert-08.pd.infn.it:8443/CREAM499828632 Left: 147 (at submission time:147) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM499828632 2014-08-18 15:29:50.881708 Exit https://cert-08.pd.infn.it:8443/CREAM285157484 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:29:51,786 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:29:51,809 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:29:51,810 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:29:51,810 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152951.log]\n', '2014-08-18 15:29:51,813 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:29:53,377 DEBUG - Will invoke JobStart for JobID [CREAM488148009]\n', 'https://cert-08.pd.infn.it:8443/CREAM488148009\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM4881', '2014-08-18 15:27:52,047 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152752.log]\n', '2014-08-18 15:27:52,056 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:27:53,569 DEBUG - Will invoke JobStart for JobID [CREAM947658492]\n', 'https://cert-08.pd.infn.it:8443/CREAM947658492\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM947658492 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM947658492 2014-08-18 15:27:53.897123 Submit https://cert-08.pd.infn.it:8443/CREAM947658492 Left: 151 (at submission time:151) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM947658492 2014-08-18 15:29:45.744430 Exit https://cert-08.pd.infn.it:8443/CREAM710068392 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:29:46,081 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:29:46,107 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:29:46,107 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:29:46,107 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152946.log]\n', '2014-08-18 15:29:46,117 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:29:47,426 DEBUG - Will invoke JobStart for JobID [CREAM733635981]\n', 'https://cert-08.pd.infn.it:8443/CREAM733635981\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM733635981 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM733635981 2014-08-18 15:29:47.687396 Submit https://cert-08.pd.infn.it:8443/CREAM733635981 Left: 146 (at submission time:146) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM733635981 2014-08-18 15:30:45.781991 Exit https://cert-08.pd.infn.it:8443/CREAM340092670 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:30:46,128 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:30:46,148 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:30:46,148 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:30:46,148 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153046.log]\n', '2014-08-18 15:30:46,151 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:30:47,289 DEBUG - Will invoke JobStart for JobID [CREAM356904099]\n', 'https://cert-08.pd.infn.it:8443/CREAM356904099\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM3569', '2014-08-18 15:27:51,048 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152751.log]\n', '2014-08-18 15:27:51,051 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:27:52,478 DEBUG - Will invoke JobStart for JobID [CREAM039023542]\n', 'https://cert-08.pd.infn.it:8443/CREAM039023542\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM039023542 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM039023542 2014-08-18 15:27:53.068179 Submit https://cert-08.pd.infn.it:8443/CREAM039023542 Left: 152 (at submission time:152) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM039023542 2014-08-18 15:28:45.457856 Exit https://cert-08.pd.infn.it:8443/CREAM822223673 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:28:45,820 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:28:45,855 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:28:45,855 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:28:45,855 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152845.log]\n', '2014-08-18 15:28:45,858 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:28:47,253 DEBUG - Will invoke JobStart for JobID [CREAM789808550]\n', 'https://cert-08.pd.infn.it:8443/CREAM789808550\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM789808550 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM789808550 2014-08-18 15:28:47.513274 Submit https://cert-08.pd.infn.it:8443/CREAM789808550 Left: 150 (at submission time:150) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM789808550 2014-08-18 15:30:50.223128 Exit https://cert-08.pd.infn.it:8443/CREAM405094138 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:30:51,089 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:30:51,112 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:30:51,112 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:30:51,112 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153051.log]\n', '2014-08-18 15:30:51,120 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:30:52,695 DEBUG - Will invoke JobStart for JobID [CREAM580203107]\n', 'https://cert-08.pd.infn.it:8443/CREAM580203107\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM5802', '2014-08-18 15:27:45,306 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152745.log]\n', '2014-08-18 15:27:45,309 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:27:46,660 DEBUG - Will invoke JobStart for JobID [CREAM153975892]\n', 'https://cert-08.pd.infn.it:8443/CREAM153975892\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM153975892 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM153975892 2014-08-18 15:27:47.133402 Submit https://cert-08.pd.infn.it:8443/CREAM153975892 Left: 154 (at submission time:154) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM153975892 2014-08-18 15:29:51.574649 Exit https://cert-08.pd.infn.it:8443/CREAM415111673 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:29:52,467 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:29:52,494 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:29:52,494 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:29:52,494 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-152952.log]\n', '2014-08-18 15:29:52,497 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:29:53,969 DEBUG - Will invoke JobStart for JobID [CREAM377993444]\n', 'https://cert-08.pd.infn.it:8443/CREAM377993444\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM377993444 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM377993444 2014-08-18 15:29:54.360573 Submit https://cert-08.pd.infn.it:8443/CREAM377993444 Left: 143 (at submission time:143) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM377993444 2014-08-18 15:30:52.464315 Exit https://cert-08.pd.infn.it:8443/CREAM135567822 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:30:53,249 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:30:53,283 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:30:53,283 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:30:53,283 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153053.log]\n', '2014-08-18 15:30:53,286 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:30:54,804 DEBUG - Will invoke JobStart for JobID [CREAM289652688]\n', 'https://cert-08.pd.infn.it:8443/CREAM289652688\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM2896inal Status: 0 Collected 832/1000 2014-08-18 15:28:52.913903 Submitted: 851 Running: 19 Cancelled: 0 Done-Ok: 832 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 832/1000 2014-08-18 15:28:53.782589 Submitted: 852 Running: 20 Cancelled: 0 Done-Ok: 832 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 832/1000 2014-08-18 15:28:54.123228 Submitted: 852 Running: 19 Cancelled: 0 Done-Ok: 833 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 833/1000 2014-08-18 15:28:56.860599 Submitted: 853 Running: 20 Cancelled: 0 Done-Ok: 833 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 833/1000 2014-08-18 15:29:45.746872 Submitted: 853 Running: 19 Cancelled: 0 Done-Ok: 834 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 834/1000 2014-08-18 15:29:47.690145 Submitted: 854 Running: 20 Cancelled: 0 Done-Ok: 834 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 834/1000 2014-08-18 15:29:49.590047 Submitted: 854 Running: 19 Cancelled: 0 Done-Ok: 835 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 835/1000 2014-08-18 15:29:50.883311 Submitted: 854 Running: 18 Cancelled: 0 Done-Ok: 836 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 836/1000 2014-08-18 15:29:51.576647 Submitted: 854 Running: 17 Cancelled: 0 Done-Ok: 837 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 837/1000 2014-08-18 15:29:51.938514 Submitted: 855 Running: 18 Cancelled: 0 Done-Ok: 837 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 837/1000 2014-08-18 15:29:53.659125 Submitted: 856 Running: 19 Cancelled: 0 Done-Ok: 837 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 837/1000 2014-08-18 15:29:54.361793 Submitted: 857 Running: 20 Cancelled: 0 Done-Ok: 837 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 837/1000 2014-08-18 15:30:45.784256 Submitted: 857 Running: 19 Cancelled: 0 Done-Ok: 838 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 838/1000 2014-08-18 15:30:47.529845 Submitted: 858 Running: 20 Cancelled: 0 Done-Ok: 838 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 838/1000 2014-08-18 15:30:50.228207 Submitted: 858 Running: 19 Cancelled: 0 Done-Ok: 839 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 839/1000 2014-08-18 15:30:52.468618 Submitted: 858 Running: 18 Cancelled: 0 Done-Ok: 840 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 840/1000 2014-08-18 15:30:53.083211 Submitted: 859 Running: 19 Cancelled: 0 Done-Ok: 840 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 840/1000 2014-08-18 15:30:53.515774 Submitted: 859 Running: 18 Cancelled: 0 Done-Ok: 841 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 841/1000 2014-08-18 15:30:55.203744 Submitted: 860 Running: 19 Cancelled: 0 Done-Ok: 841 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 841/1000 2014-08-18 15:30:56.165967 Submitted: 861 Running: 20 Cancelled: 0 Done-Ok: 841 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illeg03107 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM580203107 2014-08-18 15:30:53.080780 Submit https://cert-08.pd.infn.it:8443/CREAM580203107 Left: 141 (at submission time:141) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM580203107 2014-08-18 15:30:53.513467 Exit https://cert-08.pd.infn.it:8443/CREAM886046427 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:30:54,230 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:30:54,254 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:30:54,255 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:30:54,255 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153054.log]\n', '2014-08-18 15:30:54,258 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:30:55,735 DEBUG - Will invoke JobStart for JobID [CREAM630053125]\n', 'https://cert-08.pd.infn.it:8443/CREAM630053125\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM630053125 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM630053125 2014-08-18 15:30:56.162758 Submit https://cert-08.pd.infn.it:8443/CREAM630053125 Left: 139 (at submission time:139) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM630053125 2014-08-18 15:32:53.593594 Exit https://cert-08.pd.infn.it:8443/CREAM039023542 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:32:54,184 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:32:54,209 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:32:54,209 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:32:54,209 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153254.log]\n', '2014-08-18 15:32:54,217 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:32:55,587 DEBUG - Will invoke JobStart for JobID [CREAM516284792]\n', 'https://cert-08.pd.infn.it:8443/CREAM516284792\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM516284792 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM516284792 2014-08-18 15:32:55.728591 Submit https://cert-08.pd.infn.it:8443/CREAM516284792 Left: 132 (at submission time:132) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM516284792 2014-08-18 15:33:47.630392 Exit https://cert-08.pd.infn.it:8443/CREAM789808550 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:33:47,966 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08al Final Status: 0 Collected 841/1000 2014-08-18 15:31:46.775194 Submitted: 861 Running: 19 Cancelled: 0 Done-Ok: 842 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 842/1000 2014-08-18 15:31:49.099450 Submitted: 862 Running: 20 Cancelled: 0 Done-Ok: 842 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 842/1000 2014-08-18 15:31:50.254164 Submitted: 862 Running: 19 Cancelled: 0 Done-Ok: 843 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 843/1000 2014-08-18 15:31:52.316363 Submitted: 862 Running: 18 Cancelled: 0 Done-Ok: 844 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 844/1000 2014-08-18 15:31:52.484958 Submitted: 862 Running: 17 Cancelled: 0 Done-Ok: 845 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 845/1000 2014-08-18 15:31:52.771774 Submitted: 863 Running: 18 Cancelled: 0 Done-Ok: 845 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 845/1000 2014-08-18 15:31:54.993230 Submitted: 864 Running: 19 Cancelled: 0 Done-Ok: 845 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 845/1000 2014-08-18 15:31:55.267680 Submitted: 865 Running: 20 Cancelled: 0 Done-Ok: 845 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 845/1000 2014-08-18 15:32:47.080852 Submitted: 865 Running: 19 Cancelled: 0 Done-Ok: 846 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 846/1000 2014-08-18 15:32:49.101859 Submitted: 866 Running: 20 Cancelled: 0 Done-Ok: 846 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 846/1000 2014-08-18 15:32:51.723115 Submitted: 866 Running: 19 Cancelled: 0 Done-Ok: 847 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 847/1000 2014-08-18 15:32:53.595964 Submitted: 866 Running: 18 Cancelled: 0 Done-Ok: 848 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 848/1000 2014-08-18 15:32:53.979299 Submitted: 866 Running: 17 Cancelled: 0 Done-Ok: 849 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 849/1000 2014-08-18 15:32:54.408506 Submitted: 867 Running: 18 Cancelled: 0 Done-Ok: 849 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 849/1000 2014-08-18 15:32:55.730942 Submitted: 868 Running: 19 Cancelled: 0 Done-Ok: 849 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 849/1000 2014-08-18 15:32:56.637738 Submitted: 869 Running: 20 Cancelled: 0 Done-Ok: 849 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 849/1000 2014-08-18 15:33:47.631874 Submitted: 869 Running: 19 Cancelled: 0 Done-Ok: 850 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 850/1000 2014-08-18 15:33:49.538085 Submitted: 870 Running: 20 Cancelled: 0 Done-Ok: 850 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 850/1000 2014-08-18 15:33:51.692915 Submitted: 870 Running: 19 Cancelled: 0 Done-Ok: 851 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 851/1000 2014-08-18 15:33:53.447134 Submitted: 870 Running: 18 Cancelled: 0 Done-Ok: 852 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 I60169 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM045260169 2014-08-18 15:29:51.936099 Submit https://cert-08.pd.infn.it:8443/CREAM045260169 Left: 145 (at submission time:145) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM045260169 2014-08-18 15:31:50.249685 Exit https://cert-08.pd.infn.it:8443/CREAM346326461 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:31:50,997 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:31:51,020 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:31:51,020 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:31:51,020 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153151.log]\n', '2014-08-18 15:31:51,023 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:31:52,552 DEBUG - Will invoke JobStart for JobID [CREAM906545858]\n', 'https://cert-08.pd.infn.it:8443/CREAM906545858\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM906545858 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM906545858 2014-08-18 15:31:52.769411 Submit https://cert-08.pd.infn.it:8443/CREAM906545858 Left: 137 (at submission time:137) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM906545858 2014-08-18 15:32:51.720616 Exit https://cert-08.pd.infn.it:8443/CREAM108489132 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:32:52,548 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:32:52,576 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:32:52,576 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:32:52,577 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153252.log]\n', '2014-08-18 15:32:52,580 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:32:53,976 DEBUG - Will invoke JobStart for JobID [CREAM616583801]\n', 'https://cert-08.pd.infn.it:8443/CREAM616583801\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM616583801 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM616583801 2014-08-18 15:32:54.406952 Submit https://cert-08.pd.infn.it:8443/CREAM616583801 Left: 133 (at submission time:133) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM616583801 2014-08-18 15:33:53.444284 Exit https://cert-08.pd.infn.it:8443/CREAM870006580 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:33:54,073 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-0848009 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM488148009 2014-08-18 15:29:53.654426 Submit https://cert-08.pd.infn.it:8443/CREAM488148009 Left: 144 (at submission time:144) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM488148009 2014-08-18 15:31:46.771989 Exit https://cert-08.pd.infn.it:8443/CREAM559971875 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:31:47,188 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:31:47,217 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:31:47,217 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:31:47,217 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153147.log]\n', '2014-08-18 15:31:47,223 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:31:48,873 DEBUG - Will invoke JobStart for JobID [CREAM930301437]\n', 'https://cert-08.pd.infn.it:8443/CREAM930301437\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM930301437 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM930301437 2014-08-18 15:31:49.095207 Submit https://cert-08.pd.infn.it:8443/CREAM930301437 Left: 138 (at submission time:138) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM930301437 2014-08-18 15:33:51.691341 Exit https://cert-08.pd.infn.it:8443/CREAM746241831 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:33:52,228 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:33:52,258 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:33:52,259 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:33:52,259 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153352.log]\n', '2014-08-18 15:33:52,264 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:33:53,568 DEBUG - Will invoke JobStart for JobID [CREAM160433889]\n', 'https://cert-08.pd.infn.it:8443/CREAM160433889\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM160433889 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM160433889 2014-08-18 15:33:53.841415 Submit https://cert-08.pd.infn.it:8443/CREAM160433889 Left: 129 (at submission time:129) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM160433889 2014-08-18 15:33:54.227179 Exit https://cert-08.pd.infn.it:8443/CREAM499828632 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:33:55,370 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-0804099 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM356904099 2014-08-18 15:30:47.527850 Submit https://cert-08.pd.infn.it:8443/CREAM356904099 Left: 142 (at submission time:142) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM356904099 2014-08-18 15:31:52.311216 Exit https://cert-08.pd.infn.it:8443/CREAM269304983 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:31:52,973 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:31:52,996 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:31:52,997 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:31:52,997 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153152.log]\n', '2014-08-18 15:31:53,000 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:31:54,762 DEBUG - Will invoke JobStart for JobID [CREAM776264572]\n', 'https://cert-08.pd.infn.it:8443/CREAM776264572\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM776264572 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM776264572 2014-08-18 15:31:54.990101 Submit https://cert-08.pd.infn.it:8443/CREAM776264572 Left: 136 (at submission time:136) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM776264572 2014-08-18 15:32:53.976614 Exit https://cert-08.pd.infn.it:8443/CREAM947658492 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:32:54,540 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:32:54,571 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:32:54,571 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:32:54,571 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153254.log]\n', '2014-08-18 15:32:54,574 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:32:56,368 DEBUG - Will invoke JobStart for JobID [CREAM216927950]\n', 'https://cert-08.pd.infn.it:8443/CREAM216927950\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM216927950 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM216927950 2014-08-18 15:32:56.634912 Submit https://cert-08.pd.infn.it:8443/CREAM216927950 Left: 131 (at submission time:131) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM216927950 2014-08-18 15:34:47.723317 Exit https://cert-08.pd.infn.it:8443/CREAM733635981 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:34:48,043 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-0852688 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM289652688 2014-08-18 15:30:55.202321 Submit https://cert-08.pd.infn.it:8443/CREAM289652688 Left: 140 (at submission time:140) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM289652688 2014-08-18 15:31:52.483277 Exit https://cert-08.pd.infn.it:8443/CREAM640206193 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:31:53,302 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:31:53,330 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:31:53,330 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:31:53,330 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153153.log]\n', '2014-08-18 15:31:53,334 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:31:54,918 DEBUG - Will invoke JobStart for JobID [CREAM435338761]\n', 'https://cert-08.pd.infn.it:8443/CREAM435338761\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM435338761 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM435338761 2014-08-18 15:31:55.263089 Submit https://cert-08.pd.infn.it:8443/CREAM435338761 Left: 135 (at submission time:135) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM435338761 2014-08-18 15:32:47.078755 Exit https://cert-08.pd.infn.it:8443/CREAM153975892 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:32:47,431 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:32:47,454 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:32:47,454 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:32:47,454 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153247.log]\n', '2014-08-18 15:32:47,466 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:32:48,683 DEBUG - Will invoke JobStart for JobID [CREAM778029380]\n', 'https://cert-08.pd.infn.it:8443/CREAM778029380\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM778029380 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM778029380 2014-08-18 15:32:49.100045 Submit https://cert-08.pd.infn.it:8443/CREAM778029380 Left: 134 (at submission time:134) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM778029380 2014-08-18 15:34:53.644642 Exit https://cert-08.pd.infn.it:8443/CREAM377993444 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:34:54,375 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:33:47,999 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:33:47,999 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:33:47,999 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153347.log]\n', '2014-08-18 15:33:48,008 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:33:49,225 DEBUG - Will invoke JobStart for JobID [CREAM862719828]\n', 'https://cert-08.pd.infn.it:8443/CREAM862719828\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM862719828 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM862719828 2014-08-18 15:33:49.536324 Submit https://cert-08.pd.infn.it:8443/CREAM862719828 Left: 130 (at submission time:130) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM862719828 2014-08-18 15:35:52.170377 Exit https://cert-08.pd.infn.it:8443/CREAM580203107 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:35:53,007 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:35:53,031 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:35:53,031 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:35:53,031 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153553.log]\n', '2014-08-18 15:35:53,041 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:35:54,551 DEBUG - Will invoke JobStart for JobID [CREAM970013961]\n', 'https://cert-08.pd.infn.it:8443/CREAM970013961\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM970013961 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM970013961 2014-08-18 15:35:54.695168 Submit https://cert-08.pd.infn.it:8443/CREAM970013961 Left: 121 (at submission time:121) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM970013961 2014-08-18 15:35:55.088074 Exit https://cert-08.pd.infn.it:8443/CREAM630053125 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:35:56,061 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:35:56,084 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:35:56,084 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:35:56,085 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153556.log]\n', '2014-08-18 15:35:56,087 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:35:57,325 DEBUG - Will invoke JobStart for JobID [CREAM280021003]\n', 'https://cert-08.pdllegal Final Status: 0 Collected 852/1000 2014-08-18 15:33:53.845782 Submitted: 871 Running: 19 Cancelled: 0 Done-Ok: 852 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 852/1000 2014-08-18 15:33:54.228962 Submitted: 871 Running: 18 Cancelled: 0 Done-Ok: 853 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 853/1000 2014-08-18 15:33:56.136094 Submitted: 872 Running: 19 Cancelled: 0 Done-Ok: 853 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 853/1000 2014-08-18 15:33:56.840946 Submitted: 873 Running: 20 Cancelled: 0 Done-Ok: 853 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 853/1000 2014-08-18 15:34:47.725683 Submitted: 873 Running: 19 Cancelled: 0 Done-Ok: 854 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 854/1000 2014-08-18 15:34:49.313010 Submitted: 874 Running: 20 Cancelled: 0 Done-Ok: 854 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 854/1000 2014-08-18 15:34:52.706026 Submitted: 874 Running: 19 Cancelled: 0 Done-Ok: 855 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 855/1000 2014-08-18 15:34:53.425354 Submitted: 874 Running: 18 Cancelled: 0 Done-Ok: 856 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 856/1000 2014-08-18 15:34:53.647850 Submitted: 874 Running: 17 Cancelled: 0 Done-Ok: 857 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 857/1000 2014-08-18 15:34:55.425940 Submitted: 875 Running: 18 Cancelled: 0 Done-Ok: 857 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 857/1000 2014-08-18 15:34:56.228229 Submitted: 876 Running: 19 Cancelled: 0 Done-Ok: 857 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 857/1000 2014-08-18 15:34:56.583442 Submitted: 877 Running: 20 Cancelled: 0 Done-Ok: 857 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 857/1000 2014-08-18 15:35:48.379150 Submitted: 877 Running: 19 Cancelled: 0 Done-Ok: 858 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 858/1000 2014-08-18 15:35:50.236501 Submitted: 878 Running: 20 Cancelled: 0 Done-Ok: 858 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 858/1000 2014-08-18 15:35:52.171806 Submitted: 878 Running: 19 Cancelled: 0 Done-Ok: 859 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 859/1000 2014-08-18 15:35:54.011756 Submitted: 878 Running: 18 Cancelled: 0 Done-Ok: 860 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 860/1000 2014-08-18 15:35:54.697021 Submitted: 879 Running: 19 Cancelled: 0 Done-Ok: 860 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 860/1000 2014-08-18 15:35:55.090411 Submitted: 879 Running: 18 Cancelled: 0 Done-Ok: 861 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 861/1000 2014-08-18 15:35:56.903606 Submitted: 880 Running: 19 Cancelled: 0 Done-Ok: 861 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 861/1000 2014-08-18 15:35:57.528675 Submitted: 881 Running: 20 Cancelled: 0 Done-Ok: 861 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed:-18 15:33:55,396 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:33:55,397 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:33:55,397 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153355.log]\n', '2014-08-18 15:33:55,400 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:33:56,635 DEBUG - Will invoke JobStart for JobID [CREAM565341698]\n', 'https://cert-08.pd.infn.it:8443/CREAM565341698\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM565341698 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM565341698 2014-08-18 15:33:56.838305 Submit https://cert-08.pd.infn.it:8443/CREAM565341698 Left: 127 (at submission time:127) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM565341698 2014-08-18 15:34:53.423719 Exit https://cert-08.pd.infn.it:8443/CREAM488148009 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:34:54,344 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:34:54,376 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:34:54,377 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:34:54,377 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153454.log]\n', '2014-08-18 15:34:54,380 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:34:56,232 DEBUG - Will invoke JobStart for JobID [CREAM550259400]\n', 'https://cert-08.pd.infn.it:8443/CREAM550259400\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM550259400 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM550259400 2014-08-18 15:34:56.582146 Submit https://cert-08.pd.infn.it:8443/CREAM550259400 Left: 124 (at submission time:124) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM550259400 2014-08-18 15:36:48.284131 Exit https://cert-08.pd.infn.it:8443/CREAM930301437 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:36:48,696 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:36:48,720 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:36:48,720 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:36:48,720 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153648.log]\n', '2014-08-18 15:36:48,724 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:36:49,765 DEBUG - Will invoke JobStart for JobID [CREAM864626545]\n', 'https://cert-08.pd-18 15:33:54,113 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:33:54,113 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:33:54,114 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153354.log]\n', '2014-08-18 15:33:54,117 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:33:55,413 DEBUG - Will invoke JobStart for JobID [CREAM389789294]\n', 'https://cert-08.pd.infn.it:8443/CREAM389789294\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM389789294 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM389789294 2014-08-18 15:33:56.134438 Submit https://cert-08.pd.infn.it:8443/CREAM389789294 Left: 128 (at submission time:128) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM389789294 2014-08-18 15:34:52.704207 Exit https://cert-08.pd.infn.it:8443/CREAM045260169 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:34:53,590 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:34:53,614 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:34:53,614 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:34:53,614 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153453.log]\n', '2014-08-18 15:34:53,617 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:34:54,841 DEBUG - Will invoke JobStart for JobID [CREAM812028181]\n', 'https://cert-08.pd.infn.it:8443/CREAM812028181\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM812028181 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM812028181 2014-08-18 15:34:55.424066 Submit https://cert-08.pd.infn.it:8443/CREAM812028181 Left: 125 (at submission time:125) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM812028181 2014-08-18 15:36:52.406633 Exit https://cert-08.pd.infn.it:8443/CREAM906545858 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:36:53,175 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:36:53,197 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:36:53,198 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:36:53,198 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153653.log]\n', '2014-08-18 15:36:53,201 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:36:54,561 DEBUG - Will invoke JobStart for JobID [CREAM362935168]\n', 'https://cert-08.pd-18 15:34:54,398 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:34:54,398 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:34:54,398 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153454.log]\n', '2014-08-18 15:34:54,401 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:34:55,895 DEBUG - Will invoke JobStart for JobID [CREAM011586962]\n', 'https://cert-08.pd.infn.it:8443/CREAM011586962\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM011586962 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM011586962 2014-08-18 15:34:56.226018 Submit https://cert-08.pd.infn.it:8443/CREAM011586962 Left: 123 (at submission time:123) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM011586962 2014-08-18 15:35:54.009689 Exit https://cert-08.pd.infn.it:8443/CREAM289652688 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:35:54,663 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:35:54,686 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:35:54,686 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:35:54,686 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153554.log]\n', '2014-08-18 15:35:54,691 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:35:56,575 DEBUG - Will invoke JobStart for JobID [CREAM846154076]\n', 'https://cert-08.pd.infn.it:8443/CREAM846154076\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM846154076 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM846154076 2014-08-18 15:35:56.901304 Submit https://cert-08.pd.infn.it:8443/CREAM846154076 Left: 120 (at submission time:120) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM846154076 2014-08-18 15:36:54.107021 Exit https://cert-08.pd.infn.it:8443/CREAM435338761 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:36:54,950 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:36:54,973 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:36:54,973 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:36:54,973 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153654.log]\n', '2014-08-18 15:36:54,979 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:36:56,157 DEBUG - Will invoke JobStart for JobID [CREAM348809802]\n', 'https://cert-08.pd-18 15:34:48,067 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:34:48,068 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:34:48,068 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153448.log]\n', '2014-08-18 15:34:48,075 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:34:49,074 DEBUG - Will invoke JobStart for JobID [CREAM735921217]\n', 'https://cert-08.pd.infn.it:8443/CREAM735921217\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM735921217 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM735921217 2014-08-18 15:34:49.311508 Submit https://cert-08.pd.infn.it:8443/CREAM735921217 Left: 126 (at submission time:126) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM735921217 2014-08-18 15:35:48.377487 Exit https://cert-08.pd.infn.it:8443/CREAM356904099 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:35:48,768 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:35:48,796 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:35:48,796 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:35:48,796 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153548.log]\n', '2014-08-18 15:35:48,805 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:35:49,999 DEBUG - Will invoke JobStart for JobID [CREAM385578806]\n', 'https://cert-08.pd.infn.it:8443/CREAM385578806\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM385578806 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM385578806 2014-08-18 15:35:50.232446 Submit https://cert-08.pd.infn.it:8443/CREAM385578806 Left: 122 (at submission time:122) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM385578806 2014-08-18 15:36:55.048785 Exit https://cert-08.pd.infn.it:8443/CREAM776264572 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:36:56,132 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:36:56,158 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:36:56,159 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:36:56,159 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153656.log]\n', '2014-08-18 15:36:56,163 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:36:57,449 DEBUG - Will invoke JobStart for JobID [CREAM775561838]\n', 'https://cert-08.pd 0 Illegal Final Status: 0 Collected 861/1000 2014-08-18 15:36:48.286594 Submitted: 881 Running: 19 Cancelled: 0 Done-Ok: 862 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 862/1000 2014-08-18 15:36:50.199573 Submitted: 882 Running: 20 Cancelled: 0 Done-Ok: 862 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 862/1000 2014-08-18 15:36:52.409419 Submitted: 882 Running: 19 Cancelled: 0 Done-Ok: 863 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 863/1000 2014-08-18 15:36:54.108394 Submitted: 882 Running: 18 Cancelled: 0 Done-Ok: 864 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 864/1000 2014-08-18 15:36:54.844311 Submitted: 883 Running: 19 Cancelled: 0 Done-Ok: 864 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 864/1000 2014-08-18 15:36:55.052008 Submitted: 883 Running: 18 Cancelled: 0 Done-Ok: 865 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 865/1000 2014-08-18 15:36:56.397091 Submitted: 884 Running: 19 Cancelled: 0 Done-Ok: 865 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 865/1000 2014-08-18 15:36:57.694008 Submitted: 885 Running: 20 Cancelled: 0 Done-Ok: 865 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 865/1000 2014-08-18 15:37:49.287900 Submitted: 885 Running: 19 Cancelled: 0 Done-Ok: 866 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 866/1000 2014-08-18 15:37:51.175706 Submitted: 886 Running: 20 Cancelled: 0 Done-Ok: 866 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 866/1000 2014-08-18 15:37:53.257825 Submitted: 886 Running: 19 Cancelled: 0 Done-Ok: 867 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 867/1000 2014-08-18 15:37:55.417200 Submitted: 886 Running: 18 Cancelled: 0 Done-Ok: 868 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 868/1000 2014-08-18 15:37:55.608398 Submitted: 886 Running: 17 Cancelled: 0 Done-Ok: 869 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 869/1000 2014-08-18 15:37:55.919150 Submitted: 887 Running: 18 Cancelled: 0 Done-Ok: 869 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 869/1000 2014-08-18 15:37:57.843954 Submitted: 888 Running: 19 Cancelled: 0 Done-Ok: 869 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 869/1000 2014-08-18 15:37:58.971321 Submitted: 889 Running: 20 Cancelled: 0 Done-Ok: 869 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 869/1000 2014-08-18 15:38:49.481180 Submitted: 889 Running: 19 Cancelled: 0 Done-Ok: 870 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 870/1000 2014-08-18 15:38:51.501349 Submitted: 890 Running: 20 Cancelled: 0 Done-Ok: 870 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 870/1000 2014-08-18 15:38:53.579807 Submitted: 890 Running: 19 Cancelled: 0 Done-Ok: 871 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 871/1000 2014-08-18 15:38:55.081037 Submitted: 890 Running: 18 Cancelled: 0 Done-Ok: 872 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Fai.infn.it:8443/CREAM362935168\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM362935168 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM362935168 2014-08-18 15:36:54.841718 Submit https://cert-08.pd.infn.it:8443/CREAM362935168 Left: 117 (at submission time:117) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM362935168 2014-08-18 15:37:53.253740 Exit https://cert-08.pd.infn.it:8443/CREAM616583801 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:37:53,993 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:37:54,017 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:37:54,017 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:37:54,017 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153754.log]\n', '2014-08-18 15:37:54,020 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:37:55,624 DEBUG - Will invoke JobStart for JobID [CREAM113659206]\n', 'https://cert-08.pd.infn.it:8443/CREAM113659206\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM113659206 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM113659206 2014-08-18 15:37:55.917565 Submit https://cert-08.pd.infn.it:8443/CREAM113659206 Left: 113 (at submission time:113) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM113659206 2014-08-18 15:38:55.077277 Exit https://cert-08.pd.infn.it:8443/CREAM389789294 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:38:55,915 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:38:55,940 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:38:55,940 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:38:55,940 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153855.log]\n', '2014-08-18 15:38:55,949 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:38:57,307 DEBUG - Will invoke JobStart for JobID [CREAM036118977]\n', 'https://cert-08.pd.infn.it:8443/CREAM036118977\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM036118977 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM036118977 2014-08-18 15:38:57.590099 Submit https://cert-08.pd.infn.it:8443/CREAM036118977 Left: 108 (at submission time:108) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM036118977 2014-08-18 15:39:54.800756 Exit https://cert-08.pd.infn.it:8443/CREAM812028181 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing.infn.it:8443/CREAM864626545\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM864626545 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM864626545 2014-08-18 15:36:50.196873 Submit https://cert-08.pd.infn.it:8443/CREAM864626545 Left: 118 (at submission time:118) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM864626545 2014-08-18 15:38:53.575188 Exit https://cert-08.pd.infn.it:8443/CREAM160433889 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:38:54,399 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:38:54,422 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:38:54,422 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:38:54,423 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153854.log]\n', '2014-08-18 15:38:54,426 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:38:56,123 DEBUG - Will invoke JobStart for JobID [CREAM175528403]\n', 'https://cert-08.pd.infn.it:8443/CREAM175528403\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM175528403 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM175528403 2014-08-18 15:38:56.725800 Submit https://cert-08.pd.infn.it:8443/CREAM175528403 Left: 109 (at submission time:109) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM175528403 2014-08-18 15:38:57.065920 Exit https://cert-08.pd.infn.it:8443/CREAM565341698 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:38:57,751 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:38:57,782 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:38:57,782 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:38:57,782 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153857.log]\n', '2014-08-18 15:38:57,785 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:38:59,283 DEBUG - Will invoke JobStart for JobID [CREAM889866520]\n', 'https://cert-08.pd.infn.it:8443/CREAM889866520\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM889866520 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM889866520 2014-08-18 15:38:59.567084 Submit https://cert-08.pd.infn.it:8443/CREAM889866520 Left: 107 (at submission time:107) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM889866520 2014-08-18 15:39:56.804934 Exit https://cert-08.pd.infn.it:8443/CREAM550259400 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing.infn.it:8443/CREAM775561838\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM775561838 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM775561838 2014-08-18 15:36:57.692729 Submit https://cert-08.pd.infn.it:8443/CREAM775561838 Left: 115 (at submission time:115) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM775561838 2014-08-18 15:37:55.412419 Exit https://cert-08.pd.infn.it:8443/CREAM216927950 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:37:55,832 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:37:55,856 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:37:55,856 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:37:55,856 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153755.log]\n', '2014-08-18 15:37:55,860 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:37:57,531 DEBUG - Will invoke JobStart for JobID [CREAM317746483]\n', 'https://cert-08.pd.infn.it:8443/CREAM317746483\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM317746483 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM317746483 2014-08-18 15:37:57.842392 Submit https://cert-08.pd.infn.it:8443/CREAM317746483 Left: 112 (at submission time:112) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM317746483 2014-08-18 15:39:50.018842 Exit https://cert-08.pd.infn.it:8443/CREAM735921217 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:39:50,370 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:39:50,395 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:39:50,395 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:39:50,395 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153950.log]\n', '2014-08-18 15:39:50,401 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:39:51,422 DEBUG - Will invoke JobStart for JobID [CREAM986376526]\n', 'https://cert-08.pd.infn.it:8443/CREAM986376526\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM986376526 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM986376526 2014-08-18 15:39:51.690746 Submit https://cert-08.pd.infn.it:8443/CREAM986376526 Left: 106 (at submission time:106) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM986376526 2014-08-18 15:40:50.435317 Exit https://cert-08.pd.infn.it:8443/CREAM385578806 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing.infn.it:8443/CREAM280021003\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM280021003 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM280021003 2014-08-18 15:35:57.524774 Submit https://cert-08.pd.infn.it:8443/CREAM280021003 Left: 119 (at submission time:119) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM280021003 2014-08-18 15:37:55.604882 Exit https://cert-08.pd.infn.it:8443/CREAM516284792 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:37:56,545 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:37:56,568 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:37:56,568 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:37:56,568 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153756.log]\n', '2014-08-18 15:37:56,571 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:37:58,691 DEBUG - Will invoke JobStart for JobID [CREAM296543184]\n', 'https://cert-08.pd.infn.it:8443/CREAM296543184\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM296543184 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM296543184 2014-08-18 15:37:58.968111 Submit https://cert-08.pd.infn.it:8443/CREAM296543184 Left: 111 (at submission time:111) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM296543184 2014-08-18 15:38:49.477304 Exit https://cert-08.pd.infn.it:8443/CREAM862719828 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:38:49,835 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:38:49,865 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:38:49,866 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:38:49,866 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153849.log]\n', '2014-08-18 15:38:49,880 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:38:51,197 DEBUG - Will invoke JobStart for JobID [CREAM701932571]\n', 'https://cert-08.pd.infn.it:8443/CREAM701932571\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM701932571 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM701932571 2014-08-18 15:38:51.499808 Submit https://cert-08.pd.infn.it:8443/CREAM701932571 Left: 110 (at submission time:110) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM701932571 2014-08-18 15:40:54.836375 Exit https://cert-08.pd.infn.it:8443/CREAM970013961 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing.infn.it:8443/CREAM348809802\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM348809802 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM348809802 2014-08-18 15:36:56.393088 Submit https://cert-08.pd.infn.it:8443/CREAM348809802 Left: 116 (at submission time:116) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM348809802 2014-08-18 15:37:49.286001 Exit https://cert-08.pd.infn.it:8443/CREAM778029380 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:37:49,613 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:37:49,632 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:37:49,633 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:37:49,633 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153749.log]\n', '2014-08-18 15:37:49,644 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:37:50,789 DEBUG - Will invoke JobStart for JobID [CREAM018268985]\n', 'https://cert-08.pd.infn.it:8443/CREAM018268985\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM018268985 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM018268985 2014-08-18 15:37:51.174133 Submit https://cert-08.pd.infn.it:8443/CREAM018268985 Left: 114 (at submission time:114) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM018268985 2014-08-18 15:39:55.700820 Exit https://cert-08.pd.infn.it:8443/CREAM011586962 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:39:56,640 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:39:56,663 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:39:56,664 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:39:56,664 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153956.log]\n', '2014-08-18 15:39:56,667 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:39:57,897 DEBUG - Will invoke JobStart for JobID [CREAM557176229]\n', 'https://cert-08.pd.infn.it:8443/CREAM557176229\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM557176229 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM557176229 2014-08-18 15:39:58.349563 Submit https://cert-08.pd.infn.it:8443/CREAM557176229 Left: 104 (at submission time:104) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM557176229 2014-08-18 15:40:56.322966 Exit https://cert-08.pd.infn.it:8443/CREAM846154076 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testingled: 0 Illegal Final Status: 0 Collected 872/1000 2014-08-18 15:38:56.727976 Submitted: 891 Running: 19 Cancelled: 0 Done-Ok: 872 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 872/1000 2014-08-18 15:38:57.067356 Submitted: 891 Running: 18 Cancelled: 0 Done-Ok: 873 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 873/1000 2014-08-18 15:38:57.591738 Submitted: 892 Running: 19 Cancelled: 0 Done-Ok: 873 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 873/1000 2014-08-18 15:38:59.569402 Submitted: 893 Running: 20 Cancelled: 0 Done-Ok: 873 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 873/1000 2014-08-18 15:39:50.020976 Submitted: 893 Running: 19 Cancelled: 0 Done-Ok: 874 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 874/1000 2014-08-18 15:39:51.693846 Submitted: 894 Running: 20 Cancelled: 0 Done-Ok: 874 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 874/1000 2014-08-18 15:39:54.802223 Submitted: 894 Running: 19 Cancelled: 0 Done-Ok: 875 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 875/1000 2014-08-18 15:39:55.706747 Submitted: 894 Running: 18 Cancelled: 0 Done-Ok: 876 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 876/1000 2014-08-18 15:39:56.807821 Submitted: 894 Running: 17 Cancelled: 0 Done-Ok: 877 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 877/1000 2014-08-18 15:39:57.725606 Submitted: 895 Running: 18 Cancelled: 0 Done-Ok: 877 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 877/1000 2014-08-18 15:39:58.352085 Submitted: 896 Running: 19 Cancelled: 0 Done-Ok: 877 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 877/1000 2014-08-18 15:39:59.387251 Submitted: 897 Running: 20 Cancelled: 0 Done-Ok: 877 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 877/1000 2014-08-18 15:40:50.438171 Submitted: 897 Running: 19 Cancelled: 0 Done-Ok: 878 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 878/1000 2014-08-18 15:40:52.536012 Submitted: 898 Running: 20 Cancelled: 0 Done-Ok: 878 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 878/1000 2014-08-18 15:40:54.838703 Submitted: 898 Running: 19 Cancelled: 0 Done-Ok: 879 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 879/1000 2014-08-18 15:40:56.324918 Submitted: 898 Running: 18 Cancelled: 0 Done-Ok: 880 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 880/1000 2014-08-18 15:40:57.709175 Submitted: 899 Running: 19 Cancelled: 0 Done-Ok: 880 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 880/1000 2014-08-18 15:40:58.031622 Submitted: 899 Running: 18 Cancelled: 0 Done-Ok: 881 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 881/1000 2014-08-18 15:40:58.751822 Submitted: 900 Running: 19 Cancelled: 0 Done-Ok: 881 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 881/1000 2014-08-18 15:41:00.790981 Submitted: 901 Running: 20 Cancelled: 0 Done-Ok: 881 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:40:57,042 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:40:57,062 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:40:57,062 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:40:57,062 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154057.log]\n', '2014-08-18 15:40:57,066 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:40:58,393 DEBUG - Will invoke JobStart for JobID [CREAM763496536]\n', 'https://cert-08.pd.infn.it:8443/CREAM763496536\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM763496536 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM763496536 2014-08-18 15:40:58.750166 Submit https://cert-08.pd.infn.it:8443/CREAM763496536 Left: 100 (at submission time:100) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM763496536 2014-08-18 15:41:57.067104 Exit https://cert-08.pd.infn.it:8443/CREAM348809802 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:41:57,900 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:41:57,920 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:41:57,920 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:41:57,920 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154157.log]\n', '2014-08-18 15:41:57,923 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:41:59,266 DEBUG - Will invoke JobStart for JobID [CREAM930718609]\n', 'https://cert-08.pd.infn.it:8443/CREAM930718609\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM930718609 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM930718609 2014-08-18 15:41:59.524618 Submit https://cert-08.pd.infn.it:8443/CREAM930718609 Left: 95 (at submission time:95) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM930718609 2014-08-18 15:42:50.891679 Exit https://cert-08.pd.infn.it:8443/CREAM018268985 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:42:51,293 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:42:51,316 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:42:51,316 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:42:51,316 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154251.log]\n', '2014-08-18 15:42:51,321 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:39:55,499 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:39:55,517 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:39:55,518 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:39:55,518 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153955.log]\n', '2014-08-18 15:39:55,529 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:39:57,137 DEBUG - Will invoke JobStart for JobID [CREAM068807083]\n', 'https://cert-08.pd.infn.it:8443/CREAM068807083\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM068807083 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM068807083 2014-08-18 15:39:57.724259 Submit https://cert-08.pd.infn.it:8443/CREAM068807083 Left: 105 (at submission time:105) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM068807083 2014-08-18 15:41:54.918843 Exit https://cert-08.pd.infn.it:8443/CREAM362935168 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:41:55,669 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:41:55,702 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:41:55,702 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:41:55,703 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154155.log]\n', '2014-08-18 15:41:55,706 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:41:57,259 DEBUG - Will invoke JobStart for JobID [CREAM323140222]\n', 'https://cert-08.pd.infn.it:8443/CREAM323140222\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM323140222 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM323140222 2014-08-18 15:41:57.843096 Submit https://cert-08.pd.infn.it:8443/CREAM323140222 Left: 97 (at submission time:97) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM323140222 2014-08-18 15:42:55.935959 Exit https://cert-08.pd.infn.it:8443/CREAM113659206 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:42:56,660 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:42:56,682 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:42:56,682 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:42:56,682 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154256.log]\n', '2014-08-18 15:42:56,692 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:40:55,692 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:40:55,721 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:40:55,721 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:40:55,721 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154055.log]\n', '2014-08-18 15:40:55,724 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:40:57,272 DEBUG - Will invoke JobStart for JobID [CREAM169351480]\n', 'https://cert-08.pd.infn.it:8443/CREAM169351480\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM169351480 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM169351480 2014-08-18 15:40:57.708032 Submit https://cert-08.pd.infn.it:8443/CREAM169351480 Left: 101 (at submission time:101) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM169351480 2014-08-18 15:40:58.028215 Exit https://cert-08.pd.infn.it:8443/CREAM280021003 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:40:58,628 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:40:58,655 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:40:58,655 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:40:58,655 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154058.log]\n', '2014-08-18 15:40:58,658 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:41:00,284 DEBUG - Will invoke JobStart for JobID [CREAM584371177]\n', 'https://cert-08.pd.infn.it:8443/CREAM584371177\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM584371177 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM584371177 2014-08-18 15:41:00.787184 Submit https://cert-08.pd.infn.it:8443/CREAM584371177 Left: 99 (at submission time:99) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM584371177 2014-08-18 15:42:57.545129 Exit https://cert-08.pd.infn.it:8443/CREAM296543184 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:42:58,281 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:42:58,301 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:42:58,301 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:42:58,301 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154258.log]\n', '2014-08-18 15:42:58,305 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:40:50,778 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:40:50,806 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:40:50,806 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:40:50,806 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154050.log]\n', '2014-08-18 15:40:50,811 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:40:52,130 DEBUG - Will invoke JobStart for JobID [CREAM419335273]\n', 'https://cert-08.pd.infn.it:8443/CREAM419335273\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM419335273 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM419335273 2014-08-18 15:40:52.534364 Submit https://cert-08.pd.infn.it:8443/CREAM419335273 Left: 102 (at submission time:102) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM419335273 2014-08-18 15:41:56.224200 Exit https://cert-08.pd.infn.it:8443/CREAM775561838 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:41:56,961 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:41:56,984 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:41:56,984 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:41:56,984 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154156.log]\n', '2014-08-18 15:41:56,988 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:41:58,637 DEBUG - Will invoke JobStart for JobID [CREAM980770706]\n', 'https://cert-08.pd.infn.it:8443/CREAM980770706\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM980770706 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM980770706 2014-08-18 15:41:59.097477 Submit https://cert-08.pd.infn.it:8443/CREAM980770706 Left: 96 (at submission time:96) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM980770706 2014-08-18 15:42:57.756848 Exit https://cert-08.pd.infn.it:8443/CREAM317746483 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:42:58,462 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:42:58,485 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:42:58,485 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:42:58,485 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154258.log]\n', '2014-08-18 15:42:58,493 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File Failed: 0 Illegal Final Status: 0 Collected 881/1000 2014-08-18 15:41:50.995789 Submitted: 901 Running: 19 Cancelled: 0 Done-Ok: 882 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 882/1000 2014-08-18 15:41:53.006807 Submitted: 902 Running: 20 Cancelled: 0 Done-Ok: 882 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 882/1000 2014-08-18 15:41:54.922323 Submitted: 902 Running: 19 Cancelled: 0 Done-Ok: 883 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 883/1000 2014-08-18 15:41:56.228830 Submitted: 902 Running: 18 Cancelled: 0 Done-Ok: 884 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 884/1000 2014-08-18 15:41:57.071239 Submitted: 902 Running: 17 Cancelled: 0 Done-Ok: 885 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 885/1000 2014-08-18 15:41:57.843918 Submitted: 903 Running: 18 Cancelled: 0 Done-Ok: 885 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 885/1000 2014-08-18 15:41:59.100853 Submitted: 904 Running: 19 Cancelled: 0 Done-Ok: 885 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 885/1000 2014-08-18 15:41:59.527135 Submitted: 905 Running: 20 Cancelled: 0 Done-Ok: 885 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 885/1000 2014-08-18 15:42:50.893740 Submitted: 905 Running: 19 Cancelled: 0 Done-Ok: 886 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 886/1000 2014-08-18 15:42:52.843347 Submitted: 906 Running: 20 Cancelled: 0 Done-Ok: 886 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 886/1000 2014-08-18 15:42:55.940199 Submitted: 906 Running: 19 Cancelled: 0 Done-Ok: 887 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 887/1000 2014-08-18 15:42:57.547035 Submitted: 906 Running: 18 Cancelled: 0 Done-Ok: 888 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 888/1000 2014-08-18 15:42:57.759530 Submitted: 906 Running: 17 Cancelled: 0 Done-Ok: 889 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 889/1000 2014-08-18 15:42:58.593188 Submitted: 907 Running: 18 Cancelled: 0 Done-Ok: 889 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 889/1000 2014-08-18 15:43:00.240084 Submitted: 908 Running: 19 Cancelled: 0 Done-Ok: 889 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 889/1000 2014-08-18 15:43:00.602936 Submitted: 909 Running: 20 Cancelled: 0 Done-Ok: 889 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 889/1000 2014-08-18 15:43:51.844723 Submitted: 909 Running: 19 Cancelled: 0 Done-Ok: 890 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 890/1000 2014-08-18 15:43:53.607285 Submitted: 910 Running: 20 Cancelled: 0 Done-Ok: 890 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 890/1000 2014-08-18 15:43:56.369086 Submitted: 910 Running: 19 Cancelled: 0 Done-Ok: 891 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 891/1000 2014-08-18 15:43:58.059355 Submitted: 910 Running: 18 Cancelled: 0 Done-Ok: 892 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Ca-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:39:57,489 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:39:57,508 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:39:57,508 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:39:57,508 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-153957.log]\n', '2014-08-18 15:39:57,511 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:39:59,007 DEBUG - Will invoke JobStart for JobID [CREAM951785939]\n', 'https://cert-08.pd.infn.it:8443/CREAM951785939\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM951785939 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM951785939 2014-08-18 15:39:59.385666 Submit https://cert-08.pd.infn.it:8443/CREAM951785939 Left: 103 (at submission time:103) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM951785939 2014-08-18 15:41:50.994612 Exit https://cert-08.pd.infn.it:8443/CREAM864626545 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:41:51,320 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:41:51,341 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:41:51,341 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:41:51,341 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154151.log]\n', '2014-08-18 15:41:51,358 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:41:52,620 DEBUG - Will invoke JobStart for JobID [CREAM144966184]\n', 'https://cert-08.pd.infn.it:8443/CREAM144966184\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM144966184 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM144966184 2014-08-18 15:41:53.002718 Submit https://cert-08.pd.infn.it:8443/CREAM144966184 Left: 98 (at submission time:98) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM144966184 2014-08-18 15:43:56.365969 Exit https://cert-08.pd.infn.it:8443/CREAM175528403 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:43:57,131 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:43:57,154 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:43:57,154 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:43:57,154 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154357.log]\n', '2014-08-18 15:43:57,157 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:42:59,954 DEBUG - Will invoke JobStart for JobID [CREAM145335574]\n', 'https://cert-08.pd.infn.it:8443/CREAM145335574\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM145335574 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM145335574 2014-08-18 15:43:00.236800 Submit https://cert-08.pd.infn.it:8443/CREAM145335574 Left: 92 (at submission time:92) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM145335574 2014-08-18 15:43:51.842390 Exit https://cert-08.pd.infn.it:8443/CREAM701932571 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:43:52,193 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:43:52,217 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:43:52,217 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:43:52,217 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154352.log]\n', '2014-08-18 15:43:52,220 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:43:53,355 DEBUG - Will invoke JobStart for JobID [CREAM386197386]\n', 'https://cert-08.pd.infn.it:8443/CREAM386197386\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM386197386 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM386197386 2014-08-18 15:43:53.603056 Submit https://cert-08.pd.infn.it:8443/CREAM386197386 Left: 90 (at submission time:90) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM386197386 2014-08-18 15:45:57.581769 Exit https://cert-08.pd.infn.it:8443/CREAM169351480 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:45:58,302 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:45:58,325 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:45:58,326 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:45:58,326 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154558.log]\n', '2014-08-18 15:45:58,329 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:45:59,779 DEBUG - Will invoke JobStart for JobID [CREAM712968231]\n', 'https://cert-08.pd.infn.it:8443/CREAM712968231\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM712968231 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM712968231 2014-08-18 15:46:00.369302 Submit https://cert-08.pd.infn.it:8443/CREAM712968231 Left: 81 (at submission time:81) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM712968231 2014-08-18 15:46:00.713173 Exit https://cert-08.pd.infn.it:8443/CREAM584371177 Status: "DONE-OK" Entering submit wrapper I am going to calncel Failed: 0 Illegal Final Status: 0 Collected 892/1000 2014-08-18 15:43:58.642493 Submitted: 911 Running: 19 Cancelled: 0 Done-Ok: 892 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 892/1000 2014-08-18 15:43:59.061314 Submitted: 911 Running: 18 Cancelled: 0 Done-Ok: 893 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 893/1000 2014-08-18 15:44:00.814608 Submitted: 912 Running: 19 Cancelled: 0 Done-Ok: 893 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 893/1000 2014-08-18 15:44:01.477089 Submitted: 913 Running: 20 Cancelled: 0 Done-Ok: 893 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 893/1000 2014-08-18 15:44:51.908947 Submitted: 913 Running: 19 Cancelled: 0 Done-Ok: 894 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 894/1000 2014-08-18 15:44:53.893304 Submitted: 914 Running: 20 Cancelled: 0 Done-Ok: 894 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 894/1000 2014-08-18 15:44:56.573489 Submitted: 914 Running: 19 Cancelled: 0 Done-Ok: 895 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 895/1000 2014-08-18 15:44:58.272910 Submitted: 914 Running: 18 Cancelled: 0 Done-Ok: 896 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 896/1000 2014-08-18 15:44:59.349863 Submitted: 914 Running: 17 Cancelled: 0 Done-Ok: 897 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 897/1000 2014-08-18 15:44:59.567882 Submitted: 915 Running: 18 Cancelled: 0 Done-Ok: 897 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 897/1000 2014-08-18 15:45:00.839487 Submitted: 916 Running: 19 Cancelled: 0 Done-Ok: 897 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 897/1000 2014-08-18 15:45:01.578587 Submitted: 917 Running: 20 Cancelled: 0 Done-Ok: 897 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 897/1000 2014-08-18 15:45:52.556026 Submitted: 917 Running: 19 Cancelled: 0 Done-Ok: 898 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 898/1000 2014-08-18 15:45:54.470896 Submitted: 918 Running: 20 Cancelled: 0 Done-Ok: 898 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 898/1000 2014-08-18 15:45:57.583810 Submitted: 918 Running: 19 Cancelled: 0 Done-Ok: 899 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 899/1000 2014-08-18 15:45:58.786743 Submitted: 918 Running: 18 Cancelled: 0 Done-Ok: 900 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 900/1000 2014-08-18 15:46:00.370769 Submitted: 919 Running: 19 Cancelled: 0 Done-Ok: 900 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 900/1000 2014-08-18 15:46:00.715154 Submitted: 919 Running: 18 Cancelled: 0 Done-Ok: 901 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 901/1000 2014-08-18 15:46:01.769430 Submitted: 920 Running: 19 Cancelled: 0 Done-Ok: 901 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 901/1000 2014-08-18 15:46:03.180737 Submitted: 921 Running: 20 Cancelled: 0 Done-Ok: 901 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: =[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:43:58,396 DEBUG - Will invoke JobStart for JobID [CREAM234126859]\n', 'https://cert-08.pd.infn.it:8443/CREAM234126859\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM234126859 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM234126859 2014-08-18 15:43:58.639477 Submit https://cert-08.pd.infn.it:8443/CREAM234126859 Left: 89 (at submission time:89) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM234126859 2014-08-18 15:43:59.060195 Exit https://cert-08.pd.infn.it:8443/CREAM889866520 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:43:59,810 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:43:59,853 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:43:59,853 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:43:59,853 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154359.log]\n', '2014-08-18 15:43:59,859 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:44:01,180 DEBUG - Will invoke JobStart for JobID [CREAM674125742]\n', 'https://cert-08.pd.infn.it:8443/CREAM674125742\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM674125742 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM674125742 2014-08-18 15:44:01.475874 Submit https://cert-08.pd.infn.it:8443/CREAM674125742 Left: 87 (at submission time:87) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM674125742 2014-08-18 15:44:58.271563 Exit https://cert-08.pd.infn.it:8443/CREAM951785939 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:44:58,829 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:44:58,852 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:44:58,853 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:44:58,853 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154458.log]\n', '2014-08-18 15:44:58,857 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:45:00,249 DEBUG - Will invoke JobStart for JobID [CREAM051652168]\n', 'https://cert-08.pd.infn.it:8443/CREAM051652168\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM051652168 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM051652168 2014-08-18 15:45:00.836561 Submit https://cert-08.pd.infn.it:8443/CREAM051652168 Left: 84 (at submission time:84) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM051652168 2014-08-18 15:46:52.595637 Exit https://cert-08.pd.infn.it:8443/CREAM144966184 Status: "DONE-OK" Entering submit wrapper I am going to cal=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:42:58,266 DEBUG - Will invoke JobStart for JobID [CREAM936864719]\n', 'https://cert-08.pd.infn.it:8443/CREAM936864719\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM936864719 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM936864719 2014-08-18 15:42:58.592206 Submit https://cert-08.pd.infn.it:8443/CREAM936864719 Left: 93 (at submission time:93) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM936864719 2014-08-18 15:43:58.055825 Exit https://cert-08.pd.infn.it:8443/CREAM036118977 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:43:58,791 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:43:58,821 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:43:58,821 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:43:58,821 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154358.log]\n', '2014-08-18 15:43:58,830 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:44:00,388 DEBUG - Will invoke JobStart for JobID [CREAM452092677]\n', 'https://cert-08.pd.infn.it:8443/CREAM452092677\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM452092677 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM452092677 2014-08-18 15:44:00.811541 Submit https://cert-08.pd.infn.it:8443/CREAM452092677 Left: 88 (at submission time:88) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM452092677 2014-08-18 15:44:56.570248 Exit https://cert-08.pd.infn.it:8443/CREAM068807083 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:44:57,356 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:44:57,379 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:44:57,379 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:44:57,379 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154457.log]\n', '2014-08-18 15:44:57,390 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:44:59,071 DEBUG - Will invoke JobStart for JobID [CREAM533090149]\n', 'https://cert-08.pd.infn.it:8443/CREAM533090149\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM533090149 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM533090149 2014-08-18 15:44:59.566177 Submit https://cert-08.pd.infn.it:8443/CREAM533090149 Left: 85 (at submission time:85) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM533090149 2014-08-18 15:46:58.075112 Exit https://cert-08.pd.infn.it:8443/CREAM323140222 Status: "DONE-OK" Entering submit wrapper I am going to cal=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:42:52,599 DEBUG - Will invoke JobStart for JobID [CREAM704874061]\n', 'https://cert-08.pd.infn.it:8443/CREAM704874061\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM704874061 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM704874061 2014-08-18 15:42:52.840563 Submit https://cert-08.pd.infn.it:8443/CREAM704874061 Left: 94 (at submission time:94) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM704874061 2014-08-18 15:44:59.347020 Exit https://cert-08.pd.infn.it:8443/CREAM557176229 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:45:00,129 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:45:00,152 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:45:00,153 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:45:00,153 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154500.log]\n', '2014-08-18 15:45:00,156 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:45:01,329 DEBUG - Will invoke JobStart for JobID [CREAM977261822]\n', 'https://cert-08.pd.infn.it:8443/CREAM977261822\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM977261822 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM977261822 2014-08-18 15:45:01.574174 Submit https://cert-08.pd.infn.it:8443/CREAM977261822 Left: 83 (at submission time:83) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM977261822 2014-08-18 15:45:58.784425 Exit https://cert-08.pd.infn.it:8443/CREAM763496536 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:45:59,712 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:45:59,746 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:45:59,746 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:45:59,746 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154559.log]\n', '2014-08-18 15:45:59,754 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:46:01,363 DEBUG - Will invoke JobStart for JobID [CREAM460478374]\n', 'https://cert-08.pd.infn.it:8443/CREAM460478374\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM460478374 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM460478374 2014-08-18 15:46:01.765338 Submit https://cert-08.pd.infn.it:8443/CREAM460478374 Left: 80 (at submission time:80) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM460478374 2014-08-18 15:46:59.637972 Exit https://cert-08.pd.infn.it:8443/CREAM930718609 Status: "DONE-OK" Entering submit wrapper I am going to cal=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:43:00,254 DEBUG - Will invoke JobStart for JobID [CREAM068820247]\n', 'https://cert-08.pd.infn.it:8443/CREAM068820247\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM068820247 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM068820247 2014-08-18 15:43:00.600360 Submit https://cert-08.pd.infn.it:8443/CREAM068820247 Left: 91 (at submission time:91) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM068820247 2014-08-18 15:44:51.906637 Exit https://cert-08.pd.infn.it:8443/CREAM986376526 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:44:52,276 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:44:52,300 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:44:52,300 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:44:52,300 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154452.log]\n', '2014-08-18 15:44:52,308 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:44:53,662 DEBUG - Will invoke JobStart for JobID [CREAM899202123]\n', 'https://cert-08.pd.infn.it:8443/CREAM899202123\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM899202123 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM899202123 2014-08-18 15:44:53.891442 Submit https://cert-08.pd.infn.it:8443/CREAM899202123 Left: 86 (at submission time:86) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM899202123 2014-08-18 15:45:52.554313 Exit https://cert-08.pd.infn.it:8443/CREAM419335273 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:45:52,888 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:45:52,926 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:45:52,927 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:45:52,927 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154552.log]\n', '2014-08-18 15:45:52,930 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:45:54,128 DEBUG - Will invoke JobStart for JobID [CREAM328063080]\n', 'https://cert-08.pd.infn.it:8443/CREAM328063080\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM328063080 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM328063080 2014-08-18 15:45:54.469445 Submit https://cert-08.pd.infn.it:8443/CREAM328063080 Left: 82 (at submission time:82) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM328063080 2014-08-18 15:46:59.894629 Exit https://cert-08.pd.infn.it:8443/CREAM980770706 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:46:01,270 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:46:01,290 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:46:01,290 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:46:01,290 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154601.log]\n', '2014-08-18 15:46:01,295 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:46:02,817 DEBUG - Will invoke JobStart for JobID [CREAM253863876]\n', 'https://cert-08.pd.infn.it:8443/CREAM253863876\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM253863876 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM253863876 2014-08-18 15:46:03.179441 Submit https://cert-08.pd.infn.it:8443/CREAM253863876 Left: 79 (at submission time:79) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM253863876 2014-08-18 15:48:00.465730 Exit https://cert-08.pd.infn.it:8443/CREAM145335574 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:48:01,345 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:48:01,371 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:48:01,371 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:48:01,371 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154801.log]\n', '2014-08-18 15:48:01,374 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:48:02,826 DEBUG - Will invoke JobStart for JobID [CREAM995327060]\n', 'https://cert-08.pd.infn.it:8443/CREAM995327060\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM995327060 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM995327060 2014-08-18 15:48:03.167903 Submit https://cert-08.pd.infn.it:8443/CREAM995327060 Left: 71 (at submission time:71) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM995327060 2014-08-18 15:48:53.645425 Exit https://cert-08.pd.infn.it:8443/CREAM386197386 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:48:54,021 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:48:54,046 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:48:54,046 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:48:54,046 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154854.log]\n', '2014-08-18 15:48:54,052 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSy0 Cancel Failed: 0 Illegal Final Status: 0 Collected 901/1000 2014-08-18 15:46:52.599401 Submitted: 921 Running: 19 Cancelled: 0 Done-Ok: 902 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 902/1000 2014-08-18 15:46:54.700709 Submitted: 922 Running: 20 Cancelled: 0 Done-Ok: 902 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 902/1000 2014-08-18 15:46:58.077636 Submitted: 922 Running: 19 Cancelled: 0 Done-Ok: 903 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 903/1000 2014-08-18 15:46:59.641189 Submitted: 922 Running: 18 Cancelled: 0 Done-Ok: 904 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 904/1000 2014-08-18 15:46:59.896879 Submitted: 922 Running: 17 Cancelled: 0 Done-Ok: 905 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 905/1000 2014-08-18 15:47:00.682007 Submitted: 923 Running: 18 Cancelled: 0 Done-Ok: 905 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 905/1000 2014-08-18 15:47:02.289751 Submitted: 924 Running: 19 Cancelled: 0 Done-Ok: 905 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 905/1000 2014-08-18 15:47:02.702627 Submitted: 925 Running: 20 Cancelled: 0 Done-Ok: 905 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 905/1000 2014-08-18 15:47:53.515044 Submitted: 925 Running: 19 Cancelled: 0 Done-Ok: 906 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 906/1000 2014-08-18 15:47:55.465054 Submitted: 926 Running: 20 Cancelled: 0 Done-Ok: 906 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 906/1000 2014-08-18 15:47:58.163705 Submitted: 926 Running: 19 Cancelled: 0 Done-Ok: 907 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 907/1000 2014-08-18 15:48:00.329488 Submitted: 926 Running: 18 Cancelled: 0 Done-Ok: 908 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 908/1000 2014-08-18 15:48:00.468885 Submitted: 926 Running: 17 Cancelled: 0 Done-Ok: 909 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 909/1000 2014-08-18 15:48:00.759125 Submitted: 927 Running: 18 Cancelled: 0 Done-Ok: 909 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 909/1000 2014-08-18 15:48:02.939476 Submitted: 928 Running: 19 Cancelled: 0 Done-Ok: 909 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 909/1000 2014-08-18 15:48:03.169234 Submitted: 929 Running: 20 Cancelled: 0 Done-Ok: 909 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 909/1000 2014-08-18 15:48:53.647773 Submitted: 929 Running: 19 Cancelled: 0 Done-Ok: 910 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 910/1000 2014-08-18 15:48:55.537324 Submitted: 930 Running: 20 Cancelled: 0 Done-Ok: 910 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 910/1000 2014-08-18 15:48:58.292911 Submitted: 930 Running: 19 Cancelled: 0 Done-Ok: 911 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 911/1000 2014-08-18 15:49:00.933408 Submitted: 931 Running: 20 Cancelled: 0 Done-Ok: 911 Failed: 0 Aborted: 0 Status Failed: 0 Submit Faill submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:46:52,981 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:46:53,008 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:46:53,008 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:46:53,008 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154653.log]\n', '2014-08-18 15:46:53,020 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:46:54,336 DEBUG - Will invoke JobStart for JobID [CREAM399667892]\n', 'https://cert-08.pd.infn.it:8443/CREAM399667892\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM399667892 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM399667892 2014-08-18 15:46:54.696953 Submit https://cert-08.pd.infn.it:8443/CREAM399667892 Left: 78 (at submission time:78) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM399667892 2014-08-18 15:48:58.289926 Exit https://cert-08.pd.infn.it:8443/CREAM234126859 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:48:59,120 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:48:59,146 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:48:59,146 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:48:59,146 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154859.log]\n', '2014-08-18 15:48:59,150 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:49:00,652 DEBUG - Will invoke JobStart for JobID [CREAM245028676]\n', 'https://cert-08.pd.infn.it:8443/CREAM245028676\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM245028676 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM245028676 2014-08-18 15:49:00.930539 Submit https://cert-08.pd.infn.it:8443/CREAM245028676 Left: 69 (at submission time:69) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM245028676 2014-08-18 15:49:01.216399 Exit https://cert-08.pd.infn.it:8443/CREAM674125742 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:49:02,047 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:49:02,071 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:49:02,071 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:49:02,071 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154902.log]\n', '2014-08-18 15:49:02,075 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSyl submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:46:58,686 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:46:58,716 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:46:58,717 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:46:58,717 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154658.log]\n', '2014-08-18 15:46:58,721 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:47:00,201 DEBUG - Will invoke JobStart for JobID [CREAM191472394]\n', 'https://cert-08.pd.infn.it:8443/CREAM191472394\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM191472394 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM191472394 2014-08-18 15:47:00.680330 Submit https://cert-08.pd.infn.it:8443/CREAM191472394 Left: 77 (at submission time:77) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM191472394 2014-08-18 15:47:58.159031 Exit https://cert-08.pd.infn.it:8443/CREAM936864719 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:47:58,949 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:47:58,977 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:47:58,977 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:47:58,978 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154758.log]\n', '2014-08-18 15:47:58,981 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:48:00,351 DEBUG - Will invoke JobStart for JobID [CREAM073275856]\n', 'https://cert-08.pd.infn.it:8443/CREAM073275856\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM073275856 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM073275856 2014-08-18 15:48:00.757362 Submit https://cert-08.pd.infn.it:8443/CREAM073275856 Left: 73 (at submission time:73) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM073275856 2014-08-18 15:49:01.058750 Exit https://cert-08.pd.infn.it:8443/CREAM452092677 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:49:01,859 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:49:01,880 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:49:01,880 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:49:01,880 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154901.log]\n', '2014-08-18 15:49:01,883 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSyl submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:47:00,526 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:47:00,550 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:47:00,550 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:47:00,550 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154700.log]\n', '2014-08-18 15:47:00,554 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:47:02,310 DEBUG - Will invoke JobStart for JobID [CREAM353756889]\n', 'https://cert-08.pd.infn.it:8443/CREAM353756889\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM353756889 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM353756889 2014-08-18 15:47:02.701435 Submit https://cert-08.pd.infn.it:8443/CREAM353756889 Left: 75 (at submission time:75) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM353756889 2014-08-18 15:48:00.327398 Exit https://cert-08.pd.infn.it:8443/CREAM068820247 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:48:01,120 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:48:01,143 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:48:01,143 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:48:01,143 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154801.log]\n', '2014-08-18 15:48:01,146 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:48:02,759 DEBUG - Will invoke JobStart for JobID [CREAM495383880]\n', 'https://cert-08.pd.infn.it:8443/CREAM495383880\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM495383880 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM495383880 2014-08-18 15:48:02.938279 Submit https://cert-08.pd.infn.it:8443/CREAM495383880 Left: 72 (at submission time:72) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM495383880 2014-08-18 15:49:54.324563 Exit https://cert-08.pd.infn.it:8443/CREAM899202123 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:49:54,697 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:49:54,726 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:49:54,727 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:49:54,727 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154954.log]\n', '2014-08-18 15:49:54,731 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSyl submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:47:00,471 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:47:00,494 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:47:00,494 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:47:00,494 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154700.log]\n', '2014-08-18 15:47:00,497 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:47:01,985 DEBUG - Will invoke JobStart for JobID [CREAM486668489]\n', 'https://cert-08.pd.infn.it:8443/CREAM486668489\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM486668489 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM486668489 2014-08-18 15:47:02.288722 Submit https://cert-08.pd.infn.it:8443/CREAM486668489 Left: 76 (at submission time:76) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM486668489 2014-08-18 15:47:53.513362 Exit https://cert-08.pd.infn.it:8443/CREAM704874061 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:47:53,882 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:47:53,911 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:47:53,911 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:47:53,911 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-154753.log]\n', '2014-08-18 15:47:53,920 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:47:55,202 DEBUG - Will invoke JobStart for JobID [CREAM508501778]\n', 'https://cert-08.pd.infn.it:8443/CREAM508501778\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM508501778 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM508501778 2014-08-18 15:47:55.463619 Submit https://cert-08.pd.infn.it:8443/CREAM508501778 Left: 74 (at submission time:74) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM508501778 2014-08-18 15:50:01.865428 Exit https://cert-08.pd.infn.it:8443/CREAM977261822 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:50:02,503 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:50:02,522 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:50:02,522 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:50:02,523 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155002.log]\n', '2014-08-18 15:50:02,525 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:48:55,318 DEBUG - Will invoke JobStart for JobID [CREAM131340290]\n', 'https://cert-08.pd.infn.it:8443/CREAM131340290\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM131340290 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM131340290 2014-08-18 15:48:55.530911 Submit https://cert-08.pd.infn.it:8443/CREAM131340290 Left: 70 (at submission time:70) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM131340290 2014-08-18 15:50:59.097569 Exit https://cert-08.pd.infn.it:8443/CREAM712968231 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:50:59,818 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:50:59,845 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:50:59,845 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:50:59,845 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155059.log]\n', '2014-08-18 15:50:59,849 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:51:01,376 DEBUG - Will invoke JobStart for JobID [CREAM609719050]\n', 'https://cert-08.pd.infn.it:8443/CREAM609719050\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM609719050 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM609719050 2014-08-18 15:51:01.537167 Submit https://cert-08.pd.infn.it:8443/CREAM609719050 Left: 61 (at submission time:61) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM609719050 2014-08-18 15:51:02.129182 Exit https://cert-08.pd.infn.it:8443/CREAM253863876 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:51:02,739 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:51:02,763 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:51:02,763 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:51:02,763 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155102.log]\n', '2014-08-18 15:51:02,772 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:51:04,309 DEBUG - Will invoke JobStart for JobID [CREAM989522200]\n', 'https://cert-08.pd.infn.it:8443/CREAM989522200\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM989522200 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM989522200 2014-08-18 15:51:04.620039 Submit https://cert-08.pd.infn.it:8443/CREAM989522200 Left: 59 (at submission time:59) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM989522ed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 911/1000 2014-08-18 15:49:01.060147 Submitted: 931 Running: 19 Cancelled: 0 Done-Ok: 912 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 912/1000 2014-08-18 15:49:01.218497 Submitted: 931 Running: 18 Cancelled: 0 Done-Ok: 913 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 913/1000 2014-08-18 15:49:03.821607 Submitted: 932 Running: 19 Cancelled: 0 Done-Ok: 913 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 913/1000 2014-08-18 15:49:04.006558 Submitted: 933 Running: 20 Cancelled: 0 Done-Ok: 913 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 913/1000 2014-08-18 15:49:54.325942 Submitted: 933 Running: 19 Cancelled: 0 Done-Ok: 914 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 914/1000 2014-08-18 15:49:56.421165 Submitted: 934 Running: 20 Cancelled: 0 Done-Ok: 914 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 914/1000 2014-08-18 15:49:59.324216 Submitted: 934 Running: 19 Cancelled: 0 Done-Ok: 915 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 915/1000 2014-08-18 15:50:00.182828 Submitted: 934 Running: 18 Cancelled: 0 Done-Ok: 916 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 916/1000 2014-08-18 15:50:01.867629 Submitted: 934 Running: 17 Cancelled: 0 Done-Ok: 917 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 917/1000 2014-08-18 15:50:02.132591 Submitted: 935 Running: 18 Cancelled: 0 Done-Ok: 917 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 917/1000 2014-08-18 15:50:03.436162 Submitted: 936 Running: 19 Cancelled: 0 Done-Ok: 917 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 917/1000 2014-08-18 15:50:04.222570 Submitted: 937 Running: 20 Cancelled: 0 Done-Ok: 917 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 917/1000 2014-08-18 15:50:54.357111 Submitted: 937 Running: 19 Cancelled: 0 Done-Ok: 918 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 918/1000 2014-08-18 15:50:56.570813 Submitted: 938 Running: 20 Cancelled: 0 Done-Ok: 918 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 918/1000 2014-08-18 15:50:59.099438 Submitted: 938 Running: 19 Cancelled: 0 Done-Ok: 919 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 919/1000 2014-08-18 15:51:00.643672 Submitted: 938 Running: 18 Cancelled: 0 Done-Ok: 920 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 920/1000 2014-08-18 15:51:01.538589 Submitted: 939 Running: 19 Cancelled: 0 Done-Ok: 920 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 920/1000 2014-08-18 15:51:02.130710 Submitted: 939 Running: 18 Cancelled: 0 Done-Ok: 921 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 921/1000 2014-08-18 15:51:02.913731 Submitted: 940 Running: 19 Cancelled: 0 Done-Ok: 921 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 921/1000 2014-08-18 15:51:04.621406 Submitted: 941 Running: 20 Cancelled: 0 Done-Ok: 921 Failed: 0 Aborted: 0 Status Failed: 0 Submit stem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:49:03,510 DEBUG - Will invoke JobStart for JobID [CREAM597274180]\n', 'https://cert-08.pd.infn.it:8443/CREAM597274180\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM597274180 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM597274180 2014-08-18 15:49:03.819867 Submit https://cert-08.pd.infn.it:8443/CREAM597274180 Left: 67 (at submission time:67) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM597274180 2014-08-18 15:50:00.180867 Exit https://cert-08.pd.infn.it:8443/CREAM051652168 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:50:01,011 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:50:01,052 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:50:01,053 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:50:01,053 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155001.log]\n', '2014-08-18 15:50:01,061 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:50:02,651 DEBUG - Will invoke JobStart for JobID [CREAM545182002]\n', 'https://cert-08.pd.infn.it:8443/CREAM545182002\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM545182002 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM545182002 2014-08-18 15:50:03.433547 Submit https://cert-08.pd.infn.it:8443/CREAM545182002 Left: 64 (at submission time:64) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM545182002 2014-08-18 15:51:55.300076 Exit https://cert-08.pd.infn.it:8443/CREAM399667892 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:51:55,660 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:51:55,693 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:51:55,693 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:51:55,693 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155155.log]\n', '2014-08-18 15:51:55,703 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:51:57,010 DEBUG - Will invoke JobStart for JobID [CREAM780645608]\n', 'https://cert-08.pd.infn.it:8443/CREAM780645608\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM780645608 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM780645608 2014-08-18 15:51:57.395628 Submit https://cert-08.pd.infn.it:8443/CREAM780645608 Left: 58 (at submission time:58) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM780645stem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:49:03,710 DEBUG - Will invoke JobStart for JobID [CREAM041946294]\n', 'https://cert-08.pd.infn.it:8443/CREAM041946294\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM041946294 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM041946294 2014-08-18 15:49:04.004432 Submit https://cert-08.pd.infn.it:8443/CREAM041946294 Left: 68 (at submission time:68) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM041946294 2014-08-18 15:49:59.322968 Exit https://cert-08.pd.infn.it:8443/CREAM533090149 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:50:00,104 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:50:00,122 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:50:00,123 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:50:00,123 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155000.log]\n', '2014-08-18 15:50:00,126 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:50:01,694 DEBUG - Will invoke JobStart for JobID [CREAM788800865]\n', 'https://cert-08.pd.infn.it:8443/CREAM788800865\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM788800865 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM788800865 2014-08-18 15:50:02.131661 Submit https://cert-08.pd.infn.it:8443/CREAM788800865 Left: 65 (at submission time:65) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM788800865 2014-08-18 15:51:59.479848 Exit https://cert-08.pd.infn.it:8443/CREAM191472394 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:52:00,194 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:52:00,232 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:52:00,232 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:52:00,232 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155200.log]\n', '2014-08-18 15:52:00,236 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:52:01,894 DEBUG - Will invoke JobStart for JobID [CREAM047593982]\n', 'https://cert-08.pd.infn.it:8443/CREAM047593982\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM047593982 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM047593982 2014-08-18 15:52:02.193048 Submit https://cert-08.pd.infn.it:8443/CREAM047593982 Left: 57 (at submission time:57) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM047593stem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:50:03,897 DEBUG - Will invoke JobStart for JobID [CREAM529405455]\n', 'https://cert-08.pd.infn.it:8443/CREAM529405455\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM529405455 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM529405455 2014-08-18 15:50:04.220764 Submit https://cert-08.pd.infn.it:8443/CREAM529405455 Left: 63 (at submission time:63) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM529405455 2014-08-18 15:51:00.640491 Exit https://cert-08.pd.infn.it:8443/CREAM460478374 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:51:01,392 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:51:01,431 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:51:01,431 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:51:01,431 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155101.log]\n', '2014-08-18 15:51:01,440 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:51:02,715 DEBUG - Will invoke JobStart for JobID [CREAM818470384]\n', 'https://cert-08.pd.infn.it:8443/CREAM818470384\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM818470384 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM818470384 2014-08-18 15:51:02.910667 Submit https://cert-08.pd.infn.it:8443/CREAM818470384 Left: 60 (at submission time:60) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM818470384 2014-08-18 15:52:01.804602 Exit https://cert-08.pd.infn.it:8443/CREAM486668489 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:52:02,678 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:52:02,701 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:52:02,701 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:52:02,702 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155202.log]\n', '2014-08-18 15:52:02,704 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:52:04,358 DEBUG - Will invoke JobStart for JobID [CREAM303715683]\n', 'https://cert-08.pd.infn.it:8443/CREAM303715683\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM303715683 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM303715683 2014-08-18 15:52:04.769472 Submit https://cert-08.pd.infn.it:8443/CREAM303715683 Left: 56 (at submission time:56) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM303715stem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:49:56,001 DEBUG - Will invoke JobStart for JobID [CREAM910606916]\n', 'https://cert-08.pd.infn.it:8443/CREAM910606916\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM910606916 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM910606916 2014-08-18 15:49:56.418938 Submit https://cert-08.pd.infn.it:8443/CREAM910606916 Left: 66 (at submission time:66) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM910606916 2014-08-18 15:50:54.353826 Exit https://cert-08.pd.infn.it:8443/CREAM328063080 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:50:54,692 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:50:54,726 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:50:54,726 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:50:54,726 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155054.log]\n', '2014-08-18 15:50:54,733 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:50:56,125 DEBUG - Will invoke JobStart for JobID [CREAM988477599]\n', 'https://cert-08.pd.infn.it:8443/CREAM988477599\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM988477599 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM988477599 2014-08-18 15:50:56.568379 Submit https://cert-08.pd.infn.it:8443/CREAM988477599 Left: 62 (at submission time:62) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM988477599 2014-08-18 15:52:02.479557 Exit https://cert-08.pd.infn.it:8443/CREAM353756889 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:52:03,560 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:52:03,583 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:52:03,583 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:52:03,583 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155203.log]\n', '2014-08-18 15:52:03,586 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:52:04,907 DEBUG - Will invoke JobStart for JobID [CREAM344993563]\n', 'https://cert-08.pd.infn.it:8443/CREAM344993563\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM344993563 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM344993563 2014-08-18 15:52:05.248620 Submit https://cert-08.pd.infn.it:8443/CREAM344993563 Left: 55 (at submission time:55) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM344993Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 921/1000 2014-08-18 15:51:55.302248 Submitted: 941 Running: 19 Cancelled: 0 Done-Ok: 922 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 922/1000 2014-08-18 15:51:57.397167 Submitted: 942 Running: 20 Cancelled: 0 Done-Ok: 922 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 922/1000 2014-08-18 15:51:59.482820 Submitted: 942 Running: 19 Cancelled: 0 Done-Ok: 923 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 923/1000 2014-08-18 15:52:01.809036 Submitted: 942 Running: 18 Cancelled: 0 Done-Ok: 924 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 924/1000 2014-08-18 15:52:02.197320 Submitted: 943 Running: 19 Cancelled: 0 Done-Ok: 924 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 924/1000 2014-08-18 15:52:02.481376 Submitted: 943 Running: 18 Cancelled: 0 Done-Ok: 925 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 925/1000 2014-08-18 15:52:04.776312 Submitted: 944 Running: 19 Cancelled: 0 Done-Ok: 925 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 925/1000 2014-08-18 15:52:05.251004 Submitted: 945 Running: 20 Cancelled: 0 Done-Ok: 925 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 925/1000 2014-08-18 15:52:55.462015 Submitted: 945 Running: 19 Cancelled: 0 Done-Ok: 926 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 926/1000 2014-08-18 15:52:57.361869 Submitted: 946 Running: 20 Cancelled: 0 Done-Ok: 926 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 926/1000 2014-08-18 15:52:59.918801 Submitted: 946 Running: 19 Cancelled: 0 Done-Ok: 927 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 927/1000 2014-08-18 15:53:01.445676 Submitted: 946 Running: 18 Cancelled: 0 Done-Ok: 928 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 928/1000 2014-08-18 15:53:02.382618 Submitted: 947 Running: 19 Cancelled: 0 Done-Ok: 928 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 928/1000 2014-08-18 15:53:03.284770 Submitted: 947 Running: 18 Cancelled: 0 Done-Ok: 929 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 929/1000 2014-08-18 15:53:04.123076 Submitted: 948 Running: 19 Cancelled: 0 Done-Ok: 929 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 929/1000 2014-08-18 15:53:05.895904 Submitted: 949 Running: 20 Cancelled: 0 Done-Ok: 929 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 929/1000 2014-08-18 15:53:55.945065 Submitted: 949 Running: 19 Cancelled: 0 Done-Ok: 930 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 930/1000 2014-08-18 15:53:57.861025 Submitted: 950 Running: 20 Cancelled: 0 Done-Ok: 930 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 930/1000 2014-08-18 15:54:01.162559 Submitted: 950 Running: 19 Cancelled: 0 Done-Ok: 931 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 931/1000 2014-08-18 15:54:02.067079 Submitted: 950 Running: 18 Cancelled: 0 Done-Ok: 932 Failed: 0 Aborted: 0 Status Failed: 0 Sub982 2014-08-18 15:52:59.916615 Exit https://cert-08.pd.infn.it:8443/CREAM073275856 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:53:00,557 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:53:00,575 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:53:00,576 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:53:00,576 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155300.log]\n', '2014-08-18 15:53:00,580 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:53:02,115 DEBUG - Will invoke JobStart for JobID [CREAM366176969]\n', 'https://cert-08.pd.infn.it:8443/CREAM366176969\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM366176969 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM366176969 2014-08-18 15:53:02.379569 Submit https://cert-08.pd.infn.it:8443/CREAM366176969 Left: 53 (at submission time:53) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM366176969 2014-08-18 15:54:02.063845 Exit https://cert-08.pd.infn.it:8443/CREAM041946294 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:54:02,971 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:54:02,997 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:54:02,997 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:54:02,997 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155402.log]\n', '2014-08-18 15:54:03,001 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:54:04,548 DEBUG - Will invoke JobStart for JobID [CREAM639789060]\n', 'https://cert-08.pd.infn.it:8443/CREAM639789060\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM639789060 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM639789060 2014-08-18 15:54:04.809448 Submit https://cert-08.pd.infn.it:8443/CREAM639789060 Left: 48 (at submission time:48) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM639789060 2014-08-18 15:55:00.944032 Exit https://cert-08.pd.infn.it:8443/CREAM788800865 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:55:01,553 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:55:01,581 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:55:01,582 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:55:01,582 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155501608 2014-08-18 15:54:01.160124 Exit https://cert-08.pd.infn.it:8443/CREAM245028676 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:54:01,890 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:54:01,916 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:54:01,917 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:54:01,917 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155401.log]\n', '2014-08-18 15:54:01,928 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:54:03,549 DEBUG - Will invoke JobStart for JobID [CREAM902627027]\n', 'https://cert-08.pd.infn.it:8443/CREAM902627027\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM902627027 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM902627027 2014-08-18 15:54:04.012513 Submit https://cert-08.pd.infn.it:8443/CREAM902627027 Left: 49 (at submission time:49) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM902627027 2014-08-18 15:54:04.348345 Exit https://cert-08.pd.infn.it:8443/CREAM597274180 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:54:05,272 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:54:05,304 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:54:05,304 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:54:05,304 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155405.log]\n', '2014-08-18 15:54:05,308 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:54:06,790 DEBUG - Will invoke JobStart for JobID [CREAM377010817]\n', 'https://cert-08.pd.infn.it:8443/CREAM377010817\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM377010817 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM377010817 2014-08-18 15:54:07.120302 Submit https://cert-08.pd.infn.it:8443/CREAM377010817 Left: 47 (at submission time:47) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM377010817 2014-08-18 15:55:02.244348 Exit https://cert-08.pd.infn.it:8443/CREAM545182002 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:55:02,940 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:55:02,970 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:55:02,970 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:55:02,970 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155502563 2014-08-18 15:53:01.442993 Exit https://cert-08.pd.infn.it:8443/CREAM495383880 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:53:02,208 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:53:02,236 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:53:02,236 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:53:02,236 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155302.log]\n', '2014-08-18 15:53:02,240 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:53:03,800 DEBUG - Will invoke JobStart for JobID [CREAM096835642]\n', 'https://cert-08.pd.infn.it:8443/CREAM096835642\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM096835642 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM096835642 2014-08-18 15:53:04.120214 Submit https://cert-08.pd.infn.it:8443/CREAM096835642 Left: 52 (at submission time:52) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM096835642 2014-08-18 15:54:56.529093 Exit https://cert-08.pd.infn.it:8443/CREAM910606916 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:54:56,862 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:54:56,882 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:54:56,882 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:54:56,882 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155456.log]\n', '2014-08-18 15:54:56,887 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:54:58,157 DEBUG - Will invoke JobStart for JobID [CREAM114599105]\n', 'https://cert-08.pd.infn.it:8443/CREAM114599105\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM114599105 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM114599105 2014-08-18 15:54:58.599974 Submit https://cert-08.pd.infn.it:8443/CREAM114599105 Left: 46 (at submission time:46) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM114599105 2014-08-18 15:55:56.673704 Exit https://cert-08.pd.infn.it:8443/CREAM988477599 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:55:57,038 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:55:57,064 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:55:57,065 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:55:57,065 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155557200 2014-08-18 15:53:03.281607 Exit https://cert-08.pd.infn.it:8443/CREAM995327060 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:53:04,008 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:53:04,028 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:53:04,028 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:53:04,028 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155304.log]\n', '2014-08-18 15:53:04,031 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:53:05,665 DEBUG - Will invoke JobStart for JobID [CREAM310805805]\n', 'https://cert-08.pd.infn.it:8443/CREAM310805805\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM310805805 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM310805805 2014-08-18 15:53:05.894511 Submit https://cert-08.pd.infn.it:8443/CREAM310805805 Left: 51 (at submission time:51) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM310805805 2014-08-18 15:53:55.941312 Exit https://cert-08.pd.infn.it:8443/CREAM131340290 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:53:56,280 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:53:56,305 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:53:56,305 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:53:56,305 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155356.log]\n', '2014-08-18 15:53:56,315 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:53:57,599 DEBUG - Will invoke JobStart for JobID [CREAM730390136]\n', 'https://cert-08.pd.infn.it:8443/CREAM730390136\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM730390136 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM730390136 2014-08-18 15:53:57.857756 Submit https://cert-08.pd.infn.it:8443/CREAM730390136 Left: 50 (at submission time:50) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM730390136 2014-08-18 15:56:01.797311 Exit https://cert-08.pd.infn.it:8443/CREAM609719050 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:56:02,645 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:56:02,668 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:56:02,668 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:56:02,668 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155602683 2014-08-18 15:52:55.460178 Exit https://cert-08.pd.infn.it:8443/CREAM508501778 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:52:55,820 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:52:55,844 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:52:55,844 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:52:55,844 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155255.log]\n', '2014-08-18 15:52:55,847 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:52:57,114 DEBUG - Will invoke JobStart for JobID [CREAM203218834]\n', 'https://cert-08.pd.infn.it:8443/CREAM203218834\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM203218834 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM203218834 2014-08-18 15:52:57.359004 Submit https://cert-08.pd.infn.it:8443/CREAM203218834 Left: 54 (at submission time:54) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM203218834 2014-08-18 15:55:03.426890 Exit https://cert-08.pd.infn.it:8443/CREAM529405455 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:55:04,092 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:55:04,115 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:55:04,115 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:55:04,115 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155504.log]\n', '2014-08-18 15:55:04,118 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:55:05,548 DEBUG - Will invoke JobStart for JobID [CREAM648262536]\n', 'https://cert-08.pd.infn.it:8443/CREAM648262536\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM648262536 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM648262536 2014-08-18 15:55:05.915105 Submit https://cert-08.pd.infn.it:8443/CREAM648262536 Left: 43 (at submission time:43) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM648262536 2014-08-18 15:56:02.368270 Exit https://cert-08.pd.infn.it:8443/CREAM818470384 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:56:03,100 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:56:03,123 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:56:03,123 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:56:03,123 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155603mit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 932/1000 2014-08-18 15:54:04.016994 Submitted: 951 Running: 19 Cancelled: 0 Done-Ok: 932 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 932/1000 2014-08-18 15:54:04.349818 Submitted: 951 Running: 18 Cancelled: 0 Done-Ok: 933 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 933/1000 2014-08-18 15:54:04.812120 Submitted: 952 Running: 19 Cancelled: 0 Done-Ok: 933 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 933/1000 2014-08-18 15:54:07.121680 Submitted: 953 Running: 20 Cancelled: 0 Done-Ok: 933 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 933/1000 2014-08-18 15:54:56.530207 Submitted: 953 Running: 19 Cancelled: 0 Done-Ok: 934 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 934/1000 2014-08-18 15:54:58.603139 Submitted: 954 Running: 20 Cancelled: 0 Done-Ok: 934 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 934/1000 2014-08-18 15:55:00.945501 Submitted: 954 Running: 19 Cancelled: 0 Done-Ok: 935 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 935/1000 2014-08-18 15:55:02.245373 Submitted: 954 Running: 18 Cancelled: 0 Done-Ok: 936 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 936/1000 2014-08-18 15:55:03.430587 Submitted: 954 Running: 17 Cancelled: 0 Done-Ok: 937 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 937/1000 2014-08-18 15:55:03.700084 Submitted: 955 Running: 18 Cancelled: 0 Done-Ok: 937 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 937/1000 2014-08-18 15:55:04.971167 Submitted: 956 Running: 19 Cancelled: 0 Done-Ok: 937 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 937/1000 2014-08-18 15:55:05.916952 Submitted: 957 Running: 20 Cancelled: 0 Done-Ok: 937 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 937/1000 2014-08-18 15:55:56.675801 Submitted: 957 Running: 19 Cancelled: 0 Done-Ok: 938 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 938/1000 2014-08-18 15:55:58.800618 Submitted: 958 Running: 20 Cancelled: 0 Done-Ok: 938 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 938/1000 2014-08-18 15:56:01.799651 Submitted: 958 Running: 19 Cancelled: 0 Done-Ok: 939 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 939/1000 2014-08-18 15:56:02.369848 Submitted: 958 Running: 18 Cancelled: 0 Done-Ok: 940 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 940/1000 2014-08-18 15:56:04.509978 Submitted: 959 Running: 19 Cancelled: 0 Done-Ok: 940 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 940/1000 2014-08-18 15:56:04.834687 Submitted: 959 Running: 18 Cancelled: 0 Done-Ok: 941 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 941/1000 2014-08-18 15:56:05.038029 Submitted: 960 Running: 19 Cancelled: 0 Done-Ok: 941 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 941/1000 2014-08-18 15:56:07.489202 Submitted: 961 Running: 20 Cancelled: 0 Done-Ok: 941 Failed: 0 Aborted: 0 Status Failed: 0.log]\n', '2014-08-18 15:56:03,126 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:56:04,689 DEBUG - Will invoke JobStart for JobID [CREAM483327563]\n', 'https://cert-08.pd.infn.it:8443/CREAM483327563\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM483327563 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM483327563 2014-08-18 15:56:05.034861 Submit https://cert-08.pd.infn.it:8443/CREAM483327563 Left: 40 (at submission time:40) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM483327563 2014-08-18 15:57:03.696605 Exit https://cert-08.pd.infn.it:8443/CREAM303715683 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:57:04,332 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:57:04,361 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:57:04,362 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:57:04,362 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155704.log]\n', '2014-08-18 15:57:04,364 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:57:05,813 DEBUG - Will invoke JobStart for JobID [CREAM707205842]\n', 'https://cert-08.pd.infn.it:8443/CREAM707205842\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM707205842 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM707205842 2014-08-18 15:57:06.229391 Submit https://cert-08.pd.infn.it:8443/CREAM707205842 Left: 36 (at submission time:36) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM707205842 2014-08-18 15:57:57.875215 Exit https://cert-08.pd.infn.it:8443/CREAM203218834 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:57:58,278 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:57:58,301 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:57:58,301 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:57:58,301 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155758.log]\n', '2014-08-18 15:57:58,314 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:57:59,721 DEBUG - Will invoke JobStart for JobID [CREAM631888118]\n', 'https://cert-08.pd.infn.it:8443/CREAM631888118\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM631888118 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM631888118 2014-08-18 15:58:00.056233 Submit https://cert-.log]\n', '2014-08-18 15:55:01,591 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:55:03,114 DEBUG - Will invoke JobStart for JobID [CREAM010987809]\n', 'https://cert-08.pd.infn.it:8443/CREAM010987809\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM010987809 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM010987809 2014-08-18 15:55:03.697347 Submit https://cert-08.pd.infn.it:8443/CREAM010987809 Left: 45 (at submission time:45) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM010987809 2014-08-18 15:57:01.858908 Exit https://cert-08.pd.infn.it:8443/CREAM047593982 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:57:02,740 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:57:02,760 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:57:02,760 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:57:02,760 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155702.log]\n', '2014-08-18 15:57:02,764 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:57:04,480 DEBUG - Will invoke JobStart for JobID [CREAM119166555]\n', 'https://cert-08.pd.infn.it:8443/CREAM119166555\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM119166555 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM119166555 2014-08-18 15:57:05.160881 Submit https://cert-08.pd.infn.it:8443/CREAM119166555 Left: 37 (at submission time:37) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM119166555 2014-08-18 15:58:02.597481 Exit https://cert-08.pd.infn.it:8443/CREAM366176969 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:58:03,364 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:58:03,396 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:58:03,396 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:58:03,397 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155803.log]\n', '2014-08-18 15:58:03,402 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:58:04,713 DEBUG - Will invoke JobStart for JobID [CREAM219291325]\n', 'https://cert-08.pd.infn.it:8443/CREAM219291325\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM219291325 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM219291325 2014-08-18 15:58:04.980407 Submit https://cert-.log]\n', '2014-08-18 15:56:02,671 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:56:04,090 DEBUG - Will invoke JobStart for JobID [CREAM807485711]\n', 'https://cert-08.pd.infn.it:8443/CREAM807485711\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM807485711 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM807485711 2014-08-18 15:56:04.509134 Submit https://cert-08.pd.infn.it:8443/CREAM807485711 Left: 41 (at submission time:41) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM807485711 2014-08-18 15:56:04.829969 Exit https://cert-08.pd.infn.it:8443/CREAM989522200 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:56:05,636 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:56:05,669 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:56:05,669 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:56:05,669 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155605.log]\n', '2014-08-18 15:56:05,678 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:56:07,105 DEBUG - Will invoke JobStart for JobID [CREAM183117039]\n', 'https://cert-08.pd.infn.it:8443/CREAM183117039\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM183117039 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM183117039 2014-08-18 15:56:07.484605 Submit https://cert-08.pd.infn.it:8443/CREAM183117039 Left: 39 (at submission time:39) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM183117039 2014-08-18 15:58:03.460893 Exit https://cert-08.pd.infn.it:8443/CREAM310805805 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:58:04,398 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:58:04,422 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:58:04,423 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:58:04,423 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155804.log]\n', '2014-08-18 15:58:04,426 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:58:05,956 DEBUG - Will invoke JobStart for JobID [CREAM936059426]\n', 'https://cert-08.pd.infn.it:8443/CREAM936059426\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM936059426 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM936059426 2014-08-18 15:58:06.338926 Submit https://cert-.log]\n', '2014-08-18 15:55:57,073 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:55:58,397 DEBUG - Will invoke JobStart for JobID [CREAM560220216]\n', 'https://cert-08.pd.infn.it:8443/CREAM560220216\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM560220216 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM560220216 2014-08-18 15:55:58.799602 Submit https://cert-08.pd.infn.it:8443/CREAM560220216 Left: 42 (at submission time:42) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM560220216 2014-08-18 15:57:04.230982 Exit https://cert-08.pd.infn.it:8443/CREAM344993563 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:57:05,193 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:57:05,218 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:57:05,218 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:57:05,218 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155705.log]\n', '2014-08-18 15:57:05,224 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:57:06,838 DEBUG - Will invoke JobStart for JobID [CREAM702729500]\n', 'https://cert-08.pd.infn.it:8443/CREAM702729500\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM702729500 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM702729500 2014-08-18 15:57:07.090671 Submit https://cert-08.pd.infn.it:8443/CREAM702729500 Left: 35 (at submission time:35) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM702729500 2014-08-18 15:58:04.584627 Exit https://cert-08.pd.infn.it:8443/CREAM096835642 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:58:05,430 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:58:05,454 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:58:05,454 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:58:05,454 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155805.log]\n', '2014-08-18 15:58:05,460 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:58:06,722 DEBUG - Will invoke JobStart for JobID [CREAM325485456]\n', 'https://cert-08.pd.infn.it:8443/CREAM325485456\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM325485456 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM325485456 2014-08-18 15:58:07.015932 Submit https://cert- Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 941/1000 2014-08-18 15:56:57.560402 Submitted: 961 Running: 19 Cancelled: 0 Done-Ok: 942 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 942/1000 2014-08-18 15:56:59.599514 Submitted: 962 Running: 20 Cancelled: 0 Done-Ok: 942 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 942/1000 2014-08-18 15:57:01.861186 Submitted: 962 Running: 19 Cancelled: 0 Done-Ok: 943 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 943/1000 2014-08-18 15:57:03.699832 Submitted: 962 Running: 18 Cancelled: 0 Done-Ok: 944 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 944/1000 2014-08-18 15:57:04.232446 Submitted: 962 Running: 17 Cancelled: 0 Done-Ok: 945 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 945/1000 2014-08-18 15:57:05.162749 Submitted: 963 Running: 18 Cancelled: 0 Done-Ok: 945 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 945/1000 2014-08-18 15:57:06.231065 Submitted: 964 Running: 19 Cancelled: 0 Done-Ok: 945 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 945/1000 2014-08-18 15:57:07.091773 Submitted: 965 Running: 20 Cancelled: 0 Done-Ok: 945 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 945/1000 2014-08-18 15:57:57.877913 Submitted: 965 Running: 19 Cancelled: 0 Done-Ok: 946 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 946/1000 2014-08-18 15:58:00.058124 Submitted: 966 Running: 20 Cancelled: 0 Done-Ok: 946 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 946/1000 2014-08-18 15:58:02.599622 Submitted: 966 Running: 19 Cancelled: 0 Done-Ok: 947 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 947/1000 2014-08-18 15:58:03.464025 Submitted: 966 Running: 18 Cancelled: 0 Done-Ok: 948 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 948/1000 2014-08-18 15:58:04.587371 Submitted: 966 Running: 17 Cancelled: 0 Done-Ok: 949 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 949/1000 2014-08-18 15:58:04.981774 Submitted: 967 Running: 18 Cancelled: 0 Done-Ok: 949 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 949/1000 2014-08-18 15:58:06.340498 Submitted: 968 Running: 19 Cancelled: 0 Done-Ok: 949 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 949/1000 2014-08-18 15:58:07.017735 Submitted: 969 Running: 20 Cancelled: 0 Done-Ok: 949 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 949/1000 2014-08-18 15:58:57.842679 Submitted: 969 Running: 19 Cancelled: 0 Done-Ok: 950 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 950/1000 2014-08-18 15:58:59.984070 Submitted: 970 Running: 20 Cancelled: 0 Done-Ok: 950 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 950/1000 2014-08-18 15:59:03.788053 Submitted: 970 Running: 19 Cancelled: 0 Done-Ok: 951 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 951/1000 2014-08-18 15:59:03.944875 Submitted: 970 Running: 18 Cancelled: 0 Done-Ok: 952 Failed: 0 Aborted: 0 Status Faile.log]\n', '2014-08-18 15:55:02,973 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:55:04,585 DEBUG - Will invoke JobStart for JobID [CREAM090135486]\n', 'https://cert-08.pd.infn.it:8443/CREAM090135486\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM090135486 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM090135486 2014-08-18 15:55:04.967830 Submit https://cert-08.pd.infn.it:8443/CREAM090135486 Left: 44 (at submission time:44) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM090135486 2014-08-18 15:56:57.557664 Exit https://cert-08.pd.infn.it:8443/CREAM780645608 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:56:57,901 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:56:57,924 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:56:57,924 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:56:57,924 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155657.log]\n', '2014-08-18 15:56:57,929 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:56:59,295 DEBUG - Will invoke JobStart for JobID [CREAM863547166]\n', 'https://cert-08.pd.infn.it:8443/CREAM863547166\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM863547166 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM863547166 2014-08-18 15:56:59.595074 Submit https://cert-08.pd.infn.it:8443/CREAM863547166 Left: 38 (at submission time:38) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM863547166 2014-08-18 15:59:03.943082 Exit https://cert-08.pd.infn.it:8443/CREAM902627027 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:59:04,503 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:59:04,526 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:59:04,527 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:59:04,527 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155904.log]\n', '2014-08-18 15:59:04,530 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:59:06,129 DEBUG - Will invoke JobStart for JobID [CREAM757857324]\n', 'https://cert-08.pd.infn.it:8443/CREAM757857324\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM757857324 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM757857324 2014-08-18 15:59:06.485831 Submit https://cert-08.pd.infn.it:8443/CREAM936059426 Left: 32 (at submission time:32) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM936059426 2014-08-18 15:58:57.841157 Exit https://cert-08.pd.infn.it:8443/CREAM730390136 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:58:58,240 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:58:58,279 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:58:58,279 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:58:58,280 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155858.log]\n', '2014-08-18 15:58:58,287 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:58:59,603 DEBUG - Will invoke JobStart for JobID [CREAM053383218]\n', 'https://cert-08.pd.infn.it:8443/CREAM053383218\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM053383218 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM053383218 2014-08-18 15:58:59.982269 Submit https://cert-08.pd.infn.it:8443/CREAM053383218 Left: 30 (at submission time:30) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM053383218 2014-08-18 16:01:04.745687 Exit https://cert-08.pd.infn.it:8443/CREAM807485711 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:01:05,355 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:01:05,390 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:01:05,390 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:01:05,390 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160105.log]\n', '2014-08-18 16:01:05,398 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:01:06,499 DEBUG - Will invoke JobStart for JobID [CREAM904721336]\n', 'https://cert-08.pd.infn.it:8443/CREAM904721336\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM904721336 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM904721336 2014-08-18 16:01:07.109577 Submit https://cert-08.pd.infn.it:8443/CREAM904721336 Left: 21 (at submission time:21) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM904721336 2014-08-18 16:01:07.337693 Exit https://cert-08.pd.infn.it:8443/CREAM183117039 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:01:08,148 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:01:08,176 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:01:08,177 WARN - No configuration file suitable for loading. Ud: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 952/1000 2014-08-18 15:59:06.009419 Submitted: 971 Running: 19 Cancelled: 0 Done-Ok: 952 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 952/1000 2014-08-18 15:59:06.488107 Submitted: 972 Running: 20 Cancelled: 0 Done-Ok: 952 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 952/1000 2014-08-18 15:59:06.774604 Submitted: 972 Running: 19 Cancelled: 0 Done-Ok: 953 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 953/1000 2014-08-18 15:59:09.499230 Submitted: 973 Running: 20 Cancelled: 0 Done-Ok: 953 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 953/1000 2014-08-18 15:59:58.861114 Submitted: 973 Running: 19 Cancelled: 0 Done-Ok: 954 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 954/1000 2014-08-18 16:00:00.983041 Submitted: 974 Running: 20 Cancelled: 0 Done-Ok: 954 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 954/1000 2014-08-18 16:00:03.877683 Submitted: 974 Running: 19 Cancelled: 0 Done-Ok: 955 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 955/1000 2014-08-18 16:00:04.932653 Submitted: 974 Running: 18 Cancelled: 0 Done-Ok: 956 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 956/1000 2014-08-18 16:00:06.151271 Submitted: 974 Running: 17 Cancelled: 0 Done-Ok: 957 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 957/1000 2014-08-18 16:00:06.849074 Submitted: 975 Running: 18 Cancelled: 0 Done-Ok: 957 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 957/1000 2014-08-18 16:00:07.896445 Submitted: 976 Running: 19 Cancelled: 0 Done-Ok: 957 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 957/1000 2014-08-18 16:00:08.930767 Submitted: 977 Running: 20 Cancelled: 0 Done-Ok: 957 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 957/1000 2014-08-18 16:00:58.806759 Submitted: 977 Running: 19 Cancelled: 0 Done-Ok: 958 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 958/1000 2014-08-18 16:01:00.616793 Submitted: 978 Running: 20 Cancelled: 0 Done-Ok: 958 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 958/1000 2014-08-18 16:01:04.746845 Submitted: 978 Running: 19 Cancelled: 0 Done-Ok: 959 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 959/1000 2014-08-18 16:01:05.471999 Submitted: 978 Running: 18 Cancelled: 0 Done-Ok: 960 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 960/1000 2014-08-18 16:01:07.112789 Submitted: 979 Running: 19 Cancelled: 0 Done-Ok: 960 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 960/1000 2014-08-18 16:01:07.340976 Submitted: 979 Running: 18 Cancelled: 0 Done-Ok: 961 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 961/1000 2014-08-18 16:01:08.006796 Submitted: 980 Running: 19 Cancelled: 0 Done-Ok: 961 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 961/1000 2014-08-18 16:01:09.790200 Submitted: 981 Running: 20 Cancelled: 0 Done-Ok: 961 Failed: 0 Aborted: 0 Status F08.pd.infn.it:8443/CREAM757857324 Left: 28 (at submission time:28) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM757857324 2014-08-18 15:59:06.771565 Exit https://cert-08.pd.infn.it:8443/CREAM377010817 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:59:07,550 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:59:07,574 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:59:07,574 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:59:07,574 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155907.log]\n', '2014-08-18 15:59:07,577 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:59:08,997 DEBUG - Will invoke JobStart for JobID [CREAM109835101]\n', 'https://cert-08.pd.infn.it:8443/CREAM109835101\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM109835101 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM109835101 2014-08-18 15:59:09.498167 Submit https://cert-08.pd.infn.it:8443/CREAM109835101 Left: 27 (at submission time:27) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM109835101 2014-08-18 16:00:06.149639 Exit https://cert-08.pd.infn.it:8443/CREAM090135486 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:00:06,971 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:00:06,999 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:00:06,999 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:00:06,999 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160006.log]\n', '2014-08-18 16:00:07,009 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:00:08,640 DEBUG - Will invoke JobStart for JobID [CREAM902973996]\n', 'https://cert-08.pd.infn.it:8443/CREAM902973996\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM902973996 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM902973996 2014-08-18 16:00:08.926755 Submit https://cert-08.pd.infn.it:8443/CREAM902973996 Left: 23 (at submission time:23) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM902973996 2014-08-18 16:01:59.461767 Exit https://cert-08.pd.infn.it:8443/CREAM863547166 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:01:59,783 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:01:59,807 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:01:59,807 WARN - No configuration file suitable for loading. U08.pd.infn.it:8443/CREAM631888118 Left: 34 (at submission time:34) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM631888118 2014-08-18 16:00:04.930813 Exit https://cert-08.pd.infn.it:8443/CREAM648262536 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:00:05,843 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:00:05,868 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:00:05,868 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:00:05,868 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160005.log]\n', '2014-08-18 16:00:05,875 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:00:07,585 DEBUG - Will invoke JobStart for JobID [CREAM405836974]\n', 'https://cert-08.pd.infn.it:8443/CREAM405836974\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM405836974 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM405836974 2014-08-18 16:00:07.894294 Submit https://cert-08.pd.infn.it:8443/CREAM405836974 Left: 24 (at submission time:24) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM405836974 2014-08-18 16:01:05.470801 Exit https://cert-08.pd.infn.it:8443/CREAM483327563 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:01:06,511 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:01:06,530 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:01:06,530 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:01:06,530 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160106.log]\n', '2014-08-18 16:01:06,533 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:01:07,766 DEBUG - Will invoke JobStart for JobID [CREAM453442754]\n', 'https://cert-08.pd.infn.it:8443/CREAM453442754\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM453442754 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM453442754 2014-08-18 16:01:08.004355 Submit https://cert-08.pd.infn.it:8443/CREAM453442754 Left: 20 (at submission time:20) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM453442754 2014-08-18 16:02:05.009135 Exit https://cert-08.pd.infn.it:8443/CREAM707205842 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:02:05,752 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:02:05,810 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:02:05,811 WARN - No configuration file suitable for loading. U08.pd.infn.it:8443/CREAM219291325 Left: 33 (at submission time:33) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM219291325 2014-08-18 15:59:03.785125 Exit https://cert-08.pd.infn.it:8443/CREAM639789060 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:59:04,417 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:59:04,440 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:59:04,441 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:59:04,441 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155904.log]\n', '2014-08-18 15:59:04,446 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 15:59:05,869 DEBUG - Will invoke JobStart for JobID [CREAM845224824]\n', 'https://cert-08.pd.infn.it:8443/CREAM845224824\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM845224824 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM845224824 2014-08-18 15:59:06.006832 Submit https://cert-08.pd.infn.it:8443/CREAM845224824 Left: 29 (at submission time:29) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM845224824 2014-08-18 16:00:03.875983 Exit https://cert-08.pd.infn.it:8443/CREAM010987809 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:00:04,761 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:00:04,787 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:00:04,788 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:00:04,788 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160004.log]\n', '2014-08-18 16:00:04,792 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:00:06,544 DEBUG - Will invoke JobStart for JobID [CREAM584367000]\n', 'https://cert-08.pd.infn.it:8443/CREAM584367000\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM584367000 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM584367000 2014-08-18 16:00:06.847834 Submit https://cert-08.pd.infn.it:8443/CREAM584367000 Left: 25 (at submission time:25) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM584367000 2014-08-18 16:02:05.300778 Exit https://cert-08.pd.infn.it:8443/CREAM119166555 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:02:05,872 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:02:05,901 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:02:05,901 WARN - No configuration file suitable for loading. U08.pd.infn.it:8443/CREAM325485456 Left: 31 (at submission time:31) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM325485456 2014-08-18 15:59:58.859578 Exit https://cert-08.pd.infn.it:8443/CREAM114599105 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 15:59:59,169 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 15:59:59,205 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 15:59:59,205 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 15:59:59,205 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-155959.log]\n', '2014-08-18 15:59:59,217 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:00:00,611 DEBUG - Will invoke JobStart for JobID [CREAM514036777]\n', 'https://cert-08.pd.infn.it:8443/CREAM514036777\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM514036777 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM514036777 2014-08-18 16:00:00.980006 Submit https://cert-08.pd.infn.it:8443/CREAM514036777 Left: 26 (at submission time:26) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM514036777 2014-08-18 16:00:58.804389 Exit https://cert-08.pd.infn.it:8443/CREAM560220216 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:00:59,175 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:00:59,208 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:00:59,208 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:00:59,208 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160059.log]\n', '2014-08-18 16:00:59,222 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:01:00,331 DEBUG - Will invoke JobStart for JobID [CREAM196051998]\n', 'https://cert-08.pd.infn.it:8443/CREAM196051998\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM196051998 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM196051998 2014-08-18 16:01:00.614659 Submit https://cert-08.pd.infn.it:8443/CREAM196051998 Left: 22 (at submission time:22) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM196051998 2014-08-18 16:02:06.106675 Exit https://cert-08.pd.infn.it:8443/CREAM702729500 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:02:07,309 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:02:07,330 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:02:07,330 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:01:08,177 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160108.log]\n', '2014-08-18 16:01:08,181 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:01:09,441 DEBUG - Will invoke JobStart for JobID [CREAM972564353]\n', 'https://cert-08.pd.infn.it:8443/CREAM972564353\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM972564353 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM972564353 2014-08-18 16:01:09.786513 Submit https://cert-08.pd.infn.it:8443/CREAM972564353 Left: 19 (at submission time:19) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM972564353 2014-08-18 16:03:06.086688 Exit https://cert-08.pd.infn.it:8443/CREAM936059426 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:03:06,498 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:03:06,522 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:03:06,522 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:03:06,523 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160306.log]\n', '2014-08-18 16:03:06,526 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:03:08,198 DEBUG - Will invoke JobStart for JobID [CREAM499209695]\n', 'https://cert-08.pd.infn.it:8443/CREAM499209695\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM499209695 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM499209695 2014-08-18 16:03:08.554290 Submit https://cert-08.pd.infn.it:8443/CREAM499209695 Left: 12 (at submission time:12) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM499209695 2014-08-18 16:04:00.259538 Exit https://cert-08.pd.infn.it:8443/CREAM053383218 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:04:00,581 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:04:00,601 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:04:00,601 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:04:00,601 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160400.log]\n', '2014-08-18 16:04:00,608 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:04:01,998 DEBUG - Will invoke JobStart for JobID [CREAM319873990]\n', 'https://cert-08.pd.infn.it:8443/CREAM319873990\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.ailed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 961/1000 2014-08-18 16:01:59.463776 Submitted: 981 Running: 19 Cancelled: 0 Done-Ok: 962 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 962/1000 2014-08-18 16:02:01.401407 Submitted: 982 Running: 20 Cancelled: 0 Done-Ok: 962 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 962/1000 2014-08-18 16:02:05.011998 Submitted: 982 Running: 19 Cancelled: 0 Done-Ok: 963 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 963/1000 2014-08-18 16:02:05.302609 Submitted: 982 Running: 18 Cancelled: 0 Done-Ok: 964 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 964/1000 2014-08-18 16:02:06.109355 Submitted: 982 Running: 17 Cancelled: 0 Done-Ok: 965 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 965/1000 2014-08-18 16:02:07.572328 Submitted: 983 Running: 18 Cancelled: 0 Done-Ok: 965 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 965/1000 2014-08-18 16:02:07.940887 Submitted: 984 Running: 19 Cancelled: 0 Done-Ok: 965 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 965/1000 2014-08-18 16:02:09.239214 Submitted: 985 Running: 20 Cancelled: 0 Done-Ok: 965 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 965/1000 2014-08-18 16:02:59.781303 Submitted: 985 Running: 19 Cancelled: 0 Done-Ok: 966 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 966/1000 2014-08-18 16:03:01.774922 Submitted: 986 Running: 20 Cancelled: 0 Done-Ok: 966 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 966/1000 2014-08-18 16:03:05.937376 Submitted: 986 Running: 19 Cancelled: 0 Done-Ok: 967 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 967/1000 2014-08-18 16:03:06.090006 Submitted: 986 Running: 18 Cancelled: 0 Done-Ok: 968 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 968/1000 2014-08-18 16:03:07.208731 Submitted: 986 Running: 17 Cancelled: 0 Done-Ok: 969 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 969/1000 2014-08-18 16:03:08.082863 Submitted: 987 Running: 18 Cancelled: 0 Done-Ok: 969 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 969/1000 2014-08-18 16:03:08.558890 Submitted: 988 Running: 19 Cancelled: 0 Done-Ok: 969 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 969/1000 2014-08-18 16:03:10.090021 Submitted: 989 Running: 20 Cancelled: 0 Done-Ok: 969 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 969/1000 2014-08-18 16:04:00.261321 Submitted: 989 Running: 19 Cancelled: 0 Done-Ok: 970 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 970/1000 2014-08-18 16:04:02.388267 Submitted: 990 Running: 20 Cancelled: 0 Done-Ok: 970 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 970/1000 2014-08-18 16:04:05.569671 Submitted: 990 Running: 19 Cancelled: 0 Done-Ok: 971 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 971/1000 2014-08-18 16:04:05.759434 Submitted: 990 Running: 18 Cancelled: 0 Done-Ok: 972 Failed: 0 Aborted: 0 Statsing built-in configuration\n', '2014-08-18 16:02:05,901 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160205.log]\n', '2014-08-18 16:02:05,911 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:02:07,449 DEBUG - Will invoke JobStart for JobID [CREAM262601250]\n', 'https://cert-08.pd.infn.it:8443/CREAM262601250\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM262601250 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM262601250 2014-08-18 16:02:07.938286 Submit https://cert-08.pd.infn.it:8443/CREAM262601250 Left: 16 (at submission time:16) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM262601250 2014-08-18 16:03:05.935152 Exit https://cert-08.pd.infn.it:8443/CREAM219291325 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:03:06,361 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:03:06,387 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:03:06,387 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:03:06,387 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160306.log]\n', '2014-08-18 16:03:06,395 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:03:07,581 DEBUG - Will invoke JobStart for JobID [CREAM101190198]\n', 'https://cert-08.pd.infn.it:8443/CREAM101190198\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM101190198 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM101190198 2014-08-18 16:03:08.077067 Submit https://cert-08.pd.infn.it:8443/CREAM101190198 Left: 13 (at submission time:13) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM101190198 2014-08-18 16:04:05.567406 Exit https://cert-08.pd.infn.it:8443/CREAM845224824 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:04:06,311 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:04:06,334 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:04:06,334 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:04:06,334 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160406.log]\n', '2014-08-18 16:04:06,337 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:04:07,930 DEBUG - Will invoke JobStart for JobID [CREAM300461361]\n', 'https://cert-08.pd.infn.it:8443/CREAM300461361\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.sing built-in configuration\n', '2014-08-18 16:01:59,807 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160159.log]\n', '2014-08-18 16:01:59,810 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:02:01,091 DEBUG - Will invoke JobStart for JobID [CREAM772333002]\n', 'https://cert-08.pd.infn.it:8443/CREAM772333002\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM772333002 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM772333002 2014-08-18 16:02:01.399122 Submit https://cert-08.pd.infn.it:8443/CREAM772333002 Left: 18 (at submission time:18) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM772333002 2014-08-18 16:04:05.757941 Exit https://cert-08.pd.infn.it:8443/CREAM757857324 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:04:06,454 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:04:06,478 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:04:06,479 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:04:06,479 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160406.log]\n', '2014-08-18 16:04:06,482 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:04:08,230 DEBUG - Will invoke JobStart for JobID [CREAM015246584]\n', 'https://cert-08.pd.infn.it:8443/CREAM015246584\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM015246584 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM015246584 2014-08-18 16:04:08.474459 Submit https://cert-08.pd.infn.it:8443/CREAM015246584 Left: 8 (at submission time:8) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM015246584 2014-08-18 16:04:08.845393 Exit https://cert-08.pd.infn.it:8443/CREAM109835101 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:04:09,756 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:04:09,779 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:04:09,779 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:04:09,779 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160409.log]\n', '2014-08-18 16:04:09,782 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:04:11,281 DEBUG - Will invoke JobStart for JobID [CREAM972892274]\n', 'https://cert-08.pd.infn.it:8443/CREAM972892274\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pdsing built-in configuration\n', '2014-08-18 16:02:07,330 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160207.log]\n', '2014-08-18 16:02:07,333 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:02:08,930 DEBUG - Will invoke JobStart for JobID [CREAM373813970]\n', 'https://cert-08.pd.infn.it:8443/CREAM373813970\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM373813970 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM373813970 2014-08-18 16:02:09.238107 Submit https://cert-08.pd.infn.it:8443/CREAM373813970 Left: 15 (at submission time:15) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM373813970 2014-08-18 16:03:07.204601 Exit https://cert-08.pd.infn.it:8443/CREAM325485456 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:03:08,139 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:03:08,165 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:03:08,165 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:03:08,165 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160308.log]\n', '2014-08-18 16:03:08,169 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:03:09,690 DEBUG - Will invoke JobStart for JobID [CREAM602905736]\n', 'https://cert-08.pd.infn.it:8443/CREAM602905736\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM602905736 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM602905736 2014-08-18 16:03:10.088287 Submit https://cert-08.pd.infn.it:8443/CREAM602905736 Left: 11 (at submission time:11) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM602905736 2014-08-18 16:05:00.988598 Exit https://cert-08.pd.infn.it:8443/CREAM514036777 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:05:01,369 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:05:01,396 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:05:01,396 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:05:01,396 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160501.log]\n', '2014-08-18 16:05:01,406 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:05:02,865 DEBUG - Will invoke JobStart for JobID [CREAM037908631]\n', 'https://cert-08.pd.infn.it:8443/CREAM037908631\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.sing built-in configuration\n', '2014-08-18 16:02:05,811 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160205.log]\n', '2014-08-18 16:02:05,822 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:02:07,166 DEBUG - Will invoke JobStart for JobID [CREAM257724263]\n', 'https://cert-08.pd.infn.it:8443/CREAM257724263\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM257724263 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM257724263 2014-08-18 16:02:07.569486 Submit https://cert-08.pd.infn.it:8443/CREAM257724263 Left: 17 (at submission time:17) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM257724263 2014-08-18 16:02:59.779170 Exit https://cert-08.pd.infn.it:8443/CREAM631888118 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:03:00,117 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:03:00,142 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:03:00,142 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:03:00,142 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160300.log]\n', '2014-08-18 16:03:00,146 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:03:01,509 DEBUG - Will invoke JobStart for JobID [CREAM137858147]\n', 'https://cert-08.pd.infn.it:8443/CREAM137858147\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM137858147 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM137858147 2014-08-18 16:03:01.768105 Submit https://cert-08.pd.infn.it:8443/CREAM137858147 Left: 14 (at submission time:14) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM137858147 2014-08-18 16:05:07.024930 Exit https://cert-08.pd.infn.it:8443/CREAM405836974 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:05:07,669 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:05:07,712 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:05:07,712 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:05:07,712 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160507.log]\n', '2014-08-18 16:05:07,715 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:05:09,638 DEBUG - Will invoke JobStart for JobID [CREAM872632470]\n', 'https://cert-08.pd.infn.it:8443/CREAM872632470\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.us Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 972/1000 2014-08-18 16:04:08.244965 Submitted: 991 Running: 19 Cancelled: 0 Done-Ok: 972 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 972/1000 2014-08-18 16:04:08.476001 Submitted: 992 Running: 20 Cancelled: 0 Done-Ok: 972 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 972/1000 2014-08-18 16:04:08.847601 Submitted: 992 Running: 19 Cancelled: 0 Done-Ok: 973 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 973/1000 2014-08-18 16:04:11.578760 Submitted: 993 Running: 20 Cancelled: 0 Done-Ok: 973 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 973/1000 2014-08-18 16:05:00.990581 Submitted: 993 Running: 19 Cancelled: 0 Done-Ok: 974 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 974/1000 2014-08-18 16:05:03.126724 Submitted: 994 Running: 20 Cancelled: 0 Done-Ok: 974 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 974/1000 2014-08-18 16:05:06.887118 Submitted: 994 Running: 19 Cancelled: 0 Done-Ok: 975 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 975/1000 2014-08-18 16:05:07.027169 Submitted: 994 Running: 18 Cancelled: 0 Done-Ok: 976 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 976/1000 2014-08-18 16:05:07.405810 Submitted: 994 Running: 17 Cancelled: 0 Done-Ok: 977 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 977/1000 2014-08-18 16:05:09.884882 Submitted: 995 Running: 18 Cancelled: 0 Done-Ok: 977 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 977/1000 2014-08-18 16:05:09.938825 Submitted: 996 Running: 19 Cancelled: 0 Done-Ok: 977 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 977/1000 2014-08-18 16:05:10.141595 Submitted: 997 Running: 20 Cancelled: 0 Done-Ok: 977 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 977/1000 2014-08-18 16:06:01.487659 Submitted: 997 Running: 19 Cancelled: 0 Done-Ok: 978 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 978/1000 2014-08-18 16:06:03.618977 Submitted: 998 Running: 20 Cancelled: 0 Done-Ok: 978 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 978/1000 2014-08-18 16:06:06.409501 Submitted: 998 Running: 19 Cancelled: 0 Done-Ok: 979 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 979/1000 2014-08-18 16:06:08.455327 Submitted: 998 Running: 18 Cancelled: 0 Done-Ok: 980 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 980/1000 2014-08-18 16:06:08.735211 Submitted: 999 Running: 19 Cancelled: 0 Done-Ok: 980 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 980/1000 2014-08-18 16:06:09.113239 Submitted: 999 Running: 18 Cancelled: 0 Done-Ok: 981 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 981/1000 2014-08-18 16:06:11.152049 Submitted: 1000 Running: 19 Cancelled: 0 Done-Ok: 981 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 981/1000 2014-08-18 16:07:01.720681 Submitted: 1000 Running: 18 Cancelled: 0 Done-Ok: 982 Failed: 0 Aborted: 0 pd.infn.it:8443/CREAM300461361 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM300461361 2014-08-18 16:04:08.242179 Submit https://cert-08.pd.infn.it:8443/CREAM300461361 Left: 9 (at submission time:9) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM300461361 2014-08-18 16:05:06.883631 Exit https://cert-08.pd.infn.it:8443/CREAM584367000 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:05:07,528 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:05:07,562 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:05:07,562 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:05:07,562 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160507.log]\n', '2014-08-18 16:05:07,567 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:05:09,631 DEBUG - Will invoke JobStart for JobID [CREAM671087396]\n', 'https://cert-08.pd.infn.it:8443/CREAM671087396\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM671087396 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM671087396 2014-08-18 16:05:09.881731 Submit https://cert-08.pd.infn.it:8443/CREAM671087396 Left: 5 (at submission time:5) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM671087396 2014-08-18 16:07:06.927088 Exit https://cert-08.pd.infn.it:8443/CREAM262601250 Status: "DONE-OK" 2014-08-18 16:08:08.560106 Exit https://cert-08.pd.infn.it:8443/CREAM101190198 Status: "DONE-OK" 2014-08-18 16:09:11.950453 Exit https://cert-08.pd.infn.it:8443/CREAM300461361 Status: "DONE-OK" 2014-08-18 16:10:07.792059 Exit https://cert-08.pd.infn.it:8443/CREAM671087396 Status: "DONE-OK" no jobs left to submit or collect 2014-08-18 16:10:07.792657 Process 3644 terminating, no jobs left to submit or collect .infn.it:8443/CREAM972892274 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM972892274 2014-08-18 16:04:11.576268 Submit https://cert-08.pd.infn.it:8443/CREAM972892274 Left: 7 (at submission time:7) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM972892274 2014-08-18 16:05:07.402536 Exit https://cert-08.pd.infn.it:8443/CREAM902973996 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:05:08,230 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:05:08,253 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:05:08,253 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:05:08,253 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160508.log]\n', '2014-08-18 16:05:08,257 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:05:09,763 DEBUG - Will invoke JobStart for JobID [CREAM558298063]\n', 'https://cert-08.pd.infn.it:8443/CREAM558298063\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM558298063 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM558298063 2014-08-18 16:05:10.140223 Submit https://cert-08.pd.infn.it:8443/CREAM558298063 Left: 3 (at submission time:3) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM558298063 2014-08-18 16:07:01.718570 Exit https://cert-08.pd.infn.it:8443/CREAM772333002 Status: "DONE-OK" 2014-08-18 16:09:11.935409 Exit https://cert-08.pd.infn.it:8443/CREAM972892274 Status: "DONE-OK" 2014-08-18 16:09:12.099878 Exit https://cert-08.pd.infn.it:8443/CREAM015246584 Status: "DONE-OK" 2014-08-18 16:10:08.980938 Exit https://cert-08.pd.infn.it:8443/CREAM558298063 Status: "DONE-OK" no jobs left to submit or collect 2014-08-18 16:10:08.981338 Process 3640 terminating, no jobs left to submit or collect pd.infn.it:8443/CREAM037908631 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM037908631 2014-08-18 16:05:03.125117 Submit https://cert-08.pd.infn.it:8443/CREAM037908631 Left: 6 (at submission time:6) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM037908631 2014-08-18 16:06:01.484700 Exit https://cert-08.pd.infn.it:8443/CREAM196051998 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:06:01,824 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:06:01,851 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:06:01,853 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:06:01,853 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160601.log]\n', '2014-08-18 16:06:01,857 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:06:03,340 DEBUG - Will invoke JobStart for JobID [CREAM697377320]\n', 'https://cert-08.pd.infn.it:8443/CREAM697377320\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM697377320 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM697377320 2014-08-18 16:06:03.612599 Submit https://cert-08.pd.infn.it:8443/CREAM697377320 Left: 2 (at submission time:2) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM697377320 2014-08-18 16:07:07.930371 Exit https://cert-08.pd.infn.it:8443/CREAM373813970 Status: "DONE-OK" 2014-08-18 16:08:08.647920 Exit https://cert-08.pd.infn.it:8443/CREAM602905736 Status: "DONE-OK" 2014-08-18 16:10:03.343505 Exit https://cert-08.pd.infn.it:8443/CREAM037908631 Status: "DONE-OK" 2014-08-18 16:11:03.627147 Exit https://cert-08.pd.infn.it:8443/CREAM697377320 Status: "DONE-OK" no jobs left to submit or collect 2014-08-18 16:11:03.627700 Process 3642 terminating, no jobs left to submit or collect pd.infn.it:8443/CREAM319873990 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM319873990 2014-08-18 16:04:02.384376 Submit https://cert-08.pd.infn.it:8443/CREAM319873990 Left: 10 (at submission time:10) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM319873990 2014-08-18 16:06:06.407753 Exit https://cert-08.pd.infn.it:8443/CREAM904721336 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:06:07,153 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:06:07,177 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:06:07,177 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:06:07,178 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160607.log]\n', '2014-08-18 16:06:07,182 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:06:08,530 DEBUG - Will invoke JobStart for JobID [CREAM275815287]\n', 'https://cert-08.pd.infn.it:8443/CREAM275815287\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM275815287 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM275815287 2014-08-18 16:06:08.733355 Submit https://cert-08.pd.infn.it:8443/CREAM275815287 Left: 1 (at submission time:1) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM275815287 2014-08-18 16:06:09.110823 Exit https://cert-08.pd.infn.it:8443/CREAM972564353 Status: "DONE-OK" 2014-08-18 16:08:07.703984 Exit https://cert-08.pd.infn.it:8443/CREAM499209695 Status: "DONE-OK" 2014-08-18 16:09:12.012628 Exit https://cert-08.pd.infn.it:8443/CREAM319873990 Status: "DONE-OK" 2014-08-18 16:11:08.381114 Exit https://cert-08.pd.infn.it:8443/CREAM275815287 Status: "DONE-OK" no jobs left to submit or collect 2014-08-18 16:11:08.381615 Process 3639 terminating, no jobs left to submit or collect pd.infn.it:8443/CREAM872632470 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM872632470 2014-08-18 16:05:09.936125 Submit https://cert-08.pd.infn.it:8443/CREAM872632470 Left: 4 (at submission time:4) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM872632470 2014-08-18 16:06:08.453780 Exit https://cert-08.pd.infn.it:8443/CREAM453442754 Status: "DONE-OK" Entering submit wrapper I am going to call submit_job submit command : /usr/bin/glite-ce-job-submit -d -r cert-08.pd.infn.it:8443/cream-slurm-creamtest -D DJsdCEeczJidUNm /tmp/cream_stress_testing-1408355868.51-sleep.jdl Submission retval :0 JOB SUBMISSION output: ['2014-08-18 16:06:09,199 DEBUG - Using certificate proxy file [/tmp/x509up_u500]\n', '2014-08-18 16:06:09,227 DEBUG - VO from certificate=[dteam]\n', '2014-08-18 16:06:09,227 WARN - No configuration file suitable for loading. Using built-in configuration\n', '2014-08-18 16:06:09,227 DEBUG - Logfile is [/tmp/glite_cream_cli_logs/glite-ce-job-submit_CREAM_bertocco_20140818-160609.log]\n', '2014-08-18 16:06:09,231 DEBUG - Registering to [https://cert-08.pd.infn.it:8443/ce-cream/services/CREAM2] JDL=[ StdOutput = "job.out"; BatchSystem = "slurm"; QueueName = "creamtest"; Executable = "/bin/sleep"; Type = "job"; Arguments = "60"; JobType = "normal"; StdError = "job.err" ] - JDL File=[/tmp/cream_stress_testing-1408355868.51-sleep.jdl]\n', '2014-08-18 16:06:10,956 DEBUG - Will invoke JobStart for JobID [CREAM101061353]\n', 'https://cert-08.pd.infn.it:8443/CREAM101061353\n'] job submission failed?! job submission successful Returning from submit_job with jobid = https://cert-08.pd.infn.it:8443/CREAM101061353 Submitted job: jid = https://cert-08.pd.infn.it:8443/CREAM101061353 2014-08-18 16:06:11.149777 Submit https://cert-08.pd.infn.it:8443/CREAM101061353 Left: 0 (at submission time:0) submission succeeded, returned jobid = https://cert-08.pd.infn.it:8443/CREAM101061353 2014-08-18 16:07:08.199614 Exit https://cert-08.pd.infn.it:8443/CREAM257724263 Status: "DONE-OK" 2014-08-18 16:08:02.264656 Exit https://cert-08.pd.infn.it:8443/CREAM137858147 Status: "DONE-OK" 2014-08-18 16:10:09.020483 Exit https://cert-08.pd.infn.it:8443/CREAM872632470 Status: "DONE-OK" 2014-08-18 16:11:08.730611 Exit https://cert-08.pd.infn.it:8443/CREAM101061353 Status: "DONE-OK" no jobs left to submit or collect 2014-08-18 16:11:08.731402 Process 3641 terminating, no jobs left to submit or collect Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 982/1000 2014-08-18 16:07:06.929507 Submitted: 1000 Running: 17 Cancelled: 0 Done-Ok: 983 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 983/1000 2014-08-18 16:07:07.933189 Submitted: 1000 Running: 16 Cancelled: 0 Done-Ok: 984 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 984/1000 2014-08-18 16:07:08.202078 Submitted: 1000 Running: 15 Cancelled: 0 Done-Ok: 985 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 985/1000 2014-08-18 16:08:02.267012 Submitted: 1000 Running: 14 Cancelled: 0 Done-Ok: 986 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 986/1000 2014-08-18 16:08:07.705786 Submitted: 1000 Running: 13 Cancelled: 0 Done-Ok: 987 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 987/1000 2014-08-18 16:08:08.562559 Submitted: 1000 Running: 12 Cancelled: 0 Done-Ok: 988 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 988/1000 2014-08-18 16:08:08.651661 Submitted: 1000 Running: 11 Cancelled: 0 Done-Ok: 989 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 989/1000 2014-08-18 16:09:11.937936 Submitted: 1000 Running: 10 Cancelled: 0 Done-Ok: 990 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 990/1000 2014-08-18 16:09:11.952380 Submitted: 1000 Running: 9 Cancelled: 0 Done-Ok: 991 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 991/1000 2014-08-18 16:09:12.014666 Submitted: 1000 Running: 8 Cancelled: 0 Done-Ok: 992 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 992/1000 2014-08-18 16:09:12.103101 Submitted: 1000 Running: 7 Cancelled: 0 Done-Ok: 993 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 993/1000 2014-08-18 16:10:03.345737 Submitted: 1000 Running: 6 Cancelled: 0 Done-Ok: 994 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 994/1000 2014-08-18 16:10:07.793412 Submitted: 1000 Running: 5 Cancelled: 0 Done-Ok: 995 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 995/1000 2014-08-18 16:10:08.982578 Submitted: 1000 Running: 4 Cancelled: 0 Done-Ok: 996 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 996/1000 2014-08-18 16:10:09.023674 Submitted: 1000 Running: 3 Cancelled: 0 Done-Ok: 997 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 997/1000 2014-08-18 16:11:03.628502 Submitted: 1000 Running: 2 Cancelled: 0 Done-Ok: 998 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 998/1000 2014-08-18 16:11:08.382145 Submitted: 1000 Running: 1 Cancelled: 0 Done-Ok: 999 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 999/1000 2014-08-18 16:11:08.732302 Submitted: 1000 Running: 0 Cancelled: 0 Done-Ok: 1000 Failed: 0 Aborted: 0 Status Failed: 0 Submit Failed: 0 Cancel Failed: 0 Illegal Final Status: 0 Collected 1000/1000 All jobs have been collected! Total Jobs: 1000 DONE-OK: 1000 DONE-FAILED: 0 ABORTED: 0 CANCELLED: 0 Failed Submit operations: 0 Failed Cancel operations: 0 Failed Status operations: 0 Illegal Final Status: 0 Numero di processi che stanno sottomettendo 6 Ended at: Mon Aug 18 16:11:20 2014 Time elapsed: 4:13:29.493061 Output stored at: /tmp/tmpdJ3gD5.cream_stress_testing/