\chapter{Annex}

\section{Held Jobs}
\label{annex-heldjobs}

\nul\hfill{\scriptsize This example is related to the DAG shown in
  section~\ref{sec-oper-tasks}. The A.condor and B.condor jobs are
  defined as "echo A" and "echo B" commands.}

If \texttt{condor\_submit\_dag} is executed from a local directory
(e.g. \textbf{/export/ippc01.0/ippdor/simple_dag}), the jobs will be
indefinitely held by Condor. 

\begin{verbatim}
ippdor@ippc01 /export/ippc01.0/ippdor/simple_dag $ condor_submit_dag AB.dag
-----------------------------------------------------------------------
File for submitting this DAG to Condor           : AB.dag.condor.sub
Log of DAGMan debugging messages                 : AB.dag.dagman.out
Log of Condor library output                     : AB.dag.lib.out
Log of Condor library error messages             : AB.dag.lib.err
Log of the life of condor_dagman itself          : AB.dag.dagman.log

Submitting job(s).
1 job(s) submitted to cluster 71204.
-----------------------------------------------------------------------
\end{verbatim}

This can be seen with the
\texttt{condor\_q} command:

\begin{verbatim}
$ condor_q

-- Submitter: ippc01.ifa.hawaii.edu : <10.10.20.80:46944> : ippc01.ifa.hawaii.edu
 ID      OWNER            SUBMITTED     RUN_TIME ST PRI SIZE CMD               
71204.0   ippdor         11/25 11:41   0+00:01:27 R  0   12.2 condor_dagman     
71205.0   ippdor         11/25 11:42   0+00:00:01 H  0   0.0  echo A            

2 jobs; 0 idle, 1 running, 1 held
\end{verbatim}

``In-depth'' analysis can be performed with \texttt{condor\_q -analyze} command:

\begin{verbatim}
$ condor_q -analyze 71205.0

-- Submitter: ippc01.ifa.hawaii.edu : <10.10.20.80:46944> : ippc01.ifa.hawaii.edu
---
71205.000:  Request is held.

Hold reason: Error from slot7@ipp029.ifa.hawaii.edu: Failed to execute 
'/bin/echo' with arguments A: Cannot access specified iwd 
"/export/ippc01.0/ippdor/simple_dag" (errno=2: 'No such file or directory')
\end{verbatim}

The hold reason makes things obvious (as soon as you know that
\texttt{iwd} stands for "Initial Working Directory")... There is no
way that the Execute node \texttt{ipp029} can get the contents of what
is on \texttt{ippc01} local file system.

To fix the problem, stop processing with:
\begin{verbatim}
$ condor_rm 71204.0
\end{verbatim}

Note the creation of the \texttt{rescue} file in \texttt{/export/ippc01.0/ippdor/simple\_dag}
