Skip to content, Skip to search

Changes

HPC Workflow Manager

782 bytes added, 04:18, 5 November 2019
Available functions (list)
[[File:hpc-workflow-manager-create-job.png |300px|thumb|center| Figure 4: Example of a new Macro job configuration.]]
=== How to start a job upload the data and the Macro script ===
If you have created a new job, the main window should look roughly like Figure 5.
[[File:hpc-workflow-manager-created-job.png |300px|thumb|center| Figure 5: A new Macro job has been created.]]
Here Before you can start the job, you need to upload your script (“user.ijm”). To do this you must select the “Upload data” item from the context menu. If your script also needs data, they should also be located in the same directory that the user's script is in. The data will be uploaded along with the Macro script file. A timer will appear in the download column. When it has completed uploading the data and user's script the cell that corresponds to the job should indicate that it is “Done” (Figure 6). [[File:hpc-workflow-manager-upload-job.png |300px|thumb|center| Figure 6: Uploading files (in this case just the user’s script) is done.]] Now that the script file is uploaded the job can be started. === How to start a job ===Let's inspect figure 6 closer. In the figure you can see the following columns:
* “Job ID” - Job’s identification number;
* “Status” – The job’s current status which can be:
Right-click on the new job to display the context menu (of Figure 3). You will notice that there are new enabled items.
Before you can start Right-click the row of the job, you need to upload your script (“user.ijm”). To do this you must and select the “Upload data” item “Start Job” from the context menu.
A timer will appear in the download column. When it has completed the uploading the cell that corresponds to the job should indicate that it is “Done” (Figure 6). [[File:hpc-workflow-manager-upload-job.png |300px|thumb|center| Figure 6: Uploading files (in this case just the user’s script) is done.]] Now that the script file is uploaded the job can be started. Right-click the row of the job and select “Start Job” from the context menu. To make the source code of the user cleaner and easier to understand the special functions that make parallelism available to the user are appended to the user script on upload and a new file is created called “mpitest“parallelMacroWrappedScript.txt” ijm” which is the file that will be executed on the cluster.
To inspect the submitted file (for example for debugging) you can right-click the job and select “Open Macro in editor” where you can see the contents of the user script along with the appended function definitions that provide parallelism.
If you are new to Macro programming it is suggested to read [[Introduction into Macro Programming]] first. This will provide you with a sufficient introduction to the basics of Macro programming in Fiji.
If you opt to use the script editor you may also find [[Using the Script Editor]] useful. Using the script editor is suggested as it supports autocompletion for the functions added by HPC Workflow Manager.
You should also be familiar with the graphical user interface of the HPC Workflow Client.
=== Available functions (list) ===
Many of the functions have an MPI equivalent, this will also be listed in the table to aid people familiar with MPI. This is because the current implementation uses OpenMPI 4.0. Note however that this does not mean that this will be a wrapper for MPI for Fiji Macro and the underlying implementation may and probably will change.
{| class="wikitable"
| parReportTasks || None || None || Outputs all task ids with their descriptions.
|}
 
If you need help remembering the functions and what they do you may use autocompletion to get help. Just type "par" and a list of options will appear. There is a link to this page in the autocomplete help. An example is provided in figure 10.
 
[[File:hpc-workflow-manager-autocomplete.png |300px|thumb|center| Figure 10: Function autocompletion example.]]
== Installation ==
95
edits