Difference between revisions of "Software Development Guide"
(→Configuration) |
(→GUI Component Computation and Communication: the FLTK and guiUtilities Libraries) |
||
(73 intermediate revisions by the same user not shown) | |||
Line 1: | Line 1: | ||
== Overview == | == Overview == | ||
− | This guide describes two examples of what is involved when developing a YARP-based component that is compliant with | + | |
+ | This guide describes two examples of what is involved when developing a YARP-based component that is compliant with recommended standards for software engineering. | ||
The first example, <code>protoComponent</code>, implements some very simple image processing and analysis (binary segmentation using a supplied threshold and then count the number of foreground pixels). | The first example, <code>protoComponent</code>, implements some very simple image processing and analysis (binary segmentation using a supplied threshold and then count the number of foreground pixels). | ||
Line 7: | Line 8: | ||
The second example, <code>protoComponentGUI</code>, explains how to write a component that implements a simple graphic use interface. In this case, the GUI allows the user to set the threshold with a slider widget and then sends the threshold to <code>protoComponent</code>. It receives some statistics from <code>protoComponent</code>, specifically the number of foreground pixels and the current time, and writes them to a text display. It also receives the binary image from <code>protoComponent</code> and displays it along with the original colour image that it receives from the source that also feeds <code>protoComponent</code>. | The second example, <code>protoComponentGUI</code>, explains how to write a component that implements a simple graphic use interface. In this case, the GUI allows the user to set the threshold with a slider widget and then sends the threshold to <code>protoComponent</code>. It receives some statistics from <code>protoComponent</code>, specifically the number of foreground pixels and the current time, and writes them to a text display. It also receives the binary image from <code>protoComponent</code> and displays it along with the original colour image that it receives from the source that also feeds <code>protoComponent</code>. | ||
− | Both examples are accompanied by a test application, again adhering to the | + | Both examples are accompanied by a test application, again adhering to the recommended standards. |
=== File Organization === | === File Organization === | ||
− | |||
− | + | As noted in the [[Mandatory Standards for File Organization]], the implementation of a typical CINDY component comprises four files. These are the interface file and three implementation files: | |
− | *The implementation files contains the source code for the implementation of each class method (C++) or the source code of each function (C). For convenience, the implementation is separated in | + | * The interface file is a header file, e.g. <code>protoComponent.h</code>, with the class declarations, method prototype declarations, and function prototype declarations, but no method or function implementations. It also contains the Doxygen documentation comments explaining the purpose and usage of the component (see [[Mandatory Standards for Internal Documentation]]). |
− | + | *The implementation files contains the source code for the implementation of each class method (C++) or the source code of each function (C). For convenience, the implementation is separated in three files: | |
− | # <code> | + | # The first source code file — e.g. <code>protoComponentMain.cpp</code> — contains the <code> main()</code> function that instantiates the module object and calls the <code>runModule</code> method to effect the configuration, coordination, computation, and communication for that component. |
− | # <code> | + | # The second source code file — e.g. <code>protoComponentConfiguration.cpp</code> — contains the code that handles the component’s configuration and coordination functionality. |
− | + | # The third source code file — e.g. <code>protoComponentComputation.cpp</code> — contains the code that handles the component’s computation and communication functionality. | |
− | + | ||
Therefore, the four <code>protoComponent</code> files are: | Therefore, the four <code>protoComponent</code> files are: | ||
Line 35: | Line 34: | ||
protoComponentGUIComputation.cpp | protoComponentGUIComputation.cpp | ||
− | === Code | + | All of these files should be placed in the <code>src</code> directory. |
− | All the code for these examples is available in the | + | |
+ | Note that in a Component-Based Software Engineering (CBSE) project, such as CINDY, the source code application file is replaced by the application script file or application XML file that runs the various components and connects them together in a working system (see [[#Application Description]]). | ||
+ | |||
+ | === Example Code === | ||
+ | |||
+ | All the code for these examples is available in the CINDY software repository. For convenience, you can also review the code here: | ||
* [[The protoComponent Example | <code>protoComponent</code> source code]] | * [[The protoComponent Example | <code>protoComponent</code> source code]] | ||
Line 43: | Line 47: | ||
* [[The protoComponentGUITEST Example | <code>protoComponentGUITEST.xml</code> application]] | * [[The protoComponentGUITEST Example | <code>protoComponentGUITEST.xml</code> application]] | ||
− | === Guide | + | === How This Guide Is Organized === |
− | There are | + | There are four main parts to this guide, in addition to this overview, some focussing on the <code>protoComponent</code> example and others on the <code>protoComponentGUI</code> example. |
==== Component Configuration and Coordination: the <code>RFModule</code> Class ==== | ==== Component Configuration and Coordination: the <code>RFModule</code> Class ==== | ||
+ | |||
We begin with the functionality associated with configuration and coordination, i.e. with the <code>protoComponentConfiguration.cpp</code> and <code>protoComponent.h</code> files. This functionality revolves around the <code>RFModule</code> class. The <code>protoComponentGUIConfiguration.cpp</code> and <code>protoComponentGUI.h</code> files have essentially the same structure. | We begin with the functionality associated with configuration and coordination, i.e. with the <code>protoComponentConfiguration.cpp</code> and <code>protoComponent.h</code> files. This functionality revolves around the <code>RFModule</code> class. The <code>protoComponentGUIConfiguration.cpp</code> and <code>protoComponentGUI.h</code> files have essentially the same structure. | ||
+ | |||
+ | This section also deals with the <code>main()</code> function, i.e. with the <code>protoComponentApplication.cpp</code> file. It shows how to instantiate a module derived from the <code>RFModule</code> class, set the default configuration file and path for the resource finder, and run the module. This allows the component to be configured using the resource finder. | ||
+ | |||
+ | Once this is done, the derived module then instantiates a <code>Thread</code> or a <code>RateThread</code> object and launches it, passing to it as arguments all the relevant resources (e.g. port names and parameter values) located by the resource finder. | ||
+ | |||
+ | Finally, it is also responsible for shutting down the thread gracefully by stopping the thread, interrupting any port communications, and closing the ports. | ||
==== Component Computation and Communication: the <code>Thread</code> and <code>RateThread</code> Classes ==== | ==== Component Computation and Communication: the <code>Thread</code> and <code>RateThread</code> Classes ==== | ||
− | |||
− | + | We then address the functionality associated with computation and communication, i.e. with the <code>protoComponentComputation.cpp</code> and <code>protoComponent.h</code> files. This functionality revolves around the <code>Thread</code> and <code>RateThread</code> classes: how to access the parameters passed to it from the derived <code>RFModule</code> object and how to perform some useful work. | |
− | + | ||
==== GUI Component Computation and Communication: the <code>FLTK</code> and <code>guiUtilities</code> Libraries ==== | ==== GUI Component Computation and Communication: the <code>FLTK</code> and <code>guiUtilities</code> Libraries ==== | ||
+ | |||
We now show how you can write your own graphic user interface for the <code>protoComponent</code> component. This will be implemented as a separate stand-along component <code>protoComponentGUI</code>. As noted above, the functionality associated with configuration and coordination, i.e. with the <code>protoComponentGUIConfiguration.cpp</code> and <code>protoComponentGUI.h</code> files, is essentially the same as for the <code>protoComponent</code> example. Again, this functionality revolves around the <code>RFModule</code> class. | We now show how you can write your own graphic user interface for the <code>protoComponent</code> component. This will be implemented as a separate stand-along component <code>protoComponentGUI</code>. As noted above, the functionality associated with configuration and coordination, i.e. with the <code>protoComponentGUIConfiguration.cpp</code> and <code>protoComponentGUI.h</code> files, is essentially the same as for the <code>protoComponent</code> example. Again, this functionality revolves around the <code>RFModule</code> class. | ||
Line 62: | Line 72: | ||
==== Test Applications ==== | ==== Test Applications ==== | ||
+ | |||
This section describes two test applications. | This section describes two test applications. | ||
Line 70: | Line 81: | ||
== Component Configuration and Coordination: The <code>RFModule</code> Class == | == Component Configuration and Coordination: The <code>RFModule</code> Class == | ||
− | The starting point in writing any | + | The starting point in writing any CINDY component is to develop a sub-class of the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RFModule.html yarp::os::RFModule] class. |
First, we define a sub-class, or derived class, of the <code>yarp::os::RFModule</code> class. The module's variables - ''and specifically the module's parameters and ports'' - go in the private data members part and you need to override three methods: | First, we define a sub-class, or derived class, of the <code>yarp::os::RFModule</code> class. The module's variables - ''and specifically the module's parameters and ports'' - go in the private data members part and you need to override three methods: | ||
Line 86: | Line 97: | ||
In the following, we assume we are writing a module named <code>protoComponent</code>. This module will be implemented as a sub-class [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RFModule.html yarp::os::RFModule] called <code>ProtoComponent</code> (it is a capital P because it is a sub-class). For convenience, the header comments have been removed. | In the following, we assume we are writing a module named <code>protoComponent</code>. This module will be implemented as a sub-class [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RFModule.html yarp::os::RFModule] called <code>ProtoComponent</code> (it is a capital P because it is a sub-class). For convenience, the header comments have been removed. | ||
+ | /** @file protoComponent.h Interface file for the example CINDY component */ | ||
+ | |||
#include <iostream> | #include <iostream> | ||
#include <string> | #include <string> | ||
Line 181: | Line 194: | ||
Perhaps the trickiest part of writing the software to implement a component is understanding the way that the <code>RFModule</code> and <code>Thread</code> share the work between them and how they interact. That's exactly what we will explain in to following, once we have covered how the <code>RFModule</code> object handles all the configuration and coordination functionality. | Perhaps the trickiest part of writing the software to implement a component is understanding the way that the <code>RFModule</code> and <code>Thread</code> share the work between them and how they interact. That's exactly what we will explain in to following, once we have covered how the <code>RFModule</code> object handles all the configuration and coordination functionality. | ||
− | + | First, some clarification. By ''configuration'' we mean the ability to specify the way that a given component is used. There are two aspects to this: | |
− | + | # How the component is presented (i.e. which particular interfaces are used: the names of ports used, the name of the configuration file, the path to the configuration file, the name of the component, and the name of the robot) and | |
− | By configuration | + | # The component parameters that govern its behaviour (e.g. thresholds, set-points, and data files) |
− | # | + | |
− | # | + | |
We refer to these collectively as resources. Typically, the configuration file name, the configuration file path (called the context), the component name, and the robot name are specified as command-line parameters, while all the remaining resources, including the names of the ports, are typically specified in the configuration file. | We refer to these collectively as resources. Typically, the configuration file name, the configuration file path (called the context), the component name, and the robot name are specified as command-line parameters, while all the remaining resources, including the names of the ports, are typically specified in the configuration file. | ||
− | + | Note that ''all'' resources are handled the same way using the ''ResourceFinder'' which not only greatly simplifies the process of finding the resources but also simplifies the process of parsing them. | |
It's worth noting that parameters that are specified in the configuration file can also be specified in the command-line if you wish. The reverse is also true, with some restrictions (e.g. it only makes sense to specify the configuration file and the configuration file path on the command-line). Finally, modules should be written so that default values are provided for all resources so that the module can be launched without any parameters. Again, the ResourceFinder makes it easy to arrange this. | It's worth noting that parameters that are specified in the configuration file can also be specified in the command-line if you wish. The reverse is also true, with some restrictions (e.g. it only makes sense to specify the configuration file and the configuration file path on the command-line). Finally, modules should be written so that default values are provided for all resources so that the module can be launched without any parameters. Again, the ResourceFinder makes it easy to arrange this. | ||
Line 194: | Line 205: | ||
Right now, what's important to grasp is that all these configuration issues are implemented by | Right now, what's important to grasp is that all these configuration issues are implemented by | ||
− | * | + | * '''Instantiating your component as a derived sub-class of <code>RFModule</code> in the <code>main()</code> function (e.g. in <code>protoComponentMain.cpp</code>), |
− | * | + | |
+ | * '''Preparing the ''ResourceFinder'' in the <code>main()</code> function by setting the default configuration file and its path,''' | ||
+ | |||
+ | * '''Overriding the <code>yarp::os::RFModule::configure()</code> method (e.g. in <code>protoComponentConfiguration.cpp</code>) to parse all the parameters from the command-line and the configuration file.''' | ||
+ | |||
+ | * '''Launching your component by calling the <code>yarp::os::RFModule::runModule()</code> method from <code>main()</code>, | ||
+ | |||
+ | The following sections explain the implementation details of each aspect of this set-up and configuration. | ||
+ | |||
+ | === Instantiating a Derived Sub-Class of <code>RFModule</code>, Configuring the Resource Finder, and Running the Module === | ||
+ | |||
+ | The <code>main()</code> function in the <code>protoComponentMain.cpp</code> file is responsible for instantiating a module derived from the <code>RFModule</code> class, setting the default configuration file and path for the resource finder, and running the module. This allows the component to be configured using the resource finder (something that is actually accomplished by the code in <code>protoComponentConfiguration.cpp</code>). | ||
+ | |||
+ | /* protoComponentMain.cpp Application file for the example CINDY component */ | ||
+ | |||
+ | int main(int argc, char * argv[]) | ||
+ | { | ||
+ | /* initialize yarp network */ | ||
+ | |||
+ | Network yarp; | ||
+ | |||
+ | /* create your module */ | ||
+ | |||
+ | ProtoComponent protoComponent; | ||
+ | |||
+ | /* prepare and configure the resource finder */ | ||
+ | |||
+ | ResourceFinder rf; | ||
+ | rf.setVerbose(true); | ||
+ | rf.setDefaultConfigFile("protoComponent.ini"); // can be overridden by --from parameter | ||
+ | rf.setDefaultContext("protoComponent/configuration"); // can be overridden by --context parameter | ||
+ | rf.configure("CINDY_ROOT", argc, argv); // environment variable with root of configuration path | ||
+ | |||
+ | /* run the module: runModule() calls configure first and, if successful, it then runs */ | ||
+ | |||
+ | protoComponent.runModule(rf); | ||
+ | |||
+ | return 0; | ||
+ | } | ||
+ | |||
+ | There are a few important points to notice in the code above. | ||
+ | |||
+ | |||
+ | * Initialization of the configuration file in the resource finder object | ||
+ | |||
+ | * Initialization of the path to the configuration file in the resource finder object | ||
+ | |||
+ | * Initialization of the environmental variable that defines the root of the configuration path in the resource finder object | ||
+ | |||
+ | * The <code>runModule</code> method is called to launch the module and do the configuration using the resource finder object passed as an argument | ||
− | |||
− | + | The first two require some additional explanation which we provide next. | |
− | + | ==== Configuration File ==== | |
Configuration can be changed by changing configuration files. The configuration file which the component reads can be specified as a command line option. | Configuration can be changed by changing configuration files. The configuration file which the component reads can be specified as a command line option. | ||
Line 209: | Line 268: | ||
The component should set a default configuration file using <code>yarp::os::ResourceFinder::setDefaultConfigFile("protoComponent.ini")</code>. This should be done in the <code>main()</code> function before running the module. | The component should set a default configuration file using <code>yarp::os::ResourceFinder::setDefaultConfigFile("protoComponent.ini")</code>. This should be done in the <code>main()</code> function before running the module. | ||
− | + | The value set by this method is overridden by the <code>--from</code> parameter (specified either during the command-line invocation or in the component configuration file; the command-line has priority over the configuration file if both are specified). | |
− | The .ini file should usually be placed in the <code>$ | + | The .ini file should usually be placed in the <code>$CINDY_ROOT/release/components/protoComponent/config</code> sub-directory. |
− | + | ==== Context ==== | |
− | The relative path from <code>$ | + | The relative path from <code>$CINDY_ROOT/release</code> to the directory containing the configuration file is specified from the command line by |
--context components/protoComponent/config | --context components/protoComponent/config | ||
Line 222: | Line 281: | ||
This should be done in the <code>main()</code> function in <code>protoComponentMain.cpp</code> before launching the component. | This should be done in the <code>main()</code> function in <code>protoComponentMain.cpp</code> before launching the component. | ||
− | This is overridden by the <code>--context</code> parameter. | + | This is overridden by the <code>--context</code> parameter (again, specified either during the command-line invocation or in the component configuration file; the command-line has priority over the configuration file if both are specified). |
− | ===== Module Name and Port Names | + | === Configuration: Overriding the <code>yarp::os::RFModule::configure()</code> method === |
+ | |||
+ | The method that overrides <code>yarp::os::RFModule::configure()</code> is defined in <code>protoComponentConfiguration.cpp</code>. It uses the resource finder to parse all the parameters from the command-line and the configuration file and assign values appropriately. | ||
+ | |||
+ | The key thing to keep in mind here is that it must be possible to ''externally'' reconfigure how the component interfaces with other components without having to modify any source code. This is why so much information is required when starting up the component and why the resource finder is so useful and important. | ||
+ | |||
+ | ==== Module Name and Port Names ==== | ||
You should ensure that it is possible to specify the names of any ports created by a module via configuration. There are two aspects to this: the stem of the port name and the port name itself. | You should ensure that it is possible to specify the names of any ports created by a module via configuration. There are two aspects to this: the stem of the port name and the port name itself. | ||
Line 271: | Line 336: | ||
All this code goes in the <code>configure()</code> method in <code>protoComponentConfiguration.cpp</code>. | All this code goes in the <code>configure()</code> method in <code>protoComponentConfiguration.cpp</code>. | ||
− | + | ==== Which Parameters Are Parsed Automatically? ==== | |
Parsing the <code>--from</code> and <code>--context</code> parameters is handled automatically by the <code>RFModule</code> but <code>--name</code> and <code>--robot</code> must be handled explicitly. | Parsing the <code>--from</code> and <code>--context</code> parameters is handled automatically by the <code>RFModule</code> but <code>--name</code> and <code>--robot</code> must be handled explicitly. | ||
Line 278: | Line 343: | ||
==== Configuration File Parameters ==== | ==== Configuration File Parameters ==== | ||
− | The configuration file, typically named <code>protoComponent.ini</code> and located in the <code>$ | + | |
+ | The configuration file, typically named <code>protoComponent.ini</code> and located in the <code>$CINDY_ROOT/release/components/protoComponent/config</code> directory, contains a key-value list: a list of pairs of keywords (configuration parameter names) and values (configuration parameter values), e.g. | ||
imageInputPort /altImage:i | imageInputPort /altImage:i | ||
− | imageOutputPort /altImage:o | + | imageOutputPort /altImage:o |
threshold 9 | threshold 9 | ||
... | ... | ||
− | These parameters are parsed using the [http://wiki.icub.org/yarpdoc | + | These parameters are parsed using the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1ResourceFinder.html <code>ResourceFinder</code>] within an <code>RFModule</code> object (i.e. by methods inherited by your module such as |
− | [http://wiki.icub.org/yarpdoc | + | [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Searchable.html <code>yarp::os::Searchable::check()</code>]). |
+ | |||
Typically, key-value pairs specify the parameters and their values that govern the behaviour of the module, as well as the names of the module ports, should you wish to rename them. | Typically, key-value pairs specify the parameters and their values that govern the behaviour of the module, as well as the names of the module ports, should you wish to rename them. | ||
Line 294: | Line 361: | ||
Apart from processing the parameters in the configuration file <code>protoComponent.ini</code>, it's often necessary to access configuration | Apart from processing the parameters in the configuration file <code>protoComponent.ini</code>, it's often necessary to access configuration | ||
data in other files. For example, you might want to read the intrinsic camera parameters from a camera calibration file. | data in other files. For example, you might want to read the intrinsic camera parameters from a camera calibration file. | ||
− | Let's assume this configuration file is called <code>cameras.ini</code> and we wish to extract the principal points of the left and right cameras. The coordinates of the principle points, and other intrinsic camera parameters, | + | Let's assume this configuration file is called <code>cameras.ini</code> and we wish to extract the principal points of the left and right cameras. The coordinates of the principle points, and other intrinsic camera parameters, are stored as a sequence of key-value pairs: |
cx 157.858 | cx 157.858 | ||
Line 321: | Line 388: | ||
* read the respective <code>cx</code> and <code>cy</code> key values. | * read the respective <code>cx</code> and <code>cy</code> key values. | ||
− | All of this is accomplished straightforwardly with the [http://wiki.icub.org/yarpdoc | + | |
+ | All of this is accomplished straightforwardly with the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1ResourceFinder.html <code>ResourceFinder</code>] and [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Property.html <code>Property</code>] classes. | ||
+ | |||
The first step is to get the name of the configuration file. This will typically be one of the key-value pairs in the module | The first step is to get the name of the configuration file. This will typically be one of the key-value pairs in the module | ||
Line 328: | Line 397: | ||
cameraConfig cameras.ini | cameraConfig cameras.ini | ||
− | so that it can be read in exactly the same way as the other parameters in the previous section, e.g. using [http://wiki.icub.org/yarpdoc | + | so that it can be read in exactly the same way as the other parameters in the previous section, e.g. using [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Searchable.html#a109f36a33b39972b0797110304380003 <code>yarp::os::Searchable::check()</code>]. |
− | The full path can then be determined by the [http://wiki.icub.org/yarpdoc | + | The full path can then be determined by the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1ResourceFinder.html#a73f64f1a452732ef8beb60984af0a99b <code>yarp::os::ResourceFinder::findFile()</code>] method. |
− | The contents of this file can then be read into a [http://wiki.icub.org/yarpdoc | + | The contents of this file can then be read into a [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Property.html <code>Property</code>] object using the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Property.html#a8048b872a66d398d1baed6aed1f301b2 <code>yarp:os:Property::fromConfigFile()</code>] method. |
− | Locating the required group (e.g. <code>CAMERA_CALIBRATION_LEFT</code>) is accomplished with the [http://wiki.icub.org/yarpdoc | + | Locating the required group (e.g. <code>CAMERA_CALIBRATION_LEFT</code>) is accomplished with the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Property.html#aa819ea2ae0d680a2e2bf899c22900e5b <code>yarp: os:Property::findGroup()</code>] method. |
− | This method returns a [http://wiki.icub.org/yarpdoc | + | This method returns a [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Bottle.html <code>Bottle</code>] with the full key-value list under this group. This list can then be searched for the required key and value using the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Searchable.html#a109f36a33b39972b0797110304380003 <code>yarp::os::Searchable::check()</code>] method, as before. |
− | + | === Run-time Interaction === | |
− | ==== | + | ==== The <code>respond()</code> Method ==== |
− | + | Often, it is very useful for a user or another module to send commands to control the behaviour of the module, e.g. interactively changing parameter values. | |
+ | We accomplish this functionality for the <code>yarp::os::RFModule</code> by overridding the <code>yarp::os::RFModule::respond()</code> method which can then be configured to receive messages from either a port (typically named <code>/protoComponent</code>) or the terminal. This is effected by the <code>yarp::os::RFModule::attach(port)</code> and <code>yarp::os::RFModule::attachTerminal()</code> methods, respectively. Attaching both the port and the terminal means that commands from both sources are then handled in the same way. | ||
+ | ==== An example of how to change module parameters at run-time ==== | ||
+ | |||
+ | In the following example, we handle three commands: | ||
+ | |||
+ | * help | ||
+ | * quit | ||
+ | * set thr <n> ... set the threshold (where <n> is an integer number) | ||
+ | |||
+ | Apart from the way that the commands are parsed and the form of the reply, the key thing to note here is the fact that the value of <code>ProtoComponent::thresholdValue</code> is updated. Since <code>protoComponent</code> references this variable, it too is updated and the updated value is used in the thread. | ||
+ | |||
+ | bool ProtoComponent::respond(const Bottle& command, Bottle& reply) | ||
+ | { | ||
+ | string helpMessage = string(getName().c_str()) + | ||
+ | " commands are: \n" + | ||
+ | "help \n" + | ||
+ | "quit \n" + | ||
+ | "set thr <n> ... set the threshold \n" + | ||
+ | "(where <n> is an integer number) \n"; | ||
+ | |||
+ | reply.clear(); | ||
+ | |||
+ | if (command.get(0).asString()=="quit") { | ||
+ | reply.addString("quitting"); | ||
+ | return false; | ||
+ | } | ||
+ | else if (command.get(0).asString()=="help") { | ||
+ | cout << helpMessage; | ||
+ | reply.addString("command is: set thr <n>"); | ||
+ | } | ||
+ | else if (command.get(0).asString()=="set") { | ||
+ | if (command.get(1).asString()=="thr") { | ||
+ | thresholdValue = command.get(2).asInt(); // set parameter value | ||
+ | reply.addString("ok"); | ||
+ | } | ||
+ | } | ||
+ | return true; | ||
+ | } | ||
+ | |||
+ | However, for any of this to work, we have to set up a port in the first place. We put the port declaration in the private data member part of <code>ProtoComponent</code> class | ||
+ | |||
+ | string handlerPortName; | ||
+ | ... | ||
+ | Port handlerPort; // a port to handle interactive messages (also uses bottles) | ||
+ | |||
+ | and open it in the <code>configure()</code> method, viz. | ||
+ | |||
+ | /* | ||
+ | * attach a port of the same name as the module (prefixed with a /) to the module | ||
+ | * so that messages received from the port are redirected to the respond method | ||
+ | */ | ||
+ | |||
+ | handlerPortName = "/"; | ||
+ | handlerPortName += getName(); // use getName() rather than a literal | ||
+ | |||
+ | if (!handlerPort.open(handlerPortName.c_str())) { | ||
+ | cout << getName() << ": Unable to open port " << handlerPortName << endl; | ||
+ | return false; | ||
+ | } | ||
+ | |||
+ | attach(handlerPort); // attach to port | ||
+ | |||
+ | Interrupt it in the <code>interrupt()</code> method, viz. | ||
+ | |||
+ | handlerPort.interrupt(); | ||
+ | |||
+ | Close it in the <code>close()</code> method, viz. | ||
+ | |||
+ | handlerPort.close(); | ||
+ | |||
+ | ==== Remote Connection ==== | ||
+ | |||
+ | Note that the <code>handlerport</code> can be used not only by other modules but also interactively by a user through the <code>yarp rpc</code> directive, viz.: | ||
+ | |||
+ | yarp rpc /protoComponent | ||
+ | |||
+ | This opens a connection from a terminal to the port and allows the user to then type in commands and receive replies from the <code>respond()</code> method. | ||
+ | |||
+ | === An Example of how to Configure the Component === | ||
+ | |||
+ | The following example summarizes how to handle all the configuration issues discussed above. This is taken directly from the [[The protoComponent Example | <code>protoComponent</code> source code]]. | ||
+ | |||
+ | /** @file protoComponent.h Interface file for the example CINDY component */ | ||
+ | |||
+ | #include <iostream> | ||
+ | #include <string> | ||
+ | |||
+ | #include <yarp/sig/all.h> | ||
#include <yarp/os/all.h> | #include <yarp/os/all.h> | ||
#include <yarp/os/RFModule.h> | #include <yarp/os/RFModule.h> | ||
#include <yarp/os/Network.h> | #include <yarp/os/Network.h> | ||
#include <yarp/os/Thread.h> | #include <yarp/os/Thread.h> | ||
− | + | ||
− | + | ||
using namespace std; | using namespace std; | ||
using namespace yarp::os; | using namespace yarp::os; | ||
using namespace yarp::sig; | using namespace yarp::sig; | ||
+ | |||
+ | class ProtoComponentThread : public Thread { | ||
+ | |||
+ | private: | ||
+ | |||
+ | /* class variables */ | ||
+ | |||
+ | bool debug; | ||
+ | int x, y; | ||
+ | PixelRgb rgbPixel; | ||
+ | ImageOf<PixelRgb> *image; | ||
+ | int *thresholdValue; | ||
+ | VectorOf<int> *thresholdVector; | ||
+ | int numberOfForegroundPixels; | ||
+ | |||
+ | /* thread parameters: they are pointers so that they refer to the original variables in protoComponent */ | ||
+ | |||
+ | BufferedPort<ImageOf<PixelRgb> > *imagePortIn; | ||
+ | BufferedPort<VectorOf<int> > *thresholdPortIn; | ||
+ | BufferedPort<ImageOf<PixelRgb> > *imagePortOut; | ||
+ | BufferedPort<Bottle> *statisticsPortOut; | ||
+ | |||
+ | public: | ||
+ | |||
+ | /* class methods */ | ||
+ | |||
+ | ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, | ||
+ | BufferedPort<VectorOf<int> > *thresholdIn, | ||
+ | BufferedPort<ImageOf<PixelRgb> > *imageOut, | ||
+ | BufferedPort<Bottle> *statisticsOut, | ||
+ | int *threshold ); | ||
+ | bool threadInit(); | ||
+ | void threadRelease(); | ||
+ | void run(); | ||
+ | }; | ||
+ | |||
+ | |||
+ | class ProtoComponent:public RFModule { | ||
− | |||
− | |||
/* module parameters */ | /* module parameters */ | ||
string moduleName; | string moduleName; | ||
− | string | + | string imageInputPortName; |
− | string | + | string thresholdInputPortName; |
− | string | + | string imageOutputPortName; |
− | string | + | string statisticsOutputPortName; |
+ | string handlerPortName; | ||
string cameraConfigFilename; | string cameraConfigFilename; | ||
float fxLeft, fyLeft; // focal length | float fxLeft, fyLeft; // focal length | ||
Line 369: | Line 562: | ||
float cxLeft, cyLeft; // coordinates of the principal point | float cxLeft, cyLeft; // coordinates of the principal point | ||
float cxRight, cyRight; // coordinates of the principal point | float cxRight, cyRight; // coordinates of the principal point | ||
− | int thresholdValue; | + | int thresholdValue; |
− | + | ||
/* class variables */ | /* class variables */ | ||
− | BufferedPort<ImageOf<PixelRgb> > imageIn; | + | BufferedPort<ImageOf<PixelRgb> > imageIn; // example image input port |
− | BufferedPort<ImageOf<PixelRgb> > imageOut; //example output port | + | BufferedPort<VectorOf<int> > thresholdIn; // example vector input port |
+ | BufferedPort<ImageOf<PixelRgb> > imageOut; // example image output port | ||
+ | BufferedPort<Bottle> statisticsOut; // example bottle output port | ||
+ | Port handlerPort; // a port to handle interactive messages (also uses bottles) | ||
+ | |||
+ | /* pointer to a new thread to be created and started in configure() and stopped in close() */ | ||
+ | |||
+ | ProtoComponentThread *protoComponentThread; | ||
public: | public: | ||
− | + | ||
bool configure(yarp::os::ResourceFinder &rf); // configure all the module parameters and return true if successful | bool configure(yarp::os::ResourceFinder &rf); // configure all the module parameters and return true if successful | ||
bool interruptModule(); // interrupt, e.g., the ports | bool interruptModule(); // interrupt, e.g., the ports | ||
bool close(); // close and shut down the module | bool close(); // close and shut down the module | ||
− | bool respond(const Bottle& command, Bottle& reply) | + | bool respond(const Bottle& command, Bottle& reply); |
double getPeriod(); | double getPeriod(); | ||
bool updateModule(); | bool updateModule(); | ||
− | }; | + | }; |
− | + | ||
− | + | ||
+ | /* protoComponentConfiguration.cpp Implementation file for the example CINDY component */ | ||
+ | |||
/* | /* | ||
− | * Configure method. | + | * Configure method ... use it to do component coordination, |
− | + | * i.e. to configure your component at runtime | |
− | + | ||
− | * | + | |
*/ | */ | ||
− | bool | + | bool ProtoComponent::configure(yarp::os::ResourceFinder &rf) |
{ | { | ||
/* Process all parameters from both command-line and .ini file */ | /* Process all parameters from both command-line and .ini file */ | ||
Line 402: | Line 600: | ||
moduleName = rf.check("name", | moduleName = rf.check("name", | ||
− | Value(" | + | Value("protoComponent"), |
"module name (string)").asString(); | "module name (string)").asString(); | ||
Line 409: | Line 607: | ||
* specifically the port names which are dependent on the module name | * specifically the port names which are dependent on the module name | ||
*/ | */ | ||
− | + | ||
setName(moduleName.c_str()); | setName(moduleName.c_str()); | ||
/* now, get the rest of the parameters */ | /* now, get the rest of the parameters */ | ||
+ | /* get the name of the input and output ports, automatically prefixing the module name by using getName() */ | ||
+ | imageInputPortName = "/"; | ||
+ | imageInputPortName += getName( | ||
+ | rf.check("imageInputPort", | ||
+ | Value("/image:i"), | ||
+ | "Input image port (string)").asString() | ||
+ | ); | ||
+ | |||
+ | thresholdInputPortName = "/"; | ||
+ | thresholdInputPortName += getName( | ||
+ | rf.check("thresholdInputPort", | ||
+ | Value("/threshold:i"), | ||
+ | "Threshold input port (string)").asString() | ||
+ | ); | ||
+ | |||
+ | imageOutputPortName = "/"; | ||
+ | imageOutputPortName += getName( | ||
+ | rf.check("imageOutputPort", | ||
+ | Value("/image:o"), | ||
+ | "Output image port (string)").asString() | ||
+ | ); | ||
+ | |||
+ | statisticsOutputPortName = "/"; | ||
+ | statisticsOutputPortName += getName( | ||
+ | rf.check("statisticsOutputPort", | ||
+ | Value("/statistics:o"), | ||
+ | "Output image port (string)").asString() | ||
+ | ); | ||
+ | |||
+ | |||
+ | /* get the threshold value */ | ||
+ | |||
+ | thresholdValue = rf.check("threshold", | ||
+ | Value(8), | ||
+ | "Key value (int)").asInt(); | ||
+ | |||
+ | |||
/* | /* | ||
* get the cameraConfig file and read the required parameter values cx, cy | * get the cameraConfig file and read the required parameter values cx, cy | ||
Line 421: | Line 656: | ||
cameraConfigFilename = rf.check("cameraConfig", | cameraConfigFilename = rf.check("cameraConfig", | ||
− | Value(" | + | Value("cameras.ini"), |
"camera configuration filename (string)").asString(); | "camera configuration filename (string)").asString(); | ||
Line 429: | Line 664: | ||
if (cameraProperties.fromConfigFile(cameraConfigFilename.c_str()) == false) { | if (cameraProperties.fromConfigFile(cameraConfigFilename.c_str()) == false) { | ||
− | cout << " | + | cout << "protoComponent: unable to read camera configuration file" << cameraConfigFilename << endl; |
return 0; | return 0; | ||
} | } | ||
Line 438: | Line 673: | ||
cyRight = (float) cameraProperties.findGroup("CAMERA_CALIBRATION_RIGHT").check("cy", Value(120.0), "cy right").asDouble(); | cyRight = (float) cameraProperties.findGroup("CAMERA_CALIBRATION_RIGHT").check("cy", Value(120.0), "cy right").asDouble(); | ||
} | } | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
Line 466: | Line 679: | ||
/* open ports */ | /* open ports */ | ||
− | if (!imageIn.open( | + | if (!imageIn.open(imageInputPortName.c_str())) { |
− | cout << getName() << ": unable to open port " << | + | cout << getName() << ": unable to open port " << imageInputPortName << endl; |
return false; // unable to open; let RFModule know so that it won't run | return false; // unable to open; let RFModule know so that it won't run | ||
} | } | ||
− | if (! | + | if (!thresholdIn.open(thresholdInputPortName.c_str())) { |
− | cout << getName() << ": unable to open port " << | + | cout << getName() << ": unable to open port " << thresholdInputPortName << endl; |
return false; // unable to open; let RFModule know so that it won't run | return false; // unable to open; let RFModule know so that it won't run | ||
} | } | ||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | if (!imageOut.open(imageOutputPortName.c_str())) { | |
+ | cout << getName() << ": unable to open port " << imageOutputPortName << endl; | ||
+ | return false; // unable to open; let RFModule know so that it won't run | ||
+ | } | ||
− | / | + | if (!statisticsOut.open(statisticsOutputPortName.c_str())) { |
+ | cout << getName() << ": unable to open port " << statisticsOutputPortName << endl; | ||
+ | return false; // unable to open; let RFModule know so that it won't run | ||
+ | } | ||
− | |||
− | /* | + | /* |
+ | * attach a port of the same name as the module (prefixed with a /) to the module | ||
+ | * so that messages received from the port are redirected to the respond method | ||
+ | */ | ||
− | + | handlerPortName = "/"; | |
− | + | handlerPortName += getName(); // use getName() rather than a literal | |
− | + | ||
− | + | ||
− | + | ||
− | + | if (!handlerPort.open(handlerPortName.c_str())) { | |
+ | cout << getName() << ": Unable to open port " << handlerPortName << endl; | ||
+ | return false; | ||
+ | } | ||
− | + | attach(handlerPort); // attach to port | |
+ | |||
+ | /* create the thread and pass pointers to the module parameters */ | ||
− | return | + | protoComponentThread = new ProtoComponentThread(&imageIn, &thresholdIn, &imageOut, &statisticsOut, &thresholdValue); |
+ | |||
+ | /* now start the thread to do the work */ | ||
+ | |||
+ | protoComponentThread->start(); // this calls threadInit() and it if returns true, it then calls run() | ||
+ | |||
+ | return true ; // let the RFModule know everything went well | ||
+ | // so that it will then run the module | ||
} | } | ||
− | + | /* protoComponentMain.cpp Application file for the example CINDY component */ | |
+ | |||
+ | #include "protoComponent.h" | ||
+ | |||
+ | int main(int argc, char * argv[]) | ||
+ | { | ||
+ | /* initialize yarp network */ | ||
+ | |||
+ | Network yarp; | ||
+ | |||
+ | /* create your module */ | ||
+ | |||
+ | ProtoComponent protoComponent; | ||
+ | |||
+ | /* prepare and configure the resource finder */ | ||
+ | |||
+ | ResourceFinder rf; | ||
+ | rf.setVerbose(true); | ||
+ | rf.setDefaultConfigFile("protoComponent.ini"); // can be overridden by --from parameter | ||
+ | rf.setDefaultContext("protoComponent/configuration"); // can be overridden by --context parameter | ||
+ | rf.configure("CINDY_ROOT", argc, argv); // environment variable with root of configuration path | ||
+ | |||
+ | /* run the module: runModule() calls configure first and, if successful, it then runs */ | ||
+ | |||
+ | protoComponent.runModule(rf); | ||
+ | |||
+ | return 0; | ||
+ | } | ||
+ | === Doing Some Work: Instantiating and starting the <code>protoComponentThread</code> === | ||
− | To achieve clean shutdown, two methods <code>yarp::os::RFModule::interruptModule()</code> and <code>yarp::os::RFModule::close()</code> should be overridden. The <code>interruptModule()</code> method will be called when it is desired that <code>updateModule()</code> finish up. When it has indeed finished, <code>close()</code> will be called. For example: | + | Once the configuration is done (in <code>protoComponentConfiguration.cpp</code>), the derived module then instantiates a <code>Thread</code> (or <code>RateThread</code>) object and launches it (again, this is done in <code>protoComponentConfiguration.cpp</code>), passing to it as arguments all the relevant resources, e.g. port names and parameter values, located by the resource finder. |
+ | |||
+ | In the example above, this we done as follows. | ||
+ | |||
+ | /* create the thread and pass pointers to the module parameters */ | ||
+ | |||
+ | protoComponentThread = new ProtoComponentThread(&imageIn, &thresholdIn, &imageOut, &statisticsOut, &thresholdValue); | ||
+ | |||
+ | /* now start the thread to do the work */ | ||
+ | |||
+ | protoComponentThread->start(); // this calls threadInit() and it if returns true, it then calls run() | ||
+ | |||
+ | === Graceful Shut-down === | ||
+ | |||
+ | To achieve clean shutdown, two <code>RFModule</code> methods, <code>yarp::os::RFModule::interruptModule()</code> and <code>yarp::os::RFModule::close()</code>, should be overridden. | ||
+ | |||
+ | The <code>interruptModule()</code> method will be called when it is desired that <code>updateModule()</code> finish up. When it has indeed finished, <code>close()</code> will be called. | ||
+ | |||
+ | The <code>interruptModule()</code> method should first call the <code>stop()</code> method for the thread (e.g. <code>protoComponentThread->stop();</code>) and then call the <code>interrupt</code> method for each of the ports that it opened in the <code>configure()</code> method. For example: | ||
− | bool | + | bool ProtoComponent::interruptModule() |
{ | { | ||
+ | protoComponentThread->stop(); | ||
+ | |||
imageIn.interrupt(); | imageIn.interrupt(); | ||
+ | thresholdIn.interrupt(); | ||
imageOut.interrupt(); | imageOut.interrupt(); | ||
+ | handlerPort.interrupt(); | ||
+ | |||
return true; | return true; | ||
} | } | ||
− | + | ||
− | bool | + | bool ProtoComponent::close() |
− | { | + | { |
imageIn.close(); | imageIn.close(); | ||
+ | thresholdIn.close(); | ||
imageOut.close(); | imageOut.close(); | ||
+ | handlerPort.close(); | ||
+ | |||
return true; | return true; | ||
− | } | + | } |
+ | The order in which you do this is very important: first <code>stop()</code> the thread, then <code>interrupt()</code> the ports, then <code>close()</code> the ports. Getting this out of sequence causes problems when shutting down a component and it will often hang, requiring you to kill the process. | ||
For <code>yarp::os::RFModule</code>, the method <code>yarp::os::RFModule::updateModule()</code> will be called from the main control thread until it returns false. After that a clean shutdown will be initiated. The period with which it is called is determined by the method <code>yarp::os::RFModule::getPeriod()</code>. Neither method need necessarily be overridden. The default methods provide the required functionality. | For <code>yarp::os::RFModule</code>, the method <code>yarp::os::RFModule::updateModule()</code> will be called from the main control thread until it returns false. After that a clean shutdown will be initiated. The period with which it is called is determined by the method <code>yarp::os::RFModule::getPeriod()</code>. Neither method need necessarily be overridden. The default methods provide the required functionality. | ||
Line 529: | Line 807: | ||
/* Called periodically every getPeriod() seconds */ | /* Called periodically every getPeriod() seconds */ | ||
− | bool | + | bool ProtoComponent::updateModule() |
{ | { | ||
return true; | return true; | ||
} | } | ||
− | + | ||
− | double | + | double ProtoComponent::getPeriod() |
{ | { | ||
− | /* module periodicity (seconds), called implicitly by | + | /* module periodicity (seconds), called implicitly by protoComponent */ |
return 0.1; | return 0.1; | ||
} | } | ||
− | |||
Note that the <code>updateModule()</code> method is not meant to run code that that implements the algorithm encapsulated in the module. Instead <code>updateModule()</code> is meant to be used as a periodic mechanism to check in on the operation of the thread that implements the module (e.g. gather interim statistics, change parameter settings, etc.). The <code>updateModule()</code> is called periodically by the RFModule object, with the period being determined by the <code>getPeriod()</code> method. Both <code>updateModule()</code> and <code>getPeriod()</code> can be overridden in your implementation of <code>myModule</code>. | Note that the <code>updateModule()</code> method is not meant to run code that that implements the algorithm encapsulated in the module. Instead <code>updateModule()</code> is meant to be used as a periodic mechanism to check in on the operation of the thread that implements the module (e.g. gather interim statistics, change parameter settings, etc.). The <code>updateModule()</code> is called periodically by the RFModule object, with the period being determined by the <code>getPeriod()</code> method. Both <code>updateModule()</code> and <code>getPeriod()</code> can be overridden in your implementation of <code>myModule</code>. | ||
− | == Thread | + | == Component Computation and Communication: the <code>Thread</code> and <code>RateThread</code> Classes == |
+ | |||
+ | Here we finally explain how to get the component to do some work: the functionality associated with computation and communication. This is defined in the <code>protoComponentComputation.cpp</code> file. This functionality revolves around the <code>Thread</code> and <code>RateThread</code> classes: how to access the parameters passed to it from the derived <code>RFModule</code> object, how to perform some useful work. | ||
=== Using Threads to Implement Your Algorithm === | === Using Threads to Implement Your Algorithm === | ||
− | For the module to actually do anything, it should start or stop threads using the YARP [http://wiki.icub.org/yarpdoc | + | For the module to actually do anything, it should start or stop threads using the YARP [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Thread.html Thread] and [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RateThread.html RateThread] classes. Typically, these threads are started and stopped in the <code>configure</code> and <code>close</code> methods of the RFModule class. If you are writing a control loop or an algorithm that requires precise scheduling your should use the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RateThread.html RateThread] class. |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
+ | Just as the starting point in writing a component for the CINDY repository is to develop a sub-class of the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RFModule.html yarp::os::RFModule] class, '''the starting point for implementing the algorithm within that component is to develop a sub-class of either [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Thread.html Thread] or [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RateThread.html RateThread]'''. | ||
− | + | In the following, we will explain how to do it with [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Thread.html Thread]; it's straightforward to extend this to [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1RateThread.html RateThread]: effectively, you provide an argument with the <code>RateThread</code> instantiation specifying the period with which the thread should be spawned; the thread just runs once so that you don't have to check <code>isStopping()</code> to see if the thread should end as in the [http://wiki.icub.org/yarpdoc/classyarp_1_1os_1_1Thread.html Thread] example below. | |
+ | '''Perhaps one of the best ways of thinking about this is to view it as a two levels of encapsulation, one with <code>RFModule</code>, and another with <code>Thread</code>; the former deals with the configuration of the module and the latter dealing with the execution of the algorithm.''' The only tricky part is that somehow these two objects have to communicate with one another. | ||
− | You need to know three things: | + | You need to know three things (two of which we can covered already): |
− | + | ||
# The thread is instantiated and started in the <code>configure()</code> method. | # The thread is instantiated and started in the <code>configure()</code> method. | ||
Line 567: | Line 841: | ||
# When the thread is instantiated, you pass the module parameters to it as a set of arguments (for the constructor). | # When the thread is instantiated, you pass the module parameters to it as a set of arguments (for the constructor). | ||
+ | Let's begin with the definition of a thread <code>ProtoComponentThread</code> (capital P because we are going to create a sub-class) and then turn our attention to how it is used by <code>protoComponent</code>. | ||
− | + | === An example of how to use the <code>Thread</code> class === | |
− | + | ||
− | === An | + | |
First, we define a sub-class, or derived class, of the <code>yarp::os::Thread</code> class. The algorithm's variables - ''and specifically the thread's parameters and ports'' - go in the private data members part and you need to override four methods: | First, we define a sub-class, or derived class, of the <code>yarp::os::Thread</code> class. The algorithm's variables - ''and specifically the thread's parameters and ports'' - go in the private data members part and you need to override four methods: | ||
− | + | # <code>ProtoComponentThread::ProtoComponentThread(); // the constructor</code> | |
− | # <code> | + | # <code>bool threadInit(); // initialize variables and return true if successful</code> |
− | # <code>bool threadInit(); | + | # <code>void run(); // do the work</code> |
− | # <code>void run(); | + | # <code>void threadRelease(); // close and shut down the thread</code> |
− | # <code>void threadRelease(); | + | |
− | + | ||
There are a number of important points to note. | There are a number of important points to note. | ||
− | + | First, the variables in the <code>ProtoComponentThread</code> class which represent the thread's parameters and port should be pointer types and the constructor parameters should initialize them. In turn, the arguments of the <code>protoComponentThread</code> object instantiation in the <code>configure()</code> should be the addresses of (pointers to) the module parameters and ports in the <code>protoComponentThread</code> object. In this way, the thread's parameter and port variables are just references to the original module parameters and ports that were initialized in the <code>configure</code> method of the <code>protoComponent</code> object. | |
− | First, the variables in the <code> | + | |
− | + | ||
Second, <code>threadInit()</code> returns <code>true</code> if the initialization was successful, otherwise it should return <code>false</code>. This is significant because if it returns <code>false</code> the thread will not subsequently be run. | Second, <code>threadInit()</code> returns <code>true</code> if the initialization was successful, otherwise it should return <code>false</code>. This is significant because if it returns <code>false</code> the thread will not subsequently be run. | ||
+ | Third, '''the <code>run()</code> method is where the algorithm is implemented.''' Typically, it will run continuously until some stopping condition is met. This stopping condition should include the return value of a call to the <code>yarp::os::Thread::isStopping()</code> method which flags whether or not the thread is to terminate. In turn, the value of <code>yarp::os::Thread::isStopping()</code> is determined by the <code>yarp::os::Thread::stop()</code> method which, as we saw already, is called in <code>protoComponent.close()</code>. | ||
− | + | The following is an example declaration and definition of the <code>ProtoComponentThread</code> class taken from <code>protoComponent.h</code> | |
− | + | ||
− | + | ||
− | The following is an example declaration and definition of the <code> | + | |
− | + | ||
+ | /** @file protoComponent.h Interface file for the example CINDY component */ | ||
+ | |||
#include <yarp/os/Thread.h> | #include <yarp/os/Thread.h> | ||
− | + | ||
using namespace std; | using namespace std; | ||
− | using namespace yarp::os; | + | using namespace yarp::os; |
+ | using namespace yarp::sig; | ||
− | class | + | class ProtoComponentThread : public Thread { |
− | + | ||
private: | private: | ||
/* class variables */ | /* class variables */ | ||
− | int | + | bool debug; |
− | PixelRgb rgbPixel; | + | int x, y; |
+ | PixelRgb rgbPixel; | ||
ImageOf<PixelRgb> *image; | ImageOf<PixelRgb> *image; | ||
− | + | int *thresholdValue; | |
− | + | VectorOf<int> *thresholdVector; | |
− | + | int numberOfForegroundPixels; | |
− | + | ||
− | + | ||
− | int | + | |
− | + | /* thread parameters: they are pointers so that they refer to the original variables in protoComponent */ | |
− | + | ||
− | /* | + | |
− | + | BufferedPort<ImageOf<PixelRgb> > *imagePortIn; | |
− | + | BufferedPort<VectorOf<int> > *thresholdPortIn; | |
− | + | BufferedPort<ImageOf<PixelRgb> > *imagePortOut; | |
− | + | BufferedPort<Bottle> *statisticsPortOut; | |
+ | |||
+ | public: | ||
+ | |||
+ | /* class methods */ | ||
+ | |||
+ | ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, | ||
+ | BufferedPort<VectorOf<int> > *thresholdIn, | ||
+ | BufferedPort<ImageOf<PixelRgb> > *imageOut, | ||
+ | BufferedPort<Bottle> *statisticsOut, | ||
+ | int *threshold ); | ||
+ | bool threadInit(); | ||
+ | void threadRelease(); | ||
+ | void run(); | ||
}; | }; | ||
− | + | /* protoComponentComputation.cpp Implementation file for the computation and communication aspects of protoComponent */ | |
+ | |||
+ | ProtoComponentThread::ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, | ||
+ | BufferedPort<VectorOf<int> > *thresholdIn, | ||
+ | BufferedPort<ImageOf<PixelRgb> > *imageOut, | ||
+ | BufferedPort<Bottle> *statisticsOut, | ||
+ | int *threshold) | ||
{ | { | ||
− | imagePortIn | + | imagePortIn = imageIn; |
− | + | thresholdPortIn = thresholdIn; | |
− | thresholdValue = threshold; | + | imagePortOut = imageOut; |
+ | statisticsPortOut = statisticsOut; | ||
+ | thresholdValue = threshold; | ||
} | } | ||
− | bool | + | bool ProtoComponentThread::threadInit() |
{ | { | ||
/* initialize variables and create data-structures if needed */ | /* initialize variables and create data-structures if needed */ | ||
+ | |||
+ | debug = false; | ||
return true; | return true; | ||
− | } | + | } |
− | void | + | void ProtoComponentThread::run(){ |
/* | /* | ||
Line 649: | Line 937: | ||
unsigned char value; | unsigned char value; | ||
+ | double start; | ||
+ | |||
+ | start = yarp::os::Time::now(); // start time | ||
while (isStopping() != true) { // the thread continues to run until isStopping() returns true | while (isStopping() != true) { // the thread continues to run until isStopping() returns true | ||
− | + | ||
− | cout << " | + | if (debug) |
+ | cout << "protoComponentThread: threshold value is " << *thresholdValue << endl; | ||
+ | /* read image ... block until image is received */ | ||
+ | |||
do { | do { | ||
image = imagePortIn->read(true); | image = imagePortIn->read(true); | ||
− | } while (image == NULL); | + | } while ((image == NULL) && (isStopping() != true)); // exit loop if shutting down; |
+ | if (isStopping()) break; // abort this loop to avoid make sure we don't continue and possibly use NULL images | ||
+ | |||
+ | |||
+ | /* read threshold ... block if threshold is not received */ | ||
+ | /* | ||
+ | do { | ||
+ | thresholdVector = thresholdPortIn->read(false); | ||
+ | } while ((thresholdVector == NULL) && (isStopping() != true)); // exit loop if shutting down; | ||
+ | */ | ||
+ | |||
+ | /* read threshold ... do not block if threshold is not received */ | ||
+ | |||
+ | thresholdVector = thresholdPortIn->read(false); | ||
+ | |||
+ | if (thresholdVector != NULL) { | ||
+ | *thresholdValue = (int) (*thresholdVector)[0]; | ||
+ | } | ||
+ | |||
+ | |||
+ | if (debug) | ||
+ | cout << "protoComponentThread: threshold value is " << *thresholdValue << endl; | ||
+ | |||
+ | |||
+ | /* write out the binary image */ | ||
+ | |||
ImageOf<PixelRgb> &binary_image = imagePortOut->prepare(); | ImageOf<PixelRgb> &binary_image = imagePortOut->prepare(); | ||
binary_image.resize(image->width(),image->height()); | binary_image.resize(image->width(),image->height()); | ||
+ | |||
+ | numberOfForegroundPixels = 0; | ||
for (x=0; x<image->width(); x++) { | for (x=0; x<image->width(); x++) { | ||
Line 668: | Line 989: | ||
if (((rgbPixel.r + rgbPixel.g + rgbPixel.b)/3) > *thresholdValue) { | if (((rgbPixel.r + rgbPixel.g + rgbPixel.b)/3) > *thresholdValue) { | ||
value = (unsigned char) 255; | value = (unsigned char) 255; | ||
+ | numberOfForegroundPixels++; | ||
} | } | ||
else { | else { | ||
Line 679: | Line 1,001: | ||
binary_image(x,y) = rgbPixel; | binary_image(x,y) = rgbPixel; | ||
} | } | ||
− | } | + | } |
− | + | ||
imagePortOut->write(); | imagePortOut->write(); | ||
+ | |||
+ | /* write out the image statistics */ | ||
+ | |||
+ | Bottle &statisticsMessage = statisticsPortOut->prepare(); | ||
+ | |||
+ | statisticsMessage.clear(); | ||
+ | |||
+ | statisticsMessage.addInt((int)(yarp::os::Time::now()-start)); | ||
+ | statisticsMessage.addString("seconds elapsed"); | ||
+ | statisticsMessage.addString(" - foreground pixel count is"); | ||
+ | statisticsMessage.addInt(numberOfForegroundPixels); | ||
+ | statisticsPortOut->write(); | ||
} | } | ||
} | } | ||
− | void | + | void ProtoComponentThread::threadRelease() |
{ | { | ||
/* for example, delete dynamically created data-structures */ | /* for example, delete dynamically created data-structures */ | ||
} | } | ||
− | == | + | == GUI Component Computation and Communication: the <code>FLTK</code> and <code>guiUtilities</code> Libraries == |
− | + | This section explains how you can write your own graphic user interface (GUI). We will use the specific example of a GUI for the <code>protoComponent</code> component. This will be implemented as a separate stand-along component <code>protoComponentGUI</code>. | |
− | / | + | The functionality associated with configuration and coordination, i.e. with the <code>protoComponentGUIConfiguration.cpp</code> and <code>protoComponentGUI.h</code> files, is essentially the same as for the <code>protoComponent</code> example so we will skip over that part. For reference, you can see the complete source code in [[The protoComponentGUI Example]]. |
− | + | ||
− | + | ||
+ | Here we address the functionality associated with computation and communication, i.e. with the <code> protoComponentGUIComputation.cpp </code> and <code>protoComponent.h </code> files (also included in [[The protoComponentGUI Example]]). As with <code>protoComponent</code>, the functionality revolves around the <code>Thread</code> and <code>RateThread</code> classes but the difference here is that the <code>ProtoComponentGUIThread::run()</code> now contains code to implement the GUI using the ''FLTK'' and ''guiUtilities'' libraries. That is the essential difference. | ||
− | The | + | First, we look at the definition of the <code>ProtoComponentGUIThread</code>. The only thing worthy of note here is the use of the inclusion of the <code>guiUtilities.h</code> file to allow us use the ''guiUtilities'' library. This library, which is included in the CINDY release software repository, provide a number of general-purpose classes and methods to lighten the burden of writing a GUI. In particular, here we see the definition of the two images <code>DVimage *rgbDVImage;</code> and <code>DVimage *binaryDVImage;</code>. The <code>DVimage</code> is one of the utility classes in the ''guiUtilities'' library. Other classes, which we will see later, include the <code>DVdisplay</code> class with is a specially-design GUI widget that allows the display of <code>DVimage</code> image objects. |
− | + | /** @file protoComponentGUI.h Interface file for the example CINDY component */ | |
− | /* | + | |
− | + | #include <iostream> | |
+ | #include <string> | ||
− | / | + | #include <yarp/sig/all.h> |
+ | #include <yarp/os/all.h> | ||
+ | #include <yarp/os/RFModule.h> | ||
+ | #include <yarp/os/Network.h> | ||
+ | #include <yarp/os/Thread.h> | ||
+ | |||
+ | #include "guiUtilities.h" | ||
− | + | using namespace std; | |
− | + | using namespace yarp::os; | |
− | + | using namespace yarp::sig; | |
− | + | ||
− | + | #define STRINGLENGTH 132 // used to define a string when post-processing the bottle messages | |
− | / | + | |
− | + | class ProtoComponentGUIThread : public Thread { | |
+ | |||
+ | private: | ||
+ | |||
+ | /* class variables */ | ||
+ | |||
+ | bool debug; | ||
+ | int x, y; | ||
+ | PixelRgb rgbPixel; | ||
+ | int *thresholdValue; | ||
+ | nt numberOfForegroundPixels; | ||
+ | int rgb_width; | ||
+ | int rgb_height; | ||
+ | int rgb_depth; | ||
+ | int binary_width; | ||
+ | int binary_height; | ||
+ | int binary_depth; | ||
+ | unsigned char pixel_value; | ||
+ | float float_pixel_value; | ||
+ | double thresholdValueDouble; | ||
+ | string logoFilenameValue; | ||
+ | int temp; | ||
+ | |||
+ | ImageOf<PixelRgb> *rgbYARPImage; | ||
+ | ImageOf<PixelRgb> *binaryYARPImage; | ||
+ | DVimage *rgbDVImage; | ||
+ | DVimage *binaryDVImage; | ||
+ | Bottle *statisticsMessage; | ||
+ | |||
+ | /* thread parameters: they are pointers so that they refer to the original variables in protoComponentGUI */ | ||
+ | |||
+ | BufferedPort<ImageOf<PixelRgb> > *colourImagePortIn; | ||
+ | BufferedPort<ImageOf<PixelRgb> > *binaryImagePortIn; | ||
+ | BufferedPort<Bottle> *statisticsPortIn; | ||
+ | BufferedPort<VectorOf<int> > *thresholdPortOut; | ||
+ | |||
+ | public: | ||
+ | |||
+ | /* class methods */ | ||
+ | |||
+ | ProtoComponentGUIThread(BufferedPort<ImageOf<PixelRgb> > *colourImageIn, | ||
+ | BufferedPort<ImageOf<PixelRgb> > *binaryImageIn, | ||
+ | BufferedPort<Bottle> *statisticsIn, | ||
+ | BufferedPort<VectorOf<int> > *thresholdOut, | ||
+ | int *threshold, | ||
+ | string logoFilename); | ||
+ | bool threadInit(); | ||
+ | void threadRelease(); | ||
+ | void run(); | ||
+ | }; | ||
− | + | Note that the thread parameter list contains a filename. This is the name of the file that contain the CINDY logo. We pass it as a parameter from the <code>RFModule::configure()</code> so that we can user the resource finder to locate the file and its path. | |
− | |||
− | |||
+ | Next, we look at the definition of the GUI itself in the <code>run()</code> method. For convenience, we will only show code snippets; refer to [[The protoComponentGUI Example]] for the complete source code listing. | ||
− | + | The first thing to notice is the instantiation of a number of objects from ''FLTK'' classes <code>Fl_Group</code>, <code>Fl_Box</code>, and <code>Fl_PNG_Image</code>. These define a group of widgets, a variety of individual widget, and an image with the CINDY logo. | |
− | = | + | /* protoComponentGUIComputation.cpp Implementation file for the example CINDY component */ |
+ | |||
+ | void ProtoComponentGUIThread::run(){ | ||
+ | |||
+ | Fl_Group *start_protoComponent_GUI; | ||
+ | Fl_Box *box1, *box2, *heading; | ||
+ | Fl_PNG_Image *logo=new Fl_PNG_Image(logoFilenameValue.c_str()); | ||
+ | |||
+ | The next thing is the long list of variables that determine the presentation of the GUI. These are then initialized in as subsequent section. This may look tedious but it means that it is very easy to re-design the layout of the GUI. | ||
− | + | int i, j; | |
+ | char modifiedString[STRINGLENGTH]; | ||
+ | |||
+ | /* variable that determine the presentation of the GUI */ | ||
+ | |||
+ | int control_panel_x, control_panel_y; | ||
+ | int control_panel_width, control_panel_height; | ||
+ | int heading_x, heading_y, heading_width, heading_height; | ||
+ | int display_width, display_height; | ||
+ | int display_x1, display_x2, display_y; | ||
+ | int display_spacing; | ||
+ | int display_offset_x, display_offset_y; | ||
+ | int control_offset_x, control_offset_y; | ||
+ | int button_size_x, button_size_y, button_spacing_y; | ||
+ | int input_size_x, input_size_y; | ||
+ | int title_height; | ||
+ | int threshold_x, threshold_y; | ||
+ | int threshold_size_x, threshold_size_y; | ||
+ | int section_spacing_y; | ||
+ | int window_width, window_height, border_width, border_height; | ||
+ | int text_output_width,text_output_height; | ||
+ | int text_output_x, text_output_y; | ||
+ | |||
+ | /* intialize the presentation settings */ | ||
+ | |||
+ | window_width = GetSystemMetrics(SM_CXFULLSCREEN); // this is the area available for the window on the screen | ||
+ | window_height = GetSystemMetrics(SM_CYFULLSCREEN); | ||
+ | |||
+ | border_width = GetSystemMetrics(SM_CXSIZEFRAME); | ||
+ | border_height = GetSystemMetrics(SM_CYSIZEFRAME); | ||
+ | |||
+ | display_width = DISPLAY_WIDTH; | ||
+ | display_height = DISPLAY_HEIGHT; | ||
+ | display_spacing = 25; | ||
+ | |||
+ | heading_x = (window_width - display_width*2 - display_spacing)/2; | ||
+ | heading_y = MENUBAR_HEIGHT; | ||
+ | heading_width = display_width*2 + display_spacing; // centre over displays | ||
+ | heading_height = HEADING_HEIGHT*2; // logo and caption | ||
+ | |||
+ | display_offset_x = heading_x ; | ||
+ | display_offset_y = heading_y + heading_height; | ||
+ | display_x1 = display_offset_x; | ||
+ | display_x2 = display_x1 + display_spacing + display_width ; | ||
+ | display_y = display_offset_y; | ||
+ | |||
+ | title_height = 12; | ||
+ | |||
+ | button_size_x = 130; | ||
+ | button_size_y = 20; | ||
+ | button_spacing_y = 5; | ||
+ | |||
+ | input_size_x = button_size_x; | ||
+ | input_size_y = button_size_y; | ||
+ | |||
+ | control_offset_x = 20; | ||
+ | control_offset_y = 0; | ||
+ | |||
+ | control_panel_width = display_width * 1; | ||
+ | control_panel_height = display_height / 2; // alternative to match the panel height to the number of widgets: | ||
+ | // control_panel_height = title_height + 1*(5 + button_size_y) + title_height; | ||
+ | control_panel_x = display_x2; | ||
+ | control_panel_y = display_y + display_height + display_spacing; | ||
+ | |||
+ | section_spacing_y = 8; | ||
+ | |||
+ | threshold_size_x = control_panel_width - 2 * control_offset_x; | ||
+ | threshold_size_y = input_size_y; | ||
+ | threshold_x = control_panel_x + control_offset_x; | ||
+ | threshold_y = control_panel_y + control_offset_x + 0 * (button_size_y + button_spacing_y); // 0 because threshold is the first widget in the control panel | ||
+ | // increase by 1 for every extra widget added | ||
+ | text_output_width = display_width; | ||
+ | text_output_height = display_height / 2; | ||
+ | text_output_x = display_offset_x; | ||
+ | text_output_y = display_offset_y + display_height + display_spacing; | ||
+ | |||
+ | With that done, we can then define a group with all the GUI widgets and add the widgets to this group, one by one. | ||
− | * | + | /* define a group with all the GUI widgets */ |
− | * | + | |
− | * | + | start_protoComponent_GUI = new Fl_Group(0,MENUBAR_HEIGHT,window_width,window_height-MENUBAR_HEIGHT,""); |
− | ** | + | |
− | :( | + | start_protoComponent_GUI->begin(); |
+ | |||
+ | /* ... note: we don't declare heading because it is declared in the guiUtilities library */ | ||
+ | |||
+ | heading = new Fl_Box(heading_x, heading_y, | ||
+ | heading_width,heading_height,"The protoComponentGUI Example" ); | ||
+ | |||
+ | heading->align(FL_ALIGN_INSIDE | FL_ALIGN_CENTER | FL_ALIGN_IMAGE_OVER_TEXT); | ||
+ | heading->labelsize(20); | ||
+ | heading->labelcolor(FL_BLACK); | ||
+ | heading->labelfont(FL_HELVETICA_BOLD); | ||
+ | heading->box(FL_NO_BOX); | ||
+ | heading->image(logo); | ||
+ | |||
+ | /* boxes to frame images ... note: we don't declare box1 or box2 because they are declared in the guiUtilities library */ | ||
+ | |||
+ | box1 = new Fl_Box(display_x1-BORDER,display_y-BORDER, | ||
+ | display_width+2*BORDER,display_height+2*BORDER,"" ); | ||
+ | box1->box(FL_DOWN_BOX); | ||
+ | box1->align(FL_ALIGN_BOTTOM | FL_ALIGN_CENTER); | ||
+ | box1->labelsize(12); | ||
+ | |||
+ | box2 = new Fl_Box(display_x2-BORDER,display_y-BORDER, | ||
+ | display_width+2*BORDER,display_height+2*BORDER,"" ); | ||
+ | box2->box(FL_DOWN_BOX); | ||
+ | box2->align(FL_ALIGN_BOTTOM | FL_ALIGN_CENTER); | ||
+ | box2->labelsize(12); | ||
+ | |||
+ | /* image display ... note: we don't declare display1 or display2 because they declared in the guiUtilities library */ | ||
+ | |||
+ | display1 = new DVdisplay(display_x1, display_y, | ||
+ | display_width,display_height); | ||
+ | |||
+ | display2 = new DVdisplay(display_x2, display_y, | ||
+ | display_width,display_height); | ||
+ | |||
+ | /* box to frame controls */ | ||
+ | |||
+ | Fl_Box *control_panel; | ||
+ | control_panel = new Fl_Box(control_panel_x, control_panel_y, control_panel_width, control_panel_height,"" ); | ||
+ | control_panel->align(FL_ALIGN_TOP | FL_ALIGN_CENTER | FL_ALIGN_INSIDE); | ||
+ | control_panel->labelsize(12); | ||
+ | control_panel->labelfont(FL_HELVETICA_BOLD); | ||
+ | control_panel->box(FL_PLASTIC_DOWN_BOX); | ||
+ | |||
+ | /* threshold slider */ | ||
+ | |||
+ | Fl_Value_Slider *threshold; | ||
+ | threshold = new Fl_Value_Slider(threshold_x, threshold_y, threshold_size_x, threshold_size_y,"Binary Threshold Value"); | ||
+ | threshold->type(FL_HOR_NICE_SLIDER); | ||
+ | threshold->textsize(11); | ||
+ | threshold->callback(valuator_cb, &thresholdValueDouble); // NB valuator_cb() is a general-purpose callback defined in guiUtilities.h | ||
+ | threshold->labelsize(12); // other general-purpose callbacks are defined there too, e.g. radio buttons | ||
+ | threshold->labelfont(FL_HELVETICA_BOLD); // some widgets may require you to write your own callback | ||
+ | threshold->when(FL_WHEN_ENTER_KEY | FL_WHEN_CHANGED | FL_WHEN_RELEASE); | ||
+ | threshold->align(FL_ALIGN_TOP); | ||
+ | threshold->minimum(0); | ||
+ | threshold->maximum(255); | ||
+ | threshold->step(1); | ||
+ | threshold->value((double)*thresholdValue); // initialize the threshold to the value passed as a parameter | ||
+ | threshold->box(FL_PLASTIC_DOWN_BOX); | ||
+ | |||
+ | /* Text output ... note: we don't declare text_output because it is declared in the guiUtilities library */ | ||
+ | |||
+ | text_output = new Fl_Multiline_Output(text_output_x, text_output_y, text_output_width, text_output_height,"" ); | ||
+ | text_output->align(FL_ALIGN_TOP | FL_ALIGN_CENTER ); | ||
+ | text_output->labelsize(12); | ||
+ | text_output->textsize(12); | ||
+ | //text_output->color(FL_GREEN); | ||
+ | text_output->value(""); | ||
+ | //text_output->box(FL_THIN_DOWN_FRAME); // matches the image display frames | ||
+ | text_output->box(FL_PLASTIC_DOWN_BOX); // rounded edges for something more visually appealing | ||
+ | |||
+ | start_protoComponent_GUI->end(); // end of the group | ||
+ | |||
+ | Now we are in a position to actually create the GUI. We do this by instantiating a window class <code>Fl_Double_Window</code>, position it, enable double buffering to make images in video sequences transition smoothly, display the window, add the group of GUI widgets, and then redraw the window. We call the ''FLTK'' function <code>Fl::check();</code> to display the window. | ||
+ | // create main window | ||
+ | |||
+ | DVwindow = new Fl_Double_Window(window_width-border_width,window_height-border_height,"The protoComponentGUI Example"); | ||
+ | DVwindow->position(0,0); | ||
+ | |||
+ | Fl::visual(FL_DOUBLE|FL_INDEX); // enable double buffering of the window | ||
+ | |||
+ | DVwindow->end(); | ||
+ | DVwindow->show(); | ||
+ | |||
+ | // add the GUI | ||
+ | |||
+ | DVwindow->add(start_protoComponent_GUI); | ||
+ | DVwindow->redraw(); | ||
+ | Fl::check(); | ||
+ | |||
+ | We can now interact with the widgets. First we display some text in the <code>text_output</code> widget using the <code>message()</code> function. This function is one of the utilities that is provided by the ''guiUtilities'' library. | ||
− | + | Having done that, we are done with the GUI definition. We now revert to the normal YARP thread loop. Notice however, that we include two ''FLTK'' method calls inside this loop, one to redraw the window and one the tell ''FLTK'' that the window has been re-drawn and needs to be redisplayed. | |
− | + | /* write some text in the window ... */ | |
− | + | /* note that function message() is defined in guiUtilities as a general-purpose routine to write */ | |
− | + | /* to the predefined display widget text_output ... notice how we didn't declare text_output above */ | |
− | + | /* we didn't have to because it is declared in guiUtilities */ | |
− | + | ||
− | + | ||
− | + | ||
− | + | message("Waiting to start .... image statistics will be displayed here"); | |
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | |||
− | + | /*************************************************************************************/ | |
+ | /* This is where the definition of the GUI ends and the normal run() loop begins */ | ||
+ | /*************************************************************************************/ | ||
+ | |||
+ | while (isStopping() != true) { // the thread continues to run until isStopping() returns true | ||
+ | |||
+ | DVwindow->redraw(); | ||
+ | |||
+ | Fl::check(); // refresh the GUI .... we do it this way rather than calling Fl::run() as we nomally would | ||
+ | // because we do not want to cede control to the event loop | ||
− | + | Further down this loop we have occasion to interact with the ''FLTK'' widgets, e.g. to read an image from a port, copy it to the local format suitable for display, and then display it. | |
− | + | ||
− | + | /*** read colour image ... do not block if image is not received ***/ | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | rgbYARPImage = colourImagePortIn->read(false); | |
− | + | ||
+ | if (rgbYARPImage != NULL) { | ||
+ | |||
+ | rgb_width = rgbYARPImage->width(); | ||
+ | rgb_height = rgbYARPImage->height(); | ||
+ | rgb_depth = 3; | ||
+ | |||
+ | if (debug) printf("protoComponentGUI: rgb width = %d, rgb height = %d, rgb depth = %d\n",rgb_width, rgb_height, rgb_depth); | ||
− | + | if (rgbDVImage == NULL) { | |
− | + | rgbDVImage = new DVimage(rgb_width, rgb_height, rgb_depth); | |
− | + | } | |
− | + | ||
− | + | ||
+ | /* now copy the image to local format */ | ||
− | + | for (x = 0; x < rgb_width; x++) { | |
+ | for (y = 0; y < rgb_height; y++) { | ||
+ | rgbPixel = rgbYARPImage->safePixel(x,y); | ||
+ | rgbDVImage->put_pixel(x, y, rgbPixel.r, 0); | ||
+ | rgbDVImage->put_pixel(x, y, rgbPixel.g, 1); | ||
+ | rgbDVImage->put_pixel(x, y, rgbPixel.b, 2); | ||
+ | } | ||
+ | } | ||
+ | |||
+ | display1->draw(rgbDVImage); | ||
+ | } | ||
+ | else { | ||
+ | if (debug) printf("protoComponentGUI: colour image not received\n"); | ||
+ | } | ||
− | + | We also read the image statistics from another port, process them, and then display them in a text box. | |
+ | |||
+ | /* read the image statistics ... do not block if bottle is not received*/ | ||
+ | |||
+ | statisticsMessage = statisticsPortIn->read(false); | ||
+ | |||
+ | if (statisticsMessage != NULL) { | ||
+ | |||
+ | /* for some strange reason, YARP puts double quotes around every individual string in a bottle so we strip them here */ | ||
+ | |||
+ | j=0; | ||
+ | for (i=0; i<min(STRINGLENGTH-1,(int)strlen(statisticsMessage->toString().c_str()));i++) { | ||
+ | if (statisticsMessage->toString().c_str()[i]!='\"') { | ||
+ | modifiedString[j] = statisticsMessage->toString().c_str()[i]; | ||
+ | j++; | ||
+ | } | ||
+ | } | ||
+ | modifiedString[j]='\0'; | ||
+ | |||
+ | |||
+ | /* now copy the message to the display */ | ||
+ | |||
+ | message(modifiedString); | ||
+ | if (debug) cout << "protoComponentGUIThread: statistics message is " << modifiedString << endl; | ||
+ | } | ||
+ | else { | ||
+ | if (debug) printf("protoComponentGUI: statistics not received\n"); | ||
+ | } | ||
− | + | Finally, we can use the threshold value set by the ''FLTK'' valuator and send it on a port (to <code>protoComponent</code>). | |
+ | |||
+ | /*** write the threshold ***/ | ||
+ | |||
+ | VectorOf<int> &thresholdVector = thresholdPortOut->prepare(); | ||
+ | thresholdVector.resize(1); | ||
+ | thresholdVector(0) = *thresholdValue; | ||
+ | |||
+ | thresholdPortOut->write(); | ||
− | + | == Test Applications == | |
− | + | As we noted at the outset, in a Component-Based Software Engineering (CBSE) project, such as CINDY, the source code application file is replaced by the application script file or application XML file that runs the various components and connects them together in a working system. Thus, CINDY applications, i.e. collections of inter-connected YARP modules, are described in XML and launched using a utility called ''gyarpmanager''. Refer to the [[Software Users Guide]] for more details on how to run these application descriptions. | |
− | + | In this section, we provide two test applications. | |
− | + | ||
− | + | The first test application shows how to configure and run a simple application to use the <code>protoComponent</code> by connecting it to other components that provide input images and display the output images. This application uses <code>yarpview</code> modules to view the images. The threshold is modified online by sending commands to <code>protoComponent</code> from the command line in a terminal window. | |
− | + | The second test application shows how to configure and run a simple application to use <code> protoComponent</code> and <code> protoComponentGUI</code> together. In this case, the images are displayed in the GUI rather than <code>yarpview</code> displays and the threshold is modified interactively using the GUI controls. | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
+ | Both applications have some some command-line parameters for illustration. Remember that these command-line parameter values have priority over the same parameter values specified in the relevant configuration file, which in turn have priority over the default values provided in the source code. | ||
<application> | <application> | ||
− | + | <name>Demo of protoComponent</name> | |
− | <name> | + | |
<dependencies> | <dependencies> | ||
<port>/robot/cam/left</port> | <port>/robot/cam/left</port> | ||
− | </dependencies> | + | </dependencies> |
<module> | <module> | ||
− | <name> | + | <name>protoComponent</name> |
− | <parameters>-- | + | <parameters>--context components/protoComponent/config </parameters> |
− | <node> | + | <node>cindy1</node> |
− | <tag> | + | <tag>protoComponent</tag> |
− | </module> | + | </module> |
+ | |||
+ | <module> | ||
+ | <name>imageSource</name> | ||
+ | <parameters>--context components/imageSource/config</parameters> | ||
+ | <node>cindy1</node> | ||
+ | <tag>imageSource</tag> | ||
+ | </module> | ||
<module> | <module> | ||
<name>yarpview</name> | <name>yarpview</name> | ||
− | <parameters>--name / | + | <parameters>--name /inputImage --x 000 --y 000 --w 320 --h 318 </parameters> |
− | + | <node>cindy1</node> | |
− | <tag> | + | <tag>input_image</tag> |
− | </module> | + | </module> |
<module> | <module> | ||
<name>yarpview</name> | <name>yarpview</name> | ||
− | <parameters>--name /binaryImage --x | + | <parameters>--name /binaryImage --x 320 --y 000 --w 320 --h 318 </parameters> |
− | <node> | + | <node>cindy1</node> |
− | <tag> | + | <tag>plot_image</tag> |
− | </module> | + | </module> |
<connection> | <connection> | ||
<from>/robot/cam/left</from> | <from>/robot/cam/left</from> | ||
− | <to>/ | + | <to>/inputImage</to> |
<protocol>tcp</protocol> | <protocol>tcp</protocol> | ||
</connection> | </connection> | ||
Line 870: | Line 1,449: | ||
<connection> | <connection> | ||
<from>/robot/cam/left</from> | <from>/robot/cam/left</from> | ||
− | <to>/ | + | <to>/protoComponent/image:i</to> |
<protocol>tcp</protocol> | <protocol>tcp</protocol> | ||
− | </connection> | + | </connection> |
<connection> | <connection> | ||
− | <from>/ | + | <from>/protoComponent/image:o</from> |
<to>/binaryImage</to> | <to>/binaryImage</to> | ||
<protocol>tcp</protocol> | <protocol>tcp</protocol> | ||
− | </connection> | + | </connection> |
</application> | </application> | ||
− | |||
− | + | <application> | |
− | + | <name>Demo of protoComponentGUI</name> | |
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | ||
− | + | <dependencies> | |
− | + | <port>/robot/cam/left</port> | |
− | + | </dependencies> | |
− | + | <module> | |
− | + | <name>protoComponentGUI</name> | |
− | + | <parameters>--context components/protoComponentGUI/config </parameters> | |
− | + | <node>cindy1</node> | |
− | + | <tag>protoComponentGUI</tag> | |
− | + | </module> | |
− | + | ||
− | + | ||
− | + | ||
− | + | <module> | |
− | + | <name>protoComponent</name> | |
− | + | <parameters>--context components/protoComponent/config </parameters> | |
− | + | <node>cindy1</node> | |
− | + | <tag>protoComponent</tag> | |
− | + | </module> | |
− | + | ||
− | + | <module> | |
− | + | <name>imageSource</name> | |
− | + | <parameters>--context components/imageSource/config --width 640 --height 480 </parameters> | |
− | + | <node>cindy1</node> | |
− | + | <tag>imageSource</tag> | |
− | + | </module> | |
− | + | ||
− | + | <connection> | |
− | + | <from>/robot/cam/left</from> | |
− | + | <to>/protoComponent/image:i</to> | |
− | + | <protocol>tcp</protocol> | |
− | + | </connection> | |
− | + | ||
− | + | <connection> | |
− | + | <from>/protoComponent/image:o</from> | |
− | + | <to>/protoComponentGUI/binaryimage:i</to> | |
− | + | <protocol>tcp</protocol> | |
− | + | </connection> | |
− | + | ||
+ | <connection> | ||
+ | <from>/protoComponent/statistics:o</from> | ||
+ | <to>/protoComponentGUI/statistics:i</to> | ||
+ | <protocol>tcp</protocol> | ||
+ | </connection> | ||
+ | |||
+ | <connection> | ||
+ | <from>/robot/cam/left</from> | ||
+ | <to>/protoComponentGUI/colourimage:i</to> | ||
+ | <protocol>tcp</protocol> | ||
+ | </connection> | ||
+ | |||
+ | <connection> | ||
+ | <from>/protoComponentGUI/threshold:o</from> | ||
+ | <to>/protoComponent/threshold:i</to> | ||
+ | <protocol>tcp</protocol> | ||
+ | </connection> | ||
+ | |||
+ | </application> | ||
− | + | To run the application, follow the instruction in the [[Software Users Guide]]. | |
− | + | == Software Engineering Standards == | |
− | + | Finally, note that CINDY follows a set of recommended software engineering standardi, as follows. | |
− | * [ | + | * [[Standards for File Organization]] |
+ | * [[Standards for Internal Documentation]] | ||
+ | * [[Standards for Component Functionality]] | ||
+ | <!-- * [[Standards for Testing]]--> | ||
+ | * [[Standards for Programming Style]] | ||
+ | * [[Standards for Programming Practice]] | ||
− | + | Please take the time to read through these documents. | |
− | |||
− | + | ---- | |
+ | Return to [[The CINDY Cognitive Architecture]] main page. |
Latest revision as of 03:19, 17 February 2015
Contents
- 1 Overview
- 2 Component Configuration and Coordination: The RFModule Class
- 2.1 Instantiating a Derived Sub-Class of RFModule, Configuring the Resource Finder, and Running the Module
- 2.2 Configuration: Overriding the yarp::os::RFModule::configure() method
- 2.3 Run-time Interaction
- 2.4 An Example of how to Configure the Component
- 2.5 Doing Some Work: Instantiating and starting the protoComponentThread
- 2.6 Graceful Shut-down
- 3 Component Computation and Communication: the Thread and RateThread Classes
- 4 GUI Component Computation and Communication: the FLTK and guiUtilities Libraries
- 5 Test Applications
- 6 Software Engineering Standards
Overview
This guide describes two examples of what is involved when developing a YARP-based component that is compliant with recommended standards for software engineering.
The first example, protoComponent
, implements some very simple image processing and analysis (binary segmentation using a supplied threshold and then count the number of foreground pixels).
The second example, protoComponentGUI
, explains how to write a component that implements a simple graphic use interface. In this case, the GUI allows the user to set the threshold with a slider widget and then sends the threshold to protoComponent
. It receives some statistics from protoComponent
, specifically the number of foreground pixels and the current time, and writes them to a text display. It also receives the binary image from protoComponent
and displays it along with the original colour image that it receives from the source that also feeds protoComponent
.
Both examples are accompanied by a test application, again adhering to the recommended standards.
File Organization
As noted in the Mandatory Standards for File Organization, the implementation of a typical CINDY component comprises four files. These are the interface file and three implementation files:
- The interface file is a header file, e.g.
protoComponent.h
, with the class declarations, method prototype declarations, and function prototype declarations, but no method or function implementations. It also contains the Doxygen documentation comments explaining the purpose and usage of the component (see Mandatory Standards for Internal Documentation). - The implementation files contains the source code for the implementation of each class method (C++) or the source code of each function (C). For convenience, the implementation is separated in three files:
- The first source code file — e.g.
protoComponentMain.cpp
— contains themain()
function that instantiates the module object and calls therunModule
method to effect the configuration, coordination, computation, and communication for that component. - The second source code file — e.g.
protoComponentConfiguration.cpp
— contains the code that handles the component’s configuration and coordination functionality. - The third source code file — e.g.
protoComponentComputation.cpp
— contains the code that handles the component’s computation and communication functionality.
Therefore, the four protoComponent
files are:
protoComponent.h protoComponentMain.cpp protoComponentConfiguration.cpp protoComponentComputation.cpp
and the four protoComponentGUI
files are:
protoComponentGUI.h protoComponentGUIMain.cpp protoComponentGUIConfiguration.cpp protoComponentGUIComputation.cpp
All of these files should be placed in the src
directory.
Note that in a Component-Based Software Engineering (CBSE) project, such as CINDY, the source code application file is replaced by the application script file or application XML file that runs the various components and connects them together in a working system (see #Application Description).
Example Code
All the code for these examples is available in the CINDY software repository. For convenience, you can also review the code here:
-
protoComponent
source code -
protoComponentTEST.xml
application -
protoComponentGUI
source code -
protoComponentGUITEST.xml
application
How This Guide Is Organized
There are four main parts to this guide, in addition to this overview, some focussing on the protoComponent
example and others on the protoComponentGUI
example.
Component Configuration and Coordination: the RFModule
Class
We begin with the functionality associated with configuration and coordination, i.e. with the protoComponentConfiguration.cpp
and protoComponent.h
files. This functionality revolves around the RFModule
class. The protoComponentGUIConfiguration.cpp
and protoComponentGUI.h
files have essentially the same structure.
This section also deals with the main()
function, i.e. with the protoComponentApplication.cpp
file. It shows how to instantiate a module derived from the RFModule
class, set the default configuration file and path for the resource finder, and run the module. This allows the component to be configured using the resource finder.
Once this is done, the derived module then instantiates a Thread
or a RateThread
object and launches it, passing to it as arguments all the relevant resources (e.g. port names and parameter values) located by the resource finder.
Finally, it is also responsible for shutting down the thread gracefully by stopping the thread, interrupting any port communications, and closing the ports.
Component Computation and Communication: the Thread
and RateThread
Classes
We then address the functionality associated with computation and communication, i.e. with the protoComponentComputation.cpp
and protoComponent.h
files. This functionality revolves around the Thread
and RateThread
classes: how to access the parameters passed to it from the derived RFModule
object and how to perform some useful work.
GUI Component Computation and Communication: the FLTK
and guiUtilities
Libraries
We now show how you can write your own graphic user interface for the protoComponent
component. This will be implemented as a separate stand-along component protoComponentGUI
. As noted above, the functionality associated with configuration and coordination, i.e. with the protoComponentGUIConfiguration.cpp
and protoComponentGUI.h
files, is essentially the same as for the protoComponent
example. Again, this functionality revolves around the RFModule
class.
Instead, this section addresses the functionality associated with computation and communication, i.e. with the protoComponentGUIComputation.cpp
and protoComponent.h
files. Again, the functionality revolves around the Thread
and RateThread
classes but here we explain how to configure the graphic user interface with the FLTK and guiUtilities libraries.
Test Applications
This section describes two test applications.
The first test application shows how to configure and run a simple application to use the protoComponent
by connecting it to other components that provide input images and display the output images. This application uses yarpview
modules to view the images. The threshold is modified online by sending commands to protoComponent
from the command line in a terminal window.
The second test application shows how to configure and run a simple application to use protoComponent
and protoComponentGUI
together. In this case, the images are displayed in the GUI rather than yarpview
displays and the threshold is modified interactively using the GUI controls.
Component Configuration and Coordination: The RFModule
Class
The starting point in writing any CINDY component is to develop a sub-class of the yarp::os::RFModule class.
First, we define a sub-class, or derived class, of the yarp::os::RFModule
class. The module's variables - and specifically the module's parameters and ports - go in the private data members part and you need to override three methods:
-
bool configure();
-
bool interruptModule();
-
bool close();
We will see later that there are three other methods which can be useful to override:
-
bool respond();
-
double getPeriod();
-
bool updateModule();
In the following, we assume we are writing a module named protoComponent
. This module will be implemented as a sub-class yarp::os::RFModule called ProtoComponent
(it is a capital P because it is a sub-class). For convenience, the header comments have been removed.
/** @file protoComponent.h Interface file for the example CINDY component */ #include <iostream> #include <string> #include <yarp/sig/all.h> #include <yarp/os/all.h> #include <yarp/os/RFModule.h> #include <yarp/os/Network.h> #include <yarp/os/Thread.h> using namespace std; using namespace yarp::os; using namespace yarp::sig; class ProtoComponentThread : public Thread { private: /* class variables */ bool debug; int x, y; PixelRgb rgbPixel; ImageOf<PixelRgb> *image; int *thresholdValue; VectorOf<int> *thresholdVector; int numberOfForegroundPixels; /* thread parameters: they are pointers so that they refer to the original variables in protoComponent */ BufferedPort<ImageOf<PixelRgb> > *imagePortIn; BufferedPort<VectorOf<int> > *thresholdPortIn; BufferedPort<ImageOf<PixelRgb> > *imagePortOut; BufferedPort<Bottle> *statisticsPortOut; public: /* class methods */ ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, BufferedPort<VectorOf<int> > *thresholdIn, BufferedPort<ImageOf<PixelRgb> > *imageOut, BufferedPort<Bottle> *statisticsOut, int *threshold ); bool threadInit(); void threadRelease(); void run(); }; class ProtoComponent:public RFModule { /* module parameters */ string moduleName; string imageInputPortName; string thresholdInputPortName; string imageOutputPortName; string statisticsOutputPortName; string handlerPortName; string cameraConfigFilename; float fxLeft, fyLeft; // focal length float fxRight, fyRight; // focal length float cxLeft, cyLeft; // coordinates of the principal point float cxRight, cyRight; // coordinates of the principal point int thresholdValue; /* class variables */ BufferedPort<ImageOf<PixelRgb> > imageIn; // example image input port BufferedPort<VectorOf<int> > thresholdIn; // example vector input port BufferedPort<ImageOf<PixelRgb> > imageOut; // example image output port BufferedPort<Bottle> statisticsOut; // example bottle output port Port handlerPort; // a port to handle interactive messages (also uses bottles) /* pointer to a new thread to be created and started in configure() and stopped in close() */ ProtoComponentThread *protoComponentThread; public: bool configure(yarp::os::ResourceFinder &rf); // configure all the module parameters and return true if successful bool interruptModule(); // interrupt, e.g., the ports bool close(); // close and shut down the module bool respond(const Bottle& command, Bottle& reply); double getPeriod(); bool updateModule(); };
Here we deal with the various issues of implementing the module, particularly configuration of the component from external parameters and files, and run-time interaction.
The actual work to be done by the component is accomplished by another sub-class of a Thread
class. The definition of this sub-class is also included in the interface header file, e.g. protoComponent.h
but the implementation is effected in a separate source file, e.g. protoComponentComputation.cpp
.
Perhaps the trickiest part of writing the software to implement a component is understanding the way that the RFModule
and Thread
share the work between them and how they interact. That's exactly what we will explain in to following, once we have covered how the RFModule
object handles all the configuration and coordination functionality.
First, some clarification. By configuration we mean the ability to specify the way that a given component is used. There are two aspects to this:
- How the component is presented (i.e. which particular interfaces are used: the names of ports used, the name of the configuration file, the path to the configuration file, the name of the component, and the name of the robot) and
- The component parameters that govern its behaviour (e.g. thresholds, set-points, and data files)
We refer to these collectively as resources. Typically, the configuration file name, the configuration file path (called the context), the component name, and the robot name are specified as command-line parameters, while all the remaining resources, including the names of the ports, are typically specified in the configuration file.
Note that all resources are handled the same way using the ResourceFinder which not only greatly simplifies the process of finding the resources but also simplifies the process of parsing them.
It's worth noting that parameters that are specified in the configuration file can also be specified in the command-line if you wish. The reverse is also true, with some restrictions (e.g. it only makes sense to specify the configuration file and the configuration file path on the command-line). Finally, modules should be written so that default values are provided for all resources so that the module can be launched without any parameters. Again, the ResourceFinder makes it easy to arrange this.
Right now, what's important to grasp is that all these configuration issues are implemented by
- Instantiating your component as a derived sub-class of
RFModule
in themain()
function (e.g. inprotoComponentMain.cpp
),
- Preparing the ResourceFinder in the
main()
function by setting the default configuration file and its path,
- Overriding the
yarp::os::RFModule::configure()
method (e.g. inprotoComponentConfiguration.cpp
) to parse all the parameters from the command-line and the configuration file.
- Launching your component by calling the
yarp::os::RFModule::runModule()
method frommain()
,
The following sections explain the implementation details of each aspect of this set-up and configuration.
Instantiating a Derived Sub-Class of RFModule
, Configuring the Resource Finder, and Running the Module
The main()
function in the protoComponentMain.cpp
file is responsible for instantiating a module derived from the RFModule
class, setting the default configuration file and path for the resource finder, and running the module. This allows the component to be configured using the resource finder (something that is actually accomplished by the code in protoComponentConfiguration.cpp
).
/* protoComponentMain.cpp Application file for the example CINDY component */ int main(int argc, char * argv[]) { /* initialize yarp network */ Network yarp; /* create your module */ ProtoComponent protoComponent; /* prepare and configure the resource finder */ ResourceFinder rf; rf.setVerbose(true); rf.setDefaultConfigFile("protoComponent.ini"); // can be overridden by --from parameter rf.setDefaultContext("protoComponent/configuration"); // can be overridden by --context parameter rf.configure("CINDY_ROOT", argc, argv); // environment variable with root of configuration path /* run the module: runModule() calls configure first and, if successful, it then runs */ protoComponent.runModule(rf); return 0; }
There are a few important points to notice in the code above.
- Initialization of the configuration file in the resource finder object
- Initialization of the path to the configuration file in the resource finder object
- Initialization of the environmental variable that defines the root of the configuration path in the resource finder object
- The
runModule
method is called to launch the module and do the configuration using the resource finder object passed as an argument
The first two require some additional explanation which we provide next.
Configuration File
Configuration can be changed by changing configuration files. The configuration file which the component reads can be specified as a command line option.
--from protoComponent.ini
The component should set a default configuration file using yarp::os::ResourceFinder::setDefaultConfigFile("protoComponent.ini")
. This should be done in the main()
function before running the module.
The value set by this method is overridden by the --from
parameter (specified either during the command-line invocation or in the component configuration file; the command-line has priority over the configuration file if both are specified).
The .ini file should usually be placed in the $CINDY_ROOT/release/components/protoComponent/config
sub-directory.
Context
The relative path from $CINDY_ROOT/release
to the directory containing the configuration file is specified from the command line by
--context components/protoComponent/config
The module should set a default context using yarp::os::ResourceFinder::setDefaultContext("components/protoComponent/config")
.
This should be done in the main()
function in protoComponentMain.cpp
before launching the component.
This is overridden by the --context
parameter (again, specified either during the command-line invocation or in the component configuration file; the command-line has priority over the configuration file if both are specified).
Configuration: Overriding the yarp::os::RFModule::configure()
method
The method that overrides yarp::os::RFModule::configure()
is defined in protoComponentConfiguration.cpp
. It uses the resource finder to parse all the parameters from the command-line and the configuration file and assign values appropriately.
The key thing to keep in mind here is that it must be possible to externally reconfigure how the component interfaces with other components without having to modify any source code. This is why so much information is required when starting up the component and why the resource finder is so useful and important.
Module Name and Port Names
You should ensure that it is possible to specify the names of any ports created by a module via configuration. There are two aspects to this: the stem of the port name and the port name itself.
A command-line option of
--name altName
sets the name of the module and will cause the module to use "/altName" as a stem for all port names provided the port names are generated using the yarp::os::RFModule::getName()
method. Note that he leading "/" prefix has to be added explicitly to the module name to create the port name.
The module should set a default name (and, hence, a default stem) using yarp::os::RFModule::setName("protoComponent")
.
This is overridden by the --name
parameter but you must check for this parameter and call setName()
accordingly, e.g.
string moduleName; moduleName = rf.check("name", Value("protoComponent"), "module name (string)").asString(); setName(moduleName.c_str()); // do this before processing any port name parameters
The port names should be specified as parameters, typically as key-value pairs in the .ini
configuration file, e.g.
imageInputPort /image:i imageOutputPort /image:o
These key-value pairs can also be specified as command-line parameters, viz:
--imageInputPort /image:i --imageOutputPort /image:o
The component should set a default port name using the ResourceFinder, e.g using yarp::os::ResourceFinder::check();
For example
string inputPortName = "/"; inputPortName += getName( rf.check("imageInputPort", Value("/image:i"), "Input image port (string)").asString() );
will assign to inputPortName
the value /altName/image:i
if --name altName
is specified as a parameter. Otherwise, it would assign /protoComponent/image:i
On the other hand, it would assign /protoComponent/altImage:i
if the key-value pair myInputPort /altImage:i
was specified (either in the .ini
file or as a command-line parameter) but not the --name altName
When providing the names of ports as parameter values (whether as a default value in ResourceFinder::check
, as a value in the key-value list in the .ini
configuration file, or as a command line argument), you always include the leading /
.
All this code goes in the configure()
method in protoComponentConfiguration.cpp
.
Which Parameters Are Parsed Automatically?
Parsing the --from
and --context
parameters is handled automatically by the RFModule
but --name
and --robot
must be handled explicitly.
As noted above, you would handle the --name
parameter by using ResourcFinder::check()
to parse it and get the parameter value, then user setName()
to set it. You should do this before proceeding to process any port name parameters, otherwise the wrong stem will be used when constructing the port names from the parameter values.
Configuration File Parameters
The configuration file, typically named protoComponent.ini
and located in the $CINDY_ROOT/release/components/protoComponent/config
directory, contains a key-value list: a list of pairs of keywords (configuration parameter names) and values (configuration parameter values), e.g.
imageInputPort /altImage:i imageOutputPort /altImage:o threshold 9 ...
These parameters are parsed using the ResourceFinder
within an RFModule
object (i.e. by methods inherited by your module such as
yarp::os::Searchable::check()
).
Typically, key-value pairs specify the parameters and their values that govern the behaviour of the module, as well as the names of the module ports, should you wish to rename them.
Other Configuration Files
Apart from processing the parameters in the configuration file protoComponent.ini
, it's often necessary to access configuration
data in other files. For example, you might want to read the intrinsic camera parameters from a camera calibration file.
Let's assume this configuration file is called cameras.ini
and we wish to extract the principal points of the left and right cameras. The coordinates of the principle points, and other intrinsic camera parameters, are stored as a sequence of key-value pairs:
cx 157.858 cy 113.51
Matters are somewhat complicated by the fact that we need to read two sets of coordinates, one for the left camera and one for the right. Both sets have the same key associated with them so the left and right camera parameters, including the principal point coordinates, are typically listed under different group headings, viz.
[CAMERA_CALIBRATION_RIGHT] ... cx 157.858 cy 113.51 ... [CAMERA_CALIBRATION_LEFT] ... cx 174.222 cy 141.757 ...
So, to read these two pairs of coordinates, we need to
- find the name of the file (e.g.
cameras.ini
) - locate the file (i.e. get its full path)
- open the file and read its content
- find the
CAMERA_CALIBRATION_RIGHT
andCAMERA_CALIBRATION_LEFT
groups - read the respective
cx
andcy
key values.
All of this is accomplished straightforwardly with the ResourceFinder
and Property
classes.
The first step is to get the name of the configuration file. This will typically be one of the key-value pairs in the module
configuration file protoComponent.ini
, e.g.
cameraConfig cameras.ini
so that it can be read in exactly the same way as the other parameters in the previous section, e.g. using yarp::os::Searchable::check()
.
The full path can then be determined by the yarp::os::ResourceFinder::findFile()
method.
The contents of this file can then be read into a Property
object using the yarp:os:Property::fromConfigFile()
method.
Locating the required group (e.g. CAMERA_CALIBRATION_LEFT
) is accomplished with the yarp: os:Property::findGroup()
method.
This method returns a Bottle
with the full key-value list under this group. This list can then be searched for the required key and value using the yarp::os::Searchable::check()
method, as before.
Run-time Interaction
The respond()
Method
Often, it is very useful for a user or another module to send commands to control the behaviour of the module, e.g. interactively changing parameter values.
We accomplish this functionality for the yarp::os::RFModule
by overridding the yarp::os::RFModule::respond()
method which can then be configured to receive messages from either a port (typically named /protoComponent
) or the terminal. This is effected by the yarp::os::RFModule::attach(port)
and yarp::os::RFModule::attachTerminal()
methods, respectively. Attaching both the port and the terminal means that commands from both sources are then handled in the same way.
An example of how to change module parameters at run-time
In the following example, we handle three commands:
- help
- quit
- set thr <n> ... set the threshold (where <n> is an integer number)
Apart from the way that the commands are parsed and the form of the reply, the key thing to note here is the fact that the value of ProtoComponent::thresholdValue
is updated. Since protoComponent
references this variable, it too is updated and the updated value is used in the thread.
bool ProtoComponent::respond(const Bottle& command, Bottle& reply) { string helpMessage = string(getName().c_str()) + " commands are: \n" + "help \n" + "quit \n" + "set thr <n> ... set the threshold \n" + "(where <n> is an integer number) \n"; reply.clear(); if (command.get(0).asString()=="quit") { reply.addString("quitting"); return false; } else if (command.get(0).asString()=="help") { cout << helpMessage; reply.addString("command is: set thr <n>"); } else if (command.get(0).asString()=="set") { if (command.get(1).asString()=="thr") { thresholdValue = command.get(2).asInt(); // set parameter value reply.addString("ok"); } } return true; }
However, for any of this to work, we have to set up a port in the first place. We put the port declaration in the private data member part of ProtoComponent
class
string handlerPortName; ... Port handlerPort; // a port to handle interactive messages (also uses bottles)
and open it in the configure()
method, viz.
/* * attach a port of the same name as the module (prefixed with a /) to the module * so that messages received from the port are redirected to the respond method */ handlerPortName = "/"; handlerPortName += getName(); // use getName() rather than a literal if (!handlerPort.open(handlerPortName.c_str())) { cout << getName() << ": Unable to open port " << handlerPortName << endl; return false; } attach(handlerPort); // attach to port
Interrupt it in the interrupt()
method, viz.
handlerPort.interrupt();
Close it in the close()
method, viz.
handlerPort.close();
Remote Connection
Note that the handlerport
can be used not only by other modules but also interactively by a user through the yarp rpc
directive, viz.:
yarp rpc /protoComponent
This opens a connection from a terminal to the port and allows the user to then type in commands and receive replies from the respond()
method.
An Example of how to Configure the Component
The following example summarizes how to handle all the configuration issues discussed above. This is taken directly from the protoComponent
source code.
/** @file protoComponent.h Interface file for the example CINDY component */ #include <iostream> #include <string> #include <yarp/sig/all.h> #include <yarp/os/all.h> #include <yarp/os/RFModule.h> #include <yarp/os/Network.h> #include <yarp/os/Thread.h> using namespace std; using namespace yarp::os; using namespace yarp::sig; class ProtoComponentThread : public Thread { private: /* class variables */ bool debug; int x, y; PixelRgb rgbPixel; ImageOf<PixelRgb> *image; int *thresholdValue; VectorOf<int> *thresholdVector; int numberOfForegroundPixels; /* thread parameters: they are pointers so that they refer to the original variables in protoComponent */ BufferedPort<ImageOf<PixelRgb> > *imagePortIn; BufferedPort<VectorOf<int> > *thresholdPortIn; BufferedPort<ImageOf<PixelRgb> > *imagePortOut; BufferedPort<Bottle> *statisticsPortOut; public: /* class methods */ ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, BufferedPort<VectorOf<int> > *thresholdIn, BufferedPort<ImageOf<PixelRgb> > *imageOut, BufferedPort<Bottle> *statisticsOut, int *threshold ); bool threadInit(); void threadRelease(); void run(); }; class ProtoComponent:public RFModule { /* module parameters */ string moduleName; string imageInputPortName; string thresholdInputPortName; string imageOutputPortName; string statisticsOutputPortName; string handlerPortName; string cameraConfigFilename; float fxLeft, fyLeft; // focal length float fxRight, fyRight; // focal length float cxLeft, cyLeft; // coordinates of the principal point float cxRight, cyRight; // coordinates of the principal point int thresholdValue; /* class variables */ BufferedPort<ImageOf<PixelRgb> > imageIn; // example image input port BufferedPort<VectorOf<int> > thresholdIn; // example vector input port BufferedPort<ImageOf<PixelRgb> > imageOut; // example image output port BufferedPort<Bottle> statisticsOut; // example bottle output port Port handlerPort; // a port to handle interactive messages (also uses bottles) /* pointer to a new thread to be created and started in configure() and stopped in close() */ ProtoComponentThread *protoComponentThread; public: bool configure(yarp::os::ResourceFinder &rf); // configure all the module parameters and return true if successful bool interruptModule(); // interrupt, e.g., the ports bool close(); // close and shut down the module bool respond(const Bottle& command, Bottle& reply); double getPeriod(); bool updateModule(); };
/* protoComponentConfiguration.cpp Implementation file for the example CINDY component */ /* * Configure method ... use it to do component coordination, * i.e. to configure your component at runtime */ bool ProtoComponent::configure(yarp::os::ResourceFinder &rf) { /* Process all parameters from both command-line and .ini file */ /* get the module name which will form the stem of all module port names */ moduleName = rf.check("name", Value("protoComponent"), "module name (string)").asString(); /* * before continuing, set the module name before getting any other parameters, * specifically the port names which are dependent on the module name */ setName(moduleName.c_str()); /* now, get the rest of the parameters */ /* get the name of the input and output ports, automatically prefixing the module name by using getName() */ imageInputPortName = "/"; imageInputPortName += getName( rf.check("imageInputPort", Value("/image:i"), "Input image port (string)").asString() ); thresholdInputPortName = "/"; thresholdInputPortName += getName( rf.check("thresholdInputPort", Value("/threshold:i"), "Threshold input port (string)").asString() ); imageOutputPortName = "/"; imageOutputPortName += getName( rf.check("imageOutputPort", Value("/image:o"), "Output image port (string)").asString() ); statisticsOutputPortName = "/"; statisticsOutputPortName += getName( rf.check("statisticsOutputPort", Value("/statistics:o"), "Output image port (string)").asString() ); /* get the threshold value */ thresholdValue = rf.check("threshold", Value(8), "Key value (int)").asInt(); /* * get the cameraConfig file and read the required parameter values cx, cy * in both the groups [CAMERA_CALIBRATION_LEFT] and [CAMERA_CALIBRATION_RIGHT] */ cameraConfigFilename = rf.check("cameraConfig", Value("cameras.ini"), "camera configuration filename (string)").asString(); cameraConfigFilename = (rf.findFile(cameraConfigFilename.c_str())).c_str(); Property cameraProperties; if (cameraProperties.fromConfigFile(cameraConfigFilename.c_str()) == false) { cout << "protoComponent: unable to read camera configuration file" << cameraConfigFilename << endl; return 0; } else { cxLeft = (float) cameraProperties.findGroup("CAMERA_CALIBRATION_LEFT").check("cx", Value(160.0), "cx left").asDouble(); cyLeft = (float) cameraProperties.findGroup("CAMERA_CALIBRATION_LEFT").check("cy", Value(120.0), "cy left").asDouble(); cxRight = (float) cameraProperties.findGroup("CAMERA_CALIBRATION_RIGHT").check("cx", Value(160.0), "cx right").asDouble(); cyRight = (float) cameraProperties.findGroup("CAMERA_CALIBRATION_RIGHT").check("cy", Value(120.0), "cy right").asDouble(); } /* do all initialization here */ /* open ports */ if (!imageIn.open(imageInputPortName.c_str())) { cout << getName() << ": unable to open port " << imageInputPortName << endl; return false; // unable to open; let RFModule know so that it won't run } if (!thresholdIn.open(thresholdInputPortName.c_str())) { cout << getName() << ": unable to open port " << thresholdInputPortName << endl; return false; // unable to open; let RFModule know so that it won't run } if (!imageOut.open(imageOutputPortName.c_str())) { cout << getName() << ": unable to open port " << imageOutputPortName << endl; return false; // unable to open; let RFModule know so that it won't run } if (!statisticsOut.open(statisticsOutputPortName.c_str())) { cout << getName() << ": unable to open port " << statisticsOutputPortName << endl; return false; // unable to open; let RFModule know so that it won't run } /* * attach a port of the same name as the module (prefixed with a /) to the module * so that messages received from the port are redirected to the respond method */ handlerPortName = "/"; handlerPortName += getName(); // use getName() rather than a literal if (!handlerPort.open(handlerPortName.c_str())) { cout << getName() << ": Unable to open port " << handlerPortName << endl; return false; } attach(handlerPort); // attach to port /* create the thread and pass pointers to the module parameters */ protoComponentThread = new ProtoComponentThread(&imageIn, &thresholdIn, &imageOut, &statisticsOut, &thresholdValue); /* now start the thread to do the work */ protoComponentThread->start(); // this calls threadInit() and it if returns true, it then calls run() return true ; // let the RFModule know everything went well // so that it will then run the module }
/* protoComponentMain.cpp Application file for the example CINDY component */ #include "protoComponent.h" int main(int argc, char * argv[]) { /* initialize yarp network */ Network yarp; /* create your module */ ProtoComponent protoComponent; /* prepare and configure the resource finder */ ResourceFinder rf; rf.setVerbose(true); rf.setDefaultConfigFile("protoComponent.ini"); // can be overridden by --from parameter rf.setDefaultContext("protoComponent/configuration"); // can be overridden by --context parameter rf.configure("CINDY_ROOT", argc, argv); // environment variable with root of configuration path /* run the module: runModule() calls configure first and, if successful, it then runs */ protoComponent.runModule(rf); return 0; }
Doing Some Work: Instantiating and starting the protoComponentThread
Once the configuration is done (in protoComponentConfiguration.cpp
), the derived module then instantiates a Thread
(or RateThread
) object and launches it (again, this is done in protoComponentConfiguration.cpp
), passing to it as arguments all the relevant resources, e.g. port names and parameter values, located by the resource finder.
In the example above, this we done as follows.
/* create the thread and pass pointers to the module parameters */ protoComponentThread = new ProtoComponentThread(&imageIn, &thresholdIn, &imageOut, &statisticsOut, &thresholdValue); /* now start the thread to do the work */ protoComponentThread->start(); // this calls threadInit() and it if returns true, it then calls run()
Graceful Shut-down
To achieve clean shutdown, two RFModule
methods, yarp::os::RFModule::interruptModule()
and yarp::os::RFModule::close()
, should be overridden.
The interruptModule()
method will be called when it is desired that updateModule()
finish up. When it has indeed finished, close()
will be called.
The interruptModule()
method should first call the stop()
method for the thread (e.g. protoComponentThread->stop();
) and then call the interrupt
method for each of the ports that it opened in the configure()
method. For example:
bool ProtoComponent::interruptModule() { protoComponentThread->stop(); imageIn.interrupt(); thresholdIn.interrupt(); imageOut.interrupt(); handlerPort.interrupt(); return true; } bool ProtoComponent::close() { imageIn.close(); thresholdIn.close(); imageOut.close(); handlerPort.close(); return true; }
The order in which you do this is very important: first stop()
the thread, then interrupt()
the ports, then close()
the ports. Getting this out of sequence causes problems when shutting down a component and it will often hang, requiring you to kill the process.
For yarp::os::RFModule
, the method yarp::os::RFModule::updateModule()
will be called from the main control thread until it returns false. After that a clean shutdown will be initiated. The period with which it is called is determined by the method yarp::os::RFModule::getPeriod()
. Neither method need necessarily be overridden. The default methods provide the required functionality.
/* Called periodically every getPeriod() seconds */ bool ProtoComponent::updateModule() { return true; } double ProtoComponent::getPeriod() { /* module periodicity (seconds), called implicitly by protoComponent */ return 0.1; }
Note that the updateModule()
method is not meant to run code that that implements the algorithm encapsulated in the module. Instead updateModule()
is meant to be used as a periodic mechanism to check in on the operation of the thread that implements the module (e.g. gather interim statistics, change parameter settings, etc.). The updateModule()
is called periodically by the RFModule object, with the period being determined by the getPeriod()
method. Both updateModule()
and getPeriod()
can be overridden in your implementation of myModule
.
Component Computation and Communication: the Thread
and RateThread
Classes
Here we finally explain how to get the component to do some work: the functionality associated with computation and communication. This is defined in the protoComponentComputation.cpp
file. This functionality revolves around the Thread
and RateThread
classes: how to access the parameters passed to it from the derived RFModule
object, how to perform some useful work.
Using Threads to Implement Your Algorithm
For the module to actually do anything, it should start or stop threads using the YARP Thread and RateThread classes. Typically, these threads are started and stopped in the configure
and close
methods of the RFModule class. If you are writing a control loop or an algorithm that requires precise scheduling your should use the RateThread class.
Just as the starting point in writing a component for the CINDY repository is to develop a sub-class of the yarp::os::RFModule class, the starting point for implementing the algorithm within that component is to develop a sub-class of either Thread or RateThread.
In the following, we will explain how to do it with Thread; it's straightforward to extend this to RateThread: effectively, you provide an argument with the RateThread
instantiation specifying the period with which the thread should be spawned; the thread just runs once so that you don't have to check isStopping()
to see if the thread should end as in the Thread example below.
Perhaps one of the best ways of thinking about this is to view it as a two levels of encapsulation, one with RFModule
, and another with Thread
; the former deals with the configuration of the module and the latter dealing with the execution of the algorithm. The only tricky part is that somehow these two objects have to communicate with one another.
You need to know three things (two of which we can covered already):
- The thread is instantiated and started in the
configure()
method. - The thread is stopped in the
close()
method. - When the thread is instantiated, you pass the module parameters to it as a set of arguments (for the constructor).
Let's begin with the definition of a thread ProtoComponentThread
(capital P because we are going to create a sub-class) and then turn our attention to how it is used by protoComponent
.
An example of how to use the Thread
class
First, we define a sub-class, or derived class, of the yarp::os::Thread
class. The algorithm's variables - and specifically the thread's parameters and ports - go in the private data members part and you need to override four methods:
-
ProtoComponentThread::ProtoComponentThread(); // the constructor
-
bool threadInit(); // initialize variables and return true if successful
-
void run(); // do the work
-
void threadRelease(); // close and shut down the thread
There are a number of important points to note.
First, the variables in the ProtoComponentThread
class which represent the thread's parameters and port should be pointer types and the constructor parameters should initialize them. In turn, the arguments of the protoComponentThread
object instantiation in the configure()
should be the addresses of (pointers to) the module parameters and ports in the protoComponentThread
object. In this way, the thread's parameter and port variables are just references to the original module parameters and ports that were initialized in the configure
method of the protoComponent
object.
Second, threadInit()
returns true
if the initialization was successful, otherwise it should return false
. This is significant because if it returns false
the thread will not subsequently be run.
Third, the run()
method is where the algorithm is implemented. Typically, it will run continuously until some stopping condition is met. This stopping condition should include the return value of a call to the yarp::os::Thread::isStopping()
method which flags whether or not the thread is to terminate. In turn, the value of yarp::os::Thread::isStopping()
is determined by the yarp::os::Thread::stop()
method which, as we saw already, is called in protoComponent.close()
.
The following is an example declaration and definition of the ProtoComponentThread
class taken from protoComponent.h
/** @file protoComponent.h Interface file for the example CINDY component */ #include <yarp/os/Thread.h> using namespace std; using namespace yarp::os; using namespace yarp::sig; class ProtoComponentThread : public Thread { private: /* class variables */ bool debug; int x, y; PixelRgb rgbPixel; ImageOf<PixelRgb> *image; int *thresholdValue; VectorOf<int> *thresholdVector; int numberOfForegroundPixels; /* thread parameters: they are pointers so that they refer to the original variables in protoComponent */ BufferedPort<ImageOf<PixelRgb> > *imagePortIn; BufferedPort<VectorOf<int> > *thresholdPortIn; BufferedPort<ImageOf<PixelRgb> > *imagePortOut; BufferedPort<Bottle> *statisticsPortOut; public: /* class methods */ ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, BufferedPort<VectorOf<int> > *thresholdIn, BufferedPort<ImageOf<PixelRgb> > *imageOut, BufferedPort<Bottle> *statisticsOut, int *threshold ); bool threadInit(); void threadRelease(); void run(); };
/* protoComponentComputation.cpp Implementation file for the computation and communication aspects of protoComponent */ ProtoComponentThread::ProtoComponentThread(BufferedPort<ImageOf<PixelRgb> > *imageIn, BufferedPort<VectorOf<int> > *thresholdIn, BufferedPort<ImageOf<PixelRgb> > *imageOut, BufferedPort<Bottle> *statisticsOut, int *threshold) { imagePortIn = imageIn; thresholdPortIn = thresholdIn; imagePortOut = imageOut; statisticsPortOut = statisticsOut; thresholdValue = threshold; } bool ProtoComponentThread::threadInit() { /* initialize variables and create data-structures if needed */ debug = false; return true; } void ProtoComponentThread::run(){ /* * do some work .... * for example, convert the input image to a binary image using the threshold provided */ unsigned char value; double start; start = yarp::os::Time::now(); // start time while (isStopping() != true) { // the thread continues to run until isStopping() returns true if (debug) cout << "protoComponentThread: threshold value is " << *thresholdValue << endl; /* read image ... block until image is received */ do { image = imagePortIn->read(true); } while ((image == NULL) && (isStopping() != true)); // exit loop if shutting down; if (isStopping()) break; // abort this loop to avoid make sure we don't continue and possibly use NULL images /* read threshold ... block if threshold is not received */ /* do { thresholdVector = thresholdPortIn->read(false); } while ((thresholdVector == NULL) && (isStopping() != true)); // exit loop if shutting down; */ /* read threshold ... do not block if threshold is not received */ thresholdVector = thresholdPortIn->read(false); if (thresholdVector != NULL) { *thresholdValue = (int) (*thresholdVector)[0]; } if (debug) cout << "protoComponentThread: threshold value is " << *thresholdValue << endl; /* write out the binary image */ ImageOf<PixelRgb> &binary_image = imagePortOut->prepare(); binary_image.resize(image->width(),image->height()); numberOfForegroundPixels = 0; for (x=0; x<image->width(); x++) { for (y=0; y<image->height(); y++) { rgbPixel = image->safePixel(x,y); if (((rgbPixel.r + rgbPixel.g + rgbPixel.b)/3) > *thresholdValue) { value = (unsigned char) 255; numberOfForegroundPixels++; } else { value = (unsigned char) 0; } rgbPixel.r = value; rgbPixel.g = value; rgbPixel.b = value; binary_image(x,y) = rgbPixel; } } imagePortOut->write(); /* write out the image statistics */ Bottle &statisticsMessage = statisticsPortOut->prepare(); statisticsMessage.clear(); statisticsMessage.addInt((int)(yarp::os::Time::now()-start)); statisticsMessage.addString("seconds elapsed"); statisticsMessage.addString(" - foreground pixel count is"); statisticsMessage.addInt(numberOfForegroundPixels); statisticsPortOut->write(); } } void ProtoComponentThread::threadRelease() { /* for example, delete dynamically created data-structures */ }
GUI Component Computation and Communication: the FLTK
and guiUtilities
Libraries
This section explains how you can write your own graphic user interface (GUI). We will use the specific example of a GUI for the protoComponent
component. This will be implemented as a separate stand-along component protoComponentGUI
.
The functionality associated with configuration and coordination, i.e. with the protoComponentGUIConfiguration.cpp
and protoComponentGUI.h
files, is essentially the same as for the protoComponent
example so we will skip over that part. For reference, you can see the complete source code in The protoComponentGUI Example.
Here we address the functionality associated with computation and communication, i.e. with the protoComponentGUIComputation.cpp
and protoComponent.h
files (also included in The protoComponentGUI Example). As with protoComponent
, the functionality revolves around the Thread
and RateThread
classes but the difference here is that the ProtoComponentGUIThread::run()
now contains code to implement the GUI using the FLTK and guiUtilities libraries. That is the essential difference.
First, we look at the definition of the ProtoComponentGUIThread
. The only thing worthy of note here is the use of the inclusion of the guiUtilities.h
file to allow us use the guiUtilities library. This library, which is included in the CINDY release software repository, provide a number of general-purpose classes and methods to lighten the burden of writing a GUI. In particular, here we see the definition of the two images DVimage *rgbDVImage;
and DVimage *binaryDVImage;
. The DVimage
is one of the utility classes in the guiUtilities library. Other classes, which we will see later, include the DVdisplay
class with is a specially-design GUI widget that allows the display of DVimage
image objects.
/** @file protoComponentGUI.h Interface file for the example CINDY component */ #include <iostream> #include <string> #include <yarp/sig/all.h> #include <yarp/os/all.h> #include <yarp/os/RFModule.h> #include <yarp/os/Network.h> #include <yarp/os/Thread.h> #include "guiUtilities.h" using namespace std; using namespace yarp::os; using namespace yarp::sig; #define STRINGLENGTH 132 // used to define a string when post-processing the bottle messages class ProtoComponentGUIThread : public Thread { private: /* class variables */ bool debug; int x, y; PixelRgb rgbPixel; int *thresholdValue; nt numberOfForegroundPixels; int rgb_width; int rgb_height; int rgb_depth; int binary_width; int binary_height; int binary_depth; unsigned char pixel_value; float float_pixel_value; double thresholdValueDouble; string logoFilenameValue; int temp; ImageOf<PixelRgb> *rgbYARPImage; ImageOf<PixelRgb> *binaryYARPImage; DVimage *rgbDVImage; DVimage *binaryDVImage; Bottle *statisticsMessage; /* thread parameters: they are pointers so that they refer to the original variables in protoComponentGUI */ BufferedPort<ImageOf<PixelRgb> > *colourImagePortIn; BufferedPort<ImageOf<PixelRgb> > *binaryImagePortIn; BufferedPort<Bottle> *statisticsPortIn; BufferedPort<VectorOf<int> > *thresholdPortOut; public: /* class methods */ ProtoComponentGUIThread(BufferedPort<ImageOf<PixelRgb> > *colourImageIn, BufferedPort<ImageOf<PixelRgb> > *binaryImageIn, BufferedPort<Bottle> *statisticsIn, BufferedPort<VectorOf<int> > *thresholdOut, int *threshold, string logoFilename); bool threadInit(); void threadRelease(); void run(); };
Note that the thread parameter list contains a filename. This is the name of the file that contain the CINDY logo. We pass it as a parameter from the RFModule::configure()
so that we can user the resource finder to locate the file and its path.
Next, we look at the definition of the GUI itself in the run()
method. For convenience, we will only show code snippets; refer to The protoComponentGUI Example for the complete source code listing.
The first thing to notice is the instantiation of a number of objects from FLTK classes Fl_Group
, Fl_Box
, and Fl_PNG_Image
. These define a group of widgets, a variety of individual widget, and an image with the CINDY logo.
/* protoComponentGUIComputation.cpp Implementation file for the example CINDY component */ void ProtoComponentGUIThread::run(){ Fl_Group *start_protoComponent_GUI; Fl_Box *box1, *box2, *heading; Fl_PNG_Image *logo=new Fl_PNG_Image(logoFilenameValue.c_str());
The next thing is the long list of variables that determine the presentation of the GUI. These are then initialized in as subsequent section. This may look tedious but it means that it is very easy to re-design the layout of the GUI.
int i, j; char modifiedString[STRINGLENGTH]; /* variable that determine the presentation of the GUI */ int control_panel_x, control_panel_y; int control_panel_width, control_panel_height; int heading_x, heading_y, heading_width, heading_height; int display_width, display_height; int display_x1, display_x2, display_y; int display_spacing; int display_offset_x, display_offset_y; int control_offset_x, control_offset_y; int button_size_x, button_size_y, button_spacing_y; int input_size_x, input_size_y; int title_height; int threshold_x, threshold_y; int threshold_size_x, threshold_size_y; int section_spacing_y; int window_width, window_height, border_width, border_height; int text_output_width,text_output_height; int text_output_x, text_output_y; /* intialize the presentation settings */ window_width = GetSystemMetrics(SM_CXFULLSCREEN); // this is the area available for the window on the screen window_height = GetSystemMetrics(SM_CYFULLSCREEN); border_width = GetSystemMetrics(SM_CXSIZEFRAME); border_height = GetSystemMetrics(SM_CYSIZEFRAME); display_width = DISPLAY_WIDTH; display_height = DISPLAY_HEIGHT; display_spacing = 25; heading_x = (window_width - display_width*2 - display_spacing)/2; heading_y = MENUBAR_HEIGHT; heading_width = display_width*2 + display_spacing; // centre over displays heading_height = HEADING_HEIGHT*2; // logo and caption display_offset_x = heading_x ; display_offset_y = heading_y + heading_height; display_x1 = display_offset_x; display_x2 = display_x1 + display_spacing + display_width ; display_y = display_offset_y; title_height = 12; button_size_x = 130; button_size_y = 20; button_spacing_y = 5; input_size_x = button_size_x; input_size_y = button_size_y; control_offset_x = 20; control_offset_y = 0; control_panel_width = display_width * 1; control_panel_height = display_height / 2; // alternative to match the panel height to the number of widgets: // control_panel_height = title_height + 1*(5 + button_size_y) + title_height; control_panel_x = display_x2; control_panel_y = display_y + display_height + display_spacing; section_spacing_y = 8; threshold_size_x = control_panel_width - 2 * control_offset_x; threshold_size_y = input_size_y; threshold_x = control_panel_x + control_offset_x; threshold_y = control_panel_y + control_offset_x + 0 * (button_size_y + button_spacing_y); // 0 because threshold is the first widget in the control panel // increase by 1 for every extra widget added text_output_width = display_width; text_output_height = display_height / 2; text_output_x = display_offset_x; text_output_y = display_offset_y + display_height + display_spacing;
With that done, we can then define a group with all the GUI widgets and add the widgets to this group, one by one.
/* define a group with all the GUI widgets */ start_protoComponent_GUI = new Fl_Group(0,MENUBAR_HEIGHT,window_width,window_height-MENUBAR_HEIGHT,""); start_protoComponent_GUI->begin(); /* ... note: we don't declare heading because it is declared in the guiUtilities library */ heading = new Fl_Box(heading_x, heading_y, heading_width,heading_height,"The protoComponentGUI Example" ); heading->align(FL_ALIGN_INSIDE | FL_ALIGN_CENTER | FL_ALIGN_IMAGE_OVER_TEXT); heading->labelsize(20); heading->labelcolor(FL_BLACK); heading->labelfont(FL_HELVETICA_BOLD); heading->box(FL_NO_BOX); heading->image(logo); /* boxes to frame images ... note: we don't declare box1 or box2 because they are declared in the guiUtilities library */ box1 = new Fl_Box(display_x1-BORDER,display_y-BORDER, display_width+2*BORDER,display_height+2*BORDER,"" ); box1->box(FL_DOWN_BOX); box1->align(FL_ALIGN_BOTTOM | FL_ALIGN_CENTER); box1->labelsize(12); box2 = new Fl_Box(display_x2-BORDER,display_y-BORDER, display_width+2*BORDER,display_height+2*BORDER,"" ); box2->box(FL_DOWN_BOX); box2->align(FL_ALIGN_BOTTOM | FL_ALIGN_CENTER); box2->labelsize(12); /* image display ... note: we don't declare display1 or display2 because they declared in the guiUtilities library */ display1 = new DVdisplay(display_x1, display_y, display_width,display_height); display2 = new DVdisplay(display_x2, display_y, display_width,display_height); /* box to frame controls */ Fl_Box *control_panel; control_panel = new Fl_Box(control_panel_x, control_panel_y, control_panel_width, control_panel_height,"" ); control_panel->align(FL_ALIGN_TOP | FL_ALIGN_CENTER | FL_ALIGN_INSIDE); control_panel->labelsize(12); control_panel->labelfont(FL_HELVETICA_BOLD); control_panel->box(FL_PLASTIC_DOWN_BOX); /* threshold slider */ Fl_Value_Slider *threshold; threshold = new Fl_Value_Slider(threshold_x, threshold_y, threshold_size_x, threshold_size_y,"Binary Threshold Value"); threshold->type(FL_HOR_NICE_SLIDER); threshold->textsize(11); threshold->callback(valuator_cb, &thresholdValueDouble); // NB valuator_cb() is a general-purpose callback defined in guiUtilities.h threshold->labelsize(12); // other general-purpose callbacks are defined there too, e.g. radio buttons threshold->labelfont(FL_HELVETICA_BOLD); // some widgets may require you to write your own callback threshold->when(FL_WHEN_ENTER_KEY | FL_WHEN_CHANGED | FL_WHEN_RELEASE); threshold->align(FL_ALIGN_TOP); threshold->minimum(0); threshold->maximum(255); threshold->step(1); threshold->value((double)*thresholdValue); // initialize the threshold to the value passed as a parameter threshold->box(FL_PLASTIC_DOWN_BOX); /* Text output ... note: we don't declare text_output because it is declared in the guiUtilities library */ text_output = new Fl_Multiline_Output(text_output_x, text_output_y, text_output_width, text_output_height,"" ); text_output->align(FL_ALIGN_TOP | FL_ALIGN_CENTER ); text_output->labelsize(12); text_output->textsize(12); //text_output->color(FL_GREEN); text_output->value(""); //text_output->box(FL_THIN_DOWN_FRAME); // matches the image display frames text_output->box(FL_PLASTIC_DOWN_BOX); // rounded edges for something more visually appealing start_protoComponent_GUI->end(); // end of the group
Now we are in a position to actually create the GUI. We do this by instantiating a window class Fl_Double_Window
, position it, enable double buffering to make images in video sequences transition smoothly, display the window, add the group of GUI widgets, and then redraw the window. We call the FLTK function Fl::check();
to display the window.
// create main window DVwindow = new Fl_Double_Window(window_width-border_width,window_height-border_height,"The protoComponentGUI Example"); DVwindow->position(0,0); Fl::visual(FL_DOUBLE|FL_INDEX); // enable double buffering of the window DVwindow->end(); DVwindow->show(); // add the GUI DVwindow->add(start_protoComponent_GUI); DVwindow->redraw(); Fl::check();
We can now interact with the widgets. First we display some text in the text_output
widget using the message()
function. This function is one of the utilities that is provided by the guiUtilities library.
Having done that, we are done with the GUI definition. We now revert to the normal YARP thread loop. Notice however, that we include two FLTK method calls inside this loop, one to redraw the window and one the tell FLTK that the window has been re-drawn and needs to be redisplayed.
/* write some text in the window ... */ /* note that function message() is defined in guiUtilities as a general-purpose routine to write */ /* to the predefined display widget text_output ... notice how we didn't declare text_output above */ /* we didn't have to because it is declared in guiUtilities */ message("Waiting to start .... image statistics will be displayed here"); /*************************************************************************************/ /* This is where the definition of the GUI ends and the normal run() loop begins */ /*************************************************************************************/ while (isStopping() != true) { // the thread continues to run until isStopping() returns true DVwindow->redraw(); Fl::check(); // refresh the GUI .... we do it this way rather than calling Fl::run() as we nomally would // because we do not want to cede control to the event loop
Further down this loop we have occasion to interact with the FLTK widgets, e.g. to read an image from a port, copy it to the local format suitable for display, and then display it.
/*** read colour image ... do not block if image is not received ***/ rgbYARPImage = colourImagePortIn->read(false); if (rgbYARPImage != NULL) { rgb_width = rgbYARPImage->width(); rgb_height = rgbYARPImage->height(); rgb_depth = 3; if (debug) printf("protoComponentGUI: rgb width = %d, rgb height = %d, rgb depth = %d\n",rgb_width, rgb_height, rgb_depth); if (rgbDVImage == NULL) { rgbDVImage = new DVimage(rgb_width, rgb_height, rgb_depth); } /* now copy the image to local format */ for (x = 0; x < rgb_width; x++) { for (y = 0; y < rgb_height; y++) { rgbPixel = rgbYARPImage->safePixel(x,y); rgbDVImage->put_pixel(x, y, rgbPixel.r, 0); rgbDVImage->put_pixel(x, y, rgbPixel.g, 1); rgbDVImage->put_pixel(x, y, rgbPixel.b, 2); } } display1->draw(rgbDVImage); } else { if (debug) printf("protoComponentGUI: colour image not received\n"); }
We also read the image statistics from another port, process them, and then display them in a text box.
/* read the image statistics ... do not block if bottle is not received*/ statisticsMessage = statisticsPortIn->read(false); if (statisticsMessage != NULL) { /* for some strange reason, YARP puts double quotes around every individual string in a bottle so we strip them here */ j=0; for (i=0; i<min(STRINGLENGTH-1,(int)strlen(statisticsMessage->toString().c_str()));i++) { if (statisticsMessage->toString().c_str()[i]!='\"') { modifiedString[j] = statisticsMessage->toString().c_str()[i]; j++; } } modifiedString[j]='\0'; /* now copy the message to the display */ message(modifiedString); if (debug) cout << "protoComponentGUIThread: statistics message is " << modifiedString << endl; } else { if (debug) printf("protoComponentGUI: statistics not received\n"); }
Finally, we can use the threshold value set by the FLTK valuator and send it on a port (to protoComponent
).
/*** write the threshold ***/ VectorOf<int> &thresholdVector = thresholdPortOut->prepare(); thresholdVector.resize(1); thresholdVector(0) = *thresholdValue; thresholdPortOut->write();
Test Applications
As we noted at the outset, in a Component-Based Software Engineering (CBSE) project, such as CINDY, the source code application file is replaced by the application script file or application XML file that runs the various components and connects them together in a working system. Thus, CINDY applications, i.e. collections of inter-connected YARP modules, are described in XML and launched using a utility called gyarpmanager. Refer to the Software Users Guide for more details on how to run these application descriptions.
In this section, we provide two test applications.
The first test application shows how to configure and run a simple application to use the protoComponent
by connecting it to other components that provide input images and display the output images. This application uses yarpview
modules to view the images. The threshold is modified online by sending commands to protoComponent
from the command line in a terminal window.
The second test application shows how to configure and run a simple application to use protoComponent
and protoComponentGUI
together. In this case, the images are displayed in the GUI rather than yarpview
displays and the threshold is modified interactively using the GUI controls.
Both applications have some some command-line parameters for illustration. Remember that these command-line parameter values have priority over the same parameter values specified in the relevant configuration file, which in turn have priority over the default values provided in the source code.
<application> <name>Demo of protoComponent</name> <dependencies> <port>/robot/cam/left</port> </dependencies> <module> <name>protoComponent</name> <parameters>--context components/protoComponent/config </parameters> <node>cindy1</node> <tag>protoComponent</tag> </module> <module> <name>imageSource</name> <parameters>--context components/imageSource/config</parameters> <node>cindy1</node> <tag>imageSource</tag> </module> <module> <name>yarpview</name> <parameters>--name /inputImage --x 000 --y 000 --w 320 --h 318 </parameters> <node>cindy1</node> <tag>input_image</tag> </module> <module> <name>yarpview</name> <parameters>--name /binaryImage --x 320 --y 000 --w 320 --h 318 </parameters> <node>cindy1</node> <tag>plot_image</tag> </module> <connection> <from>/robot/cam/left</from> <to>/inputImage</to> <protocol>tcp</protocol> </connection> <connection> <from>/robot/cam/left</from> <to>/protoComponent/image:i</to> <protocol>tcp</protocol> </connection> <connection> <from>/protoComponent/image:o</from> <to>/binaryImage</to> <protocol>tcp</protocol> </connection> </application>
<application> <name>Demo of protoComponentGUI</name> <dependencies> <port>/robot/cam/left</port> </dependencies> <module> <name>protoComponentGUI</name> <parameters>--context components/protoComponentGUI/config </parameters> <node>cindy1</node> <tag>protoComponentGUI</tag> </module> <module> <name>protoComponent</name> <parameters>--context components/protoComponent/config </parameters> <node>cindy1</node> <tag>protoComponent</tag> </module> <module> <name>imageSource</name> <parameters>--context components/imageSource/config --width 640 --height 480 </parameters> <node>cindy1</node> <tag>imageSource</tag> </module> <connection> <from>/robot/cam/left</from> <to>/protoComponent/image:i</to> <protocol>tcp</protocol> </connection> <connection> <from>/protoComponent/image:o</from> <to>/protoComponentGUI/binaryimage:i</to> <protocol>tcp</protocol> </connection> <connection> <from>/protoComponent/statistics:o</from> <to>/protoComponentGUI/statistics:i</to> <protocol>tcp</protocol> </connection> <connection> <from>/robot/cam/left</from> <to>/protoComponentGUI/colourimage:i</to> <protocol>tcp</protocol> </connection> <connection> <from>/protoComponentGUI/threshold:o</from> <to>/protoComponent/threshold:i</to> <protocol>tcp</protocol> </connection> </application>
To run the application, follow the instruction in the Software Users Guide.
Software Engineering Standards
Finally, note that CINDY follows a set of recommended software engineering standardi, as follows.
- Standards for File Organization
- Standards for Internal Documentation
- Standards for Component Functionality
- Standards for Programming Style
- Standards for Programming Practice
Please take the time to read through these documents.
Return to The CINDY Cognitive Architecture main page.