Distributed Computing

Terrain generation is a complex task and may require a substantial amount of time depending on the area size and data resolution. The Landscape Tool enables you to use the advantages of distributed computing in the process of terrain generation.

Distributed computing is available for the following tasks:

• raster cache generation (elevation, imagery, masks)
• procedural cache generation
• procedural cache blending
• procedural tileset updating (heights,masks)
• tileset generation for all LODs
• detail masks generation
• landcover objects generation

All calculations to be performed in the framework of the terrain generation can be distributed between different computers of your LAN. These computers can be of two types:

Launching Order

To set up a Master, open the Distributed Computing settings window by choosing Distributed Computing -> Settings in the Landscape Tool window menu. The following window will appear:

Select the Master mode.

In the Required common paths field you will find the list of common shared folders, that will be used by all computers in the process of terrain generation.

In the Workers list you will see all Workers in you network with their ports and statuses.

Select desired Workers in the list one by one and Connect for each of them. If the connection was successful the Worker's status will be changed to Connected. Workers, that are occupied calculating for another Master will have the Busy status.

To disconnect a connected Worker, select it in the list and click Disconnect.

As soon as you are done with settings and connections, click OK.

To set up a Worker, open the Distributed Computing settings window by choosing Distributed Computing -> Settings in the Landscape Tool window menu.

In the window that appears select the Worker mode. The following settings will be displayed:

Here you can specify the port to be used by the Worker in the corresponding field. You can set different ports for different Workers.

After setting a port, click Activate Worker. If the Worker is activated successfully, you will see the following Status window:

Now the Worker is switched to online mode and ready to perform calculations for the Master. This window will remain opened during the whole generation process.

The basic workflow is as follows:

1. Prepare your environment.

   Connect all computers to the network. It is recommended to use network with at least 1 Gb bandwidth. Otherwise, you may experience network lags (see Troubleshooting section). Broadcasting should not be blocked in your network, otherwise distributed computation will be unavailable.

   Notice

   It is recommended to use an SSD drive to store the generation cache and output files. Otherwise, the generation performance will be significantly lower, due to multiple read/write and head positioning operations, in case if an HDD is used.
2. On each computer run the UnigineEditor and open the Landscape Tool via the corresponding menu option Tools -> Landscape.
   Notice

   The versions of binary executable files must be the same on all computers.
3. On each Worker computer set up a Worker and activate it.
   Notice

   It is not necessary to open your world or the landscape asset on a Worker computer.
4. On the Master computer perform the following steps:
   • Open your world in the UnigineEditor.
   • Open the *.landscape asset, containing all necessary settings via File -> Open Asset, or specify all necessary generation settings for your terrain, if you do not have a *.landscape asset file yet.
   • Specify Master's settings.
   • Now you can start generation process by clicking Generate in the Landscape Tool window and specifying required generation steps.
     Notice

     Any unsaved changes made to generation parameters must be saved to the *.landscape asset before you start the generation process. You will be prompted to save your changes if any.

   • In the process of generation you will see the list of connected workers in the progress window. You can disconnect Workers in the process of generation when necessary by clicking remove.

     

     Notice

     • In case of a repeated generation (e.g., due to failed previous attempt) using a procedural data source, it is required to restart the engine on all Workers.
     • In case if a Worker fails to perform certain tasks due to a system crash or a network failure, the Master shall redistribute all the tasks, that were assigned to this Worker, between the others.

If the network latency is too large despite 1Gb bandwidth or higher, it can be caused by a 100 Mb or 10 Mb device connected to a network. Data exchange rate will drop down to the maximum rate supported by such device, slowing down generation speed.

• Some 100 Mb or 10 Mb devices can have a working network interface when they are turned off.
• It is also possible that when turned off, 1 Gb devices have a network interface working at 100 Mb rate, which will slow down connection in LAN.

Useful Tool