V4 to v5 migration guide

From collectd Wiki
Revision as of 13:43, 27 September 2010 by Octo (talk | contribs) (Network plugin: New section.)

Jump to: navigation, search

Since version 5.* is a different major version than version 4.*, some things have been changed in a backwards incompatible manner. This migration guide is here to help you with the transition.

Upgrade strategy

If you use collectd in a client / server setup, we recommend to upgrade the server instance(s) first. This allows you to use the v5 upgrade target which transforms data sent by v4 clients to the new v5 layout. Once the server is running v5 and the v5 upgrade target you can easily upgrade the clients one by one.

This step-by-step migration suggestion assumes you have one or more dedicated collectd servers writing RRD files. The directive is to upgrade the servers and minimizing the resulting gap in the collected data.

  • If you have only one server:
    • Set up a second server identical to your production machine. You can use the Forwarding option of the Network plugin or a packet filter such as ip_tables to send a copy of the network traffic to your clone.
  • If you have two or more redundant servers:
    • Enter a downtime for one server in the monitoring and remove it from the load balancing if the server is used to create graphs. Let it still receive and handle collectd traffic, though.
  • On this separate server:
    • Install the v5 daemon.
    • Adapt the configuration for plugins collecting data locally. Usually this is fairly easy on central collectd servers.
    • Configure the v5 upgrade target. Usually this is as simple as adding the following block to your collectd configuration:
<Chain "PreCache">
  Target "v5upgrade"
</Chain>
    • (Re)start the daemon.
    • Look for files that are no longer upgraded and rename them or split them up. Look at #Migrating existing RRD files for details on this. Possibly rsync / scp the RRD files and run the migration script multiple times until you are satisfied with the migrated data.
  • On your original server / For each other server:
    • Install the v5 daemon.
    • Copy the v5 config and adapt hostname / IP-addresses etc.
    • Restart the daemon.
    • rsync / scp the migrated files to get a clean data set without gaps.

Migrating the configuration

This section details which changes you need to make to the configuration file.

FQDNLookup

The default value for FQDNLookup has been changed. It used to be disabled by default and it's now enabled by default. You can use "FQDNLookup false" to configure the old default behavior. Enabling this option is recommended though.

Apache plugin

The old configuration was suited for one webserver only. The new configuration (added in version 4.7) puts the same configuration options into <Instance /> blocks.

Old New
<Plugin "apache">
  
  URL "http://localhost/mod_status?auto"
  
</Plugin>
<Plugin "apache">
  <Instance "">
    URL "http://localhost/mod_status?auto"
  </Instance>
</Plugin>

The string argument of the Instance blocks is used as the plugin instance. The example above used an empty string ("") as the instance name to get the same behavior the previous version (without Instance blocks) used.

Versions 4.7 through 4.10 included backwards compatibility code for configurations without Instance blocks. This code has been removed in version 5.0.

HDDTemp plugin

The TranslateDevicename configuration option has been removed.

For backwards compatibility reasons, the default behavior was to translate device names such as "/dev/sda" to major and minor device numbers, e.g. "8-0". This translation could be disabled by setting TranslateDevicename to false.

The new behavior is to not translate device names, i.e. behave as if the option was set to false.

Old New
<Plugin "hddtemp">
  … other options …
  TranslateDevicename false
</Plugin>
<Plugin "hddtemp">
  … other options …
  
</Plugin>
<Plugin "hddtemp">
  … other options …
  TranslateDevicename true
</Plugin>
<Plugin "hddtemp">
  … other options …
  
</Plugin>

+Rename RRD files!

If you used TranslateDevicename true or used the default behavior, you need to move the RRD files or rename the data by other means. If you used the recommended setting false, you only need to remove this line from the config.

MySQL plugin

In order to support collecting information from multiple MySQL instances, the configuration options have been moved into <Database /> blocks.

Old New
<Plugin "mysql">
  
  Host "localhost"
  User "username"
  Password "password"
  
</Plugin>
<Plugin "mysql">
  <Database "">
    Host "localhost"
    User "username"
    Password "password"
  </Database>
</Plugin>

The string argument of the Database block is used as plugin instance. The example above used an empty string ("") to mimic the old behavior.

Please note that the old behavior was to use the globally configured hostname for all values submitted by the MySQL plugin. This changes with the Database blocks: When the hostname is not set, an empty string ("") or "localhost", the globally defined hostname will be used as before. If the option is set to any other string, it will be used in the dispatched data, too. You may need to rename existing data accordingly.

Network plugin

The default buffer size of the Network plugin has been increased from 1000 byte to 1452 byte. If you send data from a v5 client to a v4 server, not all data sent by the client will be received, leading to gaps in the graphs.

For this and other reasons we strongly recommend to upgrade the server(s) first. If this is not an option for you, you should use the MaxPacketSize option (since version 4.8) on the server to increase the receive buffer size.

Todo

Migrating existing RRD files

Todo:

Other

Todo: