Redundant database: Difference between revisions
No edit summary |
(Add GUI migration workflow and compare dump/restore vs online migration methods) |
||
| Line 8: | Line 8: | ||
This method is an alternative to traditional MySQL replication and is particularly useful for: | This method is an alternative to traditional MySQL replication and is particularly useful for: | ||
* '''Online GUI Migration''': Migrating the GUI database from an old server to a new server with minimal or no downtime. The sensor replicates CDR data incrementally while users continue using the old GUI. Once replication completes, you can switch users to the new GUI without service interruption. | |||
* Creating a read-only replica database for reporting or analysis without impacting the performance of the primary database. | * Creating a read-only replica database for reporting or analysis without impacting the performance of the primary database. | ||
* Setting up a hot-standby database for disaster recovery. | * Setting up a hot-standby database for disaster recovery. | ||
| Line 13: | Line 14: | ||
The process incrementally syncs data starting from a specified date, ensuring that the destination database stays up-to-date in near real-time. | The process incrementally syncs data starting from a specified date, ensuring that the destination database stays up-to-date in near real-time. | ||
== Online GUI Migration Workflow == | |||
When migrating the GUI to a new server, you have two primary methods: | |||
=== Method 1: Dump/Restore (With Downtime) === | |||
If a service interruption is acceptable: | |||
1. Stop the sniffer on the old server | |||
2. Perform a database dump: `mysqldump -u root -p voipmonitor > backup.sql` | |||
3. Transfer and restore on new server: `mysql -u root -p voipmonitor < backup.sql` | |||
4. Repoint the GUI to the new database | |||
5. Install and configure the new GUI instance | |||
This method is simple but requires downtime and may take hours for terabyte-sized databases. | |||
=== Method 2: Online Migration (Minimal/No Downtime) === | |||
Using the sensor's database backup mode: | |||
1. Install VoIPmonitor GUI on the new server with a fresh empty database | |||
2. Configure and run a separate sensor instance in "database backup mode" on the new server | |||
3. The sensor connects to the old database and replicates CDR data incrementally | |||
4. Use [[Backup_and_restore_GUI_tables|GUI backup tools]] to migrate settings (users, sensors, rules) | |||
5. Once replication catches up, switch users to the new GUI | |||
6. Stop replication and decommission the old server | |||
For assistance with this method, provide remote SSH access to both the old and new hosts to the support team. | |||
== Comparison: Dump/Restore vs Online Migration == | |||
| Aspect | Dump/Restore | Online Migration | | |||
| :--- | :--- | :--- | | |||
| Downtime | Required (hours for large DBs) | Minimal/None | | |||
| Complexity | Low - Manual SQL dump | Medium - Sensor configuration | | |||
| Data Loss Risk | Moderate (if dump fails) | Low - Incremental sync | | |||
| Best For | Small databases | Large databases, zero-downtime requirements | | |||
== Configuration == | == Configuration == | ||
| Line 72: | Line 105: | ||
== AI Summary for RAG == | == AI Summary for RAG == | ||
'''Summary:''' This article describes how to use a dedicated VoIPmonitor sensor instance to perform application-level replication of its MySQL/MariaDB database. | '''Summary:''' This article describes how to use a dedicated VoIPmonitor sensor instance to perform application-level replication of its MySQL/MariaDB database (also known as "database backup mode"). This is particularly useful for online GUI migration with minimal downtime, creating read-only replicas, hot-standby backups, or disaster recovery. The guide provides a detailed example of a `voipmonitor.conf` file configured for replication, distinguishing between destination database settings (`mysqlhost`, etc.) and source database settings (`database_backup_from_mysqlhost`, etc.). It explains `database_backup_from_date` to control the sync starting point and `database_backup_insert_threads` for performance. Finally, it provides command-line instructions for running the replication instance, comparing dump/restore vs online migration methods. | ||
'''Keywords:''' database replication, backup, mysql backup, mariadb replication, replica, read-only, standby, disaster recovery, database_backup_from_date, database_backup_from_mysqlhost, voipmonitor.conf, high availability | '''Keywords:''' database replication, backup, mysql backup, mariadb replication, replica, read-only, standby, disaster recovery, GUI migration, migrate database, online migration, zero downtime migration, database_backup_from_date, database_backup_from_mysqlhost, voipmonitor.conf, high availability | ||
'''Key Questions:''' | '''Key Questions:''' | ||
* How can I migrate the GUI database with minimal downtime? | |||
* How to migrate the database during GUI migration? | |||
* What are the two methods for migrating the VoIPmonitor database? | |||
* How can I create a real-time backup of my VoIPmonitor database? | * How can I create a real-time backup of my VoIPmonitor database? | ||
* How do I replicate the VoIPmonitor database to another server? | * How do I replicate the VoIPmonitor database to another server? | ||
| Line 81: | Line 117: | ||
* Can I use VoIPmonitor to create a read-only replica of my database for reporting? | * Can I use VoIPmonitor to create a read-only replica of my database for reporting? | ||
* How does the `database_backup_from_date` parameter work? | * How does the `database_backup_from_date` parameter work? | ||
* What is the difference between dump/restore and online migration for GUI migration? | |||
Revision as of 05:48, 4 January 2026
This guide explains how to use a dedicated VoIPmonitor sensor instance to perform real-time replication of the CDR database to a secondary MySQL/MariaDB server. This provides a native, application-level method for creating backups or read-only replicas.
Overview & Use Case
VoIPmonitor offers a built-in mechanism to replicate its database. This is achieved by running a special instance of the sensor in "database backup mode." In this mode, the sensor does not sniff any packets; its sole purpose is to connect to a primary (source) database, read CDR data, and write it to a secondary (destination) database.
This method is an alternative to traditional MySQL replication and is particularly useful for:
- Online GUI Migration: Migrating the GUI database from an old server to a new server with minimal or no downtime. The sensor replicates CDR data incrementally while users continue using the old GUI. Once replication completes, you can switch users to the new GUI without service interruption.
- Creating a read-only replica database for reporting or analysis without impacting the performance of the primary database.
- Setting up a hot-standby database for disaster recovery.
- Consolidating data from multiple, smaller VoIPmonitor databases into one central database.
The process incrementally syncs data starting from a specified date, ensuring that the destination database stays up-to-date in near real-time.
Online GUI Migration Workflow
When migrating the GUI to a new server, you have two primary methods:
Method 1: Dump/Restore (With Downtime)
If a service interruption is acceptable: 1. Stop the sniffer on the old server 2. Perform a database dump: `mysqldump -u root -p voipmonitor > backup.sql` 3. Transfer and restore on new server: `mysql -u root -p voipmonitor < backup.sql` 4. Repoint the GUI to the new database 5. Install and configure the new GUI instance
This method is simple but requires downtime and may take hours for terabyte-sized databases.
Method 2: Online Migration (Minimal/No Downtime)
Using the sensor's database backup mode: 1. Install VoIPmonitor GUI on the new server with a fresh empty database 2. Configure and run a separate sensor instance in "database backup mode" on the new server 3. The sensor connects to the old database and replicates CDR data incrementally 4. Use GUI backup tools to migrate settings (users, sensors, rules) 5. Once replication catches up, switch users to the new GUI 6. Stop replication and decommission the old server
For assistance with this method, provide remote SSH access to both the old and new hosts to the support team.
Comparison: Dump/Restore vs Online Migration
| Aspect | Dump/Restore | Online Migration | | :--- | :--- | :--- | | Downtime | Required (hours for large DBs) | Minimal/None | | Complexity | Low - Manual SQL dump | Medium - Sensor configuration | | Data Loss Risk | Moderate (if dump fails) | Low - Incremental sync | | Best For | Small databases | Large databases, zero-downtime requirements |
Configuration
To set up database replication, you will run a new, dedicated VoIPmonitor sensor instance on the server that hosts your secondary (destination) database. This instance requires its own `voipmonitor.conf` file.
Below is a complete example configuration file for a replication instance.
Example `voipmonitor.conf` for Replication
Create a new configuration file, for example at `/etc/voipmonitor-backup.conf`:
# /etc/voipmonitor-backup.conf [general] # --- Destination Database (where to write data) --- # This instance connects to the local database where data will be replicated. mysqlhost = 127.0.0.1 mysqldb = voipmonitor_replica # It is wise to use a different DB name mysqlusername = root mysqlpassword = your_destination_db_password cdr_partition = yes # Ensure partitioning is enabled on the destination # --- Source Database (where to read data from) --- # These parameters tell the sensor which primary database to replicate. database_backup_from_mysqlhost = 192.168.0.1 # IP of the PRIMARY database server database_backup_from_mysqldb = voipmonitor # Name of the source database database_backup_from_mysqlusername = root database_backup_from_mysqlpassword = your_source_db_password # --- Replication Control --- # The date from which the replication should begin. The sensor will replicate all # data from this date forward. database_backup_from_date = 2024-01-01 # The number of parallel threads to use for inserting data into the destination database. # Increase this value for higher throughput. database_backup_insert_threads = 3 # The pause in seconds between each batch of replicated data. database_backup_pause = 3
Running the Replication Instance
Once your configuration file is ready, you can start the sensor in this special mode.
1. Manual Test Run
It is highly recommended to first run the process manually to ensure all settings are correct and there are no connection errors.
voipmonitor --config-file /etc/voipmonitor-backup.conf -k -v 1
-k: Prevents the process from forking into the background.-v 1: Sets verbosity to level 1, which will show status information.- Watch the output for any database connection errors or other warnings.
2. Running as a Service
To run the replication instance permanently as a background service, you will need to create a separate `systemd` or `init.d` service file for it. This process is covered in the Multiple Sniffer Instances guide. The key is to ensure the new service unit file uses the -c /etc/voipmonitor-backup.conf argument to load your specific configuration.
AI Summary for RAG
Summary: This article describes how to use a dedicated VoIPmonitor sensor instance to perform application-level replication of its MySQL/MariaDB database (also known as "database backup mode"). This is particularly useful for online GUI migration with minimal downtime, creating read-only replicas, hot-standby backups, or disaster recovery. The guide provides a detailed example of a `voipmonitor.conf` file configured for replication, distinguishing between destination database settings (`mysqlhost`, etc.) and source database settings (`database_backup_from_mysqlhost`, etc.). It explains `database_backup_from_date` to control the sync starting point and `database_backup_insert_threads` for performance. Finally, it provides command-line instructions for running the replication instance, comparing dump/restore vs online migration methods. Keywords: database replication, backup, mysql backup, mariadb replication, replica, read-only, standby, disaster recovery, GUI migration, migrate database, online migration, zero downtime migration, database_backup_from_date, database_backup_from_mysqlhost, voipmonitor.conf, high availability Key Questions:
- How can I migrate the GUI database with minimal downtime?
- How to migrate the database during GUI migration?
- What are the two methods for migrating the VoIPmonitor database?
- How can I create a real-time backup of my VoIPmonitor database?
- How do I replicate the VoIPmonitor database to another server?
- What is the "database backup mode" for the sniffer?
- What configuration is needed to mirror the VoIPmonitor database?
- Can I use VoIPmonitor to create a read-only replica of my database for reporting?
- How does the `database_backup_from_date` parameter work?
- What is the difference between dump/restore and online migration for GUI migration?