Skip to main content

Maintenance

Regular maintenance ensures optimal performance and prevents issues before they impact production workloads. Establish a maintenance schedule that includes database cleanup, log rotation, and performance optimization tasks.

Routine Maintenance Tasks

Database Maintenance: Run weekly database optimization:


Bash
sudo -u dataformulator /opt/dataformulator/bin/db-optimize.sh

Log Cleanup: Automated log rotation is configured, but manual cleanup may be needed:

Bash
sudo find /var/log/dataformulator/ -name "*.log.*" -mtime +30 -delete

Cache Management: Clear Redis cache when needed:


Bash
redis-cli FLUSHDB

Performance Tuning

Monitor system performance regularly and adjust configuration parameters based on workload patterns. Common tuning areas include JVM heap sizes, database connection pools, and Kafka consumer settings.

Backup Procedures Implement regular backups of configuration files and databases:


Bash
sudo tar -czf /backup/dataformulator-config-$(date +%Y%m%d).tar.gz /etc/dataformulator/

Database backups should be scheduled according to your data retention policies and recovery time objectives.