Skip to main content

Data Formulator supports integration with various external systems through APIs, webhooks, and direct database connections. The integration framework is designed to be extensible and supports both real-time and batch processing scenarios.

API Integration

The REST API is available at http://localhost:8080/api/v1/ and supports standard HTTP methods. Authentication is handled through JWT tokens or API keys depending on your configuration.

Common integration patterns include:

  • Webhook endpoints for receiving data from external systems

  • Scheduled data pulls from databases and file systems

  • Real-time streaming integration with Kafka topics

  • Batch file processing for large data imports

Database Connectors

Built-in connectors are available for PostgreSQL, MySQL, MongoDB, and Elasticsearch. Configure database connections in the integrations.yaml file:


Bash
sudo nano /etc/dataformulator/integrations.yaml

Third-party Integrations

Popular integrations include Salesforce, AWS S3, Google Cloud Storage, and various CRM systems. Each integration requires specific configuration parameters and may need additional authentication setup.