Edge devices mainly monitor and alert on specific data on the production line, such as real-time data in a particular plant, and then synchronize this edge-side production data to a central platform in the cloud. On the edge side, real-time performance is essential, but the data volume may not be large, typically ranging from a few thousand to tens of thousands of monitoring points in a plant. On the central side, computing resources are generally abundant, capable of aggregating data from the edge side for analysis and computation.
Video
TDengine’s Edge–Cloud Synchronization Solution
TDengine Enterprise delivers powerful edge–cloud synchronization capabilities, including:
- Efficient data synchronization: Supports synchronization of millions of data points per second, ensuring fast and stable data transmission between the edge and cloud
- Multiple data sources: Compatible with various external data sources, such as AVEVA PI System, OPC, and MQTT
- Flexible configuration: Provides configurable synchronization rules, allowing users to customize the strategy and method of data synchronization according to actual needs
- Automated backfill: Fills in missing edge data in the event that the connection is interrupted, ensuring that the cloud and edge are in sync
- Historical data: Supports the seamless migration of historical data to new or upgraded systems
The following diagram illustrates the implementation of an edge–cloud synchronization architecture in TDengine Enterprise.
Implement Edge–Cloud Synchronization in TDengine
Note: Edge–cloud synchronization is an enterprise feature. If you would like to try this feature for yourself, contact us or email business@tdengine.com for a trial license.
This procedure describes how to synchronize a TDengine Enterprise instance running on the edge with a TDengine Cloud instance deployed in AWS. Note that these are the most basic steps for edge–cloud synchronization; there are many options for customization to meet your specific needs.
Prerequisites
-
Register for a TDengine Cloud account and set up an instance containing a database to store synchronized data.
-
Deploy TDengine Enterprise and create a topic subscribing to the data that you want to synchronize.
-
Record the hostname and port number of taosAdapter on the edge instance, as well as the name of the topic that you created.
-
Record the username and password of a user on the edge cluster with permission to read the topic.
Procedure
-
In a web browser, log in to your TDengine Cloud instance.
-
In the main menu on the left, select Data In and click Add Data Source.
-
Enter a name for your synchronization task.
-
From the Type drop-down list, select
TDengine 3.x. -
From the Target DB drop-down list, select the database on the cloud instance where you want to store synchronized data from the edge instance.
-
In the Connection Configuration section, enter the WebSocket URL to the topic on the edge instance. Include the username and password of a user on the edge instance that can access the topic.
-
Click Check Connection to verify that the cloud instance can connect with the edge instance.
-
Under Migrate Options, select how you want to synchronize data:
-
Start From: choose
earliestto start synchronizing from the oldest data in the topic, orlatestto start synchronizing from the newest data in the topic -
Client ID: specify a unique client ID for this synchronization task
-
-
Retain the default values for other parameters and click Add.
After a few minutes, check the database on your cloud instance and verify that data is being synchronized. You can repeat this procedure to synchronize multiple TDengine Enterprise instances at the edge with a single cloud instance, aggregating your data for easier management and analytics.
