Skip to content

Workshop Review

The workshop built and validated a Streaming Integration Platform environment around a Synergy ISAM system of record. It demonstrated the complete flow from application data, through change data capture and snapshots, to ISAM, SQL Server, and JSON consumers.

Work completed

  • Configured the Linux workshop environment, host name resolution, TLS trust, service account, installation defaults, and working directories.
  • Installed and configured Configuration Server, the Base Environment, Message Broker, Snapshot Agent, ISAM Agent, SQL Agent, and JSON Agent.
  • Created the required Redpanda topics:
    • DEFAULT_CDC
    • DEFAULT_CDC_JSON
    • DEFAULT_SNAPSHOT_REQUEST
    • DEFAULT_SNAPSHOT_RESPONSE
  • Configured Kafka, RustFS S3 storage, SQL Server, email notifications, logging, snapshot locations, and agent settings through Configuration Server.
  • Installed MetaDataTool and generated metadata for the workshop application.
  • Configured nine application data files: Customer, Employee, Inventory, Order, Orderline, Shipto, User, Vendor, and Warehouse.
  • Generated and deployed the helper assemblies required by the SQL and JSON Agents.
  • Granted the Snapshot Agent read-only access to the system-of-record data.

Snapshot and replication validation

Both snapshot formats were exercised:

  • An ISAM counted snapshot was created, compressed, uploaded to RustFS, and announced through Kafka.
  • A SQL Parquet snapshot was created and uploaded to RustFS.
  • The ISAM Agent restored the snapshot into a local replica data set.
  • The SQL Agent restored the snapshot into SQL Server tables.
  • All agents reached a READY state and began monitoring the CDC topic.

The workshop then demonstrated real-time replication:

  1. A customer record was updated in the Workshop Client Application.
  2. The Message Broker published a CDC message containing the updated and original record data.
  3. The JSON Agent transformed the message and published it to DEFAULT_CDC_JSON.
  4. The ISAM Agent applied the update to its local replica.
  5. The SQL Agent applied the update to the SQL Server replica.

A bulk inventory price change was also performed, generating several thousand CDC messages. The agent consoles confirmed that the ISAM, SQL, and JSON Agents processed the same change stream and reached the same CDC offset.

Key outcomes

The workshop demonstrated how Streaming Integration Platform provides:

  • Centralized configuration and certificate distribution.
  • Snapshot-based initial hydration of replica systems.
  • CDC-based real-time synchronization.
  • Replication from Synergy ISAM data to ISAM and SQL Server targets.
  • Transformation of CDC data into JSON for downstream consumers.
  • Administrative web interfaces and REST APIs for monitoring and control.
  • Operational visibility through logs, status, activity, snapshot, and data views.

Production considerations

Before deploying in a production environment, establish automated snapshot scheduling and monitoring, ensure snapshots remain newer than the CDC retention window, secure all credentials and certificates, and replace workshop defaults with production-specific values.