We're introducing the new Google Drive Connector for Conduit, a destination-only connector that enables you to stream files directly into Google Drive from your Conduit pipelines. This is ideal for backing up data, sharing generated documents, or integrating file output into cloud workflows.
Today, we released Conduit DynamoDB Connector v0.3.0, adding the ability to connnect to the source connector with a session token via aws.sessionToken to help those users who can't use IAM roles.
Conduit Postgres Connector v0.12.0 is now available, and it will be part of the next Conduit release as a builtin connector, making use of the the new Connector SDK ReadN method, and adding validation for the logical replication slot name.
Conduit RabbitMQ Connector v0.3.0 was released today, propagating AMQP 0.9 headers via OpenCDC headers, and with a breaking change on the routingKey, but this will make it more flexible to use with other connectors by utilizing Go templates.
Ecdysis v0.4.2 was released and will be part of the next Conduit release fixing an issue with the environment variable CONDUIT_CONFIG_PATH.
Conduit v0.13.4 is out and comes with a couple of configuration fixes.
Today, we released Benchi, a minimal yet powerful benchmarking framework that makes it easy to configure and run performance benchmarks for any tool.
We are using Benchi to run performance benchmarks for Conduit and other data streaming tools, ensuring that all tools are tested under the same conditions and that the results are comparable. Check out how we use it in the Streaming Benchmarks repository.
Today, we released a new version of Conduit v0.13.3, adding new builtin processors and fixing a bug when using batching delay on the connector with an older version of our Conduit Connector SDK.
If you're experiencing a validation issue when using sdk.batch.delay, make sure your connector is using at least Conduit Connector SDK v0.13.2.
Today, we released Conduit v0.13.2 to fix the possibility of building custom Conduit applications after the introduction of our Conduit CLI.
Check out this page for more information on how to build custom Conduit applications.
We're introducing the new MySQL Connector for Conduit, which allows extraction of data from and loading data into MySQL databases. This connector supports dual operation modes, including snapshot and Change Data Capture (CDC) for the source connector, as well as a destination connector for upserting records.