Striim updates data streaming platform to help manage data pipelines
Data streaming and analytics company Striim released the 4.1 update to its real-time data integration and streaming Platform, featuring optimizations, new adapters, improved big data analytics, and workflow automation. Products such as Striim are needed to help build and manage data pipelines to make effective use of data for edge AI, for example.
For optimization, Striim Platform 4.1 added a smart application rebalance that enables customers to track the compute and memory resources consumed by their data pipelines, rebalance pipelines to servers with spare capacity, free up unused memory, and make it available to other data pipelines.
To accommodate high throughput data streams, Striim launched OJet, a change data capture (CDC) reader that can process several hundred gigabytes of data per hour from Oracle databases. For enterprises using Azure Cosmos DB, it also introduced two CDC adapters that can read data using the SQL API or the MongoDB API to support analytics and streaming use cases.
The Striim Platform 4.1 also includes real-time data pipelines that can read data stored in Parquet format on sources such as Amazon S3 and Hadoop File Systems. It can also write to targets such as Databricks Delta Lake, Snowflake, Azure Synapse, Google BigQuery, and Amazon Redshift. Striim says the Platform’s smart data pipelines convert data to match the format on the target side, which reduces customers’ setup and maintenance burden.
And to enhance collaboration, Striim can allow customers to send alerts and notifications to Slack channels for real-time reactions to data pipelines. It also adds workflow automation with automatic IT service tickets created on the incoming alert message through ServiceNow and PagerDuty.
“Striim is the only solution that delivers unified real-time data integration and SQL-driven data streaming to enable end-to-end smart data pipelines for digital transformation,” says Alok Pareek, executive vice president of products and engineering at Striim. “We’re bringing more to our customers: more performance and more scale so that they can continuously expand their data platforms to discover new meaning and relationships in their data to accelerate innovation.”
Striim also offers Cloud, a real-time data streaming solution that offers data integration as a fully managed software-as-a-service platform.
Article Topics
Azure | data pipeline | data streaming | edge AI | MongoDB | Striim
Comments