Become a member of our daily and weekly newsletters for the latest updates and exclusive content about leading AI coverage. Leather
For everyone in AI it is not big news that “data is the real price.” If you have strong data foundations, your models and the applications they have driven will have the same on the money.
But that’s where it gets messy. Building that basis is not a piece of cake, especially if there are dozens of data sources, each host valuable information. You must build and maintain integration pipelines for each source -a huge technical burden for data teams that juggle with different ETL tools to centralize what is needed to supply AI workloads with power. On a scale, these pipelines are rigid bottlenecks – difficult to adjust, expand or expand.
Snowflake thinks it has an answer.
Nowadays, the company has announced the general availability of OpenFlow at its annual top – a fully managed data innovation service that extracts any type of data from almost every source, so that the process of mobilizing information for fast AI implementation is streamlined.
How does it work?
OpenFlow is powered by Apache NiFi and uses connectors – front building or customized – with Snowflake’s embedded governance and safety. Whether it is about unstructured multimodal content of Box of Real-Time Event Streams, open flow plugs, unites and makes all data types directly available in Snowflake’s AI Data Cloud.
“Dataing engineers were often confronted with a critical assessment -if they wanted very controllable pipelines, they came across complexity and significant infrastructure management. If they wanted a simple solution, they came across problems of limited privacy, flexibility and adjustment. Openflow meets customers where their data and the guarantee of security, it provides and providing it Governance, “Chis Child, VP of product, data engineering, on the road, on the road, in the field of snow protection.
Although Snowflake Intame options such as SnowPipe has offered for streaming or individual connectors, OpenFlow provides an “extensive, effortless solution for taking almost all company data.”
“Snowflake’s Snowpipe and Snowpipe streaming remain an important basis for customers who bring data in Snowflake and concentrate on the ‘load’ of the ETL process. OpenFlow, on the other hand, deals with the extraction of data directly from source systems, then the transformation and charging processes. HetststeMaaming also integrated -also integrated -also integrated -also integrated -also integrated -also integrated – -architecture.
This ultimately unlocks new use cases where AI can analyze a complete picture of company data, including documents, images and real -time events, directly inside Snowflake. Once the insights have been extracted, they can return to the source system using the connector.
More than 200 available connectors
OpenFlow currently supports 200+ ready-made connectors and processors, with regard to services such as Box, Google Ads, Microsoft SharePoint, Oracle, Salesforce Data Cloud, Workday and Zendesk.
“Box’s integration with Snowflake OpenFlow … uses data extraction from box with box AI, honors the original permissions for safe access and feeds that data in snowflake for analysis. It also makes a two -way stream possible in which enriched insights or metadata can be written back to box, cus kus, box boxer in time,” Box.
Making new connectors only takes a few minutes, which means that the time is accelerated to appreciate. Users also receive security functions such as rolls-based authorization, coding in transport and secrets management to keep data end-to-end.
“Organizations that need real -time data integration, handling large amounts of data from different sources, or relying on unstructured data such as images, audio and video to collect value will take great advantage of OpenFlow,” Jilde added. For example, a retail company can unite Siled data from Sales, E -Commerce, CRM and Social Media to offer personalized experiences and optimized activities.
Snowflake customers Irwin, Securonix and Wormkave are among those set up to use open flow to move and scale worldwide data – although the company has not announced exact adoptien numbers.
What is the following?
If the next step, Snowflake OpenFlow wants the backbone of real-time, intelligent data movement on distributed systems-worth the age of AI agents.
“We focus on moving events on a large scale and making real-time, agent-to-agent-agent bidirectional communication, so insights and actions are seamlessly flowing over distributed systems. A cortex agent who hands over events from other systems, such as Serviceenow,” said Hildd.
The timeline for these upgrades now remains unclear.
