Scaling Information Belief and Collaboration with Monte Carlo and Atlan’s New Integration – Atlan


In line with a latest survey, information engineers are reporting practically twice as many information incidents this yr as final. On common, it takes 15 hours per incident to achieve a decision. And practically 75% of the time, enterprise stakeholders are the primary to determine information points. As information leaders know, when enterprise customers encounter information that’s lacking, faulty, or in any other case inaccurate, decision-making is compromised and belief in information erodes. 

That’s why we’re excited to announce that uniting various information crew personas to collectively guarantee information high quality simply acquired simpler, due to a brand new integration between Monte Carlo’s information observability platform and Atlan’s lively metadata platform

Collectively, these market main instruments make it attainable for firms that depend on information for a aggressive benefit to grasp and enhance information high quality, whereas guaranteeing information customers have all of the context they want, inside their current workflows, to make knowledgeable choices with information.

Monte Carlo offers groups end-to-end information observability via automated detection, alerting, and incident decision for information high quality points. Atlan is a house for various information groups, serving as a single supply of fact that prompts metadata throughout the fashionable information stack to allow new modalities of collaboration. And each platforms already present deep integrations throughout the fashionable information stack, together with Slack, Snowflake, dbt, Databricks, Sigma, and Fivetran. 

Now, these two platforms work in tandem to offer information groups with enhanced visibility into key information operations and granular insights for information asset discovery and exploration. Information customers can simply entry up-to-date details about the standard of knowledge belongings earlier than they use them, streamlining collaboration throughout the group whereas constructing belief in information. 

How companies can leverage Monte Carlo + Atlan

With Monte Carlo and Atlan, groups can achieve an up-to-date understanding of their information well being, construct belief in information, and assist progressive new methods to strategy distributed information infrastructure. 

Extending visibility into information well being

Groups utilizing Monte Carlo and Atlan can now rapidly perceive the well being of particular information belongings throughout their Information Property. Information standing updates in Atlan about information well being are knowledgeable by Monte Carlo, and information groups can now view screens and checks created for every manufacturing desk.

“Earlier than we modernized our information stack, our information monitoring was very reactive,” mentioned Michael Weiss, Senior Director of Product Administration (NAM, Information Entry and Analytics) at NASDAQ. “The pipeline would possibly succeed, however we wouldn’t know if the information was proper, unsuitable, or detached. With Monte Carlo and Atlan, we are able to catch information incidents early on, and supply everybody with clear visibility into the present standing of knowledge accuracy. That is proving precious and has been essential for the manager crew to believe we are able to ship on our promise of dependable, reliable information.” 

By extending visibility into information well being, information groups can work proactively to resolve points sooner and guarantee any impacted enterprise customers are conscious of potential downstream impacts.

Growing information belief and collaboration throughout the enterprise

With this new integration, information customers can view particulars of the newest information incidents and anomalies detected by Monte Carlo. This helps all information crew personas, no matter technical skillset,  to maintain shut tabs on the reliability of any given asset, based mostly on a standard metadata management aircraft.  

“With 1,600 workers serving over 1,000 purchasers with actionable, data-driven insights, we churn via large volumes of knowledge each day,” mentioned Kenza Zanzouri, Information Governance Strategist at Contentsquare. “Our inner groups are at all times centered on creating worth with new dashboards, fashions, or information explorations, so guaranteeing that information is dependable is important. With Monte Carlo and Atlan, we’ve been in a position to shift from guide checks and testing to automated information high quality protection—and make it readily obvious to enterprise customers when information belongings could also be impacted by high quality points. This helps us scale in the long run and enhance communication between departments.”

By dramatically enhancing visibility throughout information operations and streamlining communication, thereby enabling wider belief in information, information customers and engineers can work with information in additional environment friendly, collaborative, and progressive methods.

Enabling domain-oriented information administration

Ahead-thinking information organizations are more and more shifting to undertake distributed information architectures just like the information mesh. Monte Carlo and Atlan assist present these information groups with peace of thoughts about information reliability, which could be a problem when belongings are owned by area groups and accessible via self-serve entry.

“At BairesDev, we offer main companies all over the world with expertise groups on demand, and applied a knowledge mesh strategy to attain information high quality, availability, and efficiency throughout our group,” mentioned Matheus Espanhol, Information Engineering Supervisor at BairesDev. “Automation is an absolute necessity to attain sturdy information governance throughout decentralized domains. With Monte Carlo and Atlan working in tandem, we are able to automate information high quality requirements whereas sustaining visibility into how every crew follows world insurance policies and units native insurance policies inside the area.”

With end-to-end visibility into information well being and a centralized supply of fact, it’s now attainable for information groups to facilitate self-serve analytics with out compromising on governance and high quality requirements. 

How the combination works

With this new integration, Atlan and Monte Carlo work collectively seamlessly to centralize data and communication about information high quality. 

Information incidents detected by Monte Carlo will probably be surfaced in Atlan, with all of the context wanted to grasp precisely what and the place information has been impacted. When incidents are resolved, they’ll be cleared—which means a scarcity of incidents signifies all is nicely with a given asset. What’s extra, any Monte Carlo customized screens will probably be recorded as native belongings in Atlan, offering the road of sight for information customers to the underlying information high quality framework applied with Monte Carlo.  

By uniting a wider spectrum of knowledge personas, Monte Carlo and Atlan allow the activation of knowledge shopper enterprise context, such that this precious IP will be productionized to additional advance information belief and a deeper tradition of knowledge high quality.

The combination takes 5 minutes or fewer to configure, with no API use wanted, and all information is obtainable through the Atlan Chrome extension. This implies groups can entry wealthy metadata context instantly within the workflows the place they use the underlying belongings, similar to Information Clouds, Lakehouses, Warehouses, and in style Enterprise Intelligence tooling 

Get began right this moment

To study extra about constructing belief in information with Monte Carlo and Atlan, discover our documentation. 
Create an account-service API key

Configure the combination in 5 minutes (with interactive walkthrough)

Metadata sourced from Monte Carlo

Prepared to begin enhancing your information high quality with end-to-end information observability and cataloging? Attain out to request a Monte Carlo demo to see information observability in motion or begin a free trial with Atlan to see information collaboration work.