{"id":345107,"date":"2026-10-09T10:00:32","date_gmt":"2026-10-09T10:00:32","guid":{"rendered":"https:\/\/scanda.com.mx\/?p=345107"},"modified":"2026-10-12T20:54:57","modified_gmt":"2026-10-12T20:54:57","slug":"como-evitar-data-swamp-controles-data-lake","status":"publish","type":"post","link":"https:\/\/scanda.com.mx\/en\/how-to-avoid-data-swamp-controls-for-data-lakes\/","title":{"rendered":"How to prevent your data lake from turning into a data swamp: 6 essential controls?"},"content":{"rendered":"<p class=\"wp-block-paragraph\">A data lake becomes <strong>data swamp<\/strong> When it accumulates information without a catalog, owner, quality controls, lineage, permissions, or lifecycle. To avoid this, six operational controls are required: ownership, metadata, layered quality, traceability, security, and economic management. The goal is not to store more data, but to maintain reliable, findable, and usable data for analytics and AI.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Taxonomic definitions<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>1. Data lake<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Repository designed to store large volumes of structured, semi-structured, and unstructured information, typically storing data in formats close to their original state. Its flexibility allows for integrating multiple sources for analytics, data science, and artificial intelligence.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>2. Data swamp<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It is a data lake that lost its governance: users no longer know for sure <strong>what it contains, where each piece of data comes from, which version is valid, who is responsible, and whether it can be used<\/strong>. Google Cloud explicitly identifies this risk when the data loaded into a lake is not properly cataloged, managed, and governed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>3. Data lineage<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The registration of where a data originates, how it is transformed, why it passes through systems and where it ends up being used. Microsoft points out that lineage enables supporting quality analysis, compliance, fault diagnosis, and the impact of changes.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Comparative table<\/strong><\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><td><strong>Variable<\/strong><\/td><td><strong>Governed data lake<\/strong><\/td><td><strong>Data swamp<\/strong><\/td><td><strong>Business impact<\/strong><\/td><\/tr><\/thead><tbody><tr><td>Discovery<\/td><td>The datasets are cataloged and searchable.<\/td><td>The data exist, but no one knows where they are.<\/td><td>Hours of lost time for analysts and engineers searching for information<\/td><\/tr><tr><td>Ownership<\/td><td>Each asset has a responsible person<\/td><td>The datasets become \u201corphaned\u201d<\/td><td>Unowned problems and longer resolution time<\/td><\/tr><tr><td>Quality<\/td><td>Automatic rules before consumption<\/td><td>Quality is revealed in the report<\/td><td>Rework, wrong decisions and less confidence<\/td><\/tr><tr><td>Lineage<\/td><td>The source, transformation and consumer are known.<\/td><td>The origin of a figure requires manual research.<\/td><td>Slow audits and changes with greater risk<\/td><\/tr><tr><td>Security<\/td><td>Classification and minimum privilege<\/td><td>Inherited permissions and excessive access<\/td><td>Information and regulatory risk exposure<\/td><\/tr><tr><td>Life cycle<\/td><td>Defined retention, filing and deletion<\/td><td>Everything is kept \u201cjust in case it might be useful someday\u201d<\/td><td>Continued growth in storage and risk surface area<\/td><\/tr><tr><td>Economy<\/td><td>Cost is measured per product\/use case<\/td><td>Only the total platform bill is known.<\/td><td>ROI difficult to defend before Finance<\/td><\/tr><tr><td>Consumption<\/td><td>There are certified datasets for business<\/td><td>Each area creates its own version<\/td><td>Different figures for the same question<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Technical team<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>What turns a data lake into a data swamp?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The problem rarely starts with technology. It starts with an apparently innocent premise:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u201cLet\u2019s keep everything for now; we\u2019ll see later what it\u2019s for.\u201d<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At first it works. The storage is relatively inexpensive and adding a new source seems simple. The problem appears when the number of systems, tables, files, users and transformations increases.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Then the uncomfortable questions begin:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Which of these five customer records is correct?<\/li>\n\n\n\n<li>Who is responsible for updating this dataset?<\/li>\n\n\n\n<li>Did this figure come from the ERP or was it modified later?<\/li>\n\n\n\n<li>What exactly does this field mean?<\/li>\n\n\n\n<li>When was it last updated?<\/li>\n\n\n\n<li>Does it contain personal information?<\/li>\n\n\n\n<li>Which dashboards would stop working if we changed the structure?<\/li>\n\n\n\n<li>Why do we keep paying for storage and processing for data that nobody ever looks at?<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">That is the point at which the data lake stops reducing friction and begins to generate it.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At <strong>MaIA by Scanda<\/strong> We address that problem within Data Intelligence: we do not treat the data repository as an isolated storage project, but as a capability that must be integrated. <strong>MDM, government, quality, multiple sources and analytics<\/strong> to produce reliable decisions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Google Cloud sums up the technical issue well: loading information without cataloguing it, managing it, and governing it can turn a data lake into a data swamp where the data becomes difficult to find, trust, and use.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The difference, therefore, is not in how many terabytes can be stored. It is in how much of the stored data can be converted into reliable decisions.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Control 1: no data enters without owner, purpose and contract<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The first defense against the data swamp occurs <strong>before storing the data<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Each new source should be entered through a minimum onboarding contract that identifies:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>business owner;<\/li>\n\n\n\n<li>Technical owner;<\/li>\n\n\n\n<li>system of origin;<\/li>\n\n\n\n<li>business purpose;<\/li>\n\n\n\n<li>the domain to which it belongs;<\/li>\n\n\n\n<li>expected structure or scheme;<\/li>\n\n\n\n<li>update frequency;<\/li>\n\n\n\n<li>level of sensitivity;<\/li>\n\n\n\n<li>expected consumers;<\/li>\n\n\n\n<li>retention policy;<\/li>\n\n\n\n<li>minimum quality standards;<\/li>\n\n\n\n<li>SLA or expected availability.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>The operational rule<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Data without an owner is not an asset: it is a future debt.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A file can physically exist for years without anyone wanting to take responsibility for its semantics, updates, or quality. When that happens, every new project must re-investigate the data from scratch.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Financial impact<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Without ownership, the cost appears in the form of:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>hours of engineering to understand existing datasets;<\/li>\n\n\n\n<li>duplicated pipelines;<\/li>\n\n\n\n<li>manual reconciliations;<\/li>\n\n\n\n<li>delays in BI and AI projects;<\/li>\n\n\n\n<li>model rework;<\/li>\n\n\n\n<li>decisions built on different sources.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">That expense rarely appears as a line called \u201cdata swamp.\u201d It appears spread across payroll, consulting, cloud, and delayed projects. That\u2019s why it ends up affecting the <strong>Data and AI ROI and, eventually, EBITDA<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Control 2: cataloging and metadata from ingestion<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Keeping a file does not mean knowing that it exists.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A governed data lake needs a catalog that describes its information assets. At a minimum, each productive dataset should include:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>understandable name;<\/li>\n\n\n\n<li>business description;<\/li>\n\n\n\n<li>owner;<\/li>\n\n\n\n<li>source system;<\/li>\n\n\n\n<li>domination;<\/li>\n\n\n\n<li>scheme;<\/li>\n\n\n\n<li>date of last update;<\/li>\n\n\n\n<li>sensitivity;<\/li>\n\n\n\n<li>access policy;<\/li>\n\n\n\n<li>expected frequency;<\/li>\n\n\n\n<li>consumers;<\/li>\n\n\n\n<li>relationships with other datasets;<\/li>\n\n\n\n<li>lineage.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">AWS uses the catalog precisely as the central piece for storing and managing metadata from a data lake and linking them with access controls.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>The catalog must be operational, not just a document.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A common mistake is to build a catalog as a separate project and then ask the teams to maintain it manually.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That gets old fast.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The alternative is to capture metadata <strong>during the actual ingestion and transformation<\/strong>. When a new dataset appears, its schema, location, date, origin, and technical relationships must also appear automatically.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Then the human layer is added: business meaning, owner, and usage rules.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Indicator that we recommend monitoring<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In our diagnostic model we also observe the <strong>number of versions of the same figure<\/strong>, The percentage of integrated sources and the time it takes for a data point to become a decision are very direct signals of whether the architecture is reducing or increasing friction.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If Finance, Commercial and Operations present three different values for \u201cnet sales\u201d, the problem is not the dashboard. The problem is deeper down.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Control 3: data quality by layers, not at the end<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Quality should not be validated when the CFO opens the report.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It must be verified as the data progresses through the architecture.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A widely used practice is to separate the layers according to their degree of preparation:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Bronze: keep the original data<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The Bronze layer receives information practically as it arrives from the source.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It should serve to:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>preserve history;<\/li>\n\n\n\n<li>allow reprocessing;<\/li>\n\n\n\n<li>keep evidence of the original data;<\/li>\n\n\n\n<li>audit subsequent changes.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">It should not be the official source of business indicators.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Silver: clean, validate and standardize<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Here, controls must be implemented such as:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>schema validation;<\/li>\n\n\n\n<li>treatment of null values;<\/li>\n\n\n\n<li>duplication;<\/li>\n\n\n\n<li>normalization;<\/li>\n\n\n\n<li>unit standardization;<\/li>\n\n\n\n<li>reference rules;<\/li>\n\n\n\n<li>resolution of late registrations;<\/li>\n\n\n\n<li>Quarantine of invalid records.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">Databricks recommends precisely an architecture in which the data evolves from <strong>Bronze \u2014raw\u2014, Silver \u2014validated\u2014 and Gold \u2014ready for business\u2014<\/strong>, By progressively increasing its quality and reliability.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Gold: publish reliable business products<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Here the data prepared for:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>executive dashboards;<\/li>\n\n\n\n<li>financial indicators;<\/li>\n\n\n\n<li>analytical models;<\/li>\n\n\n\n<li>applications;<\/li>\n\n\n\n<li>AI cases;<\/li>\n\n\n\n<li>Operational decisions.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">The rule is simple:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Raw does not mean bad; it means not certified for commercial consumption.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The error occurs when an organization allows any application or user to access any layer without distinguishing between received, validated, and certified data.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Control 4: lineage and observability from end to end<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If a field in the ERP changes, the data team should know about it before doing so:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>which pipelines depend on it;<\/li>\n\n\n\n<li>which tables will be changed;<\/li>\n\n\n\n<li>which indicators consume it;<\/li>\n\n\n\n<li>what AI models use that information;<\/li>\n\n\n\n<li>Which executive reports could be affected.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">That requires lineage.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft describes lineage as the cycle that allows tracking data from its origin and understanding how it moves and transforms, using it for root cause analysis, quality, compliance, and impact.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>But lineage alone is not enough<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The behavior of the data must also be observed.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A serious control should monitor:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>last update;<\/li>\n\n\n\n<li>delay against the expected frequency;<\/li>\n\n\n\n<li>received volume;<\/li>\n\n\n\n<li>schematic changes;<\/li>\n\n\n\n<li>percentage of records rejected;<\/li>\n\n\n\n<li>duplicates;<\/li>\n\n\n\n<li>values outside the range;<\/li>\n\n\n\n<li>pipeline failures;<\/li>\n\n\n\n<li>quality degradation;<\/li>\n\n\n\n<li>datasets without consumption.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Example<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Suppose the historical average daily sales is 150,000 records.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Suddenly there are 18,000.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The pipeline can technically be finished with a state <strong>\u201csuccess\u201d<\/strong>.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">From the infrastructure point of view, everything worked.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">From a business perspective, probably not.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Data observability must detect that difference. A successful process does not guarantee reliable data.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Control 5: classification and access with minimum privilege<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A data swamp not only creates analytical problems; it also expands the surface area of exposure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The organization needs to know:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>what data are public;<\/li>\n\n\n\n<li>which ones are internal;<\/li>\n\n\n\n<li>which are confidential;<\/li>\n\n\n\n<li>which contain personal information;<\/li>\n\n\n\n<li>what information requires additional protection;<\/li>\n\n\n\n<li>who can consult each category;<\/li>\n\n\n\n<li>who can modify it;<\/li>\n\n\n\n<li>who can export it.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">AWS Lake Formation, for example, allows you to separate permissions on metadata and on the underlying data, as well as apply granular access to databases, tables, columns, rows, and cells.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>The inherited permissions error<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The dangerous pattern is:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u201cGive him access to the full bucket because he needs a table.\u201d<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Over time, dozens of exceptions, privileged accounts, and permissions appear, the original reason for which no one remembers.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The correct control is:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>minimum privilege;<\/li>\n\n\n\n<li>role-based or attribute-based access;<\/li>\n\n\n\n<li>sensitivity classification;<\/li>\n\n\n\n<li>periodic reviews;<\/li>\n\n\n\n<li>traceability of access;<\/li>\n\n\n\n<li>automatic revocation when the need disappears.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">In our framework, preparing information for AI specifically includes cataloging sensitive information, correcting inherited permissions, reviewing privileges, and mapping sources before enabling new use cases.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Financial impact<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The poor ranking increases:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>regulatory risk;<\/li>\n\n\n\n<li>cost of audit;<\/li>\n\n\n\n<li>cost of research in the face of incidents;<\/li>\n\n\n\n<li>potential scope of a leak;<\/li>\n\n\n\n<li>Time required to deploy new AI cases.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">When Security does not trust the repository, each initiative takes longer to be approved. That delay also has a cost.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Control 6: Life cycle and data economy<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">\u201cStoring is cheap\u201d can be a bad government policy.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The problem isn't just how much it costs to store a terabyte. You also have to pay for:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>copies;<\/li>\n\n\n\n<li>supports;<\/li>\n\n\n\n<li>processing;<\/li>\n\n\n\n<li>consultations;<\/li>\n\n\n\n<li>movement;<\/li>\n\n\n\n<li>cataloguing;<\/li>\n\n\n\n<li>protection;<\/li>\n\n\n\n<li>auditing;<\/li>\n\n\n\n<li>maintenance;<\/li>\n\n\n\n<li>engineering.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">That is why each category of information needs a lifecycle policy.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Define from the beginning<\/strong><\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>How long it remains active;<\/li>\n\n\n\n<li>when it is transferred to less expensive storage;<\/li>\n\n\n\n<li>How long it should be kept;<\/li>\n\n\n\n<li>when it is deleted;<\/li>\n\n\n\n<li>which regulation requires its retention;<\/li>\n\n\n\n<li>which event allows it to be destroyed;<\/li>\n\n\n\n<li>who authorizes exceptions.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">AWS S3 enables you to automate transitions to lower-cost storage classes and remove expired objects through lifecycle policies. Microsoft also recommends aligning storage levels and retention policies with actual access patterns to control costs.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Don't just measure storage<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The most useful KPI is not:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u201cWe have 300 TB.\u201d<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It is asking:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>How much does it cost to maintain each data product?<\/li>\n\n\n\n<li>How much does it cost to process it each month?<\/li>\n\n\n\n<li>How many active consumers does it have?<\/li>\n\n\n\n<li>When was it last consulted?<\/li>\n\n\n\n<li>What result does it support?<\/li>\n\n\n\n<li>How many copies exist?<\/li>\n\n\n\n<li>Which part can be archived or withdrawn?<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">A dataset that no one uses but is processed every night is a small recurring charge. Thousands of them are already a financial decision.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>How to measure whether the data lake remains under control<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At MaIA by Scanda, we believe that good governance should be measurable. Our Data Intelligence model is focused on turning governed data into reliable decisions by integrating quality, governance, MDM, and multiple sources.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">An executive dashboard of the data lake should focus on indicators such as:<\/p>\n\n\n\n<figure class=\"wp-block-table\"><table class=\"has-fixed-layout\"><thead><tr><td><strong>KPI<\/strong><\/td><td><strong>What it reveals<\/strong><\/td><\/tr><\/thead><tbody><tr><td>% productive datasets with owner<\/td><td>If there is real responsibility<\/td><\/tr><tr><td>% of assets with complete mandatory metadata<\/td><td>If the catalog can be used<\/td><\/tr><tr><td>% from critical sources with lineage<\/td><td>If impact analyses can be carried out<\/td><\/tr><tr><td>Compliance rate of quality rules<\/td><td>If the data arrives reliable<\/td><\/tr><tr><td>Freshness versus SLA<\/td><td>If they arrive while they are still serving<\/td><\/tr><tr><td>Number of versions of the same metric<\/td><td>If there is a source of truth<\/td><\/tr><tr><td>% of datasets without consumption<\/td><td>How much data debt exists<\/td><\/tr><tr><td>Cost per data product<\/td><td>If architecture scales economically<\/td><\/tr><tr><td>Given time \u2192 decision<\/td><td>If the data really improves business speed<\/td><\/tr><tr><td>% of classified sensitive information<\/td><td>If the risk is under control<\/td><\/tr><\/tbody><\/table><\/figure>\n\n\n\n<p class=\"wp-block-paragraph\">AWS recommends setting quality thresholds, continuously evaluating them, integrating alerts, and making quality metrics visible to the consumers of each asset.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The most dangerous signal is not a bad metric.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">It's not having the metric.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Predictive conclusion<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The data swamp will be a bigger problem with the adoption of generative AI and corporate agents.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Before, poorly documented data could remain buried for years in a folder. Now, AI systems can find, summarize, combine, and use information at a much faster rate.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That changes the risk.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">An incorrect data can feed a model. Excessive permission can expose information. A contradictory definition can lead an agent to perform an action later on.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That is why the data lake government is no longer a storage discipline to become a <strong>Trustworthy infrastructure for AI<\/strong>. Google Cloud, in fact, already builds its catalog capabilities around metadata, quality, lineage, and business context for analytical applications and AI agents.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At <strong>MaIA by Scanda<\/strong> We work under the premise that it makes no sense to accelerate AI based on a foundation of data that no one can explain. Our CoE envisages a data platform governed by quality, security, and governance as cross-functional capabilities; not as activities that are added at the end of the project.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The question for a CIO should no longer be:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u201cHow much storage do we have available?\u201d<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The correct question is:<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>\u201cWhat percentage of our data can be found, understood, trusted, audited and used today without manual intervention?\u201d<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">That percentage will become increasingly closer to the percentage of data that can actually generate returns.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>CTA final of MaIA<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Your data doesn't need another repository. They need control.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If your teams are still reconciling numbers manually, unaware of which sources are official or have AI projects stalled due to quality issues, the next step is not to incorporate more technology.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At <strong>MaIA by Scanda<\/strong> We can evaluate the architecture, quality, catalog, governance, and flow of your data to identify what is hindering its use in analytics and artificial intelligence.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Transform your data lake into a reliable data platform for decision-making and AI, before further information accumulation increases the cost of the problem.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>Schedule a Data Intelligence session with MaIA by Scanda.<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>FAQ<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>1. How do I know if my data lake has already become a data swamp?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">There are five particularly clear signs: there are multiple versions of the same information, users don\u2019t know which dataset to use, there are no owners, the analyses require manual reconciliation, and no one can easily explain the source of a figure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">A practical test consists of asking the team to find the official customer dataset, identify its owner, explain its origin, and show its latest update. If it takes several calls and messages to respond, the problem already exists.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>2. Do I need to replace my data lake to fix a data swamp?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Not necessarily.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In many cases the problem is not the platform but the lack of controls. It can be corrected by incorporating cataloging, lineage, ownership, classification, quality rules, layered architecture, and lifecycle management over the existing infrastructure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">At MaIA by Scanda, we prefer to first diagnose the underlying problem. Switching platforms without correcting governance practices often transfers the same problem to a new infrastructure.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\"><strong>3. How is investing in data governance financially justified?<\/strong><\/p>\n\n\n\n<p class=\"wp-block-paragraph\">The business case must be built against observable costs:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>hours spent reconciling information;<\/li>\n\n\n\n<li>duplication of pipelines;<\/li>\n\n\n\n<li>delayed reports;<\/li>\n\n\n\n<li>infrastructure without consumption;<\/li>\n\n\n\n<li>defects caused by quality;<\/li>\n\n\n\n<li>AI projects detained for data;<\/li>\n\n\n\n<li>time dedicated to audits;<\/li>\n\n\n\n<li>risk associated with sensitive information;<\/li>\n\n\n\n<li>decisions made with inconsistent figures.<\/li>\n<\/ul>\n\n\n\n<p class=\"wp-block-paragraph\">The discussion with Finance should not be about \u201chow much it costs to govern data,\u201d but <strong>How much it costs today not to be able to trust them<\/strong>.<\/p>","protected":false},"excerpt":{"rendered":"<p>Un data lake se convierte en data swamp cuando acumula informaci\u00f3n sin cat\u00e1logo, due\u00f1o, controles de calidad, linaje, permisos ni ciclo de vida. Para evitarlo se requieren seis controles operativos: ownership, metadatos, calidad por capas, trazabilidad, seguridad y gesti\u00f3n econ\u00f3mica. El objetivo no es almacenar m\u00e1s datos, sino mantener datos confiables, encontrables y utilizables para [&hellip;]<\/p>\n","protected":false},"author":3,"featured_media":345108,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_et_pb_use_builder":"off","_et_pb_old_content":"","_et_gb_content_width":"","content-type":"","footnotes":""},"categories":[1],"tags":[],"class_list":["post-345107","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-blog"],"_links":{"self":[{"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/posts\/345107","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/users\/3"}],"replies":[{"embeddable":true,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/comments?post=345107"}],"version-history":[{"count":1,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/posts\/345107\/revisions"}],"predecessor-version":[{"id":345109,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/posts\/345107\/revisions\/345109"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/media\/345108"}],"wp:attachment":[{"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/media?parent=345107"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/categories?post=345107"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/scanda.com.mx\/en\/wp-json\/wp\/v2\/tags?post=345107"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}