/

Blogue

Salesforce Account Ingestion

Salesforce Account Ingestion

Assurez une cohérence irréprochable entre tous vos produits de données

Assurez une cohérence irréprochable entre tous vos produits de données

Renata Hlavová

Data Engineer at Make

Ensure CRM account data ingested from Salesforce is structurally complete, fresh, and free of duplicates before it enters the transformation layer.

Data contract description

This data contract is used by Make, an AI automation platform, to validate Salesforce Account data at the point of ingestion into Snowflake, before any transformation runs. The ACCOUNTdataset is managed by the Business Processes & Automation (BPnS) team, which owns Salesforce operations. The contract enforces schema stability, data freshness, row count, and column-level checks, with critical failures routed automatically to the relevant Slack channel.

Dataset

Defines the dataset this contract applies to, including its source and scope. This is the single point of reference for what data is being validated and protected.

Dataset checks

Validations that apply to the dataset as a whole. This contract includes a schema check that allows flexible column ordering but flags unexpected structural changes, a row count check to ensure the dataset is not empty, and a freshness check that warns when data is more than two days old based on CREATED_AT. Critical checks notify the #dq-bpns Slack channel and are attributed to the BPnS team.

Column checks

Column-level rules that define required fields, uniqueness constraints, and value guardrails. This contract enforces that ID is not missing and not duplicated (both critical), that NAME is not missing (major), and that CREATED_AT is not missing (critical). It also applies maximum character length constraints to COMPANY_DOMAIN and COMPANY_DESCRIPTION. IS_DELETED is checked for missing values at minor severity. All critical and major column checks notify #dq-bpns.

salesforce_account_data_contract.yaml

dataset
checks:
  - schema:
      allow_other_column_order: true
      attributes:
        teams:
          - BPnS
        severity: critical
        notify:
          - '#dq-bpns'
  - row_count:
      name: Row count > 0
      attributes:
        teams:
          - BPnS
        severity: critical
        notify:
          - '#dq-bpns'
  - freshness:
      column: CREATED_AT
      threshold:
        level: warn
        unit: day
        must_be_less_than: 2
      attributes:
        teams:
          - BPnS
        severity


columns:
  - name: ID
    data_type: text
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'
      - duplicate:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'
  - name: IS_DELETED
    data_type: number
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: NAME
    data_type: text
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: major
            notify:
              - '#dq-bpns'
  - name: COMPANY_DOMAIN
    data_type: text
    checks:
      - invalid:
          name: Max character length
          valid_max_length: 255
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: COMPANY_DESCRIPTION
    data_type: text
    checks:
      - invalid:
          name: Max character length
          valid_max_length: 131000
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: CREATED_AT
    data_type: timestamp_tz
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'

Data contract description

This data contract is used by Make, an AI automation platform, to validate Salesforce Account data at the point of ingestion into Snowflake, before any transformation runs. The ACCOUNTdataset is managed by the Business Processes & Automation (BPnS) team, which owns Salesforce operations. The contract enforces schema stability, data freshness, row count, and column-level checks, with critical failures routed automatically to the relevant Slack channel.

Dataset

Defines the dataset this contract applies to, including its source and scope. This is the single point of reference for what data is being validated and protected.

Dataset checks

Validations that apply to the dataset as a whole. This contract includes a schema check that allows flexible column ordering but flags unexpected structural changes, a row count check to ensure the dataset is not empty, and a freshness check that warns when data is more than two days old based on CREATED_AT. Critical checks notify the #dq-bpns Slack channel and are attributed to the BPnS team.

Column checks

Column-level rules that define required fields, uniqueness constraints, and value guardrails. This contract enforces that ID is not missing and not duplicated (both critical), that NAME is not missing (major), and that CREATED_AT is not missing (critical). It also applies maximum character length constraints to COMPANY_DOMAIN and COMPANY_DESCRIPTION. IS_DELETED is checked for missing values at minor severity. All critical and major column checks notify #dq-bpns.

salesforce_account_data_contract.yaml

dataset
checks:
  - schema:
      allow_other_column_order: true
      attributes:
        teams:
          - BPnS
        severity: critical
        notify:
          - '#dq-bpns'
  - row_count:
      name: Row count > 0
      attributes:
        teams:
          - BPnS
        severity: critical
        notify:
          - '#dq-bpns'
  - freshness:
      column: CREATED_AT
      threshold:
        level: warn
        unit: day
        must_be_less_than: 2
      attributes:
        teams:
          - BPnS
        severity


columns:
  - name: ID
    data_type: text
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'
      - duplicate:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'
  - name: IS_DELETED
    data_type: number
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: NAME
    data_type: text
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: major
            notify:
              - '#dq-bpns'
  - name: COMPANY_DOMAIN
    data_type: text
    checks:
      - invalid:
          name: Max character length
          valid_max_length: 255
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: COMPANY_DESCRIPTION
    data_type: text
    checks:
      - invalid:
          name: Max character length
          valid_max_length: 131000
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: CREATED_AT
    data_type: timestamp_tz
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'

Data contract description

This data contract is used by Make, an AI automation platform, to validate Salesforce Account data at the point of ingestion into Snowflake, before any transformation runs. The ACCOUNTdataset is managed by the Business Processes & Automation (BPnS) team, which owns Salesforce operations. The contract enforces schema stability, data freshness, row count, and column-level checks, with critical failures routed automatically to the relevant Slack channel.

salesforce_account_data_contract.yaml

dataset
checks:
  - schema:
      allow_other_column_order: true
      attributes:
        teams:
          - BPnS
        severity: critical
        notify:
          - '#dq-bpns'
  - row_count:
      name: Row count > 0
      attributes:
        teams:
          - BPnS
        severity: critical
        notify:
          - '#dq-bpns'
  - freshness:
      column: CREATED_AT
      threshold:
        level: warn
        unit: day
        must_be_less_than: 2
      attributes:
        teams:
          - BPnS
        severity


columns:
  - name: ID
    data_type: text
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'
      - duplicate:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'
  - name: IS_DELETED
    data_type: number
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: NAME
    data_type: text
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: major
            notify:
              - '#dq-bpns'
  - name: COMPANY_DOMAIN
    data_type: text
    checks:
      - invalid:
          name: Max character length
          valid_max_length: 255
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: COMPANY_DESCRIPTION
    data_type: text
    checks:
      - invalid:
          name: Max character length
          valid_max_length: 131000
          attributes:
            teams:
              - BPnS
            severity: minor
  - name: CREATED_AT
    data_type: timestamp_tz
    checks:
      - missing:
          attributes:
            teams:
              - BPnS
            severity: critical
            notify:
              - '#dq-bpns'

How to Enforce Data Contracts with Soda

Embed data quality through data contracts at any point in your pipeline.

Embed data quality through data contracts at any point in your pipeline.

# pip install soda-{data source} for other data sources

# pip install soda-{data source} for other data sources

pip install soda-postgres

pip install soda-postgres

# verify the contract locally against a data source

# verify the contract locally against a data source

soda contract verify -c contract.yml -ds ds_config.yml

soda contract verify -c contract.yml -ds ds_config.yml

# publish and schedule the contract with Soda Cloud

# publish and schedule the contract with Soda Cloud

soda contract publish -c contract.yml -sc sc_config.yml

soda contract publish -c contract.yml -sc sc_config.yml

Check out the CLI documentation to learn more.

Check out the CLI documentation to learn more.

How to Automatically Create Data Contracts.
In one Click.

Automatically write and publish data contracts using Soda's AI-powered data contract copilot.

Qualité des données IA basée sur la recherche

Nos recherches ont été publiées dans des revues et conférences de renom, telles que NeurIPs, JAIR et ACML. Les mêmes lieux qui ont fait progresser les fondations de GPT et de l'IA moderne.

Demande une démo

Explore more data contract templates

One new data contract template every day, across industries and use cases

Demande une démo

Produit

Solutions

Tarifs

Templates

Blogue

Log in

Demande une démo

4,4 sur 5

Commencez à faire confiance à vos données. Aujourd'hui.

Trouvez, comprenez et corrigez tout problème de qualité des données en quelques secondes.
Du niveau de la table au niveau des enregistrements.

Demande une démo

Adopté par

ⓒ 2025 Soda Data Inc. Tous droits réservés.

|

Conditions Générales

|

Politique de Confidentialité

AICPA SOC logo
Giga OM logo
TW logo
Gartner logo
High Performer 2025 badge
Best Roi 2025 badge
Momentum Leader 2025 badge

4,4 sur 5

Commencez à faire confiance à vos données. Aujourd'hui.

Trouvez, comprenez et corrigez tout problème de qualité des données en quelques secondes.
Du niveau de la table au niveau des enregistrements.

Demande une démo

Adopté par

ⓒ 2025 Soda Data Inc. Tous droits réservés.

|

Conditions Générales

|

Politique de Confidentialité

AICPA SOC logo
Giga OM logo
TW logo
Gartner logo
High Performer 2025 badge
Best Roi 2025 badge
Momentum Leader 2025 badge

4,4 sur 5

Commencez à faire confiance à vos données. Aujourd'hui.

Trouvez, comprenez et corrigez tout problème de qualité des données en quelques secondes.
Du niveau de la table au niveau des enregistrements.

Demande une démo

Adopté par

Qualité des données native AI

Product

Soda AI

Observabilité des données

Contrats de Données Collaboratifs

Alertes Intelligentes

Diagnostics au Niveau des Enregistrements

Traçabilité et impact

Entrepôt de diagnostics

Résolution automatisée au niveau des enregistrements

Réparation Automatisée des Pipelines

Solutions

Personas

Gouvernance des données

Architecte de Données

Consommateur de Données

Ingénieur Data

Responsable de la gouvernance des données

Cas d'utilisation

Opérationnaliser la Gouvernance des Données

Test de pipeline

Maillage de données

Migration vers le Cloud et Réconciliation

Conformité BCBS 239

Company

Tarifs

Opportunités de carrière

Opportunités de carrière

Boutique d'articles promotionnels

Boutique d'articles promotionnels

Ressources

Blogue

Documentation

Documentation

Webinaires

Événements

Notes de version

Slack

Contactez le Support

Blogue

Quelles sont les Dimensions de la Qualité des Données ?

Introduction à la Traçabilité des Données 101

Prévention des problèmes avec les Data Contracts

Observabilité et Tests des Données sur Databricks

ⓒ 2025 Soda Data Inc. Tous droits réservés.

Conditions Générales

Politique de Confidentialité

AICPA SOC logo
Giga OM logo
TW logo
Gartner logo
High Performer 2025 badge
Best Roi 2025 badge
Momentum Leader 2025 badge