Automate e mail notifications for governance groups working with Amazon SageMaker Catalog

October 22, 2025

2

Amazon SageMaker Catalog simplifies the discovery, governance, and collaboration for information and AI throughout Information Lakehouse, AI fashions, and functions. With Amazon SageMaker Catalog, you possibly can securely uncover and entry permitted information and fashions utilizing semantic search with generative AI–created metadata or might simply ask Amazon Q Developer with pure language to search out their information.

Giant enterprise prospects have a number of traces of companies who produce and eat information utilizing a central SageMaker Information Catalog. Many purchasers have a central information governance group that’s liable for creating, publishing, and sustaining information governance requirements and greatest practices throughout the agency. Because the buyer’s information platform scales, it turns into difficult for the central governance group to take care of the requirements throughout all information producers and shoppers. Due to this, many governance groups want to watch person exercise in Amazon SageMaker Catalog to make sure information belongings are printed in keeping with established organizational governance requirements and greatest practices. On this situation, there’s a want for automation the place the central governance groups could be notified when essential occasions occur in Amazon SageMaker Catalog.

On this submit, we present you easy methods to create customized notifications for occasions occurring in SageMaker Catalog utilizing Amazon EventBridge, AWS Lambda, and Amazon Easy Notification Service (Amazon SNS). You possibly can broaden this answer to mechanically combine SageMaker Catalog with in-house enterprise workflow instruments like ServiceNow and Helix.

Resolution overview

The next answer structure exhibits how SageMaker Catalog integrates with different AWS companies like AWS IAM Id Heart, Amazon EventBridge, Amazon SQS, AWS Lambda, and Amazon SNS to generate automated notifications to seize essential occasions within the enterprise catalog.

A SageMaker Catalog person logs into Amazon SageMaker Unified Studio utilizing IAM Id heart. This might be a knowledge scientist, machine studying engineer, or analyst on the lookout for printed information units within the agency. AWS IAM Id heart ensures that solely licensed personnel can entry the cataloged belongings and ML sources.
Consumer performs an exercise inside SageMaker Catalog. Instance person creates a brand new venture or person searches for a knowledge asset and creates a subscription request to entry the asset.
Consumer occasions from SageMaker Catalog are captured in Amazon EventBridge. Amazon EventBridge is a completely managed, serverless occasion bus service designed that will help you construct scalable, event-driven functions throughout AWS, SaaS, and customized functions. Amazon EventBridge supplies the flexibility to filter occasions and permit customers to take motion on particular occasions.The next instance occasion sample in EventBridge filters DataZone create venture occasions.
```
{
  "supply": [
    "aws.datazone"
  ],
  "element": {
    "eventSource": [
      "datazone.amazonaws.com"
    ],
    "eventName": [
      "CreateProject"
    ]
  }
}
```
Amazon EventBridge sends the filtered occasions to Amazon SQS. Routing occasions to an SQS queue improves reliability and sturdiness. Amazon SQS acts as a buffer between Amazon EventBridge and AWS Lambda, decoupling occasion producers from shoppers. This permits your Lambda features to course of messages at their very own tempo, stopping overload throughout site visitors spikes or when downstream sources are quickly sluggish or unavailable. Amazon SQS supplies sturdy, persistent storage for occasions. If Lambda service is unavailable or throttled, messages stay within the queue till they are often efficiently processed, lowering the chance of information loss. There’s a Useless Letter Queue (DLQ) connected to the primary SQS queue. Attaching a DLQ to SQS ensures that any messages that may’t be processed after a number of makes an attempt are safely captured for inspection and troubleshooting, stopping them from blocking or endlessly circulating in the primary queue.
AWS Lambda operate reads the messages from SQS queue. Lambda operate codecs the notification primarily based in your wants.
AWS Lambda publishes the message to Amazon SNS. Finish customers and Central Governance group can subscribe to the SNS matter to obtain e mail alerts when an occasion occurs in SageMaker catalog.
Amazon CloudWatch integrates with AWS Lambda to watch efficiency, logs occasions, and may set off alarms if something goes awry, making certain your workflows run easily.

Conditions

That you must setup the next prerequisite sources:

An AWS account with a configured Amazon Amazon Digital Non-public Cloud (Amazon VPC) and base community.
An present SageMaker Unified Studio area (observe directions on Organising Amazon SageMaker Unified Studio).
Grant Lambda Entry in SageMaker Unified Studio (required for Publishing the belongings)
- Add the Lambda execution position as an IAM position in SageMaker Unified Studio.
- Assign the Lambda execution position to your venture throughout the SageMaker Unified Studio portal.

This configuration ensures that Lambda operate has the required authorization to entry Information Zone sources and efficiently publish belongings out of your SageMaker Unified Studio initiatives.

Code Deployment

Overview the directions on our GitHub repository to deploy the framework in your AWS account utilizing AWS CDK. The CDK provisions an event-driven notification structure for Amazon SageMaker Unified Studio, specializing in venture creation and asset publishing occasions.

Core AWS Assets Deployed – The next are the core AWS resourced deployed:

EventBridge Guidelines
- DataZoneCreateProjectRule: Captures DataZone venture creation occasions (CreateProject).
- DataZonePublishAssetRule: Captures DataZone asset publishing occasions (CreateListingChangeSet with PUBLISH motion for ASSET entity sort).
SQS Queue
- DataZoneEventQueue: Buffers DataZone occasions from EventBridge earlier than processing.
- Queue Coverage: Permits EventBridge to ship messages to the SQS queue.
Lambda Perform
- ProjectNotificationLambda: Processes messages from the SQS queue, retrieves occasion particulars from DataZone, and sends notifications to an SNS matter.
  - IAM Position: Grants permissions to entry SQS, SNS, CloudWatch Logs, and DataZone companies.
  - Occasion Supply Mapping: Triggers the Lambda operate for every SQS message.
SNS Subject
- LambdaSNSTopic: Receives notifications from the Lambda operate.
  - E-mail Subscriptions: Two e mail endpoints are subscribed to obtain notifications.
- Add your e mail ID to the SNS matter. You’ll obtain an e mail to request for subscription, click on on ‘Verify Subscription’
Permissions
- Amazon EventBridge sends occasions to SQS (requiring SQS permissions), Lambda ballot reads messages from Amazon SQS (requiring Lambda position in SQS permissions), and Lambda publishes to Amazon SNS (requiring SNS permissions).
- IAM Insurance policies: Lambda execution position has crucial permissions for SQS, SNS, logging, and Information Zone operations.

Outputs Supplied (CloudFormation Output)

Amazon SNS Subject ARN: For notification publishing.
Amazon SQS Queue ARN: For occasion buffering.
AWS Lambda Perform ARN: For occasion processing.
Amazon EventBridge Rule ARNs: For each asset publishing and venture creation occasions.

Venture Creation Notification

Execute the next steps to login to SageMaker Unified Studio and create a venture.

Login to SageMaker Unified Studio Console. This takes you to Amazon SageMaker Unified Studio area login display screen (SSO and IAM sign-in choices).
Select Create Venture on SageMaker Unified Studio login web page.
Select a venture title of your selection, reminiscent of ‘My_Demo_Project’. In Venture profile, choose ‘All-Capabilities’.
Select Proceed. Maintain the whole lot as default.
Select Proceed. On subsequent web page, create on ‘Create venture’.
Venture creation ultimate display screen
E-mail Notification. As soon as venture creation is profitable, it is best to see an e mail notification despatched by the above deployed automation.

Asset Publish Notification

To publish a pattern asset in SageMaker Unified Studio.

Lambda Permissions
After the CDK Stack creates the Lambda execution position ‘DatazoneStack-LambdaExecutionRole’, use the next process to combine this position into your SageMaker Studio venture. This integration permits Lambda features to work together with DataZone API in SageMaker Unified Studio venture.
1. Login to SageMaker Unified studio utilizing SSO, click on on Members, Add members.
2. Discover the position ‘DatazoneStack-LambdaExecutionRole’ and add as a ‘Contributor’
  
  The LambdaExecutionRole (-LambdaExecutionRole) has been added as a member to a venture in SageMaker Unified Studio.
Create Asset
1. In your venture ‘My_Demo_Project’, click on on Information. Select the plus signal so as to add a knowledge set.
2. Add your CSV file utilizing the pattern ‘Product_v6.csv’ discovered within the checkout folder of the ‘sample-sagemaker-unified-studio-governance-notifications’ GitHub repository.
3. Use desk sort as S3/exterior desk.
4. Overview and make sure that the column/attribute names within the uploaded CSV file.
5. Examine the Glue database(glue_db_) to verify that the desk has been created and correctly imported
Publish Asset
1. Choose the asset, select Actions and Publish to Catalog.
2. View the printed asset under.
3. Within the Venture Catalog’s Belongings part, find the highlighted entry and confirm the printed desk’s title
4. Select the asset title to show extra particulars and properties concerning the desk/asset.
E-mail Alerts
1. As soon as the asset is printed to SageMaker Unified studio, you’ll obtain an e mail alert despatched with particulars of the printed asset. Central governance groups can use this alert to evaluation the printed asset to make sure it aligns with the enterprise requirements.
  
  E-mail alerts are despatched to inform customers when belongings have been printed

Cleanup

To scrub up your sources, full the next steps:

Conclusion

On this submit, you realized easy methods to construct an automatic notification system for Amazon SageMaker Unified Studio utilizing AWS companies. Particularly, we lined:

How one can arrange event-driven notifications from Amazon SageMaker Unified Studio leveraging Amazon EventBridge, AWS Lambda, and Amazon SNS
The step-by-step strategy of deploying the answer utilizing AWS CDK
Sensible examples of monitoring essential occasions like venture creation and asset publishing
How one can combine AWS Lambda permissions with SageMaker Unified Studio for safe operations
Greatest practices for implementing governance controls via automated notifications

Amazon SageMaker Catalog helps governance groups keep knowledgeable of catalog actions in real-time, enabling them to take care of organizational requirements as their Information and ML platforms scale. The structure is versatile and could be prolonged to combine with enterprise workflow instruments like ServiceNow or to watch extra occasion varieties primarily based in your group’s wants.

We sit up for listening to the way you adapt this answer to your group’s governance wants. Fork the CDK code from our repository and share your implementation expertise within the feedback under