🚀 Project 7: Serverless Event-Driven Image Intake Pipeline
✅ Status: Live and Operational
📋 Project Overview
A fully serverless, event-driven architecture for automated image processing with metadata extraction, storage, and real-time notifications. This project demonstrates enterprise-grade serverless design patterns and AWS best practices.
🏗️ Architecture Diagram
🏗️ Architecture Components
📁 S3 Upload Bucket: project-7-serverless-event-upload
Triggers Lambda function on image uploads (.jpg, .png)
Triggers Lambda function on image uploads (.jpg, .png)
⚡ Lambda Function: project-7-serverless-event-image-ingest
Python 3.11 runtime with metadata extraction and error handling
Python 3.11 runtime with metadata extraction and error handling
🗄️ DynamoDB Table: project-7-image-metadata
Stores image metadata with unique IDs and processing status
Stores image metadata with unique IDs and processing status
📧 SNS Topic: project-7-serverless-event-notifications
Email notifications to rusty.teston@gmail.com
Email notifications to rusty.teston@gmail.com
📁 S3 Processed Bucket: project-7-serverless-event-processed
Storage for processed images (future enhancement)
Storage for processed images (future enhancement)
🔄 Event Flow
1. Image Upload → S3 upload bucket receives image file
2. S3 Event Trigger → Automatically invokes Lambda function
3. Lambda Processing → Extracts metadata, generates unique ID
4. Metadata Storage → Stores details in DynamoDB table
5. Notification → Sends SNS email with processing results
🧪 Live Testing Interface
🎯 Interactive Demo: Test the Pipeline →
Upload your own images and see real-time metadata extraction results
Upload your own images and see real-time metadata extraction results
🧪 Previous Testing Results
Test Image: test-image.jpg (19 bytes)
Metadata Stored: ✅ DynamoDB record created
Notification Sent: ✅ Email delivered successfully
Generated ID: 39377a58-e12e-44c9-8630-ebb03efc06d9
Processing Time: < 1 second
Metadata Stored: ✅ DynamoDB record created
Notification Sent: ✅ Email delivered successfully
Generated ID: 39377a58-e12e-44c9-8630-ebb03efc06d9
Processing Time: < 1 second
💻 Technical Implementation
Runtime: Python 3.11
Trigger: S3 ObjectCreated events
IAM Roles: Lambda execution with DynamoDB, SNS, S3 permissions
Error Handling: Comprehensive try/catch with CloudWatch logging
Scalability: Serverless auto-scaling based on upload volume
Security: Encrypted S3 buckets, IAM least privilege access
🚀 Deployment Details
Region: us-east-1
CloudFormation Stacks:
• project-7-serverless-event (Infrastructure)
• project-7-lambda-function (Lambda function)
Deployment Date: October 22, 2025
Status: ✅ Production Ready
CloudFormation Stacks:
• project-7-serverless-event (Infrastructure)
• project-7-lambda-function (Lambda function)
Deployment Date: October 22, 2025
Status: ✅ Production Ready
🎯 Key Features
- Event-Driven Architecture: Fully reactive, no polling required
- Serverless Design: Zero server management, pay-per-use
- Real-time Processing: Immediate response to file uploads
- Metadata Extraction: Automatic file analysis and cataloging
- Notification System: Email alerts for processing completion
- Error Handling: Robust exception management and logging
- Scalability: Handles concurrent uploads automatically
🔧 AWS Services Utilized
S3 (Storage & Triggers)
Lambda (Compute)
DynamoDB (Database)
SNS (Notifications)
IAM (Security)
CloudFormation (IaC)