ML Provisioner Tool DocumentationΒΆ
Welcome to the ML Provisioner Tool documentation. This tool provisions and manages AWS ML product infrastructure using tier-based CloudFormation templates (starter, professional, enterprise).
π Getting Started (Read First)ΒΆ
Start here if youβre new to the ML Provisioner.
- README
Quick start and overview - What the tool does, common commands, tier-based architecture, and AWS credentials setup.
- USER_GUIDE
Complete command reference - All 12 actions (validate-config, create-prov-template, deploy-product, delete-product, etc.), deployment workflows, volume mounts, and best practices.
π Core Documentation (Essential)ΒΆ
- CONFIGURATION
Configuration reference - Config file naming convention, discriminators (source_control, vpc_mode, vpc_source), and all enterprise tier combinations.
- CONFIGURATION_GUIDE
Configuration guide - Step-by-step decision tree for selecting the correct config file, verifying prerequisites, and populating config values before deployment.
- NAMING_CONVENTIONS
Naming conventions - Resource naming patterns, ml_name construction, artifact filename conventions, and SSM parameter paths.
- PREREQUISITES
Pre-deployment requirements - S3 source control bucket setup, VPC and route table requirements for enterprise tier, standalone vs bundle networking.
π SecurityΒΆ
- IAM_PERMISSIONS
Required AWS permissions - Least-privilege IAM policy for CloudFormation, SageMaker, CodePipeline, CodeBuild, KMS, VPC, and SSM operations.
- SECURITY_GUIDELINES
Security guidelines - KMS encryption, permission boundaries, VPC endpoint security groups, and compliance monitoring.
π§ Operations (Day-to-Day Use)ΒΆ
- UPDATE_PROCEDURES
Update and maintenance procedures - How to update the Docker image, modify tier configurations, and perform maintenance tasks.
π TroubleshootingΒΆ
- TROUBLESHOOTING
Common issues and solutions - AWS credentials, configuration errors, CloudFormation errors, VPC integration issues, and Docker errors.
π Advanced Topics (Optional)ΒΆ
- RESOURCES_EXPLAINED
AWS resources explained β Educational guide to every AWS resource provisioned by the ML Provisioner, what it does, why it exists, and how it relates to other resources in the stack.
- APPLICATION_ARCHITECTURE
Complete architecture documentation - Tier-based design, CFN generator architecture, blueprint system, SSM integration, and deployment patterns.
- INTEGRATION_EXAMPLES
Integration examples - How to consume ML stack outputs from SSM Parameter Store in SageMaker, CI/CD pipelines, and downstream provisioners.
- MIGRATION_GUIDE
Migration guide - Migrating from manually created ML infrastructure or other IaC tools to the ML Provisioner.
π ReferenceΒΆ
- ROADMAP
Future features and plans - Planned features, enhancement requests, and product roadmap.
- RELEASE_NOTES
Version history and changes - Release history, new features, bug fixes, and upgrade notes.
- SAMPLE_REPORTS
Sample HTML reports - Example pre-deployment review report and deployment report.
π Getting Started:
- README
- User Guide
π Onboarding Examples:
- Onboarding Examples
- Scenario Index
- Standalone Scenarios β Run Commands
- Enterprise β SG Provisioner Scenarios β Run Commands
- Edge β Professional Tier Scenarios β Run Commands
- TechCorp β Starter Tier Scenarios β Run Commands
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-codecommit-standalone-ssm
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-codecommit-standalone-direct
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-codecommit-standalone-direct-rtb
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-codecommit-standalone-ssm-workload
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-codecommit-sgprov-ssm
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-codecommit-sgprov-direct
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-s3-standalone-ssm
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-s3-standalone-direct
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-s3-standalone-direct-rtb
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-s3-standalone-ssm-workload
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-s3-sgprov-ssm
- Integration Test β globalbank-prod-c001-us-west-2-demand-forecasting-ml-s3-sgprov-direct
- Integration Test β edge-prod-b001-us-west-2-fraud-detection-ml-codecommit
- Integration Test β edge-prod-b001-us-west-2-fraud-detection-ml-s3
- Integration Test β edge-prod-b001-us-west-2-fraud-detection-ml-codecommit-workload
- Integration Test β edge-prod-b001-us-west-2-fraud-detection-ml-s3-workload
- Integration Test β techcorp-prod-a001-us-west-2-customer-churn-ml-codecommit
- Integration Test β techcorp-prod-a001-us-west-2-customer-churn-ml-s3
- Integration Test β techcorp-prod-a001-us-west-2-customer-churn-ml-codecommit-workload
- Integration Test β techcorp-prod-a001-us-west-2-customer-churn-ml-s3-workload
π Core Documentation:
- Configuration Reference
- Configuration Guide
- Table of Contents
- Overview
- Step 1 β Which tier have you purchased?
- Step 2A β Starter
- Step 2B β Professional
- Step 2C β Enterprise Prerequisites
- Step 2D β Enterprise Config Selection
- Step 3 β Populate your config file
- Step 4 β Validate and deploy
- Quick Reference β Config File by Scenario
- Naming Conventions
- Prerequisites
π Security & Compliance:
- IAM Permissions
- Security Guidelines
- Table of Contents
- Credential Management
- IAM Least Privilege
- KMS Encryption (Enterprise Tier)
- VPC Endpoint Security (Enterprise Tier)
- Permission Boundaries (Enterprise Tier)
- Compliance Monitoring (Enterprise Tier)
- CloudFormation Security
- Docker Security
- Logging and Monitoring
- Security Checklist
- References
π§ Operations:
π Troubleshooting and Support:
- Troubleshooting
- Support
- Feedback
π Advanced Topics:
- Application Architecture
- Table of Contents
- Overview
- Position in the MLOps Suite
- Design Decisions
- Decision 1: Generic Templates, Parameterized Use Cases
- Decision 2: Tier as Primary Template Dimension
- Decision 3: CodeCommit as Primary, S3 as Fallback
- Decision 4: 12 Actions β Same Pattern as SG Provisioner
- Decision 5: SSM Parameter Store Outputs
- Decision 6: Separate CI/CD Artifacts Bucket from ML Data Lake
- Decision 7: No Service Catalog Dependency
- Decision 8: IAM Resource Naming β Region Omitted
- Decision 9: EventBridge Rule β CodePipeline (Direct Invocation)
- Decision 10: License Per AWS Account, No Template Sharing Mechanism
- Decision 11: IAM Policy β CodeCommit Resource Scoping
- Product Tier System
- Configuration System
- CloudFormation Generation
- SSM Parameter Store Integration
- Actions Reference
- Source Tree
- Future Roadmap
- Resources - Detailed explanation of purpose
- AWS::SageMaker::ModelPackageGroup
- AWS::CodeCommit::Repository
- AWS::CodeBuild::Project
- AWS::CodePipeline::Pipeline
- AWS::IAM::Role
- AWS::SSM::Parameter
- AWS::Events::Rule
- AWS::Events::Rule
- AWS::CloudWatch::Dashboard
- AWS::IAM::ManagedPolicy
- AWS::KMS::Key
- AWS::KMS::Alias
- AWS::Logs::LogGroup
- AWS::CloudWatch::Alarm
- AWS::SNS::Topic
- AWS::SNS::Subscription
- AWS::EC2::VPCEndpoint
- AWS::EC2::SecurityGroup
- Integration Examples
- Migration Guide
π Reference:
- Sample Reports
- Release Notes
- Roadmap
- API Reference
- Core Modules
- Configuration
- Generators
- Utilities
- Products
- Data Models
- License
- CLI Interface
MlProvisionerCLIMlProvisionerCLI.__init__()MlProvisionerCLI.add_custom_arguments()MlProvisionerCLI.create_manager_instance()MlProvisionerCLI.get_actions()MlProvisionerCLI.get_actions_help()MlProvisionerCLI.get_example_usage()MlProvisionerCLI.get_manager_class()MlProvisionerCLI.is_action_required()MlProvisionerCLI.requires_force()
main()
π Recommended Reading OrderΒΆ
For New UsersΒΆ
README - Overview and quick start
User Guide - Complete command reference
Configuration Reference - Configuration parameters
Prerequisites - Pre-deployment requirements
Troubleshooting - Common issues
For Production DeploymentΒΆ
Prerequisites - Ensure all prerequisites are met
Configuration Reference - Production configuration
Security Guidelines - Security hardening
ποΈ ML Product Tier ArchitectureΒΆ
The ML Provisioner supports three tiers of ML product infrastructure:
- Starter
SageMaker Project, Model Registry, CodeCommit/S3 repositories, CodeBuild, CodePipeline, IAM roles.
- Professional
All Starter resources plus S3 artifacts bucket, EventBridge rule and pipe for automated deployment, CloudWatch dashboard, and enhanced managed policies.
- Enterprise
All Professional resources plus KMS encryption, compliance log group, CloudWatch alarms, SNS alerting, VPC endpoints, and permission boundaries.
π Documentation ConventionsΒΆ
UPPERCASE_WITH_UNDERSCORES.md - Main documentation files
All paths are relative to the docs/ directory
Code examples use bash syntax unless otherwise noted
AWS resource names follow the pattern: {company_prefix}-{env}-{tenant_id}-{region}-{use_case}-ml
π Documentation UpdatesΒΆ
This documentation is version-controlled and updated with each release. See Release Notes for documentation changes in each version.
Β© 2026 Axon Tech Labs. All rights reserved.