Task Configuration
This section contains comprehensive guides for configuring Datablast tasks, including task types, configuration methods, and task-specific settings.
Core Configuration
Section titled “Core Configuration”- Task Overview – Task types and basic configuration
Task Types
Section titled “Task Types”- SQL Tasks – SQL task configuration and optimization
- Python Tasks – Python task configuration and optimization
- Sensor Tasks – Sensor configuration and monitoring
Key Features
Section titled “Key Features”Task Management
Section titled “Task Management”- Task Types: SQL, Python, and Sensor tasks
- Configuration Methods: YAML and annotation-based configuration
- Dependency Management: Task dependencies and execution order
- Resource Allocation: Instance types and resource configuration
Task Configuration
Section titled “Task Configuration”- Task Metadata: Name, description, and type configuration
- Connection Management: Task-specific connection settings
- Environment Variables: Task-level environment configuration
- Error Handling: Retry policies and failure management
Best Practices and Advanced Features
Section titled “Best Practices and Advanced Features”For best practices, performance optimization, troubleshooting, and advanced configuration patterns, see the comprehensive guides:
- SQL Development – SQL best practices and advanced features
- Python Development – Python best practices and advanced features
- Development Guides – Platform capabilities and best practices
Quick Start
Section titled “Quick Start”- Choose Task Type: Select appropriate task type
- Configure Task: Set up task configuration
- Define Dependencies: Set task dependencies
- Test Task: Validate task configuration
- Deploy Task: Add task to pipeline