SQL Tasks
This section contains comprehensive guides for configuring SQL tasks in Datablast, including supported databases, configuration methods, and database-specific features.
Core Configuration
Section titled “Core Configuration”- SQL Task Overview – SQL task types and basic configuration
Database-Specific Guides
Section titled “Database-Specific Guides”- BigQuery Tasks – BigQuery SQL task configuration and features
- Snowflake Tasks – Snowflake SQL task configuration and features
- Athena Tasks – Athena SQL task configuration and features
- PostgreSQL Tasks – PostgreSQL SQL task configuration and features
Specialized Configuration
Section titled “Specialized Configuration”- Materialization Strategies – Table and view materialization options
- Data Quality Testing – Built-in testing framework and custom tests
- Task Dependencies – Dependency management and execution order
Key Features
Section titled “Key Features”SQL Task Management
Section titled “SQL Task Management”- Multiple Databases: BigQuery, Snowflake, Athena, PostgreSQL support
- Configuration Methods: YAML and annotation-based configuration
- Materialization: Table, view, and incremental materialization
- Data Quality: Built-in testing framework
Database Integration
Section titled “Database Integration”- BigQuery: Automatic job management, cost tracking, partitioning
- Snowflake: Snowflake-specific optimizations and features
- Athena: S3 data access and cost optimization
- PostgreSQL: Advanced SQL features and transaction support
Best Practices and Advanced Features
Section titled “Best Practices and Advanced Features”For best practices, performance optimization, troubleshooting, and advanced configuration patterns, see the comprehensive guides:
- BigQuery Development – BigQuery best practices and advanced features
- Snowflake Development – Snowflake best practices and advanced features
- Athena Development – Athena best practices and advanced features
- PostgreSQL Development – PostgreSQL best practices and advanced features
Quick Start
Section titled “Quick Start”- Choose Database: Select appropriate SQL dialect
- Configure Task: Set up task configuration
- Define Materialization: Choose materialization strategy
- Add Tests: Implement data quality tests
- Set Dependencies: Define task execution order