Overview
This section contains comprehensive guides for developing SQL tasks with Google Cloud BigQuery in the Datablast Data Platform.
Core Development
Section titled “Core Development”- BigQuery Development – Core BigQuery development, configuration, and features
Specialized Guides
Section titled “Specialized Guides”- Materialization Strategies – Table creation, partitioning, clustering, and storage optimization
- Data Quality Testing – Built-in tests, custom validation, and quality assurance
- Performance Optimization – Query optimization, cost management, and performance tuning
Key Features
Section titled “Key Features”Platform Integration
Section titled “Platform Integration”- Automatic Job Management: Job ID generation and monitoring
- Enhanced Client Features: Extended BigQuery client with platform-specific capabilities
- Cost Optimization: Query optimization and cost tracking
- Connection Management: Seamless BigQuery integration
Development Tools
Section titled “Development Tools”- Annotation-based Configuration: Simple task configuration
- YAML Configuration: Complex task setup
- BigQuery-specific Functions: Date functions, window functions, and SQL features
- Debugging Support: Comprehensive error handling and logging
Quick Start
Section titled “Quick Start”- Start with Core Development: Learn the basics of BigQuery task configuration
- Choose Materialization Strategy: Select the right approach for your data
- Implement Data Quality: Add tests to ensure data reliability
- Optimize Performance: Tune queries and manage costs