Saddle up for 1923 – our latest Mage Pro release! This update brings the grit and determination of the Dutton Ranch to your data pipelines, forging new paths and expanding your horizons.

🔗 Enhanced API source for data integrations

Mage Pro's API Source now delivers unparalleled flexibility and resilience in data integration. Our enhanced connector provides advanced capabilities to handle complex API data retrieval, supporting custom encodings, compressed file formats, dynamic type handling, and seamless ingestion of large-scale data sources. Overcome traditional API integration challenges with a single, powerful solution designed to streamline your data extraction workflows.

Key Enhancements:

• Support custom encoding

• Support syncing zipped csv file

• Support force column types to string type

• Support syncing large files from API

🚀 Teradata Integration

🔄 Mage Pro now includes native Teradata connectivity, enabling bidirectional data synchronization for enterprise-scale data warehousing. Leverage our full support for both source and destination configurations with advanced replication capabilities.

☁️ Hybrid Deployment on Azure

Experience the seamless integration of Azure cloud scalability and on-premises security with Mage Pro's Hybrid Deployment solution. By combining the robust management capabilities of Microsoft Azure with the control and privacy of your local infrastructure, our deployment offers a flexible and resilient approach to data processing. Unlock the full potential of your data while maintaining stringent security standards and operational efficiency.

🧊 Iceberg Destination

Mage Pro now supports direct writes to Apache Iceberg tables, empowering data teams to build robust, scalable data lakehouse architectures. Leverage native Iceberg table format capabilities, including schema evolution, time travel, and atomic commits, directly within your data pipelines. Integrate with cloud data platforms and enable advanced data engineering workflows with our Iceberg destination support.

✨ Airbyte Cloud Integration

Expand your data integration capabilities with Mage Pro's native Airbyte Cloud connector. Access an extensive ecosystem of pre-built data sources, enabling rapid connection to hundreds of platforms without complex configuration. Streamline your data ingestion workflow by leveraging Airbyte's robust connector library directly within the Mage Pro platform.

📄 Check out our documentation for details: https://docs.mage.ai/integrations/airbyte#airbyte-in-mage

🧱 Databricks Integration Suite

Mage Pro now offers seamless integration with Databricks SQL, enabling you to run SQL queries directly within your Databricks environment. We’re taking our integration with Databricks to the next level. Chek out which features we recently added:

• Databricks SQL Block: Run SQL queries directly within your Databricks environment using our Databricks SQL block. More info: https://docs.mage.ai/integrations/databases/Databricks

• Unity Catalog Integration: Seamlessly access and manage data in your Unity Catalog.

• Databricks PySpark Integration: Harness the power of PySpark for data transformations within Mage. Details: https://docs.mage.ai/integrations/compute/databricks

♾️ Universal Block Concurrency Limit

Take precise control of your data pipeline's computational resources with Mage Pro's new Universal Block Concurrency Limit. Implement granular execution constraints that prevent system overload, optimize resource allocation, and ensure predictable performance across complex data workflows.

🤖 AI Inline code assistance

Revolutionize your coding workflow with Mage Pro's intelligent AI sidekick. Seamlessly generate, debug, and optimize code directly within your development environment. Leverage AI-powered insights to write complex queries, analyze data, and accelerate your development process without ever leaving your coding workspace.

💡 Learn more: https://www.mage.ai/explore/ai-inline-code-assistance

🧠 AI data-aware autocomplete

Elevate your coding precision with Mage Pro's intelligent autocomplete that understands your code in all upstream pipeline blocks. Our AI provides context-aware suggestions by analyzing upstream code blocks and anticipating exact input parameters, transforming code completion from a basic hint to a smart, data-intelligent assistant.

💡 Learn more: https://www.mage.ai/explore/ai-data-aware-autocomplete

This release is all about taming the data frontier and building a robust foundation for your data-driven future. Onward to new horizons!