Get ready for "Cobra Kai" - our latest Mage Pro release! This update packs a punch with exciting new features and enhancements. Let's break it down:

🌏 Asia Region Now Open!

Mage Pro is going global! We've expanded our reach to include Asia, joining our existing regions: US West, US East, Canada, Europe, and Australia.

🚀 SFTP Source Enhancements

• 📂 Support for syncing large SFTP source files.

  • We've optimized the handling of large SFTP source files to improve performance and reduce the time required for syncing. This enhancement ensures that files of significantly larger sizes can now be processed efficiently, minimizing memory usage and enabling more robust transfers.

• 🏷️ Auto-generated column names for SFTP source files.

  • To streamline the data pipeline setup, SFTP source files now come with auto-generated column names. This feature automatically analyzes the file structure and assigns meaningful, consistent names to the columns based on their content or predefined rules.

💻 IDE Integrations

• 🧑‍💻 VSCode integration.

  • Mage Pro has enhanced its functionality by integrating directly with VS Code, allowing you to streamline your development workflow. With this integration, developers can now manage Mage Pro projects within VS Code. Check out a more detailed video in our documentation.

• 🖱️ Cursor integration.

  

🔄 MongoDB CDC Streaming

• ⏪ Mage Pro now supports the ability to replay events from the MongoDB Change Data Capture (CDC) streaming source, allowing for the reprocessing of captured data changes. This feature ensures that missed or delayed events can be efficiently reprocessed, ensuring data consistency across downstream systems.

  

🔒 Enhanced Security

• 🔐 Mage Pro now supports the use of custom SSL Certificate Authority (CA) certificates in the ClickHouse configuration. This enhancement enables secure communication with ClickHouse instances using specific CA certificates, providing greater flexibility and control over encryption and ensuring compatibility with enterprise security policies.

  

🔌 New Integrations

• 📊 Airtable Source and Destination in Data Integration Pipeline: Mage Pro now includes native support for Airtable as both a source and destination in your data integration pipeline. This feature enables seamless data transfer between Airtable and other systems, simplifying the process of syncing data and automating workflows across your organization.

• 
  

  

• 💾 Mage Pro now offers seamless integration with Databricks SQL, enabling you to run SQL queries directly within your Databricks environment. This integration allows for efficient querying and transformation of large datasets, streamlining your data processing and analytics workflows.

  

  
  

📊 Dynamic Visualizations

• 📈 Dynamic block stream mode realtime graph.

🐘 Postgres Improvements

• 🔒 SSL Configuration for Postgres IO Library and Data Integration source / destination: Mage Pro now supports SSL configurations for the Postgres IO library as well as Postgres source and destination integrations. This enhancement ensures secure connections to Postgres databases, enabling encrypted data transfers that comply with enterprise security standards and best practices.

Ready to level up your data game? This release is all about striking first, striking hard, and showing no mercy to inefficient data processes!