Get ready for "Cobra Kai" - our latest Mage Pro release! This update packs a punch with exciting new features and enhancements. Let's break it down:

🌏 Asia Region Now Open!

Mage Pro is going global! We've expanded our reach to include Asia, joining our existing regions: US West, US East, Canada, Europe, and Australia.

🚀 SFTP Source Enhancements

• 📂 Support for syncing large SFTP source files.

  • We've optimized the handling of large SFTP source files to improve performance and reduce the time required for syncing. This enhancement ensures that files of significantly larger sizes can now be processed efficiently, minimizing memory usage and enabling more robust transfers.

• 🏷️ Auto-generated column names for SFTP source files.

  • To streamline the data pipeline setup, SFTP source files now come with auto-generated column names. This feature automatically analyzes the file structure and assigns meaningful, consistent names to the columns based on their content or predefined rules.

💻 IDE Integrations

• 🧑‍💻 VSCode integration.

  • Mage Pro has enhanced its functionality by integrating directly with VS Code, allowing you to streamline your development workflow. With this integration, developers can now manage Mage Pro projects within VS Code. Check out a more detailed video in our documentation.

• 🖱️ Cursor integration.

  

🔄 MongoDB CDC Streaming

• ⏪ Mage Pro now supports the ability to replay events from the MongoDB Change Data Capture (CDC) streaming source, allowing for the reprocessing of captured data changes. This feature ensures that missed or delayed events can be efficiently reprocessed, ensuring data consistency across downstream systems.

  

🔒 Enhanced Security

• 🔐 Mage Pro now supports the use of custom SSL Certificate Authority (CA) certificates in the ClickHouse configuration. This enhancement enables secure communication with ClickHouse instances using specific CA certificates, providing greater flexibility and control over encryption and ensuring compatibility with enterprise security policies.

  

🔌 New Integrations

• 📊 Airtable Source and Destination in Data Integration Pipeline: Mage Pro now includes native support for Airtable as both a source and destination in your data integration pipeline. This feature enables seamless data transfer between Airtable and other systems, simplifying the process of syncing data and automating workflows across your organization.

• 
  

  

• 💾 Mage Pro now offers seamless integration with Databricks SQL, enabling you to run SQL queries directly within your Databricks environment. This integration allows for efficient querying and transformation of large datasets, streamlining your data processing and analytics workflows.

  

  
  

📊 Dynamic Visualizations

• 📈 Dynamic block stream mode realtime graph.

🐘 Postgres Improvements

• 🔒 SSL Configuration for Postgres IO Library and Data Integration source / destination: Mage Pro now supports SSL configurations for the Postgres IO library as well as Postgres source and destination integrations. This enhancement ensures secure connections to Postgres databases, enabling encrypted data transfers that comply with enterprise security standards and best practices.

Ready to level up your data game? This release is all about striking first, striking hard, and showing no mercy to inefficient data processes!

🔐 Ready to unlock the power of the data lakehouse?

Join Cole Freeman, Mage Developer Advocate, on Thursday, February 20th 2025 for the next interactive Mage Lunch and Learn where we'll dive into building a data lakehouse using Mage! 🧙

Learn to create a reliable, scalable data architecture that combines the best of data lakes and warehouses. 💡

You can sign-up for the event here.

⭐️ Mage Pro’s latest enhancements streamline how data engineers build, manage, and troubleshoot pipelines. By centralizing versioning, boosting collaboration, and leveraging AI-driven insights, data teams can focus on true data challenges instead of platform overhead. These improvements foster stronger collaboration, reliability, and productivity across the data engineering lifecycle.

🔍 AI Q&A

Get your Mage Pro questions answered directly in Mage Pro with our AI sidekick. Mage Pro’s AI sidekick will provide best practices, code snippets, and troubleshooting steps all without leaving the platform.

Key Benefits:

• Accelerate problem-solving with real-time, relevant solutions.

• Reduce context switching and external research for faster development.

• Improve productivity through immediate guidance and knowledge sharing.

🗄️ File versioning

Keep track of your pipeline changes with file versioning. Quickly compare revisions, revert to previous versions, and maintain a clear audit trail for data governance and compliance.

Key Benefits:

• Protect against accidental overwrites or lost work with easy rollbacks.

• Enhance collaboration by providing a single source of truth for code changes.

• Ensure reproducibility and maintain detailed history for compliance needs.

🪶 Multiple deployment configurations

Easily manage and switch between different deployment environments. Use the same pipeline code across dev, staging, and production with environment-specific configurations.

Key Benefits:

• Eliminate manual reconfiguration errors by storing environment settings in one place.

• Streamline deployments and minimize downtime with reusable, tested configurations.

• Scale pipelines faster by automating environment-specific parameters.

🛠️ Pipeline and pipeline runs filtering and search

Quickly locate and analyze pipeline runs with filtering and search capabilities. Identify relevant runs, pinpoint performance issues, and streamline troubleshooting.

Key Benefits:

• Rapidly surface critical information with flexible filter and query options.

• Speed up diagnostics and root-cause analysis of pipeline runs.

• Improve collaboration and organization with clear, targeted views of data.

🎥 Markdown editing live preview

Create and refine documentation in real time with integrated Markdown live preview. See exactly how your notes, README files, and explanations will appear as you type.

Key Benefits:

• Eliminate guesswork and formatting surprises by viewing the final output immediately.

• Encourage thorough documentation for seamless knowledge transfer.

• Maintain consistent styling and structure across the platform with instant feedback.

📝 Pipeline author association

Automatically record and display the original author of each pipeline to enhance visibility and collaboration. Quickly identify contributors for streamlined communication and accountability.

Key Benefits:

• Establish clear ownership and accountability for each pipeline’s quality.

• Simplify handoffs by connecting questions or issues to the right expert.

• Strengthen audit trails and compliance with visible author history.

🌠 VSCode Integration

Connect Mage Pro with Visual Studio Code, allowing you to develop and manage pipelines without leaving your preferred coding environment. Access real-time code assistance, debugging, and version control, all while leveraging Mage Pro’s powerful data pipeline features.

Key Benefits:

• Accelerate development by unifying your coding and pipeline management in one place.

• Boost quality with in-IDE syntax checks, intelligent suggestions, and integrated debugging.

• Simplify collaboration through consistent version control and alignment with team workflows.

Join us for a walkthrough with Mage's DevRel, Cole Freeman, on how to use dynamic blocks in your workflows! 🧙‍♂️💫

Sign up now

Mage's dynamic blocks allow users to autoscale large workflows and process data in parallel, reducing compute resources. Learn how to build smarter, more efficient workflows without having to manually tweak each step.

We're excited to announce the launch of the Mage Pro Partner Program, designed to revolutionize how data professionals deliver value to their clients.

Program Highlights

Lucrative Commission Structure

• Up to 15% commission on annual contract values for every successful customer referral

• Opportunity to build recurring income through annual renewals

Exclusive Partner Benefits

• Earn Big: Substantial commissions on new customer contracts

• Dedicated Support: Our engineering team handles setup and project migration

• Risk-Free Starter: $25 in free credits for prospects to explore Mage Pro

Who Can Join?

Our partnership is perfect for:

• System Integrators

• Consultants & Advisors

• Technology Innovators

• Distributors & Resellers

Transformative Value Proposition

• Save Customers Up to 50% on data-related costs

• Boost Productivity 5x with Mage Pro's advanced solutions

• Gain exclusive access to cutting-edge AI-powered tools

Get Started

Ready to supercharge your data services? Join the Mage Pro Partner Program today at mage.ai/partners!

Mage’s latest updates empower users to work faster, smarter, and more securely. From the AI Sidekick for automated pipeline creation to Pipeline Templates and expanded database support, we’re simplifying workflows and enhancing productivity. With features like workspace management, private repository integration, and a refreshed UI with light mode, Mage ensures seamless collaboration and ease of use. These innovations combine to streamline your data engineering process, reduce errors, and deliver reliable results.

🤖 AI Sidekick

Mage’s AI Sidekick enables data engineers to quickly build, manage, and maintain Mage infrastructure. It accelerates pipeline creation, automates code generation, enhances code quality, and streamlines documentation. Start to move faster, reduce errors, and improve your pipelines with our AI sidekick on Mage Pro!

Key benefits:

• Accelerated Pipeline Creation: Quickly build and manage data pipelines by automating code generation, saving valuable time and effort.

• Enhanced Code Quality and Reduced Errors: Ensure high-quality code output while minimizing human errors, enabling reliable and efficient data workflows.

• Streamlined Documentation and Maintenance: Automating documentation and providing intelligent assistance makes managing and maintaining pipelines seamless, reducing the overhead for ongoing infrastructure improvements.

⚡️ Faster Code Execution

Unlock blazing-fast performance with Mage Pro—code execution is now 5x faster, enabling you to process data and run workflows at unparalleled speeds.

💼 Workspace Management

Mage’s workspace management features empower teams with secure permissions, streamlined configurations, and seamless Kubernetes integration for efficient and collaborative data engineering.

Key benefits:

• Enhanced Permissions and Collaboration: Manage workspace-level permissions and roles, ensuring secure and tailored access for different team members or projects.

• Streamlined Workspace Configuration: Centralize and standardize workspace configurations with customizable default settings, simplifying the setup process and reducing errors.

• Seamless Kubernetes Integration: Enable advanced lifecycle and resource management for Kubernetes workspaces, including automatic scaling, ingress setup, and lifecycle hooks, ensuring efficiency and flexibility in production environments.

🌎 New Regional Deployment Support

We’re expanding our capabilities to support Mage Pro deployments in additional regions, including US east and Australia. This allows users to deploy Mage Pro closer to their target markets, ensuring improved performance, reduced latency, and greater compliance with regional regulations.

🧩 Pipeline Templates

Kickstart your Mage Pro workflows with ready-to-use pipeline templates. Save time and focus on driving innovation and delivering results

Key benefits:

• Accelerated Development: Quickly create pipelines with pre-configured templates, reducing setup time and effort.

• Best Practices Built-In: Leverage templates designed with industry standards to ensure reliability and scalability.

🔐 Google Oauth and Github Login for Cloud Portal

Simplify and secure your login experience with support for Google OAuth and GitHub authentication. Easily access the Mage cloud portal using credentials you trust.

Key benefits:

• Enhanced Security: Leverage industry-standard authentication methods to protect your account with minimal effort.

• Seamless Access: Quickly log in without remembering new credentials, improving efficiency and reducing login friction.

🌞 Brand new UI (with light mode)

Experience Mage like never before with a refreshed user interface featuring an intuitive design and a brand-new light mode. Navigate and manage your pipelines with enhanced clarity and ease.

Key benefits:

• Improved Usability: The clean and modern interface simplifies complex tasks, boosting productivity and user satisfaction.

• Customizable Experience: Switch between light and dark modes to suit your preference and reduce eye strain.

🛠️ OracleDB SQL block

Easily integrate with OracleDB using the new SQL block, enabling seamless data querying and processing within your pipelines. Unlock the full potential of your Oracle database with minimal setup.

Key benefits:

• Simplified Database Integration: Connect to OracleDB directly from your pipelines without additional configuration hurdles.

• Optimized Data Workflows: Run complex queries and process data efficiently, streamlining your pipeline operations.

💬 Help Chat Directly in App

We've introduced a built-in help chat to provide real-time support and guidance directly within the Mage app. Whether you need troubleshooting assistance or quick answers to your questions, our team is just a message away.

Key benefits:

• Faster Issue Resolution: Get instant help from our support team without leaving the app, minimizing downtime and keeping workflows on track.

• Improved User Experience: Access resources, tips, and guidance seamlessly while staying focused on your work.

💾 Deploy Code Changes and Data Pipelines from Private Repositories

Seamlessly deploy updates and manage your pipelines using code from private repositories. Ensure your workflows stay secure and version-controlled while maintaining flexibility.

Key benefits:

• Enhanced Security: Protect your code and data pipelines with private repository access, ensuring confidentiality and control.

• Streamlined Deployment: Easily integrate updates and changes into your workflows, reducing manual effort and potential errors.

🧱 dbt 1.8 Support

Mage now supports dbt 1.8, enabling seamless integration with the latest features and improvements in your data transformation workflows. Stay up-to-date with enhanced compatibility and performance for modern data engineering.

Key benefits:

• Cutting-Edge Features: Leverage the newest advancements in dbt 1.8 to optimize your transformation pipelines.

• Improved Integration: Effortlessly incorporate dbt workflows into Mage, ensuring consistency and reliability in your processes.

We’ve got a little secret to share: you no longer have to wait to try out Mage Pro! It’s now available for everyone to access right away! 🎉

To make it even sweeter, we’re giving you $25+ in free starter credit to kickstart your adventure. Dive in and explore the new UI and all the magical features Mage Pro has to offer. Are you ready to level-up? ✨

Mage's DevRel, Cole Freeman, demos how Mage and dbt will allow you to build faster, simpler, and more scalable data projects! dbt empowers data engineers to transform raw data into actionable insights using SQL transformations and version-controlled workflows. When integrated with Mage, dbt's capabilities are elevated to new heights!

Learn how to use streaming pipelines in your workflows with Mage's DevRel Cole Freeman. 🧙‍♂️💫

Mage's streaming pipelines cut latency from seconds to milliseconds, empowering data engineers to deliver immediate insights without the hassle of complex configurations. Learn how to build faster, simpler, and more scalable projects on Mage!

A lot of people are holding space for Mage’s new version release! 🫧 🧹

• Support Mage in Python 3.11 & 3.12

• Airtable destination

• Support to multiples webhook endpoints for Microsoft Teams notification service

• Update Redshift connector to enable merge load and correct row count

• Binocular Enhancements

• Added Postgres client package

• ElasticSearch updates

Read full release notes here.