GAP Migrations Announces SnowConvert for Apache Spark, Accelerating Migration to Snowpark

Gap Migrations SnowConvert now migrates Apache Spark workloads to Snowflake

LAS VEGAS, NV – June 15, 2022 – At Snowflake Summit today, GAP Migrations announced the addition of Apache Spark to the growing list of sources which its SnowConvert migration tool can automatically analyze, assess, and migrate to the Snowflake Data Cloud. SnowConvert for Spark Scala is available stand-alone, or within BlackDiamond Studio – the newly-announced Snowflake-specific source code analysis tool, integrated development environment, code repository, and migration platform. With BlackDiamond Studio, users can be fully setup to run Scala or Python code using the Snowpark API by simply connecting to their Snowflake account.

“Mobilize.Net SnowConvert already scans, analyzes, and transforms code from the most widely used legacy data platforms,” said Tom Button, CEO of Mobilize.Net. “With this release, Apache Spark users can use Scala with Snowpark in minutes.”

“Harnessing the power of data in the Snowflake Data Cloud became even more crucial during the pandemic, when cross domain data and machine learning models became even more necessary for business-critical decisions,” said Padmaja Vrudhula, Vice President, Industry Vertical Workloads at Snowflake. “SnowConvert is an essential tool in Snowflake Professional Services’ toolkit to accelerate migration of workloads from Teradata, Oracle, Apache Spark, and SQL Server to the Snowflake Data Cloud.”

With this release of SnowConvert for Spark Scala, customers can dramatically reduce the time, risk, and expense of moving their Spark workloads to Snowflake. Now Spark users can access Snowpark’s unique ability to scale workloads both up and down – which can be much more complicated and expensive with on-premise local machines or Spark clusters. Likewise, SnowConvert enables organizations to use Snowpark to simplify big data structures by warehousing all custom analytics scripts and data in one location.

SnowConvert for Spark Scala supports:

• Scala functions in Spark (org.apache.spark.sql) are converted to a Scala equivalent in Snowflake, supported by the Snowpark API (com.snowflake.snowpark)
• Spark SQL functions are converted to UDF's in Snowflake SQL as either:
  • JavaScript embedded in Snowflake SQL
  • Snowflake Scripting

Technical Resources

• The Apache Spark with Scala source to target code pairs were jointly developed by GAP in partnership with Snowflake Professional Services. Learn more about migrating from Apache Spark to Snowpark by attending the session with Snowflakeat Snowflake Summit 2022. 
• Learn how to migrate Apache Spark to Snowflake with the Spark to Snowflake Migration Guide
• Customers can get started with SnowConvert for Apache Spark at: https://www.mobilize.net/products/database-migrations/snowconvert/spark-scala-get-started
• Learn more about the SnowConvert product line at: https://www.mobilize.net/products/database-migrations/snowconvert

About GAP Migrations
GAP Migrations builds the world's highest fidelity source code understanding and translation technology. Millions of developers have used GAP Migrations technology to successfully modernize billions of lines of code reducing the risk, cost, and time it takes to migrate to today’s cloud platforms. SnowConvert is developed in partnership with Snowflake. Find out more at https://www.mobilize.net.