November Product Monthly Update

November Product Monthly Update

Intro

We're back with another set of brand new features and updates from November! Here's what's new to Neosync:

EU infrastructure

Neosync now supports EU regions in Neosync Cloud making data residency and GDPR a breeze.

Column auto-map

base

You can configure Neosync to auto-map new columns coming in so that your job doesn't stop running if it detects a new column or table.

IP Address Transformer

base

We've added a new IP Address Transformer that can generate all classes (public and private) of IP addresses.

Business Name Transformer

base

We've added a new Transformer that can generate realistic business names.

SQL Server Init Schema

We now support creating and syncing SQL server schemas across environments natively in Neosync!

Updated S3 datatypes

We've revamped the data type mapping when syncing from S3 -> postgres/mysql/mssql, making it faster and more stable.

Optimized Job Mapping table

We've massively optimized the Job Mapping Table to be faster and handle larger schemas

Anonymization API multi-language

The Anonymziation API which can anonymize free form text now supports french, spanish, italian and german.

Hot off the Press

Here's some news and articles that we found interesting this month:

  1. Data Masking vs Data Anonymization - What's the Difference?
  2. How to Build and Test Data Pipelines with Neosync and dbt
  3. A Data Engineer's Guide to Data Anonymization Pipelines

Meme of the month

// TODO: refactor

float

Helpful Resources

Some helpful links to have handy:

  1. Try Neosync for free!- an easy way to get started with Neosync Cloud.
  2. Github for open source Neosync.
  3. Documentation for how to get started + everything else.
  4. Discord for any questions about Neosync, synthetic data or to just chat with us.

Thanks for reading and see you in the new year!


Implementing Foreign Key Tracking in Memory

Implementing Foreign Key Tracking in Memory

An overview of how Neosync handles foreign key tracking in memory during data synchronizations

December 3rd, 2024

View Article