Sql Server 2019 New Features

31 Aug 2022

Beginner

17.1K Views

8 min read

Today I will describe the new features and performance enhancements to security in Sql Server 2019 which is introduced by Microsoft at ignite conference 2018 Orlando, Florida. Today’s Sql server 2019 not only work in Windows or Linux but it can work in multiple OS types and also it is integrated with multiple data sources which will be discussed below. Now it can be utilized in the field of Machine Learning and Artificial Intelligence.

Features and performance

Sql server 2019 will help us by making data integration, Management and intelligence easier and more intuitive than ever earlier.

Major Key points

Single virtual data layer
Data virtualization and Integrating Data
No data replication and Managing all data
Spark Built-In
Unified platform for big data analytics
Spark jobs
Train machine learning models

In sql server 2019 you can create single virtual data layer and all application can access it. Polybase data virtualization reduces the complexity of data sources integration without move it.

Data management process can be easier using sql server 2019 big data clusters which can be deployed in kubernetes . Every node of big data cluster includes sql server relational engine HDFS storage and spark which will allow you store and manage the data.

We can build intelligent apps with big data now. You can run spark jobs to analyze the structured and unstructured data. Train models over data from everywhere with sql server machine learning services or spark ml and query data anywhere using highly configurable notebook embedded in Azure data studio. The Sql server 2019 makes easier to manage and handle business data and keep it secure than ever before.

Sql Server 2019 Features with Azure Data Studio and Spark

Here I will tell you how we can use Sql server 2019 and spark together as a unified platform running on kubernetes and how Azure Data Studio provides seamless experience over data. Sql server 2019 is deployed in kubernetes provides more flexibility to run on premises or in the cloud. In the same instance of Azure data studio, we can connect two sql server instances and to the spark HDFS endpoint in the kubernetes cluster. Sql server 2019 provides a unified view of enterprise data whether it is relational data stored in data sources or big data stored in HDFS clustes. Sql server 2019 allows querying data from other data sources such as Oracle, Teradata, and MongoDB.

Data Virtualization from Oracle

Data virtualization provides data quality, data security and data privacy. Once I choose the data to virtualize I can write a new simple sql query which will query the results from my remote server in Oracle. Once the data in Sql server I can write a simple select top thousand records this actually queries the data which is in Oracle.

Spark and HDFS End point running on kubernetes

In sql server 2019 the sql engine to read files located in HDFS. If one file is uploaded in HDFS then steps to write sql query to query directly from the file which is stored in HDFS. Once we create external tables over the files in HDFS. We can easily join the data with other relational data sources. In this way sql server 2019 joins high-value data in relational databases with high volume of data in HDFS. Sql server also provides scalable compute and storage for faster data processing. Sql server 2019 is the first release where we are bringing both sql and spark together providing query capabilities over scalable storage across relational and big data.

Notebook Viewer In Azure Data Studio

In azure data studio I can easily browse my files in HDFS. In one click I can start analyzing my files in notebook. In azure data studio, we have an integrated notebook viewer which seamlessly connect sql server 2019 clusters. It is attached to PI spark kernel and lets you submit the spark jobs against the cluster.

Azure Data Studio made easy for Data Scientists

Data scientists spend a lot of time to prepare the data. Using Azure Data Studio we have made it easier for data scientists to be more productive.

Spark job viewer

In azure data studio it has made it simple for customers to submit spark jobs against the cluster. It has built rich spark job viewer which will allow customers to monitor their submitted spark jobs.

Data Migration and Management

There are more than 340 types of databases and moving and replication data across was a big challenge. Integrating data across them always very difficult but Sql server 2019 integrates data from many data sources without movement. That means using one platform we can access multiple data sources.

Sql server 2019 meets Big Data explosion

Read and write directly in HDFS using Sql server and Spark. Using Kubernetes architecture we can scale compute and storage as per demand. It is possible to combine and cache data from relational and non-relational data source with scale-out data marts.

Sql server 2019 brings easy platform for analytic users

Sql server 2019 enables analytic users to built intelligent apps and leverage AI from their data. Query your data using your own programming languages like java, python, scala etc in sql server or spark. To train data models we can use Sql server machine Learning and Spark ML. The big advantage is we can store and operationalize all train models.

Sql Server 2019 Big Data Clusters

SQL Server Big Data Clusters offers deep integration between SQL Server and big data in a form that is easy to deploy and manage. It offers three major pieces of functionality :

Data virtualization

Combine data from many sources without moving or replicating it.

Managed SQL Server, Spark and data lake

It can save high volume data and access it easily using either SQL or Spark. It can handle and manage easily in the field of Management services, admin portal, and integrated security.

Support 100% AI platform

It can easily integrate data from all different Data sources to your model. Next it can train, store, and your models all under one platform.

Easy job for data scientists to manage Big Data

Data scientists earlier fetch high-value data from the enterprise database to retrieve data from big data and push it into Hadoop, As a result they were able to join it with the new data streams.

SQL Server Big Data Clusters provide platform for big data sets which can be joined with the dimensional and fact data which are stored in the enterprise database and provides a comfortable way for users and applications that can use SQL Server to query big data.

Azure Data Studio and Other Tools In Sql server 2019

Azure Data Studio is a open source, cross-platform desktop application which can be used for querying SQL Server instances running on different platform, Azure SQL Data Warehouse, and Azure SQL Database instances. Azure Data Studio and Visual Studio Code both from same platform, and it contains Git integration. It makes easy for Database Administrators and data scientists to interact with SQL Server Big Data Clusters using Azure Data Studio and Jupyter Notebooks.

To know more about it visit http://aka.ms/azuredatastudio Azure Data Studio and SQL Operations Studio both based on same platform and Azure data studio released based on SOS.

Why we should prefer Sql server 2019

Most important part in today’s data management world is the product should work in multiple languages, cross platform systems and multiple data source under one box. Sql server 2019 covers all these above features and fulfill the demands of end user under one platform and that’s why we should use Sql server 2019. Sql server 2019 has a big role in the field of manage big data and provides a easy and unique platform for data scientists to handle data using Azure Data Studio.

Let’s discuss in details

Automatic plan correction resolves performance problems called Automatically tune Sql server.
Sql server provides layers of security with protection and it is in always encrypted secure enclaves.
Database maintenance can be reduced by running on available groups on containers using kubernetes.
Data discovery and classification for GDPR and vulnerability assessment tool to track compliance.
It can support for windows, linux and containers using kubernetes. You can run java code in sql server to store and analyzege graph data.
Sql server has the control and make use of the power of big data.
AI platform now train models in Sql server ML services using Azure data studio notebooks.
Data virtualization allows queries across different data sources by eliminating data movement and replication.
Visual data integration and analysis using Sql server BI tool and Power BI report server.
It can run real-time analytics on operational data using HTAP.
Azure data studio has a big role in cross platform for querying sql server instances.