In this blog, we are going to create Azure Cosmos DB with Core(SQL) as API. Understand data explorer, create document database from data explorer, insert dummy data and use .net SDK to read data from Cosmos DB. Let us start by creating Azure Cosmos DB for Core(SQL) Login to Azure portal, click on Create a … Continue reading Azure Cosmos DB for SQL Core API step by step guide
Azure Cosmos DB Overview
Azure Cosmos DB is Microsoft's globally distributed, multi-model database service. Cosmos DB is horizontally scalable, globally distributed, fully managed, low latency, multi-model, multi query-API database for managing data at large scale. Cosmos DB is a PaaS (Platform as a Service) offering from Microsoft Azure and is a cloud-based NoSQL database. Please refer to Microsoft documentation … Continue reading Azure Cosmos DB Overview
Azure Virtual Network step by step guide
Through this blog i will try to pen what i learnt on how to create Virtual Network in Azure. Pre-requisites : Azure account, if you do not have one, follow the link to create one, Microsoft is offering 12 months of free services. https://azure.microsoft.com/en-us/free/ I assume the reader has basic understanding of Networking concepts (virtual … Continue reading Azure Virtual Network step by step guide
BIML, dynamically create Stored Procedures from Meta database.
In this blog, we are going to see how to create stored procedures dynamically using BIML, i would recommend readers to be familiar with my previous blog series before we deep dive. In the previous blog, we have created couple of stored procedures manually which are used in SQL execution tasks. In this blog, we … Continue reading BIML, dynamically create Stored Procedures from Meta database.
Part 3 : BIML to generate DataVault packages
This is a part 3 of BIML series, I would recommend readers to be familiar with part 1 and part 2 of this series before we deep dive into generating DataVault packages. As discussed in Part 2 , we need to identify the SSIS template that we are going to choose to automate the process. … Continue reading Part 3 : BIML to generate DataVault packages
Part 2 : BIML to generate SSIS Stage Packages
Why do we need stage packages ? you guessed it right, to copy data from Source tables to Stage tables. Stage table is a used to store data for temporary purpose just before loading it to the target table from the Source table. This is Part 2 of BIML Series. To create SSIS Stage package, … Continue reading Part 2 : BIML to generate SSIS Stage Packages
Part 1 : Prerequisites
This is Part 1 of BIML Series. Since we are going to generate automated Stage and DataVault packages from scratch, there are few prerequisites. This blog is to fill the gaps before we get started with BIML Script. Assuming the reader has prior knowledge of XML, basic programming,basic BIML and SQL. If not, please refer … Continue reading Part 1 : Prerequisites
BIML to Automate Data Warehouse Project from scratch
Through this series of blogs I would like to share my knowledge on how to dynamically generate SSIS (SQL Server Integration Services) packages using BIML. By the end of this series you will be able generate DataWarehouse project in just a click. For demonstration purpose, I picked a table ( Address) from AdventureWorks database, ETLéd … Continue reading BIML to Automate Data Warehouse Project from scratch