Azure, AI, SP, .NET, Microsoft - Knowledge Base

A shared access signature (SAS) is a signed URI that points to one or more storage resources and includes a token that contains a special set of query parameters.  Here, the token plays an important part, it indicates how the resources might be accessed by the client. Signature query parameters (sig) is constructed from the SAS parameters and signed with the key that was used to create the SAS. This signature is used by Azure Storage to authorize access to the storage resource. Azure Storage supports three types of SAS: User delegation SAS Secured with Microsoft Entra credentials and also by the permissions specified for the SAS. Applies to Blob storage only. Service SAS Secured with the storage account key. A service SAS delegates access to a resource in the following Azure Storage services: Blob storage, Queue storage, Table storage, or Azure Files. Account SAS Secured with the storage account key. An account SAS delegates access to resources in one or more of the storage service...

Micrsoft Fabric brings many teams in one platform - It joining Data Engineering, Data Science, and Reporting landscape in one platform.  Lakehouse is new concept in Faric and here it is. Question is why we are going to use Lakehouse while Micrsoft do have existing data storage platform. They do have multiple options in Data Engineering area. I believe Microsoft is now looking to operate on a fully managed compute platform that can support Data Engineering and Data Science experiences - Selecting Apache spark features and services, Microsoft Fabric started it's journey. Fabric do using starter pools. With starter pools, we can expect rapid Spark session initialization, typically within 5 to 10 seconds, with no need for manual setup. Starter pools have Spark clusters that are always on and ready for your requests.  Starter pools are a fast and easy way to use Spark on the Microsoft Fabric platform within seconds. You can use Spark sessions right away, instead of waiting for Spar...

This is final part 3 of Azure Storage Service. We talked about it in earlier articles  Part 1 and Part 2 . Azure Storage API Azure Storage provides a REST API to work with the containers and data stored in each account. There are independent APIs available to work with each type of data you can store. ·          Blobs  for unstructured data such as binary and text files. ·          Queues  for persistent messaging. ·          Tables  for structured storage of key/values. ·          Files  for traditional SMB file shares. Storage REST APIs are accessible from anywhere on the Internet, by any application that can send an HTTP/HTTPS request and receive an HTTP/HTTPS response. For example (HTTP) GET https://[url-for-service-account]/?comp=list&include=metadata – This returns t...

This is continuing part of Azure Storage. We talked about part 1 article on this and this is second part of it. Storage Account Settings Following three settings that apply to the account itself Name Deployment model Account kind Name : must be globally unique within Azure, use only lowercase letters and digits and be between 3 and 24 characters Deployment model : It is the system Azure uses to organize your resources. The model defines the API that we use to create, configure, and manage those resources. Azure provides two deployment models. ·          Resource Manager: the current model that uses the Azure Resource Manager API ·          Classic: a legacy offering that uses the Azure Service Management API Microsoft recommends that you use Resource Manager for all new resources. Account kind : Storage account kind is a set of policies that determine which data...

I n this article and subsequent a few articles, will talk about some important objects of Azure Storage Service and it's utility. This is actually kind of learning hand book. Azure Storage Services Microsoft Azure Storage is a managed service that provides durable, secure, and salable storage in the cloud. A single Azure subscription can host up to 200 storage accounts, each of which can hold 500 TB of data. If you have a business case, you can talk to the Azure Storage team and get approval for up to 250 storage accounts in a subscription, which pushes your max storage up to 125 Petabytes! Azure data services:  Azure storage includes four types of data: Blobs: A massively scalable object store for text and binary data. Files: Managed file shares for cloud or on-premises deployments. Queues: A messaging store for reliable messaging between application components. Tables: A NoSQL store for schemaless storage of structured   Blob storage : Is ...