Giter Club home page Giter Club logo

purviewlab's Introduction

Microsoft Purview Workshop

What is Microsoft Purview?

Microsoft Purview is a unified data governance service that helps you manage and govern your on-premises, multi-cloud and software-as-a-service (SaaS) data. Easily create a holistic, up-to-date map of your data landscape with automated data discovery, sensitive data classification and end-to-end data lineage. Empower data consumers to find valuable, trustworthy data.

πŸ€” Prerequisites

  • An Azure account with an active subscription. Note: If you don't have access to an Azure subscription, you may be able to start with a free account.
  • You must have the necessary privileges within your Azure subscription to create resources, perform role assignments, register resource providers (if required), etc.

πŸ§ͺ Lab Environment Setup

πŸ“š Preface

πŸ“š Learning Modules

  1. Create a Microsoft Purview Account
  2. Register & Scan: 2A. Azure Data Lake Storage Gen2 (Managed Identity) | 2B. Azure SQL Database (Azure Key Vault)
  3. Search & Browse
  4. Glossary
  5. Classifications
  6. Lineage
  7. Insights
  8. Monitor
  9. Integrate with Azure Synapse Analytics

πŸ“š Optional Learning Modules

  1. REST API
  2. Securely scan sources using Self-Hosted Integration Runtimes
  3. Managed private endpoints
  4. Process events using Atlas Kafka topics via Event Hubs and NodeJS
  5. Data owner policies (Azure Storage)
  6. Azure SQL Database Lineage Extraction
  7. Data Sharing
  8. Metamodel

πŸ”— Workshop URL

https://aka.ms/purviewlab

purviewlab's People

Contributors

adhazel avatar arevaloisabel avatar bennyaustin avatar bhitney avatar cedricve avatar christinaleo-msft avatar henriheijltjes avatar henrischulte-ms avatar ievsantillan avatar imicknl avatar jwstarkie avatar mada-d avatar meenal-gupta141 avatar nakazax avatar norelina avatar pietheinstrengholt avatar simondale-bjss avatar tayganr avatar tuterbatuhan avatar zmon3y avatar

Stargazers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

Watchers

 avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar  avatar

purviewlab's Issues

Workflow

Please enhance the lab with an example of Workflow and Approval

Update Module 10

  • Update content within module (including screenshots).
  • Build out REST API content for further learning around the topic.
  • Update the REST API module to include the web-based version of Postman as a workaround.

@tayganr

New Module Idea: Purview + MDM

Possibility of including a Purview + MDM module /demo since I am seeing a lot of questions on this topic. Not sure how feasible it is given the 3rd party MDM element i.e. Profisee or other

Issues in Module 5 and Module 9

  1. In Module 5>task 6, step 3, the UI got updated for Azure Purview and we couldn't able to see the Schema option after selecting twitter_handles.parquet file. Please find the below screenshot for your reference.

image

  1. In Module 7>task 5, the sensitivity label insights(preview) is not getting loaded inside the Sensitivity Labels section of Azure Purview as shown in the below screenshot.

image

  1. In Module 9>task 3 after selecting twitter_handles.parquet file, facing an error "Invalid Parquet file size" as shown below while running the SQL query in synape workspace.

image

Update to Knowledge Checks

Knowledge Checks

  • Update to include new self-rating against new modules (e.g. SHIR)
  • Include an option for people to not self-rate if did not complete (e.g. bonus modules).

Elastic Data Map

  • Add references to the Elastic Data Map in Module 01.
  • Include a question on the Elastic Data Map as part of the Knowledge Check.

Authentification

Hi,
there seems to be an issue with authentification. After login with az login or VS Code I get:
DefaultAzureCredential failed to retrieve a token from the included credentials.
Attempted credentials:
EnvironmentCredential: EnvironmentCredential authentication unavailable. Environment variables are not fully configured.

Other azure cli commands seem to work

Christoph

Key vault screens seem to have moved on - error "The operation "List" is not enabled in this key vault's access policy. "

Looks like the Keyvault Portal screens have moved on and the dialogue for this section (Module 02B - Register & Scan (Azure SQL DB)) doesn't quite match the current portal

I ended up with the error above which I think I fixed using this fix (https://jd-bots.com/2021/07/27/fixed-the-operation-list-is-not-enabled-in-this-key-vaults-access-policy/) but not sure if that's the right approach

Module 0:0 Lab Environment Setup : Template Deployment Validation Failed

Just getting started with Microsoft Purview and encountered this error with a new set up.

{"code":"InvalidTemplateDeployment","details":[{"code":"QuotaExceeded","message":"Operation could not be completed as it results in exceeding approved standardDADSv5Family Cores quota. Additional details - Deployment Model: Resource Manager, Location: westus2, Current Limit: 0, Current Usage: 0, Additional Required: 2, (Minimum) New Limit Required: 2. Setup Alerts when Quota reaches threshold. Learn more at https://aka.ms/quotamonitoringalerting . Submit a request for Quota increase at [[https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/{"subscriptionId":"76ba4329-2174-451c-8319-9d9eec471a20","command":"openQuotaApprovalBlade","quotas":{"location":"westus2","providerId":"Microsoft.Compute","resourceName":"standardDADSv5Family","quotaRequest":{"properties":{"limit":2,"unit":"Count","name":{"value":"standardDADSv5Family"}}}}]}](https://aka.ms/ProdportalCRP/#blade/Microsoft_Azure_Capacity/UsageAndQuota.ReactView/Parameters/%7B%22subscriptionId%22:%2276ba4329-2174-451c-8319-9d9eec471a20%22,%22command%22:%22openQuotaApprovalBlade%22,%22quotas%22:%5B%7B%22location%22:%22westus2%22,%22providerId%22:%22Microsoft.Compute%22,%22resourceName%22:%22standardDADSv5Family%22,%22quotaRequest%22:%7B%22properties%22:%7B%22limit%22:2,%22unit%22:%22Count%22,%22name%22:%7B%22value%22:%22standardDADSv5Family%22%7D%7D%7D%7D%5D%7D) by specifying parameters listed in the β€˜Details’ section for deployment to succeed. Please read more about quota limits at [https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests"}],"message":"The](https://docs.microsoft.com/en-us/azure/azure-supportability/per-vm-quota-requests%22%7D%5D,%22message%22:%22The) template deployment 'Microsoft.Template-20240507202059' is not valid according to the validation procedure. The tracking id is 'ddcae37e-7352-4e2a-bcd3-074e5783b003'. See inner errors for details."}

Adjust Module: 8 - Clear Guidelines

Module 8 - connecting to storage account for metrics. Only shows the storage accounts in the same location as the Purview account - we need to be clear about this in the lab

Update Module 1

Did you know to cover C0/C1/D0 snippet (currently missing).

Deployment of SQL VM fails if the first 6 characters of the resource group ID are only numbers

Issue Description

The parameter randomString depends on the first 6 digits of the resource group ID. Also, adminPassword of SQL VM depends on the parameter randomString.

The first 6 digits of the resource group ID is sometimes composed only of numbers. In this case, the requirement of adminPassword of SQL VM cannot be satisfied and deployment of SQL VM fails.

Workaround Idea

To meet the requirement, the adminPassword of the SQL VM already contains an exclamation as a special character.
Similarly, the above issue can be avoided by putting one or more fixed lower and upper case alphabetical characters into the adminPassword.

Not able to get expected output in Module 13 Task 2 step 3

Module 13 Task 2 step 3 we are getting a different output than expected. But we proceeded with the next step and got the expected results as shown in the screenshot.

Please let us know if we are missing something.

Attaching the screenshot of the issue which we are facing below:

image

Recommend Projects

  • React photo React

    A declarative, efficient, and flexible JavaScript library for building user interfaces.

  • Vue.js photo Vue.js

    πŸ–– Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.

  • Typescript photo Typescript

    TypeScript is a superset of JavaScript that compiles to clean JavaScript output.

  • TensorFlow photo TensorFlow

    An Open Source Machine Learning Framework for Everyone

  • Django photo Django

    The Web framework for perfectionists with deadlines.

  • D3 photo D3

    Bring data to life with SVG, Canvas and HTML. πŸ“ŠπŸ“ˆπŸŽ‰

Recommend Topics

  • javascript

    JavaScript (JS) is a lightweight interpreted programming language with first-class functions.

  • web

    Some thing interesting about web. New door for the world.

  • server

    A server is a program made to process requests and deliver data to clients.

  • Machine learning

    Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.

  • Game

    Some thing interesting about game, make everyone happy.

Recommend Org

  • Facebook photo Facebook

    We are working to build community through open source technology. NB: members must have two-factor auth.

  • Microsoft photo Microsoft

    Open source projects and samples from Microsoft.

  • Google photo Google

    Google ❀️ Open Source for everyone.

  • D3 photo D3

    Data-Driven Documents codes.