solliancenet / azure-synapse-wwi-lab Goto Github PK

Hi Team,
I hope you're going well.
I'm a cloud solution architect at Microsoft France and I work on your workshop around Synapse. I create a fresh environment today following each step beginning by the "Before Starting section".

It seems that when I clone the Github repository those cloned notebooks are not up to date, I just follow the "Before Starting section", those are not up to date.

The cloned repository is the master branch and the Product Recommandation Workbook is not up to date and not working.
For example the second cell is (with my suffix ocpsyn)

%%pyspark
customer_data = spark.read.load('abfss://[email protected]/customer-sales-latest.csv'
,format='csv'
,header=True)
customer_data.show(10)

And the last cell of this notebook is number 12.

When I check the repository I find the branch 2735c68 and the associated notebooks works fine, the second cell of the recommendation workbook is

%%spark
val df = spark.read.sqlanalytics("SQLPool01.dbo.Customer_SalesLatest")
df.head(10)
//Create a Temp view for using the dataframe from Scala to Python
df.createOrReplaceTempView ("df")

I check the git clone on the azure shell and it seems to have the first version of the notebook, those which do not work.

Thanks for your feedback,
Frederic

Hi @daronyondem

I completely clean my environment and try to setup another one, with a first approach of git pull, and finally a new git clone, both have the same failed result on setup automation.

Can you help me on this,
Thanks

Enter the SQL Administrator password you used in the deployment: *********************
InvalidOperation: /home/frederic/synapse-wwiv2/artifacts/environment-setup/automation/01-environment-setup.ps1:84
Line |
84 | $uniqueId = (Get-AzResource -ResourceGroupName $resourceGroupName -Re …
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| You cannot call a method on a null-valued expression.

Assign Ownership to Proctors on Synapse Workspace
Invoke-RestMethod: /home/frederic/synapse-wwiv2/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:1462
Line |
1462 | … $result = Invoke-RestMethod -Uri $uri -Method $method -Body $body …
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| Name or service not known

Invoke-RestMethod: /home/frederic/synapse-wwiv2/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:1462
Line |
1462 | … $result = Invoke-RestMethod -Uri $uri -Method $method -Body $body …
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| Name or service not known

Invoke-RestMethod: /home/frederic/synapse-wwiv2/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:1462
Line |
1462 | … $result = Invoke-RestMethod -Uri $uri -Method $method -Body $body …
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| Name or service not known

New-AzRoleAssignment: /home/frederic/synapse-wwiv2/artifacts/environment-setup/automation/01-environment-setup.ps1:121
Line |
121 | New-AzRoleAssignment -Objectid $id -RoleDefinitionName "Storage Blob …
| ~~~
| Cannot validate argument on parameter 'ObjectId'. The argument is null or empty. Provide an argument that is not null or empty, and then try the command again.

On another note, I’m setting up the lab for https://github.com/solliancenet/azure-synapse-wwi-lab

When I run ./01-environment-setup.ps1 And choose 30 billion records, I get this error that keeps repeating:

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:968
Line |
968 | $ie.visible = $true;
| ~~~~~~~~~~~~~~~~~~~
| The property 'visible' cannot be found on this object. Verify that the property exists and can be set.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:970
Line |
970 | $ie.Navigate($url)
| ~~~~~~~~~~~~~~~~~~
| You cannot call a method on a null-valued expression.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:971
Line |
971 | $ie.visible = $false;
| ~~~~~~~~~~~~~~~~~~~~
| The property 'visible' cannot be found on this object. Verify that the property exists and can be set.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:978
Line |
978 | $inputs = $ie.Document.body.getElementsByTagName("input");
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| You cannot call a method on a null-valued expression.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:984
Line |
984 | $buttons = $ie.Document.body.getElementsByTagName("button");
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| You cannot call a method on a null-valued expression.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:987
Line |
987 | $msgInput.value = $message.replace("r","\r").replace("n","\n");
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| The property 'value' cannot be found on this object. Verify that the property exists and can be set.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:988
Line |
988 | $secretInput.value = $secret;
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| The property 'value' cannot be found on this object. Verify that the property exists and can be set.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:989
Line |
989 | $btnGo.click();
| ~~~~~~~~~~~~~~
| You cannot call a method on a null-valued expression.

InvalidOperation: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:992
Line |
992 | $ie.quit();
| ~~~~~~~~~~
| You cannot call a method on a null-valued expression.

Error getting CSRF
Invoke-WebRequest: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:928
Line |
928 | … rawResult = Invoke-WebRequest -Uri $uri -Method POST -Body $SQLQuery …
| ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
| The X-CSRF-Signature header could not be validated.

ConvertFrom-Json: /home/james/synapse-wwi/artifacts/environment-setup/solliance-synapse-automation/solliance-synapse-automation.psm1:931
Line |
931 | $result = ConvertFrom-Json $rawResult.Content
| ~~~~~~~~~~~~~~~~~~
| Cannot bind argument to parameter 'InputObject' because it is null.

James Serra