mitzen

 secret in azure devops are often masked and not accessible. I used to be able to extract it by dumping it into a file and then expose the value of the file. Anyways, to extract secret, you can use the following code. Just ensure you have assigned the actual value to the $secret below :- from https://stackoverflow.com/questions/68320361/get-azure-devops-secret-variable-as-plain-text-using-powershell $secret = "fOoBaR" Remove-Variable joined - Force - Confirm: $false - ErrorAction SilentlyContinue for ( $i = 0 ; $i -lt $secret .Length ; $i ++ ){     if ( $joined ) { $joined = $ ( $joined + " " + $ ( $secret [ $i ]))}     else { $joined = $ ( $secret [ $i ])} } Write-output "Secret: > $( $joined ) <"

 To install istio on k3, please remove traefik first. Todo that you can run the following commands sudo rm -rf /var/lib/rancher/k3s/server/manifests/traefik.yaml helm uninstall traefik traefik-crd -n kube-system sudo systemctl restart k3s Once it is remove, you can download istio by running the following command curl -sL https://istio.io/downloadIstioctl | sh - If you like to install a specific version, you can do this  curl -L https://istio.io/downloadIstio | ISTIO_VERSION=1.22.0 sh - Then to install, you can do the following:- istioctl install --set profile = demo

To resolve this issue, i use the following  export KUBECONFIG=/etc/rancher/k3s/k3s.yaml After that i was able to run helm command against k3s.

  When running your wsl, you typically have different flavour such as ubuntu or alphine. You can access your local drive via /mnt/c which basically refers to c:\ drive.

Sometimes we need to do some packet capture or even do some network monitoring for AKS cluster's running nodes. To do that we first need to configure the network watcher linux extension.  To do that, goto your AKS's VMSS instance by going to AKS cluster -> Properties -> Infrastructure resource group -> Select your VMSS.  Find and install the following extension Even after i installed it, I was able to do my packet capture. Make sure you have check "Network watcher" Once you kick start the process, it will start to run. Then you can stop if by right clicking on your newly created job and select "Stop" packet capture. The file is a pcap file.  You can open up the pcap file using tools like wireshark.

To verify flow connectivity from VM to bing or external internet  az network watcher test-ip-flow --direction 'outbound' --protocol 'TCP' --local '10.0.0.4:60000' --remote '13.107.21.200:80' --vm 'myVM' --nic 'myVmVMNic' --resource-group 'myResourceGroup' --out 'table' To verify flow from another remote VM or IP  az network watcher test-ip-flow --direction 'inbound' --protocol 'TCP' --local '10.0.0.4:80' --remote '10.10.10.10:6000' --vm 'myVM' --nic 'myVmVMNic' --resource-group 'myResourceGroup' --out 'table' Then you may want to see what NSG rules might be applied. az network nic list-effective-nsg --resource-group 'myResourceGroup' --name 'myVmVMNic' Please note that this only applies for VM. It won't be able to do it for kubernetes cluster. If you're trying to troubleshoot for kubernetes cluster yo...

  Hit this issue trying to get k3 working on a Windows Subsystem Linux.  wsl.conf  Ensure you have the following configuration in your  /etc/wsl.conf Add the following: [boot] systemd=true From a powershell command prompt, you may need to do  wsl --update  wsl --shutdown Then restart your wsl and run the k3 install script :-  curl -sfL https://get.k3s.io | sh - And that should be it. Notice the following output from kubectl.

  Cilium dataplane requires network policy cilium -  getting this error when trying to update my network policy to use calico.  I think the only way around this is not to configure or turn off cilium during the initial AKS setup and specify calico or azure network policy instead.

 In short no, " Allow Azure services and resources to access this server " includes Azure services such as virtual machines, azure app service. Azure devops is NOT part of this services. From Azure docs Checking  Allow Azure services and resources to access this server   adds an IP based firewall rule with start and end IP address of 0.0.0.0

 When downloading a file using dbutils.fs.cp command, sometimes we might not have a clear understanding of where we are placing this file, for example  import os os.environ[ "UNITY_CATALOG_VOLUME_PATH" ] = "databrick-my-store" os.environ[ "DATASET_DOWNLOAD_URL" ] = "https://health.data.ny.gov/api/views/jxy9-yhdk/rows.csv" os.environ[ "DATASET_DOWNLOAD_FILENAME" ] = "rows.csv" dbutils.fs. cp ( f " { os.environ. get ( 'DATASET_DOWNLOAD_URL' ) } " , f " { os.environ. get ( 'UNITY_CATALOG_VOLUME_PATH' ) } / { os.environ. get ( 'DATASET_DOWNLOAD_FILENAME' ) } " ) When it is downloaded, we often tries to read it using spark.read.csv but we need to know the path to our file.    df = spark.read. csv ( "dbfs:/ databrick-my-store /rows.csv" , header = True , inferSchema = True ) We can quickly figure out what to pass to spark.read.csv by using the following command. Please note ...

We can use icacls to set folder permission for a user by using the following command. The /t option does this for folder and subfolders (recursive)  icacls "C:\Path\To\Your\Folder" /grant "Username:(OI)(CI)(M)" /T Another option would be to use: $folder = "C:\MyFolder" $acl = Get-Acl $folder $rule = New-Object System.Security.AccessControl.FileSystemAccessRule("JohnDoe", "Modify", "ContainerInherit, ObjectInherit", "None", "Allow") $acl.SetAccessRule($rule) # Apply recursively Get-ChildItem -Path $folder -Recurse | ForEach-Object { $itemAcl = Get-Acl $_.FullName $itemAcl.SetAccessRule($rule) Set-Acl -Path $_.FullName -AclObject $itemAcl }

  You can use file my-linux-executable to reveal if it supports 32 and 64 bit.  On the os level you can use 'uname -m' 

You can run the following command on a windows machine to checkout what are the ciphertext supported Get-TlsCipherSuite | format-wide If you would like to check the ciphertext on the registry,  Get-ItemProperty -Path "HKLM:\SYSTEM\CurrentControlSet\Control\Cryptography\Configuration\Local\SSL\00010002" | Select-Object -ExpandProperty Functions This by itself is not much use - nobody is going to look at the cipher suit without any reason. This comes out as part of a debugging session when we try to connect to another website.  Easiest way to use SSLLab and entering the domain that you like to connect to  https://www.ssllabs.com/ssltest/index.html Sometimes the server might not be hosted on the public web, which is why we need: Nmap nmap --script ssl-enum-ciphers -p 443 www.example.com Openssl - can be quite tedious openssl s_client -connect example.com:443 -cipher ECDHE-RSA-AES256-GCM-SHA384 Additional info of changing order of TLS cipher To change the order of TLS. Not to...

  int[,] is used to declare a multi-dimension array of x,y equal equal multi-dimensional array of int in this case. Due to its fixed size, it is often stored as a continuous memory location For example,    int [,] matrix = {      { 0 , 0 , 0 , 1 },      { 0 , 1 , 0 , 0 },      { 0 , 0 , 1 , 0 },      { 1 , 0 , 0 , 0 },      { 0 , 0 , 0 , 0 }  }; You can't do this - as element of your matrix is not of the same size.   int [,] matrix_error = {      { 0 , 0 , 0 , 1 },      { 0 , 1 },      { 0 , 0 , 1 , 0 },      { 1 , 0 },      { 0 , 0 , 0 , 0 }  }; To traverse it, int [,] matrix = {     { 1 , 2 , 3 , 4 },     { 5 , 6 , 7 , 8 },     { 9 , 10 , 11 , 12 },     { 1 , 0 , 0 , 0 },     { 0 , 0 , 0 , 0 } }; var m = matrix . GetLength ( 0 ); var n ...

A delta live table is a declarative way to process data in a pipeline. You essentially using coding this in a notebook and generate a pipeline.  Let's say you have the following codes Customers from pyspark.sql.functions import * from pyspark.sql.types import * import dlt @ dlt . view (   comment = "The customers buying finished products, ingested from /databricks-datasets." ) def customers ():   return spark.read. csv ( '/databricks-datasets/retail-org/customers/customers.csv' , header = True ) Sales_Orders_Raw @ dlt . table (   comment = "The raw sales orders, ingested from /databricks-datasets." ,   table_properties = {     "myCompanyPipeline.quality" : "bronze" ,     "pipelines.autoOptimize.managed" : "true"   } ) def sales_orders_raw ():   return (     spark.readStream. format ( "cloudFiles" ) \       . option ( "cloudFiles.schemaLocation" , "/tmp/john.odwyer/pythonsalestest...

First we create a notebook and then we install the require python library for accessing mongodb atlas. % pip install pymongo Then we obtain the require connection string for mongodb by going into  Next, you setup the require datasource and connection string by clicking on add code.  connectionString = "mongodb+srv://your-user-name:your-password@cluster0.psk0yd7.mongodb.net/?retryWrites=true&w=majority&appName=Cluster0" database = "sample_supplies" collection = "sales" df = spark.read. format ( "com.mongodb.spark.sql.DefaultSource" ) \        . option ( "database" , database) \        . option ( "spark.mongodb.input.uri" , connectionString) \        . option ( "collection" , collection) \        . load () display (df) Run the code to get connected, pull out all the data and then display it

  To create to a mongodb atlas, you need to have the proper library and have your compute instance setup already.  Select Libraries tab and click on "install new". Then select maven and click on search packages. You will see a whole list of packages available.  You can select from Maven central or spark packages. We are just going to search for "mongo-spark" and then select this package.  If you're getting similiar error messages as shown here, then try to provision your compute as a single personal instance.  " Jars and Maven Libraries on Shared Clusters must be on the allowlist. Failed Libraries: org.mongodb.spark:mongo-spark-connector_2.12:3.0.1: PERMISSION_DENIED: 'org.mongodb.spark:mongo-spark-connector_2.12:3.0.1' is not in the artifact allowlist "