Posts

Showing posts from 2020

Manual intervention Azure Devops yaml

 Sometimes it can be pretty daunting, trying to get the correct manual intervention step correct.  Here is a an example that will create a stage in the environment and then you can start to add "Approval" and checks.  stages :  -  stage  :  ${{parameters.stageName}}      dependsOn :  ${{parameters.stageDependency}}    jobs :   -  deployment :  'qadeployment'      displayName :  'QA Deployment'        environment :  'OnlineShopping.UI.QA'   

OAuth 2.0 Terms and definitions

  I think this resource link provide a good explanation of some of OAuth 2.0 terms used for example, what distinguishing between acess_token vs refresh_token.

cypress install package.json version

  If you having cypress versioning issues - i.e, you have a global cypress version 5.4 but your project uses cypress 4.9, you can uninstall global version using  npm uninstall cypress -g  Then make sure you're in your project source directory, then install using the following command :- npx cypress install 

azure devops multiple custom condition in yaml

  In case you run into a situation whereby you need to specify multiple condition in your task / job, you can try the following command :- condition :  and( succeeded(), or(eq(variables[' Build.Reason'], 'PullRequest') ,  eq(variables['Build. SourceBranch'], 'refs/heads/ master')))

git log to see only changes in your branch

  If you want to see only changes in your current git branch, use the following command :- git log master.. Otherwise, to specify your target branch git log master..<your branch name>

Setting up containerized azure pipeline agents into Azure Devops

Image
 This is a tutorial for setting up build agents in Azure Devops. Lets say you would like to add more build agents, there's a couple of ways to do it. You can add vm scale set or you can use docker.  This tutorial is about using microsoft pipeline agent image to add an agent to your Azure Devops pipeline build process.  The setup is pretty easy, all you need is to generate your PAT token. You need to have AGENT READ-WRITE SCOPE.  Run docker command  sudo docker run \   -e VSTS_ACCOUNT=cdiwi \   -e VSTS_TOKEN=YOUR_PAT_TOKEN_WITH_AGENT_READWRITE \   -e VSTS_AGENT='jeremydev-agent' \   -e VSTS_WORK='/var/vsts/$VSTS_AGENT' \   -it mcr.microsoft.com/azure-pipelines/vsts-agent Once you have your container running you should see the following outputs:-  And if you go back to your Azure Devops pipeline and start looking for the agent name 'jeremydev-agent', you should be able to see something similar below :-

git command of the day - allow-unrelated-histories

This is a pretty handy command to blog about :) git pull origin master --allow-unrelated-histories

Setting up jest for your node app that uses typescript :)

Here you go, proper instruction for setting up jest for your node app that uses typescript :) https://basarat.gitbook.io/typescript/intro-1/jest

moq automock sample code

Automock helps to reduce code tremendously. But it can be tricky to use at times. Here are some simple code that you can get started with, to show it works. Sometimes those calls can get complicated and you need to know what works. The code sample below, is simple, straight forward and you won't have problem getting it to work

Enabling flake8 in vscode

In your .vscode directory, please update your settings.json file { "python.pythonPath" : "/anaconda3/envs/myenv/bin/python" , "python.linting.pylintEnabled" : false , "python.linting.flake8Enabled" : true , "python.linting.enabled" : true }

install specific version of tensorflow

Unfortunately i have problem getting tensorflow installed on my ubuntu using pip. So i resorted to using system install and it works pip3 install -- user -- upgrade tensorflow  

Running microsoft deepspeed

If you wanna run Microsoft deepspeed using docker, then try with the following command :- sudo docker run -it --entrypoint bash deepspeed/deepspeed:latest

setting up drozer

Installing server  create python 2.7, and then create your environment. Then install using drozer server side using :- https://github.com/mwrlabs/drozer/releases/download/2.4.4/drozer-2.4.4-py2-none-any.whl pip install drozer-2.4.4-py2-none-any.whl Start emulator  ./emulator avd Pixel_2_API_27 Install the agent using adb install drozer-agent-2.3.4.apk adb forward tcp:31415 tcp:31415 Please goto your android emulator and then run Drozer by firing up the application and then click on "Off" (to turn it on) Next, run  drozer console connect Now, we are in. To list all the command please type "ls" Some common command to use are :- app.package.attacksurface How to do something useful with it? Trying to look for database for passwords run scanner.provider.findurls com.android.chrome.browser run app.provider.query content://com.google.settings/partner

Following azure best practices and naming conventins

Following azur best practices and naming conventins https://docs.microsoft.com/en-us/azure/cloud-adoption-framework/ready/azure-best-practices/naming-and-tagging

nuget commonly used command

nuget config -set http_proxy.password= nuget config -set http_proxy="http:// @proxycompletename" nuget config -set http_proxy.user=" " nuget sources add -name MyPackageSource -source https://pkgs.dev.azure.com/company/nuget/v3/index.json -username username -password password

Maven separates repository between plugin and package repositories.

The following example illustrate how we can setup plugin and package repository. Maven tends to separate this out individually.

Setting up git to use Azure Devops over proxy

The following provide a configuration that you need to update when you're trying to use git over a proxy to hit into Azure DevOps. [user]      email  = jeremy.woo@mysuper.com      name  = Jeremy.Woo      password  = mypassword [http "https://dev.azure.com"]      proxy  = http://jeremywo:mypassword@myproxyserver:80 [credential]      helper  = store

Azure CMK for storage account

If we were to use key rotation in Azure storage account, then we can do it by setting up our Azure KeyVault and tying it to a storage account. The problem with this approach is that, it will be harder because right now, we're trying to manage key ourselves. Typically this is an answer to 'how can i apply key rotation to Azure storage account'.

Azure Devops - how to build pipeline that uses npm securely for docker images

This is a setup for npm, docker images and react app (This doesn't matter i guess) In this post, we are going to be building a secure pipeline. When we say secure, we mean a) No PAT token is saved in source code or as a insecure variable. No credential is leak We also separate the pipeline and allow it to evolve independently. b) No token is written into docker image. User wil not be able to use docker inspect  / docker history to obtain PAT token. In a nutshell, we use Azure Devops and build machine to install npm packages. Then copy all the files, assets and node_modules into docker for next steps to build it. I know some of you might say, we want a full containerized build. This is a good way too, if you think about it. you don't have to generate user .npmrc file and somehow maintain that in variable group. It just make the steps so much simpler. This is the Azure Devops build pipeline setup Let's look at the dockerfile setup

azure devops build pipeline template : using if macro

Did you know that you can actullly use template with abit of if macro magic as shown below :-

Create a local git for Azure WebApp deployment

From Azure portal, goto your webapp service and select deployment center.  Then create a local git. It looks something like this :- https:// .scm.azurewebsites.net:443/ .git git remote add azure https:// .scm.azurewebsites.net:443/ .git To figure out the username and password, click on the Credential Tab. Then you can provide the username and password for writing to the git repository. Remember to execute the command below to deploy :- git push azure 

Azure function v1, v2 and v3 configuration

React-create script getting unrecognisable token when running yarn or nom start

This is most likely you are using a very old version of the tools (yarn / npm). Try to uninstall and then reinstall the yarn. To uninstall, npm uninstall yarn To Install brew install yarn Then you should be able to use other form of tooling, like yarn install and yarn start to fire up your 'react-create-script'

Docker build with Maven over proxy

Getting maven to build over proxy can be tricky.  So here is an example of a proxy setup which might help. But still you need to ensure that your Maven setings.xml proxy configuration (name and password are correct)

Azure Devops - $(Build.SourcesDirectory) and (System.DefaultWorkingDirectory) is the same

Did you know that $(Build.SourcesDirectory) and (System.DefaultWorkingDirectory) has the same value. For example if you $(Build.SourcesDirectory) is /home/buildadmin/agent/_work/97/s then (System.DefaultWorkingDirectory) is /home/buildadmin/agent/_work/97/s then In case, somebody ask, this could come in handy.

Docker to copy entire folder

To copy entire folder from a running docker instance, all you have to do is use the following command. docker cp :/my/folder_name_only docker run --name targetdockerapp --rm -d ${{ parameters.dockerRegistryName }}/${{ parameters.dockerRepositoryName }}:latest   docker cp targetdockerapp:app/target/site/jacoco $(System.DefaultWorkingDirectory)

React css module

Css module cannot have dashes, It should be something like a whole word. Css format :- .yes .no-no-no

Running dotnet restore for command line in a proxy server (corporate network)

Run dotnet restore and see what info you're getting. If you're getting 407 (Proxy access denied) nuget config -set http_proxy="http://proxysslbypass" nuget config -set http_proxy.user="ourUserName" nuget config -set http_proxy.password="Your secret password." If you're getting 401 then Download nuget.exe ( https://dist.nuget.org/win-x86-commandline/latest/nuget.exe ) Then run the following command line, please make sure you replace the package url name and PAT Token info which you got from Azure DevOps. nuget.exe sources Add -Name "Nuget_Artifact" -Source "https://pkgs.dev.azure.com/somecompany_packaging/division/nuget/v3/index.json" -username MY_USERNAME -password MY_PAT_TOKEN

CSS Grid - fixing first and second column. Third column gets the rest

you can use grid-template-column to fix the size of your grid column. For example, you might want to say 1st and 2nd column has the size of 100px and 200px respectively. The rest goes to column 3, which takes on auto-fill, don't specify any grid size to it.

Terraform - Azure container registry multiple ip network rule setup

You can setup multiple ip rules using for container registry using the terraform code

Azure Devops - Container based build

Here is a sample of using container based build in Azure Devops While this looks cool, i could have use Dockerfile to do similiar things. The only problem i have install docker. Using the containerized based built, I have to copy or manage my artifact directory.

Intellij : How to run maven goal

Image
To run a specific maven goal, click on the "m" for Maven :) and then select the goal you would like to run. If you don't see your goal, just type it out as shown below :- Specifiying goal as illustrated in diagram below :-

dockerfile - using image that allows some debugging for java build

Using this image for debugging purposes during docker build works! :) FROM amd64/adoptopenjdk:13.0.2_8-jdk-openj9-0.18.0-bionic AS publish

react reducer what

Ok where is the general accepted implementation with react-redux. It is a global / subsection state management that maintain data used in your application. For example, lets say you have a Todo list, you might use, the following objects to keep track of it. STATE { - TODO_ID - when user click on ADD_TODO - TODO_LIST - keep tracks of all your tasks you have created. } These are all trigger based on actions. This is why we have to setup actions. Action when someone click "Add Task". Then it sends a certain message - "ADD_TODO' to be specific to a  reducer. What is a reducer? Say you have fire up / dispatch / send out a 'ADD_TODO' instruction and you increment current task id with 1. So you can have a unique Id or some way to keep track of it. This is where you pass it to a reducer. You say hey, my ADD_TODO is fired, get me a new TASK_ID. Reducer is where you are allowed to changes / update state STATE - TODO_ID. Some other action will update

azure naming convention

It just seems so clear to me that having "-" dash as a naming convention is bad and causes more problem. Azure container registry won't like it, storage acount won't like it and probably a few others. But you will never know ......... so it can causes more pain than anything else :(

react basics

Set state the correct way. Setstate is a merge operation. React dumb component Better way to work with events Another const example, Check out this cool useEffect()

installing debian package on ubuntu

If you're trying to install debian package on Ubuntu, all you need is the following command :- sudo dpkg -i DEB_PACKAGE

Linux distro name - when uname don't tell you much

Try running the following command and that will help to display your Linux distro name. This works for Redhat. :) cat /proc/version 

docker image running dotnet - A fatal error occurred, the folder [/usr/share/dotnet/host/fxr] does not contain any version-numbered child folders

This error seems to be Linux specific. When i ran it on Redhat it gives me this issue. Otherwise running it on Ubuntu Bionic, this problem doesn't shows up. https://github.com/dotnet/dotnet-docker/issues/1537

Azure Devops pipeline - Getting dotnet tools (customer command) to run

Often have problem when there is more than a feed config in your nuget.config. For example, having your private feed, dotnet custom tool like "dotnet tool install' just won't work. To resolve this you specify a --configfile and provide a single config file entry called dotnettool.config which has the content below :-   -  task :  DotNetCoreCLI@2      displayName :  Install ReportGenerator tool      inputs :        command :  custom        custom :  tool        arguments :  install --tool-path . dotnet-reportgenerator-globaltool  --configfile dotnettool.config        feedsToUse :  'select' dotnettool.config content xml  version = "1.0"  encoding = "utf-8" ?> < configuration >    < packageSources >      < clear />      < add   key = "nuget.org"   value = "https://api.nuget.org/v3/index.json"   />    </ packageSources > </ configuration >

salesforce - working with records

This setup uses a controller that contains the following code, please note that this code is available in /default/classes/bearController.cls ' Notice how different the import path is :- import getAllBears from '@salesforce/apex/BearController.getAllBears' ; And load bead runs this method to run query and assigned it into a variable bear with a @track decorator loadBears ( ) { getAllBears ( ) . then ( result = > { this . bears = result ; } ) . catch ( error = > { this . error = error ; } ) ; } The funny thing about this code is, it returns mostly string which contains SOQL query. Still not really sure how it works under the hood. This is imperative query.. However, you can greatly simplify the code using @wire as shown below:- import { LightningElement , wire } from 'lwc' ; import ursusResources from '@salesforce/resourceUrl/ursus_park' ; /** BearController.getAllBears() Apex method */

salesforce - getting all the objects

To query all salesforce object name, you can use the following soql -

salesforce parent child event interfactions

In the lightning-button-icon, we have a onclick event which can be used to fire off events - And code below fires off an event called 'bearview' On the parents side of things, we need to tell parent component to handle the event, On the parent's javascript :-

salesforce - getting started - common terms

@track - is a decorate that make a variable  automatically refresh when its value changes Handing UI events On the javascript side of things Bear tile component This sections allow us to create a new custom component that is used in a parent component. Lets say we are creating a component called beartile. Here is the javascript side of things :- The html :- Looking at the parent html :- Also noticed that, it become c_bear_tile - where c is the default, somewhat predefined name for components and then as the upper case changes, then an underscore is introduced. Loading style :-

REST API Http versioning

Common ways to go about it would be :- 1. URL versioning An example would be :- https://adventure-works.com/v2/customers/3 : 2. Query string versioning https://adventure-works.com/customers/3?version=2 3.Header versioning GET https://adventure-works.com/customers/3 HTTP/1.1 Custom-Header : api-version=1 4. Media type versioning - this is more for client trying to digest the media type data content. For example, the data content supported by the client should be of pdf version 2. GET https://adventure-works.com/customers/3 HTTP/1.1 Accept : application/vnd.adventure-works.v2+pdf

Recap in HTTP design

Some of the common stuff when it comes to responding to REST based API are as follows :- 1. GET - 200 for OK, 404 when not found 2. POST - 201 for created and 204 No update. Returns 404 if it is a bad request. Returns 409 when conflict. For long running or async processes, an API could just return 202 (ACCEPTED) with a link to poll status info. Agent can poll the status and once upon completed returns 303. Results can be show here :- HTTP/1.1 202 Accepted Location : /api/status/12345 HTTP/1.1 303 See Other Location : /api/orders/12345 3. PUT - 201 for created and 204 No update. Returns 409 when conflict. 4. PATCH - this is mainly used for update resource. It will return 415 for unsupported media, 400 bad request and 409 for conflict. 5. HEAD - for handling large content If you have a long running task or wanted to poll status of a resources, then you can do something like this :- POST to a resource and returns 202 (Accepted) with a location of resource URL

salesforce lightning web component library

This is a link to salesforce component library that is essential for testing purposes. https://developer.salesforce.com/docs/component-library/bundle/lightning-accordion/example

Web lightning component documentation site

https://developer.salesforce.com/docs/component-library/documentation/lwc/lwc.apex

Using Powershell for Azure Devops to refer to predefined variables.

Using Powershell for Azure Devops Linux agent to refer to variables can be hard to get right essentially just use $(build.SourceBranchName) - the build.SourceBranchName is what listed in the documentation. You can see one example given below :- -  task :  PowerShell@2        displayName :  'PowerShell contruct VersionSuffix if not Master'        inputs :          targetType :  'inline'          script :  |          Write-Host "Setting up version info"          $VersionSuffix =  'prerelease' + '.$(build.SourceBranchName).' + $(build.buildid)          write-host "##vso[task.setvariable variable=VersionSuffix]$VersionSuffix"          Write-Output "##vso[build.updatebuildnumber]$($env:VersionPrefix)-$VersionSuffix"          failOnStderr :  true        condition :  and(succeeded(), ne(variables['Build.SourceBranch'], 'refs/heads/master'))

using terraform expression

Image
Terraform expression consist of conditional operators like ==, != and functions that you can leverage to work with input values. For example, lets say you want to concatenate two variable together, you can do that using terraform. There are a whole lot of functions available which are categorized under string, numeric and collection functions . Lets have a look at where you can use these functions. Functions are typically classified as expresssion and you can use it within a terraform code. Example  Let's have a look at the example below :- In this example, i am combining a couple of function together (chaining) and produce a list as the final output. This snippet shows where we can :- Disecting the code out further, we have substr functions, which attempts to get a subsection of a string except the last character. substr( data . azurerm_storage_account . paymentmonitorui . primary_web_endpoint ,   0 ,  length ( data . azurerm_storage_account . paymentm

Salesforce codepen / playground

This let you get a feel of the codepen or playground for salesforce https://developer.salesforce.com/docs/component-library/tools/playground

mulesoft java invoke

Image
To create a flow using java invoke. Please have a look at the flow below :- As you can see, we need a java new component, then follow by a java invoke component. Here is our java code :- public class Greeter {    public String Hello(String name) {    return "Hello " + name;    } } Java new component requires the following configuration :- And the java invoke component. As you can see we reference our variable using #[vars.mygreeter] :- Note the class and method configuration below is very important.

mulesoft media type supported by dataweave

Ever wonder what type of media type supported by data weave? application/avro Avro application/csv CSV application/dw DataWeave (weave)  (for testing a DataWeave expression) application/flatfile Flat File ,  Cobol Copybook ,  Fixed Width application/java Java ,  Enum Custom Type (for Java) application/json JSON application/octet-stream Octet Stream  (for binaries) application/yaml YAML application/xml XML ,  CData Custom Type (for XML) application/x-ndjson Newline Delimited JSON  (Newline Delimited JSON) application/xlsx Excel application/x-www-form-urlencoded URL Encoding multipart/* Multipart (Form-Data) text/plain Text Plain  (for plain text) text/x-java-properties Text Java Properties  (Properties) Links are provided here. https://docs.mulesoft.com/mule-runtime/4.2/dataweave-formats