How to deploy your Azure DevOps repository to Different Azure Subscription

Problem By default, Azure DevOps provides you an easy way to deploy your codes repository to the same account with your Azure Subscription. For example, when you have [email protected], it will have access to Azure subscription that related with [email protected]. The problem is raising when you need to deploy your Azure DevOps repository to the different account or subscription that not related with your tenant. For example, you want to deploy your solution to contoso.com active directory but you only have access to adatum.com. This article will give you an insight into the possibility of the solution. Solution #1 Adding your account in their active directory. You request the administrator of contoso.com to add you as a guest in their azure directory. You request them to give you an access as owner of a resource group or as contributor in a cloud service. In a startup or small business this is possible, but in medium and large enterprise this solution might be not acceptable. You can see the tutorial here Tutorial: Grant a user access to Azure resources using the Azure portal - Azure RBAC | Microsoft Docs #3 Creating service principle to connect between the Azure DevOps to their Azure. Azure DevOps has a feature namely services connection. It can connect the subscription into the Azure DevOps. You can see the video here. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

How to Become DevOps Engineer?

What is DevOps Engineer DevOps engineer is a sensual role in a company that focus in delivering software engineering toolchain and culture in the organization. DevOps engineer is a software engineer that care not only to build a software but also to operation the software. The purpose of the DevOps is to improve the productivity of the developer and the performance of the operation team. It happens by creating a set of culture and computing environments that support their workflow. DevOps is closely related to the cloud computing. Cloud computing empowers the DevOps process to achieve more by reducing the complexity in the infrastructure. On this article, we will discuss how to become DevOps engineer. We will use DevOps toolchain from Microsoft or Amazon AWS interchangeably. The Component of the DevOps We already hear this about its thousands of times. The six practices of the DevOps are: Continuous integration. A practice that integrates your codes into one single repository (such as GitHub). After that, the codes are tested and automated. Continuous delivery. A practice that automatically deploy your tested codes into staging environments or production Microservices. A practice that composes your codes into small pieces that has loosely coupled dependency. Infrastructure as a code. A practice that automatically construct the infrastructure that needed for development and production. Monitoring and logging. A practice that monitors your production infrastructure as well as your application through log and metrics. It also provides alert or automatic action based on the metrics. Collaboration and communication. A practice that delivers the organization an environment to do communication and collaboration that blended with the DevOps initiatives. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; The Domain of the DevOps Knowledge If you want to learn a DevOps and proof your DevOps knowledge you should understand these domains. Domain 1. SDLC Automation. Understanding what DevOps and what toolchain that you can use. Domain 2. Configuration management and Infrastructure as a code (IAAC). Be able to prepare the infrastructure with IAAC method. Domain 3. Managing monitoring and logging. Be able to setup and to configure toolchain that related with monitoring and logging. Domain 4. Applying policies and standard automation. Be able to enforce the security, governance, and policy to DevOps environment. Domain 5. Recovering from incident. Be able to do restore operations in DevOps environment. Domain 6. Managing High Available, Fault Tollerance, and disaster recovery. Be able to design, to implement, and to manage best practices architecture and approaches in DevOps environments. That is the basic of DevOps knowledge domain that you should understand, let's discuss more. In another post.   medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

Simplifying IoT solution with Cloud Computing

Creating IoT environment and solution is not an easy task. There are several challenges that we face such as the heterogenic of the device, security, and the complexity management solution of IOT. Fortunately, we have a cloud who can reduce the risk of integration, management, and the lack of security. Yesterday, I discussed how Cloud Computing can solve the IoT issue. The event that held by 165 participants in UTY (Universitas Technology Yogyakarta). It executed on 10 April 2021. The key discussion in this event is: High Level IoT architecture On this part, we should understand several IoT Architecture. For example, in Azure we have two main architectures. Centralized model. On this model, we have Azure IoT Central as software as a service that help to manage our plug and play device Gateway model. On this model, gateway become a hub to connect the IoT device and forward the data to the processing solution such as streaming analytics or power bi   medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; Microsoft Product Portfolio Microsoft has ready to use solution to fulfill the main scenario. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; Video tutorial VSID has a video tutorial that can be viewed here

Understanding Cloud Computing as Enabler

Cloud is anywhere, from the consumer to the enterprise. Many of them already adopt the cloud. Cloud computing is not only a technology but culture that you might need to understand. We start to see the benefit cloud for personal such as storing files with better flexibility in access and space. Organization sees a cloud as enabler to expand their business without invest on capital expense. You can see a cloud in various point of view, but every point of view will give you similar answer. Cloud as enabler to do more. Cloud in Before – After Scenario We will see several examples that you already did before and after the cloud exist. Before the cloud, you should put the files into your hard drive. You should never forget the hard drive, and make sure the hard drive is work as expected, you will have limited space based on you hard drive size, when you need more space you need to migrate into larger hard drive. You can put your files in the cloud, you can access it anywhere. Cloud already has virus protection and disaster recovery. When you need more storage, you can subscribe more storage without migrating your content. Before the cloud, organization should buy a server. Server should be bought in up-front cost. Organization should configure the network, the operating system, and the application. You can rent a server through IaaS (infrastructure as a services), organization only pay what you need. If the organization doesn't need the server, they can deallocate the resources without the need of initial investment. Before the cloud, academia should buy a machine learning server that costly. They should invest to collect the data, to train the data, create a model, and deploy a model. Academia can consume ready to use intelligence service such as cognitive service API or DSVM (data science virtual machine) Is Cloud too Expensive. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; You can see the table to understand is the cloud more expensive than having on-premises resources. As you can see, the cloud is performed better when you use huge resources and give you additional services when you use small amount resources. ScenarioNotesOn-Premises InvestmentCloud Investment Put the files in the cloudYou bought one 1 TB hard drive vs 1 TB OneDrive personal includes49$ No backup No Software No Sync 69$ / year Backup Office Software SyncOrganization Bought A ServerYou compare the server with the IaaS solution from Azur1500$ 8 GB Ram, 500 HDD, 450 watts w/o electricity w/o security w/o network w/o OS108$ / month All inAcademia bought ML Machine ServerYou compare buy NVIDIA DGX server with Azure DSVM140.000$ NVIDIA Grid 2 w/o electricity w/o security w/o network 1.3$ / hour - all in  How to learn cloud? You can get a lot of resources from the cloud provide. Here is my favorite list. The Developer's Guide to Azure | Microsoft Azure Azure on Microsoft Learn | Microsoft Docs Resource search results | Microsoft Azure medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

Database Deployment in Visual Studio

A software project should have a database. You can use SQL or no-SQL database. You choose SQL when you work with structured data that should have specific constraint and schema. You choose no-SQL if you prefer a simple and high-performance data access. Visual Studio officially support both databases. On this article, we discuss what database option that we have and how to choose the correct option. SQL Database You have a lot of options to deploy SQL-based database. We will focus on two main approaches in this post. SQL database that can be embedded in the application. If you build a desktop software that run on top of Windows. You can use Microsoft Access. If you build a web that run on top of Windows based hosting. You can use SQL Compact Edition. You can install the extension on the visual studio marketplace SQL Database that should deployed separately in the application. If you build a web that build the database from the scratch or existing SQL script, you can use the SQL Database Project If you build a web that use code-first design, you can use Code First to a New Database - EF6 | Microsoft Docs You can deploy both database to Microsoft Azure and your on-premises environment. You can do the deployment process through SQL Server Management Studio or Visual Studio Server explorer or publish profile. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; No SQL Database Unfortunately, there is no built-in support for No SQL Database. This is because the NO SQL database is simple enough to install and to implement by using NuGet package manager. My first choice is to use Mongo DB. You can install the extension of Mongo DB Mongo DB Tools - Visual Studio Marketplace If you want to deploy into the cloud you can use Cosmos DB. You can visit NuGet Gallery | Microsoft.Azure.DocumentDB 2.13.1 medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

Monitoring and Logging in Cloud Era

The Concept Running application on top application is a great news! However, it does not mean that there is no problem within the solution. The codes sometime behave not right and you need to identify and fix it right away, In order to do that, monitoring and logging provides useful information to understand the behavior of the codes. Monitoring: a process to monitor a variable (metric) in the application Logging: a process to write useful information AND metric into a database or a storage By default, logging is collecting data and monitoring is watching the data that is collected. After monitoring, the system can do two types activities: Act: for example, running a script, doing auto scale and notify the developer Analyze: for example, creating a report, show an anomaly, and metric math. The Technology In the cloud we have two technologies: Monitoring an application: for example: Amazon X-Ray or Azure App Insight Monitoring an infrastructure: for example: Amazon CloudWatch or Azure Monitor medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; The Metrics What are recommended metrics to monitor and log, you can see the table StackWhat to monitorLoad BalancerHTTP codes, Queue length, latency Virtual Machine CPU usage, CPU credit, Memory, Status Check FailedNetworkNetwork in and out, LatencyI/OUsage disk, disk write / disk readApplicationInterested variablesAuto ScalingState of Instance (Start/Pending), Min / Max Group Size, 400 / 500 codes  The Log Behavior In general, the log will be stored in 15 months in major log services such as CloudWatch or Azure Monitor. However, you can make it persistent in storage such as blob or storage. Here is an example in AWS. You might want to monitor continuously by streaming the data. For example, when we are using IOT device. We can also provide tags to add useful information for our log. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

AI Learning Path for Novice

Learning AI by Doing It As a person who does not have a perfect background on Mathematics and Basic Science, learning AI is somewhat challenging. However, AI is not a new kid on the block. If you want to start to learn AI by today, you shall find numerous things to learn and it will become complicated. On this article, I want to share about how to learn AI with the minimum effort at the beginning and then increasing based on your need. I split the steps into three major steps: Level 1 (Fundamental), Level 2 (Associate), and Level 3 (Expert). As a case study, I use Microsoft ecosystem to start the learning process. Let's get started. Level 1 Fundamental Start to learn what is AI all about. Think the AI as a solution rather than a set of mechanism / process. On this level, you should learn what AI impact in the society. On this level, you will learn AI as a black box that empower you to do more. You can start by understanding the AI on Azure. If you want to learn how AI is applied in the cloud computing. After you grab the fundamental, try to explore which one do you find most interested to understand. If you interest with image / audio / visual, you can start learning how to use AI on computer vision If you interest with speech / text / understand the meaning, you can start learning how to use AI on natural language processing If you interest with chatbot, you can start learning how to use AI on chatbot Enriching your knowledge about the AI in this MOOC Course After you grab the fundamental knowledge my recommendation is to join AI-900 exam to validate your knowledge. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; Level 2 Associate On this level, you will learn how to develop customized AI solution based on the 'existing' model. You will need Microsoft Cognitive Services. It is a set of services that can be extended to provide a set of AI service. Azure Machine Learning Studio. It is a tool to design, develop, and deploy the AI solution. You can start the learning process by Understanding the role and the benefit of cognitive services. Azure Cognitive Language Services Azure Cognitive Speech Services Azure Vision Services Azure Decisions Azure Search Creating a model with Azure Machine Learning Studio by learning this course to learn Try to build the classification model Try to build the clustering model Try to build the regression model After this course, you can join AI-100 exam to validate your knowledge as AI engineer Level 3 Expert On this level, you will learn custom development of AI solution based on the 'niche' problems that need you to build the model from the scratch. You will need Visual Studio / Visual Studio Codes. SQL Server / Azure Data Lake / Azure Storage or any data solution that can help you to build and to maintain your model. You can start the learning process by Understanding the option to build machine learning Choosing the right tools If your computer is not sufficient you can try the Data Science Virtual Machine If your computer is good enough you can build the AI Solution with AI tools with Visual Studio Learn ML.NET if you are .NET developer, I recommend you to use Visual Studio 2019 or newer. Learn Python if you are non .NET developer, I recommend you to use Visual Studio Codes. There is a lot of option to learn after this. For example, you can learn how Deep learning, AI on IOT, AI works on data analytics, how to use ML Flow in Databricks, or using R as your choice of your programming language. After this course, my recommendation is to visit Azure Architecture Center to understand the recommended architecture to build better solution. You can learn further by clicking the links. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

Accelerating .NET development in AWS

.NET is a first-class citizen in Microsoft Azure. However, you might have a customer who want to develop with .NET but use their existing Amazon AWS infrastructure. Is it hard to start with non-Microsoft environment? This article shows my experience when having Microsoft .NET solution but hosted in AWS. Terminology between AWS and Azure As a developer, we might think that is a solution in AWS does not exist in Azure (or vice versa). The Good News are cloud computing environment in Azure and AWS have similar terminology. Is just like buying a coke with brand Coca Cola vs Pepsi, you will have similar terminology Amazon EC2 vs Azure VM S3 vs Azure Storage Amazon RDS vs Azure SQL Dynamo DB vs Cosmos DB Elastic Beanstalk vs App Services medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; You can find a long list of this comparison here. In conclusion, you do not need to worry that your solution is not exist in AWS. .NET Support for Developer Amazon and Microsoft are open platform cloud computing environment. Therefore, you will find the .NET solution cam be deployed there through IaaS or PaaS environment. However, if you want to develop the .NET solution that utilize the AWS services (i.e. S3) you can download AWS Toolkit for Visual Studio. This is a tool that help you connect, manage, and consume the AWS infrastructure directly in your Visual Studio. You can download the toolkit for Visual Studio 2008, 2010, 2012, 2013, 2015, 2017, and 2019 here. AWS Toolkit for Visual Studio Codes. If you are using Visual Studio Codes the AWS toolkit is ready for you. Just search the AWS toolkit and you will find the way You can get see the getting started video here Comparing the Cost between Azure and AWS If your customer, ask you which one is better. You will be said that solution work great. In term of cost, both services are equal. I am hosting a .NET solution in EC2 instance with 4GB RAM, 2 VCPU, and 100 GB HDD, and Windows. I will get I am hosting a .NET solution in Azure VM with similar spec, I will get You can compare between the solution by visiting: Amazon AWS calculator Azure Pricing Calculator So which one do you choose? I recommend you play it around and decide. If your customer requests are AWS, it is a good time to install toolkit! See you next time! medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

MLOps a DevOps Culture for Machine Learning

What is MLOps and Why You Should Care? MLOps is a DevOps in Machine Learning Project. Just imagine you have a project to build an AI 'empowered' software. You need to build the AI feature through machine learning approach. You should build model, test the model, and implement it into your software. There are extra steps you should fulfill and implement the MLOps means you can make sure that the machine learning activity can be well integrated with your DevOps. MLOps = DevOps + ML Project What is the key difference between MLOps and DevOps? MLOps is an extra step in the DevOps. Therefore, some additional activity will be happened in MLOps. Here are the key deference's MLOps is an iteration of experiment. MLOps provides additional iteration to experiment the model. You can put the experiment before the scrum sprint or includes it in the Scrum. MLOps needs to be monitored. When building the model, you need to understand that the model itself need to be monitored carefully. Imagine you have a DGX1 to play with the dataset, you need to monitor the DGX 1 status with Azure Monitor. MLOps needs automation before the model is built. Imagine you have dataset; you might need to pre-processing first. This extra step is part of MLOps MLOps needs to handle model validation. MLOps doesn't use acceptance test, unit test, or code coverage. It uses different approaches. You might need validation set to validate your model. Doing some statistics measurement for error rate or something like that MLOps needs a special member. MLOps might need more than software engine. Data Engineer, Data Science, or AI engineer can be part of MLOps medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; How do I get started with MLOps? To get started in MLOps you should learn You should learn how to build machine learning models. You can learn here for free You should learn how to scale your AI solution and ML model. You can learn here for free. You can see the implementation of MLOps here Any Quick Reference for MLOps? We have it for you, you can click to download the PDF file. Case study about MLOps – Download Here MLOps infographic – Download Here MLOps how to implement it – Download Here In the next post, we will learn MLOps in step-by-step. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";

Active Backup for Microsoft 365

A lot of organization uses Microsoft 365 for their productivity. The increasing number of users and data on the cloud make the Microsoft 365 become one of the biggest digital assets on the organization. Although Microsoft 365 provides a data redundancy and data durability. The Cloud provider does not give warranty that the data can be accessed efficiently. In the multi-account environment, there are so many assets for each account such as: Email attachment Contact Files on OneDrive SharePoint Calendar Attachment On this article we want to show you how to do backup activity for our own Microsoft 365 by using the free solution from Synology NAS. medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299"; Introducing Active Backup for Microsoft 365 Organization should control the data so that the data can be accessed efficiently and can be used effectively. To do that we should download and backup or data in the on-premise. The on-premise solution is never been easier without NAS. Active Backup for Microsoft 365 provides you with a great feature such as: Backing up your SharePoint Online, Exchange Online, and OneDrive for Business. Centralized management for multiple accounts. Easy backup for new accounts and sites. Providing retention policy, continuous backup and many more. Storage efficiency and fast backup in your NAS. You can see the details of the feature here How to use Active Backup The video will show you how. You can download the script here. You can read the tutorial here medianet_width = "600"; medianet_height = "250"; medianet_crid = "858385152"; medianet_versionId = "3111299";