Deploy Jenkins with Terraform

REFERENCE THE LINK INSTALLING TERRAFORM ON YOUR LOCAL MACHINE BEFORE STARTING THIS LAB.

The goal is to automate the installation of Jenkins on EC2 instance. This lab will walk you through configuring and installing Jenkins with userdata.

Prerequisites:

AWS access and secret keys are required to provision resources on AWS cloud.

Open Visual Code Studio then click on File > Preferences > Extensions then search and install Terraform extension

• 
  

• 
  
• Login to AWS console, click on Username on top right corner and go to My Security Credentials

• Click on Access Keys and Create New Key

Step I: Open File Explorer, navigate to Desktop and create a folder jenkins_workspace.

Step II: Once folder has been created, open Visual Code Studio and add folder to workspace

Step III: Create a new file main.tf and copy the below code in yellow color

provider "aws" {

        access_key = "ACCESS KEY"
        secret_key  = "SECRET KEY"
        region         = "us-east-2"

}

resource "aws_instance" "jenkins" {

    user_data   = base64encode(file("deploy.sh"))
    ami                                = data.aws_ami.ubuntu.id
    instance_type                = "t2.micro"
    vpc_security_group_ids = [aws_security_group.jenkins_sg.id]
    root_block_device {
    volume_type                  = "gp2"
    volume_size                   = 200
    delete_on_termination   = true
    encrypted                       = true
  }

  tags = {
    Name = "u2-cicd-jenkins"
  }

}

Add the block below in main.tf to output the Private IP, Public IP and EC2 Name after creation. (Note: This is not required)

output "ec2_ip" {

    value = [aws_instance.jenkins.*.private_ip]

}

output "ec2_ip_public" {

    value = [aws_instance.jenkins.*.public_ip]

}

output "ec2_name" {

    value = [aws_instance.jenkins.*.tags.Name]

}

Bash Script to Deploy Jenkins

• Create a new file deploy.sh and copy the below code in yellow color. 

#!/bin/bash

echo This is installing 3

sudo apt-get update

sudo apt-get install default-jdk -y

java -version

echo Completed installing java

sudo mv -f /home/ubuntu/environment /etc/

source /etc/environment

echo Set JAVA HOME  

wget -q -O - https://pkg.jenkins.io/debian-stable/jenkins.io.key | sudo apt-key add -

echo This is installing 8

sudo sh -c 'echo deb https://pkg.jenkins.io/debian-stable binary/ > /etc/apt/sources.list.d/jenkins.list'

echo This is installing 9

sudo apt-get update

echo This is installing 10

sudo apt-get install jenkins -y

sudo sed -i 's|/bin:/usr/bin:/sbin:/usr/sbin|/bin:/usr/bin:/sbin:/usr/sbin:/home/ubuntu/jdk1.8.0_251/bin|g' /etc/init.d/jenkins  

sudo systemctl daemon-reload  

sudo systemctl start jenkins  

echo Installation Complete  

cd /home/ubuntu/  

wget https://releases.hashicorp.com/terraform/0.12.24/terraform_0.12.24_linux_amd64.zip  

unzip terraform_0.12.24_linux_amd64.zip  

sudo mv terraform /usr/bin/  

sudo apt-add-repository ppa:ansible/ansible

sudo apt install ansible

sudo apt-get install python -y

sleep 5  

sudo cat /var/lib/jenkins/secrets/initialAdminPassword  

Step IV: Create a new file data.tf and copy the below code in yellow color

data "aws_ami" "ubuntu" {

    most_recent = true

    filter {

        name   = "name"

        values = ["ubuntu/images/hvm-ssd/ubuntu-xenial-16.04-amd64-server-*"]

    }

    filter {

        name   = "virtualization-type"

        values = ["hvm"]

    }

    owners = ["099720109477"] # Canonical

}

Step V: Create a new file security.tf and copy the below code in yellow color

resource "aws_security_group" "jenkins_sg" {

name = "jenkins-dev-sg"

description = "EC2 SG"

ingress {

from_port = 22

to_port = 22

protocol = "tcp"

cidr_blocks = ["0.0.0.0/0"]

}

   ingress {

from_port = 8080

to_port = 8080

protocol = "tcp"

cidr_blocks = ["0.0.0.0/0"]

}

#Allow all outbound

egress {

from_port = 0

to_port = 0

protocol = "-1"

cidr_blocks = ["0.0.0.0/0"]

}

tags = {
    Name = "jenkins-dev-sg"
  }

}

Step VI: Open Terminal in VSCode

Step VII: Execute command below

terraform init

the above command will download the necessary plugins for AWS.

terraform plan

the above command will show how many resources will be added.

Plan: 2 to add, 0 to change, 0 to destroy.

Execute the below command

terraform apply

Plan: 2 to add, 0 to change, 0 to destroy.

Do you want to perform these actions?
  Terraform will perform the actions described above.
  Only 'yes' will be accepted to approve.

  Enter a value: yes

Apply complete! Resources: 2 added, 0 changed, 0 destroyed.

Developers Box

Vision Public DNS ec2-18-116-71-99.us-east-2.compute.amazonaws.com 

User name Administrator

 Password JM6Z(6VdeV!WN5sHQpZ(ZX?.Pw5$wg)L

 Team-E-Developer-Box i-0edb38453348ed68c Running t2.small 2/2 checks passed No alarms us-east-2b ec2-13-59-230-97.us-east-2.compute.amazonaws.com 13.59.230.97

 Team-V-Developer-Box i-031b67b9c4b1579ed Running t2.medium 2/2 checks passed No alarms us-east-2b ec2-18-116-71-99.us-east-2.compute.amazonaws.com 18.116.71.99 Team-P-Developer-Box- i-02001b366819beaf8 Running t2.small 2/2 checks passed No alarms us-east-2b ec2-18-222-60-219.us-east-2.compute.amazonaws.com 18.222.60.219 Team-A-Developer-Box- i-0a10231af907c6ce2 Running t2.small 2/2 checks passed No alarms us-east-2b ec2-18-219-0-51.us-east-2.compute.amazonaws.com 18.219.0.51 Team-I-Developer-Box- i-0b2fe028b0cee0cd0 Running t2.small 2/2 checks passed No alarms us-east-2b ec2-18-188-10-233.us-east-2.compute.amazonaws.com 18.188.10.233 – – – – disabled launch-wizard-94 Augustkey 2021/09/15 09:50 GMT-5 – – disabled launch-wizard-95 Augustkey 2021/10/02 18:54 GMT-5 – – disabled launch-wizard-96 Augustkey 2021/10/02 18:51 GMT-5 – – disabled launch-wizard-96 Augustkey 2021/10/02 18:51 GMT-5 – – disabled launch-wizard-96 Augustkey 2021/10/02 18:51 GMT-5

atlassian-domain-verification=4lK96tXGBTMDRQjtSQSj32KE7G1j/7Wa3ryh3Ekz9Upp3Je7eLaWK3uegjqE4tLr

How to version Maven Artifacts

 

Please note: This website includes an accessibility system. Press Control-F11 to adjust the website to the visually impaired who are using a screen reader; Press Control-F10PR

Configuring build artifacts with appropriate build numbers for Jenkins Maven project

First, you’ll need to modify your Project Object Model (POM) file a bit, allowing it to accept variables on its version tag. For example:
 

<version>1.2.${v}-SNAPSHOT</version>

where v is the name of the variable that should be retrieved when running the job. Here’s a sample, POM snippet:

Next, as regards to your Jenkins (Maven project) job configuration, you’ll need to edit the Goals and Options field. In your POM file, the value referenced in ${} should be the same as that which you’re using for Goals and Options. For example, in the illustration above:
 

1.2.${BUILD_NUMBER}-SNAPHOT

is the defined version in the POM file. Therefore, you’ll need to configure Goals and Options as:
 

clean install -Dv=${BUILD_NUMBER}

which you can see here:

where {BUILD_NUMBER} is the value that you’re currently running on Jenkins, which will be captured in the variable "v". The name of the artifacts, which will be deployed to Artifactory, will look similar to the following:

"18" is the deployed build number in the Jenkins. Therefore, the package has been deployed with the name 1.2.18-SNAPSHOT as it was declared as 1.2.${v}-SNAPHOT in the POM file.

Project Script

 Docker Compose file for Dokuwiki

version: '2'

services:

  dokuwiki:

    image: docker.io/bitnami/dokuwiki:20200729

    ports:

      - '80:8080'

      - '443:8443'

    volumes:

      - 'dokuwiki_data:/bitnami/dokuwiki'

volumes:

  dokuwiki_data:

    driver: local

bash: Tomcat

#!/bin/bash

set -x

echo ""

echo "........................................"

echo "Installation of application"

echo "........................................"

echo "Today's date: `date`"

echo "........................................"

echo ""

sudo apt-get update

echo "........................................"

echo "apt update completed........................................"

sudo apt-get install default-jdk -y

echo "installing java........................................"

java -version

echo "installing tomcat 8........................................"

sudo apt-get install tomcat8 -y

sudo apt-get install tomcat8-docs tomcat8-examples tomcat8-admin -y

sudo cp -r /usr/share/tomcat8-admin/* /var/lib/tomcat8/webapps/ -v

echo "changing port from 8080 to 4000........................................"

sudo sed -i 's/8080/4000/g' /var/lib/tomcat8/conf/server.xml

echo "set up a user in tomcat........................................"

CONTENT="<role rolename=\"manager-script\"/>\n<user username=\"tomcat\" password=\"password\" roles=\"manager-script\"/>"

C=$(echo $CONTENT | sed 's/\//\\\//g')

sed "/<\/tomcat-users>/ s/.*/${C}\n&/" /var/lib/tomcat8/conf/tomcat-users.xml >> file

mv /var/lib/tomcat8/conf/tomcat-users.xml /var/lib/tomcat8/conf/tomcat-users.xml.bck

mv file /var/lib/tomcat8/conf/tomcat-users.xml 

echo "add memory to jvm........................................"

sed -i 's/JAVA_OPTS/#/g' /etc/default/tomcat8

echo "JAVA_OPTS=\"-Djava.security.egd=file:/dev/./urandom -Djava.awt.headless=true -Xmx512m -XX:MaxPermSize=512m -XX:+UseConcMarkSweepGC\"" >> /etc/default/tomcat8

echo "restart tomcat........................................"

sudo systemctl restart tomcat8

echo "check status........................................"

echo this script was written by team excellence use with permission

sudo systemctl status tomcat8

exit

How to install Artifactory on a Centos Linux Machine

 Step 1

Launch a Centos 8 instance in AWS

Launch instance...select AWS Market...search for CentOS 8 (x86_64) - with Updates HVM

Launch instance and open Port 8081, 8082

We have clubbed all the commands and created a simple script to install the Jfrog on CentOS 8. The benefit of using script is that we can run all the steps just executing the script at one shot. And also we can keep the script and use at any/multiple time.

Step 2:  Log into the instance. Create a file, The vi editor are our favorite hence using same.

vi install_jfrog_centos8.sh

Paste the given below content and save the file.

#/bin/bash
#
# Install jfrog on CentOS 8
# Blog: https://sharadchhetri.com

# Disable the SELINUX on CentOS 8
# set temporary permissive selinux mode. reboot not require
sudo setenforce 0
# In next reboot,the below line will help to set disable selinux permanently.
sudo sed -i s/^SELINUX=.*$/SELINUX=disabled/ /etc/selinux/config

# jfrog oss 7.x require Java 11, installing wget and openjdk
sudo yum install -y wget java-11-openjdk*

# download jfrog repo and directly keep in /etc/yum.repos.d dir
sudo wget https://bintray.com/jfrog/artifactory-rpms/rpm -O /etc/yum.repos.d/bintray-jfrog-artifactory-oss-rpms.repo

# install jfrog-artifactory-oss (open source)
sudo yum install -y jfrog-artifactory-oss

# yaml files are indent sensitive. So do not remove spaces while copying. Keep as it is.
# creating system.yaml
cat <system.yaml
configVersion: 1
shared:
    extraJavaOpts: "-server -Xms512m -Xmx2g -Xss256k -XX:+UseG1GC"
    security:
    node:
    database:
EOF

# copying above created system.yaml and replacing by original one. It backup the original system.yaml file also.
sudo cp -brvf system.yaml /var/opt/jfrog/artifactory/etc/system.yaml

# enable artifactoyr.service as well as start the service at a same time
sudo systemctl enable --now artifactory

Step 2: Give executable permission to the script.

sudo chmod +x install_jfrog_centos8.sh

Step 3: Now execute the script.

sh install_jfrog_centos8.sh

You may get errors like below. Dont be alarmed. Arti factory is still installed

Step 4: Once the script is finished successfully, now open the web browser and hit the Jfrog IP address at port number 8081 and do the post setup.
Syntax: http://<-jfrog-ip-or-fqdn->:8081

For example, as per our jfrog server ip address in web browser we have typed http://192.168.33.10:8081. This will open the Jfrog Dashboard in web browser from where you can do the rest of the post setup. 

Username:admin

pswd: password

 

Fill Proxy details else press ‘Skip’

 

Select Package Type or Skip

To again login in Jfrog, you can use Syntax: http://<-jfrog-ip-or-fqdn->:8081. Now you can easily manage the artifacts from Jfrog Artifactory. For DevOps, integerate the Jfrog Artifactory with CI/CD pipelines.

Course Survey