4. Networking

4.1. Linux networking

  • Overview of network protocols and TCP/IP in Linux.

  • Network configuration in Linux.

  • Netplan on Ubuntu servers.

  • Network settings in Red Hat for NetworkManager.

  • Network applications and services.

  • Network calculation with ipcalc

  • Network troubleshooting tools: ping, traceroute, tcpdump.


4.2. Computers on the intertnet

  • Network communication allows sending information, transfering files, and managing applications remotely between computers.

  • Networks are organized in a series of layers implemented on each machine.

  • The layers are independent and each layer offers a specific task to the neighboring layers above and below.

  • The communication between the layers is based on defined rules and procedures, called protocols.

  • Data is processed and passed through the layers from above to below, until the bottom layer is reached.

  • At the bottom layer, computers communicate with each other via sending and receiving network datagrams through - cables, switches and routers.


4.3. TCP/IP 5 layer protocol suit

Each layer has its own task:

TCP/IP Protocol Layer

Tasks

5. Application Layer: ssh, ftp, http …

Data segmentation by the application into Message Transfer Unit (MTU) segments. Typical MTU is 1.5 Kbyte, which includes the data payload plus 40 bytes for TCP and IP headers.

4. Transport Layer: TCP, UDP, ports

Connection management, quality, and ports to the applications

3. Internet Layer: IP addresses, subnets, routing

Addressing: each computer has a unique address on its network or subnet. Routing between networks.

2. Link Layer: Ethernet

Communication on the local network (subnet) through a switch. Media Access Card (MAC) address unique on the subnet. For example, 48:d2:4f:f4:d:fb, should be unique within a subnet. Address Resolution Protocol (ARP) matches the IP address to MAC on the subnet.

1. Physical Layer: NIC, hubs, switches, routers, cabling, wifi APs and cards

Electronic devices to send and receive signals between computers.


4.4. OSI 7 layer Network Stack Model

TCP/IP Protocol Layer

Task

7. Application Layer: ssh, ftp, http …

Data segmentation by the application into Message Transfer Unit (MTU) segments. Typical MTU is 1.5 Kbyte

6. Presentation Layer: SSL, libz, XDR

Data encryption, compression, and encoding/decoding

5. Session Layer: Remote Procedure Call (RPC)

Responsible for opening, using and closing sessions. Remote procedures.


4.5. TCP/IP and Kernel

The Link, Internet and Transport layers are implemented through kernel.


4.6. Packet Encapsulation

Data is processed in form of packet encapsulation and transmitted/received in form of Ethernet frames.


4.7. Hosts communication via TCP/IP


4.8. Wired connection checkup (Exercise)

  • To see whether your desktop is connected to a network switch and at what speed, use command ethtool.

  • On your desktop, install package ethtool:

apt install ethtool
  • See your network interfaces with command ifconfig or ip a:

/sbin/ifconfig -a

or

ip a

The main network interface, connected to the Ethernet, is enp0s3. Run command below:

/sbin/ethtool enp0s3

In the output, among various parameters, it doesn’t show Speed and Duplex because the desktop is a VM in VDI.

  • Speed: Unknown!

  • Duplex: Unknown!

  • Link detected: yes

If the desktop was installed on a bare metal hardware, we would see something like below:

  • Speed: 1000Mb/s,

  • Duplex: Full,

  • Link detected: yes

Which means the cable is connected and the link speed is 1Gb/s speed, full duplex mode.


4.9. Network IP configuration

  • Static configuration

    • IP address, gateway, hostname, and Domain Name System (DNS) are configured on the host.

  • Dynamic Host Configuration Protocol (DHCP)

    • The settings are obtained from a DHCP server.


4.10. Environment for IP configuration on Ubuntu and RedHat

ifupdown scripts

NetworkManager service

Netplan networkd service Meaning

Old Debian/Ubuntu:

Ubuntu desktop, Debian, Redhat:

Ubuntu server:

File: /etc/network/interfaces

Commands: nmtui, nmcli

File:/etc/netplan/00-installer-config.yaml

RedHat:

Redhat

Command: netplan apply

File: /etc/sysconfig/network-scripts/ifcfg-ens3

File: /etc/NetworkManager/system-connections/<conn name>.nmconnection

Command:ifup ens3

systemctl restart NetworkManager; nmcli con up <conn name>


4.11. Deploy a new VM for exercises

Shutdown kvm1 VM, and clone it into netplan VM:

virsh shutdown kvm1
virt-clone  -o kvm1 -n netplan -f /home/hostadm/KVM/netplan.qcow2

Start netplan. Login to console of netplan:

virsh console netplan

Fix the hostname in file /etc/hostname.

Reset the machine ID by running the following script on netplan:

./vm_id_reset.sh

Execute command reboot on netplan:

reboot

4.12. Configuring network settings on Ubuntu server with Netplan (Exercises)

On netplan VM check the IP address settings by running command below:

ip addr

All the commands below in this section need to be run as root. Elevate the user privileges to root:

sudo -s

Assign IP address 192.168.122.222 by modifying the content of /etc/netplan/00-installer-config.yaml as follows:

---
network:
  version: 2
  renderer: networkd
  ethernets:
    enp1s0:
      dhcp4: false
      addresses:
        - 192.168.122.222/24
      routes:
        - to: default
          via: 192.168.122.1
      nameservers:
        addresses: [192.168.122.1]

Install the Yaml syntax check tool:

apt install yamllint

Check the network configuration file for syntax correctness:

yamllint /etc/netplan/00-installer-config.yaml

If no errors found, have the new network settings applied:

netplan apply

Check the IP address again:

ip addr

It should show 192.168.122.222 for ens3 interface now.

See the gateway settings by running command

ip route show

It should show the “default via 192.168.122.1”

Logout and disconnect from the console.


4.13. Clone rocky9 VM (Exercises)

Make sure rocky9 is down:

virsh list
virsh stop rocky9

Clone rocky9 into new VM rocky:

virt-clone -o rocky9 -n rocky -f /home/hostadm/KVM/rocky.qcow2

Start the VM:

virsh start rocky

Connect to the cnsole:

virsh console rocky

Login to the system.

You need to install editor dbus-tools:

sudo dnf install dbus-tools

Change the hostname to rocky by editing file /etc/hostname with nano.

Reset the machine ID:

sudo rm -f /etc/machine-id
sudo dbus-uuidgen --ensure=/etc/machine-id
sudo dbus-uuidgen --ensure
sudo dhclient -r eth0

Reboot the VM.


4.14. Network configurations on a Red Hat server (Exercises)

On RedHat based systems, we can use nmcli to control the network settings in the NetworkManager service.

Start rocky VMs:

virsh start rocky

Login to console of rocky:

virsh console rocky

Execute command ip address show to read the IP address:

ip addr show eth0

Try pinging netplan by its IP address, for example:

ping -c 3 192.168.122.222

Become root on rocky VM

sudo -s

By using command nmcli check available and active connactions:

nmcli conn show

There is connection named “System eth0” for interface eth0.

See the settings for device eth0:

nmcli dev show eth0

With command nmcli, we can create various connections with different settings for eth0 interface, then we can activate the needed connection, and de-activate non-needed.

Let’s create new connection named “eth_static” and assign it static IP address 192.168.122.126 and netmask /24:

nmcli con add type ethernet con-name eth_static ip4 192.168.122.126/24 gw4 192.168.122.1

Activate the connection:

nmcli con up eth_static

Check the connection status:

nmcli conn show

Check the new IP address:

ip addr show eth0

Change the IP address to 192.168.122.25 via nmcli command:

nmcli con modify eth_static ipv4.addresses 192.168.122.125/24

Activate eth_static connection: Activate the connection:

nmcli con up eth_static

Check the connection status:

nmcli conn show

Check the new IP address:

ip addr show eth0

Alternative way of modifying the IP address settings for a connection.

When creating a new connection with nmcli command, a new file is created in directory /etc/NetworkManager/system-connections/.

We can modify the settings in the file with an editor, then restart the NetworkManager and activate the connection, for example:

systemctl restart NetworkManager
nmcli con up eth_static

Revert back to the DHCP based connection

nmcli conn show

We need to activate connection “System eth0”:

nmcli conn up "System eth0"

4.15. Internet Control Message Protocol (ICMP) protocol (Exercises)

Implemented on hosts and gateways (routers) for:

Reporting the status of datagram processing. Diagnostics of connection and routing. Reporting errors in the processing of a datagram.

Example: ping

Exercise: command ping.

ping -c 5 capone.rutgers.edu
ping -c 5 engsoft.rutgers.edu
ping -c 5 google.com

If the systems respond, it means they are reachable on the network. Notice how varies the round-trip time and Time to Live (ttl) for packets between the hosts.

Example: traceroute

Time to leave (TTL) decrement. The TTL value of an IP packet represents the maximum number of IP routers that the packet can go through before being thrown away. You can expect each router in the Internet to decrement the TTL field by exactly one. The default TTL for traceroute on Linux is 30. It can be increased up to 255 maximum by using the -m command option.

Exercise: command traceroute.

sudo apt install traceroute
sudo /usr/sbin/traceroute -I capone.rutgers.edu
sudo /usr/sbin/traceroute -I engsoft.rutgers.edu
sudo /usr/sbin/traceroute -I google.com

This shows you all the gateways between the subnets your packet travels towards the destination. Notice the difference in the number of gateways between your desktop and the three remote hosts as well as the round trip times.


4.16. Network applications: ssh, sftp, scp, rsync (Exercises)

Make sure virtual machine netplan is running

virsh list

Figure out the IP address of netplan:

virsh domifaddr netplan

Place the IP address and netplan host name into file /etc/hosts on your desktop. netplan IP is 192.168.122.222

nano /etc/hosts

Make entry in the file: 192.168.122.222   netplan

ssh to netplan as user hostadm:

ssh hostadm@netplan

Configure SSH for private/public key authentication. For SSH authentication, you can use either RSA or DSA public/private keys besides password. We’ll be using RSA in the exercises below. To generate an RSA key pair, type the following command at a shell prompt on your desktop:

ssh-keygen -t rsa

Accept the default file location of ~/.ssh/id_rsa. Enter a passphrase different from your account password and confirm it by entering it again. The public key is written to ~/.ssh/id_rsa.pub. The private key is written to ~/.ssh/id_rsa. Never distribute your private key to anyone. The contents of ~/.ssh/id_rsa.pub needs to be delivered onto the remote machine to which you want to connect, specifically netplan, into file ~/.ssh/authorized_keys To accomplish the transfer task, here you can use one of the commands for file transfer. Commands scp and sftp come with ssh. We use interactive sftp command here:

sftp  netplan
Name (netplan:hostadm): hostadm
sftp> cd .ssh
sftp> lcd .ssh
sftp> put id_rsa.pub authorized_keys
sftp>  quit

Command cd in the sftp> shell above is for stepping into the directory, .ssh, on the remote host, netplan. Command lcd is for stepping into the directory, .ssh, on the local desktop.

Now try to ssh to netplan. You should be prompted to enter your passphrase.

The ssh-agent can be used to store your passphrase so that you do not have to enter it each time you make a ssh or scp connection. At a shell prompt on the desktop, type the following command:

exec /usr/bin/ssh-agent $SHELL

Then type the command:

ssh-add

and enter your passphrase(s). If you have more than one key pair configured, you will be prompted for each one. When you log out, your passphrase(s) will be forgotten. You must execute these two commands each time you log in to a virtual console or open a terminal window.

Run a remote command over ssh, for example:

ssh netplan "uname -a"

Beside sftp, command scp can be used for copying files from host to host. In scp, the first argument is the source_host:source_file, the second is destination_host:destination_dir. If the source_host or the destination_host is local, it is absent in the argumernt. The local directory is signified by .

Copy file /etc/hosts from netplan VM to the current directory on the desktop by using scp command:

scp netplan:/etc/hosts .

Copy new file, somef.txt, from the local directory to the home directory on netplan VM.

touch somef.txt
scp somef.txt netplan:/home/$USER

You can also copy a group of files, for example, somef.txt and /etc/hosts, by placing them in block {}:

scp {somef.txt,/etc/hosts} netplan:/home/$USER

Directories can be copied recursively with scp. For example, to copy /etc directory recursively from the desktop to the user home directory on netplan:

scp -r /etc netplan:

Syncronizing directories between remote hosts by using rsync. This tool lets you copy files and directories between a local host and a remote host. Install rsync on both your desktop and netplan:

apt install rsync

Creat a directory tree and copy it over to netplan with rsync command.

mkdir -p dir1/dir2/dir3
rsync  -avz dir1 netplan:/home/$USER

Option a stands for archive (preserve links and timestamps); v is for verbose and z is for data compression when sending-receiving.


4.17. Send/receive data with netcat (Exercises)

Netcat is a very useful tool to connect to any TCP and UDP port on a remote host, and send/receive data.

Start both, netplan and rocky VMs:

virsh start netplan
virsh start rocky

Login to console of netplan:

virsh console netplan

Bring up another command prompt on the desktop and login to rocky

virsh console rocky

Become root on both the VMs

sudo -s

Step

On Ubuntu (server)

On rocky

1.

Install netcat: apt install netcat

dnf install nmap-ncat

2.

Start netcat as a server, listening on port UDP/8080:

Connect to UDP/8080 port on netplan, 192.168.122.222:

netcat -l -u 8080

ncat 192.168.122.222 -u 8080

3.

When the session is over, type Ctrl-C to stop the netcat server.

Start typing text. Hit ENTER key. The text should appear on the both terminals. Press Ctrl+D to close the UDP connection.

4.

Start the server on TCP/8080 to write into a file, outputfile.txt

Send file /etc/hosts to TCP/8080 on netplan VM via netcat

netcat -l 8080 > outputfile.txt

ncat 192.168.122.222  8080 < /etc/hosts

5.

After the file is received, the connection closes itself. Check the content of the file:

less outputfile.txt


4.18. Subnets and routing

Example: Host A can communicate with both the hosts - B and C. Hosts B and C can’t communicate with each other. What is the problem?
Answer: the routing (gateway) is not defined on Host B.

4.19. Network calculation, gateway and routing

  • Computers connected to the same switch are on the same network/subnet and communicate with each other directly through the switch.

  • For computers located on the different networks/subnets, gateway/router is needed.

  • To define the local subnet, netmask is used.

  • Subnet mask defines the network and the host parts of the IP address

Network address = Host address (logical AND) Netmask:

Address

Decimal/Hexadecimal

Binary

IP address

192.168.5.10

11000000 10010100 00000101 00001010

Netmask

255.255.255.0

11111111 11111111 11111111 00000000

Network address

192.168.5.0

11000000 10010100 00000101 00000000

  • The network address is the smallest address on the network:

11000000 10010100 00000101 00000000 = 192.168.5.0

  • The broadcast address is the largest address on the network:

11000000 10010100 00000101 11111111 = 192.168.5.255

  • Max number of hosts on the subnet: 254 = 256 - 2 The gateway address should be on the same subnet with the host


4.20. IP calculator exercises

Network IP calculations with ipcalc On the desktop, install ipcalc by using APT:

apt install ipcalc

Run ipcalc for network address 192.168.5.0 with subnet mask 255.255.255.0.

ipcalc 192.168.5.0/255.255.255.0

See the output for Address, Netmask, Network, HostMin, HostMax, Broadcast, Hosts/Net. Notice the same results for the same network and the different representation of the netmask:

ipcalc 192.168.5.0/24

Notice the same results for Netmask, Network, HostMin, HostMax, Broadcast, Hosts/Net if using the different IP addresses within the same network in ipcalc, for example:

ipcalc 192.168.5.15/24
ipcalc 192.168.5.34/24

Run ipcalc for subnets (networks) 192.168.5.0/25 and 192.168.5.128/25:

ipcalc 192.168.5.0/25
ipcalc 192.168.5.128/25

Notice the values for HostMin and HostMax in both the cases. By looking at the ranges [HostMin, HostMax], you can see, for example, that IP address 192.168.5.5 belongs to the first subnet and 192.168.5.250 to the second. You can verify that by running ipcalc on the IP addresses above and then comparing the Network values:

ipcalc 192.168.5.5/25
ipcalc 192.168.5.250/25

4.21. tcpdump command to see the traffic on NIC (Exercises)

When you need to see all the network traffic on a network card, you can run the command for the network interface. It helps to identify the subnet your system is connected to, and see all the active traffic.

On netplan VM, install tcpdump:

apt install tcpdump

Run command tcpdump on the ethernet interface:

tcpdump -v -n -i enp1s0

On rocky VM, start pingin the IP address of netplan VM:

ping 192.168.122.222

See the output in tcpdump on netplan VM. It should show some traffic related to echo request and reply from rocky VM:

    192.168.122.126 > 192.168.122.222: ICMP echo request ...
    192.168.122.222 > 192.168.122.126: ICMP echo reply ...

tcpdum is very noisy because it picks up all the packets going through interface enp1s0. We can filter the output by the IP, protocol, and port, for example:

tcpdump -v -n -i enp1s0 host 192.168.122.157 and proto \\icmp

The IP address of rocky is 192.168.122.157 here. In your case it maybe different.

To see only the incoming packets, use the src IP address:

tcpdump -v -n -i enp1s0 src host 192.168.122.157 and proto \\icmp