Ken's Lotto Syndicate

This page is read only. You can view the source, but not change it. Ask your administrator if you think this is wrong.
===== How to Find the Difference Between Two Arrays in Bash =====
When working with arrays in Bash scripting, one of the common tasks you might encounter is finding the difference between two arrays. \\
This operation is essentially about identifying elements that are unique to each array when compared against the other. \\
This guide provides you with various methods to achieve this task using Bash scripting techniques, including the use of awk, loops, and built-in Bash capabilities.\\
\\
**Problem Statement.**\\
You have two arrays:\\

''arr1=("aa" "bb" "cc" "dd" "ee")
arr2=("cc" "dd" "ee" "ff")''

The goal is to find elements that are only present in one of the arrays, i.e., the symmetric difference. For arr1 and arr2, the expected result would be arr_diff=("aa" "bb" "ff").\\
\\
**Bash Approach Using Command Substitution.**\\
The initial attempt to calculate the difference uses a simple Bash command involving tr, sort, and uniq:\\
<code>
arr_diff=$(echo ${arr1[@]} ${arr2[@]} | tr ' ' '\n' | sort | uniq -u)
</code>
This method aims to produce the desired results but prints the output incorrectly as a single string rather than an array.\\
Hence, using ''echo ${#arr_diff[@]}'' outputs ''1'', indicating a single string rather than multiple elements.\\
\\
**Correcting Array Assignment.**\\
To correctly assign the result to an array, use the following adjusted command:\\
<code>
arr_diff=($(echo ${arr1[@]} ${arr2[@]} | tr ' ' '\n' | sort | uniq -u))
</code>
This adjustment ensures that ''arr_diff'' becomes an array, and now echo "${#arr_diff[@]}" correctly reflects the count of unique elements between arr1 and arr2.\\
\\
**Method Using awk.**\\
Here's a more sophisticated solution using ''awk'' that detects unique elements without relying on Bash's handling of arrays directly:
<code>
awk 'FNR == NR {
   arr[$1]
   next
}
{
   if ($1 in arr)
      delete arr[$1]
   else
      print $1
}
END {
   for (i in arr)
      print i
}' <(printf '%s\n' "${arr1[@]}") <(printf '%s\n' "${arr2[@]}")
</code>
This method outputs:
<code>
ff
aa
bb
</code>
\\
**To store this output into an array:**\\
<code>
read -ra diffarr < <(awk -v ORS=' ' 'FNR == NR {arr[$1]; next} {if ($1 in arr) delete arr[$1]; else print $1} END{for (i in arr) print i}' <(printf '%s\n' "${arr1[@]}") <(printf '%s\n' "${arr2[@]}"))
</code>
With this, ''declare -p diffarr'' would output ''declare -a diffarr=([0]="ff" [1]="aa" [2]="bb")'', correctly storing the array elements.\\
\\
**Alternative Bash Loop Implementation:**\\
A more traditional approach involves explicit loops and functions:\\
<code>
dup_check() {
  local _a; IFS="," read -ra _a <<< "$1";
  for i in ${_a[@]}; do
    [[ "$i" == "$2" ]] && return 0;
  done
  return 1
}
 
arr_diff_func() {
  local -n arr1=$1 arr2=$2 diff=$3
  diff=()
  for i in "${arr1[@]}"; do
    ! dup_check "${arr2[*]}" "$i" && diff+=("$i")
  done
  for i in "${arr2[@]}"; do
    ! dup_check "${arr1[*]}" "$i" && diff+=("$i")
  done
} 
 
arr_diff=()
arr_diff_func arr1 arr2 arr_diff
 
echo "${arr_diff[@]}"  # Output: aa bb ff
</code>
\\
**Conclusion.**\\
Finding the difference between two arrays in Bash efficiently requires understanding how arrays are handled in shell scripts. By leveraging command substitutions properly, using awk for more complex comparisons, or implementing comprehensive functions, you can ensure feature-rich and robust Bash scripts.
Ken's Lotto Syndicate

User Tools

Site Tools

Page Tools
