Guys I cannot for the life of me figure out how to vertically align the images in this section.

Option: 2 Add below CSS in style.css file.

.et_pb_image {
  height: 100%;
}
.et_pb_image_wrap {
  height: 100%;
}
.et_pb_image_wrap img {
  height: 100%;
}

I hope it'll resolve your issue, Thank You