Relative-zeta and Casimir energy for a semitransparent hyperplane selecting transverse modes