In this work we investigated the geometric phases of a qubit-oscillator system beyond the conventional rotating- wave approximation. We find that in the limiting of weak coupling the results coincide with that obtained under rotating-wave approximation while there exists an increasing difference with the increase of coupling constant. It was shown that the geometric phase is symmetric with respect to the sign of the detuning of the quantized field from the one-photon resonance under the conventional rotating-wave approximation while a red-blue detuning asymmetry occurs beyond the conventional rotating-wave approximation.
