Probing the Model Limitations of the Age Determination of Solar-like Oscillators from Space Photometry and Ground-based Spectroscopy