Can't remember name of this movie!

This is driving me nuts. There is a movie about a woman with children who lives near a navy base. Her son keeps getting on the military radio and they send someone out to investigate. It is a comedy. In the end, the son ends up floating on balloons across the city and she has to make the sos call herself. I think it is Doris Day or similar actress, from that era, but can't find it anywhere! I want my son to see it . . . it is a really cute comedy!