Generally persistent bad breath is accompanies by a bad taste in the mouth. It is usually a warning of gum or periodontal disease. When plaque is allowed to accumulate on teeth, bacteria will grow to the point that they will form toxins. These toxins will then irritate the gums. If left untreated, it will result in serious problems with not only the gums, but the underlying bone structure as well.