To avoid this, try grinding your dried herbs less. They should be a coarse grind, not too finely ground, to minimize the sediment and smaller herb particles from slipping through the holes in the herb pod. To further avoid any sediment in your infusion, wrap a thin layer of cheesecloth over the opening of the container you drain your infusion into to catch any remaining sediment/herb particles.