First, have you properly primed your bottle to eliminate any dust in the filter? If not, refer to your manual and complete or repeat the priming step.

If the taste persists, here is a little tip to remove the odor. Take the container (without the straw or filter), fill it partially with white vinegar (about 1/5 to 1/3 of its capacity) and top it up with hot water. Let it sit overnight, rinse thoroughly, and then let it dry. As it dries, vinegar has the unique ability to remove odors (including its own).