My headcanon says that this used to have a plastic window instead, until someone pointed out that having a plastic window in packaging of paper straws is ridiculous, so they decided to remove it. A package redesign without a window was also proposed, but was rejected for budgetary reasons.