100 calories snack before bed = bad?

Well, im on a diet and i eat around 1200-1300 calories everyday, exercise and so on. but i sometimes let myself eat an apple or drink a gl of nonfat milk before bed. i dont go over my calorie limit. But does that still affect weight loss?