I assume it's been sitting all winter? The valve guide seals are probably just dry and shrank a bit. When you let off the throttle is when the engine generates high cylinder/manifold vacuum, and oil will get sucked into the cylinder past the valve guide seals. Not to worry.