I am seeking your opinion about feeding non Muslims as I have a lot of friends and neighbors who are not Muslims. Is there any evidence proving this issue?

Evidence from Qur'an
God Almighty says, "And they give food in spite of love for it to the needy, the orphan, and the captive, [Saying], "We feed you only for the countenance of God. We wish not from you reward or gratitude." (Qur'an 76: 8-9) The captives are always from among the disbelievers.

Evidence from Sunnah

the Prophet (peace and blessings be upon him) said, "O people, provide food, maintain the ties of your kinship, spread peace and stand in prayer at night when others are sleeping, you will be peacefully granted the abode of Paradise [Jannah]."
The Prophet words are addresses to the generality of people which means feeding and exchanging food in general.