Non excisable unit can supply excisable goods without excise duty

Dear All, Kindly clarify me If a company is a non-excisable unit. They want to supply material paying without excise duty. But another supplier supply the same material paying excise duty. We are purchaser. Can we received the material both the parties. Is there is any problem in future for us.