Maybe you could generate the Interop assembly yourself, instead of adding a reference to the type library, using tlbimp.exe?
"The Type Library Importer utility (tlbimp.exe) is a command line tool that reads COM type information (typically contained in *.tlb, *.dll or *.exe files) and generates a corresponding .NET interop assembly."