Mask edges in After Effects have white/black edges

[ssjenforcer191191191]

I have made masks and am trying to composite objects behind other objects, but I am getting white border edges between one object and the mask edge of the object it is being put behind.

Other instances, I have a black border around an object.

What would cause this or fix it?

 

 

[ssjenforcer191191191 · Accepted solution]

 The edge is even more noticeable in Resolve.

I just realized that I rendered the mask after I had already rendered the beauty pass, and so I set the samples low so I wouldn't have to wait a full day to get the full beauty sample image.

Could a low sample effect the mask edge quality enough to cause this?
I think I only had samples set to 1 or 2 for GPU render just for the mask render.

EDIT:
I confirm after doing a high sample render that the bad mask was a result of using too low of samples, which gave aliased edges.

[lee_griggs]

>Could a low sample effect the mask edge quality enough to cause this?

Yes, you should use the same Camera (AA) settings for both to avoid these kinds of issues.